[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:56:26.574528   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:32877
I20260709 12:56:26.576207   431 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:56:26.577607   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:26.596972   437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:26.598511   431 server_base.cc:1061] running on GCE node
W20260709 12:56:26.597004   438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:26.597936   440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:27.713462   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:27.713750   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:27.713914   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601787713896 us; error 0 us; skew 500 ppm
I20260709 12:56:27.714771   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:27.720794   431 webserver.cc:533] Webserver started at http://127.0.107.254:42021/ using document root <none> and password file <none>
I20260709 12:56:27.721697   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:27.721912   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:27.722337   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:27.728309   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601786404416-431-0/minicluster-data/master-0-root/instance:
uuid: "cb6e45bcc6fc4eca826301423f339f8f"
format_stamp: "Formatted at 2026-07-09 12:56:27 on dist-test-slave-6j4g"
I20260709 12:56:27.736863   431 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:56:27.742751   446 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:27.744043   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:56:27.744421   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601786404416-431-0/minicluster-data/master-0-root
uuid: "cb6e45bcc6fc4eca826301423f339f8f"
format_stamp: "Formatted at 2026-07-09 12:56:27 on dist-test-slave-6j4g"
I20260709 12:56:27.744778   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601786404416-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601786404416-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601786404416-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:27.810488   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:27.812088   431 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:56:27.812590   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:27.895803   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:32877
I20260709 12:56:27.895881   497 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:32877 every 8 connection(s)
I20260709 12:56:27.904312   498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:27.927759   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb6e45bcc6fc4eca826301423f339f8f: Bootstrap starting.
I20260709 12:56:27.934114   498 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb6e45bcc6fc4eca826301423f339f8f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:27.936041   498 log.cc:826] T 00000000000000000000000000000000 P cb6e45bcc6fc4eca826301423f339f8f: Log is configured to *not* fsync() on all Append() calls
I20260709 12:56:27.940979   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb6e45bcc6fc4eca826301423f339f8f: No bootstrap required, opened a new log
I20260709 12:56:27.962309   498 raft_consensus.cc:359] T 00000000000000000000000000000000 P cb6e45bcc6fc4eca826301423f339f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb6e45bcc6fc4eca826301423f339f8f" member_type: VOTER }
I20260709 12:56:27.962878   498 raft_consensus.cc:385] T 00000000000000000000000000000000 P cb6e45bcc6fc4eca826301423f339f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:27.963138   498 raft_consensus.cc:740] T 00000000000000000000000000000000 P cb6e45bcc6fc4eca826301423f339f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb6e45bcc6fc4eca826301423f339f8f, State: Initialized, Role: FOLLOWER
I20260709 12:56:27.964119   498 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb6e45bcc6fc4eca826301423f339f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb6e45bcc6fc4eca826301423f339f8f" member_type: VOTER }
I20260709 12:56:27.964658   498 raft_consensus.cc:399] T 00000000000000000000000000000000 P cb6e45bcc6fc4eca826301423f339f8f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:56:27.964928   498 raft_consensus.cc:493] T 00000000000000000000000000000000 P cb6e45bcc6fc4eca826301423f339f8f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:56:27.965725   498 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cb6e45bcc6fc4eca826301423f339f8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:27.969847   498 raft_consensus.cc:515] T 00000000000000000000000000000000 P cb6e45bcc6fc4eca826301423f339f8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb6e45bcc6fc4eca826301423f339f8f" member_type: VOTER }
I20260709 12:56:27.970610   498 leader_election.cc:304] T 00000000000000000000000000000000 P cb6e45bcc6fc4eca826301423f339f8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb6e45bcc6fc4eca826301423f339f8f; no voters: 
I20260709 12:56:27.972766   498 leader_election.cc:290] T 00000000000000000000000000000000 P cb6e45bcc6fc4eca826301423f339f8f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:56:27.973066   501 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cb6e45bcc6fc4eca826301423f339f8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:27.976151   501 raft_consensus.cc:697] T 00000000000000000000000000000000 P cb6e45bcc6fc4eca826301423f339f8f [term 1 LEADER]: Becoming Leader. State: Replica: cb6e45bcc6fc4eca826301423f339f8f, State: Running, Role: LEADER
I20260709 12:56:27.977087   501 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb6e45bcc6fc4eca826301423f339f8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb6e45bcc6fc4eca826301423f339f8f" member_type: VOTER }
I20260709 12:56:27.978564   498 sys_catalog.cc:565] T 00000000000000000000000000000000 P cb6e45bcc6fc4eca826301423f339f8f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:56:27.990090   503 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb6e45bcc6fc4eca826301423f339f8f [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb6e45bcc6fc4eca826301423f339f8f. Latest consensus state: current_term: 1 leader_uuid: "cb6e45bcc6fc4eca826301423f339f8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb6e45bcc6fc4eca826301423f339f8f" member_type: VOTER } }
I20260709 12:56:27.990818   503 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb6e45bcc6fc4eca826301423f339f8f [sys.catalog]: This master's current role is: LEADER
I20260709 12:56:27.991357   502 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb6e45bcc6fc4eca826301423f339f8f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cb6e45bcc6fc4eca826301423f339f8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb6e45bcc6fc4eca826301423f339f8f" member_type: VOTER } }
I20260709 12:56:27.992012   502 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb6e45bcc6fc4eca826301423f339f8f [sys.catalog]: This master's current role is: LEADER
I20260709 12:56:27.994978   511 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:56:28.008572   511 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:56:28.011232   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:56:28.026827   511 catalog_manager.cc:1383] Generated new cluster ID: 88a95c61c7134a38be3cee7c52427f67
I20260709 12:56:28.027151   511 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:56:28.064982   511 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:56:28.066563   511 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:56:28.082201   511 catalog_manager.cc:6070] T 00000000000000000000000000000000 P cb6e45bcc6fc4eca826301423f339f8f: Generated new TSK 0
I20260709 12:56:28.083230   511 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:56:28.142895   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:28.154023   520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:28.156021   521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:28.159569   523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:28.159632   431 server_base.cc:1061] running on GCE node
I20260709 12:56:28.160832   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:28.161125   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:28.161348   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601788161326 us; error 0 us; skew 500 ppm
I20260709 12:56:28.162161   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:28.166759   431 webserver.cc:533] Webserver started at http://127.0.107.193:40545/ using document root <none> and password file <none>
I20260709 12:56:28.167490   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:28.167748   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:28.168095   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:28.169647   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601786404416-431-0/minicluster-data/ts-0-root/instance:
uuid: "fe9806f22d144af29384514ba001d2d4"
format_stamp: "Formatted at 2026-07-09 12:56:28 on dist-test-slave-6j4g"
I20260709 12:56:28.177160   431 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:56:28.182391   528 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:28.183323   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.001s
I20260709 12:56:28.183705   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601786404416-431-0/minicluster-data/ts-0-root
uuid: "fe9806f22d144af29384514ba001d2d4"
format_stamp: "Formatted at 2026-07-09 12:56:28 on dist-test-slave-6j4g"
I20260709 12:56:28.184015   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601786404416-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601786404416-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601786404416-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:28.216387   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:28.218235   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:28.220779   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:56:28.225190   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:56:28.225453   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:28.225698   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:56:28.225859   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:28.341347   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:43439
I20260709 12:56:28.341501   590 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:43439 every 8 connection(s)
I20260709 12:56:28.349427   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:28.360421   595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:28.364884   596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:28.370509   431 server_base.cc:1061] running on GCE node
W20260709 12:56:28.371939   598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:28.372926   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:28.373150   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:28.373332   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601788373311 us; error 0 us; skew 500 ppm
I20260709 12:56:28.373914   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:28.376938   431 webserver.cc:533] Webserver started at http://127.0.107.194:43945/ using document root <none> and password file <none>
I20260709 12:56:28.377502   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:28.377756   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:28.378095   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:28.379570   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601786404416-431-0/minicluster-data/ts-1-root/instance:
uuid: "82d3861d62814827a7586acb0678fa9e"
format_stamp: "Formatted at 2026-07-09 12:56:28 on dist-test-slave-6j4g"
I20260709 12:56:28.382853   591 heartbeater.cc:344] Connected to a master server at 127.0.107.254:32877
I20260709 12:56:28.383358   591 heartbeater.cc:461] Registering TS with master...
I20260709 12:56:28.384696   591 heartbeater.cc:507] Master 127.0.107.254:32877 requested a full tablet report, sending...
I20260709 12:56:28.390147   463 ts_manager.cc:194] Registered new tserver with Master: fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439)
I20260709 12:56:28.391242   431 fs_manager.cc:696] Time spent creating directory manager: real 0.011s	user 0.010s	sys 0.004s
I20260709 12:56:28.393312   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49758
I20260709 12:56:28.396679   603 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:28.398559   431 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:56:28.398918   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601786404416-431-0/minicluster-data/ts-1-root
uuid: "82d3861d62814827a7586acb0678fa9e"
format_stamp: "Formatted at 2026-07-09 12:56:28 on dist-test-slave-6j4g"
I20260709 12:56:28.399286   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601786404416-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601786404416-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601786404416-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:28.424172   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:28.425957   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:28.428953   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:56:28.432636   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:56:28.432922   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:28.433215   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:56:28.433427   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:28.531109   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:38585
I20260709 12:56:28.531268   665 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:38585 every 8 connection(s)
I20260709 12:56:28.537420   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:28.551192   669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:28.554364   666 heartbeater.cc:344] Connected to a master server at 127.0.107.254:32877
I20260709 12:56:28.554797   666 heartbeater.cc:461] Registering TS with master...
I20260709 12:56:28.556272   666 heartbeater.cc:507] Master 127.0.107.254:32877 requested a full tablet report, sending...
W20260709 12:56:28.557480   670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:28.558610   463 ts_manager.cc:194] Registered new tserver with Master: 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585)
I20260709 12:56:28.560314   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49766
W20260709 12:56:28.566083   672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:28.566138   431 server_base.cc:1061] running on GCE node
I20260709 12:56:28.567360   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:28.567584   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:28.567761   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601788567743 us; error 0 us; skew 500 ppm
I20260709 12:56:28.568298   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:28.571022   431 webserver.cc:533] Webserver started at http://127.0.107.195:33351/ using document root <none> and password file <none>
I20260709 12:56:28.571518   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:28.571724   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:28.571972   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:28.573117   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601786404416-431-0/minicluster-data/ts-2-root/instance:
uuid: "2e26e357812d44c9bad12d473db3306b"
format_stamp: "Formatted at 2026-07-09 12:56:28 on dist-test-slave-6j4g"
I20260709 12:56:28.578076   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:56:28.582428   677 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:28.583532   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 12:56:28.583976   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601786404416-431-0/minicluster-data/ts-2-root
uuid: "2e26e357812d44c9bad12d473db3306b"
format_stamp: "Formatted at 2026-07-09 12:56:28 on dist-test-slave-6j4g"
I20260709 12:56:28.584381   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601786404416-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601786404416-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601786404416-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:28.624279   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:28.625945   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:28.627828   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:56:28.631466   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:56:28.631762   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:28.632046   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:56:28.632247   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:28.737869   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:44181
I20260709 12:56:28.737960   739 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:44181 every 8 connection(s)
I20260709 12:56:28.754912   740 heartbeater.cc:344] Connected to a master server at 127.0.107.254:32877
I20260709 12:56:28.755344   740 heartbeater.cc:461] Registering TS with master...
I20260709 12:56:28.756322   740 heartbeater.cc:507] Master 127.0.107.254:32877 requested a full tablet report, sending...
I20260709 12:56:28.758582   463 ts_manager.cc:194] Registered new tserver with Master: 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181)
I20260709 12:56:28.759402   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016319854s
I20260709 12:56:28.760712   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49774
I20260709 12:56:28.813946   463 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49776:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:56:28.817975   463 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:56:28.918814   704 tablet_service.cc:1511] Processing CreateTablet for tablet 04215ecc92554a7bb3332444a559c47c (DEFAULT_TABLE table=test-workload [id=b9fa3cc8da6a4bfd8b4ba05b6e613259]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:56:28.921392   705 tablet_service.cc:1511] Processing CreateTablet for tablet 91b8fadcbfdf4933bce1377d15368cdc (DEFAULT_TABLE table=test-workload [id=b9fa3cc8da6a4bfd8b4ba05b6e613259]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:56:28.918926   703 tablet_service.cc:1511] Processing CreateTablet for tablet d82dd01702a84abbb12318c0e15834cc (DEFAULT_TABLE table=test-workload [id=b9fa3cc8da6a4bfd8b4ba05b6e613259]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:56:28.926048   704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04215ecc92554a7bb3332444a559c47c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:28.935858   705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91b8fadcbfdf4933bce1377d15368cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:28.936890   703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d82dd01702a84abbb12318c0e15834cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:28.948447   702 tablet_service.cc:1511] Processing CreateTablet for tablet 8b55b3ab63c24942989e4100662226df (DEFAULT_TABLE table=test-workload [id=b9fa3cc8da6a4bfd8b4ba05b6e613259]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:56:28.952703   702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b55b3ab63c24942989e4100662226df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:28.968436   701 tablet_service.cc:1511] Processing CreateTablet for tablet de0fb96d164d4382b82fddda59cf8855 (DEFAULT_TABLE table=test-workload [id=b9fa3cc8da6a4bfd8b4ba05b6e613259]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:56:28.971935   701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de0fb96d164d4382b82fddda59cf8855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:28.977290   631 tablet_service.cc:1511] Processing CreateTablet for tablet 91b8fadcbfdf4933bce1377d15368cdc (DEFAULT_TABLE table=test-workload [id=b9fa3cc8da6a4bfd8b4ba05b6e613259]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:56:28.980232   629 tablet_service.cc:1511] Processing CreateTablet for tablet d82dd01702a84abbb12318c0e15834cc (DEFAULT_TABLE table=test-workload [id=b9fa3cc8da6a4bfd8b4ba05b6e613259]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:56:28.980110   628 tablet_service.cc:1511] Processing CreateTablet for tablet 8b55b3ab63c24942989e4100662226df (DEFAULT_TABLE table=test-workload [id=b9fa3cc8da6a4bfd8b4ba05b6e613259]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:56:28.986346   757 tablet_bootstrap.cc:492] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b: Bootstrap starting.
I20260709 12:56:28.986327   630 tablet_service.cc:1511] Processing CreateTablet for tablet 04215ecc92554a7bb3332444a559c47c (DEFAULT_TABLE table=test-workload [id=b9fa3cc8da6a4bfd8b4ba05b6e613259]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:56:28.986354   627 tablet_service.cc:1511] Processing CreateTablet for tablet de0fb96d164d4382b82fddda59cf8855 (DEFAULT_TABLE table=test-workload [id=b9fa3cc8da6a4bfd8b4ba05b6e613259]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:56:28.988790   556 tablet_service.cc:1511] Processing CreateTablet for tablet 91b8fadcbfdf4933bce1377d15368cdc (DEFAULT_TABLE table=test-workload [id=b9fa3cc8da6a4bfd8b4ba05b6e613259]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:56:28.988178   631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91b8fadcbfdf4933bce1377d15368cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:28.993233   555 tablet_service.cc:1511] Processing CreateTablet for tablet 04215ecc92554a7bb3332444a559c47c (DEFAULT_TABLE table=test-workload [id=b9fa3cc8da6a4bfd8b4ba05b6e613259]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:56:29.003859   556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91b8fadcbfdf4933bce1377d15368cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:29.001660   629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d82dd01702a84abbb12318c0e15834cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:29.003152   626 tablet_service.cc:1511] Processing CreateTablet for tablet d751bf3a15f945229b3d72b84a7a3865 (DEFAULT_TABLE table=test-workload [id=b9fa3cc8da6a4bfd8b4ba05b6e613259]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:56:29.005057   554 tablet_service.cc:1511] Processing CreateTablet for tablet d82dd01702a84abbb12318c0e15834cc (DEFAULT_TABLE table=test-workload [id=b9fa3cc8da6a4bfd8b4ba05b6e613259]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:56:29.011059   555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04215ecc92554a7bb3332444a559c47c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:29.014638   551 tablet_service.cc:1511] Processing CreateTablet for tablet d751bf3a15f945229b3d72b84a7a3865 (DEFAULT_TABLE table=test-workload [id=b9fa3cc8da6a4bfd8b4ba05b6e613259]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:56:29.010224   553 tablet_service.cc:1511] Processing CreateTablet for tablet 8b55b3ab63c24942989e4100662226df (DEFAULT_TABLE table=test-workload [id=b9fa3cc8da6a4bfd8b4ba05b6e613259]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:56:29.017869   627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de0fb96d164d4382b82fddda59cf8855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:29.018887   552 tablet_service.cc:1511] Processing CreateTablet for tablet de0fb96d164d4382b82fddda59cf8855 (DEFAULT_TABLE table=test-workload [id=b9fa3cc8da6a4bfd8b4ba05b6e613259]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:56:29.019999   626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d751bf3a15f945229b3d72b84a7a3865. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:56:29.025027   510 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:56:29.025720   554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d82dd01702a84abbb12318c0e15834cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:29.029094   553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b55b3ab63c24942989e4100662226df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:29.030458   552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de0fb96d164d4382b82fddda59cf8855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:29.033614   628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b55b3ab63c24942989e4100662226df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:29.020905   704 tablet_service.cc:1511] Processing CreateTablet for tablet d751bf3a15f945229b3d72b84a7a3865 (DEFAULT_TABLE table=test-workload [id=b9fa3cc8da6a4bfd8b4ba05b6e613259]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:56:29.033142   551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d751bf3a15f945229b3d72b84a7a3865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:29.035801   704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d751bf3a15f945229b3d72b84a7a3865. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:29.039587   630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04215ecc92554a7bb3332444a559c47c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:29.091140   550 tablet_service.cc:1511] Processing CreateTablet for tablet 8e4df88c96044b37844d6b1a2cbdd9e2 (DEFAULT_TABLE table=test-workload [id=b9fa3cc8da6a4bfd8b4ba05b6e613259]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:56:29.093968   550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e4df88c96044b37844d6b1a2cbdd9e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:29.097720   625 tablet_service.cc:1511] Processing CreateTablet for tablet 8e4df88c96044b37844d6b1a2cbdd9e2 (DEFAULT_TABLE table=test-workload [id=b9fa3cc8da6a4bfd8b4ba05b6e613259]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:56:29.099907   625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e4df88c96044b37844d6b1a2cbdd9e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:29.119241   703 tablet_service.cc:1511] Processing CreateTablet for tablet 8e4df88c96044b37844d6b1a2cbdd9e2 (DEFAULT_TABLE table=test-workload [id=b9fa3cc8da6a4bfd8b4ba05b6e613259]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:56:29.120621   703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e4df88c96044b37844d6b1a2cbdd9e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:29.121377   549 tablet_service.cc:1511] Processing CreateTablet for tablet 714d0e00fb34431780779b1ed2911bce (DEFAULT_TABLE table=test-workload [id=b9fa3cc8da6a4bfd8b4ba05b6e613259]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:56:29.124964   549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 714d0e00fb34431780779b1ed2911bce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:29.136853   624 tablet_service.cc:1511] Processing CreateTablet for tablet 714d0e00fb34431780779b1ed2911bce (DEFAULT_TABLE table=test-workload [id=b9fa3cc8da6a4bfd8b4ba05b6e613259]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:56:29.138118   757 tablet_bootstrap.cc:654] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:29.138296   624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 714d0e00fb34431780779b1ed2911bce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:29.157927   758 tablet_bootstrap.cc:492] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4: Bootstrap starting.
I20260709 12:56:29.159077   704 tablet_service.cc:1511] Processing CreateTablet for tablet 714d0e00fb34431780779b1ed2911bce (DEFAULT_TABLE table=test-workload [id=b9fa3cc8da6a4bfd8b4ba05b6e613259]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:56:29.161257   704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 714d0e00fb34431780779b1ed2911bce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:29.181902   554 tablet_service.cc:1511] Processing CreateTablet for tablet c89bd3c22b614793b48964055d767959 (DEFAULT_TABLE table=test-workload [id=b9fa3cc8da6a4bfd8b4ba05b6e613259]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:56:29.183118   554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c89bd3c22b614793b48964055d767959. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:29.213848   623 tablet_service.cc:1511] Processing CreateTablet for tablet c89bd3c22b614793b48964055d767959 (DEFAULT_TABLE table=test-workload [id=b9fa3cc8da6a4bfd8b4ba05b6e613259]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:56:29.218955   701 tablet_service.cc:1511] Processing CreateTablet for tablet c89bd3c22b614793b48964055d767959 (DEFAULT_TABLE table=test-workload [id=b9fa3cc8da6a4bfd8b4ba05b6e613259]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:56:29.220319   701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c89bd3c22b614793b48964055d767959. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:29.216392   623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c89bd3c22b614793b48964055d767959. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:29.233173   757 tablet_bootstrap.cc:492] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b: No bootstrap required, opened a new log
I20260709 12:56:29.233722   757 ts_tablet_manager.cc:1403] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b: Time spent bootstrapping tablet: real 0.254s	user 0.021s	sys 0.010s
I20260709 12:56:29.239620   760 tablet_bootstrap.cc:492] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e: Bootstrap starting.
I20260709 12:56:29.258630   760 tablet_bootstrap.cc:654] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:29.253800   757 raft_consensus.cc:359] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.263666   757 raft_consensus.cc:385] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:29.264020   757 raft_consensus.cc:740] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e26e357812d44c9bad12d473db3306b, State: Initialized, Role: FOLLOWER
I20260709 12:56:29.267153   757 consensus_queue.cc:260] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.270732   758 tablet_bootstrap.cc:654] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:29.283954   740 heartbeater.cc:499] Master 127.0.107.254:32877 was elected leader, sending a full tablet report...
I20260709 12:56:29.284435   757 ts_tablet_manager.cc:1434] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b: Time spent starting tablet: real 0.050s	user 0.010s	sys 0.009s
I20260709 12:56:29.285460   757 tablet_bootstrap.cc:492] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b: Bootstrap starting.
I20260709 12:56:29.292011   757 tablet_bootstrap.cc:654] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:29.316949   760 tablet_bootstrap.cc:492] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e: No bootstrap required, opened a new log
I20260709 12:56:29.317461   760 ts_tablet_manager.cc:1403] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e: Time spent bootstrapping tablet: real 0.079s	user 0.010s	sys 0.032s
I20260709 12:56:29.322062   760 raft_consensus.cc:359] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.322839   760 raft_consensus.cc:385] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:29.323158   760 raft_consensus.cc:740] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82d3861d62814827a7586acb0678fa9e, State: Initialized, Role: FOLLOWER
I20260709 12:56:29.323890   760 consensus_queue.cc:260] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.324716   757 tablet_bootstrap.cc:492] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b: No bootstrap required, opened a new log
I20260709 12:56:29.325553   757 ts_tablet_manager.cc:1403] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.011s
I20260709 12:56:29.326952   758 tablet_bootstrap.cc:492] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4: No bootstrap required, opened a new log
I20260709 12:56:29.329044   758 ts_tablet_manager.cc:1403] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4: Time spent bootstrapping tablet: real 0.173s	user 0.009s	sys 0.015s
I20260709 12:56:29.332343   758 raft_consensus.cc:359] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.329700   757 raft_consensus.cc:359] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.333166   758 raft_consensus.cc:385] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:29.333300   757 raft_consensus.cc:385] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:29.333530   758 raft_consensus.cc:740] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9806f22d144af29384514ba001d2d4, State: Initialized, Role: FOLLOWER
I20260709 12:56:29.333726   757 raft_consensus.cc:740] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e26e357812d44c9bad12d473db3306b, State: Initialized, Role: FOLLOWER
I20260709 12:56:29.334522   758 consensus_queue.cc:260] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.334770   757 consensus_queue.cc:260] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.338271   666 heartbeater.cc:499] Master 127.0.107.254:32877 was elected leader, sending a full tablet report...
I20260709 12:56:29.341001   757 ts_tablet_manager.cc:1434] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
I20260709 12:56:29.353822   591 heartbeater.cc:499] Master 127.0.107.254:32877 was elected leader, sending a full tablet report...
I20260709 12:56:29.353828   760 ts_tablet_manager.cc:1434] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.003s
I20260709 12:56:29.354300   758 ts_tablet_manager.cc:1434] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.017s
I20260709 12:56:29.355269   760 tablet_bootstrap.cc:492] T 04215ecc92554a7bb3332444a559c47c P 82d3861d62814827a7586acb0678fa9e: Bootstrap starting.
I20260709 12:56:29.356930   757 tablet_bootstrap.cc:492] T d751bf3a15f945229b3d72b84a7a3865 P 2e26e357812d44c9bad12d473db3306b: Bootstrap starting.
I20260709 12:56:29.364135   757 tablet_bootstrap.cc:654] T d751bf3a15f945229b3d72b84a7a3865 P 2e26e357812d44c9bad12d473db3306b: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:29.364729   760 tablet_bootstrap.cc:654] T 04215ecc92554a7bb3332444a559c47c P 82d3861d62814827a7586acb0678fa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:29.371994   758 tablet_bootstrap.cc:492] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4: Bootstrap starting.
I20260709 12:56:29.377000   760 tablet_bootstrap.cc:492] T 04215ecc92554a7bb3332444a559c47c P 82d3861d62814827a7586acb0678fa9e: No bootstrap required, opened a new log
I20260709 12:56:29.377559   760 ts_tablet_manager.cc:1403] T 04215ecc92554a7bb3332444a559c47c P 82d3861d62814827a7586acb0678fa9e: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.008s
I20260709 12:56:29.379683   758 tablet_bootstrap.cc:654] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:29.382997   757 tablet_bootstrap.cc:492] T d751bf3a15f945229b3d72b84a7a3865 P 2e26e357812d44c9bad12d473db3306b: No bootstrap required, opened a new log
I20260709 12:56:29.383667   757 ts_tablet_manager.cc:1403] T d751bf3a15f945229b3d72b84a7a3865 P 2e26e357812d44c9bad12d473db3306b: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.005s
I20260709 12:56:29.384766   760 raft_consensus.cc:359] T 04215ecc92554a7bb3332444a559c47c P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.387984   760 raft_consensus.cc:385] T 04215ecc92554a7bb3332444a559c47c P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:29.388350   760 raft_consensus.cc:740] T 04215ecc92554a7bb3332444a559c47c P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82d3861d62814827a7586acb0678fa9e, State: Initialized, Role: FOLLOWER
I20260709 12:56:29.389194   760 consensus_queue.cc:260] T 04215ecc92554a7bb3332444a559c47c P 82d3861d62814827a7586acb0678fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.387080   757 raft_consensus.cc:359] T d751bf3a15f945229b3d72b84a7a3865 P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.392797   757 raft_consensus.cc:385] T d751bf3a15f945229b3d72b84a7a3865 P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:29.393204   757 raft_consensus.cc:740] T d751bf3a15f945229b3d72b84a7a3865 P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e26e357812d44c9bad12d473db3306b, State: Initialized, Role: FOLLOWER
I20260709 12:56:29.394028   757 consensus_queue.cc:260] T d751bf3a15f945229b3d72b84a7a3865 P 2e26e357812d44c9bad12d473db3306b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.396603   760 ts_tablet_manager.cc:1434] T 04215ecc92554a7bb3332444a559c47c P 82d3861d62814827a7586acb0678fa9e: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:56:29.397598   757 ts_tablet_manager.cc:1434] T d751bf3a15f945229b3d72b84a7a3865 P 2e26e357812d44c9bad12d473db3306b: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:56:29.398537   757 tablet_bootstrap.cc:492] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b: Bootstrap starting.
I20260709 12:56:29.405978   760 tablet_bootstrap.cc:492] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e: Bootstrap starting.
I20260709 12:56:29.407008   758 tablet_bootstrap.cc:492] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4: No bootstrap required, opened a new log
I20260709 12:56:29.407498   757 tablet_bootstrap.cc:654] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:29.407873   758 ts_tablet_manager.cc:1403] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.016s
I20260709 12:56:29.413483   758 raft_consensus.cc:359] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.414631   760 tablet_bootstrap.cc:654] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:29.414619   758 raft_consensus.cc:385] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:29.415238   758 raft_consensus.cc:740] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9806f22d144af29384514ba001d2d4, State: Initialized, Role: FOLLOWER
I20260709 12:56:29.416007   758 consensus_queue.cc:260] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.418416   758 ts_tablet_manager.cc:1434] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.006s
I20260709 12:56:29.419490   758 tablet_bootstrap.cc:492] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4: Bootstrap starting.
I20260709 12:56:29.422154   757 tablet_bootstrap.cc:492] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b: No bootstrap required, opened a new log
I20260709 12:56:29.422830   757 ts_tablet_manager.cc:1403] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.006s
I20260709 12:56:29.426268   757 raft_consensus.cc:359] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } } peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } }
I20260709 12:56:29.426924   758 tablet_bootstrap.cc:654] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:29.427009   757 raft_consensus.cc:385] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:29.427449   757 raft_consensus.cc:740] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e26e357812d44c9bad12d473db3306b, State: Initialized, Role: FOLLOWER
I20260709 12:56:29.428187   757 consensus_queue.cc:260] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } } peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } }
I20260709 12:56:29.429880   761 raft_consensus.cc:493] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:29.430332   761 raft_consensus.cc:515] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } } peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } }
I20260709 12:56:29.433218   761 leader_election.cc:290] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439), 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585)
I20260709 12:56:29.442178   757 ts_tablet_manager.cc:1434] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.004s
I20260709 12:56:29.443274   757 tablet_bootstrap.cc:492] T 8b55b3ab63c24942989e4100662226df P 2e26e357812d44c9bad12d473db3306b: Bootstrap starting.
I20260709 12:56:29.454766   757 tablet_bootstrap.cc:654] T 8b55b3ab63c24942989e4100662226df P 2e26e357812d44c9bad12d473db3306b: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:29.463048   758 tablet_bootstrap.cc:492] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4: No bootstrap required, opened a new log
I20260709 12:56:29.463483   758 ts_tablet_manager.cc:1403] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.009s
I20260709 12:56:29.466218   758 raft_consensus.cc:359] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.467958   758 raft_consensus.cc:385] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:29.468355   758 raft_consensus.cc:740] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9806f22d144af29384514ba001d2d4, State: Initialized, Role: FOLLOWER
I20260709 12:56:29.469211   758 consensus_queue.cc:260] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.471555   760 tablet_bootstrap.cc:492] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e: No bootstrap required, opened a new log
I20260709 12:56:29.472047   760 ts_tablet_manager.cc:1403] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e: Time spent bootstrapping tablet: real 0.066s	user 0.016s	sys 0.005s
I20260709 12:56:29.473997   758 ts_tablet_manager.cc:1434] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:56:29.475085   758 tablet_bootstrap.cc:492] T 714d0e00fb34431780779b1ed2911bce P fe9806f22d144af29384514ba001d2d4: Bootstrap starting.
I20260709 12:56:29.474900   760 raft_consensus.cc:359] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.475631   760 raft_consensus.cc:385] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:29.475988   760 raft_consensus.cc:740] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82d3861d62814827a7586acb0678fa9e, State: Initialized, Role: FOLLOWER
I20260709 12:56:29.476871   760 consensus_queue.cc:260] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.482385   760 ts_tablet_manager.cc:1434] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:56:29.483367   760 tablet_bootstrap.cc:492] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e: Bootstrap starting.
I20260709 12:56:29.486481   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b8fadcbfdf4933bce1377d15368cdc" candidate_uuid: "2e26e357812d44c9bad12d473db3306b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9806f22d144af29384514ba001d2d4" is_pre_election: true
W20260709 12:56:29.488591   679 leader_election.cc:343] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:29.495230   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b8fadcbfdf4933bce1377d15368cdc" candidate_uuid: "2e26e357812d44c9bad12d473db3306b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d3861d62814827a7586acb0678fa9e" is_pre_election: true
W20260709 12:56:29.496866   679 leader_election.cc:343] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:29.497488   757 tablet_bootstrap.cc:492] T 8b55b3ab63c24942989e4100662226df P 2e26e357812d44c9bad12d473db3306b: No bootstrap required, opened a new log
I20260709 12:56:29.497486   679 leader_election.cc:304] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e26e357812d44c9bad12d473db3306b; no voters: 82d3861d62814827a7586acb0678fa9e, fe9806f22d144af29384514ba001d2d4
I20260709 12:56:29.498136   757 ts_tablet_manager.cc:1403] T 8b55b3ab63c24942989e4100662226df P 2e26e357812d44c9bad12d473db3306b: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.012s
W20260709 12:56:29.498428   741 tablet.cc:2406] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:56:29.498822   761 raft_consensus.cc:2749] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:29.500764   758 tablet_bootstrap.cc:654] T 714d0e00fb34431780779b1ed2911bce P fe9806f22d144af29384514ba001d2d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:29.502032   760 tablet_bootstrap.cc:654] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:29.505581   757 raft_consensus.cc:359] T 8b55b3ab63c24942989e4100662226df P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.506606   757 raft_consensus.cc:385] T 8b55b3ab63c24942989e4100662226df P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:29.507030   757 raft_consensus.cc:740] T 8b55b3ab63c24942989e4100662226df P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e26e357812d44c9bad12d473db3306b, State: Initialized, Role: FOLLOWER
I20260709 12:56:29.508049   757 consensus_queue.cc:260] T 8b55b3ab63c24942989e4100662226df P 2e26e357812d44c9bad12d473db3306b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.510922   757 ts_tablet_manager.cc:1434] T 8b55b3ab63c24942989e4100662226df P 2e26e357812d44c9bad12d473db3306b: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 12:56:29.512055   757 tablet_bootstrap.cc:492] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b: Bootstrap starting.
I20260709 12:56:29.513717   760 tablet_bootstrap.cc:492] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e: No bootstrap required, opened a new log
I20260709 12:56:29.514238   760 ts_tablet_manager.cc:1403] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e: Time spent bootstrapping tablet: real 0.031s	user 0.006s	sys 0.010s
I20260709 12:56:29.514463   765 raft_consensus.cc:493] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:29.514954   765 raft_consensus.cc:515] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.518090   765 leader_election.cc:290] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439), 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181)
I20260709 12:56:29.517802   760 raft_consensus.cc:359] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } } peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } }
I20260709 12:56:29.519801   760 raft_consensus.cc:385] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:29.521157   760 raft_consensus.cc:740] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82d3861d62814827a7586acb0678fa9e, State: Initialized, Role: FOLLOWER
I20260709 12:56:29.522313   760 consensus_queue.cc:260] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } } peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } }
I20260709 12:56:29.530951   758 tablet_bootstrap.cc:492] T 714d0e00fb34431780779b1ed2911bce P fe9806f22d144af29384514ba001d2d4: No bootstrap required, opened a new log
I20260709 12:56:29.531952   760 ts_tablet_manager.cc:1434] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.004s
I20260709 12:56:29.531863   758 ts_tablet_manager.cc:1403] T 714d0e00fb34431780779b1ed2911bce P fe9806f22d144af29384514ba001d2d4: Time spent bootstrapping tablet: real 0.057s	user 0.010s	sys 0.010s
I20260709 12:56:29.534575   760 tablet_bootstrap.cc:492] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e: Bootstrap starting.
I20260709 12:56:29.538614   758 raft_consensus.cc:359] T 714d0e00fb34431780779b1ed2911bce P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.541466   758 raft_consensus.cc:385] T 714d0e00fb34431780779b1ed2911bce P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:29.543334   761 raft_consensus.cc:493] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:29.543689   757 tablet_bootstrap.cc:654] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:29.544100   761 raft_consensus.cc:515] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.543421   758 raft_consensus.cc:740] T 714d0e00fb34431780779b1ed2911bce P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9806f22d144af29384514ba001d2d4, State: Initialized, Role: FOLLOWER
I20260709 12:56:29.549289   761 leader_election.cc:290] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439), 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585)
I20260709 12:56:29.550081   758 consensus_queue.cc:260] T 714d0e00fb34431780779b1ed2911bce P fe9806f22d144af29384514ba001d2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.552057   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82dd01702a84abbb12318c0e15834cc" candidate_uuid: "2e26e357812d44c9bad12d473db3306b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d3861d62814827a7586acb0678fa9e" is_pre_election: true
I20260709 12:56:29.552569   758 ts_tablet_manager.cc:1434] T 714d0e00fb34431780779b1ed2911bce P fe9806f22d144af29384514ba001d2d4: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.002s
I20260709 12:56:29.550753   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82dd01702a84abbb12318c0e15834cc" candidate_uuid: "2e26e357812d44c9bad12d473db3306b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9806f22d144af29384514ba001d2d4" is_pre_election: true
I20260709 12:56:29.553483   758 tablet_bootstrap.cc:492] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4: Bootstrap starting.
I20260709 12:56:29.553735   566 raft_consensus.cc:2468] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e26e357812d44c9bad12d473db3306b in term 0.
I20260709 12:56:29.555990   760 tablet_bootstrap.cc:654] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e: Neither blocks nor log segments found. Creating new log.
W20260709 12:56:29.556150   679 leader_election.cc:343] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:29.557165   679 leader_election.cc:304] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e26e357812d44c9bad12d473db3306b, fe9806f22d144af29384514ba001d2d4; no voters: 82d3861d62814827a7586acb0678fa9e
I20260709 12:56:29.559248   761 raft_consensus.cc:2804] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:29.559650   761 raft_consensus.cc:493] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:29.560010   761 raft_consensus.cc:3060] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:29.569180   761 raft_consensus.cc:515] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.571269   761 leader_election.cc:290] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 1 election: Requested vote from peers fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439), 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585)
I20260709 12:56:29.573467   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82dd01702a84abbb12318c0e15834cc" candidate_uuid: "2e26e357812d44c9bad12d473db3306b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9806f22d144af29384514ba001d2d4"
I20260709 12:56:29.573696   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82dd01702a84abbb12318c0e15834cc" candidate_uuid: "2e26e357812d44c9bad12d473db3306b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d3861d62814827a7586acb0678fa9e"
I20260709 12:56:29.574154   566 raft_consensus.cc:3060] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:29.575135   679 leader_election.cc:343] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:29.575634   758 tablet_bootstrap.cc:654] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:29.586251   566 raft_consensus.cc:2468] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e26e357812d44c9bad12d473db3306b in term 1.
I20260709 12:56:29.589046   679 leader_election.cc:304] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e26e357812d44c9bad12d473db3306b, fe9806f22d144af29384514ba001d2d4; no voters: 82d3861d62814827a7586acb0678fa9e
I20260709 12:56:29.590116   761 raft_consensus.cc:2804] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:29.590726   761 raft_consensus.cc:697] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [term 1 LEADER]: Becoming Leader. State: Replica: 2e26e357812d44c9bad12d473db3306b, State: Running, Role: LEADER
I20260709 12:56:29.591672   761 consensus_queue.cc:237] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.597163   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d751bf3a15f945229b3d72b84a7a3865" candidate_uuid: "82d3861d62814827a7586acb0678fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e26e357812d44c9bad12d473db3306b" is_pre_election: true
I20260709 12:56:29.598182   715 raft_consensus.cc:2468] T d751bf3a15f945229b3d72b84a7a3865 P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82d3861d62814827a7586acb0678fa9e in term 0.
I20260709 12:56:29.599946   606 leader_election.cc:304] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e26e357812d44c9bad12d473db3306b, 82d3861d62814827a7586acb0678fa9e; no voters: 
I20260709 12:56:29.600322   760 tablet_bootstrap.cc:492] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e: No bootstrap required, opened a new log
I20260709 12:56:29.601346   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d751bf3a15f945229b3d72b84a7a3865" candidate_uuid: "82d3861d62814827a7586acb0678fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9806f22d144af29384514ba001d2d4" is_pre_election: true
I20260709 12:56:29.600647   757 tablet_bootstrap.cc:492] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b: No bootstrap required, opened a new log
I20260709 12:56:29.600946   765 raft_consensus.cc:2804] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:29.602406   757 ts_tablet_manager.cc:1403] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b: Time spent bootstrapping tablet: real 0.091s	user 0.015s	sys 0.002s
I20260709 12:56:29.602185   765 raft_consensus.cc:493] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:29.601759   760 ts_tablet_manager.cc:1403] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e: Time spent bootstrapping tablet: real 0.067s	user 0.018s	sys 0.010s
I20260709 12:56:29.603657   765 raft_consensus.cc:3060] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:29.604781   605 leader_election.cc:343] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:29.607363   758 tablet_bootstrap.cc:492] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4: No bootstrap required, opened a new log
I20260709 12:56:29.608114   758 ts_tablet_manager.cc:1403] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4: Time spent bootstrapping tablet: real 0.055s	user 0.015s	sys 0.004s
I20260709 12:56:29.610697   757 raft_consensus.cc:359] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.611662   757 raft_consensus.cc:385] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:29.612064   757 raft_consensus.cc:740] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e26e357812d44c9bad12d473db3306b, State: Initialized, Role: FOLLOWER
I20260709 12:56:29.612993   757 consensus_queue.cc:260] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.613612   765 raft_consensus.cc:515] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.617955   765 leader_election.cc:290] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 1 election: Requested vote from peers fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439), 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181)
I20260709 12:56:29.619334   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d751bf3a15f945229b3d72b84a7a3865" candidate_uuid: "82d3861d62814827a7586acb0678fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9806f22d144af29384514ba001d2d4"
I20260709 12:56:29.619802   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d751bf3a15f945229b3d72b84a7a3865" candidate_uuid: "82d3861d62814827a7586acb0678fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e26e357812d44c9bad12d473db3306b"
I20260709 12:56:29.620625   757 ts_tablet_manager.cc:1434] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 12:56:29.620683   715 raft_consensus.cc:3060] T d751bf3a15f945229b3d72b84a7a3865 P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:29.622124   605 leader_election.cc:343] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:29.618445   760 raft_consensus.cc:359] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.623817   760 raft_consensus.cc:385] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:29.622370   757 tablet_bootstrap.cc:492] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 2e26e357812d44c9bad12d473db3306b: Bootstrap starting.
I20260709 12:56:29.624334   760 raft_consensus.cc:740] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82d3861d62814827a7586acb0678fa9e, State: Initialized, Role: FOLLOWER
I20260709 12:56:29.627019   760 consensus_queue.cc:260] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.631431   760 ts_tablet_manager.cc:1434] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 12:56:29.633149   760 tablet_bootstrap.cc:492] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e: Bootstrap starting.
I20260709 12:56:29.636121   757 tablet_bootstrap.cc:654] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 2e26e357812d44c9bad12d473db3306b: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:29.638434   715 raft_consensus.cc:2468] T d751bf3a15f945229b3d72b84a7a3865 P 2e26e357812d44c9bad12d473db3306b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82d3861d62814827a7586acb0678fa9e in term 1.
I20260709 12:56:29.640518   606 leader_election.cc:304] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e26e357812d44c9bad12d473db3306b, 82d3861d62814827a7586acb0678fa9e; no voters: fe9806f22d144af29384514ba001d2d4
I20260709 12:56:29.642530   765 raft_consensus.cc:2804] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:29.641522   461 catalog_manager.cc:5697] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e26e357812d44c9bad12d473db3306b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2e26e357812d44c9bad12d473db3306b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:29.648644   765 raft_consensus.cc:697] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [term 1 LEADER]: Becoming Leader. State: Replica: 82d3861d62814827a7586acb0678fa9e, State: Running, Role: LEADER
I20260709 12:56:29.649720   765 consensus_queue.cc:237] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.645783   758 raft_consensus.cc:359] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } } peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } }
I20260709 12:56:29.650920   758 raft_consensus.cc:385] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:29.651260   758 raft_consensus.cc:740] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9806f22d144af29384514ba001d2d4, State: Initialized, Role: FOLLOWER
I20260709 12:56:29.652137   760 tablet_bootstrap.cc:654] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:29.652001   758 consensus_queue.cc:260] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } } peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } }
I20260709 12:56:29.653538   761 raft_consensus.cc:493] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:29.654022   761 raft_consensus.cc:515] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.654803   758 ts_tablet_manager.cc:1434] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 12:56:29.655800   758 tablet_bootstrap.cc:492] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4: Bootstrap starting.
I20260709 12:56:29.656715   761 leader_election.cc:290] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439), 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585)
I20260709 12:56:29.657021   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04215ecc92554a7bb3332444a559c47c" candidate_uuid: "2e26e357812d44c9bad12d473db3306b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9806f22d144af29384514ba001d2d4" is_pre_election: true
I20260709 12:56:29.657672   566 raft_consensus.cc:2468] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e26e357812d44c9bad12d473db3306b in term 0.
I20260709 12:56:29.658658   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04215ecc92554a7bb3332444a559c47c" candidate_uuid: "2e26e357812d44c9bad12d473db3306b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d3861d62814827a7586acb0678fa9e" is_pre_election: true
I20260709 12:56:29.659332   641 raft_consensus.cc:2468] T 04215ecc92554a7bb3332444a559c47c P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e26e357812d44c9bad12d473db3306b in term 0.
I20260709 12:56:29.660821   679 leader_election.cc:304] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e26e357812d44c9bad12d473db3306b, fe9806f22d144af29384514ba001d2d4; no voters: 
I20260709 12:56:29.661669   761 raft_consensus.cc:2804] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:29.662103   761 raft_consensus.cc:493] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:29.662467   761 raft_consensus.cc:3060] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:29.664440   786 raft_consensus.cc:493] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:29.665401   786 raft_consensus.cc:515] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.668646   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0fb96d164d4382b82fddda59cf8855" candidate_uuid: "82d3861d62814827a7586acb0678fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9806f22d144af29384514ba001d2d4" is_pre_election: true
W20260709 12:56:29.670022   605 leader_election.cc:343] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:29.670339   758 tablet_bootstrap.cc:654] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:29.670527   761 raft_consensus.cc:515] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.684932   760 tablet_bootstrap.cc:492] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e: No bootstrap required, opened a new log
I20260709 12:56:29.685348   760 ts_tablet_manager.cc:1403] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.009s
I20260709 12:56:29.685451   757 tablet_bootstrap.cc:492] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 2e26e357812d44c9bad12d473db3306b: No bootstrap required, opened a new log
I20260709 12:56:29.685951   757 ts_tablet_manager.cc:1403] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 2e26e357812d44c9bad12d473db3306b: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.009s
I20260709 12:56:29.687848   771 raft_consensus.cc:493] T 8b55b3ab63c24942989e4100662226df P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:29.688112   760 raft_consensus.cc:359] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.688372   771 raft_consensus.cc:515] T 8b55b3ab63c24942989e4100662226df P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.688855   760 raft_consensus.cc:385] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:29.689157   760 raft_consensus.cc:740] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82d3861d62814827a7586acb0678fa9e, State: Initialized, Role: FOLLOWER
I20260709 12:56:29.689744   757 raft_consensus.cc:359] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.689872   760 consensus_queue.cc:260] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.690528   757 raft_consensus.cc:385] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:29.690732   771 leader_election.cc:290] T 8b55b3ab63c24942989e4100662226df P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439), 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585)
I20260709 12:56:29.690887   757 raft_consensus.cc:740] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e26e357812d44c9bad12d473db3306b, State: Initialized, Role: FOLLOWER
I20260709 12:56:29.691808   757 consensus_queue.cc:260] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 2e26e357812d44c9bad12d473db3306b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.682727   786 leader_election.cc:290] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439), 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181)
I20260709 12:56:29.695062   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55b3ab63c24942989e4100662226df" candidate_uuid: "2e26e357812d44c9bad12d473db3306b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9806f22d144af29384514ba001d2d4" is_pre_election: true
I20260709 12:56:29.695386   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55b3ab63c24942989e4100662226df" candidate_uuid: "2e26e357812d44c9bad12d473db3306b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d3861d62814827a7586acb0678fa9e" is_pre_election: true
I20260709 12:56:29.695062   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0fb96d164d4382b82fddda59cf8855" candidate_uuid: "82d3861d62814827a7586acb0678fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e26e357812d44c9bad12d473db3306b" is_pre_election: true
I20260709 12:56:29.698722   715 raft_consensus.cc:2468] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82d3861d62814827a7586acb0678fa9e in term 0.
I20260709 12:56:29.702747   463 catalog_manager.cc:5697] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 82d3861d62814827a7586acb0678fa9e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "82d3861d62814827a7586acb0678fa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:29.704371   761 leader_election.cc:290] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 1 election: Requested vote from peers fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439), 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585)
I20260709 12:56:29.705036   606 leader_election.cc:304] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e26e357812d44c9bad12d473db3306b, 82d3861d62814827a7586acb0678fa9e; no voters: fe9806f22d144af29384514ba001d2d4
I20260709 12:56:29.710476   757 ts_tablet_manager.cc:1434] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 2e26e357812d44c9bad12d473db3306b: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.005s
I20260709 12:56:29.711730   757 tablet_bootstrap.cc:492] T 714d0e00fb34431780779b1ed2911bce P 2e26e357812d44c9bad12d473db3306b: Bootstrap starting.
I20260709 12:56:29.701063   771 raft_consensus.cc:493] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:29.712329   771 raft_consensus.cc:515] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.714551   771 leader_election.cc:290] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439), 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585)
I20260709 12:56:29.717013   786 raft_consensus.cc:493] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:29.717130   765 raft_consensus.cc:2804] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:29.721182   765 raft_consensus.cc:493] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:29.721220   786 raft_consensus.cc:515] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.721833   765 raft_consensus.cc:3060] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:29.724031   786 leader_election.cc:290] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439), 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181)
I20260709 12:56:29.724985   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "714d0e00fb34431780779b1ed2911bce" candidate_uuid: "82d3861d62814827a7586acb0678fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9806f22d144af29384514ba001d2d4" is_pre_election: true
I20260709 12:56:29.725648   566 raft_consensus.cc:2468] T 714d0e00fb34431780779b1ed2911bce P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82d3861d62814827a7586acb0678fa9e in term 0.
I20260709 12:56:29.726449   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "714d0e00fb34431780779b1ed2911bce" candidate_uuid: "82d3861d62814827a7586acb0678fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e26e357812d44c9bad12d473db3306b" is_pre_election: true
I20260709 12:56:29.727962   605 leader_election.cc:304] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82d3861d62814827a7586acb0678fa9e, fe9806f22d144af29384514ba001d2d4; no voters: 
I20260709 12:56:29.729035   786 raft_consensus.cc:2804] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:56:29.729153   606 leader_election.cc:343] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:29.729415   786 raft_consensus.cc:493] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:29.729770   786 raft_consensus.cc:3060] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:29.731622   760 ts_tablet_manager.cc:1434] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.008s
I20260709 12:56:29.735702   760 tablet_bootstrap.cc:492] T 8b55b3ab63c24942989e4100662226df P 82d3861d62814827a7586acb0678fa9e: Bootstrap starting.
I20260709 12:56:29.740398   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04215ecc92554a7bb3332444a559c47c" candidate_uuid: "2e26e357812d44c9bad12d473db3306b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9806f22d144af29384514ba001d2d4"
I20260709 12:56:29.741108   566 raft_consensus.cc:3060] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:29.738103   765 raft_consensus.cc:515] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.745951   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04215ecc92554a7bb3332444a559c47c" candidate_uuid: "2e26e357812d44c9bad12d473db3306b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d3861d62814827a7586acb0678fa9e"
I20260709 12:56:29.746315   765 leader_election.cc:290] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 1 election: Requested vote from peers fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439), 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181)
I20260709 12:56:29.746665   641 raft_consensus.cc:3060] T 04215ecc92554a7bb3332444a559c47c P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:29.746985   758 tablet_bootstrap.cc:492] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4: No bootstrap required, opened a new log
I20260709 12:56:29.747852   758 ts_tablet_manager.cc:1403] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.010s
I20260709 12:56:29.749279   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0fb96d164d4382b82fddda59cf8855" candidate_uuid: "82d3861d62814827a7586acb0678fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9806f22d144af29384514ba001d2d4"
I20260709 12:56:29.747980   786 raft_consensus.cc:515] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.755616   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0fb96d164d4382b82fddda59cf8855" candidate_uuid: "2e26e357812d44c9bad12d473db3306b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9806f22d144af29384514ba001d2d4" is_pre_election: true
W20260709 12:56:29.756235   605 leader_election.cc:343] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:29.749310   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0fb96d164d4382b82fddda59cf8855" candidate_uuid: "82d3861d62814827a7586acb0678fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e26e357812d44c9bad12d473db3306b"
I20260709 12:56:29.757185   715 raft_consensus.cc:3060] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:29.762823   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "714d0e00fb34431780779b1ed2911bce" candidate_uuid: "82d3861d62814827a7586acb0678fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9806f22d144af29384514ba001d2d4"
I20260709 12:56:29.762732   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "714d0e00fb34431780779b1ed2911bce" candidate_uuid: "82d3861d62814827a7586acb0678fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e26e357812d44c9bad12d473db3306b"
I20260709 12:56:29.763707   565 raft_consensus.cc:3060] T 714d0e00fb34431780779b1ed2911bce P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:29.764988   606 leader_election.cc:343] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:29.761914   786 leader_election.cc:290] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 1 election: Requested vote from peers fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439), 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181)
I20260709 12:56:29.766156   641 raft_consensus.cc:2468] T 04215ecc92554a7bb3332444a559c47c P 82d3861d62814827a7586acb0678fa9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e26e357812d44c9bad12d473db3306b in term 1.
I20260709 12:56:29.767146   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0fb96d164d4382b82fddda59cf8855" candidate_uuid: "2e26e357812d44c9bad12d473db3306b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d3861d62814827a7586acb0678fa9e" is_pre_election: true
I20260709 12:56:29.770351   640 raft_consensus.cc:2393] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e26e357812d44c9bad12d473db3306b in current term 1: Already voted for candidate 82d3861d62814827a7586acb0678fa9e in this term.
I20260709 12:56:29.772156   766 raft_consensus.cc:493] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:29.772704   766 raft_consensus.cc:515] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.777830   715 raft_consensus.cc:2468] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82d3861d62814827a7586acb0678fa9e in term 1.
I20260709 12:56:29.779526   606 leader_election.cc:304] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e26e357812d44c9bad12d473db3306b, 82d3861d62814827a7586acb0678fa9e; no voters: fe9806f22d144af29384514ba001d2d4
I20260709 12:56:29.780772   786 raft_consensus.cc:2804] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:29.784657   786 raft_consensus.cc:697] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [term 1 LEADER]: Becoming Leader. State: Replica: 82d3861d62814827a7586acb0678fa9e, State: Running, Role: LEADER
W20260709 12:56:29.769361   679 leader_election.cc:343] T 8b55b3ab63c24942989e4100662226df P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:29.788882   760 tablet_bootstrap.cc:654] T 8b55b3ab63c24942989e4100662226df P 82d3861d62814827a7586acb0678fa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:29.785631   566 raft_consensus.cc:2468] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e26e357812d44c9bad12d473db3306b in term 1.
I20260709 12:56:29.785485   786 consensus_queue.cc:237] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.789775   766 leader_election.cc:290] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585), 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181)
I20260709 12:56:29.793136   757 tablet_bootstrap.cc:654] T 714d0e00fb34431780779b1ed2911bce P 2e26e357812d44c9bad12d473db3306b: Neither blocks nor log segments found. Creating new log.
W20260709 12:56:29.792059   679 leader_election.cc:343] T 8b55b3ab63c24942989e4100662226df P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:29.799309   679 leader_election.cc:304] T 8b55b3ab63c24942989e4100662226df P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e26e357812d44c9bad12d473db3306b; no voters: 82d3861d62814827a7586acb0678fa9e, fe9806f22d144af29384514ba001d2d4
I20260709 12:56:29.808110   793 raft_consensus.cc:2749] T 8b55b3ab63c24942989e4100662226df P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:56:29.808391   679 leader_election.cc:343] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:29.810568   679 leader_election.cc:304] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e26e357812d44c9bad12d473db3306b, fe9806f22d144af29384514ba001d2d4; no voters: 
I20260709 12:56:29.813151   793 raft_consensus.cc:2804] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:29.813834   793 raft_consensus.cc:697] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [term 1 LEADER]: Becoming Leader. State: Replica: 2e26e357812d44c9bad12d473db3306b, State: Running, Role: LEADER
I20260709 12:56:29.812211   679 leader_election.cc:304] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e26e357812d44c9bad12d473db3306b; no voters: 82d3861d62814827a7586acb0678fa9e, fe9806f22d144af29384514ba001d2d4
I20260709 12:56:29.808943   565 raft_consensus.cc:2468] T 714d0e00fb34431780779b1ed2911bce P fe9806f22d144af29384514ba001d2d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82d3861d62814827a7586acb0678fa9e in term 1.
I20260709 12:56:29.815757   761 raft_consensus.cc:2749] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:29.815063   793 consensus_queue.cc:237] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.819235   758 raft_consensus.cc:359] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.822289   758 raft_consensus.cc:385] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:29.823282   758 raft_consensus.cc:740] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9806f22d144af29384514ba001d2d4, State: Initialized, Role: FOLLOWER
I20260709 12:56:29.829887   605 leader_election.cc:304] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82d3861d62814827a7586acb0678fa9e, fe9806f22d144af29384514ba001d2d4; no voters: 2e26e357812d44c9bad12d473db3306b
I20260709 12:56:29.831084   765 raft_consensus.cc:2804] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:29.828845   758 consensus_queue.cc:260] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.831616   765 raft_consensus.cc:697] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [term 1 LEADER]: Becoming Leader. State: Replica: 82d3861d62814827a7586acb0678fa9e, State: Running, Role: LEADER
I20260709 12:56:29.833506   766 raft_consensus.cc:493] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:29.834028   765 consensus_queue.cc:237] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.834215   766 raft_consensus.cc:515] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.836249   766 leader_election.cc:290] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585), 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181)
I20260709 12:56:29.842895   758 ts_tablet_manager.cc:1434] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4: Time spent starting tablet: real 0.088s	user 0.006s	sys 0.004s
I20260709 12:56:29.844048   758 tablet_bootstrap.cc:492] T d751bf3a15f945229b3d72b84a7a3865 P fe9806f22d144af29384514ba001d2d4: Bootstrap starting.
I20260709 12:56:29.855754   766 raft_consensus.cc:493] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:29.857102   766 raft_consensus.cc:515] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } } peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } }
I20260709 12:56:29.863469   757 tablet_bootstrap.cc:492] T 714d0e00fb34431780779b1ed2911bce P 2e26e357812d44c9bad12d473db3306b: No bootstrap required, opened a new log
I20260709 12:56:29.864604   757 ts_tablet_manager.cc:1403] T 714d0e00fb34431780779b1ed2911bce P 2e26e357812d44c9bad12d473db3306b: Time spent bootstrapping tablet: real 0.153s	user 0.006s	sys 0.013s
I20260709 12:56:29.865329   463 catalog_manager.cc:5697] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 82d3861d62814827a7586acb0678fa9e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "82d3861d62814827a7586acb0678fa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:29.864080   766 leader_election.cc:290] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181), 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585)
I20260709 12:56:29.871979   757 raft_consensus.cc:359] T 714d0e00fb34431780779b1ed2911bce P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.872751   757 raft_consensus.cc:385] T 714d0e00fb34431780779b1ed2911bce P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:29.873016   757 raft_consensus.cc:740] T 714d0e00fb34431780779b1ed2911bce P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e26e357812d44c9bad12d473db3306b, State: Initialized, Role: FOLLOWER
I20260709 12:56:29.873811   757 consensus_queue.cc:260] T 714d0e00fb34431780779b1ed2911bce P 2e26e357812d44c9bad12d473db3306b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.875190   760 tablet_bootstrap.cc:492] T 8b55b3ab63c24942989e4100662226df P 82d3861d62814827a7586acb0678fa9e: No bootstrap required, opened a new log
I20260709 12:56:29.875941   760 ts_tablet_manager.cc:1403] T 8b55b3ab63c24942989e4100662226df P 82d3861d62814827a7586acb0678fa9e: Time spent bootstrapping tablet: real 0.140s	user 0.014s	sys 0.007s
I20260709 12:56:29.874960   461 catalog_manager.cc:5697] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e26e357812d44c9bad12d473db3306b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "2e26e357812d44c9bad12d473db3306b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:29.885047   757 ts_tablet_manager.cc:1434] T 714d0e00fb34431780779b1ed2911bce P 2e26e357812d44c9bad12d473db3306b: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:56:29.886039   757 tablet_bootstrap.cc:492] T c89bd3c22b614793b48964055d767959 P 2e26e357812d44c9bad12d473db3306b: Bootstrap starting.
I20260709 12:56:29.886229   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4df88c96044b37844d6b1a2cbdd9e2" candidate_uuid: "fe9806f22d144af29384514ba001d2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e26e357812d44c9bad12d473db3306b" is_pre_election: true
I20260709 12:56:29.886618   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55b3ab63c24942989e4100662226df" candidate_uuid: "fe9806f22d144af29384514ba001d2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e26e357812d44c9bad12d473db3306b" is_pre_election: true
I20260709 12:56:29.893426   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b8fadcbfdf4933bce1377d15368cdc" candidate_uuid: "fe9806f22d144af29384514ba001d2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d3861d62814827a7586acb0678fa9e" is_pre_election: true
I20260709 12:56:29.921456   715 raft_consensus.cc:2468] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9806f22d144af29384514ba001d2d4 in term 0.
I20260709 12:56:29.922099   639 raft_consensus.cc:2468] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9806f22d144af29384514ba001d2d4 in term 0.
I20260709 12:56:29.909430   463 catalog_manager.cc:5697] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 82d3861d62814827a7586acb0678fa9e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "82d3861d62814827a7586acb0678fa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:29.888727   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b8fadcbfdf4933bce1377d15368cdc" candidate_uuid: "fe9806f22d144af29384514ba001d2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e26e357812d44c9bad12d473db3306b" is_pre_election: true
I20260709 12:56:29.914775   758 tablet_bootstrap.cc:654] T d751bf3a15f945229b3d72b84a7a3865 P fe9806f22d144af29384514ba001d2d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:29.922861   531 leader_election.cc:304] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e26e357812d44c9bad12d473db3306b, fe9806f22d144af29384514ba001d2d4; no voters: 
I20260709 12:56:29.923497   530 leader_election.cc:304] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82d3861d62814827a7586acb0678fa9e, fe9806f22d144af29384514ba001d2d4; no voters: 
I20260709 12:56:29.923977   766 raft_consensus.cc:2804] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:29.924396   766 raft_consensus.cc:493] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:29.924795   766 raft_consensus.cc:3060] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:29.916014   760 raft_consensus.cc:359] T 8b55b3ab63c24942989e4100662226df P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.927000   760 raft_consensus.cc:385] T 8b55b3ab63c24942989e4100662226df P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:29.927281   760 raft_consensus.cc:740] T 8b55b3ab63c24942989e4100662226df P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82d3861d62814827a7586acb0678fa9e, State: Initialized, Role: FOLLOWER
I20260709 12:56:29.928000   760 consensus_queue.cc:260] T 8b55b3ab63c24942989e4100662226df P 82d3861d62814827a7586acb0678fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.929801   713 raft_consensus.cc:2468] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9806f22d144af29384514ba001d2d4 in term 0.
I20260709 12:56:29.933429   760 ts_tablet_manager.cc:1434] T 8b55b3ab63c24942989e4100662226df P 82d3861d62814827a7586acb0678fa9e: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 12:56:29.937160   760 tablet_bootstrap.cc:492] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e: Bootstrap starting.
I20260709 12:56:29.935963   758 tablet_bootstrap.cc:492] T d751bf3a15f945229b3d72b84a7a3865 P fe9806f22d144af29384514ba001d2d4: No bootstrap required, opened a new log
I20260709 12:56:29.947119   714 raft_consensus.cc:2468] T 8b55b3ab63c24942989e4100662226df P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9806f22d144af29384514ba001d2d4 in term 0.
I20260709 12:56:29.947935   758 ts_tablet_manager.cc:1403] T d751bf3a15f945229b3d72b84a7a3865 P fe9806f22d144af29384514ba001d2d4: Time spent bootstrapping tablet: real 0.104s	user 0.007s	sys 0.007s
I20260709 12:56:29.944607   760 tablet_bootstrap.cc:654] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:29.945385   766 raft_consensus.cc:515] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.889593   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4df88c96044b37844d6b1a2cbdd9e2" candidate_uuid: "fe9806f22d144af29384514ba001d2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d3861d62814827a7586acb0678fa9e" is_pre_election: true
I20260709 12:56:29.893288   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55b3ab63c24942989e4100662226df" candidate_uuid: "fe9806f22d144af29384514ba001d2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d3861d62814827a7586acb0678fa9e" is_pre_election: true
I20260709 12:56:29.949308   531 leader_election.cc:304] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e26e357812d44c9bad12d473db3306b, fe9806f22d144af29384514ba001d2d4; no voters: 
I20260709 12:56:29.951684   640 raft_consensus.cc:2468] T 8b55b3ab63c24942989e4100662226df P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9806f22d144af29384514ba001d2d4 in term 0.
I20260709 12:56:29.952687   766 leader_election.cc:290] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [CANDIDATE]: Term 1 election: Requested vote from peers 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585), 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181)
I20260709 12:56:29.953567   766 raft_consensus.cc:2804] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:29.953959   766 raft_consensus.cc:493] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:56:29.954170   530 leader_election.cc:343] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:29.954308   766 raft_consensus.cc:3060] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:29.954478   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4df88c96044b37844d6b1a2cbdd9e2" candidate_uuid: "fe9806f22d144af29384514ba001d2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d3861d62814827a7586acb0678fa9e"
I20260709 12:56:29.955955   757 tablet_bootstrap.cc:654] T c89bd3c22b614793b48964055d767959 P 2e26e357812d44c9bad12d473db3306b: Neither blocks nor log segments found. Creating new log.
W20260709 12:56:29.955894   530 leader_election.cc:343] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:29.958534   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4df88c96044b37844d6b1a2cbdd9e2" candidate_uuid: "fe9806f22d144af29384514ba001d2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e26e357812d44c9bad12d473db3306b"
I20260709 12:56:29.959786   714 raft_consensus.cc:3060] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:29.958379   758 raft_consensus.cc:359] T d751bf3a15f945229b3d72b84a7a3865 P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.962471   758 raft_consensus.cc:385] T d751bf3a15f945229b3d72b84a7a3865 P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:29.962796   758 raft_consensus.cc:740] T d751bf3a15f945229b3d72b84a7a3865 P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9806f22d144af29384514ba001d2d4, State: Initialized, Role: FOLLOWER
I20260709 12:56:29.963518   758 consensus_queue.cc:260] T d751bf3a15f945229b3d72b84a7a3865 P fe9806f22d144af29384514ba001d2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.965848   766 raft_consensus.cc:515] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } } peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } }
I20260709 12:56:29.968094   804 raft_consensus.cc:2804] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:29.968760   804 raft_consensus.cc:493] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:29.969470   766 leader_election.cc:290] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [CANDIDATE]: Term 1 election: Requested vote from peers 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181), 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585)
I20260709 12:56:29.970526   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b8fadcbfdf4933bce1377d15368cdc" candidate_uuid: "fe9806f22d144af29384514ba001d2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e26e357812d44c9bad12d473db3306b"
I20260709 12:56:29.971081   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b8fadcbfdf4933bce1377d15368cdc" candidate_uuid: "fe9806f22d144af29384514ba001d2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d3861d62814827a7586acb0678fa9e"
I20260709 12:56:29.971390   713 raft_consensus.cc:3060] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:29.971663   641 raft_consensus.cc:3060] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:29.970736   804 raft_consensus.cc:3060] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:29.980607   713 raft_consensus.cc:2468] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9806f22d144af29384514ba001d2d4 in term 1.
I20260709 12:56:29.980808   714 raft_consensus.cc:2468] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 2e26e357812d44c9bad12d473db3306b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9806f22d144af29384514ba001d2d4 in term 1.
I20260709 12:56:29.980768   641 raft_consensus.cc:2468] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9806f22d144af29384514ba001d2d4 in term 1.
I20260709 12:56:29.982609   757 tablet_bootstrap.cc:492] T c89bd3c22b614793b48964055d767959 P 2e26e357812d44c9bad12d473db3306b: No bootstrap required, opened a new log
I20260709 12:56:29.982995   757 ts_tablet_manager.cc:1403] T c89bd3c22b614793b48964055d767959 P 2e26e357812d44c9bad12d473db3306b: Time spent bootstrapping tablet: real 0.097s	user 0.006s	sys 0.012s
I20260709 12:56:29.982053   530 leader_election.cc:304] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82d3861d62814827a7586acb0678fa9e, fe9806f22d144af29384514ba001d2d4; no voters: 
I20260709 12:56:29.981986   531 leader_election.cc:304] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e26e357812d44c9bad12d473db3306b, fe9806f22d144af29384514ba001d2d4; no voters: 82d3861d62814827a7586acb0678fa9e
I20260709 12:56:29.986189   766 raft_consensus.cc:2804] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:29.986660   760 tablet_bootstrap.cc:492] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e: No bootstrap required, opened a new log
I20260709 12:56:29.987164   760 ts_tablet_manager.cc:1403] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.003s
I20260709 12:56:29.987735   808 raft_consensus.cc:2804] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:29.988831   758 ts_tablet_manager.cc:1434] T d751bf3a15f945229b3d72b84a7a3865 P fe9806f22d144af29384514ba001d2d4: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.003s
I20260709 12:56:29.990789   758 tablet_bootstrap.cc:492] T de0fb96d164d4382b82fddda59cf8855 P fe9806f22d144af29384514ba001d2d4: Bootstrap starting.
I20260709 12:56:29.988935   766 raft_consensus.cc:697] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [term 1 LEADER]: Becoming Leader. State: Replica: fe9806f22d144af29384514ba001d2d4, State: Running, Role: LEADER
I20260709 12:56:29.991940   760 raft_consensus.cc:359] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.993072   760 raft_consensus.cc:385] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:29.993372   760 raft_consensus.cc:740] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82d3861d62814827a7586acb0678fa9e, State: Initialized, Role: FOLLOWER
I20260709 12:56:29.992653   808 raft_consensus.cc:697] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [term 1 LEADER]: Becoming Leader. State: Replica: fe9806f22d144af29384514ba001d2d4, State: Running, Role: LEADER
I20260709 12:56:29.994292   760 consensus_queue.cc:260] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:29.993850   766 consensus_queue.cc:237] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } } peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } }
I20260709 12:56:29.997671   760 ts_tablet_manager.cc:1434] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:56:29.998502   760 tablet_bootstrap.cc:492] T c89bd3c22b614793b48964055d767959 P 82d3861d62814827a7586acb0678fa9e: Bootstrap starting.
I20260709 12:56:30.004796   757 raft_consensus.cc:359] T c89bd3c22b614793b48964055d767959 P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:30.005595   757 raft_consensus.cc:385] T c89bd3c22b614793b48964055d767959 P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:29.995532   808 consensus_queue.cc:237] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:30.005769   760 tablet_bootstrap.cc:654] T c89bd3c22b614793b48964055d767959 P 82d3861d62814827a7586acb0678fa9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:30.006734   757 raft_consensus.cc:740] T c89bd3c22b614793b48964055d767959 P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e26e357812d44c9bad12d473db3306b, State: Initialized, Role: FOLLOWER
I20260709 12:56:30.010840   757 consensus_queue.cc:260] T c89bd3c22b614793b48964055d767959 P 2e26e357812d44c9bad12d473db3306b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:30.013976   463 catalog_manager.cc:5697] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe9806f22d144af29384514ba001d2d4 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "fe9806f22d144af29384514ba001d2d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:30.015297   804 raft_consensus.cc:515] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:30.029089   758 tablet_bootstrap.cc:654] T de0fb96d164d4382b82fddda59cf8855 P fe9806f22d144af29384514ba001d2d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:30.030584   804 leader_election.cc:290] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4 [CANDIDATE]: Term 1 election: Requested vote from peers 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585), 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181)
I20260709 12:56:30.031124   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55b3ab63c24942989e4100662226df" candidate_uuid: "fe9806f22d144af29384514ba001d2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d3861d62814827a7586acb0678fa9e"
I20260709 12:56:30.031932   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55b3ab63c24942989e4100662226df" candidate_uuid: "fe9806f22d144af29384514ba001d2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e26e357812d44c9bad12d473db3306b"
I20260709 12:56:30.032913   713 raft_consensus.cc:3060] T 8b55b3ab63c24942989e4100662226df P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:30.034267   641 raft_consensus.cc:3060] T 8b55b3ab63c24942989e4100662226df P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:30.030396   757 ts_tablet_manager.cc:1434] T c89bd3c22b614793b48964055d767959 P 2e26e357812d44c9bad12d473db3306b: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.006s
W20260709 12:56:30.040153   510 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:56:30.047144   641 raft_consensus.cc:2468] T 8b55b3ab63c24942989e4100662226df P 82d3861d62814827a7586acb0678fa9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9806f22d144af29384514ba001d2d4 in term 1.
I20260709 12:56:30.047824   793 consensus_queue.cc:1048] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:30.051635   793 raft_consensus.cc:493] T 714d0e00fb34431780779b1ed2911bce P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:30.052387   793 raft_consensus.cc:515] T 714d0e00fb34431780779b1ed2911bce P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:30.053236   530 leader_election.cc:304] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82d3861d62814827a7586acb0678fa9e, fe9806f22d144af29384514ba001d2d4; no voters: 
I20260709 12:56:30.054119   804 raft_consensus.cc:2804] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:30.054615   804 raft_consensus.cc:697] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4 [term 1 LEADER]: Becoming Leader. State: Replica: fe9806f22d144af29384514ba001d2d4, State: Running, Role: LEADER
I20260709 12:56:30.054697   793 leader_election.cc:290] T 714d0e00fb34431780779b1ed2911bce P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439), 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585)
I20260709 12:56:30.055961   804 consensus_queue.cc:237] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:30.058107   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "714d0e00fb34431780779b1ed2911bce" candidate_uuid: "2e26e357812d44c9bad12d473db3306b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9806f22d144af29384514ba001d2d4" is_pre_election: true
I20260709 12:56:30.059126   566 raft_consensus.cc:2393] T 714d0e00fb34431780779b1ed2911bce P fe9806f22d144af29384514ba001d2d4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e26e357812d44c9bad12d473db3306b in current term 1: Already voted for candidate 82d3861d62814827a7586acb0678fa9e in this term.
I20260709 12:56:30.061785   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "714d0e00fb34431780779b1ed2911bce" candidate_uuid: "2e26e357812d44c9bad12d473db3306b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d3861d62814827a7586acb0678fa9e" is_pre_election: true
I20260709 12:56:30.064970   462 catalog_manager.cc:5697] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe9806f22d144af29384514ba001d2d4 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "fe9806f22d144af29384514ba001d2d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:30.069471   760 tablet_bootstrap.cc:492] T c89bd3c22b614793b48964055d767959 P 82d3861d62814827a7586acb0678fa9e: No bootstrap required, opened a new log
I20260709 12:56:30.070050   760 ts_tablet_manager.cc:1403] T c89bd3c22b614793b48964055d767959 P 82d3861d62814827a7586acb0678fa9e: Time spent bootstrapping tablet: real 0.072s	user 0.034s	sys 0.003s
I20260709 12:56:30.077886   713 raft_consensus.cc:2468] T 8b55b3ab63c24942989e4100662226df P 2e26e357812d44c9bad12d473db3306b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9806f22d144af29384514ba001d2d4 in term 1.
I20260709 12:56:30.079800   566 raft_consensus.cc:3060] T d751bf3a15f945229b3d72b84a7a3865 P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:30.085166   765 raft_consensus.cc:493] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:30.084563   679 leader_election.cc:304] T 714d0e00fb34431780779b1ed2911bce P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e26e357812d44c9bad12d473db3306b; no voters: 82d3861d62814827a7586acb0678fa9e, fe9806f22d144af29384514ba001d2d4
I20260709 12:56:30.086114   793 raft_consensus.cc:3060] T 714d0e00fb34431780779b1ed2911bce P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:30.085745   765 raft_consensus.cc:515] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:30.090920   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4df88c96044b37844d6b1a2cbdd9e2" candidate_uuid: "82d3861d62814827a7586acb0678fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9806f22d144af29384514ba001d2d4" is_pre_election: true
I20260709 12:56:30.095034   765 leader_election.cc:290] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439), 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181)
I20260709 12:56:30.100140   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4df88c96044b37844d6b1a2cbdd9e2" candidate_uuid: "82d3861d62814827a7586acb0678fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e26e357812d44c9bad12d473db3306b" is_pre_election: true
I20260709 12:56:30.101699   713 raft_consensus.cc:2393] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 2e26e357812d44c9bad12d473db3306b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 82d3861d62814827a7586acb0678fa9e in current term 1: Already voted for candidate fe9806f22d144af29384514ba001d2d4 in this term.
I20260709 12:56:30.101979   760 raft_consensus.cc:359] T c89bd3c22b614793b48964055d767959 P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:30.102706   760 raft_consensus.cc:385] T c89bd3c22b614793b48964055d767959 P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:30.102672   606 leader_election.cc:304] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82d3861d62814827a7586acb0678fa9e; no voters: 2e26e357812d44c9bad12d473db3306b, fe9806f22d144af29384514ba001d2d4
I20260709 12:56:30.103155   760 raft_consensus.cc:740] T c89bd3c22b614793b48964055d767959 P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82d3861d62814827a7586acb0678fa9e, State: Initialized, Role: FOLLOWER
I20260709 12:56:30.103703   786 consensus_queue.cc:1048] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:30.104622   760 consensus_queue.cc:260] T c89bd3c22b614793b48964055d767959 P 82d3861d62814827a7586acb0678fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:30.104676   793 raft_consensus.cc:2749] T 714d0e00fb34431780779b1ed2911bce P 2e26e357812d44c9bad12d473db3306b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:30.106673   760 ts_tablet_manager.cc:1434] T c89bd3c22b614793b48964055d767959 P 82d3861d62814827a7586acb0678fa9e: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:56:30.107297   765 raft_consensus.cc:3060] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:30.109179   462 catalog_manager.cc:5697] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe9806f22d144af29384514ba001d2d4 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "fe9806f22d144af29384514ba001d2d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:30.117043   765 raft_consensus.cc:2749] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:30.133695   765 raft_consensus.cc:493] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:30.134835   758 tablet_bootstrap.cc:492] T de0fb96d164d4382b82fddda59cf8855 P fe9806f22d144af29384514ba001d2d4: No bootstrap required, opened a new log
I20260709 12:56:30.135363   758 ts_tablet_manager.cc:1403] T de0fb96d164d4382b82fddda59cf8855 P fe9806f22d144af29384514ba001d2d4: Time spent bootstrapping tablet: real 0.145s	user 0.017s	sys 0.012s
I20260709 12:56:30.135103   765 raft_consensus.cc:515] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:30.138759   758 raft_consensus.cc:359] T de0fb96d164d4382b82fddda59cf8855 P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:30.139469   758 raft_consensus.cc:385] T de0fb96d164d4382b82fddda59cf8855 P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:30.139739   758 raft_consensus.cc:740] T de0fb96d164d4382b82fddda59cf8855 P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9806f22d144af29384514ba001d2d4, State: Initialized, Role: FOLLOWER
I20260709 12:56:30.140331   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82dd01702a84abbb12318c0e15834cc" candidate_uuid: "82d3861d62814827a7586acb0678fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9806f22d144af29384514ba001d2d4" is_pre_election: true
I20260709 12:56:30.150921   641 raft_consensus.cc:3060] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:30.153110   765 leader_election.cc:290] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439), 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181)
I20260709 12:56:30.155236   758 consensus_queue.cc:260] T de0fb96d164d4382b82fddda59cf8855 P fe9806f22d144af29384514ba001d2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:30.157712   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82dd01702a84abbb12318c0e15834cc" candidate_uuid: "82d3861d62814827a7586acb0678fa9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e26e357812d44c9bad12d473db3306b" is_pre_election: true
I20260709 12:56:30.159317   606 leader_election.cc:304] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82d3861d62814827a7586acb0678fa9e; no voters: 2e26e357812d44c9bad12d473db3306b, fe9806f22d144af29384514ba001d2d4
I20260709 12:56:30.159694   758 ts_tablet_manager.cc:1434] T de0fb96d164d4382b82fddda59cf8855 P fe9806f22d144af29384514ba001d2d4: Time spent starting tablet: real 0.024s	user 0.013s	sys 0.009s
I20260709 12:56:30.160799   758 tablet_bootstrap.cc:492] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4: Bootstrap starting.
I20260709 12:56:30.161351   765 raft_consensus.cc:2749] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:30.162401   771 consensus_queue.cc:1048] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [LEADER]: Connected to new peer: Peer: permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:30.167438   758 tablet_bootstrap.cc:654] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:30.201872   765 consensus_queue.cc:1048] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:30.204108   758 tablet_bootstrap.cc:492] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4: No bootstrap required, opened a new log
I20260709 12:56:30.204824   758 ts_tablet_manager.cc:1403] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.013s
I20260709 12:56:30.207945   758 raft_consensus.cc:359] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:30.208982   758 raft_consensus.cc:385] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:30.209403   758 raft_consensus.cc:740] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9806f22d144af29384514ba001d2d4, State: Initialized, Role: FOLLOWER
I20260709 12:56:30.210477   758 consensus_queue.cc:260] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:30.213114   758 ts_tablet_manager.cc:1434] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:56:30.223563   804 raft_consensus.cc:493] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:30.224073   804 raft_consensus.cc:515] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:30.226341   804 leader_election.cc:290] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585), 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181)
I20260709 12:56:30.227432   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89bd3c22b614793b48964055d767959" candidate_uuid: "fe9806f22d144af29384514ba001d2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d3861d62814827a7586acb0678fa9e" is_pre_election: true
I20260709 12:56:30.228132   641 raft_consensus.cc:2468] T c89bd3c22b614793b48964055d767959 P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9806f22d144af29384514ba001d2d4 in term 0.
I20260709 12:56:30.228433   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89bd3c22b614793b48964055d767959" candidate_uuid: "fe9806f22d144af29384514ba001d2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e26e357812d44c9bad12d473db3306b" is_pre_election: true
I20260709 12:56:30.229370   530 leader_election.cc:304] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82d3861d62814827a7586acb0678fa9e, fe9806f22d144af29384514ba001d2d4; no voters: 
I20260709 12:56:30.230315   804 raft_consensus.cc:2804] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:30.229341   713 raft_consensus.cc:2468] T c89bd3c22b614793b48964055d767959 P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9806f22d144af29384514ba001d2d4 in term 0.
I20260709 12:56:30.230732   804 raft_consensus.cc:493] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:30.231153   804 raft_consensus.cc:3060] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:30.236466   804 raft_consensus.cc:515] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:30.239166   804 leader_election.cc:290] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4 [CANDIDATE]: Term 1 election: Requested vote from peers 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585), 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181)
I20260709 12:56:30.239406   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89bd3c22b614793b48964055d767959" candidate_uuid: "fe9806f22d144af29384514ba001d2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d3861d62814827a7586acb0678fa9e"
I20260709 12:56:30.239574   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89bd3c22b614793b48964055d767959" candidate_uuid: "fe9806f22d144af29384514ba001d2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e26e357812d44c9bad12d473db3306b"
I20260709 12:56:30.240039   641 raft_consensus.cc:3060] T c89bd3c22b614793b48964055d767959 P 82d3861d62814827a7586acb0678fa9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:30.240187   713 raft_consensus.cc:3060] T c89bd3c22b614793b48964055d767959 P 2e26e357812d44c9bad12d473db3306b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:30.245549   713 raft_consensus.cc:2468] T c89bd3c22b614793b48964055d767959 P 2e26e357812d44c9bad12d473db3306b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9806f22d144af29384514ba001d2d4 in term 1.
I20260709 12:56:30.246735   531 leader_election.cc:304] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e26e357812d44c9bad12d473db3306b, fe9806f22d144af29384514ba001d2d4; no voters: 
I20260709 12:56:30.247013   641 raft_consensus.cc:2468] T c89bd3c22b614793b48964055d767959 P 82d3861d62814827a7586acb0678fa9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9806f22d144af29384514ba001d2d4 in term 1.
I20260709 12:56:30.247538   804 raft_consensus.cc:2804] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:30.248260   804 raft_consensus.cc:697] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4 [term 1 LEADER]: Becoming Leader. State: Replica: fe9806f22d144af29384514ba001d2d4, State: Running, Role: LEADER
I20260709 12:56:30.249527   804 consensus_queue.cc:237] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:30.258019   463 catalog_manager.cc:5697] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe9806f22d144af29384514ba001d2d4 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "fe9806f22d144af29384514ba001d2d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:30.271062   765 consensus_queue.cc:1048] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:30.285082   786 consensus_queue.cc:1048] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:30.297932   771 consensus_queue.cc:1048] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [LEADER]: Connected to new peer: Peer: permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:30.312075   761 consensus_queue.cc:1048] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:30.369521   804 raft_consensus.cc:493] T de0fb96d164d4382b82fddda59cf8855 P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:30.369954   804 raft_consensus.cc:515] T de0fb96d164d4382b82fddda59cf8855 P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:30.371745   804 leader_election.cc:290] T de0fb96d164d4382b82fddda59cf8855 P fe9806f22d144af29384514ba001d2d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585), 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181)
I20260709 12:56:30.372669   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0fb96d164d4382b82fddda59cf8855" candidate_uuid: "fe9806f22d144af29384514ba001d2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82d3861d62814827a7586acb0678fa9e" is_pre_election: true
I20260709 12:56:30.373076   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0fb96d164d4382b82fddda59cf8855" candidate_uuid: "fe9806f22d144af29384514ba001d2d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e26e357812d44c9bad12d473db3306b" is_pre_election: true
I20260709 12:56:30.373799   713 raft_consensus.cc:2393] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe9806f22d144af29384514ba001d2d4 in current term 1: Already voted for candidate 82d3861d62814827a7586acb0678fa9e in this term.
I20260709 12:56:30.374809   530 leader_election.cc:304] T de0fb96d164d4382b82fddda59cf8855 P fe9806f22d144af29384514ba001d2d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe9806f22d144af29384514ba001d2d4; no voters: 2e26e357812d44c9bad12d473db3306b, 82d3861d62814827a7586acb0678fa9e
I20260709 12:56:30.375658   804 raft_consensus.cc:3060] T de0fb96d164d4382b82fddda59cf8855 P fe9806f22d144af29384514ba001d2d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:30.381047   804 raft_consensus.cc:2749] T de0fb96d164d4382b82fddda59cf8855 P fe9806f22d144af29384514ba001d2d4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:30.393453   786 consensus_queue.cc:1048] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:30.406566   765 consensus_queue.cc:1048] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:30.445509   713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04215ecc92554a7bb3332444a559c47c"
dest_uuid: "2e26e357812d44c9bad12d473db3306b"
mode: GRACEFUL
new_leader_uuid: "fe9806f22d144af29384514ba001d2d4"
 from {username='slave'} at 127.0.0.1:48960
I20260709 12:56:30.446784   713 raft_consensus.cc:606] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [term 1 LEADER]: Received request to transfer leadership to TS fe9806f22d144af29384514ba001d2d4
I20260709 12:56:30.452667   713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d82dd01702a84abbb12318c0e15834cc"
dest_uuid: "2e26e357812d44c9bad12d473db3306b"
mode: GRACEFUL
new_leader_uuid: "fe9806f22d144af29384514ba001d2d4"
 from {username='slave'} at 127.0.0.1:48960
I20260709 12:56:30.453301   713 raft_consensus.cc:606] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [term 1 LEADER]: Received request to transfer leadership to TS fe9806f22d144af29384514ba001d2d4
I20260709 12:56:30.476310   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e4df88c96044b37844d6b1a2cbdd9e2"
dest_uuid: "fe9806f22d144af29384514ba001d2d4"
mode: GRACEFUL
new_leader_uuid: "82d3861d62814827a7586acb0678fa9e"
 from {username='slave'} at 127.0.0.1:38232
I20260709 12:56:30.476903   566 raft_consensus.cc:606] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [term 1 LEADER]: Received request to transfer leadership to TS 82d3861d62814827a7586acb0678fa9e
I20260709 12:56:30.487771   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c89bd3c22b614793b48964055d767959"
dest_uuid: "fe9806f22d144af29384514ba001d2d4"
mode: GRACEFUL
new_leader_uuid: "2e26e357812d44c9bad12d473db3306b"
 from {username='slave'} at 127.0.0.1:38232
I20260709 12:56:30.488960   566 raft_consensus.cc:606] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4 [term 1 LEADER]: Received request to transfer leadership to TS 2e26e357812d44c9bad12d473db3306b
I20260709 12:56:30.490487   804 consensus_queue.cc:1048] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:30.500365   808 raft_consensus.cc:993] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4: : Instructing follower 82d3861d62814827a7586acb0678fa9e to start an election
I20260709 12:56:30.501082   766 raft_consensus.cc:1081] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [term 1 LEADER]: Signalling peer 82d3861d62814827a7586acb0678fa9e to start an election
I20260709 12:56:30.507172   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e4df88c96044b37844d6b1a2cbdd9e2"
dest_uuid: "82d3861d62814827a7586acb0678fa9e"
 from {username='slave'} at 127.0.0.1:48704
I20260709 12:56:30.508136   640 raft_consensus.cc:493] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:30.508687   640 raft_consensus.cc:3060] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:30.511547   808 consensus_queue.cc:1048] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:30.519097   808 consensus_queue.cc:1048] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:30.526289   640 raft_consensus.cc:515] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:30.527719   641 raft_consensus.cc:1240] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Rejecting Update request from peer fe9806f22d144af29384514ba001d2d4 for earlier term 1. Current term is 2. Ops: []
I20260709 12:56:30.532320   808 consensus_queue.cc:1059] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:30.533190   766 raft_consensus.cc:3055] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:30.533635   766 raft_consensus.cc:740] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe9806f22d144af29384514ba001d2d4, State: Running, Role: LEADER
I20260709 12:56:30.534650   766 consensus_queue.cc:260] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:30.535750   766 raft_consensus.cc:3060] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:30.536867   808 consensus_queue.cc:1048] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:30.555095   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4df88c96044b37844d6b1a2cbdd9e2" candidate_uuid: "82d3861d62814827a7586acb0678fa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fe9806f22d144af29384514ba001d2d4"
I20260709 12:56:30.570919   640 leader_election.cc:290] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 2 election: Requested vote from peers fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439), 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181)
I20260709 12:56:30.580706   566 raft_consensus.cc:2468] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82d3861d62814827a7586acb0678fa9e in term 2.
I20260709 12:56:30.572093   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4df88c96044b37844d6b1a2cbdd9e2" candidate_uuid: "82d3861d62814827a7586acb0678fa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e26e357812d44c9bad12d473db3306b"
I20260709 12:56:30.586633   605 leader_election.cc:304] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82d3861d62814827a7586acb0678fa9e, fe9806f22d144af29384514ba001d2d4; no voters: 2e26e357812d44c9bad12d473db3306b
I20260709 12:56:30.587558   786 raft_consensus.cc:2804] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:30.588104   786 raft_consensus.cc:697] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [term 2 LEADER]: Becoming Leader. State: Replica: 82d3861d62814827a7586acb0678fa9e, State: Running, Role: LEADER
I20260709 12:56:30.588997   786 consensus_queue.cc:237] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:30.603559   461 catalog_manager.cc:5697] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e reported cstate change: term changed from 1 to 2, leader changed from fe9806f22d144af29384514ba001d2d4 (127.0.107.193) to 82d3861d62814827a7586acb0678fa9e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "82d3861d62814827a7586acb0678fa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:30.621754   804 consensus_queue.cc:1048] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:30.637565   839 consensus_queue.cc:1048] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:30.660456   771 raft_consensus.cc:993] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b: : Instructing follower fe9806f22d144af29384514ba001d2d4 to start an election
I20260709 12:56:30.660912   793 raft_consensus.cc:1081] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [term 1 LEADER]: Signalling peer fe9806f22d144af29384514ba001d2d4 to start an election
I20260709 12:56:30.662930   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d82dd01702a84abbb12318c0e15834cc"
dest_uuid: "fe9806f22d144af29384514ba001d2d4"
 from {username='slave'} at 127.0.0.1:58446
I20260709 12:56:30.663516   566 raft_consensus.cc:493] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:30.663890   566 raft_consensus.cc:3060] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:30.670499   566 raft_consensus.cc:515] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:30.673463   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82dd01702a84abbb12318c0e15834cc" candidate_uuid: "fe9806f22d144af29384514ba001d2d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "82d3861d62814827a7586acb0678fa9e"
I20260709 12:56:30.673134   566 leader_election.cc:290] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 [CANDIDATE]: Term 2 election: Requested vote from peers 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585), 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181)
I20260709 12:56:30.673677   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82dd01702a84abbb12318c0e15834cc" candidate_uuid: "fe9806f22d144af29384514ba001d2d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e26e357812d44c9bad12d473db3306b"
I20260709 12:56:30.674002   640 raft_consensus.cc:3060] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:30.674327   714 raft_consensus.cc:3055] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:30.674677   714 raft_consensus.cc:740] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e26e357812d44c9bad12d473db3306b, State: Running, Role: LEADER
I20260709 12:56:30.676044   714 consensus_queue.cc:260] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:30.677356   714 raft_consensus.cc:3060] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:30.679440   640 raft_consensus.cc:2468] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9806f22d144af29384514ba001d2d4 in term 2.
I20260709 12:56:30.680665   530 leader_election.cc:304] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82d3861d62814827a7586acb0678fa9e, fe9806f22d144af29384514ba001d2d4; no voters: 
I20260709 12:56:30.681329   839 raft_consensus.cc:2804] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:30.681720   839 raft_consensus.cc:697] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 [term 2 LEADER]: Becoming Leader. State: Replica: fe9806f22d144af29384514ba001d2d4, State: Running, Role: LEADER
I20260709 12:56:30.682534   839 consensus_queue.cc:237] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:30.684170   714 raft_consensus.cc:2468] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9806f22d144af29384514ba001d2d4 in term 2.
I20260709 12:56:30.690371   463 catalog_manager.cc:5697] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 reported cstate change: term changed from 1 to 2, leader changed from 2e26e357812d44c9bad12d473db3306b (127.0.107.195) to fe9806f22d144af29384514ba001d2d4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "fe9806f22d144af29384514ba001d2d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:30.708508   793 raft_consensus.cc:993] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b: : Instructing follower fe9806f22d144af29384514ba001d2d4 to start an election
I20260709 12:56:30.708976   793 raft_consensus.cc:1081] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [term 1 LEADER]: Signalling peer fe9806f22d144af29384514ba001d2d4 to start an election
I20260709 12:56:30.710567   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04215ecc92554a7bb3332444a559c47c"
dest_uuid: "fe9806f22d144af29384514ba001d2d4"
 from {username='slave'} at 127.0.0.1:58446
I20260709 12:56:30.711217   566 raft_consensus.cc:493] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:30.711521   566 raft_consensus.cc:3060] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:30.716665   566 raft_consensus.cc:515] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:30.718297   566 leader_election.cc:290] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4 [CANDIDATE]: Term 2 election: Requested vote from peers 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585), 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181)
I20260709 12:56:30.719412   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04215ecc92554a7bb3332444a559c47c" candidate_uuid: "fe9806f22d144af29384514ba001d2d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e26e357812d44c9bad12d473db3306b"
I20260709 12:56:30.719583   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04215ecc92554a7bb3332444a559c47c" candidate_uuid: "fe9806f22d144af29384514ba001d2d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "82d3861d62814827a7586acb0678fa9e"
I20260709 12:56:30.719935   714 raft_consensus.cc:3055] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:30.720186   640 raft_consensus.cc:3060] T 04215ecc92554a7bb3332444a559c47c P 82d3861d62814827a7586acb0678fa9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:30.720288   714 raft_consensus.cc:740] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e26e357812d44c9bad12d473db3306b, State: Running, Role: LEADER
I20260709 12:56:30.721105   714 consensus_queue.cc:260] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:30.721994   714 raft_consensus.cc:3060] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:30.727015   714 raft_consensus.cc:2468] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9806f22d144af29384514ba001d2d4 in term 2.
I20260709 12:56:30.727197   640 raft_consensus.cc:2468] T 04215ecc92554a7bb3332444a559c47c P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9806f22d144af29384514ba001d2d4 in term 2.
I20260709 12:56:30.728318   531 leader_election.cc:304] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e26e357812d44c9bad12d473db3306b, fe9806f22d144af29384514ba001d2d4; no voters: 
I20260709 12:56:30.729189   839 raft_consensus.cc:2804] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:30.729589   839 raft_consensus.cc:697] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4 [term 2 LEADER]: Becoming Leader. State: Replica: fe9806f22d144af29384514ba001d2d4, State: Running, Role: LEADER
I20260709 12:56:30.730264   839 consensus_queue.cc:237] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:30.737969   463 catalog_manager.cc:5697] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4 reported cstate change: term changed from 1 to 2, leader changed from 2e26e357812d44c9bad12d473db3306b (127.0.107.195) to fe9806f22d144af29384514ba001d2d4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "fe9806f22d144af29384514ba001d2d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:30.795261   839 consensus_queue.cc:1048] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:30.806979   808 consensus_queue.cc:1048] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:30.821269   808 raft_consensus.cc:993] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4: : Instructing follower 2e26e357812d44c9bad12d473db3306b to start an election
I20260709 12:56:30.821748   766 raft_consensus.cc:1081] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4 [term 1 LEADER]: Signalling peer 2e26e357812d44c9bad12d473db3306b to start an election
I20260709 12:56:30.824157   713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c89bd3c22b614793b48964055d767959"
dest_uuid: "2e26e357812d44c9bad12d473db3306b"
 from {username='slave'} at 127.0.0.1:53852
I20260709 12:56:30.824811   713 raft_consensus.cc:493] T c89bd3c22b614793b48964055d767959 P 2e26e357812d44c9bad12d473db3306b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:30.825289   713 raft_consensus.cc:3060] T c89bd3c22b614793b48964055d767959 P 2e26e357812d44c9bad12d473db3306b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:30.832618   713 raft_consensus.cc:515] T c89bd3c22b614793b48964055d767959 P 2e26e357812d44c9bad12d473db3306b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:30.834985   713 leader_election.cc:290] T c89bd3c22b614793b48964055d767959 P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 2 election: Requested vote from peers fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439), 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585)
I20260709 12:56:30.836019   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89bd3c22b614793b48964055d767959" candidate_uuid: "2e26e357812d44c9bad12d473db3306b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fe9806f22d144af29384514ba001d2d4"
I20260709 12:56:30.836675   566 raft_consensus.cc:3055] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:30.837010   566 raft_consensus.cc:740] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe9806f22d144af29384514ba001d2d4, State: Running, Role: LEADER
I20260709 12:56:30.837129   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c89bd3c22b614793b48964055d767959" candidate_uuid: "2e26e357812d44c9bad12d473db3306b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "82d3861d62814827a7586acb0678fa9e"
I20260709 12:56:30.837741   640 raft_consensus.cc:3060] T c89bd3c22b614793b48964055d767959 P 82d3861d62814827a7586acb0678fa9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:30.837950   566 consensus_queue.cc:260] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:30.839186   566 raft_consensus.cc:3060] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:30.844663   640 raft_consensus.cc:2468] T c89bd3c22b614793b48964055d767959 P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e26e357812d44c9bad12d473db3306b in term 2.
I20260709 12:56:30.845983   679 leader_election.cc:304] T c89bd3c22b614793b48964055d767959 P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e26e357812d44c9bad12d473db3306b, 82d3861d62814827a7586acb0678fa9e; no voters: 
I20260709 12:56:30.846797   566 raft_consensus.cc:2468] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e26e357812d44c9bad12d473db3306b in term 2.
I20260709 12:56:30.846822   793 raft_consensus.cc:2804] T c89bd3c22b614793b48964055d767959 P 2e26e357812d44c9bad12d473db3306b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:30.847427   793 raft_consensus.cc:697] T c89bd3c22b614793b48964055d767959 P 2e26e357812d44c9bad12d473db3306b [term 2 LEADER]: Becoming Leader. State: Replica: 2e26e357812d44c9bad12d473db3306b, State: Running, Role: LEADER
I20260709 12:56:30.848259   793 consensus_queue.cc:237] T c89bd3c22b614793b48964055d767959 P 2e26e357812d44c9bad12d473db3306b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:30.855667   461 catalog_manager.cc:5697] T c89bd3c22b614793b48964055d767959 P 2e26e357812d44c9bad12d473db3306b reported cstate change: term changed from 1 to 2, leader changed from fe9806f22d144af29384514ba001d2d4 (127.0.107.193) to 2e26e357812d44c9bad12d473db3306b (127.0.107.195). New cstate: current_term: 2 leader_uuid: "2e26e357812d44c9bad12d473db3306b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:31.125012   566 raft_consensus.cc:1275] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [term 2 FOLLOWER]: Refusing update from remote peer 82d3861d62814827a7586acb0678fa9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:31.126293   765 consensus_queue.cc:1048] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:31.138010   713 raft_consensus.cc:3060] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 2e26e357812d44c9bad12d473db3306b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:31.144896   713 raft_consensus.cc:1275] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 2e26e357812d44c9bad12d473db3306b [term 2 FOLLOWER]: Refusing update from remote peer 82d3861d62814827a7586acb0678fa9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:31.146210   791 consensus_queue.cc:1048] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:31.156010   640 raft_consensus.cc:1275] T 04215ecc92554a7bb3332444a559c47c P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Refusing update from remote peer fe9806f22d144af29384514ba001d2d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:31.157225   804 consensus_queue.cc:1048] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:31.165596   713 raft_consensus.cc:1275] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [term 2 FOLLOWER]: Refusing update from remote peer fe9806f22d144af29384514ba001d2d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:31.167716   766 consensus_queue.cc:1048] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:31.196400   713 raft_consensus.cc:1275] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [term 2 FOLLOWER]: Refusing update from remote peer fe9806f22d144af29384514ba001d2d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:31.197817   766 consensus_queue.cc:1048] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:31.207551   640 raft_consensus.cc:1275] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Refusing update from remote peer fe9806f22d144af29384514ba001d2d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:31.208950   808 consensus_queue.cc:1048] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:56:31.338789   640 raft_consensus.cc:1275] T c89bd3c22b614793b48964055d767959 P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Refusing update from remote peer 2e26e357812d44c9bad12d473db3306b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:31.340185   793 consensus_queue.cc:1048] T c89bd3c22b614793b48964055d767959 P 2e26e357812d44c9bad12d473db3306b [LEADER]: Connected to new peer: Peer: permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:31.347875   566 raft_consensus.cc:1275] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4 [term 2 FOLLOWER]: Refusing update from remote peer 2e26e357812d44c9bad12d473db3306b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:31.349323   771 consensus_queue.cc:1048] T c89bd3c22b614793b48964055d767959 P 2e26e357812d44c9bad12d473db3306b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:33.517886   431 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 12:56:33.518693   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:56:33.538558   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91b8fadcbfdf4933bce1377d15368cdc"
dest_uuid: "fe9806f22d144af29384514ba001d2d4"
mode: GRACEFUL
new_leader_uuid: "2e26e357812d44c9bad12d473db3306b"
 from {username='slave'} at 127.0.0.1:38242
I20260709 12:56:33.539070   566 raft_consensus.cc:606] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [term 1 LEADER]: Received request to transfer leadership to TS 2e26e357812d44c9bad12d473db3306b
I20260709 12:56:33.550514   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de0fb96d164d4382b82fddda59cf8855"
dest_uuid: "82d3861d62814827a7586acb0678fa9e"
mode: GRACEFUL
new_leader_uuid: "2e26e357812d44c9bad12d473db3306b"
 from {username='slave'} at 127.0.0.1:44732
I20260709 12:56:33.550997   640 raft_consensus.cc:606] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [term 1 LEADER]: Received request to transfer leadership to TS 2e26e357812d44c9bad12d473db3306b
I20260709 12:56:33.552143   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:56:33.552649   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:56:34.004079   851 raft_consensus.cc:993] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4: : Instructing follower 2e26e357812d44c9bad12d473db3306b to start an election
I20260709 12:56:34.004562   855 raft_consensus.cc:1081] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [term 1 LEADER]: Signalling peer 2e26e357812d44c9bad12d473db3306b to start an election
I20260709 12:56:34.006112   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91b8fadcbfdf4933bce1377d15368cdc"
dest_uuid: "2e26e357812d44c9bad12d473db3306b"
 from {username='slave'} at 127.0.0.1:53852
I20260709 12:56:34.006553   714 raft_consensus.cc:493] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:34.006812   714 raft_consensus.cc:3060] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:34.011381   714 raft_consensus.cc:515] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } } peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } }
I20260709 12:56:34.012979   714 leader_election.cc:290] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 2 election: Requested vote from peers fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439), 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585)
I20260709 12:56:34.013898   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b8fadcbfdf4933bce1377d15368cdc" candidate_uuid: "2e26e357812d44c9bad12d473db3306b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fe9806f22d144af29384514ba001d2d4"
I20260709 12:56:34.014179   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b8fadcbfdf4933bce1377d15368cdc" candidate_uuid: "2e26e357812d44c9bad12d473db3306b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "82d3861d62814827a7586acb0678fa9e"
I20260709 12:56:34.014576   566 raft_consensus.cc:3055] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:34.014994   566 raft_consensus.cc:740] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe9806f22d144af29384514ba001d2d4, State: Running, Role: LEADER
I20260709 12:56:34.014703   640 raft_consensus.cc:3060] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:34.015854   566 consensus_queue.cc:260] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } } peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } }
I20260709 12:56:34.016930   566 raft_consensus.cc:3060] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:34.020283   640 raft_consensus.cc:2468] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e26e357812d44c9bad12d473db3306b in term 2.
I20260709 12:56:34.021421   679 leader_election.cc:304] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e26e357812d44c9bad12d473db3306b, 82d3861d62814827a7586acb0678fa9e; no voters: 
I20260709 12:56:34.021961   566 raft_consensus.cc:2468] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e26e357812d44c9bad12d473db3306b in term 2.
I20260709 12:56:34.022070   849 raft_consensus.cc:2804] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:34.023102   849 raft_consensus.cc:697] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [term 2 LEADER]: Becoming Leader. State: Replica: 2e26e357812d44c9bad12d473db3306b, State: Running, Role: LEADER
I20260709 12:56:34.023849   849 consensus_queue.cc:237] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } } peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } }
I20260709 12:56:34.030898   462 catalog_manager.cc:5697] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b reported cstate change: term changed from 1 to 2, leader changed from fe9806f22d144af29384514ba001d2d4 (127.0.107.193) to 2e26e357812d44c9bad12d473db3306b (127.0.107.195). New cstate: current_term: 2 leader_uuid: "2e26e357812d44c9bad12d473db3306b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:34.075644   862 raft_consensus.cc:993] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e: : Instructing follower 2e26e357812d44c9bad12d473db3306b to start an election
I20260709 12:56:34.076253   765 raft_consensus.cc:1081] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [term 1 LEADER]: Signalling peer 2e26e357812d44c9bad12d473db3306b to start an election
I20260709 12:56:34.078334   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de0fb96d164d4382b82fddda59cf8855"
dest_uuid: "2e26e357812d44c9bad12d473db3306b"
 from {username='slave'} at 127.0.0.1:53842
I20260709 12:56:34.078890   714 raft_consensus.cc:493] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:34.079236   714 raft_consensus.cc:3060] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:34.086402   714 raft_consensus.cc:515] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:34.088538   714 leader_election.cc:290] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 2 election: Requested vote from peers fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439), 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585)
I20260709 12:56:34.089274   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0fb96d164d4382b82fddda59cf8855" candidate_uuid: "2e26e357812d44c9bad12d473db3306b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fe9806f22d144af29384514ba001d2d4"
I20260709 12:56:34.089777   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0fb96d164d4382b82fddda59cf8855" candidate_uuid: "2e26e357812d44c9bad12d473db3306b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "82d3861d62814827a7586acb0678fa9e"
I20260709 12:56:34.089931   566 raft_consensus.cc:3060] T de0fb96d164d4382b82fddda59cf8855 P fe9806f22d144af29384514ba001d2d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:34.090387   640 raft_consensus.cc:3055] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:34.090739   640 raft_consensus.cc:740] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 82d3861d62814827a7586acb0678fa9e, State: Running, Role: LEADER
I20260709 12:56:34.091542   640 consensus_queue.cc:260] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:34.092873   640 raft_consensus.cc:3060] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:34.096835   566 raft_consensus.cc:2468] T de0fb96d164d4382b82fddda59cf8855 P fe9806f22d144af29384514ba001d2d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e26e357812d44c9bad12d473db3306b in term 2.
I20260709 12:56:34.098037   679 leader_election.cc:304] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e26e357812d44c9bad12d473db3306b, fe9806f22d144af29384514ba001d2d4; no voters: 
I20260709 12:56:34.098888   849 raft_consensus.cc:2804] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:34.099288   849 raft_consensus.cc:697] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [term 2 LEADER]: Becoming Leader. State: Replica: 2e26e357812d44c9bad12d473db3306b, State: Running, Role: LEADER
I20260709 12:56:34.099385   640 raft_consensus.cc:2468] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e26e357812d44c9bad12d473db3306b in term 2.
I20260709 12:56:34.100080   849 consensus_queue.cc:237] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:34.106844   462 catalog_manager.cc:5697] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b reported cstate change: term changed from 1 to 2, leader changed from 82d3861d62814827a7586acb0678fa9e (127.0.107.194) to 2e26e357812d44c9bad12d473db3306b (127.0.107.195). New cstate: current_term: 2 leader_uuid: "2e26e357812d44c9bad12d473db3306b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:34.483127   640 raft_consensus.cc:1275] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Refusing update from remote peer 2e26e357812d44c9bad12d473db3306b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:34.484462   849 consensus_queue.cc:1048] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [LEADER]: Connected to new peer: Peer: permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:34.487407   641 raft_consensus.cc:1275] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Refusing update from remote peer 2e26e357812d44c9bad12d473db3306b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:34.488790   856 consensus_queue.cc:1048] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [LEADER]: Connected to new peer: Peer: permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:34.505980   566 raft_consensus.cc:1275] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [term 2 FOLLOWER]: Refusing update from remote peer 2e26e357812d44c9bad12d473db3306b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:34.509002   856 consensus_queue.cc:1048] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:34.509660   566 raft_consensus.cc:1275] T de0fb96d164d4382b82fddda59cf8855 P fe9806f22d144af29384514ba001d2d4 [term 2 FOLLOWER]: Refusing update from remote peer 2e26e357812d44c9bad12d473db3306b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:34.511253   856 consensus_queue.cc:1048] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:34.553484   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:56:34.564711   714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91b8fadcbfdf4933bce1377d15368cdc"
dest_uuid: "2e26e357812d44c9bad12d473db3306b"
mode: GRACEFUL
new_leader_uuid: "82d3861d62814827a7586acb0678fa9e"
 from {username='slave'} at 127.0.0.1:48960
I20260709 12:56:34.565269   714 raft_consensus.cc:606] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [term 2 LEADER]: Received request to transfer leadership to TS 82d3861d62814827a7586acb0678fa9e
I20260709 12:56:34.570123   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04215ecc92554a7bb3332444a559c47c"
dest_uuid: "fe9806f22d144af29384514ba001d2d4"
mode: GRACEFUL
new_leader_uuid: "82d3861d62814827a7586acb0678fa9e"
 from {username='slave'} at 127.0.0.1:38232
I20260709 12:56:34.570621   565 raft_consensus.cc:606] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4 [term 2 LEADER]: Received request to transfer leadership to TS 82d3861d62814827a7586acb0678fa9e
I20260709 12:56:34.575879   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d82dd01702a84abbb12318c0e15834cc"
dest_uuid: "fe9806f22d144af29384514ba001d2d4"
mode: GRACEFUL
new_leader_uuid: "82d3861d62814827a7586acb0678fa9e"
 from {username='slave'} at 127.0.0.1:38232
I20260709 12:56:34.576435   565 raft_consensus.cc:606] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 [term 2 LEADER]: Received request to transfer leadership to TS 82d3861d62814827a7586acb0678fa9e
I20260709 12:56:34.581118   565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b55b3ab63c24942989e4100662226df"
dest_uuid: "fe9806f22d144af29384514ba001d2d4"
mode: GRACEFUL
new_leader_uuid: "82d3861d62814827a7586acb0678fa9e"
 from {username='slave'} at 127.0.0.1:38232
I20260709 12:56:34.581632   565 raft_consensus.cc:606] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4 [term 1 LEADER]: Received request to transfer leadership to TS 82d3861d62814827a7586acb0678fa9e
I20260709 12:56:34.586160   714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de0fb96d164d4382b82fddda59cf8855"
dest_uuid: "2e26e357812d44c9bad12d473db3306b"
mode: GRACEFUL
new_leader_uuid: "82d3861d62814827a7586acb0678fa9e"
 from {username='slave'} at 127.0.0.1:48960
I20260709 12:56:34.586668   714 raft_consensus.cc:606] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [term 2 LEADER]: Received request to transfer leadership to TS 82d3861d62814827a7586acb0678fa9e
I20260709 12:56:34.682111   875 raft_consensus.cc:993] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4: : Instructing follower 82d3861d62814827a7586acb0678fa9e to start an election
I20260709 12:56:34.682518   875 raft_consensus.cc:1081] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 [term 2 LEADER]: Signalling peer 82d3861d62814827a7586acb0678fa9e to start an election
I20260709 12:56:34.683970   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d82dd01702a84abbb12318c0e15834cc"
dest_uuid: "82d3861d62814827a7586acb0678fa9e"
 from {username='slave'} at 127.0.0.1:48704
I20260709 12:56:34.684443   640 raft_consensus.cc:493] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:34.684774   640 raft_consensus.cc:3060] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:34.689496   640 raft_consensus.cc:515] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:34.691349   640 leader_election.cc:290] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 3 election: Requested vote from peers fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439), 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181)
I20260709 12:56:34.692220   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82dd01702a84abbb12318c0e15834cc" candidate_uuid: "82d3861d62814827a7586acb0678fa9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fe9806f22d144af29384514ba001d2d4"
I20260709 12:56:34.692453   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82dd01702a84abbb12318c0e15834cc" candidate_uuid: "82d3861d62814827a7586acb0678fa9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e26e357812d44c9bad12d473db3306b"
I20260709 12:56:34.692781   565 raft_consensus.cc:3055] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:56:34.692996   714 raft_consensus.cc:3060] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:34.693107   565 raft_consensus.cc:740] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fe9806f22d144af29384514ba001d2d4, State: Running, Role: LEADER
I20260709 12:56:34.693879   565 consensus_queue.cc:260] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:34.695267   565 raft_consensus.cc:3060] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:34.697964   714 raft_consensus.cc:2468] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82d3861d62814827a7586acb0678fa9e in term 3.
I20260709 12:56:34.699080   606 leader_election.cc:304] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e26e357812d44c9bad12d473db3306b, 82d3861d62814827a7586acb0678fa9e; no voters: 
I20260709 12:56:34.699709   765 raft_consensus.cc:2804] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:56:34.699931   565 raft_consensus.cc:2468] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82d3861d62814827a7586acb0678fa9e in term 3.
I20260709 12:56:34.700609   765 raft_consensus.cc:697] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [term 3 LEADER]: Becoming Leader. State: Replica: 82d3861d62814827a7586acb0678fa9e, State: Running, Role: LEADER
I20260709 12:56:34.701408   765 consensus_queue.cc:237] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:34.708201   463 catalog_manager.cc:5697] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e reported cstate change: term changed from 2 to 3, leader changed from fe9806f22d144af29384514ba001d2d4 (127.0.107.193) to 82d3861d62814827a7586acb0678fa9e (127.0.107.194). New cstate: current_term: 3 leader_uuid: "82d3861d62814827a7586acb0678fa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:34.816823   851 raft_consensus.cc:993] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4: : Instructing follower 82d3861d62814827a7586acb0678fa9e to start an election
I20260709 12:56:34.817248   875 raft_consensus.cc:1081] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4 [term 1 LEADER]: Signalling peer 82d3861d62814827a7586acb0678fa9e to start an election
I20260709 12:56:34.818712   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b55b3ab63c24942989e4100662226df"
dest_uuid: "82d3861d62814827a7586acb0678fa9e"
 from {username='slave'} at 127.0.0.1:48704
I20260709 12:56:34.819175   640 raft_consensus.cc:493] T 8b55b3ab63c24942989e4100662226df P 82d3861d62814827a7586acb0678fa9e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:34.819437   640 raft_consensus.cc:3060] T 8b55b3ab63c24942989e4100662226df P 82d3861d62814827a7586acb0678fa9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:34.824726   640 raft_consensus.cc:515] T 8b55b3ab63c24942989e4100662226df P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:34.826337   640 leader_election.cc:290] T 8b55b3ab63c24942989e4100662226df P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 2 election: Requested vote from peers fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439), 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181)
I20260709 12:56:34.827289   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55b3ab63c24942989e4100662226df" candidate_uuid: "82d3861d62814827a7586acb0678fa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fe9806f22d144af29384514ba001d2d4"
I20260709 12:56:34.827512   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b55b3ab63c24942989e4100662226df" candidate_uuid: "82d3861d62814827a7586acb0678fa9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e26e357812d44c9bad12d473db3306b"
I20260709 12:56:34.827829   565 raft_consensus.cc:3055] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:34.828027   714 raft_consensus.cc:3060] T 8b55b3ab63c24942989e4100662226df P 2e26e357812d44c9bad12d473db3306b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:34.828122   565 raft_consensus.cc:740] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe9806f22d144af29384514ba001d2d4, State: Running, Role: LEADER
I20260709 12:56:34.828866   565 consensus_queue.cc:260] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:34.829802   565 raft_consensus.cc:3060] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:34.833690   714 raft_consensus.cc:2468] T 8b55b3ab63c24942989e4100662226df P 2e26e357812d44c9bad12d473db3306b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82d3861d62814827a7586acb0678fa9e in term 2.
I20260709 12:56:34.834491   565 raft_consensus.cc:2468] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82d3861d62814827a7586acb0678fa9e in term 2.
I20260709 12:56:34.835038   606 leader_election.cc:304] T 8b55b3ab63c24942989e4100662226df P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e26e357812d44c9bad12d473db3306b, 82d3861d62814827a7586acb0678fa9e; no voters: 
I20260709 12:56:34.835780   765 raft_consensus.cc:2804] T 8b55b3ab63c24942989e4100662226df P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:34.836211   765 raft_consensus.cc:697] T 8b55b3ab63c24942989e4100662226df P 82d3861d62814827a7586acb0678fa9e [term 2 LEADER]: Becoming Leader. State: Replica: 82d3861d62814827a7586acb0678fa9e, State: Running, Role: LEADER
I20260709 12:56:34.837095   765 consensus_queue.cc:237] T 8b55b3ab63c24942989e4100662226df P 82d3861d62814827a7586acb0678fa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:34.844563   463 catalog_manager.cc:5697] T 8b55b3ab63c24942989e4100662226df P 82d3861d62814827a7586acb0678fa9e reported cstate change: term changed from 1 to 2, leader changed from fe9806f22d144af29384514ba001d2d4 (127.0.107.193) to 82d3861d62814827a7586acb0678fa9e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "82d3861d62814827a7586acb0678fa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:35.035727   849 raft_consensus.cc:993] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b: : Instructing follower 82d3861d62814827a7586acb0678fa9e to start an election
I20260709 12:56:35.036118   868 raft_consensus.cc:1081] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [term 2 LEADER]: Signalling peer 82d3861d62814827a7586acb0678fa9e to start an election
I20260709 12:56:35.037616   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91b8fadcbfdf4933bce1377d15368cdc"
dest_uuid: "82d3861d62814827a7586acb0678fa9e"
 from {username='slave'} at 127.0.0.1:48692
I20260709 12:56:35.038101   640 raft_consensus.cc:493] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:35.038393   640 raft_consensus.cc:3060] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:35.043615   640 raft_consensus.cc:515] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } } peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } }
I20260709 12:56:35.045660   640 leader_election.cc:290] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 3 election: Requested vote from peers 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181), fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439)
I20260709 12:56:35.046573   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b8fadcbfdf4933bce1377d15368cdc" candidate_uuid: "82d3861d62814827a7586acb0678fa9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e26e357812d44c9bad12d473db3306b"
I20260709 12:56:35.047168   714 raft_consensus.cc:3055] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:56:35.047495   714 raft_consensus.cc:740] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e26e357812d44c9bad12d473db3306b, State: Running, Role: LEADER
I20260709 12:56:35.047647   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b8fadcbfdf4933bce1377d15368cdc" candidate_uuid: "82d3861d62814827a7586acb0678fa9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fe9806f22d144af29384514ba001d2d4"
I20260709 12:56:35.048202   565 raft_consensus.cc:3060] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:35.048236   714 consensus_queue.cc:260] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } } peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } }
I20260709 12:56:35.049541   714 raft_consensus.cc:3060] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:35.055027   565 raft_consensus.cc:2468] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82d3861d62814827a7586acb0678fa9e in term 3.
I20260709 12:56:35.055469   849 raft_consensus.cc:993] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b: : Instructing follower 82d3861d62814827a7586acb0678fa9e to start an election
I20260709 12:56:35.055927   868 raft_consensus.cc:1081] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [term 2 LEADER]: Signalling peer 82d3861d62814827a7586acb0678fa9e to start an election
I20260709 12:56:35.056267   605 leader_election.cc:304] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82d3861d62814827a7586acb0678fa9e, fe9806f22d144af29384514ba001d2d4; no voters: 
I20260709 12:56:35.057015   765 raft_consensus.cc:2804] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:56:35.057416   765 raft_consensus.cc:697] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e [term 3 LEADER]: Becoming Leader. State: Replica: 82d3861d62814827a7586acb0678fa9e, State: Running, Role: LEADER
I20260709 12:56:35.057646   714 raft_consensus.cc:2468] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82d3861d62814827a7586acb0678fa9e in term 3.
I20260709 12:56:35.058275   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de0fb96d164d4382b82fddda59cf8855"
dest_uuid: "82d3861d62814827a7586acb0678fa9e"
 from {username='slave'} at 127.0.0.1:48692
I20260709 12:56:35.058240   765 consensus_queue.cc:237] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } } peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } }
I20260709 12:56:35.058930   640 raft_consensus.cc:493] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:35.059309   640 raft_consensus.cc:3060] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:35.067037   463 catalog_manager.cc:5697] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e reported cstate change: term changed from 2 to 3, leader changed from 2e26e357812d44c9bad12d473db3306b (127.0.107.195) to 82d3861d62814827a7586acb0678fa9e (127.0.107.194). New cstate: current_term: 3 leader_uuid: "82d3861d62814827a7586acb0678fa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:35.067703   640 raft_consensus.cc:515] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:35.069404   640 leader_election.cc:290] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 3 election: Requested vote from peers fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439), 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181)
I20260709 12:56:35.070359   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0fb96d164d4382b82fddda59cf8855" candidate_uuid: "82d3861d62814827a7586acb0678fa9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fe9806f22d144af29384514ba001d2d4"
I20260709 12:56:35.070963   565 raft_consensus.cc:3060] T de0fb96d164d4382b82fddda59cf8855 P fe9806f22d144af29384514ba001d2d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:35.071970   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de0fb96d164d4382b82fddda59cf8855" candidate_uuid: "82d3861d62814827a7586acb0678fa9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e26e357812d44c9bad12d473db3306b"
I20260709 12:56:35.072610   714 raft_consensus.cc:3055] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:56:35.072959   714 raft_consensus.cc:740] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e26e357812d44c9bad12d473db3306b, State: Running, Role: LEADER
I20260709 12:56:35.073750   714 consensus_queue.cc:260] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:35.075007   714 raft_consensus.cc:3060] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:35.078372   565 raft_consensus.cc:2468] T de0fb96d164d4382b82fddda59cf8855 P fe9806f22d144af29384514ba001d2d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82d3861d62814827a7586acb0678fa9e in term 3.
I20260709 12:56:35.079587   605 leader_election.cc:304] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82d3861d62814827a7586acb0678fa9e, fe9806f22d144af29384514ba001d2d4; no voters: 
I20260709 12:56:35.080370   765 raft_consensus.cc:2804] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:56:35.080796   765 raft_consensus.cc:697] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [term 3 LEADER]: Becoming Leader. State: Replica: 82d3861d62814827a7586acb0678fa9e, State: Running, Role: LEADER
I20260709 12:56:35.081601   714 raft_consensus.cc:2468] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82d3861d62814827a7586acb0678fa9e in term 3.
I20260709 12:56:35.081458   765 consensus_queue.cc:237] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:35.086862   463 catalog_manager.cc:5697] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e reported cstate change: term changed from 2 to 3, leader changed from 2e26e357812d44c9bad12d473db3306b (127.0.107.195) to 82d3861d62814827a7586acb0678fa9e (127.0.107.194). New cstate: current_term: 3 leader_uuid: "82d3861d62814827a7586acb0678fa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:35.131407   851 raft_consensus.cc:993] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4: : Instructing follower 82d3861d62814827a7586acb0678fa9e to start an election
I20260709 12:56:35.131832   851 raft_consensus.cc:1081] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4 [term 2 LEADER]: Signalling peer 82d3861d62814827a7586acb0678fa9e to start an election
I20260709 12:56:35.133931   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04215ecc92554a7bb3332444a559c47c"
dest_uuid: "82d3861d62814827a7586acb0678fa9e"
 from {username='slave'} at 127.0.0.1:48704
I20260709 12:56:35.134394   640 raft_consensus.cc:493] T 04215ecc92554a7bb3332444a559c47c P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:35.134680   640 raft_consensus.cc:3060] T 04215ecc92554a7bb3332444a559c47c P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:35.138595   640 raft_consensus.cc:515] T 04215ecc92554a7bb3332444a559c47c P 82d3861d62814827a7586acb0678fa9e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:35.140159   640 leader_election.cc:290] T 04215ecc92554a7bb3332444a559c47c P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 3 election: Requested vote from peers fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439), 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181)
I20260709 12:56:35.141089   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04215ecc92554a7bb3332444a559c47c" candidate_uuid: "82d3861d62814827a7586acb0678fa9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fe9806f22d144af29384514ba001d2d4"
I20260709 12:56:35.141346   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04215ecc92554a7bb3332444a559c47c" candidate_uuid: "82d3861d62814827a7586acb0678fa9e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e26e357812d44c9bad12d473db3306b"
I20260709 12:56:35.141671   565 raft_consensus.cc:3055] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:56:35.141836   714 raft_consensus.cc:3060] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:35.142027   565 raft_consensus.cc:740] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fe9806f22d144af29384514ba001d2d4, State: Running, Role: LEADER
I20260709 12:56:35.142753   565 consensus_queue.cc:260] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:35.143812   565 raft_consensus.cc:3060] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:35.146737   714 raft_consensus.cc:2468] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82d3861d62814827a7586acb0678fa9e in term 3.
I20260709 12:56:35.147787   606 leader_election.cc:304] T 04215ecc92554a7bb3332444a559c47c P 82d3861d62814827a7586acb0678fa9e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e26e357812d44c9bad12d473db3306b, 82d3861d62814827a7586acb0678fa9e; no voters: 
I20260709 12:56:35.148465   765 raft_consensus.cc:2804] T 04215ecc92554a7bb3332444a559c47c P 82d3861d62814827a7586acb0678fa9e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:56:35.148968   765 raft_consensus.cc:697] T 04215ecc92554a7bb3332444a559c47c P 82d3861d62814827a7586acb0678fa9e [term 3 LEADER]: Becoming Leader. State: Replica: 82d3861d62814827a7586acb0678fa9e, State: Running, Role: LEADER
I20260709 12:56:35.149509   565 raft_consensus.cc:2468] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82d3861d62814827a7586acb0678fa9e in term 3.
I20260709 12:56:35.149684   765 consensus_queue.cc:237] T 04215ecc92554a7bb3332444a559c47c P 82d3861d62814827a7586acb0678fa9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:35.155635   463 catalog_manager.cc:5697] T 04215ecc92554a7bb3332444a559c47c P 82d3861d62814827a7586acb0678fa9e reported cstate change: term changed from 2 to 3, leader changed from fe9806f22d144af29384514ba001d2d4 (127.0.107.193) to 82d3861d62814827a7586acb0678fa9e (127.0.107.194). New cstate: current_term: 3 leader_uuid: "82d3861d62814827a7586acb0678fa9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:35.288791   714 raft_consensus.cc:1275] T 8b55b3ab63c24942989e4100662226df P 2e26e357812d44c9bad12d473db3306b [term 2 FOLLOWER]: Refusing update from remote peer 82d3861d62814827a7586acb0678fa9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:35.289964   765 consensus_queue.cc:1048] T 8b55b3ab63c24942989e4100662226df P 82d3861d62814827a7586acb0678fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:35.299368   565 raft_consensus.cc:1275] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4 [term 2 FOLLOWER]: Refusing update from remote peer 82d3861d62814827a7586acb0678fa9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:35.301223   885 consensus_queue.cc:1048] T 8b55b3ab63c24942989e4100662226df P 82d3861d62814827a7586acb0678fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:35.305847   566 raft_consensus.cc:1275] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 [term 3 FOLLOWER]: Refusing update from remote peer 82d3861d62814827a7586acb0678fa9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:35.307621   885 consensus_queue.cc:1048] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:35.313707   714 raft_consensus.cc:1275] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [term 3 FOLLOWER]: Refusing update from remote peer 82d3861d62814827a7586acb0678fa9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:35.316275   876 consensus_queue.cc:1048] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:35.474254   566 raft_consensus.cc:1275] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [term 3 FOLLOWER]: Refusing update from remote peer 82d3861d62814827a7586acb0678fa9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:35.475564   876 consensus_queue.cc:1048] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:35.480702   714 raft_consensus.cc:1275] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [term 3 FOLLOWER]: Refusing update from remote peer 82d3861d62814827a7586acb0678fa9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:35.482357   765 consensus_queue.cc:1048] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:35.497073   714 raft_consensus.cc:1275] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [term 3 FOLLOWER]: Refusing update from remote peer 82d3861d62814827a7586acb0678fa9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:35.498179   765 consensus_queue.cc:1048] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:35.504657   566 raft_consensus.cc:1275] T de0fb96d164d4382b82fddda59cf8855 P fe9806f22d144af29384514ba001d2d4 [term 3 FOLLOWER]: Refusing update from remote peer 82d3861d62814827a7586acb0678fa9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:35.506163   876 consensus_queue.cc:1048] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:35.558241   566 raft_consensus.cc:1275] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4 [term 3 FOLLOWER]: Refusing update from remote peer 82d3861d62814827a7586acb0678fa9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:35.559463   885 consensus_queue.cc:1048] T 04215ecc92554a7bb3332444a559c47c P 82d3861d62814827a7586acb0678fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:35.567454   714 raft_consensus.cc:1275] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [term 3 FOLLOWER]: Refusing update from remote peer 82d3861d62814827a7586acb0678fa9e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:35.569290   876 consensus_queue.cc:1048] T 04215ecc92554a7bb3332444a559c47c P 82d3861d62814827a7586acb0678fa9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:37.598201   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:56:37.605754   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "714d0e00fb34431780779b1ed2911bce"
dest_uuid: "82d3861d62814827a7586acb0678fa9e"
mode: GRACEFUL
new_leader_uuid: "fe9806f22d144af29384514ba001d2d4"
 from {username='slave'} at 127.0.0.1:44732
I20260709 12:56:37.606419   640 raft_consensus.cc:606] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [term 1 LEADER]: Received request to transfer leadership to TS fe9806f22d144af29384514ba001d2d4
I20260709 12:56:37.609274   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e4df88c96044b37844d6b1a2cbdd9e2"
dest_uuid: "82d3861d62814827a7586acb0678fa9e"
mode: GRACEFUL
new_leader_uuid: "fe9806f22d144af29384514ba001d2d4"
 from {username='slave'} at 127.0.0.1:44732
I20260709 12:56:37.609769   640 raft_consensus.cc:606] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [term 2 LEADER]: Received request to transfer leadership to TS fe9806f22d144af29384514ba001d2d4
I20260709 12:56:37.612035   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91b8fadcbfdf4933bce1377d15368cdc"
dest_uuid: "82d3861d62814827a7586acb0678fa9e"
mode: GRACEFUL
new_leader_uuid: "2e26e357812d44c9bad12d473db3306b"
 from {username='slave'} at 127.0.0.1:44732
I20260709 12:56:37.612524   640 raft_consensus.cc:606] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e [term 3 LEADER]: Received request to transfer leadership to TS 2e26e357812d44c9bad12d473db3306b
I20260709 12:56:37.616065   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d751bf3a15f945229b3d72b84a7a3865"
dest_uuid: "82d3861d62814827a7586acb0678fa9e"
mode: GRACEFUL
new_leader_uuid: "fe9806f22d144af29384514ba001d2d4"
 from {username='slave'} at 127.0.0.1:44732
I20260709 12:56:37.616580   640 raft_consensus.cc:606] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [term 1 LEADER]: Received request to transfer leadership to TS fe9806f22d144af29384514ba001d2d4
I20260709 12:56:37.619076   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d82dd01702a84abbb12318c0e15834cc"
dest_uuid: "82d3861d62814827a7586acb0678fa9e"
mode: GRACEFUL
new_leader_uuid: "2e26e357812d44c9bad12d473db3306b"
 from {username='slave'} at 127.0.0.1:44732
I20260709 12:56:37.619525   640 raft_consensus.cc:606] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [term 3 LEADER]: Received request to transfer leadership to TS 2e26e357812d44c9bad12d473db3306b
I20260709 12:56:37.620610   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:56:37.621073   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:56:37.681615   765 raft_consensus.cc:993] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e: : Instructing follower 2e26e357812d44c9bad12d473db3306b to start an election
I20260709 12:56:37.682160   895 raft_consensus.cc:1081] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [term 3 LEADER]: Signalling peer 2e26e357812d44c9bad12d473db3306b to start an election
I20260709 12:56:37.684067   713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d82dd01702a84abbb12318c0e15834cc"
dest_uuid: "2e26e357812d44c9bad12d473db3306b"
 from {username='slave'} at 127.0.0.1:53842
I20260709 12:56:37.684614   713 raft_consensus.cc:493] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:37.684986   713 raft_consensus.cc:3060] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:37.690649   713 raft_consensus.cc:515] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:37.692507   713 leader_election.cc:290] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 4 election: Requested vote from peers fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439), 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585)
I20260709 12:56:37.693620   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82dd01702a84abbb12318c0e15834cc" candidate_uuid: "2e26e357812d44c9bad12d473db3306b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "82d3861d62814827a7586acb0678fa9e"
I20260709 12:56:37.693619   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82dd01702a84abbb12318c0e15834cc" candidate_uuid: "2e26e357812d44c9bad12d473db3306b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fe9806f22d144af29384514ba001d2d4"
I20260709 12:56:37.694342   640 raft_consensus.cc:3055] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:56:37.694416   565 raft_consensus.cc:3060] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:37.694624   640 raft_consensus.cc:740] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 82d3861d62814827a7586acb0678fa9e, State: Running, Role: LEADER
I20260709 12:56:37.695401   640 consensus_queue.cc:260] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:37.696558   640 raft_consensus.cc:3060] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:37.700068   565 raft_consensus.cc:2468] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e26e357812d44c9bad12d473db3306b in term 4.
I20260709 12:56:37.701195   640 raft_consensus.cc:2468] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e26e357812d44c9bad12d473db3306b in term 4.
I20260709 12:56:37.701398   679 leader_election.cc:304] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e26e357812d44c9bad12d473db3306b, fe9806f22d144af29384514ba001d2d4; no voters: 
I20260709 12:56:37.702301   868 raft_consensus.cc:2804] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:56:37.703092   868 raft_consensus.cc:697] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [term 4 LEADER]: Becoming Leader. State: Replica: 2e26e357812d44c9bad12d473db3306b, State: Running, Role: LEADER
I20260709 12:56:37.703872   868 consensus_queue.cc:237] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:37.711145   463 catalog_manager.cc:5697] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b reported cstate change: term changed from 3 to 4, leader changed from 82d3861d62814827a7586acb0678fa9e (127.0.107.194) to 2e26e357812d44c9bad12d473db3306b (127.0.107.195). New cstate: current_term: 4 leader_uuid: "2e26e357812d44c9bad12d473db3306b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:37.720357   895 raft_consensus.cc:993] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e: : Instructing follower fe9806f22d144af29384514ba001d2d4 to start an election
I20260709 12:56:37.720913   765 raft_consensus.cc:1081] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [term 1 LEADER]: Signalling peer fe9806f22d144af29384514ba001d2d4 to start an election
I20260709 12:56:37.722563   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d751bf3a15f945229b3d72b84a7a3865"
dest_uuid: "fe9806f22d144af29384514ba001d2d4"
 from {username='slave'} at 127.0.0.1:58460
I20260709 12:56:37.723078   565 raft_consensus.cc:493] T d751bf3a15f945229b3d72b84a7a3865 P fe9806f22d144af29384514ba001d2d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:37.723417   565 raft_consensus.cc:3060] T d751bf3a15f945229b3d72b84a7a3865 P fe9806f22d144af29384514ba001d2d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:37.729389   565 raft_consensus.cc:515] T d751bf3a15f945229b3d72b84a7a3865 P fe9806f22d144af29384514ba001d2d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:37.731073   565 leader_election.cc:290] T d751bf3a15f945229b3d72b84a7a3865 P fe9806f22d144af29384514ba001d2d4 [CANDIDATE]: Term 2 election: Requested vote from peers 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585), 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181)
I20260709 12:56:37.732026   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d751bf3a15f945229b3d72b84a7a3865" candidate_uuid: "fe9806f22d144af29384514ba001d2d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "82d3861d62814827a7586acb0678fa9e"
I20260709 12:56:37.732276   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d751bf3a15f945229b3d72b84a7a3865" candidate_uuid: "fe9806f22d144af29384514ba001d2d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e26e357812d44c9bad12d473db3306b"
I20260709 12:56:37.732621   640 raft_consensus.cc:3055] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:37.732820   713 raft_consensus.cc:3060] T d751bf3a15f945229b3d72b84a7a3865 P 2e26e357812d44c9bad12d473db3306b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:37.732897   640 raft_consensus.cc:740] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 82d3861d62814827a7586acb0678fa9e, State: Running, Role: LEADER
I20260709 12:56:37.733640   640 consensus_queue.cc:260] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:37.734495   640 raft_consensus.cc:3060] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:37.737435   713 raft_consensus.cc:2468] T d751bf3a15f945229b3d72b84a7a3865 P 2e26e357812d44c9bad12d473db3306b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9806f22d144af29384514ba001d2d4 in term 2.
I20260709 12:56:37.738649   640 raft_consensus.cc:2468] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9806f22d144af29384514ba001d2d4 in term 2.
I20260709 12:56:37.738706   531 leader_election.cc:304] T d751bf3a15f945229b3d72b84a7a3865 P fe9806f22d144af29384514ba001d2d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e26e357812d44c9bad12d473db3306b, fe9806f22d144af29384514ba001d2d4; no voters: 
I20260709 12:56:37.740486   902 raft_consensus.cc:2804] T d751bf3a15f945229b3d72b84a7a3865 P fe9806f22d144af29384514ba001d2d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:37.741483   902 raft_consensus.cc:697] T d751bf3a15f945229b3d72b84a7a3865 P fe9806f22d144af29384514ba001d2d4 [term 2 LEADER]: Becoming Leader. State: Replica: fe9806f22d144af29384514ba001d2d4, State: Running, Role: LEADER
I20260709 12:56:37.742238   902 consensus_queue.cc:237] T d751bf3a15f945229b3d72b84a7a3865 P fe9806f22d144af29384514ba001d2d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:37.748895   463 catalog_manager.cc:5697] T d751bf3a15f945229b3d72b84a7a3865 P fe9806f22d144af29384514ba001d2d4 reported cstate change: term changed from 1 to 2, leader changed from 82d3861d62814827a7586acb0678fa9e (127.0.107.194) to fe9806f22d144af29384514ba001d2d4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "fe9806f22d144af29384514ba001d2d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:37.801339   895 raft_consensus.cc:993] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e: : Instructing follower fe9806f22d144af29384514ba001d2d4 to start an election
I20260709 12:56:37.801730   765 raft_consensus.cc:1081] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [term 2 LEADER]: Signalling peer fe9806f22d144af29384514ba001d2d4 to start an election
I20260709 12:56:37.803144   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e4df88c96044b37844d6b1a2cbdd9e2"
dest_uuid: "fe9806f22d144af29384514ba001d2d4"
 from {username='slave'} at 127.0.0.1:58460
I20260709 12:56:37.803623   565 raft_consensus.cc:493] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:37.803918   565 raft_consensus.cc:3060] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:37.808631   565 raft_consensus.cc:515] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:37.810392   565 leader_election.cc:290] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [CANDIDATE]: Term 3 election: Requested vote from peers 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585), 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181)
I20260709 12:56:37.811340   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4df88c96044b37844d6b1a2cbdd9e2" candidate_uuid: "fe9806f22d144af29384514ba001d2d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "82d3861d62814827a7586acb0678fa9e"
I20260709 12:56:37.811457   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e4df88c96044b37844d6b1a2cbdd9e2" candidate_uuid: "fe9806f22d144af29384514ba001d2d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e26e357812d44c9bad12d473db3306b"
I20260709 12:56:37.811836   640 raft_consensus.cc:3055] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:56:37.811877   713 raft_consensus.cc:3060] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 2e26e357812d44c9bad12d473db3306b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:37.812238   640 raft_consensus.cc:740] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 82d3861d62814827a7586acb0678fa9e, State: Running, Role: LEADER
I20260709 12:56:37.812953   640 consensus_queue.cc:260] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:37.813802   640 raft_consensus.cc:3060] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:37.816547   713 raft_consensus.cc:2468] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 2e26e357812d44c9bad12d473db3306b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9806f22d144af29384514ba001d2d4 in term 3.
I20260709 12:56:37.817518   531 leader_election.cc:304] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e26e357812d44c9bad12d473db3306b, fe9806f22d144af29384514ba001d2d4; no voters: 
I20260709 12:56:37.818271   902 raft_consensus.cc:2804] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:56:37.818681   902 raft_consensus.cc:697] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [term 3 LEADER]: Becoming Leader. State: Replica: fe9806f22d144af29384514ba001d2d4, State: Running, Role: LEADER
I20260709 12:56:37.819180   640 raft_consensus.cc:2468] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9806f22d144af29384514ba001d2d4 in term 3.
I20260709 12:56:37.819484   902 consensus_queue.cc:237] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:37.826498   463 catalog_manager.cc:5697] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 reported cstate change: term changed from 2 to 3, leader changed from 82d3861d62814827a7586acb0678fa9e (127.0.107.194) to fe9806f22d144af29384514ba001d2d4 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "fe9806f22d144af29384514ba001d2d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:37.925426   895 raft_consensus.cc:993] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e: : Instructing follower 2e26e357812d44c9bad12d473db3306b to start an election
I20260709 12:56:37.925869   895 raft_consensus.cc:1081] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e [term 3 LEADER]: Signalling peer 2e26e357812d44c9bad12d473db3306b to start an election
I20260709 12:56:37.927435   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91b8fadcbfdf4933bce1377d15368cdc"
dest_uuid: "2e26e357812d44c9bad12d473db3306b"
 from {username='slave'} at 127.0.0.1:53842
I20260709 12:56:37.927896   714 raft_consensus.cc:493] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:37.928164   714 raft_consensus.cc:3060] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:37.932397   714 raft_consensus.cc:515] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } } peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } }
I20260709 12:56:37.933923   714 leader_election.cc:290] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 4 election: Requested vote from peers fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439), 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585)
I20260709 12:56:37.934953   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b8fadcbfdf4933bce1377d15368cdc" candidate_uuid: "2e26e357812d44c9bad12d473db3306b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fe9806f22d144af29384514ba001d2d4"
I20260709 12:56:37.935292   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91b8fadcbfdf4933bce1377d15368cdc" candidate_uuid: "2e26e357812d44c9bad12d473db3306b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "82d3861d62814827a7586acb0678fa9e"
I20260709 12:56:37.935539   565 raft_consensus.cc:3060] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:37.935887   640 raft_consensus.cc:3055] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:56:37.936215   640 raft_consensus.cc:740] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 82d3861d62814827a7586acb0678fa9e, State: Running, Role: LEADER
I20260709 12:56:37.937062   640 consensus_queue.cc:260] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } } peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } }
I20260709 12:56:37.937960   640 raft_consensus.cc:3060] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:37.940317   565 raft_consensus.cc:2468] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e26e357812d44c9bad12d473db3306b in term 4.
I20260709 12:56:37.941409   679 leader_election.cc:304] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e26e357812d44c9bad12d473db3306b, fe9806f22d144af29384514ba001d2d4; no voters: 
I20260709 12:56:37.942126   640 raft_consensus.cc:2468] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e26e357812d44c9bad12d473db3306b in term 4.
I20260709 12:56:37.942212   868 raft_consensus.cc:2804] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:56:37.942674   868 raft_consensus.cc:697] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [term 4 LEADER]: Becoming Leader. State: Replica: 2e26e357812d44c9bad12d473db3306b, State: Running, Role: LEADER
I20260709 12:56:37.943452   868 consensus_queue.cc:237] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } } peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } }
I20260709 12:56:37.950126   463 catalog_manager.cc:5697] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b reported cstate change: term changed from 3 to 4, leader changed from 82d3861d62814827a7586acb0678fa9e (127.0.107.194) to 2e26e357812d44c9bad12d473db3306b (127.0.107.195). New cstate: current_term: 4 leader_uuid: "2e26e357812d44c9bad12d473db3306b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:38.119863   765 raft_consensus.cc:993] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e: : Instructing follower fe9806f22d144af29384514ba001d2d4 to start an election
I20260709 12:56:38.120286   895 raft_consensus.cc:1081] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [term 1 LEADER]: Signalling peer fe9806f22d144af29384514ba001d2d4 to start an election
I20260709 12:56:38.121821   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "714d0e00fb34431780779b1ed2911bce"
dest_uuid: "fe9806f22d144af29384514ba001d2d4"
 from {username='slave'} at 127.0.0.1:58460
I20260709 12:56:38.122313   565 raft_consensus.cc:493] T 714d0e00fb34431780779b1ed2911bce P fe9806f22d144af29384514ba001d2d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:38.122615   565 raft_consensus.cc:3060] T 714d0e00fb34431780779b1ed2911bce P fe9806f22d144af29384514ba001d2d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:38.127688   565 raft_consensus.cc:515] T 714d0e00fb34431780779b1ed2911bce P fe9806f22d144af29384514ba001d2d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:38.129642   565 leader_election.cc:290] T 714d0e00fb34431780779b1ed2911bce P fe9806f22d144af29384514ba001d2d4 [CANDIDATE]: Term 2 election: Requested vote from peers 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585), 2e26e357812d44c9bad12d473db3306b (127.0.107.195:44181)
I20260709 12:56:38.130847   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "714d0e00fb34431780779b1ed2911bce" candidate_uuid: "fe9806f22d144af29384514ba001d2d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "82d3861d62814827a7586acb0678fa9e"
I20260709 12:56:38.131410   640 raft_consensus.cc:3055] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:38.131479   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "714d0e00fb34431780779b1ed2911bce" candidate_uuid: "fe9806f22d144af29384514ba001d2d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e26e357812d44c9bad12d473db3306b"
I20260709 12:56:38.131682   713 raft_consensus.cc:1275] T d751bf3a15f945229b3d72b84a7a3865 P 2e26e357812d44c9bad12d473db3306b [term 2 FOLLOWER]: Refusing update from remote peer fe9806f22d144af29384514ba001d2d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:38.131923   640 raft_consensus.cc:740] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 82d3861d62814827a7586acb0678fa9e, State: Running, Role: LEADER
I20260709 12:56:38.132133   714 raft_consensus.cc:3060] T 714d0e00fb34431780779b1ed2911bce P 2e26e357812d44c9bad12d473db3306b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:38.132798   640 consensus_queue.cc:260] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:38.133469   902 consensus_queue.cc:1048] T d751bf3a15f945229b3d72b84a7a3865 P fe9806f22d144af29384514ba001d2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:38.133996   640 raft_consensus.cc:3060] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:38.140317   714 raft_consensus.cc:2468] T 714d0e00fb34431780779b1ed2911bce P 2e26e357812d44c9bad12d473db3306b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9806f22d144af29384514ba001d2d4 in term 2.
I20260709 12:56:38.140343   640 raft_consensus.cc:2468] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9806f22d144af29384514ba001d2d4 in term 2.
I20260709 12:56:38.141908   530 leader_election.cc:304] T 714d0e00fb34431780779b1ed2911bce P fe9806f22d144af29384514ba001d2d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82d3861d62814827a7586acb0678fa9e, fe9806f22d144af29384514ba001d2d4; no voters: 
I20260709 12:56:38.142910   902 raft_consensus.cc:2804] T 714d0e00fb34431780779b1ed2911bce P fe9806f22d144af29384514ba001d2d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:38.147099   902 raft_consensus.cc:697] T 714d0e00fb34431780779b1ed2911bce P fe9806f22d144af29384514ba001d2d4 [term 2 LEADER]: Becoming Leader. State: Replica: fe9806f22d144af29384514ba001d2d4, State: Running, Role: LEADER
I20260709 12:56:38.148123   640 raft_consensus.cc:1275] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Refusing update from remote peer fe9806f22d144af29384514ba001d2d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:38.148195   902 consensus_queue.cc:237] T 714d0e00fb34431780779b1ed2911bce P fe9806f22d144af29384514ba001d2d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } }
I20260709 12:56:38.149930   909 consensus_queue.cc:1048] T d751bf3a15f945229b3d72b84a7a3865 P fe9806f22d144af29384514ba001d2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:56:38.158037   463 catalog_manager.cc:5697] T 714d0e00fb34431780779b1ed2911bce P fe9806f22d144af29384514ba001d2d4 reported cstate change: term changed from 1 to 2, leader changed from 82d3861d62814827a7586acb0678fa9e (127.0.107.194) to fe9806f22d144af29384514ba001d2d4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "fe9806f22d144af29384514ba001d2d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:38.268756   565 raft_consensus.cc:1275] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 [term 4 FOLLOWER]: Refusing update from remote peer 2e26e357812d44c9bad12d473db3306b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:56:38.269906   868 consensus_queue.cc:1048] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:56:38.281092   640 raft_consensus.cc:1275] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [term 4 FOLLOWER]: Refusing update from remote peer 2e26e357812d44c9bad12d473db3306b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:56:38.282722   916 consensus_queue.cc:1048] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [LEADER]: Connected to new peer: Peer: permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:56:38.323998   714 raft_consensus.cc:1275] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 2e26e357812d44c9bad12d473db3306b [term 3 FOLLOWER]: Refusing update from remote peer fe9806f22d144af29384514ba001d2d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:38.325503   902 consensus_queue.cc:1048] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:38.334757   640 raft_consensus.cc:1275] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [term 3 FOLLOWER]: Refusing update from remote peer fe9806f22d144af29384514ba001d2d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:38.337015   909 consensus_queue.cc:1048] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:38.396708   565 raft_consensus.cc:1275] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [term 4 FOLLOWER]: Refusing update from remote peer 2e26e357812d44c9bad12d473db3306b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:56:38.398010   916 consensus_queue.cc:1048] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9806f22d144af29384514ba001d2d4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:56:38.408449   640 raft_consensus.cc:1275] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e [term 4 FOLLOWER]: Refusing update from remote peer 2e26e357812d44c9bad12d473db3306b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:56:38.410172   921 consensus_queue.cc:1048] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [LEADER]: Connected to new peer: Peer: permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:56:38.554020   714 raft_consensus.cc:1275] T 714d0e00fb34431780779b1ed2911bce P 2e26e357812d44c9bad12d473db3306b [term 2 FOLLOWER]: Refusing update from remote peer fe9806f22d144af29384514ba001d2d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:38.555226   909 consensus_queue.cc:1048] T 714d0e00fb34431780779b1ed2911bce P fe9806f22d144af29384514ba001d2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e26e357812d44c9bad12d473db3306b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:38.564226   640 raft_consensus.cc:1275] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Refusing update from remote peer fe9806f22d144af29384514ba001d2d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:38.565830   910 consensus_queue.cc:1048] T 714d0e00fb34431780779b1ed2911bce P fe9806f22d144af29384514ba001d2d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82d3861d62814827a7586acb0678fa9e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:56:38.621927   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:56:38.627408   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 12:56:38.651271   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:56:38.652103   431 tablet_replica.cc:333] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4: stopping tablet replica
I20260709 12:56:38.653025   431 raft_consensus.cc:2243] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:38.653553   431 raft_consensus.cc:2272] T c89bd3c22b614793b48964055d767959 P fe9806f22d144af29384514ba001d2d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:38.655948   431 tablet_replica.cc:333] T de0fb96d164d4382b82fddda59cf8855 P fe9806f22d144af29384514ba001d2d4: stopping tablet replica
I20260709 12:56:38.656550   431 raft_consensus.cc:2243] T de0fb96d164d4382b82fddda59cf8855 P fe9806f22d144af29384514ba001d2d4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:38.656965   431 raft_consensus.cc:2272] T de0fb96d164d4382b82fddda59cf8855 P fe9806f22d144af29384514ba001d2d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:38.658531   431 tablet_replica.cc:333] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4: stopping tablet replica
I20260709 12:56:38.659011   431 raft_consensus.cc:2243] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:38.659435   431 raft_consensus.cc:2272] T 8b55b3ab63c24942989e4100662226df P fe9806f22d144af29384514ba001d2d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:38.661064   431 tablet_replica.cc:333] T d751bf3a15f945229b3d72b84a7a3865 P fe9806f22d144af29384514ba001d2d4: stopping tablet replica
I20260709 12:56:38.661552   431 raft_consensus.cc:2243] T d751bf3a15f945229b3d72b84a7a3865 P fe9806f22d144af29384514ba001d2d4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:56:38.662235   431 raft_consensus.cc:2272] T d751bf3a15f945229b3d72b84a7a3865 P fe9806f22d144af29384514ba001d2d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:38.664387   431 tablet_replica.cc:333] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4: stopping tablet replica
I20260709 12:56:38.665189   431 raft_consensus.cc:2243] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:38.665808   431 raft_consensus.cc:2272] T d82dd01702a84abbb12318c0e15834cc P fe9806f22d144af29384514ba001d2d4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:38.667951   431 tablet_replica.cc:333] T 714d0e00fb34431780779b1ed2911bce P fe9806f22d144af29384514ba001d2d4: stopping tablet replica
I20260709 12:56:38.668459   431 raft_consensus.cc:2243] T 714d0e00fb34431780779b1ed2911bce P fe9806f22d144af29384514ba001d2d4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:56:38.669260   431 raft_consensus.cc:2272] T 714d0e00fb34431780779b1ed2911bce P fe9806f22d144af29384514ba001d2d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:38.671252   431 tablet_replica.cc:333] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4: stopping tablet replica
I20260709 12:56:38.671736   431 raft_consensus.cc:2243] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:56:38.672441   431 raft_consensus.cc:2272] T 8e4df88c96044b37844d6b1a2cbdd9e2 P fe9806f22d144af29384514ba001d2d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:38.674386   431 tablet_replica.cc:333] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4: stopping tablet replica
I20260709 12:56:38.674868   431 raft_consensus.cc:2243] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:38.675287   431 raft_consensus.cc:2272] T 91b8fadcbfdf4933bce1377d15368cdc P fe9806f22d144af29384514ba001d2d4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:38.677378   431 tablet_replica.cc:333] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4: stopping tablet replica
I20260709 12:56:38.677840   431 raft_consensus.cc:2243] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:38.678243   431 raft_consensus.cc:2272] T 04215ecc92554a7bb3332444a559c47c P fe9806f22d144af29384514ba001d2d4 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:56:38.771343   679 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111)
I20260709 12:56:38.773347   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 12:56:38.775398   679 consensus_peers.cc:597] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b -> Peer fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439): Couldn't send request to peer fe9806f22d144af29384514ba001d2d4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:38.791678   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 12:56:38.811218   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:56:38.811794   431 tablet_replica.cc:333] T c89bd3c22b614793b48964055d767959 P 82d3861d62814827a7586acb0678fa9e: stopping tablet replica
I20260709 12:56:38.812312   431 raft_consensus.cc:2243] T c89bd3c22b614793b48964055d767959 P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:38.812790   431 raft_consensus.cc:2272] T c89bd3c22b614793b48964055d767959 P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:38.814875   431 tablet_replica.cc:333] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e: stopping tablet replica
I20260709 12:56:38.815708   431 raft_consensus.cc:2243] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:38.816161   431 raft_consensus.cc:2272] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 82d3861d62814827a7586acb0678fa9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:38.818748   431 tablet_replica.cc:333] T 8b55b3ab63c24942989e4100662226df P 82d3861d62814827a7586acb0678fa9e: stopping tablet replica
I20260709 12:56:38.819479   431 raft_consensus.cc:2243] T 8b55b3ab63c24942989e4100662226df P 82d3861d62814827a7586acb0678fa9e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:56:38.820417   431 raft_consensus.cc:2272] T 8b55b3ab63c24942989e4100662226df P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:56:38.820401   679 consensus_peers.cc:597] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b -> Peer 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585): Couldn't send request to peer 82d3861d62814827a7586acb0678fa9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:38.822412   431 tablet_replica.cc:333] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e: stopping tablet replica
I20260709 12:56:38.822937   431 raft_consensus.cc:2243] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:38.823346   431 raft_consensus.cc:2272] T d82dd01702a84abbb12318c0e15834cc P 82d3861d62814827a7586acb0678fa9e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:38.825341   431 tablet_replica.cc:333] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e: stopping tablet replica
I20260709 12:56:38.825870   431 raft_consensus.cc:2243] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:38.826263   431 raft_consensus.cc:2272] T 714d0e00fb34431780779b1ed2911bce P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:38.828212   431 tablet_replica.cc:333] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e: stopping tablet replica
I20260709 12:56:38.828737   431 raft_consensus.cc:2243] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:38.829123   431 raft_consensus.cc:2272] T d751bf3a15f945229b3d72b84a7a3865 P 82d3861d62814827a7586acb0678fa9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:38.831091   431 tablet_replica.cc:333] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e: stopping tablet replica
I20260709 12:56:38.831583   431 raft_consensus.cc:2243] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:38.831979   431 raft_consensus.cc:2272] T 91b8fadcbfdf4933bce1377d15368cdc P 82d3861d62814827a7586acb0678fa9e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:38.834007   431 tablet_replica.cc:333] T 04215ecc92554a7bb3332444a559c47c P 82d3861d62814827a7586acb0678fa9e: stopping tablet replica
I20260709 12:56:38.834460   431 raft_consensus.cc:2243] T 04215ecc92554a7bb3332444a559c47c P 82d3861d62814827a7586acb0678fa9e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:56:38.835155   431 raft_consensus.cc:2272] T 04215ecc92554a7bb3332444a559c47c P 82d3861d62814827a7586acb0678fa9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:38.836778   431 tablet_replica.cc:333] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e: stopping tablet replica
I20260709 12:56:38.837172   431 raft_consensus.cc:2243] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:56:38.837836   431 raft_consensus.cc:2272] T de0fb96d164d4382b82fddda59cf8855 P 82d3861d62814827a7586acb0678fa9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:38.863852   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 12:56:38.880265   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 12:56:38.901924   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:56:38.902657   431 tablet_replica.cc:333] T c89bd3c22b614793b48964055d767959 P 2e26e357812d44c9bad12d473db3306b: stopping tablet replica
I20260709 12:56:38.903264   431 raft_consensus.cc:2243] T c89bd3c22b614793b48964055d767959 P 2e26e357812d44c9bad12d473db3306b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:56:38.904316   431 raft_consensus.cc:2272] T c89bd3c22b614793b48964055d767959 P 2e26e357812d44c9bad12d473db3306b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:38.906374   431 tablet_replica.cc:333] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 2e26e357812d44c9bad12d473db3306b: stopping tablet replica
W20260709 12:56:38.906845   679 consensus_peers.cc:597] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b -> Peer fe9806f22d144af29384514ba001d2d4 (127.0.107.193:43439): Couldn't send request to peer fe9806f22d144af29384514ba001d2d4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43439: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:38.907045   431 raft_consensus.cc:2243] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 2e26e357812d44c9bad12d473db3306b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:38.907510   431 raft_consensus.cc:2272] T 8e4df88c96044b37844d6b1a2cbdd9e2 P 2e26e357812d44c9bad12d473db3306b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:38.909765   431 tablet_replica.cc:333] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b: stopping tablet replica
I20260709 12:56:38.910301   431 raft_consensus.cc:2243] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:38.910722   431 raft_consensus.cc:2272] T de0fb96d164d4382b82fddda59cf8855 P 2e26e357812d44c9bad12d473db3306b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:38.912688   431 tablet_replica.cc:333] T 714d0e00fb34431780779b1ed2911bce P 2e26e357812d44c9bad12d473db3306b: stopping tablet replica
W20260709 12:56:38.913007   679 consensus_peers.cc:597] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b -> Peer 82d3861d62814827a7586acb0678fa9e (127.0.107.194:38585): Couldn't send request to peer 82d3861d62814827a7586acb0678fa9e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:38585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:38.913166   431 raft_consensus.cc:2243] T 714d0e00fb34431780779b1ed2911bce P 2e26e357812d44c9bad12d473db3306b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:38.913596   431 raft_consensus.cc:2272] T 714d0e00fb34431780779b1ed2911bce P 2e26e357812d44c9bad12d473db3306b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:38.915367   431 tablet_replica.cc:333] T d751bf3a15f945229b3d72b84a7a3865 P 2e26e357812d44c9bad12d473db3306b: stopping tablet replica
I20260709 12:56:38.915853   431 raft_consensus.cc:2243] T d751bf3a15f945229b3d72b84a7a3865 P 2e26e357812d44c9bad12d473db3306b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:38.916251   431 raft_consensus.cc:2272] T d751bf3a15f945229b3d72b84a7a3865 P 2e26e357812d44c9bad12d473db3306b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:38.918202   431 tablet_replica.cc:333] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b: stopping tablet replica
I20260709 12:56:38.918678   431 raft_consensus.cc:2243] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:56:38.919386   431 raft_consensus.cc:2272] T d82dd01702a84abbb12318c0e15834cc P 2e26e357812d44c9bad12d473db3306b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:38.921305   431 tablet_replica.cc:333] T 8b55b3ab63c24942989e4100662226df P 2e26e357812d44c9bad12d473db3306b: stopping tablet replica
I20260709 12:56:38.921798   431 raft_consensus.cc:2243] T 8b55b3ab63c24942989e4100662226df P 2e26e357812d44c9bad12d473db3306b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:38.922179   431 raft_consensus.cc:2272] T 8b55b3ab63c24942989e4100662226df P 2e26e357812d44c9bad12d473db3306b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:38.923739   431 tablet_replica.cc:333] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b: stopping tablet replica
I20260709 12:56:38.924160   431 raft_consensus.cc:2243] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:56:38.924906   431 raft_consensus.cc:2272] T 91b8fadcbfdf4933bce1377d15368cdc P 2e26e357812d44c9bad12d473db3306b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:38.926721   431 tablet_replica.cc:333] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b: stopping tablet replica
I20260709 12:56:38.927145   431 raft_consensus.cc:2243] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:38.927564   431 raft_consensus.cc:2272] T 04215ecc92554a7bb3332444a559c47c P 2e26e357812d44c9bad12d473db3306b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:38.952349   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 12:56:38.968389   431 master.cc:562] Master@127.0.107.254:32877 shutting down...
I20260709 12:56:39.166025   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P cb6e45bcc6fc4eca826301423f339f8f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:56:39.166671   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P cb6e45bcc6fc4eca826301423f339f8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:39.167016   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P cb6e45bcc6fc4eca826301423f339f8f: stopping tablet replica
I20260709 12:56:39.186491   431 master.cc:584] Master@127.0.107.254:32877 shutdown complete.
2e26e357812d44c9bad12d473db3306b  1
82d3861d62814827a7586acb0678fa9e  4
fe9806f22d144af29384514ba001d2d4  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12651 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:56:39.222599   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:37307
I20260709 12:56:39.223752   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:39.229660   927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:39.230067   928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:39.230556   930 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:39.231786   431 server_base.cc:1061] running on GCE node
I20260709 12:56:39.232802   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:39.233022   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:39.233176   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601799233160 us; error 0 us; skew 500 ppm
I20260709 12:56:39.233716   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:39.236235   431 webserver.cc:533] Webserver started at http://127.0.107.254:35519/ using document root <none> and password file <none>
I20260709 12:56:39.236797   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:39.236966   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:39.237259   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:39.238363   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601786404416-431-0/minicluster-data/master-0-root/instance:
uuid: "9eadc8e3ab0645d392c5f3d7b5a49052"
format_stamp: "Formatted at 2026-07-09 12:56:39 on dist-test-slave-6j4g"
I20260709 12:56:39.242781   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:56:39.246536   935 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:39.247372   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:56:39.247694   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601786404416-431-0/minicluster-data/master-0-root
uuid: "9eadc8e3ab0645d392c5f3d7b5a49052"
format_stamp: "Formatted at 2026-07-09 12:56:39 on dist-test-slave-6j4g"
I20260709 12:56:39.247980   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601786404416-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601786404416-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601786404416-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:39.263631   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:39.264979   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:39.302208   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:37307
I20260709 12:56:39.302294   986 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:37307 every 8 connection(s)
I20260709 12:56:39.306216   987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.315696   987 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9eadc8e3ab0645d392c5f3d7b5a49052: Bootstrap starting.
I20260709 12:56:39.320267   987 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9eadc8e3ab0645d392c5f3d7b5a49052: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:39.324549   987 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9eadc8e3ab0645d392c5f3d7b5a49052: No bootstrap required, opened a new log
I20260709 12:56:39.326599   987 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9eadc8e3ab0645d392c5f3d7b5a49052 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eadc8e3ab0645d392c5f3d7b5a49052" member_type: VOTER }
I20260709 12:56:39.326988   987 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9eadc8e3ab0645d392c5f3d7b5a49052 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:39.327162   987 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9eadc8e3ab0645d392c5f3d7b5a49052 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9eadc8e3ab0645d392c5f3d7b5a49052, State: Initialized, Role: FOLLOWER
I20260709 12:56:39.327622   987 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9eadc8e3ab0645d392c5f3d7b5a49052 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eadc8e3ab0645d392c5f3d7b5a49052" member_type: VOTER }
I20260709 12:56:39.328032   987 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9eadc8e3ab0645d392c5f3d7b5a49052 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:56:39.328223   987 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9eadc8e3ab0645d392c5f3d7b5a49052 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:56:39.328435   987 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9eadc8e3ab0645d392c5f3d7b5a49052 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:39.332326   987 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9eadc8e3ab0645d392c5f3d7b5a49052 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eadc8e3ab0645d392c5f3d7b5a49052" member_type: VOTER }
I20260709 12:56:39.332914   987 leader_election.cc:304] T 00000000000000000000000000000000 P 9eadc8e3ab0645d392c5f3d7b5a49052 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9eadc8e3ab0645d392c5f3d7b5a49052; no voters: 
I20260709 12:56:39.334018   987 leader_election.cc:290] T 00000000000000000000000000000000 P 9eadc8e3ab0645d392c5f3d7b5a49052 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:56:39.334328   990 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9eadc8e3ab0645d392c5f3d7b5a49052 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:39.335597   990 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9eadc8e3ab0645d392c5f3d7b5a49052 [term 1 LEADER]: Becoming Leader. State: Replica: 9eadc8e3ab0645d392c5f3d7b5a49052, State: Running, Role: LEADER
I20260709 12:56:39.336308   990 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9eadc8e3ab0645d392c5f3d7b5a49052 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eadc8e3ab0645d392c5f3d7b5a49052" member_type: VOTER }
I20260709 12:56:39.336880   987 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9eadc8e3ab0645d392c5f3d7b5a49052 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:56:39.340758   991 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eadc8e3ab0645d392c5f3d7b5a49052 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9eadc8e3ab0645d392c5f3d7b5a49052" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eadc8e3ab0645d392c5f3d7b5a49052" member_type: VOTER } }
I20260709 12:56:39.341126   992 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9eadc8e3ab0645d392c5f3d7b5a49052 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9eadc8e3ab0645d392c5f3d7b5a49052. Latest consensus state: current_term: 1 leader_uuid: "9eadc8e3ab0645d392c5f3d7b5a49052" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9eadc8e3ab0645d392c5f3d7b5a49052" member_type: VOTER } }
I20260709 12:56:39.341671   991 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eadc8e3ab0645d392c5f3d7b5a49052 [sys.catalog]: This master's current role is: LEADER
I20260709 12:56:39.341811   992 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9eadc8e3ab0645d392c5f3d7b5a49052 [sys.catalog]: This master's current role is: LEADER
I20260709 12:56:39.344107   996 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:56:39.351704   996 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:56:39.352918   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:56:39.361037   996 catalog_manager.cc:1383] Generated new cluster ID: 32718dcd17f645b3b80217fc1f0055c0
I20260709 12:56:39.361356   996 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:56:39.374298   996 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:56:39.375562   996 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:56:39.387408   996 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9eadc8e3ab0645d392c5f3d7b5a49052: Generated new TSK 0
I20260709 12:56:39.388021   996 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:56:39.419803   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:39.425467  1008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:39.426568  1009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:39.428059  1011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:39.428445   431 server_base.cc:1061] running on GCE node
I20260709 12:56:39.429307   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:39.429489   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:39.429611   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601799429599 us; error 0 us; skew 500 ppm
I20260709 12:56:39.430066   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:39.432294   431 webserver.cc:533] Webserver started at http://127.0.107.193:38915/ using document root <none> and password file <none>
I20260709 12:56:39.432806   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:39.432976   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:39.433203   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:39.434239   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601786404416-431-0/minicluster-data/ts-0-root/instance:
uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
format_stamp: "Formatted at 2026-07-09 12:56:39 on dist-test-slave-6j4g"
I20260709 12:56:39.438720   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:56:39.442010  1016 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:39.442764   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:56:39.443068   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601786404416-431-0/minicluster-data/ts-0-root
uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
format_stamp: "Formatted at 2026-07-09 12:56:39 on dist-test-slave-6j4g"
I20260709 12:56:39.443372   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601786404416-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601786404416-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601786404416-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:39.495309   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:39.496677   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:39.498170   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:56:39.500392   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:56:39.500638   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:39.500870   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:56:39.501037   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:39.540838   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:45117
I20260709 12:56:39.540930  1078 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:45117 every 8 connection(s)
I20260709 12:56:39.545753   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:39.554149  1083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:39.554991  1084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:39.556448  1086 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:39.556661   431 server_base.cc:1061] running on GCE node
I20260709 12:56:39.557832   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:39.558028   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:39.558214   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601799558199 us; error 0 us; skew 500 ppm
I20260709 12:56:39.558734   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:39.561295   431 webserver.cc:533] Webserver started at http://127.0.107.194:36111/ using document root <none> and password file <none>
I20260709 12:56:39.561899   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:39.562155   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:39.562474   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:39.563902   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601786404416-431-0/minicluster-data/ts-1-root/instance:
uuid: "8777a520aad74df8ba8304f6f9fc7663"
format_stamp: "Formatted at 2026-07-09 12:56:39 on dist-test-slave-6j4g"
I20260709 12:56:39.563998  1079 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37307
I20260709 12:56:39.564374  1079 heartbeater.cc:461] Registering TS with master...
I20260709 12:56:39.565171  1079 heartbeater.cc:507] Master 127.0.107.254:37307 requested a full tablet report, sending...
I20260709 12:56:39.567524   952 ts_manager.cc:194] Registered new tserver with Master: d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117)
I20260709 12:56:39.569402   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:56:39.569698   952 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35776
I20260709 12:56:39.573136  1091 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:39.573900   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:56:39.574198   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601786404416-431-0/minicluster-data/ts-1-root
uuid: "8777a520aad74df8ba8304f6f9fc7663"
format_stamp: "Formatted at 2026-07-09 12:56:39 on dist-test-slave-6j4g"
I20260709 12:56:39.574472   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601786404416-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601786404416-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601786404416-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:39.584338   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:39.585608   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:39.587086   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:56:39.589399   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:56:39.589627   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:39.589854   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:56:39.590001   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:39.628379   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:44107
I20260709 12:56:39.628508  1153 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:44107 every 8 connection(s)
I20260709 12:56:39.632965   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:39.639326  1157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:39.641304  1158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:39.643164  1160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:39.643349   431 server_base.cc:1061] running on GCE node
I20260709 12:56:39.644626   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:39.644856   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:39.644920  1154 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37307
I20260709 12:56:39.645047   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601799645029 us; error 0 us; skew 500 ppm
I20260709 12:56:39.645371  1154 heartbeater.cc:461] Registering TS with master...
I20260709 12:56:39.645743   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:39.646147  1154 heartbeater.cc:507] Master 127.0.107.254:37307 requested a full tablet report, sending...
I20260709 12:56:39.648361   431 webserver.cc:533] Webserver started at http://127.0.107.195:42045/ using document root <none> and password file <none>
I20260709 12:56:39.648530   952 ts_manager.cc:194] Registered new tserver with Master: 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107)
I20260709 12:56:39.649058   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:39.649331   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:39.649643   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:39.650301   952 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35788
I20260709 12:56:39.651168   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601786404416-431-0/minicluster-data/ts-2-root/instance:
uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
format_stamp: "Formatted at 2026-07-09 12:56:39 on dist-test-slave-6j4g"
I20260709 12:56:39.655735   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:56:39.659117  1165 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:39.659930   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:56:39.660204   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601786404416-431-0/minicluster-data/ts-2-root
uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
format_stamp: "Formatted at 2026-07-09 12:56:39 on dist-test-slave-6j4g"
I20260709 12:56:39.660454   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601786404416-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601786404416-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601786404416-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:39.676134   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:39.677390   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:39.678792   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:56:39.680974   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:56:39.681178   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:39.681438   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:56:39.681583   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:39.722412   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:33907
I20260709 12:56:39.722520  1227 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:33907 every 8 connection(s)
I20260709 12:56:39.738332  1228 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37307
I20260709 12:56:39.738826  1228 heartbeater.cc:461] Registering TS with master...
I20260709 12:56:39.739723  1228 heartbeater.cc:507] Master 127.0.107.254:37307 requested a full tablet report, sending...
I20260709 12:56:39.742288   952 ts_manager.cc:194] Registered new tserver with Master: c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195:33907)
I20260709 12:56:39.743233   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017441338s
I20260709 12:56:39.744062   952 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35802
I20260709 12:56:39.770527   952 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35806:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:56:39.773461   952 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:56:39.856333  1044 tablet_service.cc:1511] Processing CreateTablet for tablet baf971c08239449a83cf7be22ab5bbb7 (DEFAULT_TABLE table=test-workload [id=15f3bae8bc54441e846a1942e40ddbb9]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:56:39.857506  1044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baf971c08239449a83cf7be22ab5bbb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.860550  1043 tablet_service.cc:1511] Processing CreateTablet for tablet 9987770ab9444666b6f418756936dbc7 (DEFAULT_TABLE table=test-workload [id=15f3bae8bc54441e846a1942e40ddbb9]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:56:39.861925  1043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9987770ab9444666b6f418756936dbc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.865543  1119 tablet_service.cc:1511] Processing CreateTablet for tablet baf971c08239449a83cf7be22ab5bbb7 (DEFAULT_TABLE table=test-workload [id=15f3bae8bc54441e846a1942e40ddbb9]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:56:39.865484  1118 tablet_service.cc:1511] Processing CreateTablet for tablet 9987770ab9444666b6f418756936dbc7 (DEFAULT_TABLE table=test-workload [id=15f3bae8bc54441e846a1942e40ddbb9]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:56:39.866989  1119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baf971c08239449a83cf7be22ab5bbb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.865427  1039 tablet_service.cc:1511] Processing CreateTablet for tablet d8b8dbcd5f024dd39f541938e3e01b49 (DEFAULT_TABLE table=test-workload [id=15f3bae8bc54441e846a1942e40ddbb9]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:56:39.866750  1041 tablet_service.cc:1511] Processing CreateTablet for tablet f9e11e115d2d4d858b28980f176c5059 (DEFAULT_TABLE table=test-workload [id=15f3bae8bc54441e846a1942e40ddbb9]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:56:39.867990  1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b8dbcd5f024dd39f541938e3e01b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.868637  1042 tablet_service.cc:1511] Processing CreateTablet for tablet 251001ae236c4740abfbadc79a3f8c7c (DEFAULT_TABLE table=test-workload [id=15f3bae8bc54441e846a1942e40ddbb9]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:56:39.869782  1038 tablet_service.cc:1511] Processing CreateTablet for tablet 269787bc590d4739b10e90ca065aacb7 (DEFAULT_TABLE table=test-workload [id=15f3bae8bc54441e846a1942e40ddbb9]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:56:39.870500  1040 tablet_service.cc:1511] Processing CreateTablet for tablet e7aa2dfe5f2b4248a04d97913ed09920 (DEFAULT_TABLE table=test-workload [id=15f3bae8bc54441e846a1942e40ddbb9]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:56:39.871169  1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 251001ae236c4740abfbadc79a3f8c7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.871744  1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7aa2dfe5f2b4248a04d97913ed09920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.875559  1037 tablet_service.cc:1511] Processing CreateTablet for tablet 95aa5762b14a479993f53d63b8a60f53 (DEFAULT_TABLE table=test-workload [id=15f3bae8bc54441e846a1942e40ddbb9]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:56:39.876837  1118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9987770ab9444666b6f418756936dbc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.877547  1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95aa5762b14a479993f53d63b8a60f53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.881138  1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9e11e115d2d4d858b28980f176c5059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.881137  1036 tablet_service.cc:1511] Processing CreateTablet for tablet 705f7616236847faa295b48d173caee6 (DEFAULT_TABLE table=test-workload [id=15f3bae8bc54441e846a1942e40ddbb9]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:56:39.884408  1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 705f7616236847faa295b48d173caee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.885084  1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 269787bc590d4739b10e90ca065aacb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.886708  1035 tablet_service.cc:1511] Processing CreateTablet for tablet 382f69f5402f47cd87dfcbadf4e26c91 (DEFAULT_TABLE table=test-workload [id=15f3bae8bc54441e846a1942e40ddbb9]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:56:39.888027  1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 382f69f5402f47cd87dfcbadf4e26c91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.891247  1117 tablet_service.cc:1511] Processing CreateTablet for tablet 251001ae236c4740abfbadc79a3f8c7c (DEFAULT_TABLE table=test-workload [id=15f3bae8bc54441e846a1942e40ddbb9]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:56:39.891515  1116 tablet_service.cc:1511] Processing CreateTablet for tablet f9e11e115d2d4d858b28980f176c5059 (DEFAULT_TABLE table=test-workload [id=15f3bae8bc54441e846a1942e40ddbb9]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:56:39.892609  1117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 251001ae236c4740abfbadc79a3f8c7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.894191  1115 tablet_service.cc:1511] Processing CreateTablet for tablet e7aa2dfe5f2b4248a04d97913ed09920 (DEFAULT_TABLE table=test-workload [id=15f3bae8bc54441e846a1942e40ddbb9]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:56:39.895493  1115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7aa2dfe5f2b4248a04d97913ed09920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.898164  1114 tablet_service.cc:1511] Processing CreateTablet for tablet d8b8dbcd5f024dd39f541938e3e01b49 (DEFAULT_TABLE table=test-workload [id=15f3bae8bc54441e846a1942e40ddbb9]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:56:39.900305  1191 tablet_service.cc:1511] Processing CreateTablet for tablet 251001ae236c4740abfbadc79a3f8c7c (DEFAULT_TABLE table=test-workload [id=15f3bae8bc54441e846a1942e40ddbb9]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:56:39.901721  1191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 251001ae236c4740abfbadc79a3f8c7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.901672  1192 tablet_service.cc:1511] Processing CreateTablet for tablet 9987770ab9444666b6f418756936dbc7 (DEFAULT_TABLE table=test-workload [id=15f3bae8bc54441e846a1942e40ddbb9]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:56:39.903080  1192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9987770ab9444666b6f418756936dbc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.903249  1111 tablet_service.cc:1511] Processing CreateTablet for tablet 705f7616236847faa295b48d173caee6 (DEFAULT_TABLE table=test-workload [id=15f3bae8bc54441e846a1942e40ddbb9]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:56:39.905450  1190 tablet_service.cc:1511] Processing CreateTablet for tablet f9e11e115d2d4d858b28980f176c5059 (DEFAULT_TABLE table=test-workload [id=15f3bae8bc54441e846a1942e40ddbb9]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:56:39.905606  1193 tablet_service.cc:1511] Processing CreateTablet for tablet baf971c08239449a83cf7be22ab5bbb7 (DEFAULT_TABLE table=test-workload [id=15f3bae8bc54441e846a1942e40ddbb9]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:56:39.906826  1190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9e11e115d2d4d858b28980f176c5059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.907483  1187 tablet_service.cc:1511] Processing CreateTablet for tablet 269787bc590d4739b10e90ca065aacb7 (DEFAULT_TABLE table=test-workload [id=15f3bae8bc54441e846a1942e40ddbb9]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:56:39.908943  1187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 269787bc590d4739b10e90ca065aacb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.909684  1188 tablet_service.cc:1511] Processing CreateTablet for tablet d8b8dbcd5f024dd39f541938e3e01b49 (DEFAULT_TABLE table=test-workload [id=15f3bae8bc54441e846a1942e40ddbb9]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:56:39.910934  1188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b8dbcd5f024dd39f541938e3e01b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.912812  1114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b8dbcd5f024dd39f541938e3e01b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.913267  1193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baf971c08239449a83cf7be22ab5bbb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.913964  1113 tablet_service.cc:1511] Processing CreateTablet for tablet 269787bc590d4739b10e90ca065aacb7 (DEFAULT_TABLE table=test-workload [id=15f3bae8bc54441e846a1942e40ddbb9]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:56:39.915261  1113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 269787bc590d4739b10e90ca065aacb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.917625  1116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9e11e115d2d4d858b28980f176c5059. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.918133  1112 tablet_service.cc:1511] Processing CreateTablet for tablet 95aa5762b14a479993f53d63b8a60f53 (DEFAULT_TABLE table=test-workload [id=15f3bae8bc54441e846a1942e40ddbb9]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:56:39.922308  1189 tablet_service.cc:1511] Processing CreateTablet for tablet e7aa2dfe5f2b4248a04d97913ed09920 (DEFAULT_TABLE table=test-workload [id=15f3bae8bc54441e846a1942e40ddbb9]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:56:39.922442  1110 tablet_service.cc:1511] Processing CreateTablet for tablet 382f69f5402f47cd87dfcbadf4e26c91 (DEFAULT_TABLE table=test-workload [id=15f3bae8bc54441e846a1942e40ddbb9]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:56:39.923786  1189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7aa2dfe5f2b4248a04d97913ed09920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.926822  1185 tablet_service.cc:1511] Processing CreateTablet for tablet 705f7616236847faa295b48d173caee6 (DEFAULT_TABLE table=test-workload [id=15f3bae8bc54441e846a1942e40ddbb9]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:56:39.930764  1184 tablet_service.cc:1511] Processing CreateTablet for tablet 382f69f5402f47cd87dfcbadf4e26c91 (DEFAULT_TABLE table=test-workload [id=15f3bae8bc54441e846a1942e40ddbb9]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:56:39.933856  1186 tablet_service.cc:1511] Processing CreateTablet for tablet 95aa5762b14a479993f53d63b8a60f53 (DEFAULT_TABLE table=test-workload [id=15f3bae8bc54441e846a1942e40ddbb9]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:56:39.935315  1185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 705f7616236847faa295b48d173caee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.938335  1186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95aa5762b14a479993f53d63b8a60f53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.939376  1111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 705f7616236847faa295b48d173caee6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.948778  1110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 382f69f5402f47cd87dfcbadf4e26c91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.948856  1184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 382f69f5402f47cd87dfcbadf4e26c91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.956028  1112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95aa5762b14a479993f53d63b8a60f53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:39.976570  1243 tablet_bootstrap.cc:492] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663: Bootstrap starting.
I20260709 12:56:40.079126  1243 tablet_bootstrap.cc:654] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.081838  1244 tablet_bootstrap.cc:492] T baf971c08239449a83cf7be22ab5bbb7 P d5ae6c7e36af45a7908e71a4052f51b4: Bootstrap starting.
I20260709 12:56:40.091033  1245 tablet_bootstrap.cc:492] T d8b8dbcd5f024dd39f541938e3e01b49 P c9bb6c25b3ed459085327bf0ec01ef4b: Bootstrap starting.
I20260709 12:56:40.108342  1245 tablet_bootstrap.cc:654] T d8b8dbcd5f024dd39f541938e3e01b49 P c9bb6c25b3ed459085327bf0ec01ef4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.110617  1243 tablet_bootstrap.cc:492] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663: No bootstrap required, opened a new log
I20260709 12:56:40.111411  1243 ts_tablet_manager.cc:1403] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663: Time spent bootstrapping tablet: real 0.135s	user 0.014s	sys 0.001s
I20260709 12:56:40.114804  1243 raft_consensus.cc:359] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.115675  1243 raft_consensus.cc:385] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.116001  1243 raft_consensus.cc:740] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8777a520aad74df8ba8304f6f9fc7663, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.125119  1243 consensus_queue.cc:260] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.149984  1244 tablet_bootstrap.cc:654] T baf971c08239449a83cf7be22ab5bbb7 P d5ae6c7e36af45a7908e71a4052f51b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.157258  1245 tablet_bootstrap.cc:492] T d8b8dbcd5f024dd39f541938e3e01b49 P c9bb6c25b3ed459085327bf0ec01ef4b: No bootstrap required, opened a new log
I20260709 12:56:40.157768  1245 ts_tablet_manager.cc:1403] T d8b8dbcd5f024dd39f541938e3e01b49 P c9bb6c25b3ed459085327bf0ec01ef4b: Time spent bootstrapping tablet: real 0.067s	user 0.023s	sys 0.017s
I20260709 12:56:40.160169  1245 raft_consensus.cc:359] T d8b8dbcd5f024dd39f541938e3e01b49 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.160787  1245 raft_consensus.cc:385] T d8b8dbcd5f024dd39f541938e3e01b49 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.161113  1245 raft_consensus.cc:740] T d8b8dbcd5f024dd39f541938e3e01b49 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.161896  1245 consensus_queue.cc:260] T d8b8dbcd5f024dd39f541938e3e01b49 P c9bb6c25b3ed459085327bf0ec01ef4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.164834  1245 ts_tablet_manager.cc:1434] T d8b8dbcd5f024dd39f541938e3e01b49 P c9bb6c25b3ed459085327bf0ec01ef4b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:56:40.166098  1245 tablet_bootstrap.cc:492] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b: Bootstrap starting.
I20260709 12:56:40.173390  1245 tablet_bootstrap.cc:654] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.180428  1245 tablet_bootstrap.cc:492] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b: No bootstrap required, opened a new log
I20260709 12:56:40.181025  1245 ts_tablet_manager.cc:1403] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.008s
I20260709 12:56:40.183785  1245 raft_consensus.cc:359] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.184391  1245 raft_consensus.cc:385] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.184720  1245 raft_consensus.cc:740] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.185387  1245 consensus_queue.cc:260] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.187187  1245 ts_tablet_manager.cc:1434] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 12:56:40.188186  1245 tablet_bootstrap.cc:492] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b: Bootstrap starting.
I20260709 12:56:40.195359  1245 tablet_bootstrap.cc:654] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.202342  1245 tablet_bootstrap.cc:492] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b: No bootstrap required, opened a new log
I20260709 12:56:40.202854  1245 ts_tablet_manager.cc:1403] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.001s
I20260709 12:56:40.206122  1245 raft_consensus.cc:359] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.206670  1154 heartbeater.cc:499] Master 127.0.107.254:37307 was elected leader, sending a full tablet report...
I20260709 12:56:40.206970  1245 raft_consensus.cc:385] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.207307  1245 raft_consensus.cc:740] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.208120  1245 consensus_queue.cc:260] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.210747  1245 ts_tablet_manager.cc:1434] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:56:40.211858  1245 tablet_bootstrap.cc:492] T baf971c08239449a83cf7be22ab5bbb7 P c9bb6c25b3ed459085327bf0ec01ef4b: Bootstrap starting.
I20260709 12:56:40.219005  1245 tablet_bootstrap.cc:654] T baf971c08239449a83cf7be22ab5bbb7 P c9bb6c25b3ed459085327bf0ec01ef4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.224517  1245 tablet_bootstrap.cc:492] T baf971c08239449a83cf7be22ab5bbb7 P c9bb6c25b3ed459085327bf0ec01ef4b: No bootstrap required, opened a new log
I20260709 12:56:40.225059  1245 ts_tablet_manager.cc:1403] T baf971c08239449a83cf7be22ab5bbb7 P c9bb6c25b3ed459085327bf0ec01ef4b: Time spent bootstrapping tablet: real 0.013s	user 0.005s	sys 0.007s
I20260709 12:56:40.227725  1245 raft_consensus.cc:359] T baf971c08239449a83cf7be22ab5bbb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.228554  1245 raft_consensus.cc:385] T baf971c08239449a83cf7be22ab5bbb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.228883  1245 raft_consensus.cc:740] T baf971c08239449a83cf7be22ab5bbb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.229622  1245 consensus_queue.cc:260] T baf971c08239449a83cf7be22ab5bbb7 P c9bb6c25b3ed459085327bf0ec01ef4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.231456  1245 ts_tablet_manager.cc:1434] T baf971c08239449a83cf7be22ab5bbb7 P c9bb6c25b3ed459085327bf0ec01ef4b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:56:40.232511  1245 tablet_bootstrap.cc:492] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b: Bootstrap starting.
I20260709 12:56:40.238417  1245 tablet_bootstrap.cc:654] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.240934  1243 ts_tablet_manager.cc:1434] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663: Time spent starting tablet: real 0.129s	user 0.009s	sys 0.016s
I20260709 12:56:40.243429  1245 tablet_bootstrap.cc:492] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b: No bootstrap required, opened a new log
I20260709 12:56:40.244004  1245 ts_tablet_manager.cc:1403] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:56:40.247097  1245 raft_consensus.cc:359] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.247874  1245 raft_consensus.cc:385] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.248181  1245 raft_consensus.cc:740] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.248994  1245 consensus_queue.cc:260] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.251380  1245 ts_tablet_manager.cc:1434] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:56:40.252381  1245 tablet_bootstrap.cc:492] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b: Bootstrap starting.
I20260709 12:56:40.259104  1245 tablet_bootstrap.cc:654] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.260761  1248 raft_consensus.cc:493] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:40.261270  1248 raft_consensus.cc:515] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.263923  1244 tablet_bootstrap.cc:492] T baf971c08239449a83cf7be22ab5bbb7 P d5ae6c7e36af45a7908e71a4052f51b4: No bootstrap required, opened a new log
I20260709 12:56:40.264415  1244 ts_tablet_manager.cc:1403] T baf971c08239449a83cf7be22ab5bbb7 P d5ae6c7e36af45a7908e71a4052f51b4: Time spent bootstrapping tablet: real 0.185s	user 0.016s	sys 0.000s
I20260709 12:56:40.267544  1244 raft_consensus.cc:359] T baf971c08239449a83cf7be22ab5bbb7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.268316  1244 raft_consensus.cc:385] T baf971c08239449a83cf7be22ab5bbb7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.268690  1244 raft_consensus.cc:740] T baf971c08239449a83cf7be22ab5bbb7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ae6c7e36af45a7908e71a4052f51b4, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.271785  1244 consensus_queue.cc:260] T baf971c08239449a83cf7be22ab5bbb7 P d5ae6c7e36af45a7908e71a4052f51b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.272667  1248 leader_election.cc:290] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117), c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195:33907)
I20260709 12:56:40.284309  1228 heartbeater.cc:499] Master 127.0.107.254:37307 was elected leader, sending a full tablet report...
I20260709 12:56:40.285562  1245 tablet_bootstrap.cc:492] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b: No bootstrap required, opened a new log
I20260709 12:56:40.286074  1245 ts_tablet_manager.cc:1403] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.023s
I20260709 12:56:40.287906  1079 heartbeater.cc:499] Master 127.0.107.254:37307 was elected leader, sending a full tablet report...
I20260709 12:56:40.288427  1244 ts_tablet_manager.cc:1434] T baf971c08239449a83cf7be22ab5bbb7 P d5ae6c7e36af45a7908e71a4052f51b4: Time spent starting tablet: real 0.024s	user 0.014s	sys 0.007s
I20260709 12:56:40.289420  1244 tablet_bootstrap.cc:492] T 269787bc590d4739b10e90ca065aacb7 P d5ae6c7e36af45a7908e71a4052f51b4: Bootstrap starting.
I20260709 12:56:40.290441  1245 raft_consensus.cc:359] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.291301  1245 raft_consensus.cc:385] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.291684  1245 raft_consensus.cc:740] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.292721  1245 consensus_queue.cc:260] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.295598  1245 ts_tablet_manager.cc:1434] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:56:40.296794  1245 tablet_bootstrap.cc:492] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b: Bootstrap starting.
I20260709 12:56:40.296947  1244 tablet_bootstrap.cc:654] T 269787bc590d4739b10e90ca065aacb7 P d5ae6c7e36af45a7908e71a4052f51b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.305543  1245 tablet_bootstrap.cc:654] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.307189  1243 tablet_bootstrap.cc:492] T 9987770ab9444666b6f418756936dbc7 P 8777a520aad74df8ba8304f6f9fc7663: Bootstrap starting.
I20260709 12:56:40.318006  1243 tablet_bootstrap.cc:654] T 9987770ab9444666b6f418756936dbc7 P 8777a520aad74df8ba8304f6f9fc7663: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.319905  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf971c08239449a83cf7be22ab5bbb7" candidate_uuid: "8777a520aad74df8ba8304f6f9fc7663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" is_pre_election: true
I20260709 12:56:40.320727  1054 raft_consensus.cc:2468] T baf971c08239449a83cf7be22ab5bbb7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8777a520aad74df8ba8304f6f9fc7663 in term 0.
I20260709 12:56:40.322312  1095 leader_election.cc:304] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8777a520aad74df8ba8304f6f9fc7663, d5ae6c7e36af45a7908e71a4052f51b4; no voters: 
I20260709 12:56:40.323261  1248 raft_consensus.cc:2804] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:40.323654  1248 raft_consensus.cc:493] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:40.324018  1248 raft_consensus.cc:3060] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.326675  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf971c08239449a83cf7be22ab5bbb7" candidate_uuid: "8777a520aad74df8ba8304f6f9fc7663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" is_pre_election: true
I20260709 12:56:40.308523  1244 tablet_bootstrap.cc:492] T 269787bc590d4739b10e90ca065aacb7 P d5ae6c7e36af45a7908e71a4052f51b4: No bootstrap required, opened a new log
I20260709 12:56:40.327616  1244 ts_tablet_manager.cc:1403] T 269787bc590d4739b10e90ca065aacb7 P d5ae6c7e36af45a7908e71a4052f51b4: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.009s
I20260709 12:56:40.327505  1203 raft_consensus.cc:2468] T baf971c08239449a83cf7be22ab5bbb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8777a520aad74df8ba8304f6f9fc7663 in term 0.
I20260709 12:56:40.330730  1244 raft_consensus.cc:359] T 269787bc590d4739b10e90ca065aacb7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.331501  1244 raft_consensus.cc:385] T 269787bc590d4739b10e90ca065aacb7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.331159  1248 raft_consensus.cc:515] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.331826  1244 raft_consensus.cc:740] T 269787bc590d4739b10e90ca065aacb7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ae6c7e36af45a7908e71a4052f51b4, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.332885  1244 consensus_queue.cc:260] T 269787bc590d4739b10e90ca065aacb7 P d5ae6c7e36af45a7908e71a4052f51b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.335361  1244 ts_tablet_manager.cc:1434] T 269787bc590d4739b10e90ca065aacb7 P d5ae6c7e36af45a7908e71a4052f51b4: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:56:40.336405  1244 tablet_bootstrap.cc:492] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4: Bootstrap starting.
I20260709 12:56:40.342060  1245 tablet_bootstrap.cc:492] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b: No bootstrap required, opened a new log
I20260709 12:56:40.342660  1245 ts_tablet_manager.cc:1403] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b: Time spent bootstrapping tablet: real 0.046s	user 0.022s	sys 0.017s
I20260709 12:56:40.342968  1243 tablet_bootstrap.cc:492] T 9987770ab9444666b6f418756936dbc7 P 8777a520aad74df8ba8304f6f9fc7663: No bootstrap required, opened a new log
I20260709 12:56:40.343117  1244 tablet_bootstrap.cc:654] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.343582  1243 ts_tablet_manager.cc:1403] T 9987770ab9444666b6f418756936dbc7 P 8777a520aad74df8ba8304f6f9fc7663: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.001s
I20260709 12:56:40.346395  1243 raft_consensus.cc:359] T 9987770ab9444666b6f418756936dbc7 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.347131  1243 raft_consensus.cc:385] T 9987770ab9444666b6f418756936dbc7 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.347427  1243 raft_consensus.cc:740] T 9987770ab9444666b6f418756936dbc7 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8777a520aad74df8ba8304f6f9fc7663, State: Initialized, Role: FOLLOWER
W20260709 12:56:40.348083  1000 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:56:40.345986  1245 raft_consensus.cc:359] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.348351  1243 consensus_queue.cc:260] T 9987770ab9444666b6f418756936dbc7 P 8777a520aad74df8ba8304f6f9fc7663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.349198  1245 raft_consensus.cc:385] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.349576  1245 raft_consensus.cc:740] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.350781  1245 consensus_queue.cc:260] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.353709  1245 ts_tablet_manager.cc:1434] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:56:40.354403  1248 leader_election.cc:290] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663 [CANDIDATE]: Term 1 election: Requested vote from peers d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117), c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195:33907)
I20260709 12:56:40.355064  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf971c08239449a83cf7be22ab5bbb7" candidate_uuid: "8777a520aad74df8ba8304f6f9fc7663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
I20260709 12:56:40.355227  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf971c08239449a83cf7be22ab5bbb7" candidate_uuid: "8777a520aad74df8ba8304f6f9fc7663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
I20260709 12:56:40.355723  1203 raft_consensus.cc:3060] T baf971c08239449a83cf7be22ab5bbb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.355816  1054 raft_consensus.cc:3060] T baf971c08239449a83cf7be22ab5bbb7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.354959  1244 tablet_bootstrap.cc:492] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4: No bootstrap required, opened a new log
I20260709 12:56:40.357338  1244 ts_tablet_manager.cc:1403] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4: Time spent bootstrapping tablet: real 0.021s	user 0.004s	sys 0.014s
I20260709 12:56:40.363258  1054 raft_consensus.cc:2468] T baf971c08239449a83cf7be22ab5bbb7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8777a520aad74df8ba8304f6f9fc7663 in term 1.
I20260709 12:56:40.363359  1244 raft_consensus.cc:359] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.364166  1244 raft_consensus.cc:385] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.364526  1244 raft_consensus.cc:740] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ae6c7e36af45a7908e71a4052f51b4, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.364665  1095 leader_election.cc:304] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8777a520aad74df8ba8304f6f9fc7663, d5ae6c7e36af45a7908e71a4052f51b4; no voters: 
I20260709 12:56:40.364933  1203 raft_consensus.cc:2468] T baf971c08239449a83cf7be22ab5bbb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8777a520aad74df8ba8304f6f9fc7663 in term 1.
I20260709 12:56:40.365309  1244 consensus_queue.cc:260] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.365985  1245 tablet_bootstrap.cc:492] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b: Bootstrap starting.
I20260709 12:56:40.368207  1263 raft_consensus.cc:2804] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:40.368743  1263 raft_consensus.cc:697] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 LEADER]: Becoming Leader. State: Replica: 8777a520aad74df8ba8304f6f9fc7663, State: Running, Role: LEADER
I20260709 12:56:40.369596  1263 consensus_queue.cc:237] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.373653  1245 tablet_bootstrap.cc:654] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.374089  1243 ts_tablet_manager.cc:1434] T 9987770ab9444666b6f418756936dbc7 P 8777a520aad74df8ba8304f6f9fc7663: Time spent starting tablet: real 0.030s	user 0.011s	sys 0.004s
I20260709 12:56:40.375087  1243 tablet_bootstrap.cc:492] T f9e11e115d2d4d858b28980f176c5059 P 8777a520aad74df8ba8304f6f9fc7663: Bootstrap starting.
I20260709 12:56:40.377935  1244 ts_tablet_manager.cc:1434] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:56:40.379002  1244 tablet_bootstrap.cc:492] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4: Bootstrap starting.
I20260709 12:56:40.381958  1243 tablet_bootstrap.cc:654] T f9e11e115d2d4d858b28980f176c5059 P 8777a520aad74df8ba8304f6f9fc7663: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.385200  1244 tablet_bootstrap.cc:654] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.385949  1249 raft_consensus.cc:493] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:40.386430  1249 raft_consensus.cc:515] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.388955  1249 leader_election.cc:290] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117), 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107)
I20260709 12:56:40.399453  1245 tablet_bootstrap.cc:492] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b: No bootstrap required, opened a new log
I20260709 12:56:40.401875  1245 ts_tablet_manager.cc:1403] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.007s
I20260709 12:56:40.406119  1244 tablet_bootstrap.cc:492] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4: No bootstrap required, opened a new log
I20260709 12:56:40.406742  1244 ts_tablet_manager.cc:1403] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.003s
I20260709 12:56:40.410991   952 catalog_manager.cc:5697] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "8777a520aad74df8ba8304f6f9fc7663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:40.405697  1245 raft_consensus.cc:359] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.415732  1245 raft_consensus.cc:385] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.416149  1245 raft_consensus.cc:740] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.416981  1244 raft_consensus.cc:359] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.417696  1244 raft_consensus.cc:385] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.418124  1244 raft_consensus.cc:740] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ae6c7e36af45a7908e71a4052f51b4, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.418443  1243 tablet_bootstrap.cc:492] T f9e11e115d2d4d858b28980f176c5059 P 8777a520aad74df8ba8304f6f9fc7663: No bootstrap required, opened a new log
I20260709 12:56:40.418705  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269787bc590d4739b10e90ca065aacb7" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8777a520aad74df8ba8304f6f9fc7663" is_pre_election: true
I20260709 12:56:40.418980  1243 ts_tablet_manager.cc:1403] T f9e11e115d2d4d858b28980f176c5059 P 8777a520aad74df8ba8304f6f9fc7663: Time spent bootstrapping tablet: real 0.044s	user 0.022s	sys 0.009s
I20260709 12:56:40.419765  1244 consensus_queue.cc:260] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
W20260709 12:56:40.420465  1167 leader_election.cc:343] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:40.422087  1243 raft_consensus.cc:359] T f9e11e115d2d4d858b28980f176c5059 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.422791  1243 raft_consensus.cc:385] T f9e11e115d2d4d858b28980f176c5059 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.423107  1243 raft_consensus.cc:740] T f9e11e115d2d4d858b28980f176c5059 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8777a520aad74df8ba8304f6f9fc7663, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.417723  1245 consensus_queue.cc:260] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.427173  1245 ts_tablet_manager.cc:1434] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:56:40.423692  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269787bc590d4739b10e90ca065aacb7" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" is_pre_election: true
I20260709 12:56:40.424062  1243 consensus_queue.cc:260] T f9e11e115d2d4d858b28980f176c5059 P 8777a520aad74df8ba8304f6f9fc7663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.427739  1054 raft_consensus.cc:2468] T 269787bc590d4739b10e90ca065aacb7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 0.
I20260709 12:56:40.425558  1244 ts_tablet_manager.cc:1434] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:56:40.429045  1169 leader_election.cc:304] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9bb6c25b3ed459085327bf0ec01ef4b, d5ae6c7e36af45a7908e71a4052f51b4; no voters: 8777a520aad74df8ba8304f6f9fc7663
I20260709 12:56:40.430094  1249 raft_consensus.cc:2804] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:40.430181  1244 tablet_bootstrap.cc:492] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4: Bootstrap starting.
I20260709 12:56:40.430413  1249 raft_consensus.cc:493] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:40.430781  1249 raft_consensus.cc:3060] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.429049  1245 tablet_bootstrap.cc:492] T 382f69f5402f47cd87dfcbadf4e26c91 P c9bb6c25b3ed459085327bf0ec01ef4b: Bootstrap starting.
I20260709 12:56:40.429049  1243 ts_tablet_manager.cc:1434] T f9e11e115d2d4d858b28980f176c5059 P 8777a520aad74df8ba8304f6f9fc7663: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:56:40.436776  1243 tablet_bootstrap.cc:492] T e7aa2dfe5f2b4248a04d97913ed09920 P 8777a520aad74df8ba8304f6f9fc7663: Bootstrap starting.
I20260709 12:56:40.437427  1244 tablet_bootstrap.cc:654] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.442901  1245 tablet_bootstrap.cc:654] T 382f69f5402f47cd87dfcbadf4e26c91 P c9bb6c25b3ed459085327bf0ec01ef4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.446585  1244 tablet_bootstrap.cc:492] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4: No bootstrap required, opened a new log
I20260709 12:56:40.447114  1244 ts_tablet_manager.cc:1403] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 12:56:40.449812  1243 tablet_bootstrap.cc:654] T e7aa2dfe5f2b4248a04d97913ed09920 P 8777a520aad74df8ba8304f6f9fc7663: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.450258  1244 raft_consensus.cc:359] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.450974  1244 raft_consensus.cc:385] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.451260  1244 raft_consensus.cc:740] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ae6c7e36af45a7908e71a4052f51b4, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.452083  1244 consensus_queue.cc:260] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.454533  1244 ts_tablet_manager.cc:1434] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:56:40.455513  1244 tablet_bootstrap.cc:492] T 705f7616236847faa295b48d173caee6 P d5ae6c7e36af45a7908e71a4052f51b4: Bootstrap starting.
I20260709 12:56:40.462816  1244 tablet_bootstrap.cc:654] T 705f7616236847faa295b48d173caee6 P d5ae6c7e36af45a7908e71a4052f51b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.463225  1245 tablet_bootstrap.cc:492] T 382f69f5402f47cd87dfcbadf4e26c91 P c9bb6c25b3ed459085327bf0ec01ef4b: No bootstrap required, opened a new log
I20260709 12:56:40.463773  1245 ts_tablet_manager.cc:1403] T 382f69f5402f47cd87dfcbadf4e26c91 P c9bb6c25b3ed459085327bf0ec01ef4b: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.011s
I20260709 12:56:40.466550  1245 raft_consensus.cc:359] T 382f69f5402f47cd87dfcbadf4e26c91 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.467141  1243 tablet_bootstrap.cc:492] T e7aa2dfe5f2b4248a04d97913ed09920 P 8777a520aad74df8ba8304f6f9fc7663: No bootstrap required, opened a new log
I20260709 12:56:40.467206  1245 raft_consensus.cc:385] T 382f69f5402f47cd87dfcbadf4e26c91 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.467646  1245 raft_consensus.cc:740] T 382f69f5402f47cd87dfcbadf4e26c91 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.467734  1243 ts_tablet_manager.cc:1403] T e7aa2dfe5f2b4248a04d97913ed09920 P 8777a520aad74df8ba8304f6f9fc7663: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.011s
I20260709 12:56:40.468505  1245 consensus_queue.cc:260] T 382f69f5402f47cd87dfcbadf4e26c91 P c9bb6c25b3ed459085327bf0ec01ef4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.469029  1249 raft_consensus.cc:515] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.470778  1243 raft_consensus.cc:359] T e7aa2dfe5f2b4248a04d97913ed09920 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.471509  1243 raft_consensus.cc:385] T e7aa2dfe5f2b4248a04d97913ed09920 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.471803  1243 raft_consensus.cc:740] T e7aa2dfe5f2b4248a04d97913ed09920 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8777a520aad74df8ba8304f6f9fc7663, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.472040  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269787bc590d4739b10e90ca065aacb7" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
I20260709 12:56:40.472750  1054 raft_consensus.cc:3060] T 269787bc590d4739b10e90ca065aacb7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.476114  1243 consensus_queue.cc:260] T e7aa2dfe5f2b4248a04d97913ed09920 P 8777a520aad74df8ba8304f6f9fc7663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.478447  1243 ts_tablet_manager.cc:1434] T e7aa2dfe5f2b4248a04d97913ed09920 P 8777a520aad74df8ba8304f6f9fc7663: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:56:40.479496  1243 tablet_bootstrap.cc:492] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663: Bootstrap starting.
I20260709 12:56:40.480316  1054 raft_consensus.cc:2468] T 269787bc590d4739b10e90ca065aacb7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 1.
I20260709 12:56:40.481220  1245 ts_tablet_manager.cc:1434] T 382f69f5402f47cd87dfcbadf4e26c91 P c9bb6c25b3ed459085327bf0ec01ef4b: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.009s
I20260709 12:56:40.481580  1169 leader_election.cc:304] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9bb6c25b3ed459085327bf0ec01ef4b, d5ae6c7e36af45a7908e71a4052f51b4; no voters: 
I20260709 12:56:40.482170  1245 tablet_bootstrap.cc:492] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b: Bootstrap starting.
I20260709 12:56:40.486073  1243 tablet_bootstrap.cc:654] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.478255  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269787bc590d4739b10e90ca065aacb7" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
I20260709 12:56:40.489327  1277 raft_consensus.cc:2804] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:40.490329  1258 raft_consensus.cc:493] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:40.491055  1245 tablet_bootstrap.cc:654] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.491441  1244 tablet_bootstrap.cc:492] T 705f7616236847faa295b48d173caee6 P d5ae6c7e36af45a7908e71a4052f51b4: No bootstrap required, opened a new log
W20260709 12:56:40.491730  1167 leader_election.cc:343] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:40.491925  1244 ts_tablet_manager.cc:1403] T 705f7616236847faa295b48d173caee6 P d5ae6c7e36af45a7908e71a4052f51b4: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.010s
I20260709 12:56:40.490958  1258 raft_consensus.cc:515] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.495198  1244 raft_consensus.cc:359] T 705f7616236847faa295b48d173caee6 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.497704  1244 raft_consensus.cc:385] T 705f7616236847faa295b48d173caee6 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.498039  1244 raft_consensus.cc:740] T 705f7616236847faa295b48d173caee6 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ae6c7e36af45a7908e71a4052f51b4, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.498840  1244 consensus_queue.cc:260] T 705f7616236847faa295b48d173caee6 P d5ae6c7e36af45a7908e71a4052f51b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.500125  1258 leader_election.cc:290] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107), c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195:33907)
I20260709 12:56:40.500778  1277 raft_consensus.cc:697] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Becoming Leader. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Running, Role: LEADER
I20260709 12:56:40.501313  1280 raft_consensus.cc:493] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:40.519081  1280 raft_consensus.cc:515] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.519556  1277 consensus_queue.cc:237] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.522046  1280 leader_election.cc:290] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117), 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107)
I20260709 12:56:40.522732  1280 raft_consensus.cc:493] T d8b8dbcd5f024dd39f541938e3e01b49 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:40.523216  1280 raft_consensus.cc:515] T d8b8dbcd5f024dd39f541938e3e01b49 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.523588  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9987770ab9444666b6f418756936dbc7" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8777a520aad74df8ba8304f6f9fc7663" is_pre_election: true
I20260709 12:56:40.524361  1129 raft_consensus.cc:2468] T 9987770ab9444666b6f418756936dbc7 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 0.
I20260709 12:56:40.526461  1167 leader_election.cc:304] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8777a520aad74df8ba8304f6f9fc7663, c9bb6c25b3ed459085327bf0ec01ef4b; no voters: 
I20260709 12:56:40.528059  1280 leader_election.cc:290] T d8b8dbcd5f024dd39f541938e3e01b49 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117), 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107)
I20260709 12:56:40.528733  1280 raft_consensus.cc:2804] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:40.529099  1280 raft_consensus.cc:493] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:40.529439  1280 raft_consensus.cc:3060] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.532883  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b8dbcd5f024dd39f541938e3e01b49" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8777a520aad74df8ba8304f6f9fc7663" is_pre_election: true
W20260709 12:56:40.536183  1167 leader_election.cc:343] T d8b8dbcd5f024dd39f541938e3e01b49 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:40.546065  1280 raft_consensus.cc:515] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.550606  1249 leader_election.cc:290] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 election: Requested vote from peers d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117), 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107)
I20260709 12:56:40.554260  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9987770ab9444666b6f418756936dbc7" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
I20260709 12:56:40.554978  1129 raft_consensus.cc:3060] T 9987770ab9444666b6f418756936dbc7 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.563206  1129 raft_consensus.cc:2468] T 9987770ab9444666b6f418756936dbc7 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 1.
I20260709 12:56:40.564775  1167 leader_election.cc:304] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8777a520aad74df8ba8304f6f9fc7663, c9bb6c25b3ed459085327bf0ec01ef4b; no voters: 
I20260709 12:56:40.566277  1249 raft_consensus.cc:2804] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:40.566224  1280 leader_election.cc:290] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 election: Requested vote from peers d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117), 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107)
I20260709 12:56:40.567135  1249 raft_consensus.cc:697] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Becoming Leader. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Running, Role: LEADER
I20260709 12:56:40.576778  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9987770ab9444666b6f418756936dbc7" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" is_pre_election: true
I20260709 12:56:40.577593  1054 raft_consensus.cc:2468] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 0.
I20260709 12:56:40.579241  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b8dbcd5f024dd39f541938e3e01b49" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" is_pre_election: true
I20260709 12:56:40.568238  1249 consensus_queue.cc:237] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.583747  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9987770ab9444666b6f418756936dbc7" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
I20260709 12:56:40.584535  1054 raft_consensus.cc:3060] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:40.600323  1169 leader_election.cc:343] T d8b8dbcd5f024dd39f541938e3e01b49 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:40.600919  1169 leader_election.cc:304] T d8b8dbcd5f024dd39f541938e3e01b49 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9bb6c25b3ed459085327bf0ec01ef4b; no voters: 8777a520aad74df8ba8304f6f9fc7663, d5ae6c7e36af45a7908e71a4052f51b4
I20260709 12:56:40.602626  1277 raft_consensus.cc:2749] T d8b8dbcd5f024dd39f541938e3e01b49 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:40.592286  1054 raft_consensus.cc:2468] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 1.
I20260709 12:56:40.615095  1277 raft_consensus.cc:493] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:40.615741  1277 raft_consensus.cc:515] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.617246  1244 ts_tablet_manager.cc:1434] T 705f7616236847faa295b48d173caee6 P d5ae6c7e36af45a7908e71a4052f51b4: Time spent starting tablet: real 0.125s	user 0.031s	sys 0.040s
I20260709 12:56:40.618834  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7aa2dfe5f2b4248a04d97913ed09920" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" is_pre_election: true
I20260709 12:56:40.619530  1054 raft_consensus.cc:2468] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 0.
I20260709 12:56:40.620609  1169 leader_election.cc:304] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9bb6c25b3ed459085327bf0ec01ef4b, d5ae6c7e36af45a7908e71a4052f51b4; no voters: 
I20260709 12:56:40.621570  1283 raft_consensus.cc:2804] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:40.621982  1283 raft_consensus.cc:493] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:40.622303  1283 raft_consensus.cc:3060] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.625365  1244 tablet_bootstrap.cc:492] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4: Bootstrap starting.
I20260709 12:56:40.625825  1245 tablet_bootstrap.cc:492] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b: No bootstrap required, opened a new log
I20260709 12:56:40.627136  1245 ts_tablet_manager.cc:1403] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b: Time spent bootstrapping tablet: real 0.145s	user 0.033s	sys 0.095s
I20260709 12:56:40.631031  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f69f5402f47cd87dfcbadf4e26c91" candidate_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8777a520aad74df8ba8304f6f9fc7663" is_pre_election: true
I20260709 12:56:40.630502   951 catalog_manager.cc:5697] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b reported cstate change: term changed from 0 to 1, leader changed from <none> to c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:40.632318  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f69f5402f47cd87dfcbadf4e26c91" candidate_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" is_pre_election: true
I20260709 12:56:40.633035  1203 raft_consensus.cc:2468] T 382f69f5402f47cd87dfcbadf4e26c91 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5ae6c7e36af45a7908e71a4052f51b4 in term 0.
I20260709 12:56:40.632447   951 catalog_manager.cc:5697] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b reported cstate change: term changed from 0 to 1, leader changed from <none> to c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:40.633747  1243 tablet_bootstrap.cc:492] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663: No bootstrap required, opened a new log
I20260709 12:56:40.634271  1243 ts_tablet_manager.cc:1403] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663: Time spent bootstrapping tablet: real 0.155s	user 0.058s	sys 0.082s
I20260709 12:56:40.634519  1245 raft_consensus.cc:359] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.634873  1017 leader_election.cc:304] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9bb6c25b3ed459085327bf0ec01ef4b, d5ae6c7e36af45a7908e71a4052f51b4; no voters: 
I20260709 12:56:40.635198  1245 raft_consensus.cc:385] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.635501  1245 raft_consensus.cc:740] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.635882  1285 raft_consensus.cc:2804] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:40.636291  1285 raft_consensus.cc:493] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:40.636225  1245 consensus_queue.cc:260] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.636801  1285 raft_consensus.cc:3060] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.637780  1243 raft_consensus.cc:359] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.629846  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7aa2dfe5f2b4248a04d97913ed09920" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8777a520aad74df8ba8304f6f9fc7663" is_pre_election: true
I20260709 12:56:40.638644  1245 ts_tablet_manager.cc:1434] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:56:40.638654  1243 raft_consensus.cc:385] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.638821  1129 raft_consensus.cc:2468] T e7aa2dfe5f2b4248a04d97913ed09920 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 0.
I20260709 12:56:40.639370  1243 raft_consensus.cc:740] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8777a520aad74df8ba8304f6f9fc7663, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.640134  1243 consensus_queue.cc:260] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.642218  1243 ts_tablet_manager.cc:1434] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:56:40.642812  1244 tablet_bootstrap.cc:654] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.643208  1243 tablet_bootstrap.cc:492] T 382f69f5402f47cd87dfcbadf4e26c91 P 8777a520aad74df8ba8304f6f9fc7663: Bootstrap starting.
W20260709 12:56:40.649161  1018 leader_election.cc:343] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:40.649644  1249 raft_consensus.cc:493] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:40.650110  1243 tablet_bootstrap.cc:654] T 382f69f5402f47cd87dfcbadf4e26c91 P 8777a520aad74df8ba8304f6f9fc7663: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.649910  1277 leader_election.cc:290] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117), 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107)
I20260709 12:56:40.650254  1249 raft_consensus.cc:515] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.654711  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705f7616236847faa295b48d173caee6" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8777a520aad74df8ba8304f6f9fc7663" is_pre_election: true
I20260709 12:56:40.655341  1283 raft_consensus.cc:515] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
W20260709 12:56:40.656519  1167 leader_election.cc:343] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:40.658387  1285 raft_consensus.cc:515] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.660620  1285 leader_election.cc:290] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 [CANDIDATE]: Term 1 election: Requested vote from peers 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107), c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195:33907)
I20260709 12:56:40.662191  1243 tablet_bootstrap.cc:492] T 382f69f5402f47cd87dfcbadf4e26c91 P 8777a520aad74df8ba8304f6f9fc7663: No bootstrap required, opened a new log
I20260709 12:56:40.662343  1283 leader_election.cc:290] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 election: Requested vote from peers d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117), 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107)
I20260709 12:56:40.662937  1243 ts_tablet_manager.cc:1403] T 382f69f5402f47cd87dfcbadf4e26c91 P 8777a520aad74df8ba8304f6f9fc7663: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 12:56:40.662354  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f69f5402f47cd87dfcbadf4e26c91" candidate_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
I20260709 12:56:40.663699  1203 raft_consensus.cc:3060] T 382f69f5402f47cd87dfcbadf4e26c91 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.664247  1249 leader_election.cc:290] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117), 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107)
I20260709 12:56:40.666018  1243 raft_consensus.cc:359] T 382f69f5402f47cd87dfcbadf4e26c91 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.666805  1243 raft_consensus.cc:385] T 382f69f5402f47cd87dfcbadf4e26c91 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.666595  1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7aa2dfe5f2b4248a04d97913ed09920" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
I20260709 12:56:40.667135  1243 raft_consensus.cc:740] T 382f69f5402f47cd87dfcbadf4e26c91 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8777a520aad74df8ba8304f6f9fc7663, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.667601  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f69f5402f47cd87dfcbadf4e26c91" candidate_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
I20260709 12:56:40.668061  1243 consensus_queue.cc:260] T 382f69f5402f47cd87dfcbadf4e26c91 P 8777a520aad74df8ba8304f6f9fc7663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.669075  1053 raft_consensus.cc:3060] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.670655  1243 ts_tablet_manager.cc:1434] T 382f69f5402f47cd87dfcbadf4e26c91 P 8777a520aad74df8ba8304f6f9fc7663: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:56:40.671082  1128 raft_consensus.cc:3060] T 382f69f5402f47cd87dfcbadf4e26c91 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.671808  1243 tablet_bootstrap.cc:492] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663: Bootstrap starting.
I20260709 12:56:40.670632  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7aa2dfe5f2b4248a04d97913ed09920" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
I20260709 12:56:40.672451  1129 raft_consensus.cc:3060] T e7aa2dfe5f2b4248a04d97913ed09920 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.676553  1053 raft_consensus.cc:2468] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 1.
I20260709 12:56:40.677744  1169 leader_election.cc:304] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9bb6c25b3ed459085327bf0ec01ef4b, d5ae6c7e36af45a7908e71a4052f51b4; no voters: 
I20260709 12:56:40.678632  1249 raft_consensus.cc:2804] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:40.679119  1243 tablet_bootstrap.cc:654] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.679152  1249 raft_consensus.cc:697] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Becoming Leader. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Running, Role: LEADER
I20260709 12:56:40.680174  1249 consensus_queue.cc:237] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.684931  1203 raft_consensus.cc:2468] T 382f69f5402f47cd87dfcbadf4e26c91 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ae6c7e36af45a7908e71a4052f51b4 in term 1.
I20260709 12:56:40.685667  1128 raft_consensus.cc:2468] T 382f69f5402f47cd87dfcbadf4e26c91 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ae6c7e36af45a7908e71a4052f51b4 in term 1.
I20260709 12:56:40.688764  1243 tablet_bootstrap.cc:492] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663: No bootstrap required, opened a new log
I20260709 12:56:40.688546  1129 raft_consensus.cc:2468] T e7aa2dfe5f2b4248a04d97913ed09920 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 1.
I20260709 12:56:40.689250  1243 ts_tablet_manager.cc:1403] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 12:56:40.691848  1018 leader_election.cc:304] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8777a520aad74df8ba8304f6f9fc7663, d5ae6c7e36af45a7908e71a4052f51b4; no voters: 
I20260709 12:56:40.692323  1243 raft_consensus.cc:359] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.692773  1285 raft_consensus.cc:2804] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:40.693113  1243 raft_consensus.cc:385] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.693279  1285 raft_consensus.cc:697] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 LEADER]: Becoming Leader. State: Replica: d5ae6c7e36af45a7908e71a4052f51b4, State: Running, Role: LEADER
I20260709 12:56:40.693454  1243 raft_consensus.cc:740] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8777a520aad74df8ba8304f6f9fc7663, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.694236  1285 consensus_queue.cc:237] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.694370  1243 consensus_queue.cc:260] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.696082  1244 tablet_bootstrap.cc:492] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4: No bootstrap required, opened a new log
I20260709 12:56:40.696661  1244 ts_tablet_manager.cc:1403] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4: Time spent bootstrapping tablet: real 0.072s	user 0.025s	sys 0.009s
I20260709 12:56:40.697414  1243 ts_tablet_manager.cc:1434] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:56:40.698446  1243 tablet_bootstrap.cc:492] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663: Bootstrap starting.
I20260709 12:56:40.694135  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705f7616236847faa295b48d173caee6" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" is_pre_election: true
I20260709 12:56:40.699118  1249 raft_consensus.cc:493] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:40.699265  1054 raft_consensus.cc:2468] T 705f7616236847faa295b48d173caee6 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 0.
I20260709 12:56:40.699923   950 catalog_manager.cc:5697] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b reported cstate change: term changed from 0 to 1, leader changed from <none> to c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:40.700939  1169 leader_election.cc:304] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9bb6c25b3ed459085327bf0ec01ef4b, d5ae6c7e36af45a7908e71a4052f51b4; no voters: 8777a520aad74df8ba8304f6f9fc7663
I20260709 12:56:40.701732  1283 raft_consensus.cc:2804] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:40.701463  1244 raft_consensus.cc:359] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.702106  1283 raft_consensus.cc:493] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:40.702380  1244 raft_consensus.cc:385] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.702500  1283 raft_consensus.cc:3060] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.702935  1244 raft_consensus.cc:740] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ae6c7e36af45a7908e71a4052f51b4, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.703819  1244 consensus_queue.cc:260] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.704743  1243 tablet_bootstrap.cc:654] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.706195  1244 ts_tablet_manager.cc:1434] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:56:40.707324  1244 tablet_bootstrap.cc:492] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4: Bootstrap starting.
I20260709 12:56:40.709803  1283 raft_consensus.cc:515] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.712900  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705f7616236847faa295b48d173caee6" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
I20260709 12:56:40.713526  1054 raft_consensus.cc:3060] T 705f7616236847faa295b48d173caee6 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.714360  1244 tablet_bootstrap.cc:654] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.716432  1249 raft_consensus.cc:515] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.720181  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705f7616236847faa295b48d173caee6" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
W20260709 12:56:40.721606  1167 leader_election.cc:343] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:40.722179  1283 leader_election.cc:290] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 election: Requested vote from peers d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117), 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107)
I20260709 12:56:40.724217  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251001ae236c4740abfbadc79a3f8c7c" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8777a520aad74df8ba8304f6f9fc7663" is_pre_election: true
I20260709 12:56:40.724879  1128 raft_consensus.cc:2468] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 0.
I20260709 12:56:40.725993  1167 leader_election.cc:304] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8777a520aad74df8ba8304f6f9fc7663, c9bb6c25b3ed459085327bf0ec01ef4b; no voters: 
I20260709 12:56:40.726421  1054 raft_consensus.cc:2468] T 705f7616236847faa295b48d173caee6 P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 1.
I20260709 12:56:40.726982  1283 raft_consensus.cc:2804] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:40.727341  1283 raft_consensus.cc:493] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:40.727560  1169 leader_election.cc:304] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9bb6c25b3ed459085327bf0ec01ef4b, d5ae6c7e36af45a7908e71a4052f51b4; no voters: 8777a520aad74df8ba8304f6f9fc7663
I20260709 12:56:40.727998  1249 leader_election.cc:290] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117), 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107)
I20260709 12:56:40.728463  1249 raft_consensus.cc:2804] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:40.728961  1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251001ae236c4740abfbadc79a3f8c7c" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" is_pre_election: true
I20260709 12:56:40.729363  1249 raft_consensus.cc:697] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Becoming Leader. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Running, Role: LEADER
W20260709 12:56:40.730373  1169 leader_election.cc:343] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:40.730188  1249 consensus_queue.cc:237] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.727689  1283 raft_consensus.cc:3060] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.739706  1277 raft_consensus.cc:493] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:40.740324  1277 raft_consensus.cc:515] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.743270  1244 tablet_bootstrap.cc:492] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4: No bootstrap required, opened a new log
I20260709 12:56:40.743405  1243 tablet_bootstrap.cc:492] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663: No bootstrap required, opened a new log
I20260709 12:56:40.743786  1244 ts_tablet_manager.cc:1403] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.016s
I20260709 12:56:40.743034   950 catalog_manager.cc:5697] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:40.743902  1243 ts_tablet_manager.cc:1403] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.013s
I20260709 12:56:40.744892  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e11e115d2d4d858b28980f176c5059" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" is_pre_election: true
I20260709 12:56:40.745321  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e11e115d2d4d858b28980f176c5059" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8777a520aad74df8ba8304f6f9fc7663" is_pre_election: true
I20260709 12:56:40.745546  1054 raft_consensus.cc:2468] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 0.
I20260709 12:56:40.745890  1128 raft_consensus.cc:2468] T f9e11e115d2d4d858b28980f176c5059 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 0.
I20260709 12:56:40.746474  1244 raft_consensus.cc:359] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.746704  1169 leader_election.cc:304] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9bb6c25b3ed459085327bf0ec01ef4b, d5ae6c7e36af45a7908e71a4052f51b4; no voters: 
I20260709 12:56:40.746958  1243 raft_consensus.cc:359] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.747176  1244 raft_consensus.cc:385] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.743273  1277 leader_election.cc:290] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117), 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107)
I20260709 12:56:40.747656  1280 raft_consensus.cc:2804] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:40.747757  1243 raft_consensus.cc:385] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.747898  1244 raft_consensus.cc:740] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ae6c7e36af45a7908e71a4052f51b4, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.748188  1280 raft_consensus.cc:493] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:40.748390  1243 raft_consensus.cc:740] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8777a520aad74df8ba8304f6f9fc7663, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.748881  1280 raft_consensus.cc:3060] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.748891  1244 consensus_queue.cc:260] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.739778  1283 raft_consensus.cc:515] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.749559  1243 consensus_queue.cc:260] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.751294  1244 ts_tablet_manager.cc:1434] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:56:40.752226  1244 tablet_bootstrap.cc:492] T d8b8dbcd5f024dd39f541938e3e01b49 P d5ae6c7e36af45a7908e71a4052f51b4: Bootstrap starting.
I20260709 12:56:40.753257  1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251001ae236c4740abfbadc79a3f8c7c" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
I20260709 12:56:40.753959  1053 raft_consensus.cc:3060] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.754629  1243 ts_tablet_manager.cc:1434] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:56:40.755668  1243 tablet_bootstrap.cc:492] T 705f7616236847faa295b48d173caee6 P 8777a520aad74df8ba8304f6f9fc7663: Bootstrap starting.
I20260709 12:56:40.755717  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251001ae236c4740abfbadc79a3f8c7c" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
I20260709 12:56:40.756399  1128 raft_consensus.cc:3060] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.757789  1244 tablet_bootstrap.cc:654] T d8b8dbcd5f024dd39f541938e3e01b49 P d5ae6c7e36af45a7908e71a4052f51b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.762162  1243 tablet_bootstrap.cc:654] T 705f7616236847faa295b48d173caee6 P 8777a520aad74df8ba8304f6f9fc7663: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.763211  1128 raft_consensus.cc:2468] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 1.
I20260709 12:56:40.764525  1167 leader_election.cc:304] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8777a520aad74df8ba8304f6f9fc7663, c9bb6c25b3ed459085327bf0ec01ef4b; no voters: 
I20260709 12:56:40.765367  1277 raft_consensus.cc:2804] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:40.775174  1243 tablet_bootstrap.cc:492] T 705f7616236847faa295b48d173caee6 P 8777a520aad74df8ba8304f6f9fc7663: No bootstrap required, opened a new log
I20260709 12:56:40.775882  1243 ts_tablet_manager.cc:1403] T 705f7616236847faa295b48d173caee6 P 8777a520aad74df8ba8304f6f9fc7663: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.005s
I20260709 12:56:40.764497  1283 leader_election.cc:290] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 election: Requested vote from peers d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117), 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107)
I20260709 12:56:40.778211  1277 raft_consensus.cc:697] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Becoming Leader. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Running, Role: LEADER
I20260709 12:56:40.778657  1280 raft_consensus.cc:515] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.779137  1277 consensus_queue.cc:237] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.779287  1243 raft_consensus.cc:359] T 705f7616236847faa295b48d173caee6 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.780227  1243 raft_consensus.cc:385] T 705f7616236847faa295b48d173caee6 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.780614  1243 raft_consensus.cc:740] T 705f7616236847faa295b48d173caee6 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8777a520aad74df8ba8304f6f9fc7663, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.781522  1243 consensus_queue.cc:260] T 705f7616236847faa295b48d173caee6 P 8777a520aad74df8ba8304f6f9fc7663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.782022  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e11e115d2d4d858b28980f176c5059" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
I20260709 12:56:40.782609  1128 raft_consensus.cc:3060] T f9e11e115d2d4d858b28980f176c5059 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.787065  1243 ts_tablet_manager.cc:1434] T 705f7616236847faa295b48d173caee6 P 8777a520aad74df8ba8304f6f9fc7663: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:56:40.781647  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e11e115d2d4d858b28980f176c5059" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
I20260709 12:56:40.787802  1263 consensus_queue.cc:1048] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:40.788444  1243 tablet_bootstrap.cc:492] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663: Bootstrap starting.
I20260709 12:56:40.787806  1054 raft_consensus.cc:3060] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.794329  1128 raft_consensus.cc:2468] T f9e11e115d2d4d858b28980f176c5059 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 1.
I20260709 12:56:40.795433  1167 leader_election.cc:304] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8777a520aad74df8ba8304f6f9fc7663, c9bb6c25b3ed459085327bf0ec01ef4b; no voters: 
I20260709 12:56:40.795723  1243 tablet_bootstrap.cc:654] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.796730  1298 raft_consensus.cc:2804] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:40.803440   949 catalog_manager.cc:5697] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b reported cstate change: term changed from 0 to 1, leader changed from <none> to c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:40.807816  1263 consensus_queue.cc:1048] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:40.797252  1298 raft_consensus.cc:697] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Becoming Leader. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Running, Role: LEADER
I20260709 12:56:40.810981  1298 consensus_queue.cc:237] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.826395  1053 raft_consensus.cc:2468] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 1.
I20260709 12:56:40.831771  1054 raft_consensus.cc:2468] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 1.
I20260709 12:56:40.833921  1280 leader_election.cc:290] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 election: Requested vote from peers d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117), 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107)
I20260709 12:56:40.846529  1243 tablet_bootstrap.cc:492] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663: No bootstrap required, opened a new log
I20260709 12:56:40.847146  1243 ts_tablet_manager.cc:1403] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.008s
I20260709 12:56:40.850173  1244 tablet_bootstrap.cc:492] T d8b8dbcd5f024dd39f541938e3e01b49 P d5ae6c7e36af45a7908e71a4052f51b4: No bootstrap required, opened a new log
I20260709 12:56:40.850369  1243 raft_consensus.cc:359] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.853174  1243 raft_consensus.cc:385] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.850672  1244 ts_tablet_manager.cc:1403] T d8b8dbcd5f024dd39f541938e3e01b49 P d5ae6c7e36af45a7908e71a4052f51b4: Time spent bootstrapping tablet: real 0.099s	user 0.035s	sys 0.042s
I20260709 12:56:40.855335  1243 raft_consensus.cc:740] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8777a520aad74df8ba8304f6f9fc7663, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.854223   950 catalog_manager.cc:5697] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b reported cstate change: term changed from 0 to 1, leader changed from <none> to c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:40.856257  1243 consensus_queue.cc:260] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.857756  1244 raft_consensus.cc:359] T d8b8dbcd5f024dd39f541938e3e01b49 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.857220   950 catalog_manager.cc:5697] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b reported cstate change: term changed from 0 to 1, leader changed from <none> to c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:40.858419  1244 raft_consensus.cc:385] T d8b8dbcd5f024dd39f541938e3e01b49 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.858714  1244 raft_consensus.cc:740] T d8b8dbcd5f024dd39f541938e3e01b49 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ae6c7e36af45a7908e71a4052f51b4, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.860769  1244 consensus_queue.cc:260] T d8b8dbcd5f024dd39f541938e3e01b49 P d5ae6c7e36af45a7908e71a4052f51b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.862816  1244 ts_tablet_manager.cc:1434] T d8b8dbcd5f024dd39f541938e3e01b49 P d5ae6c7e36af45a7908e71a4052f51b4: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:56:40.864218  1244 tablet_bootstrap.cc:492] T 95aa5762b14a479993f53d63b8a60f53 P d5ae6c7e36af45a7908e71a4052f51b4: Bootstrap starting.
I20260709 12:56:40.867640  1243 ts_tablet_manager.cc:1434] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 12:56:40.868696  1263 raft_consensus.cc:493] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:40.869202  1263 raft_consensus.cc:515] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.871244  1263 leader_election.cc:290] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117), c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195:33907)
I20260709 12:56:40.876803  1202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b8dbcd5f024dd39f541938e3e01b49" candidate_uuid: "8777a520aad74df8ba8304f6f9fc7663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" is_pre_election: true
I20260709 12:56:40.877318  1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b8dbcd5f024dd39f541938e3e01b49" candidate_uuid: "8777a520aad74df8ba8304f6f9fc7663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" is_pre_election: true
I20260709 12:56:40.877523  1202 raft_consensus.cc:2468] T d8b8dbcd5f024dd39f541938e3e01b49 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8777a520aad74df8ba8304f6f9fc7663 in term 0.
I20260709 12:56:40.878094  1053 raft_consensus.cc:2468] T d8b8dbcd5f024dd39f541938e3e01b49 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8777a520aad74df8ba8304f6f9fc7663 in term 0.
I20260709 12:56:40.878882  1092 leader_election.cc:304] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8777a520aad74df8ba8304f6f9fc7663, c9bb6c25b3ed459085327bf0ec01ef4b; no voters: 
I20260709 12:56:40.879808  1263 raft_consensus.cc:2804] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:40.880187  1263 raft_consensus.cc:493] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:40.880548  1263 raft_consensus.cc:3060] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.877720  1244 tablet_bootstrap.cc:654] T 95aa5762b14a479993f53d63b8a60f53 P d5ae6c7e36af45a7908e71a4052f51b4: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:40.889292  1263 raft_consensus.cc:515] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.892398  1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b8dbcd5f024dd39f541938e3e01b49" candidate_uuid: "8777a520aad74df8ba8304f6f9fc7663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
I20260709 12:56:40.893064  1053 raft_consensus.cc:3060] T d8b8dbcd5f024dd39f541938e3e01b49 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.893141  1263 leader_election.cc:290] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663 [CANDIDATE]: Term 1 election: Requested vote from peers d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117), c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195:33907)
I20260709 12:56:40.893182  1244 tablet_bootstrap.cc:492] T 95aa5762b14a479993f53d63b8a60f53 P d5ae6c7e36af45a7908e71a4052f51b4: No bootstrap required, opened a new log
I20260709 12:56:40.893754  1202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b8dbcd5f024dd39f541938e3e01b49" candidate_uuid: "8777a520aad74df8ba8304f6f9fc7663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
I20260709 12:56:40.894426  1244 ts_tablet_manager.cc:1403] T 95aa5762b14a479993f53d63b8a60f53 P d5ae6c7e36af45a7908e71a4052f51b4: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.004s
I20260709 12:56:40.894387  1202 raft_consensus.cc:3060] T d8b8dbcd5f024dd39f541938e3e01b49 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.897389  1244 raft_consensus.cc:359] T 95aa5762b14a479993f53d63b8a60f53 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.898193  1244 raft_consensus.cc:385] T 95aa5762b14a479993f53d63b8a60f53 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:40.898535  1244 raft_consensus.cc:740] T 95aa5762b14a479993f53d63b8a60f53 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5ae6c7e36af45a7908e71a4052f51b4, State: Initialized, Role: FOLLOWER
I20260709 12:56:40.899262  1244 consensus_queue.cc:260] T 95aa5762b14a479993f53d63b8a60f53 P d5ae6c7e36af45a7908e71a4052f51b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.900908  1053 raft_consensus.cc:2468] T d8b8dbcd5f024dd39f541938e3e01b49 P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8777a520aad74df8ba8304f6f9fc7663 in term 1.
I20260709 12:56:40.901518  1244 ts_tablet_manager.cc:1434] T 95aa5762b14a479993f53d63b8a60f53 P d5ae6c7e36af45a7908e71a4052f51b4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:56:40.902611  1095 leader_election.cc:304] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8777a520aad74df8ba8304f6f9fc7663, d5ae6c7e36af45a7908e71a4052f51b4; no voters: 
I20260709 12:56:40.904081  1202 raft_consensus.cc:2468] T d8b8dbcd5f024dd39f541938e3e01b49 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8777a520aad74df8ba8304f6f9fc7663 in term 1.
I20260709 12:56:40.905352  1263 raft_consensus.cc:2804] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:40.905843  1263 raft_consensus.cc:697] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 LEADER]: Becoming Leader. State: Replica: 8777a520aad74df8ba8304f6f9fc7663, State: Running, Role: LEADER
I20260709 12:56:40.906680  1263 consensus_queue.cc:237] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.914347   949 catalog_manager.cc:5697] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "8777a520aad74df8ba8304f6f9fc7663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:40.949942  1298 consensus_queue.cc:1048] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:40.959033  1128 raft_consensus.cc:3060] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:40.967984  1298 consensus_queue.cc:1048] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:40.977363  1280 consensus_queue.cc:1048] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:40.989717  1249 consensus_queue.cc:1048] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:40.994647  1263 raft_consensus.cc:493] T 705f7616236847faa295b48d173caee6 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:40.995198  1263 raft_consensus.cc:515] T 705f7616236847faa295b48d173caee6 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:40.997432  1263 leader_election.cc:290] T 705f7616236847faa295b48d173caee6 P 8777a520aad74df8ba8304f6f9fc7663 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117), c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195:33907)
I20260709 12:56:40.998571  1202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705f7616236847faa295b48d173caee6" candidate_uuid: "8777a520aad74df8ba8304f6f9fc7663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" is_pre_election: true
I20260709 12:56:40.998724  1298 raft_consensus.cc:493] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:40.999243  1298 raft_consensus.cc:515] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:41.000878  1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705f7616236847faa295b48d173caee6" candidate_uuid: "8777a520aad74df8ba8304f6f9fc7663" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" is_pre_election: true
I20260709 12:56:41.001688  1053 raft_consensus.cc:2393] T 705f7616236847faa295b48d173caee6 P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8777a520aad74df8ba8304f6f9fc7663 in current term 1: Already voted for candidate c9bb6c25b3ed459085327bf0ec01ef4b in this term.
I20260709 12:56:41.001948  1298 leader_election.cc:290] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117), 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107)
I20260709 12:56:41.002298  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95aa5762b14a479993f53d63b8a60f53" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8777a520aad74df8ba8304f6f9fc7663" is_pre_election: true
I20260709 12:56:41.002738  1095 leader_election.cc:304] T 705f7616236847faa295b48d173caee6 P 8777a520aad74df8ba8304f6f9fc7663 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8777a520aad74df8ba8304f6f9fc7663; no voters: c9bb6c25b3ed459085327bf0ec01ef4b, d5ae6c7e36af45a7908e71a4052f51b4
I20260709 12:56:41.003019  1128 raft_consensus.cc:2468] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 0.
I20260709 12:56:41.004402  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95aa5762b14a479993f53d63b8a60f53" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" is_pre_election: true
I20260709 12:56:41.004624  1263 raft_consensus.cc:3060] T 705f7616236847faa295b48d173caee6 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:41.005106  1054 raft_consensus.cc:2468] T 95aa5762b14a479993f53d63b8a60f53 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 0.
I20260709 12:56:41.006101  1167 leader_election.cc:304] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8777a520aad74df8ba8304f6f9fc7663, c9bb6c25b3ed459085327bf0ec01ef4b; no voters: 
I20260709 12:56:41.006904  1298 raft_consensus.cc:2804] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:41.007308  1298 raft_consensus.cc:493] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:41.007608  1298 raft_consensus.cc:3060] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:41.010883  1263 raft_consensus.cc:2749] T 705f7616236847faa295b48d173caee6 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:41.013892  1298 raft_consensus.cc:515] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:41.015472  1298 leader_election.cc:290] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 election: Requested vote from peers d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117), 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107)
I20260709 12:56:41.016311  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95aa5762b14a479993f53d63b8a60f53" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
I20260709 12:56:41.016505  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95aa5762b14a479993f53d63b8a60f53" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
I20260709 12:56:41.016845  1054 raft_consensus.cc:3060] T 95aa5762b14a479993f53d63b8a60f53 P d5ae6c7e36af45a7908e71a4052f51b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:41.017032  1128 raft_consensus.cc:3060] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:41.021633  1054 raft_consensus.cc:2468] T 95aa5762b14a479993f53d63b8a60f53 P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 1.
I20260709 12:56:41.021688  1128 raft_consensus.cc:2468] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 1.
I20260709 12:56:41.022723  1169 leader_election.cc:304] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9bb6c25b3ed459085327bf0ec01ef4b, d5ae6c7e36af45a7908e71a4052f51b4; no voters: 
I20260709 12:56:41.023689  1298 raft_consensus.cc:2804] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:41.024158  1298 raft_consensus.cc:697] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Becoming Leader. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Running, Role: LEADER
I20260709 12:56:41.024971  1298 consensus_queue.cc:237] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:41.034433   949 catalog_manager.cc:5697] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b reported cstate change: term changed from 0 to 1, leader changed from <none> to c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:41.126065  1285 consensus_queue.cc:1048] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:41.138996  1318 consensus_queue.cc:1048] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:41.140308  1129 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "baf971c08239449a83cf7be22ab5bbb7"
dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
mode: GRACEFUL
new_leader_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
 from {username='slave'} at 127.0.0.1:43008
I20260709 12:56:41.140983  1129 raft_consensus.cc:606] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 LEADER]: Received request to transfer leadership to TS d5ae6c7e36af45a7908e71a4052f51b4
I20260709 12:56:41.148394  1298 consensus_queue.cc:1048] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:56:41.154343   983 debug-util.cc:398] Leaking SignalData structure 0x7b0800050180 after lost signal to thread 434
W20260709 12:56:41.155324   983 debug-util.cc:398] Leaking SignalData structure 0x7b0800050860 after lost signal to thread 986
W20260709 12:56:41.156405   983 debug-util.cc:398] Leaking SignalData structure 0x7b08001945c0 after lost signal to thread 1081
I20260709 12:56:41.158804  1298 consensus_queue.cc:1048] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:41.165246  1202 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9987770ab9444666b6f418756936dbc7"
dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
mode: GRACEFUL
new_leader_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
 from {username='slave'} at 127.0.0.1:44068
I20260709 12:56:41.165864  1202 raft_consensus.cc:606] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Received request to transfer leadership to TS d5ae6c7e36af45a7908e71a4052f51b4
I20260709 12:56:41.173696  1202 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "251001ae236c4740abfbadc79a3f8c7c"
dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
mode: GRACEFUL
new_leader_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
 from {username='slave'} at 127.0.0.1:44068
I20260709 12:56:41.174304  1202 raft_consensus.cc:606] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Received request to transfer leadership to TS d5ae6c7e36af45a7908e71a4052f51b4
I20260709 12:56:41.173643  1283 consensus_queue.cc:1048] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:56:41.176118  1277 consensus_queue.cc:1048] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:41.185775  1202 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9e11e115d2d4d858b28980f176c5059"
dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
mode: GRACEFUL
new_leader_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
 from {username='slave'} at 127.0.0.1:44068
I20260709 12:56:41.186398  1202 raft_consensus.cc:606] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Received request to transfer leadership to TS d5ae6c7e36af45a7908e71a4052f51b4
I20260709 12:56:41.196213  1202 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7aa2dfe5f2b4248a04d97913ed09920"
dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
mode: GRACEFUL
new_leader_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
 from {username='slave'} at 127.0.0.1:44068
I20260709 12:56:41.196897  1202 raft_consensus.cc:606] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Received request to transfer leadership to TS d5ae6c7e36af45a7908e71a4052f51b4
I20260709 12:56:41.211308  1202 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "269787bc590d4739b10e90ca065aacb7"
dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
mode: GRACEFUL
new_leader_uuid: "8777a520aad74df8ba8304f6f9fc7663"
 from {username='slave'} at 127.0.0.1:44068
I20260709 12:56:41.212016  1202 raft_consensus.cc:606] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Received request to transfer leadership to TS 8777a520aad74df8ba8304f6f9fc7663
I20260709 12:56:41.218497  1202 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95aa5762b14a479993f53d63b8a60f53"
dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
mode: GRACEFUL
new_leader_uuid: "8777a520aad74df8ba8304f6f9fc7663"
 from {username='slave'} at 127.0.0.1:44068
I20260709 12:56:41.219136  1202 raft_consensus.cc:606] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Received request to transfer leadership to TS 8777a520aad74df8ba8304f6f9fc7663
I20260709 12:56:41.225670  1202 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "705f7616236847faa295b48d173caee6"
dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
mode: GRACEFUL
new_leader_uuid: "8777a520aad74df8ba8304f6f9fc7663"
 from {username='slave'} at 127.0.0.1:44068
I20260709 12:56:41.226289  1202 raft_consensus.cc:606] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Received request to transfer leadership to TS 8777a520aad74df8ba8304f6f9fc7663
I20260709 12:56:41.235632  1283 raft_consensus.cc:993] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b: : Instructing follower 8777a520aad74df8ba8304f6f9fc7663 to start an election
I20260709 12:56:41.236166  1283 raft_consensus.cc:1081] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Signalling peer 8777a520aad74df8ba8304f6f9fc7663 to start an election
I20260709 12:56:41.238459  1129 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "705f7616236847faa295b48d173caee6"
dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
 from {username='slave'} at 127.0.0.1:42990
I20260709 12:56:41.240048  1129 raft_consensus.cc:493] T 705f7616236847faa295b48d173caee6 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:41.240525  1129 raft_consensus.cc:3060] T 705f7616236847faa295b48d173caee6 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:41.247480  1129 raft_consensus.cc:515] T 705f7616236847faa295b48d173caee6 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:41.250620  1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705f7616236847faa295b48d173caee6" candidate_uuid: "8777a520aad74df8ba8304f6f9fc7663" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
I20260709 12:56:41.251230  1053 raft_consensus.cc:3060] T 705f7616236847faa295b48d173caee6 P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:41.251538  1202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705f7616236847faa295b48d173caee6" candidate_uuid: "8777a520aad74df8ba8304f6f9fc7663" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
I20260709 12:56:41.252113  1202 raft_consensus.cc:3055] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:41.252573  1202 raft_consensus.cc:740] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Running, Role: LEADER
I20260709 12:56:41.253441  1202 consensus_queue.cc:260] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:41.254531  1202 raft_consensus.cc:3060] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:41.256727  1129 leader_election.cc:290] T 705f7616236847faa295b48d173caee6 P 8777a520aad74df8ba8304f6f9fc7663 [CANDIDATE]: Term 2 election: Requested vote from peers d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117), c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195:33907)
I20260709 12:56:41.258481  1054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "382f69f5402f47cd87dfcbadf4e26c91"
dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
mode: GRACEFUL
new_leader_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
 from {username='slave'} at 127.0.0.1:58124
I20260709 12:56:41.259125  1054 raft_consensus.cc:606] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 LEADER]: Received request to transfer leadership to TS c9bb6c25b3ed459085327bf0ec01ef4b
I20260709 12:56:41.260349  1053 raft_consensus.cc:2468] T 705f7616236847faa295b48d173caee6 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8777a520aad74df8ba8304f6f9fc7663 in term 2.
I20260709 12:56:41.261641  1095 leader_election.cc:304] T 705f7616236847faa295b48d173caee6 P 8777a520aad74df8ba8304f6f9fc7663 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8777a520aad74df8ba8304f6f9fc7663, d5ae6c7e36af45a7908e71a4052f51b4; no voters: 
I20260709 12:56:41.262763  1263 raft_consensus.cc:2804] T 705f7616236847faa295b48d173caee6 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:41.263640  1263 raft_consensus.cc:697] T 705f7616236847faa295b48d173caee6 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 LEADER]: Becoming Leader. State: Replica: 8777a520aad74df8ba8304f6f9fc7663, State: Running, Role: LEADER
I20260709 12:56:41.264091  1202 raft_consensus.cc:2468] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8777a520aad74df8ba8304f6f9fc7663 in term 2.
I20260709 12:56:41.264576  1263 consensus_queue.cc:237] T 705f7616236847faa295b48d173caee6 P 8777a520aad74df8ba8304f6f9fc7663 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:41.271842   950 catalog_manager.cc:5697] T 705f7616236847faa295b48d173caee6 P 8777a520aad74df8ba8304f6f9fc7663 reported cstate change: term changed from 1 to 2, leader changed from c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195) to 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "8777a520aad74df8ba8304f6f9fc7663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:41.278188  1263 raft_consensus.cc:993] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663: : Instructing follower d5ae6c7e36af45a7908e71a4052f51b4 to start an election
I20260709 12:56:41.278921  1309 raft_consensus.cc:1081] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 LEADER]: Signalling peer d5ae6c7e36af45a7908e71a4052f51b4 to start an election
I20260709 12:56:41.281196  1053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "baf971c08239449a83cf7be22ab5bbb7"
dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
 from {username='slave'} at 127.0.0.1:58100
I20260709 12:56:41.281831  1053 raft_consensus.cc:493] T baf971c08239449a83cf7be22ab5bbb7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:41.282213  1053 raft_consensus.cc:3060] T baf971c08239449a83cf7be22ab5bbb7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:41.289426  1053 raft_consensus.cc:515] T baf971c08239449a83cf7be22ab5bbb7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:41.292428  1053 leader_election.cc:290] T baf971c08239449a83cf7be22ab5bbb7 P d5ae6c7e36af45a7908e71a4052f51b4 [CANDIDATE]: Term 2 election: Requested vote from peers 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107), c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195:33907)
I20260709 12:56:41.292801  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf971c08239449a83cf7be22ab5bbb7" candidate_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
I20260709 12:56:41.293025  1202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baf971c08239449a83cf7be22ab5bbb7" candidate_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
I20260709 12:56:41.293435  1129 raft_consensus.cc:3055] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:41.293511  1202 raft_consensus.cc:3060] T baf971c08239449a83cf7be22ab5bbb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:41.293871  1129 raft_consensus.cc:740] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8777a520aad74df8ba8304f6f9fc7663, State: Running, Role: LEADER
I20260709 12:56:41.294695  1129 consensus_queue.cc:260] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:41.295629  1129 raft_consensus.cc:3060] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:41.300635  1202 raft_consensus.cc:2468] T baf971c08239449a83cf7be22ab5bbb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ae6c7e36af45a7908e71a4052f51b4 in term 2.
I20260709 12:56:41.301342  1129 raft_consensus.cc:2468] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ae6c7e36af45a7908e71a4052f51b4 in term 2.
I20260709 12:56:41.301913  1017 leader_election.cc:304] T baf971c08239449a83cf7be22ab5bbb7 P d5ae6c7e36af45a7908e71a4052f51b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9bb6c25b3ed459085327bf0ec01ef4b, d5ae6c7e36af45a7908e71a4052f51b4; no voters: 
I20260709 12:56:41.302284  1298 consensus_queue.cc:1048] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:41.303046  1318 raft_consensus.cc:2804] T baf971c08239449a83cf7be22ab5bbb7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:41.303570  1318 raft_consensus.cc:697] T baf971c08239449a83cf7be22ab5bbb7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 LEADER]: Becoming Leader. State: Replica: d5ae6c7e36af45a7908e71a4052f51b4, State: Running, Role: LEADER
I20260709 12:56:41.304394  1318 consensus_queue.cc:237] T baf971c08239449a83cf7be22ab5bbb7 P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:41.311331  1280 raft_consensus.cc:993] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b: : Instructing follower d5ae6c7e36af45a7908e71a4052f51b4 to start an election
I20260709 12:56:41.311825  1280 raft_consensus.cc:1081] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Signalling peer d5ae6c7e36af45a7908e71a4052f51b4 to start an election
I20260709 12:56:41.313853  1054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "251001ae236c4740abfbadc79a3f8c7c"
dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
 from {username='slave'} at 127.0.0.1:58110
I20260709 12:56:41.314513  1054 raft_consensus.cc:493] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:41.314898  1054 raft_consensus.cc:3060] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:41.318609  1249 consensus_queue.cc:1048] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:41.322324  1054 raft_consensus.cc:515] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:41.321717   950 catalog_manager.cc:5697] T baf971c08239449a83cf7be22ab5bbb7 P d5ae6c7e36af45a7908e71a4052f51b4 reported cstate change: term changed from 1 to 2, leader changed from 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194) to d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:41.329594  1054 leader_election.cc:290] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [CANDIDATE]: Term 2 election: Requested vote from peers 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107), c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195:33907)
I20260709 12:56:41.330839  1053 raft_consensus.cc:1240] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Rejecting Update request from peer c9bb6c25b3ed459085327bf0ec01ef4b for earlier term 1. Current term is 2. Ops: []
I20260709 12:56:41.333101  1202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251001ae236c4740abfbadc79a3f8c7c" candidate_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
I20260709 12:56:41.335309  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251001ae236c4740abfbadc79a3f8c7c" candidate_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
I20260709 12:56:41.336074  1128 raft_consensus.cc:3060] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:41.338177  1202 raft_consensus.cc:3055] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:41.338667  1202 raft_consensus.cc:740] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Running, Role: LEADER
I20260709 12:56:41.339905  1202 consensus_queue.cc:260] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:41.340791  1202 raft_consensus.cc:3060] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:41.343700  1128 raft_consensus.cc:2468] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ae6c7e36af45a7908e71a4052f51b4 in term 2.
I20260709 12:56:41.346837  1202 raft_consensus.cc:2468] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ae6c7e36af45a7908e71a4052f51b4 in term 2.
I20260709 12:56:41.348644  1017 leader_election.cc:304] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9bb6c25b3ed459085327bf0ec01ef4b, d5ae6c7e36af45a7908e71a4052f51b4; no voters: 
I20260709 12:56:41.352087  1318 raft_consensus.cc:2804] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:41.352880  1318 raft_consensus.cc:697] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 LEADER]: Becoming Leader. State: Replica: d5ae6c7e36af45a7908e71a4052f51b4, State: Running, Role: LEADER
I20260709 12:56:41.353823  1318 consensus_queue.cc:237] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:41.357106  1298 consensus_queue.cc:1048] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:41.369994   950 catalog_manager.cc:5697] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 reported cstate change: term changed from 1 to 2, leader changed from c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195) to d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:41.386128  1280 consensus_queue.cc:1048] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:41.395735  1280 raft_consensus.cc:993] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b: : Instructing follower d5ae6c7e36af45a7908e71a4052f51b4 to start an election
I20260709 12:56:41.396209  1280 raft_consensus.cc:1081] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Signalling peer d5ae6c7e36af45a7908e71a4052f51b4 to start an election
I20260709 12:56:41.397644  1053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9e11e115d2d4d858b28980f176c5059"
dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
 from {username='slave'} at 127.0.0.1:58110
I20260709 12:56:41.398101  1053 raft_consensus.cc:493] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:41.398403  1053 raft_consensus.cc:3060] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:41.404248  1053 raft_consensus.cc:515] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:41.406984  1053 leader_election.cc:290] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4 [CANDIDATE]: Term 2 election: Requested vote from peers 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107), c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195:33907)
I20260709 12:56:41.407114  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e11e115d2d4d858b28980f176c5059" candidate_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
I20260709 12:56:41.407280  1202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e11e115d2d4d858b28980f176c5059" candidate_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
I20260709 12:56:41.407743  1129 raft_consensus.cc:3060] T f9e11e115d2d4d858b28980f176c5059 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:41.407845  1202 raft_consensus.cc:3055] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:41.408254  1202 raft_consensus.cc:740] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Running, Role: LEADER
I20260709 12:56:41.409050  1202 consensus_queue.cc:260] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:41.410262  1202 raft_consensus.cc:3060] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:41.414791  1129 raft_consensus.cc:2468] T f9e11e115d2d4d858b28980f176c5059 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ae6c7e36af45a7908e71a4052f51b4 in term 2.
I20260709 12:56:41.415977  1018 leader_election.cc:304] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8777a520aad74df8ba8304f6f9fc7663, d5ae6c7e36af45a7908e71a4052f51b4; no voters: 
I20260709 12:56:41.416795  1318 raft_consensus.cc:2804] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:41.417311  1318 raft_consensus.cc:697] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 LEADER]: Becoming Leader. State: Replica: d5ae6c7e36af45a7908e71a4052f51b4, State: Running, Role: LEADER
I20260709 12:56:41.418146  1318 consensus_queue.cc:237] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:41.419673  1202 raft_consensus.cc:2468] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ae6c7e36af45a7908e71a4052f51b4 in term 2.
I20260709 12:56:41.425707   951 catalog_manager.cc:5697] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4 reported cstate change: term changed from 1 to 2, leader changed from c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195) to d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:41.466353  1280 consensus_queue.cc:1048] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:41.474514  1283 raft_consensus.cc:993] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b: : Instructing follower 8777a520aad74df8ba8304f6f9fc7663 to start an election
I20260709 12:56:41.475009  1277 raft_consensus.cc:1081] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Signalling peer 8777a520aad74df8ba8304f6f9fc7663 to start an election
I20260709 12:56:41.480626  1277 consensus_queue.cc:1048] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:41.484869  1129 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95aa5762b14a479993f53d63b8a60f53"
dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
 from {username='slave'} at 127.0.0.1:42990
I20260709 12:56:41.485544  1129 raft_consensus.cc:493] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:41.485944  1129 raft_consensus.cc:3060] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:41.493381  1129 raft_consensus.cc:515] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:41.497332  1202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95aa5762b14a479993f53d63b8a60f53" candidate_uuid: "8777a520aad74df8ba8304f6f9fc7663" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
I20260709 12:56:41.497834  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95aa5762b14a479993f53d63b8a60f53" candidate_uuid: "8777a520aad74df8ba8304f6f9fc7663" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
I20260709 12:56:41.497987  1202 raft_consensus.cc:3055] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:41.498371  1202 raft_consensus.cc:740] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Running, Role: LEADER
I20260709 12:56:41.499205  1202 consensus_queue.cc:260] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:41.499816  1129 leader_election.cc:290] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663 [CANDIDATE]: Term 2 election: Requested vote from peers d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117), c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195:33907)
I20260709 12:56:41.500146  1202 raft_consensus.cc:3060] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:41.507330  1202 raft_consensus.cc:2468] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8777a520aad74df8ba8304f6f9fc7663 in term 2.
I20260709 12:56:41.509687  1092 leader_election.cc:304] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8777a520aad74df8ba8304f6f9fc7663, c9bb6c25b3ed459085327bf0ec01ef4b; no voters: d5ae6c7e36af45a7908e71a4052f51b4
I20260709 12:56:41.510816  1263 consensus_queue.cc:1048] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:41.512009  1248 raft_consensus.cc:2804] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:41.512552  1248 raft_consensus.cc:697] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 LEADER]: Becoming Leader. State: Replica: 8777a520aad74df8ba8304f6f9fc7663, State: Running, Role: LEADER
I20260709 12:56:41.512359  1263 consensus_queue.cc:1048] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:41.513357  1248 consensus_queue.cc:237] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:41.523245   950 catalog_manager.cc:5697] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663 reported cstate change: term changed from 1 to 2, leader changed from c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195) to 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "8777a520aad74df8ba8304f6f9fc7663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:41.527318  1277 raft_consensus.cc:993] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b: : Instructing follower d5ae6c7e36af45a7908e71a4052f51b4 to start an election
I20260709 12:56:41.527966  1277 raft_consensus.cc:1081] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Signalling peer d5ae6c7e36af45a7908e71a4052f51b4 to start an election
I20260709 12:56:41.529913  1054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9987770ab9444666b6f418756936dbc7"
dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
 from {username='slave'} at 127.0.0.1:58110
I20260709 12:56:41.530519  1054 raft_consensus.cc:493] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:41.530879  1054 raft_consensus.cc:3060] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:41.554229  1054 raft_consensus.cc:515] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:41.556813  1054 leader_election.cc:290] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [CANDIDATE]: Term 2 election: Requested vote from peers 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107), c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195:33907)
I20260709 12:56:41.556856  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9987770ab9444666b6f418756936dbc7" candidate_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
I20260709 12:56:41.557504  1129 raft_consensus.cc:3060] T 9987770ab9444666b6f418756936dbc7 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:41.563964  1202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9987770ab9444666b6f418756936dbc7" candidate_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
I20260709 12:56:41.564615  1202 raft_consensus.cc:3055] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:41.564924  1202 raft_consensus.cc:740] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Running, Role: LEADER
I20260709 12:56:41.566424  1202 consensus_queue.cc:260] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:41.567525  1202 raft_consensus.cc:3060] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:41.568508  1129 raft_consensus.cc:2468] T 9987770ab9444666b6f418756936dbc7 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ae6c7e36af45a7908e71a4052f51b4 in term 2.
I20260709 12:56:41.574156  1018 leader_election.cc:304] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8777a520aad74df8ba8304f6f9fc7663, d5ae6c7e36af45a7908e71a4052f51b4; no voters: 
I20260709 12:56:41.574569  1277 raft_consensus.cc:993] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b: : Instructing follower 8777a520aad74df8ba8304f6f9fc7663 to start an election
I20260709 12:56:41.575059  1277 raft_consensus.cc:1081] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Signalling peer 8777a520aad74df8ba8304f6f9fc7663 to start an election
I20260709 12:56:41.575173  1318 raft_consensus.cc:2804] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:41.575716  1318 raft_consensus.cc:697] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 LEADER]: Becoming Leader. State: Replica: d5ae6c7e36af45a7908e71a4052f51b4, State: Running, Role: LEADER
I20260709 12:56:41.576599  1318 consensus_queue.cc:237] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:41.577193  1128 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "269787bc590d4739b10e90ca065aacb7"
dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
 from {username='slave'} at 127.0.0.1:42990
I20260709 12:56:41.577787  1128 raft_consensus.cc:493] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:41.578156  1128 raft_consensus.cc:3060] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:41.581400  1202 raft_consensus.cc:2468] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ae6c7e36af45a7908e71a4052f51b4 in term 2.
I20260709 12:56:41.585328  1128 raft_consensus.cc:515] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:41.585398   951 catalog_manager.cc:5697] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 reported cstate change: term changed from 1 to 2, leader changed from c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195) to d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:41.588743  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269787bc590d4739b10e90ca065aacb7" candidate_uuid: "8777a520aad74df8ba8304f6f9fc7663" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
I20260709 12:56:41.588924  1202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269787bc590d4739b10e90ca065aacb7" candidate_uuid: "8777a520aad74df8ba8304f6f9fc7663" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
I20260709 12:56:41.589599  1202 raft_consensus.cc:3055] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:41.589599  1054 raft_consensus.cc:3060] T 269787bc590d4739b10e90ca065aacb7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:41.590087  1202 raft_consensus.cc:740] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Running, Role: LEADER
I20260709 12:56:41.591104  1202 consensus_queue.cc:260] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:41.592275  1202 raft_consensus.cc:3060] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:41.598037  1054 raft_consensus.cc:2468] T 269787bc590d4739b10e90ca065aacb7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8777a520aad74df8ba8304f6f9fc7663 in term 2.
I20260709 12:56:41.589340  1128 leader_election.cc:290] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663 [CANDIDATE]: Term 2 election: Requested vote from peers d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117), c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195:33907)
I20260709 12:56:41.599622  1095 leader_election.cc:304] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8777a520aad74df8ba8304f6f9fc7663, d5ae6c7e36af45a7908e71a4052f51b4; no voters: 
I20260709 12:56:41.600586  1263 raft_consensus.cc:2804] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:41.601130  1263 raft_consensus.cc:697] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 LEADER]: Becoming Leader. State: Replica: 8777a520aad74df8ba8304f6f9fc7663, State: Running, Role: LEADER
I20260709 12:56:41.601199  1202 raft_consensus.cc:2468] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8777a520aad74df8ba8304f6f9fc7663 in term 2.
I20260709 12:56:41.602059  1263 consensus_queue.cc:237] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:41.609702   951 catalog_manager.cc:5697] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663 reported cstate change: term changed from 1 to 2, leader changed from c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195) to 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "8777a520aad74df8ba8304f6f9fc7663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:41.670272  1202 raft_consensus.cc:1275] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Refusing update from remote peer 8777a520aad74df8ba8304f6f9fc7663: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:41.671551  1263 consensus_queue.cc:1048] T 705f7616236847faa295b48d173caee6 P 8777a520aad74df8ba8304f6f9fc7663 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:41.679649  1054 raft_consensus.cc:1275] T 705f7616236847faa295b48d173caee6 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Refusing update from remote peer 8777a520aad74df8ba8304f6f9fc7663: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:41.685017  1263 consensus_queue.cc:1048] T 705f7616236847faa295b48d173caee6 P 8777a520aad74df8ba8304f6f9fc7663 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:41.702167  1128 raft_consensus.cc:1275] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Refusing update from remote peer d5ae6c7e36af45a7908e71a4052f51b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:41.703594  1258 consensus_queue.cc:1048] T baf971c08239449a83cf7be22ab5bbb7 P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:41.719053  1258 raft_consensus.cc:993] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4: : Instructing follower c9bb6c25b3ed459085327bf0ec01ef4b to start an election
I20260709 12:56:41.720816  1202 raft_consensus.cc:1275] T baf971c08239449a83cf7be22ab5bbb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Refusing update from remote peer d5ae6c7e36af45a7908e71a4052f51b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:41.722612  1318 raft_consensus.cc:1081] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 LEADER]: Signalling peer c9bb6c25b3ed459085327bf0ec01ef4b to start an election
I20260709 12:56:41.723942  1318 consensus_queue.cc:1048] T baf971c08239449a83cf7be22ab5bbb7 P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:41.724975  1202 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "382f69f5402f47cd87dfcbadf4e26c91"
dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
 from {username='slave'} at 127.0.0.1:44052
I20260709 12:56:41.725559  1202 raft_consensus.cc:493] T 382f69f5402f47cd87dfcbadf4e26c91 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:41.725932  1202 raft_consensus.cc:3060] T 382f69f5402f47cd87dfcbadf4e26c91 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:41.733247  1202 raft_consensus.cc:515] T 382f69f5402f47cd87dfcbadf4e26c91 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:41.739527  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f69f5402f47cd87dfcbadf4e26c91" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
I20260709 12:56:41.740356  1054 raft_consensus.cc:3055] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:41.740443  1203 raft_consensus.cc:1275] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Refusing update from remote peer d5ae6c7e36af45a7908e71a4052f51b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:41.742641  1335 consensus_queue.cc:1048] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:56:41.745805  1054 raft_consensus.cc:740] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d5ae6c7e36af45a7908e71a4052f51b4, State: Running, Role: LEADER
I20260709 12:56:41.746713  1054 consensus_queue.cc:260] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:41.747653  1054 raft_consensus.cc:3060] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:41.749782  1202 leader_election.cc:290] T 382f69f5402f47cd87dfcbadf4e26c91 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 2 election: Requested vote from peers d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117), 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107)
I20260709 12:56:41.751037  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382f69f5402f47cd87dfcbadf4e26c91" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
I20260709 12:56:41.751791  1128 raft_consensus.cc:3060] T 382f69f5402f47cd87dfcbadf4e26c91 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:41.768571  1129 raft_consensus.cc:1275] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Refusing update from remote peer d5ae6c7e36af45a7908e71a4052f51b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:41.771965  1335 consensus_queue.cc:1048] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:56:41.775008  1283 raft_consensus.cc:993] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b: : Instructing follower d5ae6c7e36af45a7908e71a4052f51b4 to start an election
I20260709 12:56:41.775548  1283 raft_consensus.cc:1081] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Signalling peer d5ae6c7e36af45a7908e71a4052f51b4 to start an election
I20260709 12:56:41.775969  1054 raft_consensus.cc:2468] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 2.
I20260709 12:56:41.777545  1169 leader_election.cc:304] T 382f69f5402f47cd87dfcbadf4e26c91 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9bb6c25b3ed459085327bf0ec01ef4b, d5ae6c7e36af45a7908e71a4052f51b4; no voters: 
I20260709 12:56:41.777691  1053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7aa2dfe5f2b4248a04d97913ed09920"
dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
 from {username='slave'} at 127.0.0.1:58110
I20260709 12:56:41.778338  1053 raft_consensus.cc:493] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:41.778580  1277 raft_consensus.cc:2804] T 382f69f5402f47cd87dfcbadf4e26c91 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:41.778725  1053 raft_consensus.cc:3060] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:41.779177  1277 raft_consensus.cc:697] T 382f69f5402f47cd87dfcbadf4e26c91 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 LEADER]: Becoming Leader. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Running, Role: LEADER
I20260709 12:56:41.780124  1277 consensus_queue.cc:237] T 382f69f5402f47cd87dfcbadf4e26c91 P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:41.780616  1128 raft_consensus.cc:2468] T 382f69f5402f47cd87dfcbadf4e26c91 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 2.
I20260709 12:56:41.794523   950 catalog_manager.cc:5697] T 382f69f5402f47cd87dfcbadf4e26c91 P c9bb6c25b3ed459085327bf0ec01ef4b reported cstate change: term changed from 1 to 2, leader changed from d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193) to c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195). New cstate: current_term: 2 leader_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:41.836354  1053 raft_consensus.cc:515] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:41.839568  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7aa2dfe5f2b4248a04d97913ed09920" candidate_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
I20260709 12:56:41.840348  1128 raft_consensus.cc:3060] T e7aa2dfe5f2b4248a04d97913ed09920 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:41.840397  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7aa2dfe5f2b4248a04d97913ed09920" candidate_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
I20260709 12:56:41.841077  1203 raft_consensus.cc:3055] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:41.841421  1203 raft_consensus.cc:740] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Running, Role: LEADER
I20260709 12:56:41.841920  1053 leader_election.cc:290] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4 [CANDIDATE]: Term 2 election: Requested vote from peers 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107), c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195:33907)
I20260709 12:56:41.842295  1203 consensus_queue.cc:260] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:41.843575  1203 raft_consensus.cc:3060] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:41.885706  1202 raft_consensus.cc:1275] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Refusing update from remote peer d5ae6c7e36af45a7908e71a4052f51b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:41.887398  1335 consensus_queue.cc:1048] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:41.896188  1129 raft_consensus.cc:1275] T f9e11e115d2d4d858b28980f176c5059 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Refusing update from remote peer d5ae6c7e36af45a7908e71a4052f51b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:41.897902  1258 consensus_queue.cc:1048] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:41.937580  1203 raft_consensus.cc:2468] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ae6c7e36af45a7908e71a4052f51b4 in term 2.
I20260709 12:56:41.937580  1128 raft_consensus.cc:2468] T e7aa2dfe5f2b4248a04d97913ed09920 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ae6c7e36af45a7908e71a4052f51b4 in term 2.
I20260709 12:56:41.939116  1017 leader_election.cc:304] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9bb6c25b3ed459085327bf0ec01ef4b, d5ae6c7e36af45a7908e71a4052f51b4; no voters: 
I20260709 12:56:41.940146  1318 raft_consensus.cc:2804] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:41.940703  1318 raft_consensus.cc:697] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 LEADER]: Becoming Leader. State: Replica: d5ae6c7e36af45a7908e71a4052f51b4, State: Running, Role: LEADER
I20260709 12:56:41.941643  1318 consensus_queue.cc:237] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:41.949082   950 catalog_manager.cc:5697] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4 reported cstate change: term changed from 1 to 2, leader changed from c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195) to d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:41.990209  1203 raft_consensus.cc:1275] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Refusing update from remote peer d5ae6c7e36af45a7908e71a4052f51b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:41.991575  1318 consensus_queue.cc:1048] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:42.002832  1128 raft_consensus.cc:1275] T 9987770ab9444666b6f418756936dbc7 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Refusing update from remote peer d5ae6c7e36af45a7908e71a4052f51b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:42.004401  1335 consensus_queue.cc:1048] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:56:42.074393  1203 raft_consensus.cc:1275] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Refusing update from remote peer 8777a520aad74df8ba8304f6f9fc7663: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:42.075692  1263 consensus_queue.cc:1048] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:42.084630  1053 raft_consensus.cc:3060] T 95aa5762b14a479993f53d63b8a60f53 P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:42.108893  1053 raft_consensus.cc:1275] T 95aa5762b14a479993f53d63b8a60f53 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Refusing update from remote peer 8777a520aad74df8ba8304f6f9fc7663: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:42.110536  1309 consensus_queue.cc:1048] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:42.172456  1053 raft_consensus.cc:1275] T 269787bc590d4739b10e90ca065aacb7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Refusing update from remote peer 8777a520aad74df8ba8304f6f9fc7663: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:42.174055  1309 consensus_queue.cc:1048] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:42.185562  1203 raft_consensus.cc:1275] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Refusing update from remote peer 8777a520aad74df8ba8304f6f9fc7663: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:42.187350  1309 consensus_queue.cc:1048] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:42.256371  1053 raft_consensus.cc:1275] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Refusing update from remote peer c9bb6c25b3ed459085327bf0ec01ef4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:42.257802  1280 consensus_queue.cc:1048] T 382f69f5402f47cd87dfcbadf4e26c91 P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:42.267484  1128 raft_consensus.cc:1275] T 382f69f5402f47cd87dfcbadf4e26c91 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Refusing update from remote peer c9bb6c25b3ed459085327bf0ec01ef4b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:42.270463  1283 consensus_queue.cc:1048] T 382f69f5402f47cd87dfcbadf4e26c91 P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:56:42.398692  1128 raft_consensus.cc:1275] T e7aa2dfe5f2b4248a04d97913ed09920 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Refusing update from remote peer d5ae6c7e36af45a7908e71a4052f51b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:42.399964  1335 consensus_queue.cc:1048] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:42.409983  1203 raft_consensus.cc:1275] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Refusing update from remote peer d5ae6c7e36af45a7908e71a4052f51b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:42.411463  1336 consensus_queue.cc:1048] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:44.296936   431 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 12:56:44.297940   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:56:44.318856  1053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "251001ae236c4740abfbadc79a3f8c7c"
dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
mode: GRACEFUL
new_leader_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
 from {username='slave'} at 127.0.0.1:58132
I20260709 12:56:44.319550  1053 raft_consensus.cc:606] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 LEADER]: Received request to transfer leadership to TS c9bb6c25b3ed459085327bf0ec01ef4b
I20260709 12:56:44.322537  1053 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9987770ab9444666b6f418756936dbc7"
dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
mode: GRACEFUL
new_leader_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
 from {username='slave'} at 127.0.0.1:58132
I20260709 12:56:44.323220  1053 raft_consensus.cc:606] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 LEADER]: Received request to transfer leadership to TS c9bb6c25b3ed459085327bf0ec01ef4b
I20260709 12:56:44.324609   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:56:44.325166   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:56:44.512990  1318 raft_consensus.cc:993] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4: : Instructing follower c9bb6c25b3ed459085327bf0ec01ef4b to start an election
I20260709 12:56:44.513453  1336 raft_consensus.cc:1081] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 LEADER]: Signalling peer c9bb6c25b3ed459085327bf0ec01ef4b to start an election
I20260709 12:56:44.515281  1202 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "251001ae236c4740abfbadc79a3f8c7c"
dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
 from {username='slave'} at 127.0.0.1:44052
I20260709 12:56:44.515892  1202 raft_consensus.cc:493] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:44.516255  1202 raft_consensus.cc:3060] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:44.523656  1202 raft_consensus.cc:515] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:44.526212  1202 leader_election.cc:290] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 3 election: Requested vote from peers d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117), 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107)
I20260709 12:56:44.526539  1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251001ae236c4740abfbadc79a3f8c7c" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
I20260709 12:56:44.527164  1053 raft_consensus.cc:3055] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:56:44.527493  1053 raft_consensus.cc:740] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d5ae6c7e36af45a7908e71a4052f51b4, State: Running, Role: LEADER
I20260709 12:56:44.527675  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251001ae236c4740abfbadc79a3f8c7c" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
I20260709 12:56:44.528230  1128 raft_consensus.cc:3060] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:44.528321  1053 consensus_queue.cc:260] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:44.529589  1053 raft_consensus.cc:3060] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:44.535518  1128 raft_consensus.cc:2468] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 3.
I20260709 12:56:44.535518  1053 raft_consensus.cc:2468] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 3.
I20260709 12:56:44.537266  1169 leader_election.cc:304] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9bb6c25b3ed459085327bf0ec01ef4b, d5ae6c7e36af45a7908e71a4052f51b4; no voters: 
I20260709 12:56:44.538013  1280 raft_consensus.cc:2804] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:56:44.539094  1280 raft_consensus.cc:697] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 LEADER]: Becoming Leader. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Running, Role: LEADER
I20260709 12:56:44.539944  1280 consensus_queue.cc:237] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:44.547395   950 catalog_manager.cc:5697] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b reported cstate change: term changed from 2 to 3, leader changed from d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193) to c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195). New cstate: current_term: 3 leader_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:44.695626  1318 raft_consensus.cc:993] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4: : Instructing follower c9bb6c25b3ed459085327bf0ec01ef4b to start an election
I20260709 12:56:44.696056  1336 raft_consensus.cc:1081] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 LEADER]: Signalling peer c9bb6c25b3ed459085327bf0ec01ef4b to start an election
I20260709 12:56:44.697705  1202 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9987770ab9444666b6f418756936dbc7"
dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
 from {username='slave'} at 127.0.0.1:44052
I20260709 12:56:44.698293  1202 raft_consensus.cc:493] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:44.698645  1202 raft_consensus.cc:3060] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:44.705533  1202 raft_consensus.cc:515] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:44.707592  1202 leader_election.cc:290] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 3 election: Requested vote from peers d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117), 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107)
I20260709 12:56:44.708225  1053 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9987770ab9444666b6f418756936dbc7" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
I20260709 12:56:44.708634  1128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9987770ab9444666b6f418756936dbc7" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
I20260709 12:56:44.708824  1053 raft_consensus.cc:3055] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:56:44.709117  1053 raft_consensus.cc:740] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d5ae6c7e36af45a7908e71a4052f51b4, State: Running, Role: LEADER
I20260709 12:56:44.709151  1128 raft_consensus.cc:3060] T 9987770ab9444666b6f418756936dbc7 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:44.709936  1053 consensus_queue.cc:260] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:44.711037  1053 raft_consensus.cc:3060] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:44.715405  1128 raft_consensus.cc:2468] T 9987770ab9444666b6f418756936dbc7 P 8777a520aad74df8ba8304f6f9fc7663 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 3.
I20260709 12:56:44.716593  1167 leader_election.cc:304] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8777a520aad74df8ba8304f6f9fc7663, c9bb6c25b3ed459085327bf0ec01ef4b; no voters: 
I20260709 12:56:44.717463  1280 raft_consensus.cc:2804] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:56:44.717949  1280 raft_consensus.cc:697] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 LEADER]: Becoming Leader. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Running, Role: LEADER
I20260709 12:56:44.718752  1053 raft_consensus.cc:2468] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 3.
I20260709 12:56:44.718720  1280 consensus_queue.cc:237] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:44.727267   950 catalog_manager.cc:5697] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b reported cstate change: term changed from 2 to 3, leader changed from d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193) to c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195). New cstate: current_term: 3 leader_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:44.971558  1128 raft_consensus.cc:1275] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663 [term 3 FOLLOWER]: Refusing update from remote peer c9bb6c25b3ed459085327bf0ec01ef4b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:44.972956  1280 consensus_queue.cc:1048] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:44.984771  1053 raft_consensus.cc:1275] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 3 FOLLOWER]: Refusing update from remote peer c9bb6c25b3ed459085327bf0ec01ef4b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:44.986481  1280 consensus_queue.cc:1048] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:45.233776  1053 raft_consensus.cc:1275] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 3 FOLLOWER]: Refusing update from remote peer c9bb6c25b3ed459085327bf0ec01ef4b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:45.235196  1280 consensus_queue.cc:1048] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:45.244946  1129 raft_consensus.cc:1275] T 9987770ab9444666b6f418756936dbc7 P 8777a520aad74df8ba8304f6f9fc7663 [term 3 FOLLOWER]: Refusing update from remote peer c9bb6c25b3ed459085327bf0ec01ef4b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:45.246855  1360 consensus_queue.cc:1048] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:56:45.326138   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:56:45.343546  1203 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9987770ab9444666b6f418756936dbc7"
dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
mode: GRACEFUL
new_leader_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
 from {username='slave'} at 127.0.0.1:44068
I20260709 12:56:45.344208  1203 raft_consensus.cc:606] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 LEADER]: Received request to transfer leadership to TS d5ae6c7e36af45a7908e71a4052f51b4
I20260709 12:56:45.350123  1203 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "251001ae236c4740abfbadc79a3f8c7c"
dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
mode: GRACEFUL
new_leader_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
 from {username='slave'} at 127.0.0.1:44068
I20260709 12:56:45.350674  1203 raft_consensus.cc:606] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 LEADER]: Received request to transfer leadership to TS d5ae6c7e36af45a7908e71a4052f51b4
I20260709 12:56:45.361548  1129 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8b8dbcd5f024dd39f541938e3e01b49"
dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
mode: GRACEFUL
new_leader_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
 from {username='slave'} at 127.0.0.1:43008
I20260709 12:56:45.362161  1129 raft_consensus.cc:606] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 LEADER]: Received request to transfer leadership to TS d5ae6c7e36af45a7908e71a4052f51b4
I20260709 12:56:45.367439  1129 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "269787bc590d4739b10e90ca065aacb7"
dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
mode: GRACEFUL
new_leader_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
 from {username='slave'} at 127.0.0.1:43008
I20260709 12:56:45.368011  1129 raft_consensus.cc:606] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 LEADER]: Received request to transfer leadership to TS d5ae6c7e36af45a7908e71a4052f51b4
I20260709 12:56:45.373385  1129 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95aa5762b14a479993f53d63b8a60f53"
dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
mode: GRACEFUL
new_leader_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
 from {username='slave'} at 127.0.0.1:43008
I20260709 12:56:45.373914  1129 raft_consensus.cc:606] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 LEADER]: Received request to transfer leadership to TS d5ae6c7e36af45a7908e71a4052f51b4
I20260709 12:56:45.402355  1362 raft_consensus.cc:993] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663: : Instructing follower d5ae6c7e36af45a7908e71a4052f51b4 to start an election
I20260709 12:56:45.402848  1248 raft_consensus.cc:1081] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 LEADER]: Signalling peer d5ae6c7e36af45a7908e71a4052f51b4 to start an election
I20260709 12:56:45.404526  1053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "269787bc590d4739b10e90ca065aacb7"
dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
 from {username='slave'} at 127.0.0.1:58100
I20260709 12:56:45.404985  1053 raft_consensus.cc:493] T 269787bc590d4739b10e90ca065aacb7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:45.405282  1053 raft_consensus.cc:3060] T 269787bc590d4739b10e90ca065aacb7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:45.409559  1053 raft_consensus.cc:515] T 269787bc590d4739b10e90ca065aacb7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:45.412350  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269787bc590d4739b10e90ca065aacb7" candidate_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
I20260709 12:56:45.413021  1129 raft_consensus.cc:3055] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:56:45.412350  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269787bc590d4739b10e90ca065aacb7" candidate_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
I20260709 12:56:45.413384  1129 raft_consensus.cc:740] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8777a520aad74df8ba8304f6f9fc7663, State: Running, Role: LEADER
I20260709 12:56:45.413646  1203 raft_consensus.cc:3060] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:45.414207  1129 consensus_queue.cc:260] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:45.415282  1129 raft_consensus.cc:3060] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:45.421097  1203 raft_consensus.cc:2468] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ae6c7e36af45a7908e71a4052f51b4 in term 3.
I20260709 12:56:45.412577  1053 leader_election.cc:290] T 269787bc590d4739b10e90ca065aacb7 P d5ae6c7e36af45a7908e71a4052f51b4 [CANDIDATE]: Term 3 election: Requested vote from peers 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107), c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195:33907)
I20260709 12:56:45.422601  1017 leader_election.cc:304] T 269787bc590d4739b10e90ca065aacb7 P d5ae6c7e36af45a7908e71a4052f51b4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9bb6c25b3ed459085327bf0ec01ef4b, d5ae6c7e36af45a7908e71a4052f51b4; no voters: 
I20260709 12:56:45.424043  1336 raft_consensus.cc:2804] T 269787bc590d4739b10e90ca065aacb7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:56:45.424525  1129 raft_consensus.cc:2468] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ae6c7e36af45a7908e71a4052f51b4 in term 3.
I20260709 12:56:45.426980  1336 raft_consensus.cc:697] T 269787bc590d4739b10e90ca065aacb7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 3 LEADER]: Becoming Leader. State: Replica: d5ae6c7e36af45a7908e71a4052f51b4, State: Running, Role: LEADER
I20260709 12:56:45.427930  1336 consensus_queue.cc:237] T 269787bc590d4739b10e90ca065aacb7 P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:45.431460  1360 raft_consensus.cc:993] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b: : Instructing follower d5ae6c7e36af45a7908e71a4052f51b4 to start an election
I20260709 12:56:45.432025  1360 raft_consensus.cc:1081] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 LEADER]: Signalling peer d5ae6c7e36af45a7908e71a4052f51b4 to start an election
I20260709 12:56:45.434154  1053 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "251001ae236c4740abfbadc79a3f8c7c"
dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
 from {username='slave'} at 127.0.0.1:58110
I20260709 12:56:45.434736  1053 raft_consensus.cc:493] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:45.435081  1053 raft_consensus.cc:3060] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:45.441135   950 catalog_manager.cc:5697] T 269787bc590d4739b10e90ca065aacb7 P d5ae6c7e36af45a7908e71a4052f51b4 reported cstate change: term changed from 2 to 3, leader changed from 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194) to d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:45.442488  1053 raft_consensus.cc:515] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:45.448545  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251001ae236c4740abfbadc79a3f8c7c" candidate_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
I20260709 12:56:45.449231  1129 raft_consensus.cc:3060] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:45.457466  1248 raft_consensus.cc:993] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663: : Instructing follower d5ae6c7e36af45a7908e71a4052f51b4 to start an election
I20260709 12:56:45.457952  1248 raft_consensus.cc:1081] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 LEADER]: Signalling peer d5ae6c7e36af45a7908e71a4052f51b4 to start an election
I20260709 12:56:45.459293  1129 raft_consensus.cc:2468] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ae6c7e36af45a7908e71a4052f51b4 in term 4.
I20260709 12:56:45.460167  1054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95aa5762b14a479993f53d63b8a60f53"
dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
 from {username='slave'} at 127.0.0.1:58100
I20260709 12:56:45.460578  1053 leader_election.cc:290] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [CANDIDATE]: Term 4 election: Requested vote from peers 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107), c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195:33907)
I20260709 12:56:45.460824  1054 raft_consensus.cc:493] T 95aa5762b14a479993f53d63b8a60f53 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:45.461189  1054 raft_consensus.cc:3060] T 95aa5762b14a479993f53d63b8a60f53 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:45.463531  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251001ae236c4740abfbadc79a3f8c7c" candidate_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
I20260709 12:56:45.464147  1203 raft_consensus.cc:3055] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:56:45.464506  1203 raft_consensus.cc:740] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Running, Role: LEADER
I20260709 12:56:45.465354  1203 consensus_queue.cc:260] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:45.466713  1203 raft_consensus.cc:3060] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:45.469064  1018 leader_election.cc:304] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8777a520aad74df8ba8304f6f9fc7663, d5ae6c7e36af45a7908e71a4052f51b4; no voters: 
I20260709 12:56:45.473208  1054 raft_consensus.cc:515] T 95aa5762b14a479993f53d63b8a60f53 P d5ae6c7e36af45a7908e71a4052f51b4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:45.477563  1054 leader_election.cc:290] T 95aa5762b14a479993f53d63b8a60f53 P d5ae6c7e36af45a7908e71a4052f51b4 [CANDIDATE]: Term 3 election: Requested vote from peers 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107), c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195:33907)
I20260709 12:56:45.475075  1203 raft_consensus.cc:2468] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ae6c7e36af45a7908e71a4052f51b4 in term 4.
I20260709 12:56:45.474157  1336 raft_consensus.cc:2804] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:56:45.478718  1202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95aa5762b14a479993f53d63b8a60f53" candidate_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
I20260709 12:56:45.479329  1202 raft_consensus.cc:3060] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:45.479005  1336 raft_consensus.cc:697] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 4 LEADER]: Becoming Leader. State: Replica: d5ae6c7e36af45a7908e71a4052f51b4, State: Running, Role: LEADER
I20260709 12:56:45.480412  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95aa5762b14a479993f53d63b8a60f53" candidate_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
I20260709 12:56:45.481142  1129 raft_consensus.cc:3055] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:56:45.480783  1336 consensus_queue.cc:237] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:45.481487  1129 raft_consensus.cc:740] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8777a520aad74df8ba8304f6f9fc7663, State: Running, Role: LEADER
I20260709 12:56:45.482492  1129 consensus_queue.cc:260] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:45.483836  1129 raft_consensus.cc:3060] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:45.487295  1202 raft_consensus.cc:2468] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ae6c7e36af45a7908e71a4052f51b4 in term 3.
I20260709 12:56:45.488603  1017 leader_election.cc:304] T 95aa5762b14a479993f53d63b8a60f53 P d5ae6c7e36af45a7908e71a4052f51b4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9bb6c25b3ed459085327bf0ec01ef4b, d5ae6c7e36af45a7908e71a4052f51b4; no voters: 
I20260709 12:56:45.489499  1336 raft_consensus.cc:2804] T 95aa5762b14a479993f53d63b8a60f53 P d5ae6c7e36af45a7908e71a4052f51b4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:56:45.489966  1336 raft_consensus.cc:697] T 95aa5762b14a479993f53d63b8a60f53 P d5ae6c7e36af45a7908e71a4052f51b4 [term 3 LEADER]: Becoming Leader. State: Replica: d5ae6c7e36af45a7908e71a4052f51b4, State: Running, Role: LEADER
I20260709 12:56:45.490797  1336 consensus_queue.cc:237] T 95aa5762b14a479993f53d63b8a60f53 P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:45.493866  1129 raft_consensus.cc:2468] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ae6c7e36af45a7908e71a4052f51b4 in term 3.
I20260709 12:56:45.496913   950 catalog_manager.cc:5697] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 reported cstate change: term changed from 3 to 4, leader changed from c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195) to d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:45.510030   950 catalog_manager.cc:5697] T 95aa5762b14a479993f53d63b8a60f53 P d5ae6c7e36af45a7908e71a4052f51b4 reported cstate change: term changed from 2 to 3, leader changed from 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194) to d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:45.727980  1360 raft_consensus.cc:993] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b: : Instructing follower d5ae6c7e36af45a7908e71a4052f51b4 to start an election
I20260709 12:56:45.728399  1360 raft_consensus.cc:1081] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 LEADER]: Signalling peer d5ae6c7e36af45a7908e71a4052f51b4 to start an election
I20260709 12:56:45.729939  1054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9987770ab9444666b6f418756936dbc7"
dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
 from {username='slave'} at 127.0.0.1:58110
I20260709 12:56:45.730436  1054 raft_consensus.cc:493] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:45.730731  1054 raft_consensus.cc:3060] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:45.736892  1054 raft_consensus.cc:515] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:45.738634  1054 leader_election.cc:290] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [CANDIDATE]: Term 4 election: Requested vote from peers 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107), c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195:33907)
I20260709 12:56:45.739470  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9987770ab9444666b6f418756936dbc7" candidate_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
I20260709 12:56:45.739846  1202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9987770ab9444666b6f418756936dbc7" candidate_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
I20260709 12:56:45.740101  1129 raft_consensus.cc:3060] T 9987770ab9444666b6f418756936dbc7 P 8777a520aad74df8ba8304f6f9fc7663 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:45.740363  1202 raft_consensus.cc:3055] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:56:45.740679  1202 raft_consensus.cc:740] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Running, Role: LEADER
I20260709 12:56:45.741423  1202 consensus_queue.cc:260] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:45.742650  1202 raft_consensus.cc:3060] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:56:45.747068  1129 raft_consensus.cc:2468] T 9987770ab9444666b6f418756936dbc7 P 8777a520aad74df8ba8304f6f9fc7663 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ae6c7e36af45a7908e71a4052f51b4 in term 4.
I20260709 12:56:45.748369  1018 leader_election.cc:304] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8777a520aad74df8ba8304f6f9fc7663, d5ae6c7e36af45a7908e71a4052f51b4; no voters: 
I20260709 12:56:45.749281  1336 raft_consensus.cc:2804] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:56:45.749779  1336 raft_consensus.cc:697] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 4 LEADER]: Becoming Leader. State: Replica: d5ae6c7e36af45a7908e71a4052f51b4, State: Running, Role: LEADER
I20260709 12:56:45.749786  1202 raft_consensus.cc:2468] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ae6c7e36af45a7908e71a4052f51b4 in term 4.
I20260709 12:56:45.750758  1336 consensus_queue.cc:237] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:45.759500   950 catalog_manager.cc:5697] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 reported cstate change: term changed from 3 to 4, leader changed from c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195) to d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:45.808844  1248 raft_consensus.cc:993] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663: : Instructing follower d5ae6c7e36af45a7908e71a4052f51b4 to start an election
I20260709 12:56:45.809265  1248 raft_consensus.cc:1081] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 LEADER]: Signalling peer d5ae6c7e36af45a7908e71a4052f51b4 to start an election
I20260709 12:56:45.810843  1054 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8b8dbcd5f024dd39f541938e3e01b49"
dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
 from {username='slave'} at 127.0.0.1:58100
I20260709 12:56:45.811457  1054 raft_consensus.cc:493] T d8b8dbcd5f024dd39f541938e3e01b49 P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:45.811787  1054 raft_consensus.cc:3060] T d8b8dbcd5f024dd39f541938e3e01b49 P d5ae6c7e36af45a7908e71a4052f51b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:45.817409  1054 raft_consensus.cc:515] T d8b8dbcd5f024dd39f541938e3e01b49 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:45.819171  1054 leader_election.cc:290] T d8b8dbcd5f024dd39f541938e3e01b49 P d5ae6c7e36af45a7908e71a4052f51b4 [CANDIDATE]: Term 2 election: Requested vote from peers 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107), c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195:33907)
I20260709 12:56:45.820139  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b8dbcd5f024dd39f541938e3e01b49" candidate_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
I20260709 12:56:45.820437  1202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b8dbcd5f024dd39f541938e3e01b49" candidate_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
I20260709 12:56:45.820823  1129 raft_consensus.cc:3055] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:45.821004  1202 raft_consensus.cc:3060] T d8b8dbcd5f024dd39f541938e3e01b49 P c9bb6c25b3ed459085327bf0ec01ef4b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:45.821256  1129 raft_consensus.cc:740] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8777a520aad74df8ba8304f6f9fc7663, State: Running, Role: LEADER
I20260709 12:56:45.821990  1129 consensus_queue.cc:260] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:45.822921  1129 raft_consensus.cc:3060] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:45.825845  1202 raft_consensus.cc:2468] T d8b8dbcd5f024dd39f541938e3e01b49 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ae6c7e36af45a7908e71a4052f51b4 in term 2.
I20260709 12:56:45.826861  1017 leader_election.cc:304] T d8b8dbcd5f024dd39f541938e3e01b49 P d5ae6c7e36af45a7908e71a4052f51b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9bb6c25b3ed459085327bf0ec01ef4b, d5ae6c7e36af45a7908e71a4052f51b4; no voters: 
I20260709 12:56:45.827379  1129 raft_consensus.cc:2468] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5ae6c7e36af45a7908e71a4052f51b4 in term 2.
I20260709 12:56:45.827561  1336 raft_consensus.cc:2804] T d8b8dbcd5f024dd39f541938e3e01b49 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:45.828080  1336 raft_consensus.cc:697] T d8b8dbcd5f024dd39f541938e3e01b49 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 LEADER]: Becoming Leader. State: Replica: d5ae6c7e36af45a7908e71a4052f51b4, State: Running, Role: LEADER
I20260709 12:56:45.829002  1336 consensus_queue.cc:237] T d8b8dbcd5f024dd39f541938e3e01b49 P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:45.836138   950 catalog_manager.cc:5697] T d8b8dbcd5f024dd39f541938e3e01b49 P d5ae6c7e36af45a7908e71a4052f51b4 reported cstate change: term changed from 1 to 2, leader changed from 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194) to d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:45.868180  1202 raft_consensus.cc:1275] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 FOLLOWER]: Refusing update from remote peer d5ae6c7e36af45a7908e71a4052f51b4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:45.870078  1336 consensus_queue.cc:1048] T 269787bc590d4739b10e90ca065aacb7 P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:45.890560  1203 raft_consensus.cc:1275] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 4 FOLLOWER]: Refusing update from remote peer d5ae6c7e36af45a7908e71a4052f51b4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:56:45.891214  1129 raft_consensus.cc:1275] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 3 FOLLOWER]: Refusing update from remote peer d5ae6c7e36af45a7908e71a4052f51b4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:45.892863  1374 consensus_queue.cc:1048] T 269787bc590d4739b10e90ca065aacb7 P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:45.893184  1203 raft_consensus.cc:1275] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 FOLLOWER]: Refusing update from remote peer d5ae6c7e36af45a7908e71a4052f51b4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:45.895143  1374 consensus_queue.cc:1048] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:56:45.897451  1336 consensus_queue.cc:1048] T 95aa5762b14a479993f53d63b8a60f53 P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:56:45.911062  1129 raft_consensus.cc:1275] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663 [term 4 FOLLOWER]: Refusing update from remote peer d5ae6c7e36af45a7908e71a4052f51b4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:56:45.913058  1374 consensus_queue.cc:1048] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:56:45.923336  1129 raft_consensus.cc:1275] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663 [term 3 FOLLOWER]: Refusing update from remote peer d5ae6c7e36af45a7908e71a4052f51b4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:45.924750  1375 consensus_queue.cc:1048] T 95aa5762b14a479993f53d63b8a60f53 P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:46.223893  1202 raft_consensus.cc:1275] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 4 FOLLOWER]: Refusing update from remote peer d5ae6c7e36af45a7908e71a4052f51b4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:56:46.225244  1375 consensus_queue.cc:1048] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:56:46.232290  1129 raft_consensus.cc:1275] T 9987770ab9444666b6f418756936dbc7 P 8777a520aad74df8ba8304f6f9fc7663 [term 4 FOLLOWER]: Refusing update from remote peer d5ae6c7e36af45a7908e71a4052f51b4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:56:46.234452  1371 consensus_queue.cc:1048] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:56:46.237098  1202 raft_consensus.cc:1275] T d8b8dbcd5f024dd39f541938e3e01b49 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Refusing update from remote peer d5ae6c7e36af45a7908e71a4052f51b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:46.238929  1371 consensus_queue.cc:1048] T d8b8dbcd5f024dd39f541938e3e01b49 P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:46.249519  1129 raft_consensus.cc:1275] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Refusing update from remote peer d5ae6c7e36af45a7908e71a4052f51b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:56:46.251371  1373 consensus_queue.cc:1048] T d8b8dbcd5f024dd39f541938e3e01b49 P d5ae6c7e36af45a7908e71a4052f51b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:48.382882   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:56:48.390626  1054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "251001ae236c4740abfbadc79a3f8c7c"
dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
mode: GRACEFUL
new_leader_uuid: "8777a520aad74df8ba8304f6f9fc7663"
 from {username='slave'} at 127.0.0.1:58132
I20260709 12:56:48.391335  1054 raft_consensus.cc:606] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 4 LEADER]: Received request to transfer leadership to TS 8777a520aad74df8ba8304f6f9fc7663
I20260709 12:56:48.394441  1054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9987770ab9444666b6f418756936dbc7"
dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
mode: GRACEFUL
new_leader_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
 from {username='slave'} at 127.0.0.1:58132
I20260709 12:56:48.394937  1054 raft_consensus.cc:606] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 4 LEADER]: Received request to transfer leadership to TS c9bb6c25b3ed459085327bf0ec01ef4b
I20260709 12:56:48.397307  1054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7aa2dfe5f2b4248a04d97913ed09920"
dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
mode: GRACEFUL
new_leader_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
 from {username='slave'} at 127.0.0.1:58132
I20260709 12:56:48.397897  1054 raft_consensus.cc:606] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 LEADER]: Received request to transfer leadership to TS c9bb6c25b3ed459085327bf0ec01ef4b
I20260709 12:56:48.400712  1054 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9e11e115d2d4d858b28980f176c5059"
dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
mode: GRACEFUL
new_leader_uuid: "8777a520aad74df8ba8304f6f9fc7663"
 from {username='slave'} at 127.0.0.1:58132
I20260709 12:56:48.401120  1054 raft_consensus.cc:606] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 LEADER]: Received request to transfer leadership to TS 8777a520aad74df8ba8304f6f9fc7663
I20260709 12:56:48.402163   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:56:48.402611   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:56:48.448891  1385 raft_consensus.cc:993] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4: : Instructing follower 8777a520aad74df8ba8304f6f9fc7663 to start an election
I20260709 12:56:48.449452  1384 raft_consensus.cc:1081] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 4 LEADER]: Signalling peer 8777a520aad74df8ba8304f6f9fc7663 to start an election
I20260709 12:56:48.451251  1129 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "251001ae236c4740abfbadc79a3f8c7c"
dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
 from {username='slave'} at 127.0.0.1:42992
I20260709 12:56:48.451735  1129 raft_consensus.cc:493] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:48.452077  1129 raft_consensus.cc:3060] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:56:48.457665  1129 raft_consensus.cc:515] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:48.459559  1129 leader_election.cc:290] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663 [CANDIDATE]: Term 5 election: Requested vote from peers d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117), c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195:33907)
I20260709 12:56:48.460724  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251001ae236c4740abfbadc79a3f8c7c" candidate_uuid: "8777a520aad74df8ba8304f6f9fc7663" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
I20260709 12:56:48.461135  1203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "251001ae236c4740abfbadc79a3f8c7c" candidate_uuid: "8777a520aad74df8ba8304f6f9fc7663" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
I20260709 12:56:48.461417  1054 raft_consensus.cc:3055] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:56:48.461665  1203 raft_consensus.cc:3060] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:56:48.461704  1054 raft_consensus.cc:740] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d5ae6c7e36af45a7908e71a4052f51b4, State: Running, Role: LEADER
I20260709 12:56:48.462754  1054 consensus_queue.cc:260] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:48.463755  1054 raft_consensus.cc:3060] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:56:48.467306  1203 raft_consensus.cc:2468] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8777a520aad74df8ba8304f6f9fc7663 in term 5.
I20260709 12:56:48.468643  1054 raft_consensus.cc:2468] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8777a520aad74df8ba8304f6f9fc7663 in term 5.
I20260709 12:56:48.468698  1092 leader_election.cc:304] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8777a520aad74df8ba8304f6f9fc7663, c9bb6c25b3ed459085327bf0ec01ef4b; no voters: 
I20260709 12:56:48.470209  1248 raft_consensus.cc:2804] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:56:48.471014  1248 raft_consensus.cc:697] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663 [term 5 LEADER]: Becoming Leader. State: Replica: 8777a520aad74df8ba8304f6f9fc7663, State: Running, Role: LEADER
I20260709 12:56:48.471911  1248 consensus_queue.cc:237] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:48.478986   950 catalog_manager.cc:5697] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663 reported cstate change: term changed from 4 to 5, leader changed from d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193) to 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "8777a520aad74df8ba8304f6f9fc7663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:48.693272  1385 raft_consensus.cc:993] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4: : Instructing follower c9bb6c25b3ed459085327bf0ec01ef4b to start an election
I20260709 12:56:48.693676  1385 raft_consensus.cc:1081] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 LEADER]: Signalling peer c9bb6c25b3ed459085327bf0ec01ef4b to start an election
I20260709 12:56:48.695148  1203 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7aa2dfe5f2b4248a04d97913ed09920"
dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
 from {username='slave'} at 127.0.0.1:44052
I20260709 12:56:48.695561  1203 raft_consensus.cc:493] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:48.695788  1203 raft_consensus.cc:3060] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:48.699695  1384 raft_consensus.cc:993] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4: : Instructing follower c9bb6c25b3ed459085327bf0ec01ef4b to start an election
I20260709 12:56:48.700156  1385 raft_consensus.cc:1081] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 4 LEADER]: Signalling peer c9bb6c25b3ed459085327bf0ec01ef4b to start an election
I20260709 12:56:48.700490  1203 raft_consensus.cc:515] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:48.701802  1202 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9987770ab9444666b6f418756936dbc7"
dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
 from {username='slave'} at 127.0.0.1:44052
I20260709 12:56:48.702129  1203 leader_election.cc:290] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 3 election: Requested vote from peers d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117), 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107)
I20260709 12:56:48.702306  1202 raft_consensus.cc:493] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:48.702715  1202 raft_consensus.cc:3060] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:56:48.703122  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7aa2dfe5f2b4248a04d97913ed09920" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
I20260709 12:56:48.703397  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7aa2dfe5f2b4248a04d97913ed09920" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
I20260709 12:56:48.703666  1054 raft_consensus.cc:3055] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:56:48.703862  1129 raft_consensus.cc:3060] T e7aa2dfe5f2b4248a04d97913ed09920 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:48.704015  1054 raft_consensus.cc:740] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d5ae6c7e36af45a7908e71a4052f51b4, State: Running, Role: LEADER
I20260709 12:56:48.704870  1054 consensus_queue.cc:260] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:48.705974  1054 raft_consensus.cc:3060] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:48.708523  1129 raft_consensus.cc:2468] T e7aa2dfe5f2b4248a04d97913ed09920 P 8777a520aad74df8ba8304f6f9fc7663 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 3.
I20260709 12:56:48.709689  1167 leader_election.cc:304] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8777a520aad74df8ba8304f6f9fc7663, c9bb6c25b3ed459085327bf0ec01ef4b; no voters: 
I20260709 12:56:48.709873  1202 raft_consensus.cc:515] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:48.710466  1360 raft_consensus.cc:2804] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:56:48.711704  1360 raft_consensus.cc:697] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 LEADER]: Becoming Leader. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Running, Role: LEADER
I20260709 12:56:48.712131  1202 leader_election.cc:290] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 5 election: Requested vote from peers d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117), 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107)
I20260709 12:56:48.712877  1054 raft_consensus.cc:2468] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 3.
I20260709 12:56:48.712677  1360 consensus_queue.cc:237] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:48.713490  1129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9987770ab9444666b6f418756936dbc7" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
I20260709 12:56:48.714023  1129 raft_consensus.cc:3060] T 9987770ab9444666b6f418756936dbc7 P 8777a520aad74df8ba8304f6f9fc7663 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:56:48.714412  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9987770ab9444666b6f418756936dbc7" candidate_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
I20260709 12:56:48.714821  1054 raft_consensus.cc:3055] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:56:48.715044  1054 raft_consensus.cc:740] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d5ae6c7e36af45a7908e71a4052f51b4, State: Running, Role: LEADER
I20260709 12:56:48.715736  1054 consensus_queue.cc:260] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:48.716463  1054 raft_consensus.cc:3060] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:56:48.720649  1054 raft_consensus.cc:2468] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 5.
I20260709 12:56:48.720749  1129 raft_consensus.cc:2468] T 9987770ab9444666b6f418756936dbc7 P 8777a520aad74df8ba8304f6f9fc7663 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9bb6c25b3ed459085327bf0ec01ef4b in term 5.
I20260709 12:56:48.722427  1167 leader_election.cc:304] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8777a520aad74df8ba8304f6f9fc7663, c9bb6c25b3ed459085327bf0ec01ef4b; no voters: 
I20260709 12:56:48.723423  1360 raft_consensus.cc:2804] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:56:48.723858  1360 raft_consensus.cc:697] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 5 LEADER]: Becoming Leader. State: Replica: c9bb6c25b3ed459085327bf0ec01ef4b, State: Running, Role: LEADER
I20260709 12:56:48.724648  1360 consensus_queue.cc:237] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:48.725955   950 catalog_manager.cc:5697] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b reported cstate change: term changed from 2 to 3, leader changed from d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193) to c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195). New cstate: current_term: 3 leader_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:48.737545   950 catalog_manager.cc:5697] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b reported cstate change: term changed from 4 to 5, leader changed from d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193) to c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195). New cstate: current_term: 5 leader_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:48.795308  1384 raft_consensus.cc:993] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4: : Instructing follower 8777a520aad74df8ba8304f6f9fc7663 to start an election
I20260709 12:56:48.795727  1384 raft_consensus.cc:1081] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 LEADER]: Signalling peer 8777a520aad74df8ba8304f6f9fc7663 to start an election
I20260709 12:56:48.797127  1129 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9e11e115d2d4d858b28980f176c5059"
dest_uuid: "8777a520aad74df8ba8304f6f9fc7663"
 from {username='slave'} at 127.0.0.1:42992
I20260709 12:56:48.797549  1129 raft_consensus.cc:493] T f9e11e115d2d4d858b28980f176c5059 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:56:48.797781  1129 raft_consensus.cc:3060] T f9e11e115d2d4d858b28980f176c5059 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:48.801865  1129 raft_consensus.cc:515] T f9e11e115d2d4d858b28980f176c5059 P 8777a520aad74df8ba8304f6f9fc7663 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:48.803360  1129 leader_election.cc:290] T f9e11e115d2d4d858b28980f176c5059 P 8777a520aad74df8ba8304f6f9fc7663 [CANDIDATE]: Term 3 election: Requested vote from peers d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117), c9bb6c25b3ed459085327bf0ec01ef4b (127.0.107.195:33907)
I20260709 12:56:48.804152  1054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e11e115d2d4d858b28980f176c5059" candidate_uuid: "8777a520aad74df8ba8304f6f9fc7663" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d5ae6c7e36af45a7908e71a4052f51b4"
I20260709 12:56:48.804361  1202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9e11e115d2d4d858b28980f176c5059" candidate_uuid: "8777a520aad74df8ba8304f6f9fc7663" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b"
I20260709 12:56:48.804656  1054 raft_consensus.cc:3055] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:56:48.804854  1202 raft_consensus.cc:3060] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:48.804960  1054 raft_consensus.cc:740] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d5ae6c7e36af45a7908e71a4052f51b4, State: Running, Role: LEADER
I20260709 12:56:48.805649  1054 consensus_queue.cc:260] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:48.806550  1054 raft_consensus.cc:3060] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:48.809391  1202 raft_consensus.cc:2468] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8777a520aad74df8ba8304f6f9fc7663 in term 3.
I20260709 12:56:48.810351  1092 leader_election.cc:304] T f9e11e115d2d4d858b28980f176c5059 P 8777a520aad74df8ba8304f6f9fc7663 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8777a520aad74df8ba8304f6f9fc7663, c9bb6c25b3ed459085327bf0ec01ef4b; no voters: 
I20260709 12:56:48.810868  1054 raft_consensus.cc:2468] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8777a520aad74df8ba8304f6f9fc7663 in term 3.
I20260709 12:56:48.811069  1248 raft_consensus.cc:2804] T f9e11e115d2d4d858b28980f176c5059 P 8777a520aad74df8ba8304f6f9fc7663 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:56:48.811518  1248 raft_consensus.cc:697] T f9e11e115d2d4d858b28980f176c5059 P 8777a520aad74df8ba8304f6f9fc7663 [term 3 LEADER]: Becoming Leader. State: Replica: 8777a520aad74df8ba8304f6f9fc7663, State: Running, Role: LEADER
I20260709 12:56:48.812361  1248 consensus_queue.cc:237] T f9e11e115d2d4d858b28980f176c5059 P 8777a520aad74df8ba8304f6f9fc7663 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } }
I20260709 12:56:48.821240   950 catalog_manager.cc:5697] T f9e11e115d2d4d858b28980f176c5059 P 8777a520aad74df8ba8304f6f9fc7663 reported cstate change: term changed from 2 to 3, leader changed from d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193) to 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "8777a520aad74df8ba8304f6f9fc7663" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:48.877458  1054 raft_consensus.cc:1275] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 5 FOLLOWER]: Refusing update from remote peer 8777a520aad74df8ba8304f6f9fc7663: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:56:48.878706  1248 consensus_queue.cc:1048] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:56:48.888870  1202 raft_consensus.cc:1275] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 5 FOLLOWER]: Refusing update from remote peer 8777a520aad74df8ba8304f6f9fc7663: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:56:48.890482  1386 consensus_queue.cc:1048] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:56:49.101464  1054 raft_consensus.cc:1275] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4 [term 3 FOLLOWER]: Refusing update from remote peer c9bb6c25b3ed459085327bf0ec01ef4b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:49.102928  1360 consensus_queue.cc:1048] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:49.114217  1053 raft_consensus.cc:1275] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 5 FOLLOWER]: Refusing update from remote peer c9bb6c25b3ed459085327bf0ec01ef4b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:56:49.116240  1129 raft_consensus.cc:1275] T e7aa2dfe5f2b4248a04d97913ed09920 P 8777a520aad74df8ba8304f6f9fc7663 [term 3 FOLLOWER]: Refusing update from remote peer c9bb6c25b3ed459085327bf0ec01ef4b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:49.122229  1403 consensus_queue.cc:1048] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:56:49.122746  1392 consensus_queue.cc:1048] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:56:49.139379  1129 raft_consensus.cc:1275] T 9987770ab9444666b6f418756936dbc7 P 8777a520aad74df8ba8304f6f9fc7663 [term 5 FOLLOWER]: Refusing update from remote peer c9bb6c25b3ed459085327bf0ec01ef4b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:56:49.141273  1405 consensus_queue.cc:1048] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8777a520aad74df8ba8304f6f9fc7663" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 44107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:56:49.263386  1202 raft_consensus.cc:1275] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 FOLLOWER]: Refusing update from remote peer 8777a520aad74df8ba8304f6f9fc7663: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:49.264714  1398 consensus_queue.cc:1048] T f9e11e115d2d4d858b28980f176c5059 P 8777a520aad74df8ba8304f6f9fc7663 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9bb6c25b3ed459085327bf0ec01ef4b" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 33907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:49.273262  1054 raft_consensus.cc:1275] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4 [term 3 FOLLOWER]: Refusing update from remote peer 8777a520aad74df8ba8304f6f9fc7663: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:56:49.274953  1248 consensus_queue.cc:1048] T f9e11e115d2d4d858b28980f176c5059 P 8777a520aad74df8ba8304f6f9fc7663 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5ae6c7e36af45a7908e71a4052f51b4" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:56:49.403424   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:56:49.409613   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 12:56:49.426952  1095 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 12:56:49.432152  1095 consensus_peers.cc:597] T 705f7616236847faa295b48d173caee6 P 8777a520aad74df8ba8304f6f9fc7663 -> Peer d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117): Couldn't send request to peer d5ae6c7e36af45a7908e71a4052f51b4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:49.432837   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:56:49.433523   431 tablet_replica.cc:333] T 95aa5762b14a479993f53d63b8a60f53 P d5ae6c7e36af45a7908e71a4052f51b4: stopping tablet replica
I20260709 12:56:49.434087   431 raft_consensus.cc:2243] T 95aa5762b14a479993f53d63b8a60f53 P d5ae6c7e36af45a7908e71a4052f51b4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:56:49.434805   431 raft_consensus.cc:2272] T 95aa5762b14a479993f53d63b8a60f53 P d5ae6c7e36af45a7908e71a4052f51b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:49.436714   431 tablet_replica.cc:333] T d8b8dbcd5f024dd39f541938e3e01b49 P d5ae6c7e36af45a7908e71a4052f51b4: stopping tablet replica
I20260709 12:56:49.437252   431 raft_consensus.cc:2243] T d8b8dbcd5f024dd39f541938e3e01b49 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:56:49.437902   431 raft_consensus.cc:2272] T d8b8dbcd5f024dd39f541938e3e01b49 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:49.439648   431 tablet_replica.cc:333] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4: stopping tablet replica
I20260709 12:56:49.440148   431 raft_consensus.cc:2243] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:49.440573   431 raft_consensus.cc:2272] T 251001ae236c4740abfbadc79a3f8c7c P d5ae6c7e36af45a7908e71a4052f51b4 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:49.443025   431 tablet_replica.cc:333] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4: stopping tablet replica
I20260709 12:56:49.443492   431 raft_consensus.cc:2243] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:49.443856   431 raft_consensus.cc:2272] T f9e11e115d2d4d858b28980f176c5059 P d5ae6c7e36af45a7908e71a4052f51b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:49.446027   431 tablet_replica.cc:333] T 705f7616236847faa295b48d173caee6 P d5ae6c7e36af45a7908e71a4052f51b4: stopping tablet replica
I20260709 12:56:49.446516   431 raft_consensus.cc:2243] T 705f7616236847faa295b48d173caee6 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:49.446915   431 raft_consensus.cc:2272] T 705f7616236847faa295b48d173caee6 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:49.448707   431 tablet_replica.cc:333] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4: stopping tablet replica
I20260709 12:56:49.449162   431 raft_consensus.cc:2243] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:49.449597   431 raft_consensus.cc:2272] T 382f69f5402f47cd87dfcbadf4e26c91 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:49.451229   431 tablet_replica.cc:333] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4: stopping tablet replica
I20260709 12:56:49.451714   431 raft_consensus.cc:2243] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:49.452090   431 raft_consensus.cc:2272] T e7aa2dfe5f2b4248a04d97913ed09920 P d5ae6c7e36af45a7908e71a4052f51b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:49.454206   431 tablet_replica.cc:333] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4: stopping tablet replica
I20260709 12:56:49.454715   431 raft_consensus.cc:2243] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:49.455097   431 raft_consensus.cc:2272] T 9987770ab9444666b6f418756936dbc7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:49.457075   431 tablet_replica.cc:333] T 269787bc590d4739b10e90ca065aacb7 P d5ae6c7e36af45a7908e71a4052f51b4: stopping tablet replica
I20260709 12:56:49.457717   431 raft_consensus.cc:2243] T 269787bc590d4739b10e90ca065aacb7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:56:49.458432   431 raft_consensus.cc:2272] T 269787bc590d4739b10e90ca065aacb7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:49.460403   431 tablet_replica.cc:333] T baf971c08239449a83cf7be22ab5bbb7 P d5ae6c7e36af45a7908e71a4052f51b4: stopping tablet replica
I20260709 12:56:49.461073   431 raft_consensus.cc:2243] T baf971c08239449a83cf7be22ab5bbb7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:56:49.462227   431 raft_consensus.cc:2272] T baf971c08239449a83cf7be22ab5bbb7 P d5ae6c7e36af45a7908e71a4052f51b4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:56:49.464023  1169 consensus_peers.cc:597] T 382f69f5402f47cd87dfcbadf4e26c91 P c9bb6c25b3ed459085327bf0ec01ef4b -> Peer d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117): Couldn't send request to peer d5ae6c7e36af45a7908e71a4052f51b4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:56:49.486189  1095 consensus_peers.cc:597] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663 -> Peer d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117): Couldn't send request to peer d5ae6c7e36af45a7908e71a4052f51b4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:49.495337   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 12:56:49.513681   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 12:56:49.520959  1169 consensus_peers.cc:597] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b -> Peer d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117): Couldn't send request to peer d5ae6c7e36af45a7908e71a4052f51b4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:49.538183   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:56:49.538954   431 tablet_replica.cc:333] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663: stopping tablet replica
I20260709 12:56:49.539685   431 raft_consensus.cc:2243] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:49.540206   431 raft_consensus.cc:2272] T 95aa5762b14a479993f53d63b8a60f53 P 8777a520aad74df8ba8304f6f9fc7663 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:49.542411   431 tablet_replica.cc:333] T 705f7616236847faa295b48d173caee6 P 8777a520aad74df8ba8304f6f9fc7663: stopping tablet replica
I20260709 12:56:49.542966   431 raft_consensus.cc:2243] T 705f7616236847faa295b48d173caee6 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:56:49.544003   431 raft_consensus.cc:2272] T 705f7616236847faa295b48d173caee6 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:56:49.544108  1169 consensus_peers.cc:597] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b -> Peer d5ae6c7e36af45a7908e71a4052f51b4 (127.0.107.193:45117): Couldn't send request to peer d5ae6c7e36af45a7908e71a4052f51b4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:49.545869   431 tablet_replica.cc:333] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663: stopping tablet replica
I20260709 12:56:49.546430   431 raft_consensus.cc:2243] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:56:49.547183   431 raft_consensus.cc:2272] T 251001ae236c4740abfbadc79a3f8c7c P 8777a520aad74df8ba8304f6f9fc7663 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:49.549294   431 tablet_replica.cc:333] T 382f69f5402f47cd87dfcbadf4e26c91 P 8777a520aad74df8ba8304f6f9fc7663: stopping tablet replica
I20260709 12:56:49.549842   431 raft_consensus.cc:2243] T 382f69f5402f47cd87dfcbadf4e26c91 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:49.550256   431 raft_consensus.cc:2272] T 382f69f5402f47cd87dfcbadf4e26c91 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:49.551909   431 tablet_replica.cc:333] T e7aa2dfe5f2b4248a04d97913ed09920 P 8777a520aad74df8ba8304f6f9fc7663: stopping tablet replica
I20260709 12:56:49.552397   431 raft_consensus.cc:2243] T e7aa2dfe5f2b4248a04d97913ed09920 P 8777a520aad74df8ba8304f6f9fc7663 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:49.552938   431 raft_consensus.cc:2272] T e7aa2dfe5f2b4248a04d97913ed09920 P 8777a520aad74df8ba8304f6f9fc7663 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:49.554996   431 tablet_replica.cc:333] T f9e11e115d2d4d858b28980f176c5059 P 8777a520aad74df8ba8304f6f9fc7663: stopping tablet replica
I20260709 12:56:49.555469   431 raft_consensus.cc:2243] T f9e11e115d2d4d858b28980f176c5059 P 8777a520aad74df8ba8304f6f9fc7663 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:56:49.556165   431 raft_consensus.cc:2272] T f9e11e115d2d4d858b28980f176c5059 P 8777a520aad74df8ba8304f6f9fc7663 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:49.558120   431 tablet_replica.cc:333] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663: stopping tablet replica
I20260709 12:56:49.558583   431 raft_consensus.cc:2243] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:49.558962   431 raft_consensus.cc:2272] T d8b8dbcd5f024dd39f541938e3e01b49 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:49.560645   431 tablet_replica.cc:333] T 9987770ab9444666b6f418756936dbc7 P 8777a520aad74df8ba8304f6f9fc7663: stopping tablet replica
I20260709 12:56:49.561082   431 raft_consensus.cc:2243] T 9987770ab9444666b6f418756936dbc7 P 8777a520aad74df8ba8304f6f9fc7663 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:49.561437   431 raft_consensus.cc:2272] T 9987770ab9444666b6f418756936dbc7 P 8777a520aad74df8ba8304f6f9fc7663 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:49.563480   431 tablet_replica.cc:333] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663: stopping tablet replica
I20260709 12:56:49.563921   431 raft_consensus.cc:2243] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:49.564292   431 raft_consensus.cc:2272] T 269787bc590d4739b10e90ca065aacb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:49.565904   431 tablet_replica.cc:333] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663: stopping tablet replica
I20260709 12:56:49.566301   431 raft_consensus.cc:2243] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:49.566648   431 raft_consensus.cc:2272] T baf971c08239449a83cf7be22ab5bbb7 P 8777a520aad74df8ba8304f6f9fc7663 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:49.586079   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 12:56:49.599043  1167 consensus_peers.cc:597] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b -> Peer 8777a520aad74df8ba8304f6f9fc7663 (127.0.107.194:44107): Couldn't send request to peer 8777a520aad74df8ba8304f6f9fc7663. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:44107: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:49.607267   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 12:56:49.630920   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:56:49.631564   431 tablet_replica.cc:333] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b: stopping tablet replica
I20260709 12:56:49.632157   431 raft_consensus.cc:2243] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:49.632707   431 raft_consensus.cc:2272] T 95aa5762b14a479993f53d63b8a60f53 P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:49.634418   431 tablet_replica.cc:333] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b: stopping tablet replica
I20260709 12:56:49.634922   431 raft_consensus.cc:2243] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:49.635378   431 raft_consensus.cc:2272] T 251001ae236c4740abfbadc79a3f8c7c P c9bb6c25b3ed459085327bf0ec01ef4b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:49.637534   431 tablet_replica.cc:333] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b: stopping tablet replica
I20260709 12:56:49.638083   431 raft_consensus.cc:2243] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:49.638513   431 raft_consensus.cc:2272] T 705f7616236847faa295b48d173caee6 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:49.640095   431 tablet_replica.cc:333] T 382f69f5402f47cd87dfcbadf4e26c91 P c9bb6c25b3ed459085327bf0ec01ef4b: stopping tablet replica
I20260709 12:56:49.640671   431 raft_consensus.cc:2243] T 382f69f5402f47cd87dfcbadf4e26c91 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:56:49.641371   431 raft_consensus.cc:2272] T 382f69f5402f47cd87dfcbadf4e26c91 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:49.642949   431 tablet_replica.cc:333] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b: stopping tablet replica
I20260709 12:56:49.643412   431 raft_consensus.cc:2243] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:56:49.644104   431 raft_consensus.cc:2272] T e7aa2dfe5f2b4248a04d97913ed09920 P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:49.646041   431 tablet_replica.cc:333] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b: stopping tablet replica
I20260709 12:56:49.646514   431 raft_consensus.cc:2243] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:49.646937   431 raft_consensus.cc:2272] T f9e11e115d2d4d858b28980f176c5059 P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:49.649071   431 tablet_replica.cc:333] T baf971c08239449a83cf7be22ab5bbb7 P c9bb6c25b3ed459085327bf0ec01ef4b: stopping tablet replica
I20260709 12:56:49.649556   431 raft_consensus.cc:2243] T baf971c08239449a83cf7be22ab5bbb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:49.649997   431 raft_consensus.cc:2272] T baf971c08239449a83cf7be22ab5bbb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:49.651643   431 tablet_replica.cc:333] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b: stopping tablet replica
I20260709 12:56:49.652084   431 raft_consensus.cc:2243] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:49.652565   431 raft_consensus.cc:2272] T 269787bc590d4739b10e90ca065aacb7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:49.654148   431 tablet_replica.cc:333] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b: stopping tablet replica
I20260709 12:56:49.654582   431 raft_consensus.cc:2243] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:56:49.655275   431 raft_consensus.cc:2272] T 9987770ab9444666b6f418756936dbc7 P c9bb6c25b3ed459085327bf0ec01ef4b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:49.657225   431 tablet_replica.cc:333] T d8b8dbcd5f024dd39f541938e3e01b49 P c9bb6c25b3ed459085327bf0ec01ef4b: stopping tablet replica
I20260709 12:56:49.657677   431 raft_consensus.cc:2243] T d8b8dbcd5f024dd39f541938e3e01b49 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:56:49.658118   431 raft_consensus.cc:2272] T d8b8dbcd5f024dd39f541938e3e01b49 P c9bb6c25b3ed459085327bf0ec01ef4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:49.676553   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 12:56:49.694237   431 master.cc:562] Master@127.0.107.254:37307 shutting down...
I20260709 12:56:49.713186   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9eadc8e3ab0645d392c5f3d7b5a49052 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:56:49.713692   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9eadc8e3ab0645d392c5f3d7b5a49052 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:56:49.714015   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9eadc8e3ab0645d392c5f3d7b5a49052: stopping tablet replica
I20260709 12:56:49.762045   431 master.cc:584] Master@127.0.107.254:37307 shutdown complete.
8777a520aad74df8ba8304f6f9fc7663  4
c9bb6c25b3ed459085327bf0ec01ef4b  1
d5ae6c7e36af45a7908e71a4052f51b4  5
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10577 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:56:49.800601   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:34735
I20260709 12:56:49.801740   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:49.807793  1415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:49.807792  1416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:49.808701  1418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:49.810693   431 server_base.cc:1061] running on GCE node
I20260709 12:56:49.811565   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:49.811756   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:49.811918   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601809811897 us; error 0 us; skew 500 ppm
I20260709 12:56:49.812439   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:49.814929   431 webserver.cc:533] Webserver started at http://127.0.107.254:39119/ using document root <none> and password file <none>
I20260709 12:56:49.815419   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:49.815599   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:49.815876   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:49.817323   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/master-0-root/instance:
uuid: "633384cf034a459c9c7300ebf04605f6"
format_stamp: "Formatted at 2026-07-09 12:56:49 on dist-test-slave-6j4g"
I20260709 12:56:49.821808   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:56:49.825362  1423 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:49.826133   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:56:49.826442   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/master-0-root
uuid: "633384cf034a459c9c7300ebf04605f6"
format_stamp: "Formatted at 2026-07-09 12:56:49 on dist-test-slave-6j4g"
I20260709 12:56:49.826712   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:49.845513   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:49.846732   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:49.884500   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:34735
I20260709 12:56:49.884696  1474 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:34735 every 8 connection(s)
I20260709 12:56:49.888590  1475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:49.898747  1475 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6: Bootstrap starting.
I20260709 12:56:49.903762  1475 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:49.908182  1475 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6: No bootstrap required, opened a new log
I20260709 12:56:49.910374  1475 raft_consensus.cc:359] T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "633384cf034a459c9c7300ebf04605f6" member_type: VOTER }
I20260709 12:56:49.910786  1475 raft_consensus.cc:385] T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:49.910966  1475 raft_consensus.cc:740] T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 633384cf034a459c9c7300ebf04605f6, State: Initialized, Role: FOLLOWER
I20260709 12:56:49.911677  1475 consensus_queue.cc:260] T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "633384cf034a459c9c7300ebf04605f6" member_type: VOTER }
I20260709 12:56:49.912123  1475 raft_consensus.cc:399] T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:56:49.912314  1475 raft_consensus.cc:493] T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:56:49.912542  1475 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:49.916826  1475 raft_consensus.cc:515] T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "633384cf034a459c9c7300ebf04605f6" member_type: VOTER }
I20260709 12:56:49.917331  1475 leader_election.cc:304] T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 633384cf034a459c9c7300ebf04605f6; no voters: 
I20260709 12:56:49.918362  1475 leader_election.cc:290] T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:56:49.918829  1478 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:49.920151  1478 raft_consensus.cc:697] T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6 [term 1 LEADER]: Becoming Leader. State: Replica: 633384cf034a459c9c7300ebf04605f6, State: Running, Role: LEADER
I20260709 12:56:49.920899  1478 consensus_queue.cc:237] T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "633384cf034a459c9c7300ebf04605f6" member_type: VOTER }
I20260709 12:56:49.921260  1475 sys_catalog.cc:565] T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:56:49.925508  1479 sys_catalog.cc:455] T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "633384cf034a459c9c7300ebf04605f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "633384cf034a459c9c7300ebf04605f6" member_type: VOTER } }
I20260709 12:56:49.925966  1480 sys_catalog.cc:455] T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 633384cf034a459c9c7300ebf04605f6. Latest consensus state: current_term: 1 leader_uuid: "633384cf034a459c9c7300ebf04605f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "633384cf034a459c9c7300ebf04605f6" member_type: VOTER } }
I20260709 12:56:49.926162  1479 sys_catalog.cc:458] T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6 [sys.catalog]: This master's current role is: LEADER
I20260709 12:56:49.926466  1480 sys_catalog.cc:458] T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6 [sys.catalog]: This master's current role is: LEADER
I20260709 12:56:49.931208  1484 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:56:49.938678  1484 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:56:49.939690   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:56:49.947878  1484 catalog_manager.cc:1383] Generated new cluster ID: c98a1de6a81048d19fd4edd83c0bf7fe
I20260709 12:56:49.948164  1484 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:56:49.966398  1484 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:56:49.967689  1484 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:56:49.980206  1484 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6: Generated new TSK 0
I20260709 12:56:49.980855  1484 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:56:50.007077   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:50.013046  1496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:50.014226  1497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:50.015583  1499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:50.016563   431 server_base.cc:1061] running on GCE node
I20260709 12:56:50.017815   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:50.018005   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:50.018126   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601810018114 us; error 0 us; skew 500 ppm
I20260709 12:56:50.018604   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:50.020937   431 webserver.cc:533] Webserver started at http://127.0.107.193:35027/ using document root <none> and password file <none>
I20260709 12:56:50.021380   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:50.021535   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:50.021745   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:50.022894   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-0-root/instance:
uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
format_stamp: "Formatted at 2026-07-09 12:56:50 on dist-test-slave-6j4g"
I20260709 12:56:50.027539   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:56:50.030997  1504 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:50.031761   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:56:50.032052   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-0-root
uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
format_stamp: "Formatted at 2026-07-09 12:56:50 on dist-test-slave-6j4g"
I20260709 12:56:50.032361   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:50.047412   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:50.049237   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:50.050793   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:56:50.053303   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:56:50.053519   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:50.053748   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:56:50.053933   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:50.096099   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:43903
I20260709 12:56:50.096311  1566 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:43903 every 8 connection(s)
I20260709 12:56:50.101253   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:50.108669  1571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:50.109838  1572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:50.113212  1574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:50.113443   431 server_base.cc:1061] running on GCE node
I20260709 12:56:50.115065   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:50.115360   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:50.115558   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601810115537 us; error 0 us; skew 500 ppm
I20260709 12:56:50.115783  1567 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34735
I20260709 12:56:50.116184  1567 heartbeater.cc:461] Registering TS with master...
I20260709 12:56:50.116217   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:50.117163  1567 heartbeater.cc:507] Master 127.0.107.254:34735 requested a full tablet report, sending...
I20260709 12:56:50.119237   431 webserver.cc:533] Webserver started at http://127.0.107.194:37229/ using document root <none> and password file <none>
I20260709 12:56:50.119733  1440 ts_manager.cc:194] Registered new tserver with Master: dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903)
I20260709 12:56:50.119910   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:50.120172   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:50.120527   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:50.122059   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-1-root/instance:
uuid: "c262eac7fc904ae9bb91e450f6532e3f"
format_stamp: "Formatted at 2026-07-09 12:56:50 on dist-test-slave-6j4g"
I20260709 12:56:50.122298  1440 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54582
I20260709 12:56:50.127534   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 12:56:50.131137  1579 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:50.131916   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:56:50.132217   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-1-root
uuid: "c262eac7fc904ae9bb91e450f6532e3f"
format_stamp: "Formatted at 2026-07-09 12:56:50 on dist-test-slave-6j4g"
I20260709 12:56:50.132542   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:50.158499   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:50.159663   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:50.161130   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:56:50.163475   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:56:50.163689   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:50.163908   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:56:50.164068   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:50.204344   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:41953
I20260709 12:56:50.204532  1641 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:41953 every 8 connection(s)
I20260709 12:56:50.210018   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:56:50.218637  1645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:50.220889  1646 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:56:50.225178  1648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:56:50.225852   431 server_base.cc:1061] running on GCE node
I20260709 12:56:50.226620  1642 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34735
I20260709 12:56:50.227207  1642 heartbeater.cc:461] Registering TS with master...
I20260709 12:56:50.227312   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:56:50.227643   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:56:50.227856   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601810227835 us; error 0 us; skew 500 ppm
I20260709 12:56:50.228434  1642 heartbeater.cc:507] Master 127.0.107.254:34735 requested a full tablet report, sending...
I20260709 12:56:50.228878   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:56:50.231528  1440 ts_manager.cc:194] Registered new tserver with Master: c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:50.233098   431 webserver.cc:533] Webserver started at http://127.0.107.195:35225/ using document root <none> and password file <none>
I20260709 12:56:50.233784  1440 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54590
I20260709 12:56:50.233855   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:56:50.234421   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:56:50.234827   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:56:50.236392   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-2-root/instance:
uuid: "4487a53c51be4634bf1ef29c5248353d"
format_stamp: "Formatted at 2026-07-09 12:56:50 on dist-test-slave-6j4g"
I20260709 12:56:50.241076   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:56:50.244467  1653 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:50.245280   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:56:50.245599   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-2-root
uuid: "4487a53c51be4634bf1ef29c5248353d"
format_stamp: "Formatted at 2026-07-09 12:56:50 on dist-test-slave-6j4g"
I20260709 12:56:50.245873   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:56:50.269289   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:56:50.270495   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:56:50.272068   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:56:50.274422   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:56:50.274645   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:50.274887   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:56:50.275054   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:56:50.316146   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:45275
I20260709 12:56:50.316263  1715 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:45275 every 8 connection(s)
I20260709 12:56:50.330600  1716 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34735
I20260709 12:56:50.331013  1716 heartbeater.cc:461] Registering TS with master...
I20260709 12:56:50.331732  1716 heartbeater.cc:507] Master 127.0.107.254:34735 requested a full tablet report, sending...
I20260709 12:56:50.333911  1440 ts_manager.cc:194] Registered new tserver with Master: 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:50.334555   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01521616s
I20260709 12:56:50.335613  1440 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54606
I20260709 12:56:50.362725  1440 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54614:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:56:50.368685  1440 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:56:50.584442  1532 tablet_service.cc:1511] Processing CreateTablet for tablet 9a7bc646e9bf4d2e9952c8b5d4a5be14 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:56:50.585201  1530 tablet_service.cc:1511] Processing CreateTablet for tablet eabf19413eea44dd86511e07a036166b (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:56:50.586158  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a7bc646e9bf4d2e9952c8b5d4a5be14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.586992  1528 tablet_service.cc:1511] Processing CreateTablet for tablet b7634482da3645aeb7462251e5df3726 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:56:50.587589  1529 tablet_service.cc:1511] Processing CreateTablet for tablet dbdf9662619648c4a3b76fbbda8d0e14 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:56:50.589145  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbdf9662619648c4a3b76fbbda8d0e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.589695  1531 tablet_service.cc:1511] Processing CreateTablet for tablet ac600187e28f4d0fa948e0d053317e88 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:56:50.590565  1526 tablet_service.cc:1511] Processing CreateTablet for tablet 9b4de1379d73445699a2babbca8fce44 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:56:50.591137  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac600187e28f4d0fa948e0d053317e88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.591807  1526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b4de1379d73445699a2babbca8fce44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.588759  1527 tablet_service.cc:1511] Processing CreateTablet for tablet 35beb9f05ad84a8fb211d701469ddd6c (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:56:50.592821  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eabf19413eea44dd86511e07a036166b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.593535  1527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35beb9f05ad84a8fb211d701469ddd6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.598515  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7634482da3645aeb7462251e5df3726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.601759  1525 tablet_service.cc:1511] Processing CreateTablet for tablet 147199196d114d4c90fd8fba442ab7d8 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:56:50.603230  1525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 147199196d114d4c90fd8fba442ab7d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.607056  1524 tablet_service.cc:1511] Processing CreateTablet for tablet 398a6324f64f46b0accba6cac64dfec6 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:56:50.608574  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 398a6324f64f46b0accba6cac64dfec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.609057  1523 tablet_service.cc:1511] Processing CreateTablet for tablet 8a2233a4e08d4138b4eb687a0440be86 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:56:50.610482  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a2233a4e08d4138b4eb687a0440be86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.620934  1680 tablet_service.cc:1511] Processing CreateTablet for tablet ac600187e28f4d0fa948e0d053317e88 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:56:50.621646  1681 tablet_service.cc:1511] Processing CreateTablet for tablet 9a7bc646e9bf4d2e9952c8b5d4a5be14 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:56:50.622483  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac600187e28f4d0fa948e0d053317e88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.624019  1678 tablet_service.cc:1511] Processing CreateTablet for tablet dbdf9662619648c4a3b76fbbda8d0e14 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:56:50.625500  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbdf9662619648c4a3b76fbbda8d0e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.625680  1679 tablet_service.cc:1511] Processing CreateTablet for tablet eabf19413eea44dd86511e07a036166b (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:56:50.627060  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eabf19413eea44dd86511e07a036166b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.627897  1677 tablet_service.cc:1511] Processing CreateTablet for tablet b7634482da3645aeb7462251e5df3726 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:56:50.629235  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7634482da3645aeb7462251e5df3726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.631609  1676 tablet_service.cc:1511] Processing CreateTablet for tablet 35beb9f05ad84a8fb211d701469ddd6c (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:56:50.633075  1676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35beb9f05ad84a8fb211d701469ddd6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.636834  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a7bc646e9bf4d2e9952c8b5d4a5be14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.650013  1675 tablet_service.cc:1511] Processing CreateTablet for tablet 9b4de1379d73445699a2babbca8fce44 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:56:50.651516  1675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b4de1379d73445699a2babbca8fce44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.654016  1674 tablet_service.cc:1511] Processing CreateTablet for tablet 147199196d114d4c90fd8fba442ab7d8 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:56:50.657227  1673 tablet_service.cc:1511] Processing CreateTablet for tablet 398a6324f64f46b0accba6cac64dfec6 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:56:50.664098  1674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 147199196d114d4c90fd8fba442ab7d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.668826  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 398a6324f64f46b0accba6cac64dfec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.678778  1607 tablet_service.cc:1511] Processing CreateTablet for tablet 9a7bc646e9bf4d2e9952c8b5d4a5be14 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:56:50.680178  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a7bc646e9bf4d2e9952c8b5d4a5be14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.681586  1606 tablet_service.cc:1511] Processing CreateTablet for tablet ac600187e28f4d0fa948e0d053317e88 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:56:50.683889  1605 tablet_service.cc:1511] Processing CreateTablet for tablet eabf19413eea44dd86511e07a036166b (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:56:50.685763  1672 tablet_service.cc:1511] Processing CreateTablet for tablet 8a2233a4e08d4138b4eb687a0440be86 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:56:50.686146  1604 tablet_service.cc:1511] Processing CreateTablet for tablet dbdf9662619648c4a3b76fbbda8d0e14 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:56:50.687204  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a2233a4e08d4138b4eb687a0440be86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.688292  1603 tablet_service.cc:1511] Processing CreateTablet for tablet b7634482da3645aeb7462251e5df3726 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:56:50.690658  1602 tablet_service.cc:1511] Processing CreateTablet for tablet 35beb9f05ad84a8fb211d701469ddd6c (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:56:50.693078  1601 tablet_service.cc:1511] Processing CreateTablet for tablet 9b4de1379d73445699a2babbca8fce44 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:56:50.695487  1600 tablet_service.cc:1511] Processing CreateTablet for tablet 147199196d114d4c90fd8fba442ab7d8 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:56:50.698156  1599 tablet_service.cc:1511] Processing CreateTablet for tablet 398a6324f64f46b0accba6cac64dfec6 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:56:50.705638  1528 tablet_service.cc:1511] Processing CreateTablet for tablet d5d52e25b9814edbb805e7d6bcce5b5d (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:56:50.708866  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbdf9662619648c4a3b76fbbda8d0e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.716542  1731 tablet_bootstrap.cc:492] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:50.717458  1602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35beb9f05ad84a8fb211d701469ddd6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.719025  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac600187e28f4d0fa948e0d053317e88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.722003  1598 tablet_service.cc:1511] Processing CreateTablet for tablet 8a2233a4e08d4138b4eb687a0440be86 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:56:50.723155  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eabf19413eea44dd86511e07a036166b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.723901  1601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b4de1379d73445699a2babbca8fce44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.724813  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a2233a4e08d4138b4eb687a0440be86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.728967  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 147199196d114d4c90fd8fba442ab7d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.729707  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 398a6324f64f46b0accba6cac64dfec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.730512  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7634482da3645aeb7462251e5df3726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.740093  1526 tablet_service.cc:1511] Processing CreateTablet for tablet 0e84698abe8e46788d46c9bf8a4c74c7 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:56:50.746847  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5d52e25b9814edbb805e7d6bcce5b5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.735278  1523 tablet_service.cc:1511] Processing CreateTablet for tablet d630fd40a4084d87954d0e6c16998a70 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:56:50.755784  1676 tablet_service.cc:1511] Processing CreateTablet for tablet d5d52e25b9814edbb805e7d6bcce5b5d (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:56:50.757273  1676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5d52e25b9814edbb805e7d6bcce5b5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.767297  1679 tablet_service.cc:1511] Processing CreateTablet for tablet 0e84698abe8e46788d46c9bf8a4c74c7 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:56:50.773953  1677 tablet_service.cc:1511] Processing CreateTablet for tablet d630fd40a4084d87954d0e6c16998a70 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:56:50.775266  1676 tablet_service.cc:1511] Processing CreateTablet for tablet db011c2c8016405d968fe57a093fc111 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:56:50.775306  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d630fd40a4084d87954d0e6c16998a70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.779004  1531 tablet_service.cc:1511] Processing CreateTablet for tablet db011c2c8016405d968fe57a093fc111 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:56:50.781112  1676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db011c2c8016405d968fe57a093fc111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.792892  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e84698abe8e46788d46c9bf8a4c74c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.797600  1731 tablet_bootstrap.cc:654] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:50.799644  1529 tablet_service.cc:1511] Processing CreateTablet for tablet d3cb0f1c44ec45f38ff2f0c27480a08c (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:56:50.802513  1681 tablet_service.cc:1511] Processing CreateTablet for tablet d3cb0f1c44ec45f38ff2f0c27480a08c (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:56:50.803905  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3cb0f1c44ec45f38ff2f0c27480a08c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.807724  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 8b3e4ab7be234d07aa27f18779c01c0d (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:56:50.809135  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b3e4ab7be234d07aa27f18779c01c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.821679  1677 tablet_service.cc:1511] Processing CreateTablet for tablet e4d03bbba4ce46ecb686052832c7b862 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:56:50.807665  1672 tablet_service.cc:1511] Processing CreateTablet for tablet 105edc3ce5964519acbd96dbaa975697 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:56:50.819931  1598 tablet_service.cc:1511] Processing CreateTablet for tablet d36fee36a84e4cf98ad42f287d4f317f (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:56:50.833976  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4d03bbba4ce46ecb686052832c7b862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.833029  1676 tablet_service.cc:1511] Processing CreateTablet for tablet d36fee36a84e4cf98ad42f287d4f317f (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:56:50.845389  1676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d36fee36a84e4cf98ad42f287d4f317f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.848907  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d36fee36a84e4cf98ad42f287d4f317f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.849036  1673 tablet_service.cc:1511] Processing CreateTablet for tablet 6f1367cef67f42eab84cbda659b7ffb1 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:56:50.866370  1604 tablet_service.cc:1511] Processing CreateTablet for tablet d5d52e25b9814edbb805e7d6bcce5b5d (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:56:50.866891  1526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e84698abe8e46788d46c9bf8a4c74c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.870939  1525 tablet_service.cc:1511] Processing CreateTablet for tablet e4d03bbba4ce46ecb686052832c7b862 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:56:50.874645  1527 tablet_service.cc:1511] Processing CreateTablet for tablet d36fee36a84e4cf98ad42f287d4f317f (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:56:50.868813  1528 tablet_service.cc:1511] Processing CreateTablet for tablet 105edc3ce5964519acbd96dbaa975697 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:56:50.872299  1525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4d03bbba4ce46ecb686052832c7b862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.876859  1607 tablet_service.cc:1511] Processing CreateTablet for tablet d630fd40a4084d87954d0e6c16998a70 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:56:50.877429  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 105edc3ce5964519acbd96dbaa975697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.885226  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f1367cef67f42eab84cbda659b7ffb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.878352  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d630fd40a4084d87954d0e6c16998a70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.891436  1681 tablet_service.cc:1511] Processing CreateTablet for tablet d127be99e2af41c0808e03480c1b64e3 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:56:50.880329  1530 tablet_service.cc:1511] Processing CreateTablet for tablet 6f1367cef67f42eab84cbda659b7ffb1 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:56:50.870079  1600 tablet_service.cc:1511] Processing CreateTablet for tablet 0e84698abe8e46788d46c9bf8a4c74c7 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:56:50.904246  1731 tablet_bootstrap.cc:492] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:50.904670  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db011c2c8016405d968fe57a093fc111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.904829  1731 ts_tablet_manager.cc:1403] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.189s	user 0.013s	sys 0.000s
I20260709 12:56:50.907791  1731 raft_consensus.cc:359] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:50.908882  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d630fd40a4084d87954d0e6c16998a70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.909358  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 105edc3ce5964519acbd96dbaa975697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.917711  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3cb0f1c44ec45f38ff2f0c27480a08c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.919839  1527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d36fee36a84e4cf98ad42f287d4f317f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.922510  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f1367cef67f42eab84cbda659b7ffb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.916846  1731 raft_consensus.cc:385] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:50.927243  1731 raft_consensus.cc:740] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:50.928066  1731 consensus_queue.cc:260] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:50.912711  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5d52e25b9814edbb805e7d6bcce5b5d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:56:50.934047  1488 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:56:50.914924  1675 tablet_service.cc:1511] Processing CreateTablet for tablet d8b7121a813948bfa350d3f0b9fd6988 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:56:50.936825  1603 tablet_service.cc:1511] Processing CreateTablet for tablet 8b3e4ab7be234d07aa27f18779c01c0d (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:56:50.938014  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e84698abe8e46788d46c9bf8a4c74c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.938724  1734 tablet_bootstrap.cc:492] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:50.945439  1601 tablet_service.cc:1511] Processing CreateTablet for tablet 105edc3ce5964519acbd96dbaa975697 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:56:50.946797  1601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 105edc3ce5964519acbd96dbaa975697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.912037  1602 tablet_service.cc:1511] Processing CreateTablet for tablet d3cb0f1c44ec45f38ff2f0c27480a08c (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:56:50.948401  1598 tablet_service.cc:1511] Processing CreateTablet for tablet e4d03bbba4ce46ecb686052832c7b862 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:56:50.916891  1524 tablet_service.cc:1511] Processing CreateTablet for tablet 8b3e4ab7be234d07aa27f18779c01c0d (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:56:50.949512  1602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3cb0f1c44ec45f38ff2f0c27480a08c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.950336  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b3e4ab7be234d07aa27f18779c01c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.950647  1599 tablet_service.cc:1511] Processing CreateTablet for tablet 6f1367cef67f42eab84cbda659b7ffb1 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:56:50.951941  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f1367cef67f42eab84cbda659b7ffb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.953277  1732 tablet_bootstrap.cc:492] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:50.911868  1605 tablet_service.cc:1511] Processing CreateTablet for tablet db011c2c8016405d968fe57a093fc111 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:56:50.959089  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db011c2c8016405d968fe57a093fc111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.960274  1679 tablet_service.cc:1511] Processing CreateTablet for tablet 9324141fa1ba48aca59e97123ca5742e (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:56:50.963148  1675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b7121a813948bfa350d3f0b9fd6988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.962700  1677 tablet_service.cc:1511] Processing CreateTablet for tablet cdff63e2a2e94c729942046ee2f02a09 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:56:50.993659  1526 tablet_service.cc:1511] Processing CreateTablet for tablet 9324141fa1ba48aca59e97123ca5742e (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:56:50.995147  1526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9324141fa1ba48aca59e97123ca5742e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.964428  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdff63e2a2e94c729942046ee2f02a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.998704  1680 tablet_service.cc:1511] Processing CreateTablet for tablet f0eedb9e9c8c4177903e544c600553f3 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:56:51.000113  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0eedb9e9c8c4177903e544c600553f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.973807  1606 tablet_service.cc:1511] Processing CreateTablet for tablet d127be99e2af41c0808e03480c1b64e3 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:56:50.968887  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b3e4ab7be234d07aa27f18779c01c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.980650  1674 tablet_service.cc:1511] Processing CreateTablet for tablet a5981b12945c4d5b8d59d139eb1c77a2 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:56:50.978549  1676 tablet_service.cc:1511] Processing CreateTablet for tablet 22060ec6ef664a749065c3f00807b450 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:56:50.973807  1532 tablet_service.cc:1511] Processing CreateTablet for tablet d127be99e2af41c0808e03480c1b64e3 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:56:51.004566  1732 tablet_bootstrap.cc:654] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:51.004817  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4d03bbba4ce46ecb686052832c7b862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.005122  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d127be99e2af41c0808e03480c1b64e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.004467  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9324141fa1ba48aca59e97123ca5742e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.008208  1674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5981b12945c4d5b8d59d139eb1c77a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.009521  1731 ts_tablet_manager.cc:1434] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.104s	user 0.013s	sys 0.000s
I20260709 12:56:51.009881  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d127be99e2af41c0808e03480c1b64e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.010586  1731 tablet_bootstrap.cc:492] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:51.012811  1567 heartbeater.cc:499] Master 127.0.107.254:34735 was elected leader, sending a full tablet report...
I20260709 12:56:51.015468  1676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22060ec6ef664a749065c3f00807b450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:50.981853  1734 tablet_bootstrap.cc:654] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:51.021601  1672 tablet_service.cc:1511] Processing CreateTablet for tablet 95abfe15f7d54f3fb0f01f162b262561 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:56:51.027146  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d127be99e2af41c0808e03480c1b64e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.029241  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95abfe15f7d54f3fb0f01f162b262561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.024770  1673 tablet_service.cc:1511] Processing CreateTablet for tablet cc0adb56140a4e698e722f4960e13783 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:56:51.059854  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc0adb56140a4e698e722f4960e13783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.067968  1524 tablet_service.cc:1511] Processing CreateTablet for tablet 22060ec6ef664a749065c3f00807b450 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:56:51.071389  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22060ec6ef664a749065c3f00807b450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.071755  1528 tablet_service.cc:1511] Processing CreateTablet for tablet cdff63e2a2e94c729942046ee2f02a09 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:56:51.073046  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdff63e2a2e94c729942046ee2f02a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.074855  1530 tablet_service.cc:1511] Processing CreateTablet for tablet a5981b12945c4d5b8d59d139eb1c77a2 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:56:51.076061  1599 tablet_service.cc:1511] Processing CreateTablet for tablet d8b7121a813948bfa350d3f0b9fd6988 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:56:51.080684  1674 tablet_service.cc:1511] Processing CreateTablet for tablet 62a133aa1e234c489eaeb6341dc87b49 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:56:51.087090  1674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62a133aa1e234c489eaeb6341dc87b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.096731  1603 tablet_service.cc:1511] Processing CreateTablet for tablet 9324141fa1ba48aca59e97123ca5742e (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:56:51.098313  1732 tablet_bootstrap.cc:492] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:51.098845  1732 ts_tablet_manager.cc:1403] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.146s	user 0.009s	sys 0.008s
I20260709 12:56:51.101784  1531 tablet_service.cc:1511] Processing CreateTablet for tablet d8b7121a813948bfa350d3f0b9fd6988 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:56:51.103179  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b7121a813948bfa350d3f0b9fd6988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.104760  1734 tablet_bootstrap.cc:492] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:51.105295  1734 ts_tablet_manager.cc:1403] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.167s	user 0.015s	sys 0.015s
I20260709 12:56:51.108577  1600 tablet_service.cc:1511] Processing CreateTablet for tablet 22060ec6ef664a749065c3f00807b450 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:56:51.114212  1731 tablet_bootstrap.cc:654] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:51.116817  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5981b12945c4d5b8d59d139eb1c77a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.119915  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b7121a813948bfa350d3f0b9fd6988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.122905  1607 tablet_service.cc:1511] Processing CreateTablet for tablet cdff63e2a2e94c729942046ee2f02a09 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:56:51.108106  1734 raft_consensus.cc:359] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:51.124878  1734 raft_consensus.cc:385] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:51.125218  1734 raft_consensus.cc:740] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:51.136077  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 12b2051da69c4c7f8b35da07093dfc33 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:56:51.136740  1523 tablet_service.cc:1511] Processing CreateTablet for tablet f0eedb9e9c8c4177903e544c600553f3 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:56:51.137181  1601 tablet_service.cc:1511] Processing CreateTablet for tablet a5981b12945c4d5b8d59d139eb1c77a2 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:56:51.138167  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0eedb9e9c8c4177903e544c600553f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.135095  1734 consensus_queue.cc:260] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:51.142738  1602 tablet_service.cc:1511] Processing CreateTablet for tablet f0eedb9e9c8c4177903e544c600553f3 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:56:51.158720  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b2051da69c4c7f8b35da07093dfc33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.169731  1674 tablet_service.cc:1511] Processing CreateTablet for tablet 42248b4b3b744072a3581db8c3874c55 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:56:51.171231  1674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42248b4b3b744072a3581db8c3874c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.161342  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9324141fa1ba48aca59e97123ca5742e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.174537  1602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0eedb9e9c8c4177903e544c600553f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.175904  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdff63e2a2e94c729942046ee2f02a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.176615  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22060ec6ef664a749065c3f00807b450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.176945  1675 tablet_service.cc:1511] Processing CreateTablet for tablet a73b99964f4c4107aed2d05c6106b3b5 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:56:51.178386  1675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a73b99964f4c4107aed2d05c6106b3b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.180044  1598 tablet_service.cc:1511] Processing CreateTablet for tablet cc0adb56140a4e698e722f4960e13783 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:56:51.181610  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc0adb56140a4e698e722f4960e13783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.181538  1525 tablet_service.cc:1511] Processing CreateTablet for tablet 95abfe15f7d54f3fb0f01f162b262561 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:56:51.203573  1734 ts_tablet_manager.cc:1434] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.098s	user 0.008s	sys 0.007s
I20260709 12:56:51.204344  1642 heartbeater.cc:499] Master 127.0.107.254:34735 was elected leader, sending a full tablet report...
I20260709 12:56:51.205009  1525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95abfe15f7d54f3fb0f01f162b262561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.210983  1731 tablet_bootstrap.cc:492] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:51.210608  1732 raft_consensus.cc:359] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:51.211504  1731 ts_tablet_manager.cc:1403] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.201s	user 0.011s	sys 0.004s
I20260709 12:56:51.214449  1731 raft_consensus.cc:359] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:51.215195  1731 raft_consensus.cc:385] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:51.215505  1731 raft_consensus.cc:740] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:51.216522  1678 tablet_service.cc:1511] Processing CreateTablet for tablet d7727fcb0cf9452fbbc077ab7987b596 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:56:51.217893  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7727fcb0cf9452fbbc077ab7987b596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.217535  1731 consensus_queue.cc:260] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:51.220279  1731 ts_tablet_manager.cc:1434] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:56:51.221354  1731 tablet_bootstrap.cc:492] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:51.221844  1527 tablet_service.cc:1511] Processing CreateTablet for tablet a73b99964f4c4107aed2d05c6106b3b5 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:56:51.223335  1527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a73b99964f4c4107aed2d05c6106b3b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.219827  1529 tablet_service.cc:1511] Processing CreateTablet for tablet cc0adb56140a4e698e722f4960e13783 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:56:51.236029  1734 tablet_bootstrap.cc:492] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:51.229789  1731 tablet_bootstrap.cc:654] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:51.237346  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc0adb56140a4e698e722f4960e13783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.260847  1604 tablet_service.cc:1511] Processing CreateTablet for tablet 95abfe15f7d54f3fb0f01f162b262561 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:56:51.266389  1606 tablet_service.cc:1511] Processing CreateTablet for tablet a73b99964f4c4107aed2d05c6106b3b5 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:56:51.264097  1679 tablet_service.cc:1511] Processing CreateTablet for tablet 920d24d01316479692fb62f167beb41e (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:56:51.269640  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 920d24d01316479692fb62f167beb41e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.211504  1732 raft_consensus.cc:385] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:51.272907  1732 raft_consensus.cc:740] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:51.273736  1732 consensus_queue.cc:260] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:51.278867  1601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5981b12945c4d5b8d59d139eb1c77a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.285686  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95abfe15f7d54f3fb0f01f162b262561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.292105  1734 tablet_bootstrap.cc:654] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:51.304136  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a73b99964f4c4107aed2d05c6106b3b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.306172  1523 tablet_service.cc:1511] Processing CreateTablet for tablet 12b2051da69c4c7f8b35da07093dfc33 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:56:51.307600  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b2051da69c4c7f8b35da07093dfc33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.308547  1732 ts_tablet_manager.cc:1434] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.209s	user 0.008s	sys 0.003s
I20260709 12:56:51.309324  1716 heartbeater.cc:499] Master 127.0.107.254:34735 was elected leader, sending a full tablet report...
I20260709 12:56:51.310765  1732 tablet_bootstrap.cc:492] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:51.280467  1673 tablet_service.cc:1511] Processing CreateTablet for tablet 0507fcc8f9794c668a81d8519fc995be (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:56:51.313349  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0507fcc8f9794c668a81d8519fc995be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.317286  1532 tablet_service.cc:1511] Processing CreateTablet for tablet 62a133aa1e234c489eaeb6341dc87b49 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:56:51.318707  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62a133aa1e234c489eaeb6341dc87b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.322012  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 42248b4b3b744072a3581db8c3874c55 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:56:51.324096  1605 tablet_service.cc:1511] Processing CreateTablet for tablet 12b2051da69c4c7f8b35da07093dfc33 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:56:51.332548  1525 tablet_service.cc:1511] Processing CreateTablet for tablet d7727fcb0cf9452fbbc077ab7987b596 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:56:51.338232  1676 tablet_service.cc:1511] Processing CreateTablet for tablet 7d92e33e89814e86abdebb8b54a3a5c5 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:56:51.340230  1524 tablet_service.cc:1511] Processing CreateTablet for tablet 920d24d01316479692fb62f167beb41e (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:56:51.347544  1525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7727fcb0cf9452fbbc077ab7987b596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.348445  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 920d24d01316479692fb62f167beb41e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.342767  1528 tablet_service.cc:1511] Processing CreateTablet for tablet 0507fcc8f9794c668a81d8519fc995be (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:56:51.306375  1602 tablet_service.cc:1511] Processing CreateTablet for tablet 62a133aa1e234c489eaeb6341dc87b49 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:56:51.347532  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b2051da69c4c7f8b35da07093dfc33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.353365  1735 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:51.353868  1735 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:51.354481  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42248b4b3b744072a3581db8c3874c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.356456  1735 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:51.375097  1676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d92e33e89814e86abdebb8b54a3a5c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.376662  1681 tablet_service.cc:1511] Processing CreateTablet for tablet e4681eaad3084357b9677e4242b97c99 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:56:51.383387  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4681eaad3084357b9677e4242b97c99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.396605  1734 tablet_bootstrap.cc:492] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:51.397073  1734 ts_tablet_manager.cc:1403] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.161s	user 0.029s	sys 0.009s
I20260709 12:56:51.399353  1734 raft_consensus.cc:359] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:51.401986  1526 tablet_service.cc:1511] Processing CreateTablet for tablet 7d92e33e89814e86abdebb8b54a3a5c5 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:56:51.403220  1732 tablet_bootstrap.cc:654] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:51.405870  1731 tablet_bootstrap.cc:492] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:51.399917  1734 raft_consensus.cc:385] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:51.400918  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0507fcc8f9794c668a81d8519fc995be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.411862  1734 raft_consensus.cc:740] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:51.417043  1734 consensus_queue.cc:260] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:51.420388  1672 tablet_service.cc:1511] Processing CreateTablet for tablet db702b262c1644109366a56f6f0d805a (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:56:51.422195  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db702b262c1644109366a56f6f0d805a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.423840  1678 tablet_service.cc:1511] Processing CreateTablet for tablet 499cf87d55ba434fa03c7cf6c1bb54c8 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:56:51.425123  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 499cf87d55ba434fa03c7cf6c1bb54c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.425194  1739 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:51.425680  1739 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:51.403697  1602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62a133aa1e234c489eaeb6341dc87b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.423964  1734 ts_tablet_manager.cc:1434] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:56:51.434725  1731 ts_tablet_manager.cc:1403] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.214s	user 0.036s	sys 0.015s
I20260709 12:56:51.429402  1676 tablet_service.cc:1511] Processing CreateTablet for tablet d2eccdddaa724fed8954f5e5bc110b80 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:56:51.444098  1734 tablet_bootstrap.cc:492] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:51.432859  1739 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:51.441620  1526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d92e33e89814e86abdebb8b54a3a5c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.454409  1734 tablet_bootstrap.cc:654] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:51.456604  1528 tablet_service.cc:1511] Processing CreateTablet for tablet e4681eaad3084357b9677e4242b97c99 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:56:51.456957  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 97e583cb09524a098c997f9996eb5b03 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:56:51.462555  1600 tablet_service.cc:1511] Processing CreateTablet for tablet 42248b4b3b744072a3581db8c3874c55 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:56:51.468952  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:51.489661  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4681eaad3084357b9677e4242b97c99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.492766  1741 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:51.469939  1607 tablet_service.cc:1511] Processing CreateTablet for tablet d7727fcb0cf9452fbbc077ab7987b596 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:56:51.493331  1741 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:51.473131  1532 tablet_service.cc:1511] Processing CreateTablet for tablet 97e583cb09524a098c997f9996eb5b03 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:56:51.477424  1529 tablet_service.cc:1511] Processing CreateTablet for tablet aa984c8881704e97b0d6a6eb60605021 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:56:51.496856  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97e583cb09524a098c997f9996eb5b03. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:56:51.497628  1505 leader_election.cc:343] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:51.478242  1598 tablet_service.cc:1511] Processing CreateTablet for tablet 920d24d01316479692fb62f167beb41e (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:56:51.411985  1674 tablet_service.cc:1511] Processing CreateTablet for tablet aa984c8881704e97b0d6a6eb60605021 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:56:51.498299  1530 tablet_service.cc:1511] Processing CreateTablet for tablet db702b262c1644109366a56f6f0d805a (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:56:51.500998  1741 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:51.513239  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa984c8881704e97b0d6a6eb60605021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.515918  1676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2eccdddaa724fed8954f5e5bc110b80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.527768  1677 tablet_service.cc:1511] Processing CreateTablet for tablet 5664f3181d5c4b20bb8443fb79030930 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:56:51.530661  1731 raft_consensus.cc:359] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:51.531543  1731 raft_consensus.cc:385] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:51.531841  1731 raft_consensus.cc:740] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:51.536780  1731 consensus_queue.cc:260] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:51.543679  1731 ts_tablet_manager.cc:1434] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.098s	user 0.004s	sys 0.002s
I20260709 12:56:51.544662  1675 tablet_service.cc:1511] Processing CreateTablet for tablet 6578815705874ccfb147b36c5f6db70a (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:56:51.546033  1678 tablet_service.cc:1511] Processing CreateTablet for tablet 03a87bdd56034cbaa09fbc461a7bd313 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:56:51.549660  1672 tablet_service.cc:1511] Processing CreateTablet for tablet f0a8a9b410b84b569aa1245ad95bb229 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:56:51.553764  1731 tablet_bootstrap.cc:492] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:51.554908  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5664f3181d5c4b20bb8443fb79030930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.557629  1675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6578815705874ccfb147b36c5f6db70a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.557250  1599 tablet_service.cc:1511] Processing CreateTablet for tablet 0507fcc8f9794c668a81d8519fc995be (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:56:51.533510  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42248b4b3b744072a3581db8c3874c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.559973  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7727fcb0cf9452fbbc077ab7987b596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.564829  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 920d24d01316479692fb62f167beb41e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.571751  1604 tablet_service.cc:1511] Processing CreateTablet for tablet e4681eaad3084357b9677e4242b97c99 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:56:51.585415  1734 tablet_bootstrap.cc:492] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:51.587387  1734 ts_tablet_manager.cc:1403] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.144s	user 0.040s	sys 0.045s
I20260709 12:56:51.582314  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0a8a9b410b84b569aa1245ad95bb229. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.587967  1679 tablet_service.cc:1511] Processing CreateTablet for tablet 07ac6d2e7442458585e7eca31089d547 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:56:51.587548  1603 tablet_service.cc:1511] Processing CreateTablet for tablet 7d92e33e89814e86abdebb8b54a3a5c5 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:56:51.595504  1605 tablet_service.cc:1511] Processing CreateTablet for tablet aa984c8881704e97b0d6a6eb60605021 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:56:51.590986  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0507fcc8f9794c668a81d8519fc995be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.602277  1601 tablet_service.cc:1511] Processing CreateTablet for tablet 97e583cb09524a098c997f9996eb5b03 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:56:51.619331  1734 raft_consensus.cc:359] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:51.620162  1734 raft_consensus.cc:385] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:51.620496  1734 raft_consensus.cc:740] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:51.615060  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03a87bdd56034cbaa09fbc461a7bd313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.634313  1674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa984c8881704e97b0d6a6eb60605021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.639395  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97e583cb09524a098c997f9996eb5b03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.642416  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:56:51.644146  1583 leader_election.cc:343] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:51.644452  1524 tablet_service.cc:1511] Processing CreateTablet for tablet 5664f3181d5c4b20bb8443fb79030930 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:56:51.645983  1681 tablet_service.cc:1511] Processing CreateTablet for tablet 5c8fc263f1e8493db14b8c7a8e316a9f (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:56:51.647439  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c8fc263f1e8493db14b8c7a8e316a9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.648928  1525 tablet_service.cc:1511] Processing CreateTablet for tablet 03a87bdd56034cbaa09fbc461a7bd313 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:56:51.592459  1523 tablet_service.cc:1511] Processing CreateTablet for tablet d2eccdddaa724fed8954f5e5bc110b80 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:56:51.618577  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db702b262c1644109366a56f6f0d805a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.612614  1527 tablet_service.cc:1511] Processing CreateTablet for tablet 499cf87d55ba434fa03c7cf6c1bb54c8 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:56:51.655233  1527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 499cf87d55ba434fa03c7cf6c1bb54c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.650246  1735 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:51.655920  1735 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:51.658041  1735 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:51.659634  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:56:51.661176  1505 leader_election.cc:343] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:51.662490  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2eccdddaa724fed8954f5e5bc110b80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.666746  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:51.668870  1542 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:56:51.620502  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa984c8881704e97b0d6a6eb60605021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.669646  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:51.670382  1581 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:56:51.671152  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d92e33e89814e86abdebb8b54a3a5c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.671077  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:51.671582  1739 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:51.671891  1601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97e583cb09524a098c997f9996eb5b03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.671978  1739 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:56:51.672891  1508 leader_election.cc:343] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:51.673355  1508 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:51.672394  1739 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:51.676497  1735 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:51.680240  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5664f3181d5c4b20bb8443fb79030930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.682916  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4681eaad3084357b9677e4242b97c99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.705157  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:56:51.693711  1508 leader_election.cc:343] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:51.707130  1508 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:56:51.707343  1654 leader_election.cc:343] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:51.707931  1735 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:51.700742  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07ac6d2e7442458585e7eca31089d547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.651367  1532 tablet_service.cc:1511] Processing CreateTablet for tablet 6578815705874ccfb147b36c5f6db70a (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:56:51.702150  1675 tablet_service.cc:1511] Processing CreateTablet for tablet 940b60c7fb3744a68751996b8bb198ca (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:56:51.716789  1675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 940b60c7fb3744a68751996b8bb198ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.729056  1525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03a87bdd56034cbaa09fbc461a7bd313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.728930  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:51.729658  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6578815705874ccfb147b36c5f6db70a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:56:51.730688  1655 leader_election.cc:343] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:51.731181  1655 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:51.732501  1741 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:51.734920  1528 tablet_service.cc:1511] Processing CreateTablet for tablet f0a8a9b410b84b569aa1245ad95bb229 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:56:51.741003  1677 tablet_service.cc:1511] Processing CreateTablet for tablet 8b1b65240a814ade9a4dff9820c94dd0 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:56:51.742419  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b1b65240a814ade9a4dff9820c94dd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.743453  1531 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51498 (request call id 32) took 1052 ms. Trace:
I20260709 12:56:51.745442  1678 tablet_service.cc:1511] Processing CreateTablet for tablet 97c958beecec40918b63217135840ff6 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:56:51.711740  1734 consensus_queue.cc:260] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:51.745446  1606 tablet_service.cc:1511] Processing CreateTablet for tablet db702b262c1644109366a56f6f0d805a (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:56:51.750039  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0a8a9b410b84b569aa1245ad95bb229. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.727962  1739 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:51.752039  1731 tablet_bootstrap.cc:654] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:51.756712  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97c958beecec40918b63217135840ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.757077  1526 tablet_service.cc:1511] Processing CreateTablet for tablet 07ac6d2e7442458585e7eca31089d547 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:56:51.743896  1531 rpcz_store.cc:276] 0709 12:56:50.691306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:56:51.320899 (+629593us) service_pool.cc:224] Handling call
0709 12:56:51.354003 (+ 33104us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:56:51.354097 (+    94us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:56:51.627734 (+273637us) tablet_metadata.cc:665] Metadata flushed
0709 12:56:51.742893 (+115159us) tablet_replica.cc:206] Creating consensus instance
0709 12:56:51.743391 (+   498us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:56:51.758857  1673 tablet_service.cc:1511] Processing CreateTablet for tablet 1a9d2e2602bd4118abc0a8629a67005c (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:56:51.764991  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db702b262c1644109366a56f6f0d805a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.769512  1674 tablet_service.cc:1511] Processing CreateTablet for tablet 480b368f643b4d85a5daa23529132504 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:56:51.768105  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 5c8fc263f1e8493db14b8c7a8e316a9f (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:56:51.775852  1680 tablet_service.cc:1511] Processing CreateTablet for tablet ba9da8e67563442eaf10dbb50de09eb5 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:56:51.779211  1529 tablet_service.cc:1511] Processing CreateTablet for tablet 940b60c7fb3744a68751996b8bb198ca (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:56:51.787298  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:51.787708  1674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 480b368f643b4d85a5daa23529132504. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.788714  1542 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:51.791333  1602 tablet_service.cc:1511] Processing CreateTablet for tablet 499cf87d55ba434fa03c7cf6c1bb54c8 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:56:51.792686  1602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 499cf87d55ba434fa03c7cf6c1bb54c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.804849  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a9d2e2602bd4118abc0a8629a67005c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.806146  1604 tablet_service.cc:1511] Processing CreateTablet for tablet d2eccdddaa724fed8954f5e5bc110b80 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:56:51.807934  1542 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:56:51.787251  1530 tablet_service.cc:1511] Processing CreateTablet for tablet 1a9d2e2602bd4118abc0a8629a67005c (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:56:51.808753  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2eccdddaa724fed8954f5e5bc110b80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.795044  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 940b60c7fb3744a68751996b8bb198ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.809648  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba9da8e67563442eaf10dbb50de09eb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.810129  1526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07ac6d2e7442458585e7eca31089d547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.814111  1732 tablet_bootstrap.cc:492] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:51.814639  1732 ts_tablet_manager.cc:1403] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.504s	user 0.020s	sys 0.021s
I20260709 12:56:51.817157  1581 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:51.818168  1600 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49284 (request call id 32) took 1027 ms. Trace:
I20260709 12:56:51.818629  1600 rpcz_store.cc:276] 0709 12:56:50.791100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:56:51.461326 (+670226us) service_pool.cc:224] Handling call
0709 12:56:51.498903 (+ 37577us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:56:51.508213 (+  9310us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:56:51.731809 (+223596us) tablet_metadata.cc:665] Metadata flushed
0709 12:56:51.817541 (+ 85732us) tablet_replica.cc:206] Creating consensus instance
0709 12:56:51.818110 (+   569us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:56:51.820032  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a9d2e2602bd4118abc0a8629a67005c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.823913  1672 tablet_service.cc:1511] Processing CreateTablet for tablet 3c62b87395ba4c3a9a99163b300d7ddf (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:56:51.822523  1606 tablet_service.cc:1511] Processing CreateTablet for tablet 5664f3181d5c4b20bb8443fb79030930 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:56:51.825920  1739 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:51.826740  1607 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49284 (request call id 33) took 1035 ms. Trace:
I20260709 12:56:51.827427  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:51.828408  1600 tablet_service.cc:1511] Processing CreateTablet for tablet 6578815705874ccfb147b36c5f6db70a (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:56:51.829460  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c8fc263f1e8493db14b8c7a8e316a9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.833820  1607 rpcz_store.cc:276] 0709 12:56:50.791392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:56:51.468904 (+677512us) service_pool.cc:224] Handling call
0709 12:56:51.547696 (+ 78792us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b5800091e98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc862085831 00007fc862062ac3 00007fc862011400 00007fc85b496af4 00007fc85b496a82 00007fc85b4969b1
0709 12:56:51.547836 (+   140us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:56:51.547923 (+    87us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:56:51.692367 (+144444us) tablet_metadata.cc:665] Metadata flushed
0709 12:56:51.826206 (+133839us) tablet_replica.cc:206] Creating consensus instance
0709 12:56:51.826682 (+   476us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5573504}
I20260709 12:56:51.839226  1739 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:51.839756  1739 raft_consensus.cc:697] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:56:51.840161  1607 tablet_service.cc:1511] Processing CreateTablet for tablet 03a87bdd56034cbaa09fbc461a7bd313 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:56:51.840580  1739 consensus_queue.cc:237] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:51.832052  1758 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:51.849700  1758 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:56:51.850894  1583 leader_election.cc:343] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:51.854317  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:56:51.855824  1583 leader_election.cc:343] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:51.856905  1758 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:51.861537  1734 ts_tablet_manager.cc:1434] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.273s	user 0.009s	sys 0.006s
I20260709 12:56:51.857211  1675 tablet_service.cc:1511] Processing CreateTablet for tablet 40880327f92147c1936b74eee0e6724d (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:56:51.867192  1675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40880327f92147c1936b74eee0e6724d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.871112  1603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49284 (request call id 36) took 1078 ms. Trace:
I20260709 12:56:51.871579  1603 rpcz_store.cc:276] 0709 12:56:50.792282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:56:51.565153 (+772871us) service_pool.cc:224] Handling call
0709 12:56:51.607739 (+ 42586us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:56:51.617629 (+  9890us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:56:51.773573 (+155944us) tablet_metadata.cc:665] Metadata flushed
0709 12:56:51.838214 (+ 64641us) tablet_replica.cc:206] Creating consensus instance
0709 12:56:51.871039 (+ 32825us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:56:51.873593  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6578815705874ccfb147b36c5f6db70a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.874329  1603 tablet_service.cc:1511] Processing CreateTablet for tablet f0a8a9b410b84b569aa1245ad95bb229 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:56:51.875558  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0a8a9b410b84b569aa1245ad95bb229. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.875242  1528 tablet_service.cc:1511] Processing CreateTablet for tablet 8b1b65240a814ade9a4dff9820c94dd0 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:56:51.877888  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03a87bdd56034cbaa09fbc461a7bd313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.877820  1598 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49284 (request call id 34) took 1086 ms. Trace:
I20260709 12:56:51.878420  1598 rpcz_store.cc:276] 0709 12:56:50.791674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:56:51.477259 (+685585us) service_pool.cc:224] Handling call
0709 12:56:51.514398 (+ 37139us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:56:51.517286 (+  2888us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:56:51.697362 (+180076us) tablet_metadata.cc:665] Metadata flushed
0709 12:56:51.841439 (+144077us) tablet_replica.cc:206] Creating consensus instance
0709 12:56:51.877756 (+ 36317us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:56:51.880134  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c62b87395ba4c3a9a99163b300d7ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.880838  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5664f3181d5c4b20bb8443fb79030930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.881206  1599 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49284 (request call id 35) took 1089 ms. Trace:
I20260709 12:56:51.880295  1598 tablet_service.cc:1511] Processing CreateTablet for tablet 07ac6d2e7442458585e7eca31089d547 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:56:51.881577  1599 rpcz_store.cc:276] 0709 12:56:50.791982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:56:51.556186 (+764204us) service_pool.cc:224] Handling call
0709 12:56:51.558186 (+  2000us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:56:51.558290 (+   104us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:56:51.773851 (+215561us) tablet_metadata.cc:665] Metadata flushed
0709 12:56:51.857795 (+ 83944us) tablet_replica.cc:206] Creating consensus instance
0709 12:56:51.880885 (+ 23090us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b5800091e98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2d1a2 00007fc862e6ebb9 00007fc861f9fd88 00007fc862066973 00007fc86206270f 00007fc862062ecd 00007fc862011400 00007fc85b496af4 00007fc85b496a82
0709 12:56:51.881150 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30912768}
I20260709 12:56:51.882830  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07ac6d2e7442458585e7eca31089d547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.883881  1599 tablet_service.cc:1511] Processing CreateTablet for tablet 5c8fc263f1e8493db14b8c7a8e316a9f (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:56:51.889254  1601 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49284 (request call id 38) took 1029 ms. Trace:
I20260709 12:56:51.890072  1523 tablet_service.cc:1511] Processing CreateTablet for tablet 3c62b87395ba4c3a9a99163b300d7ddf (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:56:51.890467  1532 tablet_service.cc:1511] Processing CreateTablet for tablet 97c958beecec40918b63217135840ff6 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:56:51.893218  1731 tablet_bootstrap.cc:492] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:51.893218  1681 tablet_service.cc:1511] Processing CreateTablet for tablet 677340b0a53f4ce8b314f9294bdaa546 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:56:51.856951  1732 raft_consensus.cc:359] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:51.899899  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b1b65240a814ade9a4dff9820c94dd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.895803  1601 rpcz_store.cc:276] 0709 12:56:50.860131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:56:51.580280 (+720149us) service_pool.cc:224] Handling call
0709 12:56:51.626902 (+ 46622us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:56:51.632769 (+  5867us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:56:51.779087 (+146318us) tablet_metadata.cc:665] Metadata flushed
0709 12:56:51.888712 (+109625us) tablet_replica.cc:206] Creating consensus instance
0709 12:56:51.889191 (+   479us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:56:51.904112  1731 ts_tablet_manager.cc:1403] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.360s	user 0.015s	sys 0.014s
I20260709 12:56:51.910760  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:51.912714  1601 tablet_service.cc:1511] Processing CreateTablet for tablet 940b60c7fb3744a68751996b8bb198ca (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:56:51.914018  1731 raft_consensus.cc:359] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:51.919348  1531 tablet_service.cc:1511] Processing CreateTablet for tablet ba9da8e67563442eaf10dbb50de09eb5 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:56:51.919852  1731 raft_consensus.cc:385] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:51.920282  1731 raft_consensus.cc:740] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:51.920749  1681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 677340b0a53f4ce8b314f9294bdaa546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.921238  1731 consensus_queue.cc:260] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:51.922405  1542 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:56:51.925938  1581 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:56:51.927255  1759 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:51.927681  1759 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:51.928026  1759 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:51.929554  1530 tablet_service.cc:1511] Processing CreateTablet for tablet 40880327f92147c1936b74eee0e6724d (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:56:51.930893  1525 tablet_service.cc:1511] Processing CreateTablet for tablet 677340b0a53f4ce8b314f9294bdaa546 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:56:51.914546  1734 tablet_bootstrap.cc:492] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:51.902707  1732 raft_consensus.cc:385] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:51.933393  1732 raft_consensus.cc:740] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:51.933887  1731 ts_tablet_manager.cc:1434] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.004s
W20260709 12:56:51.936589  1488 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:56:51.936300  1759 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:51.933298  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c62b87395ba4c3a9a99163b300d7ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.939795  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40880327f92147c1936b74eee0e6724d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.939972  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:51.942374  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:51.947611  1605 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49284 (request call id 39) took 1051 ms. Trace:
W20260709 12:56:51.948333  1583 leader_election.cc:343] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:51.949183  1542 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:51.951390  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba9da8e67563442eaf10dbb50de09eb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.942970  1759 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:51.903403  1527 tablet_service.cc:1511] Processing CreateTablet for tablet 480b368f643b4d85a5daa23529132504 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:56:51.944615  1731 tablet_bootstrap.cc:492] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:51.948040  1605 rpcz_store.cc:276] 0709 12:56:50.896770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:56:51.594581 (+697811us) service_pool.cc:224] Handling call
0709 12:56:51.596722 (+  2141us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:56:51.596817 (+    95us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:56:51.932172 (+335355us) tablet_metadata.cc:665] Metadata flushed
0709 12:56:51.947010 (+ 14838us) tablet_replica.cc:206] Creating consensus instance
0709 12:56:51.947551 (+   541us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:56:51.954164  1756 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:51.954710  1756 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:51.957602  1756 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:51.958679  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:51.956892  1605 tablet_service.cc:1511] Processing CreateTablet for tablet 1a9d2e2602bd4118abc0a8629a67005c (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:56:51.960072  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c8fc263f1e8493db14b8c7a8e316a9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.962455  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:56:51.964136  1581 leader_election.cc:343] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:51.956929  1673 tablet_service.cc:1511] Processing CreateTablet for tablet 0ff814cc76e74038894b6ec316f8749f (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:56:51.975003  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97c958beecec40918b63217135840ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.988826  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff814cc76e74038894b6ec316f8749f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:51.989473  1600 tablet_service.cc:1511] Processing CreateTablet for tablet 97c958beecec40918b63217135840ff6 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:56:52.011802  1606 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49284 (request call id 43) took 1025 ms. Trace:
I20260709 12:56:52.012245  1606 rpcz_store.cc:276] 0709 12:56:50.985960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:56:51.820675 (+834715us) service_pool.cc:224] Handling call
0709 12:56:51.849990 (+ 29315us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b5800091e98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc862085831 00007fc862062ac3 00007fc862011400 00007fc85b496af4 00007fc85b496a82 00007fc85b4969b1
0709 12:56:51.870383 (+ 20393us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b5800091e98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2ce9c 00007fc859f2ca5b 00007fc862e45c09 00007fc861f9fee0 00007fc862085831 00007fc862062ac3 00007fc862011400 00007fc85b496af4 00007fc85b496a82 00007fc85b4969b1
0709 12:56:51.880356 (+  9973us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:56:51.880503 (+   147us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:56:51.937942 (+ 57439us) tablet_metadata.cc:665] Metadata flushed
0709 12:56:52.008393 (+ 70451us) tablet_replica.cc:206] Creating consensus instance
0709 12:56:52.011714 (+  3321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70827648}
I20260709 12:56:52.014540  1606 tablet_service.cc:1511] Processing CreateTablet for tablet 8b1b65240a814ade9a4dff9820c94dd0 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:56:51.960431  1732 consensus_queue.cc:260] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.018426  1732 ts_tablet_manager.cc:1434] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.203s	user 0.004s	sys 0.004s
W20260709 12:56:51.980794  1583 leader_election.cc:343] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:52.019119  1583 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:52.019605  1732 tablet_bootstrap.cc:492] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:52.020700  1759 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:51.977782  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a9d2e2602bd4118abc0a8629a67005c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:52.031365  1734 tablet_bootstrap.cc:654] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:52.031935  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97c958beecec40918b63217135840ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:52.032793  1601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 940b60c7fb3744a68751996b8bb198ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:52.034516  1525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 677340b0a53f4ce8b314f9294bdaa546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:52.038280  1732 tablet_bootstrap.cc:654] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:52.040959  1527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 480b368f643b4d85a5daa23529132504. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:52.025091  1542 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:56:52.046967  1581 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:56:52.048326  1739 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:52.048908  1739 raft_consensus.cc:697] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:56:52.049798  1739 consensus_queue.cc:237] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.054805  1604 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49284 (request call id 42) took 1076 ms. Trace:
I20260709 12:56:52.055274  1604 rpcz_store.cc:276] 0709 12:56:50.978810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:56:51.787612 (+808802us) service_pool.cc:224] Handling call
0709 12:56:51.807750 (+ 20138us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:56:51.807937 (+   187us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:56:51.935234 (+127297us) tablet_metadata.cc:665] Metadata flushed
0709 12:56:52.054212 (+118978us) tablet_replica.cc:206] Creating consensus instance
0709 12:56:52.054733 (+   521us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:56:52.056656  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b1b65240a814ade9a4dff9820c94dd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:52.077127  1607 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49284 (request call id 45) took 1031 ms. Trace:
I20260709 12:56:52.077581  1607 rpcz_store.cc:276] 0709 12:56:51.053900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:56:51.839187 (+785287us) service_pool.cc:224] Handling call
0709 12:56:51.876445 (+ 37258us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:56:51.877526 (+  1081us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:56:52.009469 (+131943us) tablet_metadata.cc:665] Metadata flushed
0709 12:56:52.043642 (+ 34173us) tablet_replica.cc:206] Creating consensus instance
0709 12:56:52.072881 (+ 29239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:56:52.079523  1607 tablet_service.cc:1511] Processing CreateTablet for tablet ba9da8e67563442eaf10dbb50de09eb5 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:56:52.080909  1731 tablet_bootstrap.cc:654] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:52.093679  1605 tablet_service.cc:1511] Processing CreateTablet for tablet 3c62b87395ba4c3a9a99163b300d7ddf (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:56:52.083936  1524 tablet_service.cc:1511] Processing CreateTablet for tablet 0ff814cc76e74038894b6ec316f8749f (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:56:52.105118  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff814cc76e74038894b6ec316f8749f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:52.093643  1438 catalog_manager.cc:5697] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 0 to 1, leader changed from <none> to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:52.109622  1604 tablet_service.cc:1511] Processing CreateTablet for tablet 480b368f643b4d85a5daa23529132504 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:56:52.111479  1602 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49284 (request call id 41) took 1154 ms. Trace:
I20260709 12:56:52.112020  1602 rpcz_store.cc:276] 0709 12:56:50.957499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:56:51.749203 (+791704us) service_pool.cc:224] Handling call
0709 12:56:51.792200 (+ 42997us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:56:51.792286 (+    86us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:56:51.970007 (+177721us) tablet_metadata.cc:665] Metadata flushed
0709 12:56:52.043314 (+ 73307us) tablet_replica.cc:206] Creating consensus instance
0709 12:56:52.111405 (+ 68091us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:56:52.076467  1603 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49284 (request call id 46) took 1011 ms. Trace:
I20260709 12:56:52.116289  1603 rpcz_store.cc:276] 0709 12:56:51.065135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:56:51.873394 (+808259us) service_pool.cc:224] Handling call
0709 12:56:51.875119 (+  1725us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:56:51.875213 (+    94us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:56:51.919830 (+ 44617us) tablet_metadata.cc:665] Metadata flushed
0709 12:56:52.075908 (+156078us) tablet_replica.cc:206] Creating consensus instance
0709 12:56:52.076393 (+   485us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:56:52.119439  1603 tablet_service.cc:1511] Processing CreateTablet for tablet 677340b0a53f4ce8b314f9294bdaa546 (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:56:52.129173  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba9da8e67563442eaf10dbb50de09eb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:52.138787  1732 tablet_bootstrap.cc:492] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:52.139356  1732 ts_tablet_manager.cc:1403] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.120s	user 0.018s	sys 0.025s
I20260709 12:56:52.150902  1734 tablet_bootstrap.cc:492] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:52.151459  1734 ts_tablet_manager.cc:1403] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.246s	user 0.021s	sys 0.035s
I20260709 12:56:52.154474  1734 raft_consensus.cc:359] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:56:52.155216  1734 raft_consensus.cc:385] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:52.155508  1734 raft_consensus.cc:740] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:52.149235  1602 tablet_service.cc:1511] Processing CreateTablet for tablet 0ff814cc76e74038894b6ec316f8749f (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:56:52.142408  1732 raft_consensus.cc:359] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.157065  1599 tablet_service.cc:1511] Processing CreateTablet for tablet 40880327f92147c1936b74eee0e6724d (DEFAULT_TABLE table=test-workload [id=272e6f12e54643de81b83540c6afa8d4]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:56:52.157183  1734 consensus_queue.cc:260] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:56:52.159480  1734 ts_tablet_manager.cc:1434] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:56:52.163517  1532 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:51498 (request call id 51) took 1011 ms. Trace:
I20260709 12:56:52.157226  1732 raft_consensus.cc:385] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:52.147022  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c62b87395ba4c3a9a99163b300d7ddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:52.167604  1732 raft_consensus.cc:740] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:52.169183  1732 consensus_queue.cc:260] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.168720  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 677340b0a53f4ce8b314f9294bdaa546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:52.170825  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40880327f92147c1936b74eee0e6724d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:52.171240  1731 tablet_bootstrap.cc:492] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:52.171698  1731 ts_tablet_manager.cc:1403] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.227s	user 0.013s	sys 0.000s
I20260709 12:56:52.172999  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 480b368f643b4d85a5daa23529132504. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:52.174044  1732 ts_tablet_manager.cc:1434] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 12:56:52.175123  1732 tablet_bootstrap.cc:492] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:52.176608  1598 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49284 (request call id 47) took 1088 ms. Trace:
I20260709 12:56:52.177399  1734 tablet_bootstrap.cc:492] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:52.169138  1601 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49284 (request call id 49) took 1038 ms. Trace:
I20260709 12:56:52.176873  1602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff814cc76e74038894b6ec316f8749f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:56:52.177105  1598 rpcz_store.cc:276] 0709 12:56:51.087935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:56:51.879380 (+791445us) service_pool.cc:224] Handling call
0709 12:56:51.882395 (+  3015us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:56:51.882493 (+    98us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:56:52.019874 (+137381us) tablet_metadata.cc:665] Metadata flushed
0709 12:56:52.158729 (+138855us) tablet_replica.cc:206] Creating consensus instance
0709 12:56:52.176531 (+ 17802us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:56:52.180940  1601 rpcz_store.cc:276] 0709 12:56:51.130793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:56:51.911603 (+780810us) service_pool.cc:224] Handling call
0709 12:56:51.919322 (+  7719us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:56:51.919439 (+   117us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:56:52.061725 (+142286us) tablet_metadata.cc:665] Metadata flushed
0709 12:56:52.161637 (+ 99912us) tablet_replica.cc:206] Creating consensus instance
0709 12:56:52.169077 (+  7440us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:56:52.177033  1731 raft_consensus.cc:359] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.188719  1731 raft_consensus.cc:385] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:52.167752  1532 rpcz_store.cc:276] 0709 12:56:51.152306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:56:51.871678 (+719372us) service_pool.cc:224] Handling call
0709 12:56:51.932849 (+ 61171us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b5800002798. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc862085831 00007fc862062ac3 00007fc862011400 00007fc85b496af4 00007fc85b496a82 00007fc85b4969b1
0709 12:56:51.932975 (+   126us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:56:51.933060 (+    85us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:56:52.080969 (+147909us) tablet_metadata.cc:665] Metadata flushed
0709 12:56:52.163016 (+ 82047us) tablet_replica.cc:206] Creating consensus instance
0709 12:56:52.163452 (+   436us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3667328}
I20260709 12:56:52.188966  1600 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49284 (request call id 51) took 1030 ms. Trace:
I20260709 12:56:52.189435  1600 rpcz_store.cc:276] 0709 12:56:51.159020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:56:51.988246 (+829226us) service_pool.cc:224] Handling call
0709 12:56:51.990580 (+  2334us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:56:51.990695 (+   115us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:56:52.085179 (+ 94484us) tablet_metadata.cc:665] Metadata flushed
0709 12:56:52.188407 (+103228us) tablet_replica.cc:206] Creating consensus instance
0709 12:56:52.188905 (+   498us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:56:52.192109  1732 tablet_bootstrap.cc:654] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:52.189085  1731 raft_consensus.cc:740] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:52.197512  1731 consensus_queue.cc:260] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.200264  1731 ts_tablet_manager.cc:1434] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 12:56:52.187781  1734 tablet_bootstrap.cc:654] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:52.203361  1731 tablet_bootstrap.cc:492] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
W20260709 12:56:52.260768  1424 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 55098.4us
I20260709 12:56:52.267561  1732 tablet_bootstrap.cc:492] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:52.268463  1732 ts_tablet_manager.cc:1403] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.094s	user 0.021s	sys 0.004s
I20260709 12:56:52.270367  1739 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:52.273027  1732 raft_consensus.cc:359] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:56:52.283107  1732 raft_consensus.cc:385] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:52.283353  1734 tablet_bootstrap.cc:492] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:52.283445  1732 raft_consensus.cc:740] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:52.284291  1732 consensus_queue.cc:260] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:56:52.285343  1734 ts_tablet_manager.cc:1403] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.108s	user 0.045s	sys 0.031s
I20260709 12:56:52.286466  1732 ts_tablet_manager.cc:1434] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:56:52.287492  1732 tablet_bootstrap.cc:492] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:52.292325  1734 raft_consensus.cc:359] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.293105  1734 raft_consensus.cc:385] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:52.293406  1734 raft_consensus.cc:740] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:52.293730  1732 tablet_bootstrap.cc:654] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:52.293547  1438 catalog_manager.cc:5697] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 0 to 1, leader changed from <none> to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:52.302067  1734 consensus_queue.cc:260] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.304454  1734 ts_tablet_manager.cc:1434] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:56:52.305878  1732 tablet_bootstrap.cc:492] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:52.306110  1734 tablet_bootstrap.cc:492] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:52.306433  1732 ts_tablet_manager.cc:1403] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.000s
I20260709 12:56:52.309841  1732 raft_consensus.cc:359] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.310683  1732 raft_consensus.cc:385] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:52.310993  1732 raft_consensus.cc:740] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:52.311827  1732 consensus_queue.cc:260] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.265688  1731 tablet_bootstrap.cc:654] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:52.312938  1734 tablet_bootstrap.cc:654] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:52.314258  1732 ts_tablet_manager.cc:1434] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:56:52.317896  1732 tablet_bootstrap.cc:492] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:52.332871  1732 tablet_bootstrap.cc:654] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
W20260709 12:56:52.333179  1583 consensus_peers.cc:597] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f -> Peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Couldn't send request to peer 4487a53c51be4634bf1ef29c5248353d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:52.333930  1756 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:52.334474  1756 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:56:52.335580  1731 tablet_bootstrap.cc:492] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:52.336086  1731 ts_tablet_manager.cc:1403] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.133s	user 0.011s	sys 0.018s
I20260709 12:56:52.337949  1756 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:52.339489  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:52.340277  1690 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:56:52.341744  1583 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:56:52.342662  1756 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:52.343065  1756 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:52.343333  1756 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:52.344983  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:52.346288  1732 tablet_bootstrap.cc:492] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
W20260709 12:56:52.346576  1581 leader_election.cc:343] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:52.346961  1732 ts_tablet_manager.cc:1403] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.010s
I20260709 12:56:52.339005  1731 raft_consensus.cc:359] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.348975  1731 raft_consensus.cc:385] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:52.349396  1731 raft_consensus.cc:740] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:52.350196  1731 consensus_queue.cc:260] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.350824  1732 raft_consensus.cc:359] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.351749  1732 raft_consensus.cc:385] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:52.352102  1732 raft_consensus.cc:740] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:52.352988  1732 consensus_queue.cc:260] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.353917  1731 ts_tablet_manager.cc:1434] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.002s
I20260709 12:56:52.354653  1734 tablet_bootstrap.cc:492] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:52.355093  1731 tablet_bootstrap.cc:492] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:52.355172  1734 ts_tablet_manager.cc:1403] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.028s
I20260709 12:56:52.356024  1735 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:52.356554  1735 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.358347  1734 raft_consensus.cc:359] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.359131  1734 raft_consensus.cc:385] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:52.359485  1734 raft_consensus.cc:740] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:52.360222  1734 consensus_queue.cc:260] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.361179  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:52.361842  1617 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
I20260709 12:56:52.362610  1731 tablet_bootstrap.cc:654] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:52.362814  1734 ts_tablet_manager.cc:1434] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:56:52.363569  1732 ts_tablet_manager.cc:1434] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:56:52.363901  1734 tablet_bootstrap.cc:492] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:52.364337  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:52.362663  1735 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:52.370661  1734 tablet_bootstrap.cc:654] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:52.372567  1732 tablet_bootstrap.cc:492] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:52.372869  1741 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:52.373493  1741 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.375869  1741 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:52.376385  1731 tablet_bootstrap.cc:492] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:52.376981  1731 ts_tablet_manager.cc:1403] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.015s
I20260709 12:56:52.380334  1731 raft_consensus.cc:359] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.380823  1732 tablet_bootstrap.cc:654] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:52.381194  1731 raft_consensus.cc:385] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:52.381249  1734 tablet_bootstrap.cc:492] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:52.381366  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:52.381717  1731 raft_consensus.cc:740] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:52.382061  1734 ts_tablet_manager.cc:1403] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.002s
I20260709 12:56:52.382586  1731 consensus_queue.cc:260] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.363547  1505 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:56:52.384413  1508 leader_election.cc:343] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:52.384930  1731 ts_tablet_manager.cc:1434] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:56:52.385769  1734 raft_consensus.cc:359] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.386591  1734 raft_consensus.cc:385] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:52.386921  1734 raft_consensus.cc:740] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
W20260709 12:56:52.382999  1654 leader_election.cc:343] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:52.387710  1734 consensus_queue.cc:260] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.390703  1734 ts_tablet_manager.cc:1434] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:56:52.391744  1734 tablet_bootstrap.cc:492] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:52.395684  1732 tablet_bootstrap.cc:492] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:52.395790  1741 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:52.396358  1732 ts_tablet_manager.cc:1403] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.007s
I20260709 12:56:52.396534  1735 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:52.396306  1741 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.397102  1735 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:52.397533  1735 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:52.399441  1732 raft_consensus.cc:359] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.400112  1732 raft_consensus.cc:385] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:52.400228  1741 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:52.400490  1732 raft_consensus.cc:740] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:52.400815  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:52.401228  1732 consensus_queue.cc:260] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.401472  1617 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 0.
I20260709 12:56:52.402614  1654 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:56:52.403544  1741 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:52.403959  1741 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:52.401583  1731 tablet_bootstrap.cc:492] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:52.404363  1741 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:52.409063  1732 ts_tablet_manager.cc:1434] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:56:52.410125  1732 tablet_bootstrap.cc:492] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:52.416308  1731 tablet_bootstrap.cc:654] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:52.417117  1732 tablet_bootstrap.cc:654] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:52.417356  1734 tablet_bootstrap.cc:654] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
W20260709 12:56:52.429086  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 65632.4us
I20260709 12:56:52.430709  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:52.431459  1541 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 0.
I20260709 12:56:52.433133  1731 tablet_bootstrap.cc:492] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:52.433151  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:52.433780  1731 ts_tablet_manager.cc:1403] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.005s
I20260709 12:56:52.437120  1741 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.437618  1655 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:52.440864  1759 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:52.441497  1759 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.443673  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:52.444415  1617 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:52.445668  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:52.446457  1690 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:56:52.447479  1741 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:52.448370  1741 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:52.448884  1583 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:56:52.450660  1739 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:52.451035  1739 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:52.449266  1759 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:52.451385  1739 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:52.450891  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:56:52.453603  1581 leader_election.cc:343] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:52.453786  1731 raft_consensus.cc:359] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.454695  1731 raft_consensus.cc:385] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:52.455034  1731 raft_consensus.cc:740] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:52.455826  1731 consensus_queue.cc:260] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.457392  1735 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.458094  1731 ts_tablet_manager.cc:1434] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.024s	user 0.001s	sys 0.004s
I20260709 12:56:52.457850  1756 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:56:52.459154  1731 tablet_bootstrap.cc:492] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:52.460094  1756 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:52.448897  1741 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:52.464787  1741 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:52.465099  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:56:52.465693  1655 leader_election.cc:343] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:52.465720  1690 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:52.468320  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:56:52.471333  1581 leader_election.cc:343] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:52.473886  1741 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.474417  1731 tablet_bootstrap.cc:654] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:52.481727  1732 tablet_bootstrap.cc:492] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:52.546344  1741 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:56:52.546825  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 81180.8us
I20260709 12:56:52.523463  1617 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:56:52.548053  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:52.497058  1785 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:52.549497  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:52.549970  1734 tablet_bootstrap.cc:492] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:52.536453  1690 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:56:52.553882  1615 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:52.554040  1734 ts_tablet_manager.cc:1403] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.163s	user 0.009s	sys 0.014s
W20260709 12:56:52.554844  1654 leader_election.cc:343] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:52.556887  1583 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:52.550243  1735 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:52.558158  1734 raft_consensus.cc:359] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.559262  1759 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:52.559629  1734 raft_consensus.cc:385] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:52.560042  1734 raft_consensus.cc:740] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:52.561201  1734 consensus_queue.cc:260] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.553452  1785 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.547768  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:52.506117  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:52.969753  1789 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:52.513989  1756 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260709 12:56:52.888142  1785 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:52.897140  1759 raft_consensus.cc:697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:56:52.906567  1787 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:52.975626  1787 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.977823  1787 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:52.936272  1735 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:52.978480  1735 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.978988  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:52.514627  1780 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:52.940940  1734 ts_tablet_manager.cc:1434] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.386s	user 0.016s	sys 0.020s
I20260709 12:56:52.980883  1735 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:56:52.981491  1583 leader_election.cc:343] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:52.980814  1780 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:56:52.983376  1583 consensus_peers.cc:597] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f -> Peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Couldn't send request to peer 4487a53c51be4634bf1ef29c5248353d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:52.983525  1780 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:52.981788  1734 tablet_bootstrap.cc:492] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:52.983899  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:56:52.985749  1505 leader_election.cc:343] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:52.986021  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:52.986219  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:56:52.987587  1505 leader_election.cc:343] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:52.503952  1739 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.945535  1790 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:52.946014  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:52.989404  1541 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:52.989154  1790 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.990036  1734 tablet_bootstrap.cc:654] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:52.991375  1790 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:52.993389  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:52.993395  1759 consensus_queue.cc:237] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:56:52.994347  1616 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
I20260709 12:56:52.995748  1739 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:52.962107  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:52.962663  1615 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:56:52.948122  1741 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:52.995651  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:52.996697  1691 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:52.996435  1741 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:52.999122  1741 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:52.962743  1654 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:56:52.999958  1741 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:56:53.000620  1655 leader_election.cc:343] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:53.001157  1741 raft_consensus.cc:697] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:56:52.967002  1488 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:56:52.967240  1732 ts_tablet_manager.cc:1403] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.557s	user 0.024s	sys 0.029s
I20260709 12:56:53.002074  1741 consensus_queue.cc:237] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.004896  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:53.005654  1690 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
I20260709 12:56:53.006917  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:53.007634  1689 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
I20260709 12:56:53.007716  1691 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:56:53.008991  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:52.967808  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:53.009346  1583 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:56:53.010246  1540 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 0.
I20260709 12:56:52.553292  1731 tablet_bootstrap.cc:492] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:53.013149  1731 ts_tablet_manager.cc:1403] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.554s	user 0.016s	sys 0.019s
I20260709 12:56:52.970407  1789 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.011027  1759 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:53.015596  1759 raft_consensus.cc:697] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:56:53.016134  1617 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 0.
I20260709 12:56:53.016466  1759 consensus_queue.cc:237] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.017102  1789 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:52.995615  1505 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:53.020011  1655 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:53.020464  1790 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:53.020960  1790 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:53.021311  1790 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:53.024646  1785 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:53.024780  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:53.025063  1785 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:53.024012  1438 catalog_manager.cc:5697] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:53.025461  1785 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:53.025578  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:53.027437  1540 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 0.
W20260709 12:56:53.029029  1508 leader_election.cc:343] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:53.031131  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:53.031772  1542 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:56:53.033025  1508 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:53.033393  1581 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:53.033913  1780 raft_consensus.cc:2804] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:53.034283  1780 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:53.034327  1508 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:53.034740  1780 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:53.035182  1735 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:53.035653  1735 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:53.036003  1735 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:53.037406  1732 raft_consensus.cc:359] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.038192  1732 raft_consensus.cc:385] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:53.038461  1732 raft_consensus.cc:740] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:53.039347  1732 consensus_queue.cc:260] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.028964  1655 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:53.034468  1789 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:53.043087  1732 ts_tablet_manager.cc:1434] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 12:56:53.044124  1732 tablet_bootstrap.cc:492] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:53.046507  1731 raft_consensus.cc:359] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.047199  1731 raft_consensus.cc:385] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:53.047542  1731 raft_consensus.cc:740] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:53.048213  1731 consensus_queue.cc:260] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.051443  1731 ts_tablet_manager.cc:1434] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 12:56:53.052462  1731 tablet_bootstrap.cc:492] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:53.042404  1789 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:53.051331  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:53.055100  1789 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:53.055851  1508 leader_election.cc:343] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:53.084563  1792 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:53.085775  1792 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.087710  1792 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:53.090164  1735 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.092068  1735 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:53.074903  1741 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:53.060434  1541 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
W20260709 12:56:53.094249  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 64670.1us
I20260709 12:56:53.093688  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:53.093866  1540 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:53.099009  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:53.099335  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:53.099840  1688 raft_consensus.cc:2393] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 1: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:56:53.056926  1505 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:56:53.094120  1741 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:53.105962  1789 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.106709  1734 tablet_bootstrap.cc:492] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:53.107173  1734 ts_tablet_manager.cc:1403] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.126s	user 0.035s	sys 0.037s
I20260709 12:56:53.107860  1789 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:53.109123  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:56:53.109301  1654 leader_election.cc:343] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:53.110275  1734 raft_consensus.cc:359] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.110929  1734 raft_consensus.cc:385] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:53.111183  1734 raft_consensus.cc:740] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:53.111160  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:53.111836  1542 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:53.112869  1734 consensus_queue.cc:260] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.113878  1780 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.103912  1439 catalog_manager.cc:5697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 0 to 1, leader changed from <none> to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:53.115657  1734 ts_tablet_manager.cc:1434] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:56:53.116643  1734 tablet_bootstrap.cc:492] T 398a6324f64f46b0accba6cac64dfec6 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:53.116557  1780 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:53.117539  1780 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:53.117709  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:53.118053  1780 raft_consensus.cc:697] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:56:53.118278  1688 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:53.118885  1780 consensus_queue.cc:237] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:56:53.116906  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 65635.2us
I20260709 12:56:53.113384  1741 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:53.121419  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:53.124379  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:53.125871  1655 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:53.127509  1802 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:53.123003  1785 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.123167  1790 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.131493  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:53.132673  1505 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:53.133504  1691 raft_consensus.cc:2393] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 1: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:56:53.133389  1540 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:56:53.135847  1785 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:53.137068  1539 raft_consensus.cc:2393] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 1: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:56:53.137569  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:53.138302  1617 raft_consensus.cc:2393] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 1: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:56:53.138743  1741 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.139030  1581 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:53.139865  1689 raft_consensus.cc:2393] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 1: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:56:53.139894  1789 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:53.141361  1790 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:53.142907  1732 tablet_bootstrap.cc:654] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:53.145996  1731 tablet_bootstrap.cc:654] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:53.146183  1741 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:53.148269  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:53.149936  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:56:53.151510  1508 leader_election.cc:343] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:56:53.151595  1654 leader_election.cc:343] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:53.152168  1734 tablet_bootstrap.cc:654] T 398a6324f64f46b0accba6cac64dfec6 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
W20260709 12:56:53.152583  1505 leader_election.cc:343] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:53.152846  1789 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:53.133526  1688 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:56:53.144050  1802 raft_consensus.cc:697] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:56:53.154033  1505 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:53.147527  1790 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:53.158202  1804 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:53.157797  1790 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:56:53.161160  1505 leader_election.cc:343] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:53.161798  1508 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:53.163452  1790 raft_consensus.cc:2804] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:53.163405  1802 consensus_queue.cc:237] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.164522  1790 raft_consensus.cc:697] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:56:53.165313  1790 consensus_queue.cc:237] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.163787  1804 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.165953  1542 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:56:53.169330  1581 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:56:53.170480  1789 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:53.170670  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:53.171164  1789 raft_consensus.cc:697] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:56:53.171563  1542 raft_consensus.cc:2393] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 1: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:56:53.172004  1789 consensus_queue.cc:237] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.174984  1655 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:53.175115  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:53.175154  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:53.175604  1734 tablet_bootstrap.cc:492] T 398a6324f64f46b0accba6cac64dfec6 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:53.176155  1540 raft_consensus.cc:2393] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 1: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:56:53.176159  1734 ts_tablet_manager.cc:1403] T 398a6324f64f46b0accba6cac64dfec6 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.060s	user 0.008s	sys 0.003s
I20260709 12:56:53.175694  1804 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:53.178102  1655 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:53.178915  1804 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:56:53.179947  1734 raft_consensus.cc:359] T 398a6324f64f46b0accba6cac64dfec6 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.180617  1734 raft_consensus.cc:385] T 398a6324f64f46b0accba6cac64dfec6 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:53.180828  1734 raft_consensus.cc:740] T 398a6324f64f46b0accba6cac64dfec6 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:53.180716  1741 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:56:53.181712  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:53.182497  1734 consensus_queue.cc:260] T 398a6324f64f46b0accba6cac64dfec6 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.186481  1734 ts_tablet_manager.cc:1434] T 398a6324f64f46b0accba6cac64dfec6 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:56:53.187721  1734 tablet_bootstrap.cc:492] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:53.187666  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:53.191824  1655 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:53.192922  1741 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:53.195852  1617 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:56:53.200778  1505 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:56:53.202225  1790 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:53.202859  1734 tablet_bootstrap.cc:654] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:53.204914  1790 raft_consensus.cc:697] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:56:53.209406  1440 catalog_manager.cc:5697] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:53.210736  1790 consensus_queue.cc:237] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.217568  1732 tablet_bootstrap.cc:492] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:53.219570  1732 ts_tablet_manager.cc:1403] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.176s	user 0.015s	sys 0.008s
I20260709 12:56:53.222736  1732 raft_consensus.cc:359] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.223493  1732 raft_consensus.cc:385] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:53.223774  1732 raft_consensus.cc:740] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:53.224570  1732 consensus_queue.cc:260] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.218519  1731 tablet_bootstrap.cc:492] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:53.225942  1731 ts_tablet_manager.cc:1403] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.174s	user 0.010s	sys 0.014s
I20260709 12:56:53.227497  1438 catalog_manager.cc:5697] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:53.228837  1731 raft_consensus.cc:359] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.229575  1731 raft_consensus.cc:385] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:53.229856  1731 raft_consensus.cc:740] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:53.230731  1731 consensus_queue.cc:260] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.235651  1731 ts_tablet_manager.cc:1434] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:56:53.236709  1731 tablet_bootstrap.cc:492] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:53.240373  1439 catalog_manager.cc:5697] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 0 to 1, leader changed from <none> to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:53.242274  1731 tablet_bootstrap.cc:654] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:53.243060  1734 tablet_bootstrap.cc:492] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:53.242482  1439 catalog_manager.cc:5697] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 0 to 1, leader changed from <none> to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:53.243642  1734 ts_tablet_manager.cc:1403] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.056s	user 0.020s	sys 0.015s
I20260709 12:56:53.245769  1732 ts_tablet_manager.cc:1434] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:56:53.246347  1734 raft_consensus.cc:359] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.246891  1732 tablet_bootstrap.cc:492] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:53.247016  1734 raft_consensus.cc:385] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:53.247306  1734 raft_consensus.cc:740] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:53.248054  1734 consensus_queue.cc:260] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.252036  1734 ts_tablet_manager.cc:1434] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:56:53.253034  1734 tablet_bootstrap.cc:492] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:53.253137  1732 tablet_bootstrap.cc:654] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:53.255846  1440 catalog_manager.cc:5697] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:53.258178  1440 catalog_manager.cc:5697] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:53.266494  1734 tablet_bootstrap.cc:654] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:53.271842  1732 tablet_bootstrap.cc:492] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:53.272311  1732 ts_tablet_manager.cc:1403] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.009s
I20260709 12:56:53.273356  1789 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:53.273844  1789 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.275061  1732 raft_consensus.cc:359] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.275794  1732 raft_consensus.cc:385] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:53.275909  1789 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:53.276166  1732 raft_consensus.cc:740] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:53.277073  1732 consensus_queue.cc:260] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.277547  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:53.278369  1542 raft_consensus.cc:2393] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 1: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:56:53.279722  1732 ts_tablet_manager.cc:1434] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:56:53.279333  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:53.281276  1732 tablet_bootstrap.cc:492] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:53.282630  1583 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:53.284327  1789 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:53.287309  1731 tablet_bootstrap.cc:492] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:53.291662  1731 ts_tablet_manager.cc:1403] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.003s
I20260709 12:56:53.288805  1732 tablet_bootstrap.cc:654] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:53.293978  1789 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:53.295181  1731 raft_consensus.cc:359] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:56:53.296543  1731 raft_consensus.cc:385] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:53.297091  1731 raft_consensus.cc:740] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:53.298192  1731 consensus_queue.cc:260] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:56:53.300411  1734 tablet_bootstrap.cc:492] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:53.301156  1731 ts_tablet_manager.cc:1434] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:56:53.301185  1734 ts_tablet_manager.cc:1403] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.006s
I20260709 12:56:53.302887  1731 tablet_bootstrap.cc:492] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:53.304718  1734 raft_consensus.cc:359] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.305490  1734 raft_consensus.cc:385] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:53.305775  1734 raft_consensus.cc:740] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:53.306492  1734 consensus_queue.cc:260] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.309522  1734 ts_tablet_manager.cc:1434] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:56:53.310173  1732 tablet_bootstrap.cc:492] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:53.310843  1732 ts_tablet_manager.cc:1403] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.009s
I20260709 12:56:53.311697  1734 tablet_bootstrap.cc:492] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:53.314929  1732 raft_consensus.cc:359] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.315984  1732 raft_consensus.cc:385] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:53.316341  1732 raft_consensus.cc:740] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:53.319293  1732 consensus_queue.cc:260] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.320498  1734 tablet_bootstrap.cc:654] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:53.321767  1732 ts_tablet_manager.cc:1434] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:56:53.322854  1732 tablet_bootstrap.cc:492] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:53.325896  1731 tablet_bootstrap.cc:654] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:53.330286  1732 tablet_bootstrap.cc:654] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:53.331961  1734 tablet_bootstrap.cc:492] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:53.332722  1734 ts_tablet_manager.cc:1403] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.000s
I20260709 12:56:53.335620  1734 raft_consensus.cc:359] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.336735  1734 raft_consensus.cc:385] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:53.337044  1734 raft_consensus.cc:740] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:53.337776  1734 consensus_queue.cc:260] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.341342  1731 tablet_bootstrap.cc:492] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:53.341853  1731 ts_tablet_manager.cc:1403] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.001s
I20260709 12:56:53.341887  1734 ts_tablet_manager.cc:1434] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 12:56:53.342669  1732 tablet_bootstrap.cc:492] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:53.342962  1734 tablet_bootstrap.cc:492] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:53.343231  1732 ts_tablet_manager.cc:1403] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.009s
I20260709 12:56:53.344659  1731 raft_consensus.cc:359] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.345377  1731 raft_consensus.cc:385] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:53.345645  1731 raft_consensus.cc:740] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:53.346271  1732 raft_consensus.cc:359] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.346318  1731 consensus_queue.cc:260] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.347177  1732 raft_consensus.cc:385] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:53.347494  1732 raft_consensus.cc:740] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:53.348289  1732 consensus_queue.cc:260] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.350306  1732 ts_tablet_manager.cc:1434] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:56:53.350530  1734 tablet_bootstrap.cc:654] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:53.355567  1731 ts_tablet_manager.cc:1434] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:56:53.356594  1731 tablet_bootstrap.cc:492] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:53.359313  1732 tablet_bootstrap.cc:492] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:53.362277  1789 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:53.362435  1734 tablet_bootstrap.cc:492] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:53.363898  1734 ts_tablet_manager.cc:1403] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.009s
I20260709 12:56:53.363724  1789 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.365851  1789 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:53.366092  1731 tablet_bootstrap.cc:654] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:53.366504  1732 tablet_bootstrap.cc:654] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:53.366655  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:53.368752  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:56:53.371448  1581 leader_election.cc:343] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:53.371884  1734 raft_consensus.cc:359] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:56:53.372243  1583 leader_election.cc:343] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:53.372622  1734 raft_consensus.cc:385] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:53.372957  1734 raft_consensus.cc:740] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:53.372783  1583 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:53.373708  1789 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:53.373610  1734 consensus_queue.cc:260] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.375670  1734 ts_tablet_manager.cc:1434] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 12:56:53.376446  1732 tablet_bootstrap.cc:492] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:53.376848  1732 ts_tablet_manager.cc:1403] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.007s
I20260709 12:56:53.376981  1734 tablet_bootstrap.cc:492] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:53.379242  1732 raft_consensus.cc:359] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.379801  1732 raft_consensus.cc:385] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:53.380017  1732 raft_consensus.cc:740] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:53.380643  1732 consensus_queue.cc:260] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.382404  1732 ts_tablet_manager.cc:1434] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:56:53.383404  1734 tablet_bootstrap.cc:654] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:53.385118  1732 tablet_bootstrap.cc:492] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:53.389911  1802 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:53.390280  1731 tablet_bootstrap.cc:492] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:53.390717  1731 ts_tablet_manager.cc:1403] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.003s
I20260709 12:56:53.390404  1802 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.392590  1802 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:53.393113  1732 tablet_bootstrap.cc:654] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:53.393390  1731 raft_consensus.cc:359] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.393867  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:53.394065  1731 raft_consensus.cc:385] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:53.394253  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:53.394477  1731 raft_consensus.cc:740] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:53.395262  1731 consensus_queue.cc:260] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:56:53.395643  1654 leader_election.cc:343] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:53.396111  1542 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 0.
I20260709 12:56:53.400300  1655 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:53.400506  1789 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:53.404734  1741 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:53.405126  1741 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:53.405442  1741 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:53.408771  1731 ts_tablet_manager.cc:1434] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 12:56:53.409739  1731 tablet_bootstrap.cc:492] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:53.418946  1732 tablet_bootstrap.cc:492] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:53.419085  1542 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:53.419587  1732 ts_tablet_manager.cc:1403] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.007s
I20260709 12:56:53.422786  1756 consensus_queue.cc:1048] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:53.424340  1788 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:53.425063  1788 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.424945  1802 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:53.429411  1802 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.429975  1788 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:53.430687  1731 tablet_bootstrap.cc:654] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:53.437343  1734 tablet_bootstrap.cc:492] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:53.437793  1734 ts_tablet_manager.cc:1403] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.001s
I20260709 12:56:53.412714  1741 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.437124  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:53.441623  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:53.442494  1691 raft_consensus.cc:2393] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 1: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:56:53.444875  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:53.445612  1539 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:53.445713  1732 raft_consensus.cc:359] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.446452  1732 raft_consensus.cc:385] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:53.446740  1732 raft_consensus.cc:740] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:53.447561  1732 consensus_queue.cc:260] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.449546  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:53.450181  1732 ts_tablet_manager.cc:1434] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:56:53.450778  1583 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:53.447467  1741 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:53.452328  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:53.452687  1739 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:53.453130  1734 raft_consensus.cc:359] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.453787  1734 raft_consensus.cc:385] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:53.454037  1734 raft_consensus.cc:740] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
W20260709 12:56:53.451007  1654 leader_election.cc:343] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:53.455077  1732 tablet_bootstrap.cc:492] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:53.467104  1539 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
W20260709 12:56:53.468642  1655 leader_election.cc:343] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:53.469935  1655 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:53.470223  1691 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:53.471150  1741 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:53.471737  1739 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:53.471753  1741 raft_consensus.cc:697] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:56:53.471252  1734 consensus_queue.cc:260] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.473119  1741 consensus_queue.cc:237] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.477614  1734 ts_tablet_manager.cc:1434] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.003s
I20260709 12:56:53.478755  1734 tablet_bootstrap.cc:492] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:53.483454  1790 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:53.485834  1790 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:56:53.488029  1739 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:53.493305  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:53.493769  1734 tablet_bootstrap.cc:654] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
W20260709 12:56:53.494629  1654 leader_election.cc:343] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:53.496083  1654 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:53.495306  1804 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:53.495486  1802 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:53.497923  1804 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.499876  1804 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:53.497906  1785 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:53.501968  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:56:53.503185  1655 leader_election.cc:343] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:53.504400  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:56:53.505697  1654 leader_election.cc:343] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:53.506125  1654 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:53.506595  1790 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:53.506872  1785 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:53.509570  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:56:53.517097  1830 log.cc:927] Time spent T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:56:53.517153  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:53.518949  1505 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:53.521139  1539 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:53.532328  1739 consensus_queue.cc:1048] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:53.533283  1731 tablet_bootstrap.cc:492] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:53.533804  1731 ts_tablet_manager.cc:1403] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.124s	user 0.009s	sys 0.007s
I20260709 12:56:53.544924  1731 raft_consensus.cc:359] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.546931  1731 raft_consensus.cc:385] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:53.549770  1731 raft_consensus.cc:740] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:53.549446  1732 tablet_bootstrap.cc:654] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:53.546152  1688 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:53.551107  1731 consensus_queue.cc:260] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.554793  1731 ts_tablet_manager.cc:1434] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.021s	user 0.002s	sys 0.003s
I20260709 12:56:53.556002  1731 tablet_bootstrap.cc:492] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:53.557582  1790 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:53.558081  1790 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.559317  1734 tablet_bootstrap.cc:492] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:53.559811  1734 ts_tablet_manager.cc:1403] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.003s
I20260709 12:56:53.562314  1731 tablet_bootstrap.cc:654] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:53.562589  1785 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:53.563320  1734 raft_consensus.cc:359] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.564059  1734 raft_consensus.cc:385] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:53.564488  1734 raft_consensus.cc:740] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:53.564327  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:53.566047  1734 consensus_queue.cc:260] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.568034  1617 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:56:53.570513  1505 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:53.576589  1734 ts_tablet_manager.cc:1434] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.002s
I20260709 12:56:53.577323  1790 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:53.574657  1780 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:56:53.578959  1471 debug-util.cc:398] Leaking SignalData structure 0x7b0800192c40 after lost signal to thread 434
W20260709 12:56:53.579905  1471 debug-util.cc:398] Leaking SignalData structure 0x7b08000396a0 after lost signal to thread 1474
I20260709 12:56:53.580832  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:53.582044  1734 tablet_bootstrap.cc:492] T 105edc3ce5964519acbd96dbaa975697 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
W20260709 12:56:53.581043  1471 debug-util.cc:398] Leaking SignalData structure 0x7b0800163020 after lost signal to thread 1566
W20260709 12:56:53.586009  1471 debug-util.cc:398] Leaking SignalData structure 0x7b0800183560 after lost signal to thread 1641
W20260709 12:56:53.587232  1471 debug-util.cc:398] Leaking SignalData structure 0x7b08001115a0 after lost signal to thread 1715
I20260709 12:56:53.591085  1785 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:56:53.600194  1508 consensus_peers.cc:597] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 -> Peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Couldn't send request to peer 4487a53c51be4634bf1ef29c5248353d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:53.613565  1785 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:56:53.618494  1780 consensus_queue.cc:1048] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:56:53.619086  1508 consensus_peers.cc:597] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 -> Peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Couldn't send request to peer 4487a53c51be4634bf1ef29c5248353d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:53.620039  1734 tablet_bootstrap.cc:654] T 105edc3ce5964519acbd96dbaa975697 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:53.624892  1735 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:56:53.628258  1440 catalog_manager.cc:5697] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:53.630964  1735 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:56:53.631410  1735 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:53.637822  1731 tablet_bootstrap.cc:492] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:53.638348  1731 ts_tablet_manager.cc:1403] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.083s	user 0.020s	sys 0.007s
I20260709 12:56:53.656466  1785 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:53.657070  1785 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.657557  1741 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:53.659174  1785 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:53.660318  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:53.660784  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:53.661095  1616 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 0.
I20260709 12:56:53.662254  1732 tablet_bootstrap.cc:492] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:53.662300  1654 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:56:53.662909  1732 ts_tablet_manager.cc:1403] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.208s	user 0.013s	sys 0.005s
I20260709 12:56:53.664049  1785 raft_consensus.cc:2804] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:53.666153  1785 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:56:53.667248  1655 leader_election.cc:343] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:53.667905  1785 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:53.697886  1731 raft_consensus.cc:359] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.698881  1731 raft_consensus.cc:385] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:53.699229  1731 raft_consensus.cc:740] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:53.698802  1780 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:53.699996  1731 consensus_queue.cc:260] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.702771  1732 raft_consensus.cc:359] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.703534  1732 raft_consensus.cc:385] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:53.703861  1732 raft_consensus.cc:740] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:53.704308  1756 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:53.705302  1732 consensus_queue.cc:260] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.707286  1731 ts_tablet_manager.cc:1434] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.000s
I20260709 12:56:53.708315  1731 tablet_bootstrap.cc:492] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:53.744626  1732 ts_tablet_manager.cc:1434] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.001s
I20260709 12:56:53.747159  1731 tablet_bootstrap.cc:654] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:53.747226  1732 tablet_bootstrap.cc:492] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:53.747884  1785 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.747728  1735 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.754029  1785 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:53.755656  1735 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:53.757107  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:53.758210  1539 raft_consensus.cc:1240] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 1. Current term is 2. Ops: []
I20260709 12:56:53.756240  1735 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:53.783183  1756 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:53.783711  1756 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.789625  1739 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:53.790205  1739 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.793838  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:53.794598  1689 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:56:53.799966  1789 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:53.762250  1735 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.800601  1789 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:56:53.769760  1655 leader_election.cc:343] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:53.825109  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:53.827641  1790 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:53.828186  1790 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.796060  1739 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:56:53.836174  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 74235.2us
I20260709 12:56:53.812266  1735 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:53.837235  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:53.858538  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:53.858753  1803 consensus_queue.cc:1048] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:56:53.854686  1785 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:53.862072  1785 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.855047  1583 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:56:53.869683  1739 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:53.870162  1739 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:53.870520  1739 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:53.882543  1616 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:53.864352  1785 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:53.847860  1790 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:53.951439  1785 consensus_queue.cc:1059] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:53.951861  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:53.952598  1542 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 0.
I20260709 12:56:53.951220  1790 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:53.953331  1734 tablet_bootstrap.cc:492] T 105edc3ce5964519acbd96dbaa975697 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:53.961035  1734 ts_tablet_manager.cc:1403] T 105edc3ce5964519acbd96dbaa975697 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.379s	user 0.058s	sys 0.027s
I20260709 12:56:53.957659  1789 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:53.965080  1789 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:53.953271  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:53.982573  1756 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:53.970546  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:53.990690  1688 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
I20260709 12:56:53.991174  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:53.984438  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:56:53.992414  1581 leader_election.cc:343] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:53.970546  1655 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:53.968783  1789 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.994570  1789 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:53.996371  1804 raft_consensus.cc:3055] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:56:53.996305  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:53.996889  1804 raft_consensus.cc:740] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:56:53.997362  1540 raft_consensus.cc:2393] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 1: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:56:53.997747  1804 consensus_queue.cc:260] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:53.999084  1804 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:54.000697  1615 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
I20260709 12:56:53.963701  1790 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.006189  1852 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:54.010746  1741 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:54.011045  1734 raft_consensus.cc:359] T 105edc3ce5964519acbd96dbaa975697 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.012784  1734 raft_consensus.cc:385] T 105edc3ce5964519acbd96dbaa975697 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:54.011879  1731 tablet_bootstrap.cc:492] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:54.013324  1734 raft_consensus.cc:740] T 105edc3ce5964519acbd96dbaa975697 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:54.014003  1731 ts_tablet_manager.cc:1403] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.306s	user 0.027s	sys 0.013s
I20260709 12:56:54.011523  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:54.011219  1741 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:54.015472  1741 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:54.014304  1734 consensus_queue.cc:260] T 105edc3ce5964519acbd96dbaa975697 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.016517  1617 raft_consensus.cc:2468] T 105edc3ce5964519acbd96dbaa975697 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
I20260709 12:56:54.020370  1732 tablet_bootstrap.cc:654] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:54.006853  1852 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.030383  1614 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:54.033023  1731 raft_consensus.cc:359] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.033787  1731 raft_consensus.cc:385] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:54.034039  1731 raft_consensus.cc:740] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:54.034595  1731 consensus_queue.cc:260] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:56:54.029796  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 45911.8us
I20260709 12:56:54.016111  1790 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:54.037978  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:54.038128  1739 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.038694  1613 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 0.
I20260709 12:56:54.045400  1731 ts_tablet_manager.cc:1434] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 12:56:54.046289  1731 tablet_bootstrap.cc:492] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:54.041828  1739 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:56:54.047952  1581 leader_election.cc:343] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:54.048398  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:54.049132  1539 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:56:54.051674  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:54.054342  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:54.054888  1688 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
I20260709 12:56:54.056232  1505 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:54.059569  1803 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:56:54.062904  1508 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:54.064244  1803 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:54.064682  1803 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:54.065030  1803 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:54.074355  1734 ts_tablet_manager.cc:1434] T 105edc3ce5964519acbd96dbaa975697 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.113s	user 0.007s	sys 0.002s
I20260709 12:56:54.075155  1734 tablet_bootstrap.cc:492] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
W20260709 12:56:54.072779  1508 leader_election.cc:343] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:54.077203  1508 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:54.078374  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:56:54.065922  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 96163us
I20260709 12:56:54.080332  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:54.081593  1686 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:54.082562  1735 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:54.077092  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:54.081743  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:54.061625  1581 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:54.085315  1583 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:54.082986  1735 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:54.102244  1735 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:54.102552  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:56:54.089795  1488 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:56:54.085777  1790 consensus_queue.cc:1048] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:56:54.108556  1789 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:54.091537  1505 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:56:54.099962  1739 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:54.110582  1739 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:54.111007  1739 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:54.111260  1583 leader_election.cc:343] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:54.111791  1583 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:54.112725  1789 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:54.116293  1732 tablet_bootstrap.cc:492] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:54.116827  1732 ts_tablet_manager.cc:1403] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.370s	user 0.031s	sys 0.026s
I20260709 12:56:54.119272  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:54.112681  1790 raft_consensus.cc:2804] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:54.122593  1732 raft_consensus.cc:359] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.123317  1732 raft_consensus.cc:385] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:54.123577  1732 raft_consensus.cc:740] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:54.124385  1732 consensus_queue.cc:260] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.118331  1852 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:54.133605  1732 ts_tablet_manager.cc:1434] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:56:54.122979  1790 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:54.142334  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:54.144030  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:54.147307  1788 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:54.141378  1790 raft_consensus.cc:3060] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:54.153600  1654 leader_election.cc:343] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:56:54.147413  1581 leader_election.cc:343] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:54.203765  1731 tablet_bootstrap.cc:654] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:54.148341  1803 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.221634  1732 tablet_bootstrap.cc:492] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:54.161784  1741 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.211536  1852 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:54.230458  1852 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.233310  1852 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:54.233944  1851 consensus_queue.cc:1048] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.080s
I20260709 12:56:54.239876  1616 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:56:54.241971  1735 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.243588  1741 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:54.245204  1690 raft_consensus.cc:2393] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 1: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:56:54.244052  1735 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:54.247669  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:56:54.248353  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 101983us
W20260709 12:56:54.252120  1505 leader_election.cc:343] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:54.252579  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:54.253221  1614 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 0.
W20260709 12:56:54.254395  1655 leader_election.cc:343] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:54.254884  1655 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:54.255991  1732 tablet_bootstrap.cc:654] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:54.256421  1804 consensus_queue.cc:1048] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:54.256815  1689 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:54.257488  1741 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:54.249881  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:54.258720  1690 raft_consensus.cc:2393] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 1: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:56:54.259546  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:54.242040  1803 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:54.281240  1734 tablet_bootstrap.cc:654] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:54.289343  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:56:54.283591  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 81900.9us
I20260709 12:56:54.296630  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:54.275182  1654 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:56:54.307729  1655 leader_election.cc:343] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:54.308367  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:54.317691  1851 raft_consensus.cc:2804] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:54.319169  1851 raft_consensus.cc:697] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:56:54.321847  1851 consensus_queue.cc:237] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.326014  1539 raft_consensus.cc:2393] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 1: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 12:56:54.320995  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 55877.1us
I20260709 12:56:54.342940  1790 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.350595  1739 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.348210  1790 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:54.351202  1654 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:54.352041  1852 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:54.352408  1852 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:54.352808  1852 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:54.352883  1739 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:54.355670  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:54.358305  1690 raft_consensus.cc:2393] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 1: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:56:54.355683  1615 raft_consensus.cc:2393] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 1: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:56:54.365226  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:54.368278  1505 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:54.371563  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:54.372107  1790 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:56:54.372927  1539 raft_consensus.cc:2393] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 1: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 12:56:54.376830  1508 leader_election.cc:343] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:54.377244  1581 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:54.361501  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:54.383142  1866 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:56:54.389065  1731 tablet_bootstrap.cc:492] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:54.389565  1731 ts_tablet_manager.cc:1403] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.343s	user 0.011s	sys 0.005s
I20260709 12:56:54.390429  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:54.395133  1734 tablet_bootstrap.cc:492] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:54.395078  1615 raft_consensus.cc:3060] T 105edc3ce5964519acbd96dbaa975697 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:54.395666  1734 ts_tablet_manager.cc:1403] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.321s	user 0.008s	sys 0.011s
I20260709 12:56:54.393163  1655 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:54.391518  1732 tablet_bootstrap.cc:492] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:54.397931  1732 ts_tablet_manager.cc:1403] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.176s	user 0.009s	sys 0.010s
I20260709 12:56:54.398090  1741 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:56:54.398566  1861 log.cc:927] Time spent T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.063s	user 0.002s	sys 0.000s
I20260709 12:56:54.399617  1790 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:54.400698  1731 raft_consensus.cc:359] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.400823  1790 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.401517  1731 raft_consensus.cc:385] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:54.401834  1731 raft_consensus.cc:740] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:54.402478  1731 consensus_queue.cc:260] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.402976  1790 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:54.405460  1731 ts_tablet_manager.cc:1434] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:56:54.402472  1734 raft_consensus.cc:359] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.406193  1734 raft_consensus.cc:385] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:54.406383  1731 tablet_bootstrap.cc:492] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:54.407609  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:56:54.408931  1508 leader_election.cc:343] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:54.410050  1734 raft_consensus.cc:740] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:54.410398  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:54.410311  1732 raft_consensus.cc:359] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:56:54.409145  1505 leader_election.cc:343] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:54.411060  1732 raft_consensus.cc:385] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:54.411798  1732 raft_consensus.cc:740] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:54.411114  1616 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
I20260709 12:56:54.412446  1732 consensus_queue.cc:260] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.411127  1734 consensus_queue.cc:260] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.414554  1732 ts_tablet_manager.cc:1434] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 12:56:54.415481  1732 tablet_bootstrap.cc:492] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:54.417562  1734 ts_tablet_manager.cc:1434] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.006s
I20260709 12:56:54.418896  1505 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:56:54.421830  1859 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:54.422297  1859 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:54.422569  1859 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:54.423768  1734 tablet_bootstrap.cc:492] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:54.430720  1731 tablet_bootstrap.cc:654] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:54.436842  1734 tablet_bootstrap.cc:654] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:54.440237  1732 tablet_bootstrap.cc:654] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:54.445258  1734 tablet_bootstrap.cc:492] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:54.445792  1734 ts_tablet_manager.cc:1403] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.006s
I20260709 12:56:54.450549  1734 raft_consensus.cc:359] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.451252  1734 raft_consensus.cc:385] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:54.451522  1734 raft_consensus.cc:740] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:54.452175  1734 consensus_queue.cc:260] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.454481  1734 ts_tablet_manager.cc:1434] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:56:54.455479  1734 tablet_bootstrap.cc:492] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:54.457140  1732 tablet_bootstrap.cc:492] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:54.457646  1732 ts_tablet_manager.cc:1403] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.042s	user 0.004s	sys 0.010s
I20260709 12:56:54.462155  1732 raft_consensus.cc:359] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.462895  1732 raft_consensus.cc:385] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:54.463161  1732 raft_consensus.cc:740] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:54.463791  1732 consensus_queue.cc:260] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.464821  1686 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:56:54.464838  1615 raft_consensus.cc:2468] T 105edc3ce5964519acbd96dbaa975697 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:56:54.465287  1852 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.466223  1859 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.467916  1852 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:54.468403  1859 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:54.469159  1583 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:54.469906  1734 tablet_bootstrap.cc:654] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:54.470286  1866 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:54.470775  1866 raft_consensus.cc:697] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:56:54.471266  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:54.471834  1686 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:54.471843  1866 consensus_queue.cc:237] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.474421  1732 ts_tablet_manager.cc:1434] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:56:54.475651  1732 tablet_bootstrap.cc:492] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:54.479938  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:54.464964  1689 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:56:54.482052  1732 tablet_bootstrap.cc:654] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:54.482170  1508 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:54.483381  1859 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:54.484783  1859 raft_consensus.cc:697] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:56:54.485446  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:54.485641  1859 consensus_queue.cc:237] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.487098  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:54.490829  1614 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:54.491614  1655 leader_election.cc:343] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:54.492662  1505 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:56:54.493489  1790 raft_consensus.cc:2804] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:54.494011  1790 raft_consensus.cc:697] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:56:54.494305  1734 tablet_bootstrap.cc:492] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:54.494932  1734 ts_tablet_manager.cc:1403] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.003s
I20260709 12:56:54.495148  1790 consensus_queue.cc:237] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.488889  1437 catalog_manager.cc:5697] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:54.486063  1615 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:54.501382  1734 raft_consensus.cc:359] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.502211  1734 raft_consensus.cc:385] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:54.502471  1734 raft_consensus.cc:740] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:54.506132  1732 tablet_bootstrap.cc:492] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:54.506669  1732 ts_tablet_manager.cc:1403] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.031s	user 0.021s	sys 0.005s
I20260709 12:56:54.510043  1732 raft_consensus.cc:359] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.510766  1732 raft_consensus.cc:385] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:54.511075  1732 raft_consensus.cc:740] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:54.511845  1732 consensus_queue.cc:260] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.514676  1732 ts_tablet_manager.cc:1434] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:56:54.515622  1732 tablet_bootstrap.cc:492] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:54.516404  1731 tablet_bootstrap.cc:492] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:54.503171  1734 consensus_queue.cc:260] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.517692  1731 ts_tablet_manager.cc:1403] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.112s	user 0.016s	sys 0.009s
I20260709 12:56:54.518569  1734 ts_tablet_manager.cc:1434] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:56:54.519598  1734 tablet_bootstrap.cc:492] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:54.522446  1732 tablet_bootstrap.cc:654] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:54.521050  1731 raft_consensus.cc:359] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.526129  1734 tablet_bootstrap.cc:654] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:54.528568  1438 catalog_manager.cc:5697] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 0 to 1, leader changed from <none> to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:54.524087  1731 raft_consensus.cc:385] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:54.535277  1732 tablet_bootstrap.cc:492] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:54.535553  1731 raft_consensus.cc:740] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:54.535881  1732 ts_tablet_manager.cc:1403] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.010s
I20260709 12:56:54.536595  1731 consensus_queue.cc:260] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.538789  1731 ts_tablet_manager.cc:1434] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.003s
I20260709 12:56:54.539839  1731 tablet_bootstrap.cc:492] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:54.541082  1734 tablet_bootstrap.cc:492] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:54.541720  1734 ts_tablet_manager.cc:1403] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.000s
I20260709 12:56:54.541925  1440 catalog_manager.cc:5697] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:54.545048  1734 raft_consensus.cc:359] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.545822  1734 raft_consensus.cc:385] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:54.545884  1731 tablet_bootstrap.cc:654] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:54.546197  1734 raft_consensus.cc:740] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:54.546979  1734 consensus_queue.cc:260] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.549147  1734 ts_tablet_manager.cc:1434] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:56:54.538697  1732 raft_consensus.cc:359] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.549926  1732 raft_consensus.cc:385] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:54.550264  1732 raft_consensus.cc:740] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:54.550979  1732 consensus_queue.cc:260] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.552443  1734 tablet_bootstrap.cc:492] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:54.555908  1732 ts_tablet_manager.cc:1434] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.020s	user 0.001s	sys 0.004s
I20260709 12:56:54.556928  1732 tablet_bootstrap.cc:492] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:54.558696  1734 tablet_bootstrap.cc:654] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:54.563360  1732 tablet_bootstrap.cc:654] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:54.577499  1614 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:56:54.578331  1731 tablet_bootstrap.cc:492] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:54.578994  1731 ts_tablet_manager.cc:1403] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.039s	user 0.023s	sys 0.012s
I20260709 12:56:54.577920  1615 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:56:54.580094  1654 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:54.585609  1852 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:54.585855  1505 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:54.588706  1859 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:54.588783  1852 raft_consensus.cc:697] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:56:54.589310  1859 raft_consensus.cc:697] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:56:54.589764  1852 consensus_queue.cc:237] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.590243  1859 consensus_queue.cc:237] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.577778  1686 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:56:54.617141  1731 raft_consensus.cc:359] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.617909  1731 raft_consensus.cc:385] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:54.618256  1731 raft_consensus.cc:740] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:54.619046  1731 consensus_queue.cc:260] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.624143  1732 tablet_bootstrap.cc:492] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:54.624697  1732 ts_tablet_manager.cc:1403] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.068s	user 0.003s	sys 0.021s
I20260709 12:56:54.625033  1731 ts_tablet_manager.cc:1434] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 12:56:54.625530  1734 tablet_bootstrap.cc:492] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:54.626140  1731 tablet_bootstrap.cc:492] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:54.627537  1732 raft_consensus.cc:359] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.636521  1732 raft_consensus.cc:385] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:54.636875  1732 raft_consensus.cc:740] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:54.637607  1732 consensus_queue.cc:260] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.626230  1734 ts_tablet_manager.cc:1403] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.074s	user 0.025s	sys 0.042s
I20260709 12:56:54.640025  1732 ts_tablet_manager.cc:1434] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.001s
I20260709 12:56:54.642230  1732 tablet_bootstrap.cc:492] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:54.661964  1734 raft_consensus.cc:359] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.662701  1734 raft_consensus.cc:385] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:54.662971  1734 raft_consensus.cc:740] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:54.663708  1734 consensus_queue.cc:260] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.666093  1734 ts_tablet_manager.cc:1434] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:56:54.669982  1734 tablet_bootstrap.cc:492] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:54.671145  1437 catalog_manager.cc:5697] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:54.684722  1731 tablet_bootstrap.cc:654] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:54.687750  1732 tablet_bootstrap.cc:654] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:54.693434  1734 tablet_bootstrap.cc:654] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:54.694967  1731 tablet_bootstrap.cc:492] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:54.695542  1731 ts_tablet_manager.cc:1403] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.070s	user 0.006s	sys 0.006s
I20260709 12:56:54.698294  1731 raft_consensus.cc:359] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.699132  1731 raft_consensus.cc:385] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:54.699411  1731 raft_consensus.cc:740] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:54.700525  1438 catalog_manager.cc:5697] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:54.704862  1731 consensus_queue.cc:260] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.702783  1438 catalog_manager.cc:5697] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:54.706877  1732 tablet_bootstrap.cc:492] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:54.707487  1732 ts_tablet_manager.cc:1403] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.001s
I20260709 12:56:54.710731  1732 raft_consensus.cc:359] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.713429  1732 raft_consensus.cc:385] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:54.713771  1732 raft_consensus.cc:740] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:54.714481  1732 consensus_queue.cc:260] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.716241  1732 ts_tablet_manager.cc:1434] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:56:54.713112  1731 ts_tablet_manager.cc:1434] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.003s
I20260709 12:56:54.717134  1731 tablet_bootstrap.cc:492] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:54.721156  1734 tablet_bootstrap.cc:492] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:54.721709  1734 ts_tablet_manager.cc:1403] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.052s	user 0.027s	sys 0.002s
I20260709 12:56:54.722427  1731 tablet_bootstrap.cc:654] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:54.724404  1734 raft_consensus.cc:359] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.725153  1734 raft_consensus.cc:385] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:54.725430  1734 raft_consensus.cc:740] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:54.721146  1732 tablet_bootstrap.cc:492] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:54.726073  1859 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:54.726804  1859 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.729038  1859 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:54.731231  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:54.731945  1686 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:56:54.732818  1732 tablet_bootstrap.cc:654] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:54.726115  1734 consensus_queue.cc:260] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.737144  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:54.737840  1615 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
I20260709 12:56:54.739822  1505 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:54.741631  1734 ts_tablet_manager.cc:1434] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:56:54.742694  1734 tablet_bootstrap.cc:492] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:54.743753  1859 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:56:54.744196  1859 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:54.744546  1859 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:54.748224  1734 tablet_bootstrap.cc:654] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:54.751135  1732 tablet_bootstrap.cc:492] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:54.751624  1732 ts_tablet_manager.cc:1403] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.031s	user 0.006s	sys 0.005s
I20260709 12:56:54.754374  1732 raft_consensus.cc:359] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.755100  1732 raft_consensus.cc:385] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:54.755403  1732 raft_consensus.cc:740] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:54.756168  1732 consensus_queue.cc:260] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.758325  1732 ts_tablet_manager.cc:1434] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:56:54.756902  1731 tablet_bootstrap.cc:492] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:54.759411  1732 tablet_bootstrap.cc:492] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:54.765308  1731 ts_tablet_manager.cc:1403] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.004s
I20260709 12:56:54.771725  1732 tablet_bootstrap.cc:654] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:54.772420  1867 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:54.773937  1734 tablet_bootstrap.cc:492] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:54.772953  1867 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.774417  1734 ts_tablet_manager.cc:1403] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.000s
I20260709 12:56:54.775964  1867 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:54.777139  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:54.777948  1686 raft_consensus.cc:2393] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 1: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:56:54.777850  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:54.779693  1859 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.780815  1581 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:54.781999  1867 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:54.778822  1731 raft_consensus.cc:359] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.783131  1731 raft_consensus.cc:385] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:54.783401  1731 raft_consensus.cc:740] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:54.783429  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:54.784130  1615 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 2
I20260709 12:56:54.784132  1731 consensus_queue.cc:260] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.786798  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:54.787387  1689 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:54.791877  1540 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:54.793169  1686 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:54.796932  1852 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:54.797501  1852 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.786764  1731 ts_tablet_manager.cc:1434] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.002s
I20260709 12:56:54.799386  1731 tablet_bootstrap.cc:492] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:54.800598  1852 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:54.802083  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:54.798592  1732 tablet_bootstrap.cc:492] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:54.803305  1732 ts_tablet_manager.cc:1403] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.017s
I20260709 12:56:54.803841  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:56:54.805405  1654 leader_election.cc:343] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:54.806370  1732 raft_consensus.cc:359] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:56:54.806834  1655 leader_election.cc:343] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:54.807138  1732 raft_consensus.cc:385] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:54.807312  1655 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:54.807555  1732 raft_consensus.cc:740] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:54.808619  1756 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:54.808439  1732 consensus_queue.cc:260] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.809111  1756 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.809514  1851 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:54.812315  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:54.814591  1732 ts_tablet_manager.cc:1434] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.003s
W20260709 12:56:54.814704  1581 leader_election.cc:343] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:54.815624  1732 tablet_bootstrap.cc:492] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:54.812398  1731 tablet_bootstrap.cc:654] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:54.781919  1859 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:54.821056  1756 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:54.822685  1732 tablet_bootstrap.cc:654] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:54.822881  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:56:54.825253  1583 leader_election.cc:343] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:54.825744  1583 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:54.826861  1756 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:54.832098  1732 tablet_bootstrap.cc:492] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:54.832541  1732 ts_tablet_manager.cc:1403] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.017s	user 0.005s	sys 0.011s
I20260709 12:56:54.835028  1732 raft_consensus.cc:359] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.835690  1732 raft_consensus.cc:385] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:54.835954  1732 raft_consensus.cc:740] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:54.836426  1734 raft_consensus.cc:359] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.836612  1732 consensus_queue.cc:260] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.838306  1734 raft_consensus.cc:385] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:54.838645  1734 raft_consensus.cc:740] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:54.839679  1732 ts_tablet_manager.cc:1434] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:56:54.839346  1734 consensus_queue.cc:260] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.841516  1734 ts_tablet_manager.cc:1434] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.067s	user 0.003s	sys 0.004s
I20260709 12:56:54.842718  1734 tablet_bootstrap.cc:492] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:54.843443  1732 tablet_bootstrap.cc:492] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:54.849956  1852 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:54.850399  1851 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:54.856345  1734 tablet_bootstrap.cc:654] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:54.854880  1851 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.855165  1852 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.863409  1852 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:54.869004  1732 tablet_bootstrap.cc:654] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:54.869335  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:54.870747  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:54.871726  1614 raft_consensus.cc:2393] T 105edc3ce5964519acbd96dbaa975697 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 1: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:56:54.872524  1851 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:54.870115  1688 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:54.874091  1654 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:54.874737  1851 raft_consensus.cc:3060] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:54.875630  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:54.875993  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:54.879204  1654 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:54.882090  1615 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:56:54.881145  1867 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:54.883967  1859 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:54.884527  1859 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.892092  1731 tablet_bootstrap.cc:492] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:54.892709  1731 ts_tablet_manager.cc:1403] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.093s	user 0.017s	sys 0.002s
I20260709 12:56:54.881875  1689 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:56:54.894971  1508 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:54.896948  1790 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:54.897401  1790 raft_consensus.cc:697] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:56:54.897763  1734 tablet_bootstrap.cc:492] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:54.898224  1734 ts_tablet_manager.cc:1403] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.056s	user 0.016s	sys 0.003s
I20260709 12:56:54.898195  1790 consensus_queue.cc:237] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.890674  1852 consensus_queue.cc:1048] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:56:54.907269  1804 consensus_queue.cc:1048] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:54.908268  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:54.902525  1859 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:54.914412  1907 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:54.915295  1731 raft_consensus.cc:359] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.917513  1731 raft_consensus.cc:385] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:54.917829  1731 raft_consensus.cc:740] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:54.918517  1734 raft_consensus.cc:359] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.919401  1734 raft_consensus.cc:385] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:54.919673  1734 raft_consensus.cc:740] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:54.922173  1731 consensus_queue.cc:260] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.930640  1867 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:54.931413  1756 consensus_queue.cc:1048] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:54.931226  1867 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.932250  1731 ts_tablet_manager.cc:1434] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.002s
I20260709 12:56:54.922529  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:54.933187  1731 tablet_bootstrap.cc:492] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:54.933570  1867 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:54.934973  1734 consensus_queue.cc:260] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.935941  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:54.921456  1780 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:54.937067  1734 ts_tablet_manager.cc:1434] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.038s	user 0.001s	sys 0.005s
I20260709 12:56:54.936838  1780 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.937942  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:54.938647  1690 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:56:54.939260  1734 tablet_bootstrap.cc:492] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:54.943202  1583 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:56:54.945104  1867 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:54.945534  1867 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:54.945884  1867 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:54.950824  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:54.951524  1690 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
I20260709 12:56:54.953346  1508 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:54.954036  1756 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:54.938910  1780 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:54.954246  1859 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:54.954834  1859 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:54.954610  1756 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.955183  1859 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:54.922695  1907 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:54.959689  1540 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:56:54.969903  1732 tablet_bootstrap.cc:492] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:55.006898  1732 ts_tablet_manager.cc:1403] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.164s	user 0.023s	sys 0.021s
I20260709 12:56:54.996712  1851 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:55.021809  1907 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:55.027150  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:55.027798  1690 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
I20260709 12:56:55.028098  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:56:55.029601  1583 leader_election.cc:343] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:55.030591  1508 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:55.031571  1780 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:55.032666  1780 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:55.033084  1780 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:55.033222  1866 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:55.033674  1866 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:55.039023  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:55.039785  1614 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
I20260709 12:56:55.024086  1756 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:55.036743  1906 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:55.065555  1731 tablet_bootstrap.cc:654] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:55.040673  1907 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 12:56:55.072610  1866 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:55.073777  1906 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:55.089840  1859 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:55.097254  1906 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:55.098213  1859 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:55.091629  1505 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:55.098357  1734 tablet_bootstrap.cc:654] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:55.103112  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:55.103842  1689 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:56:55.105664  1732 raft_consensus.cc:359] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:55.106264  1732 raft_consensus.cc:385] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:55.106484  1732 raft_consensus.cc:740] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:55.107015  1732 consensus_queue.cc:260] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:55.111498  1732 ts_tablet_manager.cc:1434] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.104s	user 0.006s	sys 0.000s
I20260709 12:56:55.092304  1907 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:55.090071  1867 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:55.122536  1731 tablet_bootstrap.cc:492] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:55.120499  1859 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:56:55.123694  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:55.123026  1731 ts_tablet_manager.cc:1403] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.190s	user 0.011s	sys 0.006s
I20260709 12:56:55.115662  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:55.126772  1859 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:55.128873  1741 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:55.138780  1804 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:55.140626  1804 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:55.141223  1732 tablet_bootstrap.cc:492] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:55.142693  1804 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:55.144510  1616 raft_consensus.cc:2393] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 1: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:56:55.098253  1437 catalog_manager.cc:5697] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 0 to 2, leader changed from <none> to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:55.123054  1907 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:55.146735  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:55.147326  1906 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:55.126794  1583 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:56:55.156714  1541 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:55.156864  1867 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:55.157310  1907 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:55.160063  1731 raft_consensus.cc:359] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:55.160787  1731 raft_consensus.cc:385] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:55.161098  1731 raft_consensus.cc:740] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:55.137084  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:56:55.159554  1581 leader_election.cc:343] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:55.161893  1731 consensus_queue.cc:260] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:55.165870  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:55.167595  1540 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:55.168365  1686 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:55.170471  1616 raft_consensus.cc:2393] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 1: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:56:55.170992  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:55.168757  1851 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:55.161880  1756 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:55.172133  1851 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:55.173535  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:55.174281  1538 raft_consensus.cc:2393] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 1: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:56:55.175135  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:55.175341  1851 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:55.175740  1691 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:55.180361  1655 leader_election.cc:343] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:55.181129  1907 consensus_queue.cc:1048] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:55.173024  1756 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:55.186769  1756 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:55.187999  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:55.182545  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:55.184051  1780 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:55.220657  1691 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:56:55.220806  1780 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:55.220659  1915 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:56:55.223071  1915 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:55.242343  1731 ts_tablet_manager.cc:1434] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.118s	user 0.007s	sys 0.000s
I20260709 12:56:55.243654  1731 tablet_bootstrap.cc:492] T d8b7121a813948bfa350d3f0b9fd6988 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:55.168857  1581 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:55.329059  1915 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:55.294631  1780 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:55.330080  1780 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:55.240455  1686 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:56:55.341168  1866 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:55.342020  1866 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:55.342474  1866 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:56:55.343382  1488 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:56:55.305243  1867 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:55.459924  1734 tablet_bootstrap.cc:492] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:55.460587  1734 ts_tablet_manager.cc:1403] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.523s	user 0.054s	sys 0.049s
I20260709 12:56:55.461581  1732 tablet_bootstrap.cc:654] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:55.462158  1780 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:55.463321  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:55.463723  1851 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:55.464208  1851 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:55.464833  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:55.465855  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:55.466368  1851 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:55.466616  1613 raft_consensus.cc:2393] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 1: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:56:55.412554  1867 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:55.469025  1867 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:55.492436  1866 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:55.495983  1583 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:56:55.489144  1756 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:55.499212  1915 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:56:55.515622  1655 leader_election.cc:343] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:55.517330  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:55.518046  1615 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
I20260709 12:56:55.518349  1505 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:55.522094  1616 raft_consensus.cc:2393] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 1: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:56:55.519146  1905 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:55.522594  1907 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:55.522969  1859 consensus_queue.cc:1048] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:56:55.528719  1734 raft_consensus.cc:359] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:55.529523  1734 raft_consensus.cc:385] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:55.530340  1734 raft_consensus.cc:740] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:55.526302  1915 raft_consensus.cc:697] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:56:55.533020  1734 consensus_queue.cc:260] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:55.539794  1859 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:55.540441  1915 consensus_queue.cc:237] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:55.547883  1734 ts_tablet_manager.cc:1434] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.087s	user 0.005s	sys 0.001s
I20260709 12:56:55.544839  1615 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:56:55.548870  1734 tablet_bootstrap.cc:492] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:55.559775  1732 tablet_bootstrap.cc:492] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:55.560389  1732 ts_tablet_manager.cc:1403] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.419s	user 0.070s	sys 0.073s
I20260709 12:56:55.563369  1732 raft_consensus.cc:359] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:55.564169  1732 raft_consensus.cc:385] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:55.535379  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:55.564450  1732 raft_consensus.cc:740] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:55.566015  1505 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:55.567276  1859 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:56:55.551493  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 391977us
I20260709 12:56:55.568265  1731 tablet_bootstrap.cc:654] T d8b7121a813948bfa350d3f0b9fd6988 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:55.569248  1732 consensus_queue.cc:260] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:55.568379  1790 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
W20260709 12:56:55.582494  1655 leader_election.cc:343] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:55.583115  1756 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:55.585477  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:55.586244  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:55.586381  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:55.587010  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:55.580659  1859 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:55.591502  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:55.592319  1538 raft_consensus.cc:2393] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 2: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:56:55.592818  1691 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:56:55.596951  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:55.597433  1541 raft_consensus.cc:2393] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 1: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:56:55.597728  1689 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
W20260709 12:56:55.589005  1919 log.cc:927] Time spent T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:56:55.599205  1732 ts_tablet_manager.cc:1434] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.038s	user 0.010s	sys 0.003s
I20260709 12:56:55.599896  1583 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:56:55.600204  1732 tablet_bootstrap.cc:492] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:55.600773  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:55.601583  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:55.603132  1537 raft_consensus.cc:2393] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 1: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:56:55.603004  1921 consensus_queue.cc:1048] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:56:55.604710  1688 raft_consensus.cc:2393] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 1: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:56:55.592950  1686 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:56:55.603705  1922 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:56:55.609591  1583 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:56:55.591173  1859 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:55.612901  1921 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:55.614321  1921 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:55.617308  1921 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:55.623042  1921 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:55.616760  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:55.624114  1790 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:55.625924  1583 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:56:55.614475  1922 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:56:55.630069  1756 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:56:55.633016  1581 leader_election.cc:343] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:55.634375  1756 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:55.634333  1581 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:55.634944  1756 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:55.635288  1915 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:56:55.636682  1581 leader_election.cc:343] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:55.628520  1790 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:55.630239  1922 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:55.657047  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:55.657308  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:55.658114  1688 raft_consensus.cc:2393] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 1: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:56:55.662503  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:55.671561  1790 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:55.692296  1731 tablet_bootstrap.cc:492] T d8b7121a813948bfa350d3f0b9fd6988 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:55.692929  1731 ts_tablet_manager.cc:1403] T d8b7121a813948bfa350d3f0b9fd6988 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.450s	user 0.018s	sys 0.009s
I20260709 12:56:55.678438  1921 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:56:55.699932  1925 log.cc:927] Time spent T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:56:55.686725  1688 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:56:55.707595  1732 tablet_bootstrap.cc:654] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:55.712697  1734 tablet_bootstrap.cc:654] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:55.722141  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:55.722783  1691 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:55.699843  1859 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:55.704934  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:55.732807  1859 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:55.734263  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:55.738888  1731 raft_consensus.cc:359] T d8b7121a813948bfa350d3f0b9fd6988 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:55.739720  1731 raft_consensus.cc:385] T d8b7121a813948bfa350d3f0b9fd6988 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:55.739975  1731 raft_consensus.cc:740] T d8b7121a813948bfa350d3f0b9fd6988 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:55.720813  1756 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:55.742457  1756 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:55.744103  1731 consensus_queue.cc:260] T d8b7121a813948bfa350d3f0b9fd6988 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:55.766296  1731 ts_tablet_manager.cc:1434] T d8b7121a813948bfa350d3f0b9fd6988 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.000s
I20260709 12:56:55.767366  1731 tablet_bootstrap.cc:492] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:55.729776  1508 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:56:55.766322  1581 leader_election.cc:343] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:55.775722  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:56:55.781251  1505 leader_election.cc:343] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:56:55.787775  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 66462.2us
I20260709 12:56:55.783877  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:55.784005  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:55.783501  1912 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:55.802933  1691 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:56:55.846506  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:55.847157  1687 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:55.844174  1912 raft_consensus.cc:697] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:56:55.850363  1912 consensus_queue.cc:237] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:56:55.844447  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 54921.7us
I20260709 12:56:55.859093  1508 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:55.860070  1859 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:56:55.860877  1508 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:56:55.861884  1581 leader_election.cc:343] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:55.864959  1583 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:55.866235  1915 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:55.866806  1915 raft_consensus.cc:697] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:56:55.867702  1915 consensus_queue.cc:237] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:55.876165  1922 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:55.924387  1731 tablet_bootstrap.cc:654] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:55.945750  1922 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:56.011175  1732 tablet_bootstrap.cc:492] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:56.011701  1732 ts_tablet_manager.cc:1403] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.412s	user 0.016s	sys 0.018s
I20260709 12:56:56.011632  1790 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:56:56.013743  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 152957us
I20260709 12:56:56.013924  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:56.014520  1616 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:56.016667  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 238345us
I20260709 12:56:56.017239  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:56.017583  1687 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:56:56.018862  1583 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:56.019735  1922 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:56.020191  1922 raft_consensus.cc:697] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:56:56.021005  1922 consensus_queue.cc:237] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.026544  1906 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:56.027093  1906 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.029155  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:56.029021  1440 catalog_manager.cc:5697] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 0 to 1, leader changed from <none> to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:56.029975  1542 raft_consensus.cc:2393] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 2: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:56:56.031781  1688 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:56:56.040102  1732 raft_consensus.cc:359] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.043594  1732 raft_consensus.cc:385] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:56.044025  1732 raft_consensus.cc:740] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:56.048884  1756 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:56.051492  1906 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:56:56.052855  1654 leader_election.cc:343] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:56.053437  1654 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:56.054263  1947 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:56.062472  1732 consensus_queue.cc:260] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:56:56.068681  1654 leader_election.cc:343] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:56.069202  1654 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:56:56.070816  1508 leader_election.cc:343] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:56.064323  1616 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:56:56.072652  1905 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:56.073125  1583 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:56.073357  1851 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:56.073839  1732 ts_tablet_manager.cc:1434] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.002s
I20260709 12:56:56.074240  1859 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:56.074750  1732 tablet_bootstrap.cc:492] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:56.074435  1866 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:56.076269  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:56.076884  1687 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:56.076723  1866 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.072386  1734 tablet_bootstrap.cc:492] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:56.078147  1734 ts_tablet_manager.cc:1403] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.529s	user 0.016s	sys 0.011s
I20260709 12:56:56.078472  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:56.079097  1614 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:56:56.079797  1915 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:56.082494  1866 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:56.080264  1915 raft_consensus.cc:697] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:56:56.083899  1915 consensus_queue.cc:237] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.087018  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:56.089633  1734 raft_consensus.cc:359] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.090030  1691 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:56:56.090417  1734 raft_consensus.cc:385] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:56.090831  1731 tablet_bootstrap.cc:492] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:56.091264  1731 ts_tablet_manager.cc:1403] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.324s	user 0.005s	sys 0.023s
I20260709 12:56:56.090756  1734 raft_consensus.cc:740] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:56.092149  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:56.093783  1687 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:56:56.097795  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:56.097476  1734 consensus_queue.cc:260] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:56:56.097589  1654 leader_election.cc:343] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:56.098424  1537 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:56:56.100318  1581 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:56.101249  1734 ts_tablet_manager.cc:1434] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.002s
I20260709 12:56:56.102067  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:56.105721  1654 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:56.107151  1689 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:56:56.104287  1756 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:56.110371  1731 raft_consensus.cc:359] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.104399  1505 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:56.113911  1731 raft_consensus.cc:385] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:56.113793  1756 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:56.115295  1756 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:56.121333  1912 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:56.121933  1912 raft_consensus.cc:697] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:56:56.122807  1912 consensus_queue.cc:237] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.123118  1505 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:56.137483  1790 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:56:56.138006  1790 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:56.138368  1790 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:56.150539  1734 tablet_bootstrap.cc:492] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:56.114494  1731 raft_consensus.cc:740] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:56.152449  1732 tablet_bootstrap.cc:654] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:56.152714  1731 consensus_queue.cc:260] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.154577  1731 ts_tablet_manager.cc:1434] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.000s
I20260709 12:56:56.155382  1731 tablet_bootstrap.cc:492] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:56.150274  1943 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:56:56.151181  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 53634.6us
W20260709 12:56:56.160812  1508 leader_election.cc:343] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:56.161311  1508 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:56.162405  1907 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:56.166975  1790 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.219841  1731 tablet_bootstrap.cc:654] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:56.220134  1732 tablet_bootstrap.cc:492] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:56.220638  1732 ts_tablet_manager.cc:1403] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.146s	user 0.013s	sys 0.011s
I20260709 12:56:56.213714  1756 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.228189  1732 raft_consensus.cc:359] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.228996  1732 raft_consensus.cc:385] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:56.229281  1732 raft_consensus.cc:740] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:56.229943  1732 consensus_queue.cc:260] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.233667  1732 ts_tablet_manager.cc:1434] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:56:56.235152  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:56.235777  1689 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:56.236119  1915 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:56.239485  1732 tablet_bootstrap.cc:492] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:56.233589  1790 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:56.258196  1731 tablet_bootstrap.cc:492] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:56.258903  1731 ts_tablet_manager.cc:1403] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.104s	user 0.009s	sys 0.007s
I20260709 12:56:56.263202  1731 raft_consensus.cc:359] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.268857  1731 raft_consensus.cc:385] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:56.266259  1734 tablet_bootstrap.cc:654] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:56.269306  1731 raft_consensus.cc:740] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:56.255136  1866 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:56.270277  1731 consensus_queue.cc:260] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.275502  1731 ts_tablet_manager.cc:1434] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:56:56.278687  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:56.272117  1866 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.280536  1540 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:56.284206  1689 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:56:56.285100  1732 tablet_bootstrap.cc:654] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:56.286936  1508 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:56.287775  1790 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:56:56.288244  1790 raft_consensus.cc:697] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:56:56.288793  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:56.289839  1866 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:56.293205  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:56.293866  1540 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:56:56.295720  1581 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:56.289660  1790 consensus_queue.cc:237] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.293944  1537 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:56:56.300817  1581 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:56.301748  1915 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:56:56.302130  1915 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:56.302466  1915 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:56.302644  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:56.303294  1689 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:56:56.306650  1866 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:56.306744  1943 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:56.307447  1866 raft_consensus.cc:697] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:56:56.307582  1943 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.310796  1731 tablet_bootstrap.cc:492] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:56.314597  1943 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:56.319355  1438 catalog_manager.cc:5697] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:56.335529  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:56.335664  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:56.336949  1689 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:56.337800  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:56:56.339344  1654 leader_election.cc:343] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:56:56.339986  1655 leader_election.cc:343] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:56.340425  1655 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:56.341063  1922 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:56.341508  1943 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:56.341521  1922 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.324928  1866 consensus_queue.cc:237] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.345080  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:56.327278  1756 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:56:56.348429  1581 leader_election.cc:343] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:56.354121  1922 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:56.354339  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:56.355054  1686 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:56:56.356396  1583 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:56.357617  1922 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:56.357993  1922 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:56:56.358114  1964 log.cc:927] Time spent T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:56:56.358366  1922 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:56.356462  1915 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.368722  1734 tablet_bootstrap.cc:492] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:56.368860  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:56.369467  1686 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:56.369364  1734 ts_tablet_manager.cc:1403] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.219s	user 0.011s	sys 0.013s
I20260709 12:56:56.371088  1915 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:56.368623  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:56.372017  1537 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:56.373715  1732 tablet_bootstrap.cc:492] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:56.374192  1732 ts_tablet_manager.cc:1403] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.135s	user 0.023s	sys 0.012s
I20260709 12:56:56.375409  1734 raft_consensus.cc:359] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.376101  1734 raft_consensus.cc:385] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:56.376358  1734 raft_consensus.cc:740] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:56.377085  1734 consensus_queue.cc:260] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.379195  1734 ts_tablet_manager.cc:1434] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:56:56.379539  1756 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:56.380151  1734 tablet_bootstrap.cc:492] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:56.380048  1756 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.382645  1756 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:56.383505  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:56.384622  1922 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.385769  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:56.386317  1686 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:56:56.386420  1691 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:56:56.386736  1922 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:56.388451  1689 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
W20260709 12:56:56.388742  1581 leader_election.cc:343] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:56.390082  1731 tablet_bootstrap.cc:654] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:56.390475  1583 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:56:56.393148  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:56.394011  1732 raft_consensus.cc:359] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.394778  1732 raft_consensus.cc:385] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:56:56.394835  1581 leader_election.cc:343] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:56.395098  1732 raft_consensus.cc:740] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:56.396034  1734 tablet_bootstrap.cc:654] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:56.395938  1732 consensus_queue.cc:260] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.396399  1583 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:56.397814  1756 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:56.398427  1921 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:56.398862  1921 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:56.398947  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:56.399250  1921 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:56.400197  1689 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:56.398466  1756 raft_consensus.cc:697] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:56:56.398401  1537 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:56:56.406669  1732 ts_tablet_manager.cc:1434] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:56:56.407896  1756 consensus_queue.cc:237] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.406426  1921 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.409538  1732 tablet_bootstrap.cc:492] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:56.426851  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:56.427560  1691 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:56.432966  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:56:56.446720  1581 leader_election.cc:343] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:56.434537  1921 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:56:56.450995  1488 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:56:56.467561  1540 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:56.450562  1922 consensus_queue.cc:1048] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:56:56.479889  1971 consensus_queue.cc:1048] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260709 12:56:56.481890  1731 tablet_bootstrap.cc:492] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:56.482435  1731 ts_tablet_manager.cc:1403] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.172s	user 0.010s	sys 0.015s
I20260709 12:56:56.477295  1689 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:56:56.484400  1583 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:56.485183  1921 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:56.485641  1921 raft_consensus.cc:697] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:56:56.492724  1731 raft_consensus.cc:359] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.493430  1731 raft_consensus.cc:385] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:56.493708  1731 raft_consensus.cc:740] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:56.494699  1790 consensus_queue.cc:1048] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:56.496097  1790 consensus_queue.cc:1048] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:56.497475  1691 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:56:56.498800  1583 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:56.499963  1731 consensus_queue.cc:260] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.489861  1437 catalog_manager.cc:5697] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:56.505038  1922 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:56.486407  1921 consensus_queue.cc:237] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.529716  1732 tablet_bootstrap.cc:654] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:56.528600  1437 catalog_manager.cc:5697] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 1 to 3, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:56.532774  1731 ts_tablet_manager.cc:1434] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.002s
I20260709 12:56:56.533906  1731 tablet_bootstrap.cc:492] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:56.529640  1922 raft_consensus.cc:697] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:56:56.550184  1734 tablet_bootstrap.cc:492] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:56.550668  1734 ts_tablet_manager.cc:1403] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.171s	user 0.035s	sys 0.019s
I20260709 12:56:56.550616  1922 consensus_queue.cc:237] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.554478  1734 raft_consensus.cc:359] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.555194  1734 raft_consensus.cc:385] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:56.555450  1734 raft_consensus.cc:740] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:56.556106  1734 consensus_queue.cc:260] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.564253  1790 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:56.569685  1790 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.572461  1790 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:56.577332  1907 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:56.577805  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:56.577867  1907 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.578574  1613 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
W20260709 12:56:56.579290  1581 consensus_peers.cc:597] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:56.579741  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:56:56.581040  1508 leader_election.cc:343] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:56.576170  1438 catalog_manager.cc:5697] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 0 to 1, leader changed from <none> to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:56.584571  1438 catalog_manager.cc:5697] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 0 to 1, leader changed from <none> to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:56.586634  1734 ts_tablet_manager.cc:1434] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.004s
I20260709 12:56:56.587203  1537 raft_consensus.cc:1240] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3. Ops: []
I20260709 12:56:56.587019  1866 consensus_queue.cc:1048] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:56.587817  1734 tablet_bootstrap.cc:492] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:56.591849  1756 consensus_queue.cc:1059] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:56:56.618635  1756 consensus_queue.cc:1243] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 12:56:56.620914  1756 raft_consensus.cc:3055] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:56:56.621523  1756 raft_consensus.cc:740] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:56:56.622442  1756 consensus_queue.cc:260] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.623106  1731 tablet_bootstrap.cc:654] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:56.622871  1790 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:56.623554  1756 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:56:56.597239  1438 catalog_manager.cc:5697] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 0 to 1, leader changed from <none> to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:56.624910  1907 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:56.602633  1505 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:56:56.626489  1907 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:56:56.626679  1976 log.cc:927] Time spent T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:56:56.626896  1907 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:56.627260  1907 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:56.633706  1734 tablet_bootstrap.cc:654] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:56.650450  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:56.676680  1731 tablet_bootstrap.cc:492] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:56.677241  1731 ts_tablet_manager.cc:1403] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.144s	user 0.029s	sys 0.010s
I20260709 12:56:56.680197  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:56.684345  1907 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.684918  1734 tablet_bootstrap.cc:492] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:56.686040  1734 ts_tablet_manager.cc:1403] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.098s	user 0.015s	sys 0.001s
I20260709 12:56:56.688557  1505 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:56.695197  1907 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:56.689152  1734 raft_consensus.cc:359] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.696635  1734 raft_consensus.cc:385] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:56.696970  1734 raft_consensus.cc:740] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:56.697384  1732 tablet_bootstrap.cc:492] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:56.697540  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:56.697873  1732 ts_tablet_manager.cc:1403] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.289s	user 0.029s	sys 0.011s
I20260709 12:56:56.697752  1734 consensus_queue.cc:260] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.698163  1613 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:56.697156  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:56.703361  1734 ts_tablet_manager.cc:1434] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.004s
W20260709 12:56:56.705515  1508 leader_election.cc:343] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:56.705857  1790 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:56:56.704524  1734 tablet_bootstrap.cc:492] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:56.712930  1731 raft_consensus.cc:359] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.713660  1731 raft_consensus.cc:385] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:56.713968  1731 raft_consensus.cc:740] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:56.714604  1731 consensus_queue.cc:260] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.717847  1732 raft_consensus.cc:359] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.718492  1732 raft_consensus.cc:385] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:56.718693  1732 raft_consensus.cc:740] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:56.719215  1732 consensus_queue.cc:260] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.721254  1732 ts_tablet_manager.cc:1434] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:56:56.724045  1731 ts_tablet_manager.cc:1434] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.002s
I20260709 12:56:56.725277  1731 tablet_bootstrap.cc:492] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:56.728716  1734 tablet_bootstrap.cc:654] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:56.729846  1732 tablet_bootstrap.cc:492] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:56.767416  1946 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:56.772558  1946 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.778756  1731 tablet_bootstrap.cc:654] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:56.778824  1912 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:56:56.835625  1946 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:56.837460  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:56.840435  1790 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:56.841251  1790 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:56:56.843187  1654 leader_election.cc:343] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:56.856814  1921 consensus_queue.cc:1048] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:56.859228  1734 tablet_bootstrap.cc:492] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:56.859970  1734 ts_tablet_manager.cc:1403] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.156s	user 0.006s	sys 0.007s
I20260709 12:56:56.863080  1613 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:56:56.866863  1734 raft_consensus.cc:359] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.876013  1691 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:56:56.874022  1734 raft_consensus.cc:385] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:56.879336  1790 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:56.884218  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:56.879607  1440 catalog_manager.cc:5697] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 0 to 2, leader changed from <none> to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:56.885731  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:56.886727  1691 raft_consensus.cc:2393] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 1: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:56:56.886250  1440 catalog_manager.cc:5697] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 0 to 1, leader changed from <none> to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:56.888132  1440 catalog_manager.cc:5697] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 0 to 1, leader changed from <none> to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:56.883749  1731 tablet_bootstrap.cc:492] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
W20260709 12:56:56.894251  1655 leader_election.cc:343] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:56.897898  1756 consensus_queue.cc:1048] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:56.900812  1655 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:56.901158  1731 ts_tablet_manager.cc:1403] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.176s	user 0.035s	sys 0.036s
I20260709 12:56:56.901765  1946 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:56.898732  1989 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:56:56.905763  1731 raft_consensus.cc:359] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.906920  1731 raft_consensus.cc:385] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:56.907230  1731 raft_consensus.cc:740] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:56.908020  1731 consensus_queue.cc:260] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.910127  1731 ts_tablet_manager.cc:1434] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:56:56.911581  1505 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:56:56.898300  1732 tablet_bootstrap.cc:654] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:56.911602  1731 tablet_bootstrap.cc:492] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:56.877544  1734 raft_consensus.cc:740] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:56.925483  1790 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:56.926187  1734 consensus_queue.cc:260] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.920888  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:56.926235  1790 raft_consensus.cc:697] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:56:56.936213  1790 consensus_queue.cc:237] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.937891  1734 ts_tablet_manager.cc:1434] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.077s	user 0.010s	sys 0.001s
I20260709 12:56:56.941147  1505 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:56.943908  1912 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:56.947983  1614 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:56:56.948522  1614 pending_rounds.cc:85] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f: Aborting all ops after (but not including) 1
I20260709 12:56:56.948889  1614 pending_rounds.cc:107] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:56:56.949242  1614 raft_consensus.cc:2889] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:56:56.959707  1734 tablet_bootstrap.cc:492] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:56.960651  1989 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:56:56.962920  1912 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:56.985834  1732 tablet_bootstrap.cc:492] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:56.986726  1732 ts_tablet_manager.cc:1403] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.257s	user 0.009s	sys 0.016s
I20260709 12:56:56.994804  1732 raft_consensus.cc:359] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:56.995555  1732 raft_consensus.cc:385] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:56.995826  1732 raft_consensus.cc:740] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:56.996502  1732 consensus_queue.cc:260] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.001654  1731 tablet_bootstrap.cc:654] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:56.998255  1732 ts_tablet_manager.cc:1434] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 12:56:57.004655  1756 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.005347  1756 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.012274  1732 tablet_bootstrap.cc:492] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:57.012780  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:57.013495  1686 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:56:57.017648  1921 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:57.019338  1734 tablet_bootstrap.cc:654] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.020396  1583 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:56:57.017055  1756 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:57.021504  1756 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:57.021878  1756 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:57.022238  1756 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.030148  1689 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:56:57.030439  1437 catalog_manager.cc:5697] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
W20260709 12:56:57.034670  1581 consensus_peers.cc:597] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:57.036132  1915 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:57.037237  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:57.038180  1541 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:56:57.040059  1732 tablet_bootstrap.cc:654] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.042055  1541 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:56:57.047686  1731 tablet_bootstrap.cc:492] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:57.048192  1731 ts_tablet_manager.cc:1403] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.137s	user 0.014s	sys 0.009s
I20260709 12:56:57.050830  1731 raft_consensus.cc:359] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.051538  1731 raft_consensus.cc:385] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.051813  1731 raft_consensus.cc:740] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.061782  1756 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.064013  1756 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:57.068935  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:57.069628  1686 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.071197  1922 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:56:57.074533  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:57.075477  1541 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.076982  1731 consensus_queue.cc:260] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.084312  1790 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.084947  1790 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.070250  1732 tablet_bootstrap.cc:492] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:57.090095  1946 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.090582  1732 ts_tablet_manager.cc:1403] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.079s	user 0.008s	sys 0.004s
I20260709 12:56:57.095000  1731 ts_tablet_manager.cc:1434] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.001s
I20260709 12:56:57.096259  1731 tablet_bootstrap.cc:492] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:57.096282  1756 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:57.096762  1732 raft_consensus.cc:359] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.097451  1732 raft_consensus.cc:385] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.097733  1732 raft_consensus.cc:740] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.098538  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:57.098969  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:57.101387  1732 consensus_queue.cc:260] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:56:57.103189  1505 leader_election.cc:343] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:56:57.103760  1508 leader_election.cc:343] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.103684  1946 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.104274  1508 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:57.105527  1732 ts_tablet_manager.cc:1434] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:56:57.109007  1946 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:57.104730  1790 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:57.110536  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:56:57.112140  1655 leader_election.cc:343] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.113603  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:57.116597  1989 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:56:57.117487  1654 leader_election.cc:343] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.117971  1654 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:57.119874  1946 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:57.124845  1734 tablet_bootstrap.cc:492] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:57.125356  1734 ts_tablet_manager.cc:1403] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.166s	user 0.013s	sys 0.008s
I20260709 12:56:57.133898  1734 raft_consensus.cc:359] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.134596  1734 raft_consensus.cc:385] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.135130  1734 raft_consensus.cc:740] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.135824  1734 consensus_queue.cc:260] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.138077  1734 ts_tablet_manager.cc:1434] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.005s
I20260709 12:56:57.139840  1732 tablet_bootstrap.cc:492] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:57.144719  1541 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:56:57.149746  1581 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:57.150771  1756 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:57.151304  1756 raft_consensus.cc:697] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:56:57.156350  1734 tablet_bootstrap.cc:492] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:57.159559  1922 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.160089  1922 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.155537  1686 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:56:57.164147  1922 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:57.166864  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:57.167758  1691 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:56:57.171367  1583 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:56:57.174275  1731 tablet_bootstrap.cc:654] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.174930  1972 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:57.152221  1756 consensus_queue.cc:237] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.175341  1972 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:57.179148  1972 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.185765  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:56:57.192809  1581 leader_election.cc:343] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.195478  1972 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.202682  1972 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:57.204744  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:56:57.206374  1581 leader_election.cc:343] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.199225  1922 consensus_queue.cc:1048] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:56:57.213624  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:57.218492  1972 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.219055  1972 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.222240  1691 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.224038  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:57.224575  1912 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.225054  1912 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.226040  1537 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:56:57.230165  1912 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:57.231019  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:57.231390  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:57.231727  1613 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
I20260709 12:56:57.233932  1731 tablet_bootstrap.cc:492] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
W20260709 12:56:57.234500  1508 leader_election.cc:343] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.232890  1581 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:57.234856  1972 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:57.234432  1731 ts_tablet_manager.cc:1403] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.138s	user 0.013s	sys 0.009s
I20260709 12:56:57.235124  1505 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:56:57.240428  1691 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:56:57.240725  2005 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:57.241181  2005 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:57.241549  2005 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.241922  1440 catalog_manager.cc:5697] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 0 to 1, leader changed from <none> to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:57.235894  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:57.242239  1912 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:57.246801  1912 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:57.247231  1912 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.247931  1583 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:57.256228  1921 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:56:57.256733  1583 leader_election.cc:343] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.258291  1921 raft_consensus.cc:697] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:56:57.261060  1921 consensus_queue.cc:237] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.263139  2005 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.265688  1732 tablet_bootstrap.cc:654] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.269604  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:57.270040  1731 raft_consensus.cc:359] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.270725  1731 raft_consensus.cc:385] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.271008  1731 raft_consensus.cc:740] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.271684  1731 consensus_queue.cc:260] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.273057  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:56:57.275161  1583 leader_election.cc:343] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.276854  1734 tablet_bootstrap.cc:654] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.260043  1922 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.279376  1922 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.281857  1922 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:57.265416  2005 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:57.284636  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:57.285315  1540 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:56:57.286559  1731 ts_tablet_manager.cc:1434] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.000s
I20260709 12:56:57.286882  1912 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.288050  1581 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:57.288952  1756 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:57.289335  1756 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:57.289422  1912 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:57.289736  1756 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.290311  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:57.291098  1613 raft_consensus.cc:2393] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 1: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:56:57.292799  1537 raft_consensus.cc:2393] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 1: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:56:57.293572  1731 tablet_bootstrap.cc:492] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:57.296718  1946 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.297605  1946 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.297835  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:56:57.299098  1508 leader_election.cc:343] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.299608  1508 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:57.299803  1946 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:57.300318  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:57.301039  1686 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:56:57.299134  1581 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:57.302203  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:57.303347  1912 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:56:57.307345  1654 leader_election.cc:343] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.309533  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:56:57.311079  1655 leader_election.cc:343] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.303997  2005 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:56:57.312232  1655 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:57.314757  1946 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:57.319604  1756 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.327385  1732 tablet_bootstrap.cc:492] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:57.327898  1732 ts_tablet_manager.cc:1403] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.188s	user 0.011s	sys 0.005s
I20260709 12:56:57.329644  1756 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:57.331161  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:57.331835  1686 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.334506  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:57.335175  1537 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.337445  1732 raft_consensus.cc:359] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.338189  1732 raft_consensus.cc:385] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.338459  1732 raft_consensus.cc:740] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.339191  1732 consensus_queue.cc:260] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.339491  1686 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:56:57.341527  1732 ts_tablet_manager.cc:1434] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:56:57.345906  1734 tablet_bootstrap.cc:492] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:57.347663  1734 ts_tablet_manager.cc:1403] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.202s	user 0.015s	sys 0.001s
I20260709 12:56:57.348894  1537 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:56:57.350769  1583 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:56:57.352567  1734 raft_consensus.cc:359] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.353276  1734 raft_consensus.cc:385] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.353559  1734 raft_consensus.cc:740] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.354343  1734 consensus_queue.cc:260] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.355113  1731 tablet_bootstrap.cc:654] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.355626  1440 catalog_manager.cc:5697] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 0 to 1, leader changed from <none> to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:57.356750  1732 tablet_bootstrap.cc:492] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:57.357779  2005 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:57.358289  2005 raft_consensus.cc:697] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:56:57.359761  1734 ts_tablet_manager.cc:1434] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:56:57.359103  2005 consensus_queue.cc:237] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.375772  1731 tablet_bootstrap.cc:492] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:57.376362  1731 ts_tablet_manager.cc:1403] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.083s	user 0.015s	sys 0.005s
I20260709 12:56:57.379204  1734 tablet_bootstrap.cc:492] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:57.381115  1731 raft_consensus.cc:359] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.381711  1731 raft_consensus.cc:385] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.381914  1731 raft_consensus.cc:740] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.390051  1440 catalog_manager.cc:5697] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 0 to 1, leader changed from <none> to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:57.392730  1732 tablet_bootstrap.cc:654] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.392530  1731 consensus_queue.cc:260] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.395164  1731 ts_tablet_manager.cc:1434] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:56:57.396234  1731 tablet_bootstrap.cc:492] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:57.405359  1731 tablet_bootstrap.cc:654] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.424113  1734 tablet_bootstrap.cc:654] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.438506  1734 tablet_bootstrap.cc:492] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:57.439054  1734 ts_tablet_manager.cc:1403] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.003s
I20260709 12:56:57.440117  1731 tablet_bootstrap.cc:492] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:57.440594  1731 ts_tablet_manager.cc:1403] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.005s
I20260709 12:56:57.443147  1731 raft_consensus.cc:359] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.443821  1731 raft_consensus.cc:385] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.444087  1731 raft_consensus.cc:740] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.444761  1731 consensus_queue.cc:260] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.438588  1732 tablet_bootstrap.cc:492] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:57.445827  1732 ts_tablet_manager.cc:1403] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.103s	user 0.004s	sys 0.017s
I20260709 12:56:57.446130  1734 raft_consensus.cc:359] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.446867  1734 raft_consensus.cc:385] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.447130  1734 raft_consensus.cc:740] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.447928  1734 consensus_queue.cc:260] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.448601  1732 raft_consensus.cc:359] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.449236  1732 raft_consensus.cc:385] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.449502  1732 raft_consensus.cc:740] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.450135  1732 consensus_queue.cc:260] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.452515  1732 ts_tablet_manager.cc:1434] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:56:57.458227  1732 tablet_bootstrap.cc:492] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:57.465689  1731 ts_tablet_manager.cc:1434] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 12:56:57.473605  1731 tablet_bootstrap.cc:492] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:57.476030  1732 tablet_bootstrap.cc:654] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.483554  1734 ts_tablet_manager.cc:1434] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.002s
I20260709 12:56:57.486657  1731 tablet_bootstrap.cc:654] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.493407  1734 tablet_bootstrap.cc:492] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:57.495275  1732 tablet_bootstrap.cc:492] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:57.495820  1732 ts_tablet_manager.cc:1403] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.004s
I20260709 12:56:57.502813  1732 raft_consensus.cc:359] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.509285  1732 raft_consensus.cc:385] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.509680  1732 raft_consensus.cc:740] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.507138  1734 tablet_bootstrap.cc:654] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.508849  1731 tablet_bootstrap.cc:492] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:57.510505  1731 ts_tablet_manager.cc:1403] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.000s
I20260709 12:56:57.510424  1537 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.514309  1732 consensus_queue.cc:260] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.516580  1732 ts_tablet_manager.cc:1434] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.002s
I20260709 12:56:57.520710  1732 tablet_bootstrap.cc:492] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:57.513700  1731 raft_consensus.cc:359] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.521728  1731 raft_consensus.cc:385] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.522069  1731 raft_consensus.cc:740] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.522985  1731 consensus_queue.cc:260] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.524617  1731 ts_tablet_manager.cc:1434] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:56:57.525695  1731 tablet_bootstrap.cc:492] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:57.530061  1790 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.530635  1790 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.534792  1732 tablet_bootstrap.cc:654] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.539110  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:57.542997  1734 tablet_bootstrap.cc:492] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:57.543450  1734 ts_tablet_manager.cc:1403] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.001s
I20260709 12:56:57.548364  1734 raft_consensus.cc:359] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.549113  1734 raft_consensus.cc:385] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.549386  1734 raft_consensus.cc:740] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.550019  1734 consensus_queue.cc:260] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.552119  1734 ts_tablet_manager.cc:1434] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
W20260709 12:56:57.539567  1488 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:56:57.552695  1731 tablet_bootstrap.cc:654] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.558915  1537 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.561930  1686 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.568081  1734 tablet_bootstrap.cc:492] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:57.577359  1912 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:57.591741  1790 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:57.592008  1734 tablet_bootstrap.cc:654] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.592829  1790 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:57.593591  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:57.601121  1921 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:57.601302  1508 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:57.621621  1734 tablet_bootstrap.cc:492] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:57.622512  1734 ts_tablet_manager.cc:1403] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.000s
I20260709 12:56:57.633394  1734 raft_consensus.cc:359] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.635548  1734 raft_consensus.cc:385] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.635929  1734 raft_consensus.cc:740] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.635391  1790 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.637794  1731 tablet_bootstrap.cc:492] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:57.638849  1731 ts_tablet_manager.cc:1403] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.113s	user 0.027s	sys 0.011s
I20260709 12:56:57.638489  1790 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.641204  1731 raft_consensus.cc:359] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.641950  1731 raft_consensus.cc:385] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.642210  1731 raft_consensus.cc:740] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.642508  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:57.642846  1731 consensus_queue.cc:260] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.643596  1921 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:56:57.644143  1505 leader_election.cc:343] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.641151  1790 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:57.638188  1732 tablet_bootstrap.cc:492] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:57.645627  1732 ts_tablet_manager.cc:1403] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.125s	user 0.021s	sys 0.000s
I20260709 12:56:57.647428  1731 ts_tablet_manager.cc:1434] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:56:57.649041  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:57.650243  1912 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:57.650650  1734 consensus_queue.cc:260] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.656713  1734 ts_tablet_manager.cc:1434] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 12:56:57.657811  1734 tablet_bootstrap.cc:492] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:57.661288  1946 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.661928  1946 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.664423  1946 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:57.666885  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:57.669286  1731 tablet_bootstrap.cc:492] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
W20260709 12:56:57.669819  1655 leader_election.cc:343] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.673077  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:56:57.674448  1654 leader_election.cc:343] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.674911  1654 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:57.676003  1946 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:56:57.667718  1508 leader_election.cc:343] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.677551  1508 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:57.678654  1912 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:57.652602  1732 raft_consensus.cc:359] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.680827  1732 raft_consensus.cc:385] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.681180  1732 raft_consensus.cc:740] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.681972  1732 consensus_queue.cc:260] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.684964  1732 ts_tablet_manager.cc:1434] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:56:57.686030  1732 tablet_bootstrap.cc:492] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:57.698668  1989 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.699474  1734 tablet_bootstrap.cc:654] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.699195  1989 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.701609  1989 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:57.703083  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:57.707741  1731 tablet_bootstrap.cc:654] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.708640  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:57.709468  1688 raft_consensus.cc:2393] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 1: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:56:57.722626  1732 tablet_bootstrap.cc:654] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.725363  1508 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:57.732924  1912 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.733611  1731 tablet_bootstrap.cc:492] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:57.734093  1731 ts_tablet_manager.cc:1403] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.068s	user 0.002s	sys 0.016s
I20260709 12:56:57.736683  1731 raft_consensus.cc:359] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.737360  1731 raft_consensus.cc:385] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.737627  1731 raft_consensus.cc:740] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.738207  1731 consensus_queue.cc:260] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.739456  1912 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:57.731630  1734 tablet_bootstrap.cc:492] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:57.740770  1734 ts_tablet_manager.cc:1403] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.083s	user 0.014s	sys 0.006s
I20260709 12:56:57.741009  1732 tablet_bootstrap.cc:492] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:57.741472  1732 ts_tablet_manager.cc:1403] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.056s	user 0.008s	sys 0.005s
I20260709 12:56:57.743232  1734 raft_consensus.cc:359] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.744104  1734 raft_consensus.cc:385] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.744511  1734 raft_consensus.cc:740] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.745149  1734 consensus_queue.cc:260] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.747104  1734 ts_tablet_manager.cc:1434] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:56:57.740306  1731 ts_tablet_manager.cc:1434] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.001s
I20260709 12:56:57.748131  1731 tablet_bootstrap.cc:492] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:57.743897  1732 raft_consensus.cc:359] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.748855  1732 raft_consensus.cc:385] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.749156  1732 raft_consensus.cc:740] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.749364  1734 tablet_bootstrap.cc:492] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:57.749822  1732 consensus_queue.cc:260] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.755415  1732 ts_tablet_manager.cc:1434] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.005s
I20260709 12:56:57.756407  1732 tablet_bootstrap.cc:492] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:57.759675  1731 tablet_bootstrap.cc:654] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.764261  1734 tablet_bootstrap.cc:654] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.769609  1732 tablet_bootstrap.cc:654] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.773306  1915 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.773914  1915 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.777232  1915 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:57.777634  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:57.779474  1731 tablet_bootstrap.cc:492] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:57.779973  1731 ts_tablet_manager.cc:1403] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.032s	user 0.004s	sys 0.008s
I20260709 12:56:57.780164  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:56:57.781774  1581 leader_election.cc:343] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.782531  1731 raft_consensus.cc:359] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:56:57.782876  1583 leader_election.cc:343] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.783211  1731 raft_consensus.cc:385] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.783298  1583 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:57.783514  1731 raft_consensus.cc:740] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.784327  1731 consensus_queue.cc:260] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.785477  1921 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:57.785835  1731 ts_tablet_manager.cc:1434] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 12:56:57.786751  1731 tablet_bootstrap.cc:492] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:57.791239  1734 tablet_bootstrap.cc:492] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:57.791749  1734 ts_tablet_manager.cc:1403] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.003s
I20260709 12:56:57.792461  1731 tablet_bootstrap.cc:654] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.799081  1732 tablet_bootstrap.cc:492] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:57.794334  1734 raft_consensus.cc:359] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.800316  1734 raft_consensus.cc:385] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.800603  1734 raft_consensus.cc:740] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.801285  1734 consensus_queue.cc:260] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.803262  1734 ts_tablet_manager.cc:1434] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 12:56:57.799592  1732 ts_tablet_manager.cc:1403] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.004s
I20260709 12:56:57.804272  1734 tablet_bootstrap.cc:492] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:57.807840  1732 raft_consensus.cc:359] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.808540  1732 raft_consensus.cc:385] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.808825  1732 raft_consensus.cc:740] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.809805  1734 tablet_bootstrap.cc:654] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.809439  1732 consensus_queue.cc:260] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.811534  1732 ts_tablet_manager.cc:1434] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:56:57.817611  1732 tablet_bootstrap.cc:492] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:57.822821  1734 tablet_bootstrap.cc:492] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:57.823309  1734 ts_tablet_manager.cc:1403] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 12:56:57.825949  1734 raft_consensus.cc:359] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.826675  1734 raft_consensus.cc:385] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.825795  1732 tablet_bootstrap.cc:654] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.828954  1731 tablet_bootstrap.cc:492] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:57.829413  1731 ts_tablet_manager.cc:1403] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.003s
I20260709 12:56:57.830133  1921 consensus_queue.cc:1048] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:57.831966  1731 raft_consensus.cc:359] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.832661  1731 raft_consensus.cc:385] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:57.832938  1731 raft_consensus.cc:740] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.833557  1731 consensus_queue.cc:260] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.835718  1731 ts_tablet_manager.cc:1434] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:56:57.826969  1734 raft_consensus.cc:740] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:57.836505  1734 consensus_queue.cc:260] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.838038  1734 ts_tablet_manager.cc:1434] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:56:57.839069  1734 tablet_bootstrap.cc:492] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:57.845080  1731 tablet_bootstrap.cc:492] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:57.848675  1915 consensus_queue.cc:1048] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:57.851965  1731 tablet_bootstrap.cc:654] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.855481  1734 tablet_bootstrap.cc:654] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:57.859576  1915 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.860321  1915 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.863883  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:56:57.866127  1581 leader_election.cc:343] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.869143  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:57.869927  1691 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:56:57.870561  1915 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:57.871446  1583 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:57.872339  1915 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:57.872826  1915 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:57.873242  1915 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.873148  1921 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:57.888833  1915 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.893615  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:56:57.895430  1581 leader_election.cc:343] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.899389  1915 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:57.903244  1756 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:57.920899  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:57.922381  1691 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.927121  1804 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.927780  1804 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.931118  1804 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:57.940790  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:57.941073  1912 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.941701  1537 raft_consensus.cc:2393] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 1: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:56:57.941568  1912 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.946652  2005 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.950145  1691 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:56:57.950299  2005 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.950845  1912 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:57.953440  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:57.954208  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:57.954923  1617 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
W20260709 12:56:57.957612  1581 leader_election.cc:343] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.957777  1505 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:57.959017  2005 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:57.945392  1946 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.961182  1583 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:57.965807  2027 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.965967  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:57.959193  1989 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:57.966403  2027 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.966979  1989 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:57.967393  1989 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.969761  2027 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:57.971606  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:57.972657  1691 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
W20260709 12:56:57.973385  1505 leader_election.cc:343] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.961753  1946 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.965359  2005 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:57.974490  2005 raft_consensus.cc:697] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:56:57.975703  1946 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:57.976231  1946 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:57.976398  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:57.976708  1946 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.977080  1537 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 0.
I20260709 12:56:57.976997  2005 consensus_queue.cc:237] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.978413  1655 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:57.978943  1946 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:57.979171  1804 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:57.979574  1804 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:57.979898  1804 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.980223  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:56:57.981707  1655 leader_election.cc:343] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:57.982577  1989 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:57.986479  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:57.986615  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:57.986755  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:57.987208  1614 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 0.
I20260709 12:56:57.987649  1617 raft_consensus.cc:2393] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 1: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:56:57.988790  1583 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:57.990163  1756 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:57.990509  1756 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:57.990828  1756 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:57.992527  1732 tablet_bootstrap.cc:492] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:57.993011  1732 ts_tablet_manager.cc:1403] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.176s	user 0.028s	sys 0.049s
I20260709 12:56:57.993621  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:57.987213  1691 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
I20260709 12:56:57.994372  1613 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 0.
I20260709 12:56:57.998867  1756 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.004130  1756 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:58.005296  1989 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:58.005437  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:58.009234  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:56:58.015597  1581 leader_election.cc:343] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:58.016031  1731 tablet_bootstrap.cc:492] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:58.016548  1731 ts_tablet_manager.cc:1403] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.172s	user 0.038s	sys 0.023s
I20260709 12:56:58.007022  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:58.017846  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:58.017900  1615 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:58.019733  1731 raft_consensus.cc:359] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.020853  1731 raft_consensus.cc:385] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:58.013545  1688 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:58.021152  1731 raft_consensus.cc:740] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:58.021929  1731 consensus_queue.cc:260] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.023888  1731 ts_tablet_manager.cc:1434] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:56:58.025161  1731 tablet_bootstrap.cc:492] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:58.028825  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:58.030925  1734 tablet_bootstrap.cc:492] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:58.031455  1734 ts_tablet_manager.cc:1403] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.193s	user 0.047s	sys 0.044s
I20260709 12:56:58.031610  1732 raft_consensus.cc:359] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.032271  1732 raft_consensus.cc:385] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:58.032562  1732 raft_consensus.cc:740] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:58.033202  1691 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:58.039554  1732 consensus_queue.cc:260] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.033736  1688 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:56:58.041165  1691 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:56:58.041678  1583 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:58.045137  1732 ts_tablet_manager.cc:1434] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.049s	user 0.004s	sys 0.002s
I20260709 12:56:58.050459  1654 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:58.029915  1804 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:56:58.051245  1508 leader_election.cc:343] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:58.052321  1756 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:58.053282  1756 raft_consensus.cc:697] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:56:58.053942  1756 consensus_queue.cc:237] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.055457  1912 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:58.058899  2046 raft_consensus.cc:2764] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:56:58.061028  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:58.061623  1541 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:58.062749  2005 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:58.063329  2005 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.053153  1508 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:58.062196  1734 raft_consensus.cc:359] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.065657  1734 raft_consensus.cc:385] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:58.065949  1734 raft_consensus.cc:740] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:58.066193  1912 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.068799  1912 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:58.069152  1989 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:58.069676  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:58.069360  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:58.070191  2005 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:58.070694  1613 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
I20260709 12:56:58.071499  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:58.071949  1505 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:58.071226  1734 consensus_queue.cc:260] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.072746  1912 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:58.081992  1732 tablet_bootstrap.cc:492] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:58.081779  1691 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:56:58.060833  1654 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:58.088430  2046 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:58.089367  1734 ts_tablet_manager.cc:1434] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.002s
I20260709 12:56:58.083168  2005 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:58.083258  1912 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:58.090997  1583 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:56:58.092301  1756 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:58.092676  1756 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:58.093218  1756 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:58.096398  1734 tablet_bootstrap.cc:492] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:58.092867  1912 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:58.100880  1508 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:58.111419  1922 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:58.111958  1922 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.092731  1804 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:58.093122  2005 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.092661  1438 catalog_manager.cc:5697] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 0 to 1, leader changed from <none> to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:58.130964  1731 tablet_bootstrap.cc:654] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:58.116808  2026 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:58.132907  1756 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.134287  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:58.134788  1756 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:58.134858  2026 raft_consensus.cc:697] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:56:58.142392  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:58.143148  1688 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:58.144794  1541 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:56:58.132382  2046 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:58.146134  2005 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:58.147665  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:58.143180  1615 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:56:58.141131  1922 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:58.154126  1655 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:58.157570  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:58.158258  1541 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:56:58.158614  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:58.159237  1538 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:56:58.159276  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:58.162801  1581 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:58.163713  1922 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:58.164798  1922 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:58.165170  1922 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:58.135797  2026 consensus_queue.cc:237] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.180765  2046 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:58.134996  1691 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:56:58.181727  2046 raft_consensus.cc:697] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:56:58.182657  2046 consensus_queue.cc:237] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.184160  1922 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.164171  1581 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:56:58.187873  1583 leader_election.cc:343] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:58.189076  1921 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:58.189798  1921 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:58.193632  1921 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:58.195173  1731 tablet_bootstrap.cc:492] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:58.200292  1731 ts_tablet_manager.cc:1403] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.175s	user 0.004s	sys 0.022s
I20260709 12:56:58.187664  1912 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.192958  1688 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:56:58.192364  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:58.204020  1921 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.206979  1921 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:58.207403  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:58.208010  1539 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:58.208254  1583 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:58.209262  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:56:58.211026  1583 leader_election.cc:343] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:58.215890  1734 tablet_bootstrap.cc:654] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:58.215610  1731 raft_consensus.cc:359] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.216286  1731 raft_consensus.cc:385] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:58.216569  1731 raft_consensus.cc:740] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:58.217352  1731 consensus_queue.cc:260] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.223623  1804 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:58.209316  1921 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:58.224177  1804 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.224617  1921 raft_consensus.cc:697] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:56:58.225436  1921 consensus_queue.cc:237] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.226204  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:58.226862  1615 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:58.227314  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:58.227912  1617 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 0.
I20260709 12:56:58.226346  1804 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:58.228999  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:58.229622  1538 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 0.
I20260709 12:56:58.231290  1539 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:56:58.231597  1655 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:58.233233  2049 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:58.233584  2049 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:58.233898  2049 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:58.229918  1731 ts_tablet_manager.cc:1434] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:56:58.236137  1731 tablet_bootstrap.cc:492] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:58.236172  1615 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:56:58.236989  1581 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:56:58.237931  2052 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:58.238390  2052 raft_consensus.cc:697] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:56:58.239171  2052 consensus_queue.cc:237] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.258216  1440 catalog_manager.cc:5697] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:58.287010  2027 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:58.289479  2027 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.297766  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:58.376516  1537 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 1: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:56:58.376796  1922 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:58.394217  1732 tablet_bootstrap.cc:654] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:58.378557  2049 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.405501  1912 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:58.407114  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:58.405537  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:58.407989  1687 raft_consensus.cc:2393] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 1: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:56:58.411015  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:58.411633  1685 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:58.412635  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:58.413419  1538 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:58.415324  1508 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:58.401609  2027 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:58.423604  2049 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:58.420024  1912 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:58.432169  2056 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:58.426507  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:58.432780  2056 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.434640  1539 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:58.442516  1685 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:56:58.445606  2056 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:58.447139  1583 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:56:58.449008  1922 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:58.448808  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:58.449536  1922 raft_consensus.cc:697] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:56:58.450518  1508 leader_election.cc:343] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:58.450387  1922 consensus_queue.cc:237] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.454054  1539 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:56:58.454686  1915 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:58.463255  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:58.464083  1687 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 1: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:56:58.463515  1437 catalog_manager.cc:5697] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:58.465523  1508 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:58.456960  1538 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:56:58.460215  1912 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:58.467736  2056 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:56:58.480650  1655 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:58.481653  2046 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:58.482153  2046 raft_consensus.cc:697] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:56:58.482856  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:58.483685  1617 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:58.485363  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:58.482968  2046 consensus_queue.cc:237] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:56:58.493000  1505 leader_election.cc:343] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:58.493553  1505 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:58.495889  2056 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:58.515081  1731 tablet_bootstrap.cc:654] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:58.519793  1734 tablet_bootstrap.cc:492] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:58.520319  1734 ts_tablet_manager.cc:1403] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.424s	user 0.016s	sys 0.003s
I20260709 12:56:58.541069  1617 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:56:58.546669  1734 raft_consensus.cc:359] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.548694  1440 catalog_manager.cc:5697] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:58.548102  1734 raft_consensus.cc:385] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:58.553318  1734 raft_consensus.cc:740] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:58.554124  1734 consensus_queue.cc:260] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.552846  2005 consensus_queue.cc:1048] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:56:58.557654  1732 tablet_bootstrap.cc:492] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:58.558138  1732 ts_tablet_manager.cc:1403] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.501s	user 0.017s	sys 0.024s
I20260709 12:56:58.568214  1734 ts_tablet_manager.cc:1434] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.048s	user 0.003s	sys 0.004s
I20260709 12:56:58.570814  1734 tablet_bootstrap.cc:492] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:58.582307  1437 catalog_manager.cc:5697] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 0 to 1, leader changed from <none> to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:58.584725  1437 catalog_manager.cc:5697] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 0 to 1, leader changed from <none> to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:58.586979  1437 catalog_manager.cc:5697] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 0 to 1, leader changed from <none> to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:58.590799  1732 raft_consensus.cc:359] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.589900  1437 catalog_manager.cc:5697] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 0 to 1, leader changed from <none> to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:58.591683  1732 raft_consensus.cc:385] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:58.591985  1732 raft_consensus.cc:740] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:58.592818  1732 consensus_queue.cc:260] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.593329  1731 tablet_bootstrap.cc:492] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:58.604321  1731 ts_tablet_manager.cc:1403] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.368s	user 0.010s	sys 0.024s
I20260709 12:56:58.605509  1921 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:58.607561  1732 ts_tablet_manager.cc:1434] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 12:56:58.615476  1731 raft_consensus.cc:359] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.625214  1731 raft_consensus.cc:385] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:58.628688  1731 raft_consensus.cc:740] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:58.630900  2046 consensus_queue.cc:1048] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:58.629616  1731 consensus_queue.cc:260] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:56:58.625285  1581 consensus_peers.cc:597] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:58.634336  1731 ts_tablet_manager.cc:1434] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:56:58.635983  1731 tablet_bootstrap.cc:492] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:58.623735  1734 tablet_bootstrap.cc:654] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:58.649876  1732 tablet_bootstrap.cc:492] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:58.651162  2057 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:56:58.656032  1488 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:56:58.661942  1732 tablet_bootstrap.cc:654] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:58.683036  1804 consensus_queue.cc:1048] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:58.685348  2056 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:58.692904  1731 tablet_bootstrap.cc:654] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:58.699478  1921 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:58.706979  1921 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.709129  1921 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:58.716342  1734 tablet_bootstrap.cc:492] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:58.716838  1734 ts_tablet_manager.cc:1403] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.148s	user 0.019s	sys 0.018s
I20260709 12:56:58.721051  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:58.723368  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:58.731693  1537 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:56:58.733409  1581 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:58.734134  1915 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:56:58.734331  1583 leader_election.cc:343] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:58.734529  1915 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:58.734879  1915 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:58.742223  1915 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.747146  1915 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:58.748852  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:56:58.750245  1583 leader_election.cc:343] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:58.754518  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:58.756820  1537 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:58.756976  1731 tablet_bootstrap.cc:492] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:58.757577  1731 ts_tablet_manager.cc:1403] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.122s	user 0.007s	sys 0.010s
I20260709 12:56:58.742247  1734 raft_consensus.cc:359] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.758812  1734 raft_consensus.cc:385] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:58.759115  1734 raft_consensus.cc:740] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:58.759294  1732 tablet_bootstrap.cc:492] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:58.759662  1732 ts_tablet_manager.cc:1403] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.151s	user 0.012s	sys 0.005s
I20260709 12:56:58.760577  1731 raft_consensus.cc:359] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.761258  1731 raft_consensus.cc:385] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:58.762375  1732 raft_consensus.cc:359] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.763177  1732 raft_consensus.cc:385] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:58.768606  1732 raft_consensus.cc:740] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:58.759763  1734 consensus_queue.cc:260] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.770437  1731 raft_consensus.cc:740] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:58.771692  1734 ts_tablet_manager.cc:1434] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.055s	user 0.004s	sys 0.001s
I20260709 12:56:58.769450  1732 consensus_queue.cc:260] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.773306  1734 tablet_bootstrap.cc:492] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:58.777719  2052 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:58.780812  1921 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:58.781137  1912 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:58.781899  1912 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.785526  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:58.786929  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:58.771677  1731 consensus_queue.cc:260] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.790263  1508 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:58.791041  1912 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:58.792356  2057 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:58.777741  1732 ts_tablet_manager.cc:1434] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:56:58.796802  1731 ts_tablet_manager.cc:1434] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 12:56:58.798149  1731 tablet_bootstrap.cc:492] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:58.803262  1537 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:56:58.804955  1581 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:56:58.806015  2052 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:58.806551  2052 raft_consensus.cc:697] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:56:58.807497  1734 tablet_bootstrap.cc:654] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:58.807385  2052 consensus_queue.cc:237] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.809660  1732 tablet_bootstrap.cc:492] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:58.811445  1804 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:58.811966  1804 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.816118  1804 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:58.817761  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:58.818451  1539 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 0.
I20260709 12:56:58.819809  1732 tablet_bootstrap.cc:654] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:58.821144  1655 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:58.822135  2049 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:58.822480  2049 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:58.822810  2049 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:58.825168  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:58.825963  1614 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 0.
I20260709 12:56:58.830789  1734 tablet_bootstrap.cc:492] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:58.840261  2049 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.844848  1734 ts_tablet_manager.cc:1403] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.072s	user 0.014s	sys 0.000s
I20260709 12:56:58.847489  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:58.847970  1734 raft_consensus.cc:359] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.848711  1542 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:58.849144  1734 raft_consensus.cc:385] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:58.849448  1734 raft_consensus.cc:740] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:58.850107  1734 consensus_queue.cc:260] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.851850  1731 tablet_bootstrap.cc:654] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:58.852146  1734 ts_tablet_manager.cc:1434] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:56:58.854184  1734 tablet_bootstrap.cc:492] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:58.864504  1732 tablet_bootstrap.cc:492] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:58.864982  1732 ts_tablet_manager.cc:1403] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.025s
I20260709 12:56:58.867256  2049 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:58.868829  1542 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:56:58.870434  1732 raft_consensus.cc:359] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.871131  1732 raft_consensus.cc:385] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:58.871380  1732 raft_consensus.cc:740] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:58.872258  1732 consensus_queue.cc:260] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.868031  1734 tablet_bootstrap.cc:654] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:58.868216  1731 tablet_bootstrap.cc:492] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:58.874176  1731 ts_tablet_manager.cc:1403] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.076s	user 0.019s	sys 0.000s
I20260709 12:56:58.876807  1731 raft_consensus.cc:359] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.877468  1731 raft_consensus.cc:385] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:58.877717  1731 raft_consensus.cc:740] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:58.878310  1731 consensus_queue.cc:260] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.870461  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:58.880141  1614 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:58.880293  1731 ts_tablet_manager.cc:1434] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:56:58.870474  1655 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:58.881070  1732 ts_tablet_manager.cc:1434] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260709 12:56:58.882071  1732 tablet_bootstrap.cc:492] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:58.884296  2049 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:58.883132  1440 catalog_manager.cc:5697] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 0 to 1, leader changed from <none> to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:58.887614  1732 tablet_bootstrap.cc:654] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:58.887739  2049 raft_consensus.cc:697] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:56:58.888831  2049 consensus_queue.cc:237] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.890924  1731 tablet_bootstrap.cc:492] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:58.904160  1731 tablet_bootstrap.cc:654] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:58.896559  1732 tablet_bootstrap.cc:492] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:58.908026  1732 ts_tablet_manager.cc:1403] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.026s	user 0.006s	sys 0.004s
I20260709 12:56:58.910157  1734 tablet_bootstrap.cc:492] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:58.910658  1734 ts_tablet_manager.cc:1403] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.057s	user 0.008s	sys 0.002s
I20260709 12:56:58.910658  1732 raft_consensus.cc:359] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.911533  1732 raft_consensus.cc:385] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:58.911823  1732 raft_consensus.cc:740] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:58.912497  1732 consensus_queue.cc:260] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.913375  1734 raft_consensus.cc:359] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.914077  1734 raft_consensus.cc:385] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:58.914356  1734 raft_consensus.cc:740] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:58.914994  1734 consensus_queue.cc:260] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.917034  1734 ts_tablet_manager.cc:1434] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:56:58.918089  1734 tablet_bootstrap.cc:492] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:58.920727  1756 consensus_queue.cc:1048] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:58.921054  1731 tablet_bootstrap.cc:492] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:58.921535  1731 ts_tablet_manager.cc:1403] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.001s
I20260709 12:56:58.924172  1731 raft_consensus.cc:359] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.924863  1731 raft_consensus.cc:385] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:58.925140  1731 raft_consensus.cc:740] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:58.925724  1731 consensus_queue.cc:260] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.926245  1734 tablet_bootstrap.cc:654] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:58.919190  1732 ts_tablet_manager.cc:1434] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:56:58.928956  1732 tablet_bootstrap.cc:492] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:58.927737  1731 ts_tablet_manager.cc:1434] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:56:58.932880  1731 tablet_bootstrap.cc:492] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:58.938190  1804 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:58.939352  2057 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:58.939864  2057 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.942442  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:58.943065  1617 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:56:58.944325  1732 tablet_bootstrap.cc:654] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:58.944185  1505 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:58.945462  1912 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:56:58.945837  1912 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:58.946161  1912 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:58.946336  1614 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:56:58.952824  1731 tablet_bootstrap.cc:654] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:58.953155  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:58.955322  1685 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:56:58.953663  2057 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:58.958416  1912 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:58.962615  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:58.963194  1617 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:58.965204  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:58.965795  1685 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:56:58.977542  2046 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:58.998791  1617 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:56:58.999912  1505 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:59.004678  1685 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:56:59.012665  2026 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:56:59.022405  2026 raft_consensus.cc:697] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:56:59.023339  2026 consensus_queue.cc:237] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.026885  1732 tablet_bootstrap.cc:492] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:59.027580  1732 ts_tablet_manager.cc:1403] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.099s	user 0.022s	sys 0.008s
I20260709 12:56:59.027709  2005 consensus_queue.cc:1048] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:59.034674  1734 tablet_bootstrap.cc:492] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:59.035277  1734 ts_tablet_manager.cc:1403] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.117s	user 0.026s	sys 0.004s
W20260709 12:56:59.038856  1583 consensus_peers.cc:597] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f -> Peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Couldn't send request to peer 4487a53c51be4634bf1ef29c5248353d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:59.040009  1734 raft_consensus.cc:359] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.043183  1734 raft_consensus.cc:385] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:59.044128  1734 raft_consensus.cc:740] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:59.045893  1734 consensus_queue.cc:260] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.049081  1734 ts_tablet_manager.cc:1434] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:56:59.041544  1732 raft_consensus.cc:359] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.011976  1437 catalog_manager.cc:5697] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:59.051430  1732 raft_consensus.cc:385] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:59.051798  1732 raft_consensus.cc:740] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:59.052640  1732 consensus_queue.cc:260] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.054747  1732 ts_tablet_manager.cc:1434] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:56:59.016465  1912 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:59.059358  1542 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:59.058104  1734 tablet_bootstrap.cc:492] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:59.059599  1732 tablet_bootstrap.cc:492] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:59.075903  1731 tablet_bootstrap.cc:492] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:59.099485  1731 ts_tablet_manager.cc:1403] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.167s	user 0.031s	sys 0.010s
I20260709 12:56:59.060051  2056 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:59.109035  2056 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.111418  2056 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:59.089939  1756 consensus_queue.cc:1048] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:59.076102  2005 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:59.114018  2005 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.117345  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:59.118006  1687 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:56:59.118302  2005 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:59.119230  1583 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:56:59.120087  2005 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:59.120455  2005 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:59.120802  2005 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:59.117930  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:59.122711  1617 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
I20260709 12:56:59.124104  1505 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:59.126459  1731 raft_consensus.cc:359] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.144608  1731 raft_consensus.cc:385] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:59.127940  2098 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:59.144939  1731 raft_consensus.cc:740] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:59.145602  1731 consensus_queue.cc:260] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.149061  2098 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:59.149492  2098 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:56:59.131107  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 50218us
I20260709 12:56:59.137051  1734 tablet_bootstrap.cc:654] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:59.140187  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:59.159143  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:59.159694  2098 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.165429  2098 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:59.142191  2005 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.168421  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:59.169071  1617 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:59.169389  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:59.169972  1687 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:59.175825  1617 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:56:59.177070  1505 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:59.168390  2005 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:59.178864  2057 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:59.180006  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:59.176095  1732 tablet_bootstrap.cc:654] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
W20260709 12:56:59.182003  1508 leader_election.cc:343] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:56:59.190347  1508 leader_election.cc:343] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:59.187529  2057 raft_consensus.cc:697] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:56:59.183179  1731 ts_tablet_manager.cc:1434] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.083s	user 0.004s	sys 0.003s
I20260709 12:56:59.190711  1438 catalog_manager.cc:5697] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 0 to 2, leader changed from <none> to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:59.191650  1731 tablet_bootstrap.cc:492] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:59.191360  2057 consensus_queue.cc:237] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:56:59.195632  1581 leader_election.cc:343] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:59.197492  2098 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:59.198004  2098 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.198392  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:59.203652  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:59.203409  2098 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:56:59.205322  1505 leader_election.cc:343] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:59.212028  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:56:59.220811  1581 leader_election.cc:343] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:59.229655  1915 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:59.230222  1915 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:56:59.232525  1508 leader_election.cc:343] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:59.232820  2046 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:59.234053  1508 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:59.239362  2026 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:59.239564  2046 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.245769  1731 tablet_bootstrap.cc:654] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:59.246358  2046 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:59.248086  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:59.248243  1915 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:59.250036  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:59.250769  1617 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 0.
I20260709 12:56:59.252007  1654 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:56:59.252848  2046 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:59.253212  2046 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:59.253533  2046 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:59.258713  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:59.259899  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:59.239763  1687 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:56:59.261303  2005 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:56:59.263963  1655 leader_election.cc:343] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:59.264878  1583 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:59.266204  2005 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:59.266665  2005 raft_consensus.cc:697] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:56:59.267467  2005 consensus_queue.cc:237] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.269058  1687 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:59.271076  1437 catalog_manager.cc:5697] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
W20260709 12:56:59.272552  1581 leader_election.cc:343] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:59.275159  1732 tablet_bootstrap.cc:492] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:59.275733  1732 ts_tablet_manager.cc:1403] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.216s	user 0.007s	sys 0.029s
I20260709 12:56:59.302824  1732 raft_consensus.cc:359] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.303532  1732 raft_consensus.cc:385] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:59.305965  1734 tablet_bootstrap.cc:492] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:59.306466  1734 ts_tablet_manager.cc:1403] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.249s	user 0.032s	sys 0.013s
I20260709 12:56:59.309321  1734 raft_consensus.cc:359] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.310145  1734 raft_consensus.cc:385] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:59.310426  1734 raft_consensus.cc:740] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:59.311350  1734 consensus_queue.cc:260] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.313580  1734 ts_tablet_manager.cc:1434] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:56:59.314581  1734 tablet_bootstrap.cc:492] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:56:59.317687  1804 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:59.306965  1732 raft_consensus.cc:740] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:59.318698  1922 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:59.319022  1804 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.319257  1732 consensus_queue.cc:260] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.323201  1731 tablet_bootstrap.cc:492] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:59.323616  1731 ts_tablet_manager.cc:1403] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.132s	user 0.016s	sys 0.004s
I20260709 12:56:59.324254  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:59.324545  1804 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:59.325886  1732 ts_tablet_manager.cc:1434] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.050s	user 0.004s	sys 0.003s
I20260709 12:56:59.326875  1732 tablet_bootstrap.cc:492] T 5c8fc263f1e8493db14b8c7a8e316a9f P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:59.329092  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:59.317699  2046 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.332783  1686 raft_consensus.cc:2393] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 1: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:56:59.335906  1654 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:59.339515  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:59.341267  1804 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:59.342509  1583 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:56:59.343225  1655 leader_election.cc:343] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:59.343725  1922 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:59.345471  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:59.345247  2046 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:59.355327  1804 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:59.354806  1437 catalog_manager.cc:5697] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 0 to 1, leader changed from <none> to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:59.355842  1804 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.357278  1922 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:59.359272  1731 raft_consensus.cc:359] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.359855  1731 raft_consensus.cc:385] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:59.360116  1731 raft_consensus.cc:740] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:59.360157  1804 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:59.361835  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:59.362491  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:59.363252  1537 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 0.
W20260709 12:56:59.363292  1654 leader_election.cc:343] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:59.360893  1731 consensus_queue.cc:260] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.365883  1655 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:59.367041  2049 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:59.367412  2049 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:59.367666  2049 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:59.367877  1731 ts_tablet_manager.cc:1434] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.003s
I20260709 12:56:59.379771  1614 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:56:59.384261  2049 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.386547  2049 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:59.387315  1731 tablet_bootstrap.cc:492] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:59.391583  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:59.390980  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:56:59.404613  1539 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:59.436838  1539 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:56:59.440368  1731 tablet_bootstrap.cc:654] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:59.441236  1732 tablet_bootstrap.cc:654] T 5c8fc263f1e8493db14b8c7a8e316a9f P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
W20260709 12:56:59.441365  1654 leader_election.cc:343] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:59.445104  1734 tablet_bootstrap.cc:654] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:59.444991  2057 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:59.446580  2057 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.453675  1654 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:56:59.454789  2049 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:59.455322  2049 raft_consensus.cc:697] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:56:59.456125  2049 consensus_queue.cc:237] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.457190  2057 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:59.458765  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:56:59.460409  1508 leader_election.cc:343] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:56:59.462584  1734 tablet_bootstrap.cc:492] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:56:59.462828  1691 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:59.463063  1734 ts_tablet_manager.cc:1403] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.149s	user 0.008s	sys 0.003s
I20260709 12:56:59.465871  1734 raft_consensus.cc:359] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.466593  1734 raft_consensus.cc:385] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:59.466863  1734 raft_consensus.cc:740] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:56:59.469985  1655 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:56:59.471115  2046 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:59.471566  2046 raft_consensus.cc:697] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:56:59.472337  2046 consensus_queue.cc:237] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.477620  1731 tablet_bootstrap.cc:492] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:59.478106  1731 ts_tablet_manager.cc:1403] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.105s	user 0.010s	sys 0.001s
I20260709 12:56:59.482782  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:59.483556  1617 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
I20260709 12:56:59.486554  1804 consensus_queue.cc:1048] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:59.486892  1505 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:56:59.487888  2057 raft_consensus.cc:2804] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:59.488256  2057 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:59.488621  2057 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:59.489732  1731 raft_consensus.cc:359] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.490453  1731 raft_consensus.cc:385] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:59.490743  1731 raft_consensus.cc:740] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:59.494971  1732 tablet_bootstrap.cc:492] T 5c8fc263f1e8493db14b8c7a8e316a9f P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:59.495471  1732 ts_tablet_manager.cc:1403] T 5c8fc263f1e8493db14b8c7a8e316a9f P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.169s	user 0.021s	sys 0.013s
I20260709 12:56:59.496361  1734 consensus_queue.cc:260] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.500171  1731 consensus_queue.cc:260] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.507599  1440 catalog_manager.cc:5697] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:59.508157  1732 raft_consensus.cc:359] T 5c8fc263f1e8493db14b8c7a8e316a9f P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.508817  1732 raft_consensus.cc:385] T 5c8fc263f1e8493db14b8c7a8e316a9f P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:59.509087  1732 raft_consensus.cc:740] T 5c8fc263f1e8493db14b8c7a8e316a9f P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:59.509756  1732 consensus_queue.cc:260] T 5c8fc263f1e8493db14b8c7a8e316a9f P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.516206  1731 ts_tablet_manager.cc:1434] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 12:56:59.517813  1731 tablet_bootstrap.cc:492] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:59.520197  1686 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:56:59.520890  1732 ts_tablet_manager.cc:1434] T 5c8fc263f1e8493db14b8c7a8e316a9f P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.002s
I20260709 12:56:59.528402  1732 tablet_bootstrap.cc:492] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:59.530831  2056 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:56:59.531634  1615 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:56:59.515151  2057 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.611053  1734 ts_tablet_manager.cc:1434] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.148s	user 0.010s	sys 0.008s
W20260709 12:56:59.611836  1643 tablet.cc:2406] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:56:59.613758  2049 consensus_queue.cc:1048] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:56:59.646530  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 80096.2us
I20260709 12:56:59.685408  1734 tablet_bootstrap.cc:492] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
W20260709 12:56:59.684358  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 58395us
I20260709 12:56:59.686157  1912 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:56:59.719151  1731 tablet_bootstrap.cc:654] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:59.720985  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:56:59.721730  1615 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:59.738822  2057 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:56:59.739734  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 90236.7us
I20260709 12:56:59.751294  1732 tablet_bootstrap.cc:654] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:59.755923  2057 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:59.758049  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:56:59.758641  1691 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:59.756418  2057 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.760905  1615 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:56:59.761495  2057 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:56:59.765018  1505 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:59.766548  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:56:59.767393  1688 raft_consensus.cc:2393] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 1: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:56:59.767899  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:59.769621  2057 raft_consensus.cc:2804] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:56:59.771348  2057 raft_consensus.cc:697] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:56:59.772207  2057 consensus_queue.cc:237] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:56:59.778545  1508 consensus_peers.cc:597] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 -> Peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Couldn't send request to peer 4487a53c51be4634bf1ef29c5248353d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:56:59.779217  1691 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:56:59.796629  1734 tablet_bootstrap.cc:654] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:56:59.798377  1505 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:56:59.809791  1488 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:56:59.810125  2056 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:59.802277  2046 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:59.816877  2046 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.826689  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:56:59.827443  1537 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 0.
I20260709 12:56:59.831755  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:56:59.832428  1615 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 0.
I20260709 12:56:59.833472  2098 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:56:59.825397  2046 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:59.840626  1655 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:56:59.855497  2112 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:56:59.855933  2112 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:56:59.856314  2112 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:56:59.867887  1438 catalog_manager.cc:5697] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:56:59.868700  1731 tablet_bootstrap.cc:492] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:56:59.870893  1732 tablet_bootstrap.cc:492] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:56:59.871385  1732 ts_tablet_manager.cc:1403] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.346s	user 0.023s	sys 0.007s
I20260709 12:56:59.871778  1731 ts_tablet_manager.cc:1403] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.355s	user 0.027s	sys 0.035s
I20260709 12:56:59.874158  1732 raft_consensus.cc:359] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.876982  1732 raft_consensus.cc:385] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:59.877280  1732 raft_consensus.cc:740] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:56:59.887928  2056 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:56:59.881096  1732 consensus_queue.cc:260] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.874400  1731 raft_consensus.cc:359] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.890214  1731 raft_consensus.cc:385] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:56:59.890548  1731 raft_consensus.cc:740] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:56:59.888387  1437 catalog_manager.cc:5697] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:56:59.901584  1731 consensus_queue.cc:260] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.905767  1731 ts_tablet_manager.cc:1434] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.034s	user 0.002s	sys 0.004s
I20260709 12:56:59.905681  1732 ts_tablet_manager.cc:1434] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 12:56:59.907757  1732 tablet_bootstrap.cc:492] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:56:59.888389  2112 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.907800  1731 tablet_bootstrap.cc:492] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:56:59.954370  2046 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:56:59.955054  2046 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:56:59.957340  2046 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:56:59.960248  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:00.013332  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:00.023988  1732 tablet_bootstrap.cc:654] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:00.077611  1655 consensus_peers.cc:597] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:00.092236  1734 tablet_bootstrap.cc:492] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:57:00.092116  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:00.092811  1539 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:00.092773  1734 ts_tablet_manager.cc:1403] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.470s	user 0.047s	sys 0.051s
I20260709 12:57:00.097587  2117 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:00.098218  2117 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:00.100965  2117 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:00.101615  1734 raft_consensus.cc:359] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:00.102391  1734 raft_consensus.cc:385] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:00.102674  1734 raft_consensus.cc:740] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:57:00.103356  1734 consensus_queue.cc:260] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:00.105859  1734 ts_tablet_manager.cc:1434] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.005s
I20260709 12:57:00.183926  2112 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:00.191754  1654 leader_election.cc:343] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:00.194718  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 173232us
I20260709 12:57:00.200592  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:00.203500  1655 leader_election.cc:343] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:00.224707  1655 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:00.237242  2135 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:00.231436  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:00.252336  1613 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:00.261772  1731 tablet_bootstrap.cc:654] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:00.262149  1734 tablet_bootstrap.cc:492] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:57:00.269263  2134 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:00.273958  2133 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:57:00.278841  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:00.281095  1508 leader_election.cc:343] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:00.278012  1539 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:57:00.290058  1613 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
W20260709 12:57:00.309902  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 75962.1us
I20260709 12:57:00.279544  1609 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
I20260709 12:57:00.318045  1655 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:00.318667  1654 consensus_peers.cc:597] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d -> Peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Couldn't send request to peer c262eac7fc904ae9bb91e450f6532e3f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:57:00.319064  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 45797.9us
I20260709 12:57:00.319638  2026 consensus_queue.cc:1048] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:00.320650  2135 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:00.320784  2136 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:00.325974  1731 tablet_bootstrap.cc:492] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:57:00.326926  1732 tablet_bootstrap.cc:492] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:57:00.327426  1732 ts_tablet_manager.cc:1403] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.420s	user 0.022s	sys 0.017s
I20260709 12:57:00.328330  1731 ts_tablet_manager.cc:1403] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.421s	user 0.030s	sys 0.047s
I20260709 12:57:00.331379  1734 tablet_bootstrap.cc:654] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:00.328990  2135 raft_consensus.cc:697] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:00.361296  2117 consensus_queue.cc:1048] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:00.360260  1732 raft_consensus.cc:359] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:00.363088  1732 raft_consensus.cc:385] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:00.363396  1732 raft_consensus.cc:740] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:57:00.362221  2135 consensus_queue.cc:237] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:00.367897  1732 consensus_queue.cc:260] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:00.374352  1505 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:00.377948  2117 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:00.378387  2117 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:00.378737  2117 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:00.387246  1731 raft_consensus.cc:359] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:00.388016  1731 raft_consensus.cc:385] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:00.388298  1731 raft_consensus.cc:740] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:57:00.389276  1732 ts_tablet_manager.cc:1434] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
I20260709 12:57:00.357172  2134 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 12:57:00.399986  1732 tablet_bootstrap.cc:492] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:57:00.450793  1731 consensus_queue.cc:260] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:00.550889  1731 ts_tablet_manager.cc:1434] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.222s	user 0.007s	sys 0.000s
I20260709 12:57:00.554909  1731 tablet_bootstrap.cc:492] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:57:00.572695  1734 tablet_bootstrap.cc:492] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
W20260709 12:57:00.572819  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 198562us
I20260709 12:57:00.573231  1734 ts_tablet_manager.cc:1403] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.311s	user 0.022s	sys 0.013s
W20260709 12:57:00.653815  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 64630.7us
I20260709 12:57:00.705585  1731 tablet_bootstrap.cc:654] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:00.723345  1732 tablet_bootstrap.cc:654] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:00.737497  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 59692.8us
I20260709 12:57:00.782308  1734 raft_consensus.cc:359] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:00.783108  1734 raft_consensus.cc:385] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:00.783427  1734 raft_consensus.cc:740] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:57:00.784129  1734 consensus_queue.cc:260] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:00.818480  2153 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:00.819016  2153 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:00.832415  1734 ts_tablet_manager.cc:1434] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.259s	user 0.008s	sys 0.000s
I20260709 12:57:00.842670  1732 tablet_bootstrap.cc:492] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:57:00.843168  1732 ts_tablet_manager.cc:1403] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.443s	user 0.038s	sys 0.077s
I20260709 12:57:00.851672  1734 tablet_bootstrap.cc:492] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:57:00.870579  2117 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:00.874220  2117 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:00.876032  2153 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:00.877545  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:00.878154  1691 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:00.883141  1488 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:00.889917  1732 raft_consensus.cc:359] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:00.890677  1732 raft_consensus.cc:385] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:00.890933  1732 raft_consensus.cc:740] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:57:00.891564  1732 consensus_queue.cc:260] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:00.904796  1734 tablet_bootstrap.cc:654] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:00.904670  1538 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:00.886518  1691 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:00.911626  1508 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:00.911850  1732 ts_tablet_manager.cc:1434] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.001s
I20260709 12:57:00.912902  1732 tablet_bootstrap.cc:492] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:57:00.923550  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:00.939922  2149 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:00.951135  2149 raft_consensus.cc:697] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:00.986039  1731 tablet_bootstrap.cc:492] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:57:00.952080  2149 consensus_queue.cc:237] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:00.986642  1731 ts_tablet_manager.cc:1403] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.434s	user 0.029s	sys 0.023s
W20260709 12:57:00.998204  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 62423.3us
W20260709 12:57:01.036069  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 93958.2us
W20260709 12:57:01.035619  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 106057us
I20260709 12:57:01.098297  1732 tablet_bootstrap.cc:654] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:01.106467  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 181542us
I20260709 12:57:01.113786  1616 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:01.115448  2170 log.cc:927] Time spent T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
W20260709 12:57:01.111840  2171 log.cc:927] Time spent T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:57:01.122242  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:01.122931  1615 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:01.125572  1731 raft_consensus.cc:359] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.126298  1731 raft_consensus.cc:385] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:01.126601  1731 raft_consensus.cc:740] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:57:01.127243  1731 consensus_queue.cc:260] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.131742  1438 catalog_manager.cc:5697] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:01.115489  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:01.182062  1734 tablet_bootstrap.cc:492] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:57:01.182699  1734 ts_tablet_manager.cc:1403] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.331s	user 0.015s	sys 0.008s
I20260709 12:57:01.186157  1734 raft_consensus.cc:359] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.186681  1734 raft_consensus.cc:385] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:01.186919  1734 raft_consensus.cc:740] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:57:01.187529  1734 consensus_queue.cc:260] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.189520  1734 ts_tablet_manager.cc:1434] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:57:01.196308  1732 tablet_bootstrap.cc:492] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:57:01.196830  1732 ts_tablet_manager.cc:1403] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.284s	user 0.011s	sys 0.026s
I20260709 12:57:01.197408  2046 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:01.198280  1722 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.IsCreateTableDone -> {remote=127.0.107.254:34735, user_credentials={real_user=slave}} blocked reactor thread for 60128.6us
I20260709 12:57:01.198135  2046 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.203161  2160 consensus_queue.cc:1048] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:01.203655  2046 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:01.206894  1732 raft_consensus.cc:359] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.207652  1732 raft_consensus.cc:385] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:01.197376  1734 tablet_bootstrap.cc:492] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:57:01.212857  1734 tablet_bootstrap.cc:654] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:01.207945  1732 raft_consensus.cc:740] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:57:01.214123  1732 consensus_queue.cc:260] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.226238  1732 ts_tablet_manager.cc:1434] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.029s	user 0.003s	sys 0.004s
I20260709 12:57:01.228410  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:01.229336  1615 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:01.232023  1732 tablet_bootstrap.cc:492] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:57:01.236181  1731 ts_tablet_manager.cc:1434] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.247s	user 0.006s	sys 0.003s
I20260709 12:57:01.239727  1731 tablet_bootstrap.cc:492] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
W20260709 12:57:01.245957  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 93807.5us
I20260709 12:57:01.248656  2057 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:01.249230  2057 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.254261  1691 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:01.248023  1655 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:01.256745  2160 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:01.262966  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:01.268291  1508 leader_election.cc:343] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:01.271657  2057 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:01.273780  1732 tablet_bootstrap.cc:654] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:01.283214  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:01.307961  2139 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:01.308604  2139 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.348081  2139 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:01.348941  1731 tablet_bootstrap.cc:654] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:01.357195  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:01.360116  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:01.363310  1583 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:01.365475  2141 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:01.372052  1655 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:01.378069  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:01.411738  2046 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:01.415637  2133 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:01.424751  2133 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.399964  1732 tablet_bootstrap.cc:492] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:57:01.426285  1732 ts_tablet_manager.cc:1403] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.199s	user 0.032s	sys 0.026s
I20260709 12:57:01.427032  2133 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:01.430081  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:01.430491  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:01.432055  1581 leader_election.cc:343] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:01.429311  1732 raft_consensus.cc:359] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.432729  1732 raft_consensus.cc:385] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:01.433049  1732 raft_consensus.cc:740] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:57:01.434223  1732 consensus_queue.cc:260] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.435209  1691 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:57:01.436750  1732 ts_tablet_manager.cc:1434] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:57:01.437738  1732 tablet_bootstrap.cc:492] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:57:01.437695  1583 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:01.440580  2139 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:01.441015  2139 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:01.441371  2139 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:01.452152  1732 tablet_bootstrap.cc:654] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
W20260709 12:57:01.421315  1505 leader_election.cc:343] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:01.460784  1505 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:01.461436  2177 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:01.464188  1734 tablet_bootstrap.cc:492] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:57:01.465333  1734 ts_tablet_manager.cc:1403] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.268s	user 0.047s	sys 0.057s
I20260709 12:57:01.468693  1732 tablet_bootstrap.cc:492] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:57:01.469264  1732 ts_tablet_manager.cc:1403] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.005s
I20260709 12:57:01.459542  2139 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.473971  1731 tablet_bootstrap.cc:492] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:57:01.474392  1731 ts_tablet_manager.cc:1403] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.237s	user 0.010s	sys 0.011s
I20260709 12:57:01.478175  1731 raft_consensus.cc:359] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.478919  1731 raft_consensus.cc:385] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:01.479228  1731 raft_consensus.cc:740] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:57:01.479919  1731 consensus_queue.cc:260] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.484704  2097 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:01.481824  1732 raft_consensus.cc:359] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.485791  1732 raft_consensus.cc:385] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:01.486022  1732 raft_consensus.cc:740] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:57:01.487012  1732 consensus_queue.cc:260] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.485190  2097 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.489899  1731 ts_tablet_manager.cc:1434] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:57:01.494733  1732 ts_tablet_manager.cc:1434] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 12:57:01.494854  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:01.495100  2097 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:01.495362  1731 tablet_bootstrap.cc:492] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:57:01.495827  1732 tablet_bootstrap.cc:492] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:57:01.497078  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:01.497320  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:57:01.498257  1505 leader_election.cc:343] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:01.499112  1581 leader_election.cc:343] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:01.499516  1508 leader_election.cc:343] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:01.499904  1508 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:01.500119  1734 raft_consensus.cc:359] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.500896  1734 raft_consensus.cc:385] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:01.501197  1734 raft_consensus.cc:740] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:57:01.501252  2056 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:01.501494  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:01.501995  1734 consensus_queue.cc:260] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.502346  1687 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:01.501255  2139 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:01.504513  1734 ts_tablet_manager.cc:1434] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:57:01.505519  1734 tablet_bootstrap.cc:492] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:57:01.506584  1732 tablet_bootstrap.cc:654] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:01.509176  1731 tablet_bootstrap.cc:654] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:01.516361  1734 tablet_bootstrap.cc:654] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:01.516888  1687 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:57:01.518651  1583 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:01.518163  1437 catalog_manager.cc:5697] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:01.521329  2139 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:01.521847  2139 raft_consensus.cc:697] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:01.534555  1732 tablet_bootstrap.cc:492] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:57:01.535100  1732 ts_tablet_manager.cc:1403] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.006s
I20260709 12:57:01.538334  1732 raft_consensus.cc:359] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.539081  1732 raft_consensus.cc:385] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:01.539387  1732 raft_consensus.cc:740] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:57:01.533612  2139 consensus_queue.cc:237] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.540128  1732 consensus_queue.cc:260] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.542330  1732 ts_tablet_manager.cc:1434] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:57:01.543394  1732 tablet_bootstrap.cc:492] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:57:01.552610  1732 tablet_bootstrap.cc:654] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:01.558594  1731 tablet_bootstrap.cc:492] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:57:01.559008  1731 ts_tablet_manager.cc:1403] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.064s	user 0.020s	sys 0.005s
I20260709 12:57:01.562155  1731 raft_consensus.cc:359] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.562851  1731 raft_consensus.cc:385] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:01.563143  1731 raft_consensus.cc:740] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:57:01.563251  2097 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:01.563881  1731 consensus_queue.cc:260] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.566226  1731 ts_tablet_manager.cc:1434] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:57:01.569001  1731 tablet_bootstrap.cc:492] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:57:01.619139  1731 tablet_bootstrap.cc:654] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:01.619073  1440 catalog_manager.cc:5697] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 0 to 1, leader changed from <none> to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:01.626798  1734 tablet_bootstrap.cc:492] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:57:01.627302  1734 ts_tablet_manager.cc:1403] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.122s	user 0.025s	sys 0.013s
I20260709 12:57:01.630636  1734 raft_consensus.cc:359] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.631367  1734 raft_consensus.cc:385] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:01.631636  1734 raft_consensus.cc:740] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:57:01.637862  1732 tablet_bootstrap.cc:492] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:57:01.639559  2046 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:01.640230  2046 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.642206  1732 ts_tablet_manager.cc:1403] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.099s	user 0.008s	sys 0.004s
I20260709 12:57:01.632328  1734 consensus_queue.cc:260] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.646265  1732 raft_consensus.cc:359] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.646924  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:01.647294  1732 raft_consensus.cc:385] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:01.647758  1732 raft_consensus.cc:740] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:57:01.648609  1732 consensus_queue.cc:260] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.650943  1732 ts_tablet_manager.cc:1434] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:57:01.652513  1732 tablet_bootstrap.cc:492] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
W20260709 12:57:01.652108  1655 leader_election.cc:343] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:01.659863  2046 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:01.660195  1732 tablet_bootstrap.cc:654] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:01.662207  1734 ts_tablet_manager.cc:1434] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 12:57:01.662730  2132 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:01.663439  2132 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.665683  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:01.663872  1734 tablet_bootstrap.cc:492] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:57:01.668367  2138 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:57:01.672544  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:01.685386  1536 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 0.
I20260709 12:57:01.687050  1655 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:01.689489  1654 leader_election.cc:343] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:01.689982  1654 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:01.674362  2112 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:01.691418  2112 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.678472  1732 tablet_bootstrap.cc:492] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:57:01.695600  1732 ts_tablet_manager.cc:1403] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.009s
I20260709 12:57:01.696316  2135 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:01.696858  2135 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:01.697240  2135 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:01.697680  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:01.697937  2112 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:01.699581  2132 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:01.699160  1732 raft_consensus.cc:359] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:01.699781  1655 leader_election.cc:343] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:01.700256  1732 raft_consensus.cc:385] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:01.700631  1732 raft_consensus.cc:740] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:57:01.701721  1732 consensus_queue.cc:260] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.703899  1732 ts_tablet_manager.cc:1434] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:57:01.704591  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:01.708338  1608 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 0.
I20260709 12:57:01.707373  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:01.710608  1732 tablet_bootstrap.cc:492] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:57:01.715888  1732 tablet_bootstrap.cc:654] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:01.699110  2112 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:01.717437  2135 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:01.718335  1654 leader_election.cc:343] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:01.724792  1654 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:01.726931  2135 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:01.738934  1734 tablet_bootstrap.cc:654] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:01.731199  2112 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:01.731949  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:01.742014  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:01.762923  1617 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:01.768909  1535 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:01.778769  1617 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:57:01.779913  1654 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:01.781252  2112 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:01.781782  2112 raft_consensus.cc:697] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:01.782665  2112 consensus_queue.cc:237] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.784528  2160 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:01.785048  2160 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.786936  2160 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:01.792763  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:01.795935  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:01.796744  2056 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:01.797243  2056 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.800415  1731 tablet_bootstrap.cc:492] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:57:01.801110  1731 ts_tablet_manager.cc:1403] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.234s	user 0.010s	sys 0.005s
W20260709 12:57:01.799520  1655 leader_election.cc:343] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:01.802728  1654 leader_election.cc:343] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:01.804891  1535 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:57:01.810115  2056 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:01.811164  1731 raft_consensus.cc:359] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.811947  1731 raft_consensus.cc:385] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:01.812263  1731 raft_consensus.cc:740] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:57:01.812546  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:01.813220  1731 consensus_queue.cc:260] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.815639  1731 ts_tablet_manager.cc:1434] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:57:01.813304  1732 tablet_bootstrap.cc:492] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:57:01.816685  1732 ts_tablet_manager.cc:1403] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.106s	user 0.030s	sys 0.049s
I20260709 12:57:01.816818  1731 tablet_bootstrap.cc:492] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:57:01.819181  1732 raft_consensus.cc:359] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.819869  1732 raft_consensus.cc:385] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:01.820152  1732 raft_consensus.cc:740] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:57:01.823032  2135 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:01.823567  2135 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.820820  1732 consensus_queue.cc:260] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.826187  1732 ts_tablet_manager.cc:1434] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:57:01.826838  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:01.828564  1655 leader_election.cc:343] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:01.829593  1732 tablet_bootstrap.cc:492] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:57:01.832460  1731 tablet_bootstrap.cc:654] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:01.813241  1617 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
I20260709 12:57:01.833539  1505 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:01.833813  2135 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:01.834759  2056 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:01.835170  2056 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:01.835529  2056 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:01.835327  1438 catalog_manager.cc:5697] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 0 to 1, leader changed from <none> to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 1 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:01.834657  1654 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:01.838838  2112 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:01.841336  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:01.841962  1683 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
I20260709 12:57:01.845597  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:01.848150  2056 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.849347  1732 tablet_bootstrap.cc:654] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:01.852885  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:01.853679  1683 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:01.857636  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:01.858271  1608 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:01.864684  1654 leader_election.cc:343] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:01.865283  1734 tablet_bootstrap.cc:492] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:57:01.865310  1654 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:01.865962  1734 ts_tablet_manager.cc:1403] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.203s	user 0.001s	sys 0.015s
I20260709 12:57:01.850251  2056 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:01.867136  2135 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:01.871202  1683 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:01.872996  1508 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:01.875679  2056 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:01.876243  2056 raft_consensus.cc:697] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:01.879465  1734 raft_consensus.cc:359] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.880188  1734 raft_consensus.cc:385] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:01.880540  1734 raft_consensus.cc:740] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:57:01.880640  1608 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:01.881510  1734 consensus_queue.cc:260] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.883869  1734 ts_tablet_manager.cc:1434] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:57:01.877139  2056 consensus_queue.cc:237] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.885728  1731 tablet_bootstrap.cc:492] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:57:01.886152  1731 ts_tablet_manager.cc:1403] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.070s	user 0.008s	sys 0.004s
I20260709 12:57:01.888163  1734 tablet_bootstrap.cc:492] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:57:01.888453  1731 raft_consensus.cc:359] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.892946  1731 raft_consensus.cc:385] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:01.893266  1731 raft_consensus.cc:740] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:57:01.893945  1731 consensus_queue.cc:260] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.895897  1731 ts_tablet_manager.cc:1434] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 12:57:01.896770  1731 tablet_bootstrap.cc:492] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:57:01.898222  1732 tablet_bootstrap.cc:492] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:57:01.899672  1732 ts_tablet_manager.cc:1403] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.070s	user 0.016s	sys 0.024s
I20260709 12:57:01.913429  1734 tablet_bootstrap.cc:654] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:01.913192  1438 catalog_manager.cc:5697] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:01.918584  1732 raft_consensus.cc:359] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.922022  1732 raft_consensus.cc:385] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:01.923136  1732 raft_consensus.cc:740] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:57:01.923992  1732 consensus_queue.cc:260] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.929952  1732 ts_tablet_manager.cc:1434] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 12:57:01.922778  1731 tablet_bootstrap.cc:654] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:01.933791  1732 tablet_bootstrap.cc:492] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d: Bootstrap starting.
I20260709 12:57:01.942629  1732 tablet_bootstrap.cc:654] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:01.947005  1731 tablet_bootstrap.cc:492] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:57:01.947695  2139 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:01.952872  2139 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.952880  1731 ts_tablet_manager.cc:1403] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.001s
I20260709 12:57:01.956571  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:01.955492  2139 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:01.957029  1731 raft_consensus.cc:359] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.957729  1731 raft_consensus.cc:385] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:01.957994  1731 raft_consensus.cc:740] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:57:01.958329  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:01.958706  1731 consensus_queue.cc:260] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:01.960047  1581 leader_election.cc:343] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:01.959031  1687 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:57:01.961550  1583 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:01.962433  2139 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:01.964815  1732 tablet_bootstrap.cc:492] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d: No bootstrap required, opened a new log
I20260709 12:57:01.962828  2139 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:01.966289  1732 ts_tablet_manager.cc:1403] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.006s
I20260709 12:57:01.966471  2139 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:01.968267  1731 ts_tablet_manager.cc:1434] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.005s
I20260709 12:57:01.969378  1731 tablet_bootstrap.cc:492] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:57:01.971338  1732 raft_consensus.cc:359] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.972016  1732 raft_consensus.cc:385] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:01.972270  1732 raft_consensus.cc:740] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Initialized, Role: FOLLOWER
I20260709 12:57:01.972936  1732 consensus_queue.cc:260] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.975275  1732 ts_tablet_manager.cc:1434] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:57:01.976699  2139 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.978878  2139 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:01.980747  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:01.981419  1687 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:01.983865  1488 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:01.984424  1734 tablet_bootstrap.cc:492] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:57:01.984920  1734 ts_tablet_manager.cc:1403] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.097s	user 0.020s	sys 0.016s
I20260709 12:57:01.986333  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:01.987540  1734 raft_consensus.cc:359] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.988216  1734 raft_consensus.cc:385] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:01.989414  1734 raft_consensus.cc:740] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
W20260709 12:57:01.989468  1581 leader_election.cc:343] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:01.991322  1734 consensus_queue.cc:260] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:01.993726  1734 ts_tablet_manager.cc:1434] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:57:01.994901  1734 tablet_bootstrap.cc:492] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:57:02.005173  1731 tablet_bootstrap.cc:654] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:02.005173  1734 tablet_bootstrap.cc:654] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:02.016666  2005 consensus_queue.cc:1048] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:02.022221  1731 tablet_bootstrap.cc:492] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:57:02.022979  1731 ts_tablet_manager.cc:1403] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.000s
I20260709 12:57:02.025918  1731 raft_consensus.cc:359] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.027266  1731 raft_consensus.cc:385] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:02.027642  1731 raft_consensus.cc:740] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:57:02.028679  1731 consensus_queue.cc:260] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.030262  1731 ts_tablet_manager.cc:1434] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:57:02.039443  1731 tablet_bootstrap.cc:492] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:57:02.042765  1734 tablet_bootstrap.cc:492] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:57:02.043574  1734 ts_tablet_manager.cc:1403] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.006s
I20260709 12:57:02.057559  1731 tablet_bootstrap.cc:654] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:02.063709  1734 raft_consensus.cc:359] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.064765  1734 raft_consensus.cc:385] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:02.065124  1734 raft_consensus.cc:740] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:57:02.066334  1734 consensus_queue.cc:260] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.068538  1734 ts_tablet_manager.cc:1434] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.007s
I20260709 12:57:02.070480  1734 tablet_bootstrap.cc:492] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:57:02.075953  1687 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:57:02.079034  1583 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:02.080343  2005 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:02.080832  2005 raft_consensus.cc:697] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:02.081579  2005 consensus_queue.cc:237] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.093631  1734 tablet_bootstrap.cc:654] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:02.093724  1536 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:02.095952  1731 tablet_bootstrap.cc:492] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:57:02.100310  1731 ts_tablet_manager.cc:1403] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.002s
I20260709 12:57:02.103142  1731 raft_consensus.cc:359] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.103715  1731 raft_consensus.cc:385] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:02.103933  1731 raft_consensus.cc:740] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:57:02.104540  1731 consensus_queue.cc:260] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.106210  1731 ts_tablet_manager.cc:1434] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:57:02.107395  1731 tablet_bootstrap.cc:492] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:57:02.113408  1731 tablet_bootstrap.cc:654] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:02.127337  2005 consensus_queue.cc:1048] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:02.129521  1438 catalog_manager.cc:5697] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 0 to 1, leader changed from <none> to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:02.143788  1734 tablet_bootstrap.cc:492] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:57:02.144057  2056 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:02.144256  1734 ts_tablet_manager.cc:1403] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.074s	user 0.009s	sys 0.002s
I20260709 12:57:02.144595  2056 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.146667  2056 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:02.148352  1734 raft_consensus.cc:359] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.148990  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:02.149216  1734 raft_consensus.cc:385] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:02.149632  1734 raft_consensus.cc:740] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:57:02.150396  1734 consensus_queue.cc:260] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.149683  1608 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
I20260709 12:57:02.152714  1734 ts_tablet_manager.cc:1434] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:57:02.153543  1505 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:02.153836  1734 tablet_bootstrap.cc:492] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:57:02.154393  2056 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:02.154798  2056 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:02.155191  2056 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:02.155617  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:02.156289  1687 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
I20260709 12:57:02.161686  1734 tablet_bootstrap.cc:654] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:02.180845  2172 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:02.181440  2172 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.187696  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:02.188547  1608 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
I20260709 12:57:02.163358  2056 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.190619  1505 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:02.191588  2056 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:02.191982  2177 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:02.192459  2177 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:02.193197  2177 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:02.196661  2112 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:02.203004  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:02.206697  1608 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:02.207341  2177 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.205299  2172 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:02.208851  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:02.209487  1687 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
I20260709 12:57:02.229417  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:02.231823  1685 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:02.234393  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:02.235023  1615 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:02.236842  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:02.237397  1687 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:02.237730  1608 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:02.239009  1505 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:02.243558  1687 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:02.244506  1508 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:02.246167  1615 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:02.249143  2172 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:02.251286  2138 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:02.247447  2112 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:57:02.246866  2177 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:02.270213  1685 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:02.272212  1734 tablet_bootstrap.cc:492] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:57:02.277458  1734 ts_tablet_manager.cc:1403] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.124s	user 0.011s	sys 0.020s
I20260709 12:57:02.280174  1734 raft_consensus.cc:359] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.284584  1734 raft_consensus.cc:385] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:02.284910  1734 raft_consensus.cc:740] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:57:02.287580  1734 consensus_queue.cc:260] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.297911  1731 tablet_bootstrap.cc:492] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:57:02.298384  1731 ts_tablet_manager.cc:1403] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.191s	user 0.036s	sys 0.031s
I20260709 12:57:02.300186  1734 ts_tablet_manager.cc:1434] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 12:57:02.322829  1734 tablet_bootstrap.cc:492] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:57:02.332310  1922 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:02.301206  2172 raft_consensus.cc:697] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:02.332911  1922 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.336796  1922 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:02.338267  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:02.322729  2138 raft_consensus.cc:697] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:02.341207  1685 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:57:02.339670  1731 raft_consensus.cc:359] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.342389  1731 raft_consensus.cc:385] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:02.342661  1731 raft_consensus.cc:740] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:57:02.343243  1731 consensus_queue.cc:260] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.346364  2138 consensus_queue.cc:237] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.343197  2172 consensus_queue.cc:237] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.349438  1731 ts_tablet_manager.cc:1434] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.004s
I20260709 12:57:02.345242  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:02.351150  1536 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:57:02.344460  1583 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:02.354849  2137 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:02.355209  2137 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:02.355512  2137 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:02.355818  1734 tablet_bootstrap.cc:654] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:02.371641  1731 tablet_bootstrap.cc:492] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Bootstrap starting.
I20260709 12:57:02.371927  2230 consensus_queue.cc:1048] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:02.373251  2137 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.384336  1731 tablet_bootstrap.cc:654] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:02.389693  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:02.390350  1536 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:02.397687  2137 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:02.399758  1734 tablet_bootstrap.cc:492] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:57:02.404510  1536 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:57:02.405824  1581 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:02.406678  2137 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:02.407056  1734 ts_tablet_manager.cc:1403] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.089s	user 0.002s	sys 0.029s
I20260709 12:57:02.407132  2137 raft_consensus.cc:697] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:02.408646  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:02.411868  1687 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:02.411580  2137 consensus_queue.cc:237] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.409545  2172 consensus_queue.cc:1048] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:02.419474  1438 catalog_manager.cc:5697] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:02.420166  1734 raft_consensus.cc:359] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.420923  1734 raft_consensus.cc:385] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:02.420197  1687 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:57:02.421231  1438 catalog_manager.cc:5697] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:02.421236  1734 raft_consensus.cc:740] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:57:02.423784  1734 consensus_queue.cc:260] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.433220  1734 ts_tablet_manager.cc:1434] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.003s
I20260709 12:57:02.434206  1734 tablet_bootstrap.cc:492] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f: Bootstrap starting.
I20260709 12:57:02.435051  1731 tablet_bootstrap.cc:492] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8: No bootstrap required, opened a new log
I20260709 12:57:02.435511  1731 ts_tablet_manager.cc:1403] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent bootstrapping tablet: real 0.083s	user 0.010s	sys 0.000s
I20260709 12:57:02.438277  1731 raft_consensus.cc:359] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.438967  1731 raft_consensus.cc:385] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:02.448693  1731 raft_consensus.cc:740] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Initialized, Role: FOLLOWER
I20260709 12:57:02.449419  1731 consensus_queue.cc:260] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.451530  1731 ts_tablet_manager.cc:1434] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:57:02.439777  1734 tablet_bootstrap.cc:654] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:02.440928  1440 catalog_manager.cc:5697] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 0 to 1, leader changed from <none> to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:02.477123  2137 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:02.477820  2137 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.480322  2137 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:02.481055  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:02.484359  1536 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:57:02.485765  1581 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:02.482033  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:02.486977  1685 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 0.
I20260709 12:57:02.488137  2005 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:02.488548  2005 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:02.488837  2005 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:02.492885  2172 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:02.493372  2172 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.495385  2172 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:02.496793  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:02.497131  2005 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.498920  2005 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:02.500414  2172 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:02.501417  1505 leader_election.cc:343] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:02.501307  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:02.501646  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:02.500936  2172 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.502305  1685 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
I20260709 12:57:02.505028  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:02.505687  1508 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:02.506966  2227 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:02.507055  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:02.507367  2227 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:02.507565  2172 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:02.507977  1535 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:02.507715  2227 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:02.509126  1734 tablet_bootstrap.cc:492] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f: No bootstrap required, opened a new log
I20260709 12:57:02.509588  1734 ts_tablet_manager.cc:1403] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.001s
I20260709 12:57:02.512410  1734 raft_consensus.cc:359] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.513065  1734 raft_consensus.cc:385] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:02.513309  1734 raft_consensus.cc:740] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Initialized, Role: FOLLOWER
I20260709 12:57:02.513931  1734 consensus_queue.cc:260] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.515197  2227 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.516227  1734 ts_tablet_manager.cc:1434] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:57:02.517421  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:02.518116  1687 raft_consensus.cc:2393] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 1: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:02.518177  1922 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:02.519134  1508 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:02.519805  2172 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:02.523259  2227 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:02.507644  1683 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:02.525373  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:02.525939  1615 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:02.527748  2172 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:02.528633  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:02.529139  1687 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:02.531519  1615 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:02.532673  1505 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:02.534250  1683 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:57:02.533631  2227 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:02.534952  2227 raft_consensus.cc:697] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:02.535787  2227 consensus_queue.cc:237] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.538560  1922 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:02.541762  1583 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:02.542475  1922 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:02.542876  1922 raft_consensus.cc:697] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:02.543555  1922 consensus_queue.cc:237] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.545799  2230 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:02.546303  2230 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.547742  1687 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:02.549561  2230 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:02.550240  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:02.550884  1615 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
I20260709 12:57:02.551975  1505 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:02.552915  2138 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:02.553260  2138 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:02.553611  2138 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:02.537027  1535 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:57:02.569981  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:02.573781  1687 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 0.
I20260709 12:57:02.571863  2138 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:02.584342  2138 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:02.584841  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:02.585430  1616 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:02.592577  1438 catalog_manager.cc:5697] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:02.600242  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:02.601596  1690 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:02.612377  1440 catalog_manager.cc:5697] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 0 to 1, leader changed from <none> to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 1 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:02.621932  1616 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:02.624082  1505 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:02.625030  2138 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:02.625553  2138 raft_consensus.cc:697] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:02.626422  2138 consensus_queue.cc:237] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:02.634850  2240 log.cc:927] Time spent T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:57:02.637367  1690 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:02.679491  1440 catalog_manager.cc:5697] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:02.849128  2138 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:02.869484  2138 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:02.873543  2230 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:02.929651  2172 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:02.948868  2005 consensus_queue.cc:1048] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:02.956619  2139 consensus_queue.cc:1048] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:03.012962  2139 consensus_queue.cc:1048] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:03.020597  2172 consensus_queue.cc:1048] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:03.080183  2005 consensus_queue.cc:1048] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:03.094871  2230 consensus_queue.cc:1048] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:03.132728  2230 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:03.167095  2230 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:03.205054   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:03.231262  2257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:03.233011  2258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:03.235725  2260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:03.237317   431 server_base.cc:1061] running on GCE node
I20260709 12:57:03.239953   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:03.240303   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:03.240528   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601823240509 us; error 0 us; skew 500 ppm
I20260709 12:57:03.241118   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:03.244778   431 webserver.cc:533] Webserver started at http://127.0.107.196:44321/ using document root <none> and password file <none>
I20260709 12:57:03.245321   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:03.245529   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:03.245846   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:03.247099   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-3-root/instance:
uuid: "1d6516ff61104bdda54bde95e92fe579"
format_stamp: "Formatted at 2026-07-09 12:57:03 on dist-test-slave-6j4g"
I20260709 12:57:03.252835   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.006s
I20260709 12:57:03.257344  2265 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:03.258536   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:57:03.258967   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-3-root
uuid: "1d6516ff61104bdda54bde95e92fe579"
format_stamp: "Formatted at 2026-07-09 12:57:03 on dist-test-slave-6j4g"
I20260709 12:57:03.260741   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:03.298679   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:03.300407   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:03.302304   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:03.305157   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:03.305392   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:03.305662   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:03.305842   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:03.414526   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:33437
I20260709 12:57:03.414649  2327 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:33437 every 8 connection(s)
I20260709 12:57:03.420424   431 auto_leader_rebalancer-test.cc:384] add a tserver: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:57:03.478158  2328 heartbeater.cc:344] Connected to a master server at 127.0.107.254:34735
I20260709 12:57:03.478593  2328 heartbeater.cc:461] Registering TS with master...
I20260709 12:57:03.479486  2328 heartbeater.cc:507] Master 127.0.107.254:34735 requested a full tablet report, sending...
I20260709 12:57:03.481696  1440 ts_manager.cc:194] Registered new tserver with Master: 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:03.483263  1440 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38804
I20260709 12:57:04.197175  1616 consensus_queue.cc:237] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:04.212447  1690 raft_consensus.cc:1275] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:04.217252  1538 raft_consensus.cc:1275] T d8b7121a813948bfa350d3f0b9fd6988 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:04.218273  2139 consensus_queue.cc:1048] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:04.219153  1922 consensus_queue.cc:1048] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:04.238667  2116 raft_consensus.cc:2955] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:57:04.240163  1685 raft_consensus.cc:2955] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:57:04.248932  1538 raft_consensus.cc:2955] T d8b7121a813948bfa350d3f0b9fd6988 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
W20260709 12:57:04.254484  1582 consensus_peers.cc:597] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d8b7121a813948bfa350d3f0b9fd6988. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:04.269877  1440 catalog_manager.cc:5697] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:57:04.295490  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:04.295912  1535 consensus_queue.cc:237] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:04.334103  1690 raft_consensus.cc:1275] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:04.335649  2227 consensus_queue.cc:1048] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:04.338544  1616 raft_consensus.cc:1275] T 105edc3ce5964519acbd96dbaa975697 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:04.340394  2227 consensus_queue.cc:1048] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:04.384208  2138 raft_consensus.cc:2955] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
W20260709 12:57:04.390069  1507 consensus_peers.cc:597] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 105edc3ce5964519acbd96dbaa975697. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:04.394641  1616 raft_consensus.cc:2955] T 105edc3ce5964519acbd96dbaa975697 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:57:04.402908  1535 consensus_queue.cc:237] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:04.405962  1438 catalog_manager.cc:5697] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:04.399958  1687 raft_consensus.cc:2955] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
W20260709 12:57:04.434832  1507 consensus_peers.cc:597] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5c8fc263f1e8493db14b8c7a8e316a9f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:04.438915  1685 raft_consensus.cc:1275] T 5c8fc263f1e8493db14b8c7a8e316a9f P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:04.442312  2342 consensus_queue.cc:1048] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:04.443151  1616 raft_consensus.cc:1275] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:04.446611  2342 consensus_queue.cc:1048] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:04.455328  2138 raft_consensus.cc:2955] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:57:04.457863  1616 raft_consensus.cc:2955] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:57:04.458218  1690 raft_consensus.cc:2955] T 5c8fc263f1e8493db14b8c7a8e316a9f P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:57:04.470875  1535 consensus_queue.cc:237] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:04.476145  1440 catalog_manager.cc:5697] T 5c8fc263f1e8493db14b8c7a8e316a9f P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:57:04.486488  2328 heartbeater.cc:499] Master 127.0.107.254:34735 was elected leader, sending a full tablet report...
I20260709 12:57:04.497088  1687 raft_consensus.cc:1275] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:04.502514  2227 consensus_queue.cc:1048] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:57:04.507472  1507 consensus_peers.cc:597] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 398a6324f64f46b0accba6cac64dfec6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:04.523931  1616 raft_consensus.cc:1275] T 398a6324f64f46b0accba6cac64dfec6 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:04.525511  2227 consensus_queue.cc:1048] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:04.532953  2138 raft_consensus.cc:2955] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:57:04.537104  1615 raft_consensus.cc:2955] T 398a6324f64f46b0accba6cac64dfec6 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:57:04.541464  1687 raft_consensus.cc:2955] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:57:04.560525  1438 catalog_manager.cc:5697] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:57:04.673504  2357 ts_tablet_manager.cc:933] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:04.681381  2357 tablet_copy_client.cc:323] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:41953
I20260709 12:57:04.702790  1627 tablet_copy_service.cc:140] P c262eac7fc904ae9bb91e450f6532e3f: Received BeginTabletCopySession request for tablet d8b7121a813948bfa350d3f0b9fd6988 from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:58006)
I20260709 12:57:04.703461  1627 tablet_copy_service.cc:161] P c262eac7fc904ae9bb91e450f6532e3f: Beginning new tablet copy session on tablet d8b7121a813948bfa350d3f0b9fd6988 from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:58006: session id = 1d6516ff61104bdda54bde95e92fe579-d8b7121a813948bfa350d3f0b9fd6988
I20260709 12:57:04.717028  1627 tablet_copy_source_session.cc:215] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:04.724257  2357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8b7121a813948bfa350d3f0b9fd6988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:04.748240  2360 ts_tablet_manager.cc:933] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903)
I20260709 12:57:04.762188  2357 tablet_copy_client.cc:806] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:04.767719  2357 tablet_copy_client.cc:670] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:04.766963  2360 tablet_copy_client.cc:323] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43903
I20260709 12:57:04.777338  2357 tablet_copy_client.cc:538] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:04.785593  1552 tablet_copy_service.cc:140] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Received BeginTabletCopySession request for tablet 105edc3ce5964519acbd96dbaa975697 from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:42356)
I20260709 12:57:04.786234  1552 tablet_copy_service.cc:161] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Beginning new tablet copy session on tablet 105edc3ce5964519acbd96dbaa975697 from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:42356: session id = 1d6516ff61104bdda54bde95e92fe579-105edc3ce5964519acbd96dbaa975697
I20260709 12:57:04.793861  2357 tablet_bootstrap.cc:492] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:57:04.795460  1552 tablet_copy_source_session.cc:215] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:04.799248  2360 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 105edc3ce5964519acbd96dbaa975697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:04.819303  2360 tablet_copy_client.cc:806] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:04.819907  2360 tablet_copy_client.cc:670] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:04.824076  2360 tablet_copy_client.cc:538] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:04.836922  2360 tablet_bootstrap.cc:492] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:57:04.855355  2357 tablet_bootstrap.cc:492] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:04.856532  2357 tablet_bootstrap.cc:492] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:57:04.857205  2357 ts_tablet_manager.cc:1403] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 0.064s	user 0.019s	sys 0.010s
I20260709 12:57:04.860597  2357 raft_consensus.cc:359] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:04.861527  2357 raft_consensus.cc:740] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:57:04.862195  2357 consensus_queue.cc:260] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:04.873790  2365 ts_tablet_manager.cc:933] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903)
I20260709 12:57:04.875602  2360 tablet_bootstrap.cc:492] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:04.876562  2360 tablet_bootstrap.cc:492] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:57:04.877269  2360 ts_tablet_manager.cc:1403] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.015s
I20260709 12:57:04.882004  2360 raft_consensus.cc:359] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:04.883190  2360 raft_consensus.cc:740] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:57:04.883785  2360 consensus_queue.cc:260] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:04.893082  2365 tablet_copy_client.cc:323] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43903
I20260709 12:57:04.896068  1552 tablet_copy_service.cc:140] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Received BeginTabletCopySession request for tablet 5c8fc263f1e8493db14b8c7a8e316a9f from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:42356)
I20260709 12:57:04.896697  1552 tablet_copy_service.cc:161] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Beginning new tablet copy session on tablet 5c8fc263f1e8493db14b8c7a8e316a9f from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:42356: session id = 1d6516ff61104bdda54bde95e92fe579-5c8fc263f1e8493db14b8c7a8e316a9f
I20260709 12:57:04.897269  2357 ts_tablet_manager.cc:1434] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.040s	user 0.017s	sys 0.013s
I20260709 12:57:04.913779  1552 tablet_copy_source_session.cc:215] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:04.917392  2365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c8fc263f1e8493db14b8c7a8e316a9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:04.918762  1627 tablet_copy_service.cc:342] P c262eac7fc904ae9bb91e450f6532e3f: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-d8b7121a813948bfa350d3f0b9fd6988 received from {username='slave'} at 127.0.0.1:58006
I20260709 12:57:04.919552  1627 tablet_copy_service.cc:434] P c262eac7fc904ae9bb91e450f6532e3f: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-d8b7121a813948bfa350d3f0b9fd6988 on tablet d8b7121a813948bfa350d3f0b9fd6988 with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:57:04.933502  2368 ts_tablet_manager.cc:933] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903)
I20260709 12:57:04.944842  2360 ts_tablet_manager.cc:1434] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.067s	user 0.011s	sys 0.015s
I20260709 12:57:04.947242  2365 tablet_copy_client.cc:806] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:04.947888  2365 tablet_copy_client.cc:670] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:04.949849  2368 tablet_copy_client.cc:323] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43903
I20260709 12:57:04.951853  1550 tablet_copy_service.cc:140] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Received BeginTabletCopySession request for tablet 398a6324f64f46b0accba6cac64dfec6 from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:42356)
I20260709 12:57:04.952450  1550 tablet_copy_service.cc:161] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Beginning new tablet copy session on tablet 398a6324f64f46b0accba6cac64dfec6 from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:42356: session id = 1d6516ff61104bdda54bde95e92fe579-398a6324f64f46b0accba6cac64dfec6
I20260709 12:57:04.954319  1552 tablet_copy_service.cc:342] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-105edc3ce5964519acbd96dbaa975697 received from {username='slave'} at 127.0.0.1:42356
I20260709 12:57:04.954768  1552 tablet_copy_service.cc:434] P dbe6a89d0e1c4137b3a1b17bf4b520d8: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-105edc3ce5964519acbd96dbaa975697 on tablet 105edc3ce5964519acbd96dbaa975697 with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:57:04.961171  1550 tablet_copy_source_session.cc:215] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:04.965764  2368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 398a6324f64f46b0accba6cac64dfec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:04.972790  2365 tablet_copy_client.cc:538] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:04.981926  2365 tablet_bootstrap.cc:492] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:57:05.097110  2365 tablet_bootstrap.cc:700] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579: Time spent opening tablet: real 0.110s	user 0.007s	sys 0.023s
I20260709 12:57:05.170110  2368 tablet_copy_client.cc:806] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:05.177029  2368 tablet_copy_client.cc:670] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:05.186604  2303 raft_consensus.cc:1217] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:05.214180  2368 tablet_copy_client.cc:538] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:05.250178  2368 tablet_bootstrap.cc:492] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:57:05.288390  2365 tablet_bootstrap.cc:492] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:05.291563  2365 tablet_bootstrap.cc:492] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:57:05.292284  2365 ts_tablet_manager.cc:1403] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 0.311s	user 0.023s	sys 0.047s
I20260709 12:57:05.293917  2303 raft_consensus.cc:1217] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:05.295179  2365 raft_consensus.cc:359] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:05.296031  2365 raft_consensus.cc:740] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:57:05.308640  2365 consensus_queue.cc:260] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:05.310956  2365 ts_tablet_manager.cc:1434] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 12:57:05.312152  2368 tablet_bootstrap.cc:492] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:05.313133  2368 tablet_bootstrap.cc:492] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:57:05.313866  2368 ts_tablet_manager.cc:1403] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 0.064s	user 0.025s	sys 0.005s
I20260709 12:57:05.321841  2368 raft_consensus.cc:359] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:05.322804  2368 raft_consensus.cc:740] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:57:05.323536  2368 consensus_queue.cc:260] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:05.326027  2368 ts_tablet_manager.cc:1434] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:57:05.327783  1550 tablet_copy_service.cc:342] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-398a6324f64f46b0accba6cac64dfec6 received from {username='slave'} at 127.0.0.1:42356
I20260709 12:57:05.328219  1550 tablet_copy_service.cc:434] P dbe6a89d0e1c4137b3a1b17bf4b520d8: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-398a6324f64f46b0accba6cac64dfec6 on tablet 398a6324f64f46b0accba6cac64dfec6 with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:57:05.330345  1550 tablet_copy_service.cc:342] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-5c8fc263f1e8493db14b8c7a8e316a9f received from {username='slave'} at 127.0.0.1:42356
I20260709 12:57:05.330761  1550 tablet_copy_service.cc:434] P dbe6a89d0e1c4137b3a1b17bf4b520d8: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-5c8fc263f1e8493db14b8c7a8e316a9f on tablet 5c8fc263f1e8493db14b8c7a8e316a9f with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:57:05.430562  2303 raft_consensus.cc:1217] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:05.521234  2303 raft_consensus.cc:1217] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:05.728152  2378 raft_consensus.cc:1064] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:57:05.731627  2378 consensus_queue.cc:237] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:05.781169  2303 raft_consensus.cc:1275] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 1 LEARNER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:05.781903  1540 raft_consensus.cc:1275] T d8b7121a813948bfa350d3f0b9fd6988 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:05.783874  2139 consensus_queue.cc:1048] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:05.785707  2139 consensus_queue.cc:1048] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:05.802497  2138 raft_consensus.cc:1064] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:57:05.807410  2138 consensus_queue.cc:237] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:05.831650  1685 raft_consensus.cc:1275] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:05.832928  2303 raft_consensus.cc:1275] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 1 LEARNER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:05.833626  2374 consensus_queue.cc:1048] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:05.835718  2379 consensus_queue.cc:1048] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:05.861232  1616 raft_consensus.cc:1275] T 105edc3ce5964519acbd96dbaa975697 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:05.862852  2390 consensus_queue.cc:1048] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:05.881275  1690 raft_consensus.cc:1275] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:05.905947  2139 consensus_queue.cc:1048] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:05.911216  2390 raft_consensus.cc:2955] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:05.916409  2303 raft_consensus.cc:2955] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:05.920238  2378 raft_consensus.cc:2955] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:05.928514  1535 raft_consensus.cc:2955] T d8b7121a813948bfa350d3f0b9fd6988 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:05.943826  1615 raft_consensus.cc:2955] T 105edc3ce5964519acbd96dbaa975697 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 12:57:05.945643  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 89483.9us
I20260709 12:57:05.965905  1687 raft_consensus.cc:2955] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:06.004084  1690 raft_consensus.cc:2955] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:06.010162  1438 catalog_manager.cc:5697] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index 2 to 3, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:06.031196  2374 raft_consensus.cc:1064] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:57:06.035693  2374 consensus_queue.cc:237] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:06.050884  2303 raft_consensus.cc:2955] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:06.060420  2138 raft_consensus.cc:1064] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:57:06.063468  2138 consensus_queue.cc:237] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:06.075178  1615 raft_consensus.cc:1275] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:06.079550  2391 consensus_queue.cc:1048] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:06.082378  2302 raft_consensus.cc:1275] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 1 LEARNER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:06.084105  2391 consensus_queue.cc:1048] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:06.092120  1690 raft_consensus.cc:1275] T 5c8fc263f1e8493db14b8c7a8e316a9f P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:06.095201  2391 consensus_queue.cc:1048] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:06.106943  2302 raft_consensus.cc:1275] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 1 LEARNER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:06.111411  2396 consensus_queue.cc:1048] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:06.114151  1687 raft_consensus.cc:1275] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:06.116879  2379 consensus_queue.cc:1048] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:06.121222  1616 raft_consensus.cc:1275] T 398a6324f64f46b0accba6cac64dfec6 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:57:06.124089  2379 consensus_queue.cc:1048] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:06.131042  2379 raft_consensus.cc:2955] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:06.143194  1616 raft_consensus.cc:2955] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 12:57:06.202370  2405 log.cc:927] Time spent T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:57:06.208513  2302 raft_consensus.cc:2955] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:06.215545  2396 raft_consensus.cc:2955] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:06.217711  1615 raft_consensus.cc:2955] T 398a6324f64f46b0accba6cac64dfec6 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:06.233500  1689 raft_consensus.cc:2955] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:06.260751  2303 raft_consensus.cc:2955] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:06.376368  1690 raft_consensus.cc:2955] T 5c8fc263f1e8493db14b8c7a8e316a9f P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:06.385682  1439 catalog_manager.cc:5697] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 2 to 3, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:06.388257  1439 catalog_manager.cc:5697] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 2 to 3, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:06.418658  1438 catalog_manager.cc:5697] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index 2 to 3, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:06.439040  1540 consensus_queue.cc:237] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:06.442202  1535 consensus_queue.cc:237] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:06.442238  1533 consensus_queue.cc:237] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:06.462036  2302 raft_consensus.cc:1275] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:06.463778  2396 consensus_queue.cc:1048] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:06.469696  1688 raft_consensus.cc:1275] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:06.471086  2138 consensus_queue.cc:1048] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:06.473366  2303 raft_consensus.cc:1275] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:06.475069  2138 consensus_queue.cc:1048] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:06.487727  2374 raft_consensus.cc:2955] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:06.496960  1615 raft_consensus.cc:1275] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:06.500789  2301 raft_consensus.cc:2955] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:06.504741  2379 consensus_queue.cc:1048] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:06.497030  1690 raft_consensus.cc:1275] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:06.514674  2391 raft_consensus.cc:2955] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:06.519443  1615 raft_consensus.cc:2955] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:06.522145  2138 consensus_queue.cc:1048] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:06.516348  2303 raft_consensus.cc:2955] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:06.533211  2302 raft_consensus.cc:1275] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:06.536041  2396 consensus_queue.cc:1048] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:06.538682  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 105edc3ce5964519acbd96dbaa975697 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:06.545609  1438 catalog_manager.cc:5697] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index 3 to 4, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:06.551728  1616 consensus_queue.cc:237] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:06.560343  1440 catalog_manager.cc:5697] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 3 to 4, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:06.576933  2396 raft_consensus.cc:2955] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:06.586162  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5c8fc263f1e8493db14b8c7a8e316a9f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:06.596632  2303 raft_consensus.cc:1275] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:06.597126  1675 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c8fc263f1e8493db14b8c7a8e316a9f with delete_type TABLET_DATA_TOMBSTONED (TS 4487a53c51be4634bf1ef29c5248353d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50688
I20260709 12:57:06.603118  1689 raft_consensus.cc:2955] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:06.607673  1603 tablet_service.cc:1558] Processing DeleteTablet for tablet 105edc3ce5964519acbd96dbaa975697 with delete_type TABLET_DATA_TOMBSTONED (TS c262eac7fc904ae9bb91e450f6532e3f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49284
I20260709 12:57:06.614265  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 398a6324f64f46b0accba6cac64dfec6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:57:06.670064  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 78880.5us
I20260709 12:57:06.686975  2412 consensus_queue.cc:1048] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:06.695217  1690 raft_consensus.cc:1275] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:57:06.697341  2393 consensus_queue.cc:1048] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:06.713050  2393 raft_consensus.cc:2955] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:06.697264  1688 raft_consensus.cc:2955] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:06.718495  1438 catalog_manager.cc:5697] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index 3 to 4, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:06.723189  2303 raft_consensus.cc:2955] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:06.732730  1685 raft_consensus.cc:2955] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:06.737087  2302 raft_consensus.cc:2955] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:06.745767  1607 tablet_service.cc:1558] Processing DeleteTablet for tablet 398a6324f64f46b0accba6cac64dfec6 with delete_type TABLET_DATA_TOMBSTONED (TS c262eac7fc904ae9bb91e450f6532e3f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49284
I20260709 12:57:06.764083  1424 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d8b7121a813948bfa350d3f0b9fd6988 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:57:06.790755  2411 tablet_replica.cc:333] T 105edc3ce5964519acbd96dbaa975697 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 12:57:06.792524  2410 tablet_replica.cc:333] T 5c8fc263f1e8493db14b8c7a8e316a9f P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 12:57:06.817057  2411 raft_consensus.cc:2243] T 105edc3ce5964519acbd96dbaa975697 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:06.817786  2411 raft_consensus.cc:2272] T 105edc3ce5964519acbd96dbaa975697 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:06.822247  2411 ts_tablet_manager.cc:1916] T 105edc3ce5964519acbd96dbaa975697 P c262eac7fc904ae9bb91e450f6532e3f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:06.777566  1440 catalog_manager.cc:5697] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: config changed from index 3 to 4, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:06.926062  1525 tablet_service.cc:1558] Processing DeleteTablet for tablet d8b7121a813948bfa350d3f0b9fd6988 with delete_type TABLET_DATA_TOMBSTONED (TS dbe6a89d0e1c4137b3a1b17bf4b520d8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51498
W20260709 12:57:06.931586  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 49134.4us
I20260709 12:57:06.964097  2418 tablet_replica.cc:333] T d8b7121a813948bfa350d3f0b9fd6988 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 12:57:07.020185  2411 ts_tablet_manager.cc:1929] T 105edc3ce5964519acbd96dbaa975697 P c262eac7fc904ae9bb91e450f6532e3f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:07.021492  2411 log.cc:1199] T 105edc3ce5964519acbd96dbaa975697 P c262eac7fc904ae9bb91e450f6532e3f: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-1-root/wals/105edc3ce5964519acbd96dbaa975697
I20260709 12:57:07.024322  2411 tablet_replica.cc:333] T 398a6324f64f46b0accba6cac64dfec6 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 12:57:07.026697  2411 raft_consensus.cc:2243] T 398a6324f64f46b0accba6cac64dfec6 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:07.028370  2410 raft_consensus.cc:2243] T 5c8fc263f1e8493db14b8c7a8e316a9f P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:07.029435  2410 raft_consensus.cc:2272] T 5c8fc263f1e8493db14b8c7a8e316a9f P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:07.029937  1424 catalog_manager.cc:5028] TS c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): tablet 105edc3ce5964519acbd96dbaa975697 (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:57:07.040678  2410 ts_tablet_manager.cc:1916] T 5c8fc263f1e8493db14b8c7a8e316a9f P 4487a53c51be4634bf1ef29c5248353d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:07.051474  2411 raft_consensus.cc:2272] T 398a6324f64f46b0accba6cac64dfec6 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:07.060575  2411 ts_tablet_manager.cc:1916] T 398a6324f64f46b0accba6cac64dfec6 P c262eac7fc904ae9bb91e450f6532e3f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:07.092353  2418 raft_consensus.cc:2243] T d8b7121a813948bfa350d3f0b9fd6988 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:57:07.093269  2418 raft_consensus.cc:2272] T d8b7121a813948bfa350d3f0b9fd6988 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:57:07.096765  2418 ts_tablet_manager.cc:1916] T d8b7121a813948bfa350d3f0b9fd6988 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:57:07.113387  2410 ts_tablet_manager.cc:1929] T 5c8fc263f1e8493db14b8c7a8e316a9f P 4487a53c51be4634bf1ef29c5248353d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:07.113943  2410 log.cc:1199] T 5c8fc263f1e8493db14b8c7a8e316a9f P 4487a53c51be4634bf1ef29c5248353d: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-2-root/wals/5c8fc263f1e8493db14b8c7a8e316a9f
I20260709 12:57:07.116153  1427 catalog_manager.cc:5028] TS 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): tablet 5c8fc263f1e8493db14b8c7a8e316a9f (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:57:07.139029  2418 ts_tablet_manager.cc:1929] T d8b7121a813948bfa350d3f0b9fd6988 P dbe6a89d0e1c4137b3a1b17bf4b520d8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:07.139586  2418 log.cc:1199] T d8b7121a813948bfa350d3f0b9fd6988 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-0-root/wals/d8b7121a813948bfa350d3f0b9fd6988
I20260709 12:57:07.151242  2411 ts_tablet_manager.cc:1929] T 398a6324f64f46b0accba6cac64dfec6 P c262eac7fc904ae9bb91e450f6532e3f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:57:07.151260  1425 catalog_manager.cc:5028] TS dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): tablet d8b7121a813948bfa350d3f0b9fd6988 (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:57:07.151901  2411 log.cc:1199] T 398a6324f64f46b0accba6cac64dfec6 P c262eac7fc904ae9bb91e450f6532e3f: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-1-root/wals/398a6324f64f46b0accba6cac64dfec6
I20260709 12:57:07.153594  1424 catalog_manager.cc:5028] TS c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): tablet 398a6324f64f46b0accba6cac64dfec6 (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:57:08.076534  1691 consensus_queue.cc:237] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:08.084062  1615 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:08.087584  2424 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:57:08.093900  1540 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:08.095340  2408 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:08.146124  2424 raft_consensus.cc:2955] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:57:08.148128  1540 raft_consensus.cc:2955] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
W20260709 12:57:08.163422  1656 consensus_peers.cc:597] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 07ac6d2e7442458585e7eca31089d547. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:08.184293  1438 catalog_manager.cc:5697] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:57:08.199265  1540 consensus_queue.cc:237] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
W20260709 12:57:08.233363  1507 consensus_peers.cc:597] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d5d52e25b9814edbb805e7d6bcce5b5d. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:57:08.234555  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 46287.5us
I20260709 12:57:08.235080  1613 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:08.238199  2431 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:08.242502  1691 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:08.247779  2374 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:08.248266  1613 raft_consensus.cc:2955] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:57:08.268749  2374 raft_consensus.cc:2955] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:57:08.282030  1685 raft_consensus.cc:2955] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:57:08.293006  1613 raft_consensus.cc:2955] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:57:08.296512  1688 consensus_queue.cc:237] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:08.309504  1440 catalog_manager.cc:5697] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:08.323148  1615 raft_consensus.cc:1275] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:57:08.325249  1656 consensus_peers.cc:597] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4681eaad3084357b9677e4242b97c99. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:08.326135  2429 consensus_queue.cc:1048] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:08.331426  1540 raft_consensus.cc:1275] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:08.334496  2429 consensus_queue.cc:1048] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:57:08.352183  2433 raft_consensus.cc:2955] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:57:08.405467  1540 raft_consensus.cc:2955] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
W20260709 12:57:08.426599  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 63814.4us
I20260709 12:57:08.436352  1540 consensus_queue.cc:237] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
W20260709 12:57:08.443641  1507 consensus_peers.cc:597] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d127be99e2af41c0808e03480c1b64e3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:57:08.444828  1685 raft_consensus.cc:1275] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:08.446619  2430 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:08.449189  1613 raft_consensus.cc:2955] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:57:08.454344  1615 raft_consensus.cc:1275] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:57:08.457471  2138 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:08.469453  1438 catalog_manager.cc:5697] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:08.499373  2431 raft_consensus.cc:2955] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:57:08.502107  2451 ts_tablet_manager.cc:933] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:08.504768  1688 raft_consensus.cc:2955] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:57:09.603356  2449 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:09.606173  2449 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:09.608937  2449 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:09.613250  2451 tablet_copy_client.cc:323] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45275
I20260709 12:57:09.790494  2454 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:09.791301  2454 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:09.793684  2454 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:09.835002  1471 debug-util.cc:398] Leaking SignalData structure 0x7b08001bd520 after lost signal to thread 434
W20260709 12:57:10.364522  1471 debug-util.cc:398] Leaking SignalData structure 0x7b08001e3080 after lost signal to thread 1474
W20260709 12:57:10.364929  1471 debug-util.cc:398] Leaking SignalData structure 0x7b08001e2c20 after lost signal to thread 1488
I20260709 12:57:09.884323  2449 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.365751  2449 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.368023  2449 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:09.912266   436 debug-util.cc:398] Leaking SignalData structure 0x7b080000f9a0 after lost signal to thread 1505
I20260709 12:57:09.925854  2430 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:09.945474  2452 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:10.369562  2452 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:10.368924   436 kernel_stack_watchdog.cc:198] Thread 1505 stuck at /apache/dev/git/kudu/src/kudu/rpc/outbound_call.cc:307 for 191ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 12:57:10.095880  2455 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.368670  2449 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.369046  2430 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.373003  2456 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.373831  2452 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.371733  2455 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:10.372359  2449 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.375321  2430 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:10.372253  2268 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.009s	sys 0.017s
I20260709 12:57:10.376325  2449 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:10.376528  2268 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.009s	sys 0.017s
I20260709 12:57:10.377307  2455 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:10.373590  2456 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:10.380703  2456 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.395004  2459 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.395695  2459 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:10.398568  2459 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.400120  2457 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.400632  2459 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.400745  2457 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.401546  2458 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.402091  2458 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.403568  2457 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.404153  2458 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.404160  2457 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.404798  2458 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.404913  2457 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.405296  2458 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.407480  2458 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.407963  2458 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.408397  2458 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.410326  2459 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.410852  2457 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.411244  2458 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.412636  2459 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.418460  2463 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.419003  2463 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.420912  2449 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.421502  2449 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.422350  2454 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.422885  2454 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.423595  2449 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.424722  2455 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.425287  2455 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:10.426680  2454 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.427793  2455 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.429164  2463 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:10.428368  2455 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.430635  2464 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.432047  2455 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:10.432200  2464 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.435343  2464 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:10.436604  1688 consensus_meta.cc:287] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 1.926s	user 0.010s	sys 0.017s
I20260709 12:57:10.438042  2455 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.444252  2463 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.451117  2463 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:10.450271  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 550) took 1940 ms. Trace:
I20260709 12:57:10.456609  2467 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.457333  2429 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.450819  2464 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.457192  2467 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:10.453147  2462 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.453606  1688 rpcz_store.cc:276] 0709 12:57:08.504056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:08.504176 (+   120us) service_pool.cc:224] Handling call
0709 12:57:08.504458 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:08.504656 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:57:10.441631 (+1936975us) log.cc:844] Serialized 14 byte log entry
0709 12:57:10.444021 (+  2390us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:10.444071 (+    50us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:10.444113 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:10.444197 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:10.444317 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14376,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":224,"thread_start_us":1973,"threads_started":2,"wal-append.queue_time_us":895}
I20260709 12:57:10.458990  2429 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.466368  2454 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:10.466888  2429 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:10.466964  2454 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.467855  2429 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.468369  2429 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.472966  2454 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.465399  2462 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.460278  2464 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.474141  2429 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:10.477560  2449 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.487103  2471 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.479956  2452 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:10.498481  2452 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.499126  2464 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:10.495940  2471 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.500991  2452 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.507910  2452 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.513829  2464 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.515034  2464 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.496625  2467 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:10.518095  2430 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.510975  2452 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:10.528990  2430 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.495082  2449 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.533267  2463 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:10.533726  2449 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.531518  2452 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:10.534443  2431 consensus_meta.cc:287] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 2.026s	user 0.008s	sys 0.012s
I20260709 12:57:10.519963  2454 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.489578  2470 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.545392  2429 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.546128  2468 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.544118  2430 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.544507  2463 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.561978  2429 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.566741  2429 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:10.567344  2429 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.567598  2424 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.568245  2424 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.568670  2463 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.570847  2463 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:10.571388  2463 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.571832  2463 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.545555  2467 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.572722  2467 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.575525  2471 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:10.576139  2471 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.576628  2471 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.578703  2462 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:10.579286  2462 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.579785  2462 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.567857  2429 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.581825  2468 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.560801  2454 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.587602  2473 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.583675  2452 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:10.594987  2429 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:10.592571  2473 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.584271  2430 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.561689  2470 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.596747  1438 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54606 (request call id 138) took 2174 ms. Trace:
I20260709 12:57:10.595257  2452 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.588034  2449 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:10.596262  2471 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:10.599768  2472 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.600461  2463 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:10.600651  2449 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.588266  2467 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:10.604930  2475 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.602005  2462 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:10.597812  2424 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:10.605494  2475 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.608311  2465 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:10.609588  2473 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.611789  2452 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.611667  2465 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.614650  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:10.615504  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:10.606611  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:10.615597  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:10.619529  1691 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:10.616297  1688 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:10.606112  2431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:42346 (request call id 4) took 2181 ms. Trace:
I20260709 12:57:10.623950  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:10.606377  2430 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.626209  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:10.627609  2460 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.627956  2468 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:10.629454  2461 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:10.630869  2475 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.628286  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:10.630415  2460 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.635707  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:10.636302  1691 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:10.625669  2457 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.597185  1438 rpcz_store.cc:276] 0709 12:57:08.419209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:08.436908 (+ 17699us) service_pool.cc:224] Handling call
0709 12:57:08.528926 (+ 92018us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:08.528966 (+    40us) write_op.cc:454] Released schema lock
0709 12:57:10.593760 (+2064794us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:08.514770 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:08.515379 (+   609us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:08.515429 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:57:08.515462 (+    33us) tablet.cc:662] Decoding operations
0709 12:57:08.515814 (+   352us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:08.515864 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:08.515893 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:57:08.516117 (+   224us) tablet.cc:701] Row locks acquired
0709 12:57:08.516138 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:57:08.516303 (+   165us) write_op.cc:270] Start()
0709 12:57:08.516409 (+   106us) write_op.cc:276] Timestamp: P: 1783601828516260 usec, L: 0
0709 12:57:08.516430 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:57:08.517126 (+   696us) log.cc:844] Serialized 598 byte log entry
0709 12:57:08.520744 (+  3618us) op_driver.cc:464] REPLICATION: finished
0709 12:57:08.522937 (+  2193us) write_op.cc:301] APPLY: starting
0709 12:57:08.523052 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 12:57:08.523214 (+   162us) tablet.cc:1370] finished BulkCheckPresence
0709 12:57:08.523388 (+   174us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:57:08.523816 (+   428us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:57:08.524031 (+   215us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:57:08.524104 (+    73us) write_op.cc:312] APPLY: finished
0709 12:57:08.524431 (+   327us) log.cc:844] Serialized 22 byte log entry
0709 12:57:08.524738 (+   307us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:08.524853 (+   115us) write_op.cc:454] Released schema lock
0709 12:57:08.524906 (+    53us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":6454,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":1850,"apply.run_cpu_time_us":2451,"apply.run_wall_time_us":2451,"num_ops":1,"prepare.queue_time_us":131,"prepare.run_cpu_time_us":2694,"prepare.run_wall_time_us":2693,"replication_time_us":4148}]]}
I20260709 12:57:10.647423  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:10.648499  1691 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:10.649163  2457 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.621912  2431 rpcz_store.cc:276] 0709 12:57:08.421358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:08.434269 (+ 12911us) service_pool.cc:224] Handling call
0709 12:57:08.439841 (+  5572us) log.cc:844] Serialized 506 byte log entry
0709 12:57:10.602198 (+2162357us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":237,"raft.run_cpu_time_us":1897,"raft.run_wall_time_us":20189,"thread_start_us":754,"threads_started":1,"wal-append.queue_time_us":1081,"wal-append.run_cpu_time_us":1580,"wal-append.run_wall_time_us":1001600}
I20260709 12:57:10.650017  2463 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.650568  2463 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.632659  2461 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.607379  2472 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.651206  2457 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.679144  2477 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.640887  2464 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:10.650247  2430 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.647529  2424 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.651116  2470 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:10.656536  2468 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.677748  2429 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.651954  2465 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.692883  2476 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.692739  2429 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:10.679814  2477 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.693404  2476 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.698359  2474 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.699587  2429 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:10.700150  2460 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.691220  2470 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.689685  2464 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.723546  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:10.729067  2478 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.692414  2468 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.696558  2454 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.692194  2424 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.723469  2457 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.733557  2457 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.751680  2476 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:10.752224  2457 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.752674  2460 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.754678  2460 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.755116  2477 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:10.756726  2460 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.729789  2478 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.758688  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:10.759382  1688 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:10.702445  2470 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.762651  2424 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:10.767181  1691 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:10.731079  2464 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.730777  2461 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.783818  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:10.699601  2474 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:10.807247  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:10.796736  2430 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.804075  2463 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:10.817255  2416 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:10.808913  2431 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:10.821949  2483 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:10.814802  2461 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:10.819406  2457 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.823652  2483 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.821296  2430 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.822273  2463 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.826592  2424 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.824499  2431 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.817901  2416 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.989539  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:10.839458  2463 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.920894  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:10.991437  1689 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:10.831266  2472 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:11.001912  1686 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:10.919524  2486 ts_tablet_manager.cc:933] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903)
I20260709 12:57:10.945717  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:11.002516  1508 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:10.921960  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:10.946105  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:10.831866  2461 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:10.836268  2429 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.989303  2460 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:11.013144  2430 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:11.012953  2460 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.013540  2431 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.896531  2424 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:10.989562  2485 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.895398  2481 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.838884  2374 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:10.836592  2464 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:11.007853  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:11.018579  2464 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:11.010558  1687 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:11.011809  1508 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:10.946202  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:10.919571  2470 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:11.020022  2470 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:11.007620  2482 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:11.010787  1690 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:10.976197  2483 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.841187  2468 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:11.016829  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:11.015064  2460 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:11.015769  2424 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:11.015484  2485 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:11.015803  2429 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.017726  2374 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.018637  1689 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:10.830586  2457 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.019167  2464 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.020303  2463 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:10.970114  2432 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:10.836273  2476 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:11.004797  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.020553  2470 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.029668  2374 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:10.976596  2467 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:11.022675  2482 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.065212  2476 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.018293  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:11.049954  1613 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 1.
I20260709 12:57:11.028609  2431 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:11.049912  1508 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:11.020465  2481 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.021153  2472 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:10.832511  2484 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:11.074082  2484 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.074627  2482 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:11.075512  2374 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:11.075837  2478 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:11.076216  2485 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:11.076442  2474 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:11.074425  2449 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:11.072407  1508 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:11.076675  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:11.077666  2472 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:11.082552  2472 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:11.082647  1508 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:11.084570  2486 tablet_copy_client.cc:323] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43903
I20260709 12:57:11.086105  2487 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:11.086493  2487 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:11.086890  2487 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:11.087291  1550 tablet_copy_service.cc:140] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Received BeginTabletCopySession request for tablet d5d52e25b9814edbb805e7d6bcce5b5d from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:42356)
I20260709 12:57:11.088003  1550 tablet_copy_service.cc:161] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Beginning new tablet copy session on tablet d5d52e25b9814edbb805e7d6bcce5b5d from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:42356: session id = 1d6516ff61104bdda54bde95e92fe579-d5d52e25b9814edbb805e7d6bcce5b5d
I20260709 12:57:11.092692  1688 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:11.075970  2374 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:11.074659  2429 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:11.072973  2431 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:11.076357  2484 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:11.067471  2467 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.077222  2432 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:11.092015  1684 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:11.100935  2374 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:11.271078  2492 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:11.212483  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.157977  2464 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:11.272615  2492 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.213384  2472 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.212206  2489 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:11.274752  2489 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.275493  2492 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:11.249850  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.235792  2476 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:11.212674  1437 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54582 (request call id 143) took 2736 ms. Trace:
I20260709 12:57:11.277035  1437 rpcz_store.cc:276] 0709 12:57:08.462522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:08.466379 (+  3857us) service_pool.cc:224] Handling call
0709 12:57:11.199176 (+2732797us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":188084,"reported_tablets":1}
W20260709 12:57:11.236737  1471 debug-util.cc:398] Leaking SignalData structure 0x7b08000394c0 after lost signal to thread 1566
I20260709 12:57:11.270449  2420 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:11.244230  2487 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.201475  2488 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:11.166680  2459 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:11.167042  2458 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:11.279196  2420 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.284657  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.246742  1550 tablet_copy_source_session.cc:215] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:11.255043  2457 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:11.080826  2483 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:11.288550  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:11.247968  2497 ts_tablet_manager.cc:933] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903)
I20260709 12:57:11.106945  2491 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:11.106789  1508 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:11.295401  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 188694us
I20260709 12:57:11.295930  1508 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:11.106252  2431 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:11.156391  2481 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:11.281939  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.249853  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.237083  2470 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:11.278246  2432 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:11.249217  2494 ts_tablet_manager.cc:933] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:11.300555  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:11.282756  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:11.156661  1505 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.650s	user 0.039s	sys 0.136s
W20260709 12:57:11.283951  1471 debug-util.cc:398] Leaking SignalData structure 0x7b0800195480 after lost signal to thread 1641
I20260709 12:57:11.305120  1613 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
W20260709 12:57:11.305521  1471 debug-util.cc:398] Leaking SignalData structure 0x7b08001899e0 after lost signal to thread 1642
W20260709 12:57:11.306407  1471 debug-util.cc:398] Leaking SignalData structure 0x7b080030d2c0 after lost signal to thread 1716
W20260709 12:57:11.307091  1471 debug-util.cc:398] Leaking SignalData structure 0x7b080030c920 after lost signal to thread 2327
I20260709 12:57:11.167874  2460 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:11.277473  2489 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:11.284548  2458 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.288651  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:11.290094  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:11.253522  1440 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54590 (request call id 134) took 2771 ms. Trace:
I20260709 12:57:11.291004  2492 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:11.313943  1440 rpcz_store.cc:276] 0709 12:57:08.482021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:08.482155 (+   134us) service_pool.cc:224] Handling call
0709 12:57:11.253450 (+2771295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106003,"reported_tablets":1}
I20260709 12:57:11.315232  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.291440  2420 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:11.291829  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:11.292040  2485 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:11.292783  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:11.293299  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:11.289650  2483 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:11.325629  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:11.326309  1688 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:11.289449  2457 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:11.223879  2461 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:11.298952  1539 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:11.299047  2449 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:11.299342  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:11.343600  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.344206  1616 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:11.299840  2465 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:11.346306  2449 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:11.150430  2416 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:11.301292  1508 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:11.275561  2472 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:11.305008  1537 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:57:11.348507  2430 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:11.348783  2486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5d52e25b9814edbb805e7d6bcce5b5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:11.321074  2374 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:11.348137  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 46880.3us
I20260709 12:57:11.328681  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.329430  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.330857  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.330989  2485 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.331910  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.332410  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.324882  2492 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.310952  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.302079  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.340185  1540 raft_consensus.cc:1240] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:11.296311  2488 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:11.310431  2460 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.364599  2488 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:11.365420  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:11.366070  1688 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:57:11.341717  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:11.341163  2457 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.368614  2492 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:11.369336  1610 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:57:11.370200  2457 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:11.346514  2465 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:11.370374  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.370862  2465 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:11.371165  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.371685  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.352566  2430 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:11.327406  2483 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:11.375816   436 debug-util.cc:398] Leaking SignalData structure 0x7b080000f9c0 after lost signal to thread 1505
W20260709 12:57:11.308720  1505 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.852s	user 0.043s	sys 0.144s
I20260709 12:57:11.294658  2459 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.348186  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.350669  1608 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
W20260709 12:57:11.376503  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 2.92006e+06us
I20260709 12:57:11.353144  1508 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:11.352105  1617 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:57:11.356123  2374 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:11.359381  2485 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:11.351866  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.347472  2449 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:11.364640  2460 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:11.300745  2491 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.352105  1613 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:57:11.382474  1508 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:11.382987  2374 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:11.390112  2374 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:11.390496  2374 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:11.385931  1612 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:57:11.376619  2430 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:11.391718  2138 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:11.391878  1508 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:11.392807  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:11.395479  2138 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:11.395893  2138 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:11.390515  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:11.394058  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:11.396648  1690 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:57:11.394402  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:11.396792  1689 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:57:11.397277  1691 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:57:11.347065  2431 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.380419  2467 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:11.403414  1508 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:11.377038  1611 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:11.408795  2475 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:11.408938  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:11.404503  2266 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:11.410331  1508 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:11.411652  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.383814  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.417279  1440 catalog_manager.cc:5697] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:57:11.376912  1610 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:57:11.414353  2475 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:11.414930  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:11.418398  2374 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:11.419286  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:11.384965  2487 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:11.421236  1688 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:57:11.422165  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:11.420913  2475 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:11.420955  2452 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:11.423264  1614 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:57:11.423593  2452 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:11.453635  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:11.454190  2458 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:11.454591  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:11.455968  1689 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:11.415256  2454 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:11.457798  2452 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:11.470248  2454 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:11.485492  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.484719  2374 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:11.505868  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:11.511277  1691 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:11.485349  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.496443  1508 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:11.512607  2454 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:11.514696  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:11.515345  1690 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:11.517922  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:11.518676  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:11.519028  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:11.519583  1688 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:11.522035  2374 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:11.522396  2374 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:11.522651  2374 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:11.491844  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:11.485149  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.528878  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:11.529677  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:11.530894  1689 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:11.481784  2491 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:11.519475  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.553946  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.752159  1617 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
W20260709 12:57:11.648968  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 152592us
I20260709 12:57:11.655149  2374 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.555294  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:11.613404  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.757081  1686 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:57:11.535647  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.530169  2459 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:11.798794  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 44077us
I20260709 12:57:11.764127  2494 tablet_copy_client.cc:323] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45275
I20260709 12:57:11.591174  2431 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:11.799064  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.543749  2497 tablet_copy_client.cc:323] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43903
I20260709 12:57:11.570818  2475 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.830168  2374 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:11.545099  1608 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:57:11.774358  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:11.833837  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:11.549048  1614 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:57:11.839601  1688 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:11.841933  1685 raft_consensus.cc:1240] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:11.850083  1538 raft_consensus.cc:1240] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:11.852560  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:11.861524  1689 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:11.865262  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:11.866637  1691 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:11.863772  1701 tablet_copy_service.cc:140] P 4487a53c51be4634bf1ef29c5248353d: Received BeginTabletCopySession request for tablet 07ac6d2e7442458585e7eca31089d547 from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:33206)
I20260709 12:57:11.863620  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:11.885088  1538 raft_consensus.cc:1240] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:11.885864  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:11.889894  1701 tablet_copy_service.cc:161] P 4487a53c51be4634bf1ef29c5248353d: Beginning new tablet copy session on tablet 07ac6d2e7442458585e7eca31089d547 from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:33206: session id = 1d6516ff61104bdda54bde95e92fe579-07ac6d2e7442458585e7eca31089d547
I20260709 12:57:11.888968  2138 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.897995  1550 tablet_copy_service.cc:140] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Received BeginTabletCopySession request for tablet d127be99e2af41c0808e03480c1b64e3 from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:42356)
I20260709 12:57:11.898712  1550 tablet_copy_service.cc:161] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Beginning new tablet copy session on tablet d127be99e2af41c0808e03480c1b64e3 from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:42356: session id = 1d6516ff61104bdda54bde95e92fe579-d127be99e2af41c0808e03480c1b64e3
I20260709 12:57:11.889807  1700 tablet_copy_service.cc:140] P 4487a53c51be4634bf1ef29c5248353d: Received BeginTabletCopySession request for tablet e4681eaad3084357b9677e4242b97c99 from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:33206)
I20260709 12:57:11.902750  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:11.903411  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:11.894207  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:11.905445  2483 consensus_meta.cc:287] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.529s	user 0.005s	sys 0.013s
I20260709 12:57:11.904692  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.917737  2138 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:11.919073  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.895120  1536 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:57:11.922780  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.923457  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.924103  1613 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:57:11.927748  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:11.928541  1538 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:57:11.944432  1701 tablet_copy_source_session.cc:215] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:11.944504  1508 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:11.945976  2138 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:11.946306  1690 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:11.947134  1685 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:11.948364  1508 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:11.916714  2430 consensus_meta.cc:287] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.011s
I20260709 12:57:11.950436  2374 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:11.897998  2269 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:11.951136  2374 raft_consensus.cc:697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:11.946630  2138 raft_consensus.cc:697] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:11.952399  1508 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:11.915596  1700 tablet_copy_service.cc:161] P 4487a53c51be4634bf1ef29c5248353d: Beginning new tablet copy session on tablet e4681eaad3084357b9677e4242b97c99 from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:33206: session id = 1d6516ff61104bdda54bde95e92fe579-e4681eaad3084357b9677e4242b97c99
I20260709 12:57:11.957564  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:11.925619  1684 raft_consensus.cc:2468] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 1.
I20260709 12:57:11.962541  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:11.967160  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:11.971840  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:11.965920  2374 consensus_queue.cc:237] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:11.925352  2483 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.983583  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:11.984442  1536 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
W20260709 12:57:11.985616  2266 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.026s	sys 0.015s
W20260709 12:57:11.986243  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 696188us
I20260709 12:57:11.959820  2475 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:11.959242  2431 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:11.988662  2431 raft_consensus.cc:697] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:11.989529  2431 consensus_queue.cc:237] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.992726  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:11.963147  2465 consensus_meta.cc:287] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.592s	user 0.005s	sys 0.015s
I20260709 12:57:11.996271  1508 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:11.981689  2138 consensus_queue.cc:237] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.955782  2452 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.999926  2452 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:12.000730  2472 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:12.001325  2472 raft_consensus.cc:697] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:12.002252  2472 consensus_queue.cc:237] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:11.952822  2430 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:12.030872  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.029595  1534 raft_consensus.cc:1240] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:12.049245  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:12.050015  1613 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:57:12.051992  1550 tablet_copy_source_session.cc:215] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:12.023177  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:12.021968  2501 raft_consensus.cc:2804] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:12.006489  2465 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:12.061295  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:12.065886  1539 raft_consensus.cc:1240] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
W20260709 12:57:12.024192  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 126338us
I20260709 12:57:12.066524  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.045504  2502 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:12.068215  1535 raft_consensus.cc:1240] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:12.071556  1688 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:12.067102  2497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d127be99e2af41c0808e03480c1b64e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:12.023869  2507 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:12.045342  2452 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:12.088935  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:12.097467  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:12.098233  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:12.093468  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.069324  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:12.074184  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.106278  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:12.109781  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.109970  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:12.111161  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:12.112918  1690 raft_consensus.cc:1240] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:12.117137  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:12.069674  2501 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:12.118945  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:12.105940  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:12.123080  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:12.125087  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:12.126904  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:12.127833  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:12.131318  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:12.132709  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:12.113364  2269 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:12.134828  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.134368  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:12.138123  1690 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:57:12.140012  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:12.126559  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:12.104137  2452 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:12.133589  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:12.138100  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:12.142863  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:12.117425  2502 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:12.141187  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:12.133613  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:12.142227  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:12.122506  2501 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:12.132057  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.143064  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:12.146466  2449 consensus_meta.cc:287] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.754s	user 0.006s	sys 0.005s
I20260709 12:57:12.145745  2507 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:12.145233  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:12.194552  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:12.145972  2483 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:12.196892  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:12.155584  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:12.205945  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:12.213472  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:12.213790  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:12.206617  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:12.215451  1700 tablet_copy_source_session.cc:215] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:57:12.215966  2452 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:12.216892  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:12.219431  2454 consensus_meta.cc:287] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.692s	user 0.013s	sys 0.013s
I20260709 12:57:12.185550  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:12.181209  2465 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:12.206632  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:12.226265  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 148486us
I20260709 12:57:12.210582  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:12.181761  2430 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:12.212246  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:12.219192  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:12.227558  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 126247us
I20260709 12:57:12.236577  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:12.238065  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:12.230074  1654 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 1.505s (SENT) [suppressed 5 similar messages]
I20260709 12:57:12.242420  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.243052  1538 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:57:12.243841  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.242096  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.245118  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:12.246147  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.225260  2454 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:12.247349  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.235033  2451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07ac6d2e7442458585e7eca31089d547. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:12.248037  1540 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:12.239713  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:12.251559  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:12.252043  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.195935  2449 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:12.253700  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.273003  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:12.273900  1538 raft_consensus.cc:2393] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 2: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:12.236303  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.277761  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:12.278038  2454 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:12.278450  1682 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
W20260709 12:57:12.279134  2511 log.cc:927] Time spent T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:57:12.234377  2269 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:12.280800  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 46617.9us
I20260709 12:57:12.282703  1537 raft_consensus.cc:1240] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:12.283248  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:12.277179  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.305945  1583 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:12.292246  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.303013  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.291950  2507 raft_consensus.cc:2804] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:12.294799  2515 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:12.312331  1539 raft_consensus.cc:2393] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 2: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:12.321162  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.321411  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.311991  2507 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:12.328058  2486 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:32794 (request call id 44) took 1716 ms. Trace:
I20260709 12:57:12.312732  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:12.328569  2486 rpcz_store.cc:276] 0709 12:57:10.611910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:10.756663 (+144753us) service_pool.cc:224] Handling call
0709 12:57:11.027961 (+271298us) ts_tablet_manager.cc:934] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903)
0709 12:57:11.346347 (+318386us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:57:11.991464 (+645117us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:11.991594 (+   130us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:57:12.327218 (+335624us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:57:12.327554 (+   336us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:12.327893 (+   339us) ts_tablet_manager.cc:989] Replica registered.
0709 12:57:12.327964 (+    71us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":328,"tablet-copy.queue_time_us":81977,"thread_start_us":72382,"threads_started":2}
I20260709 12:57:12.329164  2507 raft_consensus.cc:3060] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:12.333137  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.334749  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.339475  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.341410  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.343142  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.345378  2494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4681eaad3084357b9677e4242b97c99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:12.348953  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:12.363970  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 54554.9us
I20260709 12:57:12.364161  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.364706  1583 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:57:12.365919  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 135923us
W20260709 12:57:12.366359  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 85927.4us
I20260709 12:57:12.333024  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:12.357283  2512 log.cc:927] Time spent T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:57:12.358894  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.368031  2486 tablet_copy_client.cc:806] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:12.532945  2486 tablet_copy_client.cc:670] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:12.316987  2515 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:12.533674  1539 raft_consensus.cc:2393] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 2: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:12.497105  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:12.499125  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:12.499819  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:12.500587  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:12.535046  2515 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:12.501266  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:12.501740  2449 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:12.504369  2497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:32794 (request call id 43) took 1895 ms. Trace:
I20260709 12:57:12.505359  2502 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:12.539390  2497 rpcz_store.cc:276] 0709 12:57:10.608807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:10.945942 (+337135us) service_pool.cc:224] Handling call
0709 12:57:11.301900 (+355958us) ts_tablet_manager.cc:934] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903)
0709 12:57:12.054275 (+752375us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:57:12.496468 (+442193us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:12.496622 (+   154us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:57:12.503591 (+  6969us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:57:12.503883 (+   292us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:12.504240 (+   357us) ts_tablet_manager.cc:989] Replica registered.
0709 12:57:12.504304 (+    64us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":149910,"tablet-copy.queue_time_us":301257,"thread_start_us":404303,"threads_started":2}
I20260709 12:57:12.329953  2517 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:12.517624  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.540885  2497 tablet_copy_client.cc:806] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:12.518963  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.519929  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.520365  1440 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54606 (request call id 139) took 1111 ms. Trace:
I20260709 12:57:12.521224  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.521503  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.543581  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.521703  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.523705  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.528911  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:12.531632  2501 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:12.533427  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.517952  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.535683  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.496711  2507 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:12.551419  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.552037  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.552608  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.553174  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.552677  2301 raft_consensus.cc:1240] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 2 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:12.540899  2517 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:12.554174  2517 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:12.555553  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:12.541873  1617 raft_consensus.cc:2955] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:57:12.549404  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.549893  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.549192  1542 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:57:12.550925  1541 raft_consensus.cc:2393] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 2: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:12.551370  1536 raft_consensus.cc:2393] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 2: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:12.569802  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:12.570186  2451 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:32802 (request call id 2) took 4085 ms. Trace:
I20260709 12:57:12.571630  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.572465  2486 tablet_copy_client.cc:538] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:12.570744  2451 rpcz_store.cc:276] 0709 12:57:08.485175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:08.485343 (+   168us) service_pool.cc:224] Handling call
0709 12:57:08.509632 (+ 24289us) ts_tablet_manager.cc:934] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
0709 12:57:12.233648 (+3724016us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:57:12.510261 (+276613us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:12.510377 (+   116us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:57:12.569451 (+ 59074us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:57:12.569747 (+   296us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:12.570035 (+   288us) ts_tablet_manager.cc:989] Replica registered.
0709 12:57:12.570096 (+    61us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":733,"tablet-copy.queue_time_us":16048,"thread_start_us":35126,"threads_started":2}
I20260709 12:57:12.548321  2520 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:12.573730  2520 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:12.574085  2520 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:12.574836  1540 raft_consensus.cc:2393] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 2: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:12.575263  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:12.553486  2507 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:12.544768  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 177835us
I20260709 12:57:12.561833  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:12.548007  2497 tablet_copy_client.cc:670] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:12.542101  1440 rpcz_store.cc:276] 0709 12:57:11.409313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:11.409488 (+   175us) service_pool.cc:224] Handling call
0709 12:57:12.520269 (+1110781us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:11.875212 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:11.959734 (+ 84522us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:11.962394 (+  2660us) write_op.cc:435] Acquired schema lock
0709 12:57:11.966480 (+  4086us) tablet.cc:662] Decoding operations
0709 12:57:12.025836 (+ 59356us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:12.029408 (+  3572us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:12.045455 (+ 16047us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:57:12.068937 (+ 23482us) tablet.cc:701] Row locks acquired
0709 12:57:12.070336 (+  1399us) write_op.cc:260] PREPARE: finished
0709 12:57:12.085053 (+ 14717us) write_op.cc:270] Start()
0709 12:57:12.100099 (+ 15046us) write_op.cc:276] Timestamp: P: 1783601832084998 usec, L: 0
0709 12:57:12.102687 (+  2588us) op_driver.cc:348] REPLICATION: starting
0709 12:57:12.133449 (+ 30762us) log.cc:844] Serialized 598 byte log entry
0709 12:57:12.346911 (+213462us) op_driver.cc:464] REPLICATION: finished
0709 12:57:12.502855 (+155944us) write_op.cc:301] APPLY: starting
0709 12:57:12.502926 (+    71us) tablet.cc:1367] starting BulkCheckPresence
0709 12:57:12.503038 (+   112us) tablet.cc:1370] finished BulkCheckPresence
0709 12:57:12.503149 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:57:12.503367 (+   218us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:57:12.503519 (+   152us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:57:12.503564 (+    45us) write_op.cc:312] APPLY: finished
0709 12:57:12.503752 (+   188us) log.cc:844] Serialized 22 byte log entry
0709 12:57:12.503941 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:12.504028 (+    87us) write_op.cc:454] Released schema lock
0709 12:57:12.504068 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:57:12.504442 (+   374us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:12.504516 (+    74us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":155723,"apply.run_cpu_time_us":1547,"apply.run_wall_time_us":1547,"num_ops":1,"prepare.queue_time_us":393617,"prepare.run_cpu_time_us":32471,"prepare.run_wall_time_us":364332,"raft.queue_time_us":110739,"raft.run_cpu_time_us":13115,"raft.run_wall_time_us":148113,"replication_time_us":244061,"thread_start_us":476343,"threads_started":4,"wal-append.queue_time_us":98393}]]}
I20260709 12:57:12.563185  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.573383  2451 tablet_copy_client.cc:806] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:12.582027  1685 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:57:12.583988  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 219362us
I20260709 12:57:12.580193  2302 raft_consensus.cc:1240] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 2 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:12.587765  1654 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:12.590528  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.580145  2267 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:12.591328  2501 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:12.594445  2501 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:12.591208  1534 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:57:12.592530  2518 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:12.596671  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:12.597083  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:12.586377  2451 tablet_copy_client.cc:670] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:12.571540  2517 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:12.598052  2518 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:12.605621  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.614167  1537 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:57:12.604799  2518 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:12.604341  1654 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:12.618613  1654 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:57:12.628620  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 50760.4us
I20260709 12:57:12.629823  2520 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:12.632297  2520 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:12.634563  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.621764  2467 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:12.649134  2467 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:12.649216  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.649648  2467 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:12.621946  2515 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:12.652925  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.660567  2449 consensus_queue.cc:1059] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:12.660971  2515 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:12.619926  2431 consensus_queue.cc:1059] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:57:12.664741  1540 raft_consensus.cc:2393] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 2: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:12.664026  1440 catalog_manager.cc:5697] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 1 to 2, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:12.667042  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.667161  1440 catalog_manager.cc:5697] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 1 to 2, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
W20260709 12:57:12.668190  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 48685.6us
I20260709 12:57:12.670670  2449 raft_consensus.cc:3055] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:12.670967  2431 raft_consensus.cc:3055] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:12.671407  2431 raft_consensus.cc:740] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:12.672953  2451 tablet_copy_client.cc:538] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:12.672183  2431 consensus_queue.cc:260] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:12.674564  2431 raft_consensus.cc:3060] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:12.669113  1440 catalog_manager.cc:5697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 1 to 2, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:12.679870  1505 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:12.666065  2518 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:12.681151  1505 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:12.682482  2518 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:12.683164  2494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:32802 (request call id 3) took 1534 ms. Trace:
I20260709 12:57:12.681342  1440 catalog_manager.cc:5697] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 2 to 3, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:12.683580  2374 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:12.684108  2483 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:12.669008  2515 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:12.663522  2497 tablet_copy_client.cc:538] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:57:12.677191  2523 log.cc:927] Time spent T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:57:12.684346  1505 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:12.686476  2472 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:12.690155  1505 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:12.691788  1505 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:12.692605  2472 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:12.683583  2494 rpcz_store.cc:276] 0709 12:57:11.156376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:11.198905 (+ 42529us) service_pool.cc:224] Handling call
0709 12:57:11.310416 (+111511us) ts_tablet_manager.cc:934] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
0709 12:57:12.291612 (+981196us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:57:12.526598 (+234986us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:12.526707 (+   109us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:57:12.682481 (+155774us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:57:12.682749 (+   268us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:12.683044 (+   295us) ts_tablet_manager.cc:989] Replica registered.
0709 12:57:12.683104 (+    60us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":131454,"tablet-copy.queue_time_us":46211,"thread_start_us":356949,"threads_started":2}
I20260709 12:57:12.693403  2472 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:12.693830  2494 tablet_copy_client.cc:806] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:57:12.693694  2517 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:12.698050  1505 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:12.700398  2431 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:12.701603  1505 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:12.702337  2486 tablet_bootstrap.cc:492] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:57:12.703073  1654 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:12.671068  2449 raft_consensus.cc:740] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:12.704586  2518 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:12.705011  2518 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:12.694386  2494 tablet_copy_client.cc:670] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:57:12.705158  2449 consensus_queue.cc:260] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:12.706034  2518 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:12.706557  2449 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:12.711681  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 81535.2us
I20260709 12:57:12.717599  2515 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:12.718736  2494 tablet_copy_client.cc:538] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:57:12.719998  2515 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:12.734457  1581 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:12.735059  2459 consensus_queue.cc:1059] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:12.727888  2431 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:12.737980  2451 tablet_bootstrap.cc:492] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:57:12.727978  2497 tablet_bootstrap.cc:492] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:57:12.721251  2467 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:12.749447  2527 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:12.752803  2527 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:12.753187  2527 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:12.726651  2518 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:12.732064  1654 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:57:12.745852  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 161077us
W20260709 12:57:12.745167  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 43638.7us
I20260709 12:57:12.759217  1505 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:12.759589  1654 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:12.760979  2449 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:12.761777  2467 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:12.761844  2530 consensus_queue.cc:1059] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:12.762413  2515 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:12.762804  2515 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:12.763130  2526 raft_consensus.cc:3055] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:12.763636  2526 raft_consensus.cc:740] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:12.757476  1583 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:12.764770  1583 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:12.764427  2526 consensus_queue.cc:260] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:12.766088  2526 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:12.766129  1505 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:12.767051  2528 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:12.768332  2449 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:12.767508  1583 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:12.769131  1654 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:12.768412  2528 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:12.769999  2528 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:12.770334  1505 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:12.763181  2515 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:12.772840  2467 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:12.773272  2467 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:12.773654  2467 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:12.775621  2520 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:12.776034  2520 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:12.776387  2520 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:12.771647  1583 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:12.778635  1505 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:12.779641  1583 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:12.776736  2529 raft_consensus.cc:3055] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:12.785084  2524 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:12.787770  2517 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:12.787726  2431 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:12.788494  2517 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:12.788926  2517 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:12.767722  2530 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:12.795017  2530 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:12.795435  2530 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:12.771096  2459 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:12.799677  1654 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:12.785313  2529 raft_consensus.cc:740] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:12.796391  2517 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:12.798270  2459 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:12.805450  1654 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:12.796233  2472 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:12.820852  1654 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:12.835471  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:57:12.840204  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 52581.6us
I20260709 12:57:12.841640  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:12.847337  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:12.856963  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:12.858287  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:12.859830  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:12.860532  2532 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:12.819101  2459 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:12.864378  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:12.866715  2533 consensus_queue.cc:1059] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:12.867003  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.867288  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:12.867717  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:12.812949  2531 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:12.871155  1617 raft_consensus.cc:3055] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:12.871503  1617 raft_consensus.cc:740] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:12.870296  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.870633  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.874599  1505 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:12.845341  2530 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:12.884755  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 52063.1us
I20260709 12:57:12.885000  2535 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:57:12.887194  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 66449.9us
I20260709 12:57:12.887351  2535 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:12.887960  2535 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:12.887977  1654 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:12.889499  1654 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:12.890374  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.890400  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.892109  1540 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:57:12.860993  2532 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:12.890576  1617 consensus_queue.cc:260] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:12.859917  2534 consensus_queue.cc:1059] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:57:12.900156  2536 raft_consensus.cc:3055] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:12.900805  2536 raft_consensus.cc:740] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:12.901026  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:12.901705  2536 consensus_queue.cc:260] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:12.903422  2524 raft_consensus.cc:3055] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:12.903825  2524 raft_consensus.cc:740] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:12.907068  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:12.882731  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:12.902300  2530 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:12.910818  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:12.895785  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:12.911521  1617 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:12.889632  2538 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:12.889957  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:12.900158  1654 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:12.885586  2449 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:12.890148  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:12.907687  1616 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:12.895988  2532 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:12.926148  1505 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:12.927011  2374 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:12.927011  2537 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:12.927644  2374 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:12.927728  2537 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:12.928073  2374 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:12.928207  2537 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:12.935601  2374 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:12.925316  1542 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:57:12.913136  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:12.938510  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 107977us
I20260709 12:57:12.919037  1654 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:12.918263  2538 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:12.923086  2518 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:12.922535  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:12.947978  1581 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:12.944466  2374 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:12.951449  1581 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:12.951927  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 111040us
I20260709 12:57:12.953646  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:12.954265  1609 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:12.955510  1654 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:12.884123  2529 consensus_queue.cc:260] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:12.936216  2537 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:12.959981  1583 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:12.960153  1617 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:12.936929  2515 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:12.947636  2538 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:12.952558  1581 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:12.965389  1617 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:12.966188  2517 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:12.966749  1608 raft_consensus.cc:3055] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:12.951301  2525 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:12.952030  2531 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:12.965204  1536 raft_consensus.cc:2393] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 2: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:12.958966  2516 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:12.967206  1608 raft_consensus.cc:740] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:12.959905  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:12.975551  2531 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:13.000157  2465 consensus_queue.cc:1059] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:57:12.989959  2529 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:12.968622  2467 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:12.983619  2516 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:13.000240  2454 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:57:13.003530  2494 tablet_bootstrap.cc:492] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:57:12.999487  2533 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:13.010021  1612 raft_consensus.cc:1240] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:12.946398  2524 consensus_queue.cc:260] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:13.003260  2530 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:13.012390  1608 consensus_queue.cc:260] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:13.019812  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 128317us
I20260709 12:57:13.001785  2518 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:13.004213  2531 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:13.008602  2516 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:13.020570  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:13.025493  1505 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:13.039824  2505 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:13.022951  2518 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:13.040704  2524 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:13.041007  2518 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:13.021860  2530 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:13.020855  2465 consensus_queue.cc:1059] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:57:13.064211  2527 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:13.065625  2502 raft_consensus.cc:3055] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:13.066051  2502 raft_consensus.cc:740] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:13.068002  2527 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:13.049746  1609 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:13.041628  1608 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:13.058269  2530 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:13.082244  2537 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:13.085377  1505 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:13.079690  2502 consensus_queue.cc:260] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:13.109845  2374 raft_consensus.cc:3055] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:13.110307  2374 raft_consensus.cc:740] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:13.111258  2374 consensus_queue.cc:260] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:13.116667  2539 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:13.117288  2539 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:13.117779  2539 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:13.088599  2454 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:13.115705  2520 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:13.130394  2374 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:13.137818  2502 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:13.143700  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:13.133200  2454 raft_consensus.cc:697] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:13.126675  2515 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:13.145089  2520 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:13.133157  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 169187us
I20260709 12:57:13.163125  2467 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:13.156232  2454 consensus_queue.cc:237] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:13.165035  1609 raft_consensus.cc:1240] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:13.170568  1654 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:13.174325  1616 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:13.196774  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:13.153271  2536 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:13.200145  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:13.200852  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:13.204033  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:13.221493  1691 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:13.221717  1685 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:13.198684  2515 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:13.230577  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:13.231791  2486 tablet_bootstrap.cc:492] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:13.232848  2486 tablet_bootstrap.cc:492] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
W20260709 12:57:13.255982  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:13.226027  1690 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:13.160072  2532 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
W20260709 12:57:13.269686  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:13.270040  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 249238us
I20260709 12:57:13.173996  2535 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:13.205407  2518 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:13.226519  2515 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:13.222978  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:13.224831  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:13.270673  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:13.353880  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 401424us
I20260709 12:57:13.181574  2431 consensus_queue.cc:1059] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.106s
I20260709 12:57:13.184787  2472 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:57:13.331568  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:57:13.368777  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 141072us
I20260709 12:57:13.381803  1655 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:13.389377  1581 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:13.392086  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:13.420097  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:13.386641  2515 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:13.411392  2528 consensus_meta.cc:287] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.640s	user 0.014s	sys 0.005s
I20260709 12:57:13.420428  2486 ts_tablet_manager.cc:1403] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 0.718s	user 0.018s	sys 0.019s
I20260709 12:57:13.429385  1581 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:13.429677  2525 consensus_queue.cc:1059] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
W20260709 12:57:13.437322  1657 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.001s	sys 0.025s
W20260709 12:57:13.437803  1657 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.001s	sys 0.025s
I20260709 12:57:13.437383  2542 raft_consensus.cc:2764] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:57:13.440587  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:13.419951  2520 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:13.479657  1608 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:13.481720  2486 raft_consensus.cc:359] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:13.482739  2486 raft_consensus.cc:740] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:57:13.483491  2486 consensus_queue.cc:260] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:13.440286  2528 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:13.491556  2535 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:13.493189  2528 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:13.497211  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:13.499157  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:13.505988  1616 raft_consensus.cc:1240] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:13.507141  2467 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:57:13.508136  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 70291.9us
I20260709 12:57:13.508420  2525 raft_consensus.cc:3055] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:13.426811  2534 consensus_queue.cc:1059] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:57:13.428922  2527 consensus_queue.cc:1059] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:57:13.452802  2520 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:13.545758  1616 raft_consensus.cc:1240] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 1. Current term is 2. Ops: []
W20260709 12:57:13.548588  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:13.510684  2525 raft_consensus.cc:740] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:57:13.553262  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:13.476400  2530 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:13.508736  2533 consensus_queue.cc:1059] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:57:13.519614  2520 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:13.557192  1583 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.013s	sys 0.019s
W20260709 12:57:13.562945  1583 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.013s	sys 0.019s
W20260709 12:57:13.564590  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 604714us
I20260709 12:57:13.571821  1613 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:13.570524  1583 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:13.577401  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 366695us
I20260709 12:57:13.580096  1583 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:13.571120  1608 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:13.556087  2467 consensus_queue.cc:1059] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:57:13.584298  1508 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:13.589185  1508 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:13.590045  2374 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:57:13.579706  2516 consensus_meta.cc:287] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.551s	user 0.021s	sys 0.000s
I20260709 12:57:13.556427  2546 consensus_queue.cc:1059] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
W20260709 12:57:13.583930  2538 consensus_meta.cc:287] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.609s	user 0.011s	sys 0.006s
I20260709 12:57:13.569551  2539 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:13.581148  2532 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:13.585819  2527 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:57:13.586970  2459 consensus_meta.cc:287] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.710s	user 0.006s	sys 0.005s
I20260709 12:57:13.601787  1508 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:13.583894  2518 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:13.594691  2552 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:13.619204  1508 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:13.619865  2374 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:13.608654  2459 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:13.627167  2459 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:13.629521  1617 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:13.601658  2527 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:13.634542  2526 raft_consensus.cc:3055] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:13.613375  2528 raft_consensus.cc:3055] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:13.641781  2539 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:13.596406  2516 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:13.618384  2534 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:57:13.643888  2531 consensus_meta.cc:287] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.617s	user 0.001s	sys 0.008s
I20260709 12:57:13.600059  2538 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:13.615046  2537 raft_consensus.cc:3055] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:13.640002  2549 consensus_queue.cc:1059] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 12:57:13.647208  2505 raft_consensus.cc:3055] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:57:13.647584  2529 consensus_meta.cc:287] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.640s	user 0.007s	sys 0.002s
I20260709 12:57:13.581326  2525 consensus_queue.cc:260] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:13.648308  2524 raft_consensus.cc:3055] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:13.685572  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:13.660185  2528 raft_consensus.cc:740] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:13.687511  1616 raft_consensus.cc:1240] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:13.700111  2541 raft_consensus.cc:3055] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:13.700600  2541 raft_consensus.cc:740] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:13.701874  1535 raft_consensus.cc:1240] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:13.704058  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:57:13.695257  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 84180.1us
I20260709 12:57:13.706300  1617 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:13.688321  2505 raft_consensus.cc:740] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:13.659755  2527 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:13.676129  2502 consensus_meta.cc:287] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.526s	user 0.008s	sys 0.002s
I20260709 12:57:13.660064  2526 raft_consensus.cc:740] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:57:13.689991  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 308274us
W20260709 12:57:13.697443  2548 log.cc:927] Time spent T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.121s	user 0.003s	sys 0.000s
I20260709 12:57:13.692714  1615 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:13.650682  2515 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:13.677757  2530 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:13.682408  2537 raft_consensus.cc:740] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:13.697291  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:13.684126  2531 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:13.695431  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:13.696216  2525 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:13.693181  2431 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:57:13.708043  1507 consensus_peers.cc:597] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:57:13.687983  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 75610us
I20260709 12:57:13.693238  2524 raft_consensus.cc:740] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:13.713603  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:13.715179  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:13.715866  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:13.730360  2520 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:13.716265  1537 raft_consensus.cc:1240] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:13.718564  1655 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:13.692409  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 73293.2us
I20260709 12:57:13.733824  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:13.719000  2551 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:13.725242  1505 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
W20260709 12:57:13.720116  2536 consensus_meta.cc:287] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.000s
I20260709 12:57:13.729367  1535 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:13.742257  1508 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:13.733054  1609 raft_consensus.cc:1240] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:13.744913  2374 consensus_queue.cc:1059] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:13.728971  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:13.728693  2449 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:57:13.754117  1617 raft_consensus.cc:1240] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:13.753993  1508 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:13.734323  2520 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:13.758008  1655 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:13.783299  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:13.747880  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:13.742578  2551 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:13.819325  2553 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:13.758200  2465 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:13.854947  2516 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:13.850203  1583 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:13.856942  2524 consensus_queue.cc:260] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:13.858254  2524 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:13.859041  2530 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:13.861246  1583 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:13.863176  1583 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:13.843986  2563 consensus_queue.cc:1059] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.131s
I20260709 12:57:13.865731  2563 raft_consensus.cc:3055] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:13.866133  2563 raft_consensus.cc:740] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:13.781476  2547 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:13.743232  2549 consensus_queue.cc:1059] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:57:13.819829  2560 consensus_queue.cc:1059] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.099s
W20260709 12:57:13.833391  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 79477.3us
I20260709 12:57:13.846062  1533 raft_consensus.cc:1240] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:13.871707  2549 raft_consensus.cc:3055] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:13.872044  2549 raft_consensus.cc:740] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:13.874194  1583 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:13.834925  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 77001.1us
I20260709 12:57:13.833053  2452 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:13.839468  2531 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:13.872844  2549 consensus_queue.cc:260] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:13.876047  2516 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:13.876457  2516 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:13.869210  2563 consensus_queue.cc:260] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:13.878101  2516 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:13.878314  2563 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:13.878813  2515 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:13.879535  1655 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:13.880813  1655 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:13.881493  2531 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:13.881827  2515 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:13.841686  2486 ts_tablet_manager.cc:1434] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.401s	user 0.025s	sys 0.033s
I20260709 12:57:13.752717  2483 consensus_queue.cc:1059] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:57:13.872984  2552 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:57:13.741235  2528 consensus_queue.cc:260] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:13.755074  1534 raft_consensus.cc:1240] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:13.833200  1540 raft_consensus.cc:1240] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:13.759315  2526 consensus_queue.cc:260] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:13.744591  2541 consensus_queue.cc:260] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:13.756074  2505 consensus_queue.cc:260] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:13.939034  2526 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:13.939435  2502 consensus_queue.cc:1175] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4487a53c51be4634bf1ef29c5248353d" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
W20260709 12:57:13.940801  2536 consensus_queue.cc:1175] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4487a53c51be4634bf1ef29c5248353d" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:57:13.938805  1614 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:13.938863  2541 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:13.940084  1541 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:13.783461  2538 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:13.845420  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:13.849977  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:13.947161  1617 raft_consensus.cc:2393] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 2: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:13.850787  2551 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:13.850360  2553 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:13.957727  2551 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:13.957880  1535 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:13.958294  2551 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:13.960433  2551 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:13.964570  2515 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:13.868386  2561 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:13.844710  2556 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:13.868101  1539 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:13.873659  1508 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:13.874974  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 595) took 1023 ms. Trace:
I20260709 12:57:13.993991  2556 raft_consensus.cc:697] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:13.994061  1615 rpcz_store.cc:276] 0709 12:57:12.851451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:12.859229 (+  7778us) service_pool.cc:224] Handling call
0709 12:57:12.861543 (+  2314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:13.719502 (+857959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:13.873446 (+153944us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b54002a62d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:13.874909 (+  1463us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1910871808}
W20260709 12:57:13.994382  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 120794us
I20260709 12:57:13.994975  2556 consensus_queue.cc:237] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:13.997632  2454 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:14.010592  2552 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:14.011279  1688 raft_consensus.cc:1240] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:14.009704  2515 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:14.011875  2515 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.012028  2452 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:57:13.932273  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 58158.6us
I20260709 12:57:14.013924  2515 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:14.014375  1583 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:13.930474  1437 catalog_manager.cc:5697] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 1 to 2, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:13.874042  2534 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:13.934712  2483 raft_consensus.cc:3055] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:13.965969  2497 tablet_bootstrap.cc:492] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:13.929314  2527 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.016669  2483 raft_consensus.cc:740] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:14.018029  2483 consensus_queue.cc:260] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.018576  2527 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:14.019204  2527 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:14.019258  2483 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.015879  1583 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:14.020736  2530 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:13.972322  2451 tablet_bootstrap.cc:492] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:57:13.985594  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:14.020717  2497 tablet_bootstrap.cc:492] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:57:14.021798  1583 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:14.025125  2497 ts_tablet_manager.cc:1403] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 1.297s	user 0.032s	sys 0.018s
I20260709 12:57:14.025497  1583 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:14.026252  2530 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:14.026623  1583 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:14.026904  2552 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:14.015826  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 582) took 1182 ms. Trace:
I20260709 12:57:14.027535  2530 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:14.027700  1583 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:14.028486  2530 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:14.028846  1583 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:14.028862  2530 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:14.029768  2530 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.027808  1614 rpcz_store.cc:276] 0709 12:57:12.833339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:12.861993 (+ 28654us) service_pool.cc:224] Handling call
0709 12:57:14.015633 (+1153640us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b54002ffb54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:14.015740 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1947519232}
I20260709 12:57:14.026885  2527 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:14.029019  2552 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:13.990694  1550 tablet_copy_service.cc:342] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-d5d52e25b9814edbb805e7d6bcce5b5d received from {username='slave'} at 127.0.0.1:42356
I20260709 12:57:14.033783  1550 tablet_copy_service.cc:434] P dbe6a89d0e1c4137b3a1b17bf4b520d8: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-d5d52e25b9814edbb805e7d6bcce5b5d on tablet d5d52e25b9814edbb805e7d6bcce5b5d with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:57:14.034909  1583 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:14.036454  2526 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:14.036398  2552 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:14.037040  1583 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:13.998466  2516 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.039525  2516 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:13.838001  2539 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.002401  1690 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:14.003576  1686 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:14.005059  1685 raft_consensus.cc:1240] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:14.009186  1691 raft_consensus.cc:1240] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:14.003767  2431 raft_consensus.cc:3055] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:14.009564  2529 raft_consensus.cc:3055] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:14.071154  2529 raft_consensus.cc:740] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:14.072036  2529 consensus_queue.cc:260] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.073323  2529 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.074471  2505 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:13.994890  2465 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:14.003760  2537 consensus_queue.cc:260] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:14.033205  2534 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:57:13.843962  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 97446.4us
I20260709 12:57:14.022579  2451 tablet_bootstrap.cc:492] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:57:14.051469  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:13.990720  1655 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:14.053977  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:14.054966  2549 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.052194  2516 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:14.078006  2302 raft_consensus.cc:2468] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:14.078739  2566 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:14.080641  1507 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:14.081719  2454 raft_consensus.cc:2804] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:14.082084  2454 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:14.082152  2537 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.082444  2454 raft_consensus.cc:3060] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:14.082865  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:14.084321  1613 raft_consensus.cc:1240] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:14.085819  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:14.079596  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:14.085737  2465 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:14.058867  2539 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:14.060323  2530 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.063401  1691 raft_consensus.cc:1240] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:14.085399  1505 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:14.057723  2497 raft_consensus.cc:359] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:14.064657  2528 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.066488  2553 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:14.067236  2494 tablet_bootstrap.cc:492] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:57:14.067878  1685 raft_consensus.cc:1240] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:14.070288  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:14.042078  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:14.072304  2502 consensus_queue.cc:1059] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:57:14.085332  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 95404.4us
I20260709 12:57:14.106158  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:14.064649  1686 raft_consensus.cc:1240] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:14.092726  1613 raft_consensus.cc:1240] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:14.093063  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:14.108589  1655 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:14.101362  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:14.109632  1687 raft_consensus.cc:2393] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 2: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:14.102898  1690 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:14.110805  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:14.111428  1690 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:14.087134  2451 ts_tablet_manager.cc:1403] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 1.349s	user 0.033s	sys 0.032s
I20260709 12:57:14.114579  1691 raft_consensus.cc:2393] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 2: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:14.115765  1655 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:14.118741  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:14.119534  1690 raft_consensus.cc:2393] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 2: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:14.120033  1655 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:14.120381  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:14.121076  1690 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.121557  1655 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:14.122623  1655 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:14.096504  2497 raft_consensus.cc:740] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:57:14.102367  2552 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:14.134545  2374 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:14.135169  2374 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:14.137981  2374 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:14.138540  2374 consensus_queue.cc:1059] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:14.139698  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:14.127303  1655 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:14.087807  2431 raft_consensus.cc:740] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:14.127170  1583 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:14.141687  1655 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:14.142681  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:14.143126  1686 raft_consensus.cc:2393] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 2: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 12:57:14.185832  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 58748.1us
I20260709 12:57:14.117384  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:14.124656  2539 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.125123  2515 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:14.129304  2566 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:14.189098  1608 raft_consensus.cc:2393] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 3: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:14.145332  2532 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:14.191908  2494 tablet_bootstrap.cc:492] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:57:14.129449  2531 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:57:14.187304  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 45704.7us
I20260709 12:57:14.210645  1655 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:14.187727  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:14.185971  1610 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:14.199252  2561 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:14.239202  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:14.192978  2467 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.195632  2556 raft_consensus.cc:3055] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:57:14.225770  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:14.139395  2553 consensus_queue.cc:1059] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 12:57:14.255236  1683 raft_consensus.cc:2393] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 2: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:14.280068  1685 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:14.283989  1611 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:57:14.285825  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:14.287207  1684 raft_consensus.cc:2393] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 3: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:14.272717  2556 raft_consensus.cc:740] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:14.289678  2430 raft_consensus.cc:3055] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:14.290074  2430 raft_consensus.cc:740] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:14.290848  2430 consensus_queue.cc:260] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.292186  2430 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.209050  2431 consensus_queue.cc:260] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.269402  1687 raft_consensus.cc:2393] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 2: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:14.288122  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:14.196054  2502 consensus_queue.cc:1059] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:57:14.297510  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:14.277137  2494 ts_tablet_manager.cc:1403] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 1.285s	user 0.031s	sys 0.017s
I20260709 12:57:14.289266  2556 consensus_queue.cc:260] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.298652  1583 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:14.253575  2559 consensus_queue.cc:1059] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.121s
I20260709 12:57:14.144616  2497 consensus_queue.cc:260] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:14.196430  2516 consensus_queue.cc:1059] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 12:57:14.251964  1538 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:14.222977  2515 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.131660  2459 consensus_queue.cc:1059] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.197s
I20260709 12:57:14.332983  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:14.333699  1691 raft_consensus.cc:2468] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:14.328791  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:14.339699  1690 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:14.343539  1542 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:14.346637  1687 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:14.343765  2472 raft_consensus.cc:3055] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:14.347947  2472 raft_consensus.cc:740] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:14.319500  2536 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:14.348956  2472 consensus_queue.cc:260] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.350271  2472 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.350579  2530 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:14.353081  2556 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.357704  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:14.358474  1685 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.360095  2566 raft_consensus.cc:3055] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:14.360581  2566 raft_consensus.cc:740] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:14.362056  1583 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:14.131312  2547 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:14.379142  1583 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:14.380844  2541 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:14.381408  2541 raft_consensus.cc:697] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:14.381929  2529 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:14.382840  2529 raft_consensus.cc:697] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:14.382296  2541 consensus_queue.cc:237] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.383884  2529 consensus_queue.cc:237] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.386246  2497 ts_tablet_manager.cc:1434] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.361s	user 0.010s	sys 0.000s
I20260709 12:57:14.392843  1689 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:57:14.402326  2494 raft_consensus.cc:359] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:14.403394  2494 raft_consensus.cc:740] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:57:14.407514  1687 raft_consensus.cc:1240] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:14.361418  2566 consensus_queue.cc:260] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:14.367868  2459 raft_consensus.cc:3055] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:14.414321  2459 raft_consensus.cc:740] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:14.414883  2566 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.415222  2459 consensus_queue.cc:260] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.369544  2431 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.330925  2505 raft_consensus.cc:3055] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:14.365283  1685 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:14.413482  2520 raft_consensus.cc:3055] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:14.418242  1687 raft_consensus.cc:1240] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:14.419176  1583 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:14.387603  2547 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:14.419302  1685 raft_consensus.cc:1240] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:14.419276  2505 raft_consensus.cc:740] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:14.418958  2520 raft_consensus.cc:740] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:14.428277  2561 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:57:14.454378  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:14.429029  2547 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.459175  1687 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:14.404138  2494 consensus_queue.cc:260] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:14.470705  2565 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:14.452919  2459 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.472373  2567 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:14.487402  2561 raft_consensus.cc:697] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:14.520308  2561 consensus_queue.cc:237] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.487576  2565 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.536818  2430 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:14.537513  2430 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:14.539896  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:14.503093  2567 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:14.496632  2505 consensus_queue.cc:260] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.513968  2454 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:14.540230  2467 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:14.569234  1684 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:14.569820  2565 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:14.542415  2520 consensus_queue.cc:260] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.574865  2539 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:14.576833  1686 raft_consensus.cc:1240] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:14.582269  2454 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:14.568176  2430 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:14.564576  2552 raft_consensus.cc:697] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 12:57:14.594272  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:14.611693  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:14.627816  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 495574us
W20260709 12:57:14.649457  1582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.014s	sys 0.019s
W20260709 12:57:14.650935  1582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.014s	sys 0.019s
W20260709 12:57:14.652558  1506 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.013s	sys 0.013s
W20260709 12:57:14.652905  1506 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.013s	sys 0.013s
W20260709 12:57:14.659744  1508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.005s	sys 0.030s
W20260709 12:57:14.660298  1508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.005s	sys 0.030s
W20260709 12:57:14.660641  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 523721us
W20260709 12:57:14.664791  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:14.668236  1581 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:14.670548  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:14.671219  1581 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:14.672305  1581 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
W20260709 12:57:14.673117  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:14.676885  1581 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:14.677874  2524 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:14.678381  2524 raft_consensus.cc:697] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:14.679286  2524 consensus_queue.cc:237] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.683883  1581 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:14.684949  2542 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:14.685446  2542 raft_consensus.cc:697] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:14.686328  2542 consensus_queue.cc:237] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:14.696605  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:14.697190  2564 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:14.699151  2374 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:14.699935  2374 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.699411  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:14.702589  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:14.703269  2374 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:14.705605  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:14.705478  2564 raft_consensus.cc:697] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:14.711617  2431 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:14.712157  2431 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.714121  2431 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:14.714534  2520 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.715919  2565 consensus_queue.cc:1059] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:14.716873  2472 consensus_queue.cc:1059] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:14.711130  2374 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:14.718609  2565 raft_consensus.cc:3055] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:14.718395  2374 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.719002  2565 raft_consensus.cc:740] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 12:57:14.719137  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 71726.4us
I20260709 12:57:14.696445  2525 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:14.725956  2374 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:14.693962  2526 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:14.726836  2374 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:14.721163  1508 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:57:14.721613  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:14.719703  2553 consensus_queue.cc:1059] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:57:14.692385  2567 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:14.725620  1550 tablet_copy_service.cc:342] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-d127be99e2af41c0808e03480c1b64e3 received from {username='slave'} at 127.0.0.1:42356
W20260709 12:57:14.729305  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:14.676131  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 347015us
W20260709 12:57:14.709702  2573 log.cc:927] Time spent T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:57:14.730499  1508 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:14.667475  2451 raft_consensus.cc:359] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:14.761677  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:14.761926  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:14.762368  1542 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.762502  1538 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.736887  2525 raft_consensus.cc:697] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:14.707173  2452 consensus_queue.cc:1059] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:57:14.719436  2547 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.768278  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:14.736827  1550 tablet_copy_service.cc:434] P dbe6a89d0e1c4137b3a1b17bf4b520d8: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-d127be99e2af41c0808e03480c1b64e3 on tablet d127be99e2af41c0808e03480c1b64e3 with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:57:14.709775  2564 consensus_queue.cc:237] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
W20260709 12:57:14.783459  1655 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.013s	sys 0.006s
I20260709 12:57:14.801299  1535 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
W20260709 12:57:14.834182  1655 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.013s	sys 0.006s
I20260709 12:57:14.737946  2526 raft_consensus.cc:697] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:14.802572  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:14.767668  2454 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:14.763500  2451 raft_consensus.cc:740] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:57:14.811977  1542 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:14.813676  1538 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:14.730389  2431 consensus_queue.cc:1059] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
W20260709 12:57:14.814162  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 47785.9us
I20260709 12:57:14.814283  2581 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:14.816573  2562 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:14.771411  2551 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:14.812686  2583 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:14.847476  2583 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:14.817862  2553 consensus_queue.cc:1059] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:14.848121  2583 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.847723  2562 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.850272  2562 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:14.818565  2452 raft_consensus.cc:3055] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:14.852725  2452 raft_consensus.cc:740] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:14.854285  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:14.856328  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:14.856880  2431 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:14.857542  2431 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.857935  2551 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.858381  2525 consensus_queue.cc:237] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.859854  2431 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:14.860657  2451 consensus_queue.cc:260] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:14.861263  2580 raft_consensus.cc:3055] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:14.862442  2580 raft_consensus.cc:740] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:14.863694  2451 ts_tablet_manager.cc:1434] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.741s	user 0.003s	sys 0.010s
I20260709 12:57:14.863462  2580 consensus_queue.cc:260] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:14.864128  2451 ts_tablet_manager.cc:1467] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579: Tablet startup took 749ms
I20260709 12:57:14.864665  2581 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.865190  2583 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.867688  2583 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:14.699419  2552 consensus_queue.cc:237] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.719877  2565 consensus_queue.cc:260] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:14.824927  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 51541.7us
W20260709 12:57:14.835749  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 625472us
I20260709 12:57:14.867551  2581 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:14.891347  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 127830us
I20260709 12:57:14.883846  1655 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:14.836735  2454 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:14.888901  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:14.893024  1508 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:14.888314  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:14.896243  1581 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:14.860002  2551 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:14.901751  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:14.902328  1613 raft_consensus.cc:1275] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:14.902727  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:14.875671  2431 raft_consensus.cc:3055] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:14.908890  1581 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:14.917126  1655 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:14.923206  2541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.036s	sys 0.052s
W20260709 12:57:14.939635  2541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.036s	sys 0.053s
I20260709 12:57:14.940382  2566 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:14.939937  1655 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:14.942512  1655 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:14.943277  1616 raft_consensus.cc:1240] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:14.944542  1655 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:14.893296  1533 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:14.903069  2454 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.900926  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:14.948967  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:14.951241  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:14.945379  2459 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:14.858080  2526 consensus_queue.cc:237] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.921983  2584 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:14.941290  2565 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.924968  2431 raft_consensus.cc:740] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:14.955479  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:14.971799  1613 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:14.947636  2302 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 1 LEARNER]: Advancing to term 2
W20260709 12:57:14.949733  2556 consensus_meta.cc:287] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.596s	user 0.005s	sys 0.006s
I20260709 12:57:14.924775  2592 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:14.949043  2539 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:14.946985  2528 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:14.961542  2459 raft_consensus.cc:697] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:14.945374  2578 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:14.977566  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:14.946820  2467 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:14.955101  2561 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:14.999150  1535 raft_consensus.cc:1275] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:14.969789  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:57:14.963884  2583 consensus_queue.cc:1059] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:57:14.946449  1655 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:14.991088  2301 raft_consensus.cc:1217] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:57:14.979043  2581 consensus_queue.cc:1048] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:57:14.992239  2430 raft_consensus.cc:3055] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:14.980212  2539 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:57:14.993189  2515 consensus_meta.cc:287] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.659s	user 0.007s	sys 0.003s
I20260709 12:57:15.008937  2430 raft_consensus.cc:740] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:15.016760  2515 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:14.953248  2551 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:57:15.017453  2430 consensus_queue.cc:260] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.962021  1541 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:15.005125  1540 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.010434  2561 raft_consensus.cc:697] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:15.019487  2459 consensus_queue.cc:237] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:15.000617  2467 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:15.024520  1581 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:15.008176  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 61794.1us
I20260709 12:57:14.997839  2578 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:57:14.994113  2589 log.cc:927] Time spent T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:57:15.003465  2547 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:15.017412  2590 log.cc:927] Time spent T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:57:15.018447  2494 ts_tablet_manager.cc:1434] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.720s	user 0.012s	sys 0.021s
I20260709 12:57:14.980930  2554 consensus_queue.cc:1059] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:57:15.029633  1540 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:15.030230  1655 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:15.011843  2539 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.006932  2303 raft_consensus.cc:3060] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:15.010701  2566 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.025934  2556 consensus_queue.cc:1059] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:57:15.043285  2374 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:15.037582  2494 ts_tablet_manager.cc:1467] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579: Tablet startup took 739ms
W20260709 12:57:15.059679  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:15.041673  1655 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:15.026937  2467 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.069226  2374 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:14.970162  2584 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:15.029285  2551 raft_consensus.cc:3055] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:15.025934  2578 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.011952  2527 consensus_queue.cc:1048] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:57:15.040807  2529 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:15.072257  1655 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:15.065047  1683 raft_consensus.cc:1240] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
W20260709 12:57:15.076848  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 49122.2us
I20260709 12:57:15.125994  2374 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:15.097301  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:15.129803  1690 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:15.133412  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:15.134493  1690 raft_consensus.cc:1275] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:57:15.134464  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 125191us
I20260709 12:57:15.136029  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:15.007232  2431 consensus_queue.cc:260] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:15.137557  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:15.138262  1690 raft_consensus.cc:3060] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:57:15.139576  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:15.140859  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:15.142006  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:15.142645  1682 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:15.143520  2608 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:57:14.869345  2451 ts_tablet_manager.cc:1469] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579: Trace:
0709 12:57:08.485175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:08.485343 (+   168us) service_pool.cc:224] Handling call
0709 12:57:08.509632 (+ 24289us) ts_tablet_manager.cc:934] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
0709 12:57:12.233648 (+3724016us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:57:12.510261 (+276613us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:12.510377 (+   116us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:57:12.569451 (+ 59074us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:57:12.569747 (+   296us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:12.570035 (+   288us) ts_tablet_manager.cc:989] Replica registered.
0709 12:57:12.570096 (+    61us) inbound_call.cc:177] Queueing success response
0709 12:57:12.670582 (+100486us) spinlock_profiling.cc:243] Waited 3.42 ms on lock 0x7b1800300ac0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859edec0a 00007fc86361e219 00007fc859e08ed8 00007fc859f63de2 00007fc861fc8d23 00007fc861fc855d 00007fc8620643d8 00007fc862095f4e 00007fc86207afdd
0709 12:57:12.737571 (+ 66989us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:57:14.127329 (+1389758us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:57:14.471379 (+344050us) tablet_replica.cc:261] Starting instrumentation
0709 12:57:14.471946 (+   567us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":733,"mutex_wait_us":12386,"raft.queue_time_us":371,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":126,"spinlock_wait_cycles":7869824,"tablet-copy.queue_time_us":16048,"tablet-download-pool.queue_time_us":1576,"tablet-download-pool.run_cpu_time_us":1387,"tablet-download-pool.run_wall_time_us":57123,"thread_start_us":35126,"threads_started":2}
I20260709 12:57:15.146530  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:15.146881  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:15.147970  2505 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.148272  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:15.149791  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:15.077102  2529 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:15.152949  2529 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:15.153720  1688 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:15.156157  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:15.157447  1686 raft_consensus.cc:1240] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:15.158116  1690 raft_consensus.cc:2468] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:15.161216  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 653) took 1062 ms. Trace:
W20260709 12:57:15.161906  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 89741.4us
I20260709 12:57:15.163074  1655 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:15.161613  1689 rpcz_store.cc:276] 0709 12:57:14.098369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:14.403075 (+304706us) service_pool.cc:224] Handling call
0709 12:57:14.403404 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:14.417677 (+ 14273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:14.417707 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:14.423380 (+  5673us) log.cc:844] Serialized 26 byte log entry
0709 12:57:14.822263 (+398883us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:14.822922 (+   659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:14.823283 (+   361us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:15.161011 (+337728us) raft_consensus.cc:1685] finished
0709 12:57:15.161031 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:15.161161 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13447,"raft.queue_time_us":14019,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":11522,"thread_start_us":389918,"threads_started":1,"wal-append.queue_time_us":515193}
I20260709 12:57:15.126957  2566 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:15.195983  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 60518.6us
I20260709 12:57:15.199169  2472 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:15.226428  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 63445.3us
I20260709 12:57:15.228256  1655 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:15.232445  1655 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:15.074981  2551 raft_consensus.cc:740] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:15.171146  2515 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.245115  1691 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:15.237389  2541 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.259873  2541 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:15.072695  2549 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.156s
I20260709 12:57:15.199563  2605 raft_consensus.cc:3055] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:15.234050  2542 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.237341  2608 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.262212  2551 consensus_queue.cc:260] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:15.225165  2472 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:15.140856  2561 consensus_queue.cc:237] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:15.271610  1700 tablet_copy_service.cc:342] P 4487a53c51be4634bf1ef29c5248353d: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-07ac6d2e7442458585e7eca31089d547 received from {username='slave'} at 127.0.0.1:33206
I20260709 12:57:15.258420  2604 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:15.278760  2515 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:15.271354  2605 raft_consensus.cc:740] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:15.270392  2530 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:57:15.269173  2581 consensus_queue.cc:1059] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:57:15.293315  2542 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:15.305142  2601 log.cc:927] Time spent T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 12:57:15.282684  2584 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:15.310081  2542 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:15.302455  1700 tablet_copy_service.cc:434] P 4487a53c51be4634bf1ef29c5248353d: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-07ac6d2e7442458585e7eca31089d547 on tablet 07ac6d2e7442458585e7eca31089d547 with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:57:15.301563  2515 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:15.296399  2608 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:15.318747  2608 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:15.313026  2581 consensus_queue.cc:1243] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer c262eac7fc904ae9bb91e450f6532e3f log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:57:15.320124  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:15.320463  2529 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:15.326176  1617 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
W20260709 12:57:15.071270  2494 ts_tablet_manager.cc:1469] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579: Trace:
0709 12:57:11.156376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:11.198905 (+ 42529us) service_pool.cc:224] Handling call
0709 12:57:11.310416 (+111511us) ts_tablet_manager.cc:934] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
0709 12:57:12.291612 (+981196us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:57:12.526598 (+234986us) tablet_metadata.cc:665] Metadata flushed
0709 12:57:12.526707 (+   109us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:57:12.682481 (+155774us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:57:12.682749 (+   268us) tablet_replica.cc:206] Creating consensus instance
0709 12:57:12.683044 (+   295us) ts_tablet_manager.cc:989] Replica registered.
0709 12:57:12.683104 (+    60us) inbound_call.cc:177] Queueing success response
0709 12:57:12.977003 (+293899us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:57:14.298114 (+1321111us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:57:14.325067 (+ 26953us) tablet_replica.cc:261] Starting instrumentation
0709 12:57:14.325727 (+   660us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":131454,"raft.queue_time_us":245497,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":28150,"tablet-copy.queue_time_us":46211,"tablet-download-pool.queue_time_us":120,"tablet-download-pool.run_cpu_time_us":2030,"tablet-download-pool.run_wall_time_us":11691,"thread_start_us":752856,"threads_started":3}
I20260709 12:57:15.330037  2610 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.311193  2592 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.333070  2472 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:15.325932  2515 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:15.336264  2594 log.cc:927] Time spent T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.267s	user 0.000s	sys 0.002s
I20260709 12:57:15.335466  1701 tablet_copy_service.cc:342] P 4487a53c51be4634bf1ef29c5248353d: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-e4681eaad3084357b9677e4242b97c99 received from {username='slave'} at 127.0.0.1:33206
I20260709 12:57:15.343338  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 759) took 1253 ms. Trace:
I20260709 12:57:15.344719  2454 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:15.335275  2600 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.349762  1701 tablet_copy_service.cc:434] P 4487a53c51be4634bf1ef29c5248353d: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-e4681eaad3084357b9677e4242b97c99 on tablet e4681eaad3084357b9677e4242b97c99 with peer 1d6516ff61104bdda54bde95e92fe579
W20260709 12:57:15.363659  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 129349us
I20260709 12:57:15.338187  2472 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.366564  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:15.372696  1686 raft_consensus.cc:1240] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
W20260709 12:57:15.373137  2599 log.cc:927] Time spent T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.274s	user 0.000s	sys 0.002s
I20260709 12:57:15.350109  1683 rpcz_store.cc:276] 0709 12:57:14.089567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:14.332676 (+243109us) service_pool.cc:224] Handling call
0709 12:57:14.373539 (+ 40863us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:15.131826 (+758287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:15.343055 (+211229us) spinlock_profiling.cc:243] Waited 652 ms on lock 0x7b5400288cd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:15.343272 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1498891008}
I20260709 12:57:15.376963  2303 raft_consensus.cc:2468] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:15.383368  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:15.384038  1685 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:15.378261  2580 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:15.382473  1505 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:15.387470  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:15.386860  2467 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:15.394575  1542 raft_consensus.cc:1240] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:15.395524  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:15.391903  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:15.396224  1613 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:15.396618  2606 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:15.414700  1537 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:15.414669  1508 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:15.389153  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:15.418133  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:15.418491  1508 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:15.419811  1617 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:15.404060  2578 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:15.416757  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 180727us
I20260709 12:57:15.389616  2472 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:15.421010  2505 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.424672  2529 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:15.425944  2606 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:15.422102  1508 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:15.426131  2609 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.443511  2505 raft_consensus.cc:2764] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:57:15.445034  2467 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:15.415720  2600 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:15.426924  2565 consensus_queue.cc:1048] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:57:15.450829  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:15.442010  2606 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:15.457449  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:15.459761  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:57:15.460976  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:15.461414  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:15.461699  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:15.456539  1508 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:15.468732  2609 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.469301  2609 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:15.470948  2566 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.471444  2609 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:15.472078  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:15.472210  1684 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:15.473462  2581 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.473467  2431 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.474850  2454 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:15.476255  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:15.476958  1613 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:15.476331  1508 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:15.479456  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:15.482549  1617 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:15.476821  2600 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:15.480615  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:15.479794  2472 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:15.485538  2541 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:15.490876  1508 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:15.488655  2580 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.495384  1608 raft_consensus.cc:1240] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:15.501806  1689 raft_consensus.cc:1275] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:15.474152  2539 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:15.506006  1505 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:15.506716  1688 raft_consensus.cc:1240] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:15.507436  1505 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:15.508662  1538 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:15.509215  2600 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.509846  2600 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.510872  1654 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:15.511843  1689 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:15.501695  2266 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:15.513986  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:15.514554  1689 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:15.516063  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:15.515998  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:15.516877  2595 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.516870  1540 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:15.517957  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:15.518608  1540 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:15.519795  1540 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:15.520860  1539 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:15.522007  2515 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:15.522833  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:15.524088  2515 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:15.516557  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:15.527272  1689 raft_consensus.cc:1275] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:57:15.528772  2593 log.cc:927] Time spent T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.501s	user 0.003s	sys 0.014s
I20260709 12:57:15.526103  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:15.529574  2431 raft_consensus.cc:2804] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:15.530742  2431 raft_consensus.cc:697] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:15.532269  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:15.525983  1505 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:15.534969  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:57:15.535602  2586 log.cc:927] Time spent T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.522s	user 0.007s	sys 0.007s
I20260709 12:57:15.535938  2431 consensus_queue.cc:237] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:15.536777  1689 raft_consensus.cc:1240] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:15.538702  1505 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:15.545549  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 313265us
I20260709 12:57:15.524808  2539 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:15.518819  2578 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:15.550863  1655 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:15.541200  2472 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:15.553886  2454 consensus_queue.cc:1059] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:15.554369  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:15.555042  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:15.577525  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:15.555537  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:15.557991  1505 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:15.560797  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:15.563287  1655 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:15.567299  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:15.579334  1686 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:15.582139  1655 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:15.543277  2554 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:15.580791  1508 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:15.586970  1505 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:15.591988  1686 raft_consensus.cc:1240] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:15.594913  1505 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:15.593406  2550 consensus_queue.cc:1059] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:57:15.598493  1581 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:15.607796  1581 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:15.610850  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:15.611663  1540 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:15.604283  2525 consensus_queue.cc:1059] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:15.563776  2472 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:15.596788  2459 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.005s	sys 0.020s
I20260709 12:57:15.615805  1581 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:15.548743  2606 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:15.585266  2539 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:15.612821  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:15.594688  2505 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:15.590787  2592 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.590592  2515 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.595584  2578 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:15.623107  1540 raft_consensus.cc:2393] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 2: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:15.616526  2454 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.594537  2552 raft_consensus.cc:2804] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:57:15.617502  2459 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.005s	sys 0.020s
I20260709 12:57:15.625593  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:15.591717  2303 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:15.606451  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:15.586171  2554 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:15.615312  2581 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.615811  2566 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:15.617828  2536 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:15.619171  2529 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:15.632416  2578 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:15.632444  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:15.595031  2600 consensus_queue.cc:1059] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:57:15.636699  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:15.636839  1655 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:15.634442  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:15.637679  1508 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:15.624199  2539 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:15.615017  2520 consensus_queue.cc:1059] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:57:15.615993  2524 consensus_queue.cc:1059] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:57:15.618896  2472 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:15.635986  2552 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:15.627225  2505 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:15.654265  2529 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:15.663841  2612 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.674765  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:15.648466  2554 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:15.632972  2614 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:57:15.649600  2536 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:15.724162  1540 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:15.665130  2539 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.726493  2300 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 2 LEARNER]: Advancing to term 3
I20260709 12:57:15.658347  2619 raft_consensus.cc:2804] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:57:15.702425  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 65674.5us
I20260709 12:57:15.670368  2552 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:15.666481  2520 raft_consensus.cc:3055] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:15.673656  2505 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:15.659762  2578 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:15.731534  2520 raft_consensus.cc:740] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:15.733346  2619 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:15.674175  2529 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:15.654071  2581 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:15.728925  1655 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:15.699131  2600 consensus_queue.cc:1243] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer c262eac7fc904ae9bb91e450f6532e3f log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:57:15.731709  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:15.697590  2515 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.699416  2609 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.730140  2301 raft_consensus.cc:2393] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 2: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:57:15.811138  1540 raft_consensus.cc:2393] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 2: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:15.728839  2536 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:15.768095  2467 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.815081  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:15.816440  2600 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.816942  2600 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:15.779718  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 179724us
I20260709 12:57:15.812717  2459 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.823506  1539 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:15.733793  2619 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.837886  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:15.818099  2516 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.822520  2610 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:15.826922  1609 raft_consensus.cc:1275] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:15.889189  2374 raft_consensus.cc:3055] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:15.892623  2374 raft_consensus.cc:740] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:15.838074  2606 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:15.893545  2374 consensus_queue.cc:260] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:15.897536  2627 log.cc:927] Time spent T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:57:15.889982  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:15.823618  2553 consensus_queue.cc:1059] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:57:15.824923  2533 consensus_queue.cc:1048] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 12:57:15.855703  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:15.907405  2374 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:15.821452  2467 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:15.828320  2459 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:15.886073  2516 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:15.827945  2562 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 12:57:15.703576  2612 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:15.895758  2613 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.821430  2520 consensus_queue.cc:260] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:15.924670  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:15.924047  2566 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:15.942596  2566 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:15.943357  2616 log.cc:927] Time spent T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
W20260709 12:57:15.944195  2625 log.cc:927] Time spent T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:57:15.930470  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:15.946296  1538 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:15.915138  2630 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:15.977202  2618 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:15.888504  2515 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:15.892668  2610 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:15.998224  2624 log.cc:927] Time spent T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:57:16.016288  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:15.978276  2618 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:16.042214  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:16.046144  1539 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:16.047115  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:16.032366  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:16.052012  2516 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:16.060534  1533 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:16.059144  2610 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:16.062062  2459 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:16.063513  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:16.078212  2580 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.078784  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:16.078985  2472 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.078725  2580 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.079614  1534 raft_consensus.cc:2393] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 3: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:16.066664  1538 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
W20260709 12:57:16.067132  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:16.066403  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:16.043911  2520 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.083384  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:16.084530  2618 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:16.084779  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:16.024541  2630 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.091508  2606 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.105365  1539 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:16.059820  2505 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:16.114270  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 385438us
I20260709 12:57:16.074316  2581 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:15.999289  2613 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.091696  2629 consensus_queue.cc:1048] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.193s
W20260709 12:57:16.137313  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:16.095593  2554 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.123950  1655 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:16.149902  1655 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:16.107314  2539 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:16.127236  1689 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.028s	sys 0.062s
W20260709 12:57:16.152634  1689 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.028s	sys 0.062s
I20260709 12:57:16.120272  1538 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:16.150911  1655 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:16.124768  2302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32794 (request call id 60) took 1279 ms. Trace:
I20260709 12:57:16.156323  1655 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:16.157316  2612 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:16.158133  2632 log.cc:927] Time spent T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:57:16.159065  2554 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:16.160597  2505 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:16.160852  2597 log.cc:927] Time spent T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 1.020s	user 0.002s	sys 0.002s
I20260709 12:57:16.161130  2515 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:16.113131  2606 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:16.175859  1538 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:16.188249  1655 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:16.151862  2610 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:16.189559  1655 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:57:16.179852  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 318116us
W20260709 12:57:16.192044  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:16.151592  2528 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:57:16.177089  2602 log.cc:927] Time spent T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 1.039s	user 0.004s	sys 0.000s
I20260709 12:57:16.194752  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:16.195380  1581 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:16.205154  1538 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:16.155637  2467 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:16.198765  1685 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:16.199667  1688 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:16.178561  2529 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.210346  1688 raft_consensus.cc:1240] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:16.177512  2564 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:16.214810  2524 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.224077  1688 raft_consensus.cc:1240] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:16.213822  1685 raft_consensus.cc:3055] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:57:16.201622  2583 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.049s	user 0.001s	sys 0.031s
I20260709 12:57:16.190186  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:16.190124  2638 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.226750  1686 raft_consensus.cc:1275] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:16.225363  1685 raft_consensus.cc:740] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:16.216138  2459 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:16.216588  1581 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:16.227102  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:16.227162  1655 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:16.230834  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:16.235764  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:16.239508  1691 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:16.239701  1686 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:16.241027  1655 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:16.223887  2467 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:16.239673  1538 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:16.239179  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:16.231199  2583 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.074s	user 0.001s	sys 0.032s
I20260709 12:57:16.243677  1685 consensus_queue.cc:260] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.243718  1687 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:16.207368  2533 consensus_queue.cc:1059] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:57:16.235589  2430 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.274535  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:16.279717  1613 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:16.246712  1538 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:16.276013  1685 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.229985  2564 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.231385  2524 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.242630  2580 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:16.300931  2642 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.300352  1682 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:16.285787  2301 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 1 LEARNER]: Advancing to term 2
I20260709 12:57:16.313949  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:16.316315  2649 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.317305  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:16.318024  1613 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:16.319967  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:16.306582  2549 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:16.321472  1613 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:16.322808  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:16.323457  1613 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.307113  2515 raft_consensus.cc:697] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:16.318866  1538 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:57:16.327373  2635 log.cc:927] Time spent T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:57:16.328583  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 656) took 1391 ms. Trace:
I20260709 12:57:16.329959  2606 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:16.328972  1615 rpcz_store.cc:276] 0709 12:57:14.936877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:14.938776 (+  1899us) service_pool.cc:224] Handling call
0709 12:57:15.558799 (+620023us) spinlock_profiling.cc:243] Waited 2.76 ms on lock 0x7b5800091e98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc86202afc0 00007fc862015929 00007fc8620153d2 00007fc85b58cbd4
0709 12:57:15.559031 (+   232us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:15.559375 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:15.559404 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:15.559872 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 12:57:15.968330 (+408458us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:15.968369 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:15.968440 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:16.328204 (+359764us) raft_consensus.cc:1685] finished
0709 12:57:16.328232 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:16.328455 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17405,"spinlock_wait_cycles":28114432,"thread_start_us":408146,"threads_started":1,"wal-append.queue_time_us":593508}
I20260709 12:57:16.337711  2524 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:16.338380  2524 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.339439  2524 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.325923  2549 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:16.341028  2549 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:16.343336  2592 consensus_meta.cc:287] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.715s	user 0.011s	sys 0.002s
I20260709 12:57:16.343835  2592 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.162532  2302 rpcz_store.cc:276] 0709 12:57:14.875089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:14.897344 (+ 22255us) service_pool.cc:224] Handling call
0709 12:57:14.923459 (+ 26115us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:15.318080 (+394621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:15.318114 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:15.318640 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 12:57:15.683127 (+364487us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:15.697487 (+ 14360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:15.702021 (+  4534us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:16.111173 (+409152us) raft_consensus.cc:1685] finished
0709 12:57:16.111930 (+   757us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:16.117292 (+  5362us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7720,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":96,"thread_start_us":322458,"threads_started":1,"wal-append.queue_time_us":497312}
I20260709 12:57:16.286280  2527 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
W20260709 12:57:16.348883  1537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 769) took 1585 ms (client timeout 1889 ms). Trace:
W20260709 12:57:16.349485  2639 log.cc:927] Time spent T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:57:16.321059  2550 raft_consensus.cc:3055] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:16.354781  2550 raft_consensus.cc:740] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:16.350165  2539 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:16.350570  2641 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
W20260709 12:57:16.351377  2578 consensus_meta.cc:287] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.618s	user 0.007s	sys 0.003s
I20260709 12:57:16.351756  2529 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:16.353359  1537 rpcz_store.cc:269] 0709 12:57:14.761835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:14.762526 (+   691us) service_pool.cc:224] Handling call
0709 12:57:16.336396 (+1573870us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b540017eb54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:16.347129 (+ 10733us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1248863616}
I20260709 12:57:16.358978  1613 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:16.327395  1534 raft_consensus.cc:1240] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:16.366482  1685 raft_consensus.cc:1275] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:57:16.432201  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 215800us
I20260709 12:57:16.353955  2613 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:16.434507  1581 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:16.433748  1539 raft_consensus.cc:1275] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:16.437492  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:16.441754  1538 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:16.448813  1537 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:16.455348  1540 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:16.370929  2610 raft_consensus.cc:697] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 2 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:16.475497  1538 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:16.441119  2580 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.397342  2578 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:16.500762  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 258521us
I20260709 12:57:16.362259  2566 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:16.466022  2533 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:57:16.489231  2552 consensus_meta.cc:287] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.748s	user 0.011s	sys 0.000s
W20260709 12:57:16.485518  2645 log.cc:927] Time spent T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 12:57:16.492558  2646 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:16.495626  2610 consensus_queue.cc:237] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.503317  2652 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:16.434605  2550 consensus_queue.cc:260] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.503383  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:16.512279  1654 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:57:16.522243  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 65138.7us
I20260709 12:57:16.505622  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:16.539214  1581 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:16.539474  2656 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:57:16.539628  2619 consensus_meta.cc:287] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.662s	user 0.013s	sys 0.000s
I20260709 12:57:16.487911  2527 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:57:16.504818  2533 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:16.477404  2515 consensus_queue.cc:237] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.551388  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 781) took 1703 ms. Trace:
I20260709 12:57:16.556239  1542 rpcz_store.cc:276] 0709 12:57:14.843885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:14.889926 (+ 46041us) service_pool.cc:224] Handling call
0709 12:57:14.923960 (+ 34034us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:15.394986 (+471026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:16.546714 (+1151728us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b540045d654. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:16.546935 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1081982848}
I20260709 12:57:16.544406  1612 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:16.546669  2656 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:16.555320  2533 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:16.549420  2646 raft_consensus.cc:697] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 2 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:16.520110  2580 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.523248  2552 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:16.554631  1534 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
W20260709 12:57:16.606215  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 328824us
I20260709 12:57:16.569900  2459 raft_consensus.cc:697] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:57:16.608716  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 62991.9us
I20260709 12:57:16.544097  2549 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.553953  2619 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:16.594823  2564 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:16.557729  2467 raft_consensus.cc:697] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 2 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:57:16.602418  2536 consensus_meta.cc:287] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.786s	user 0.006s	sys 0.005s
I20260709 12:57:16.593298  2656 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:16.545873  2652 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.626554  1581 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:16.632282  1616 raft_consensus.cc:2393] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 2: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:16.615197  2301 raft_consensus.cc:1275] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 2 LEARNER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:57:16.640606  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:16.670194  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:16.680945  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:16.697244  2452 consensus_queue.cc:260] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.698622  2452 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.623626  2564 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:16.627885  2536 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.709288  2652 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:16.709790  2655 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.710358  2655 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:16.710592  2520 consensus_meta.cc:287] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.617s	user 0.010s	sys 0.000s
W20260709 12:57:16.701584  2300 consensus_meta.cc:287] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.975s	user 0.010s	sys 0.010s
I20260709 12:57:16.726014  2652 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:57:16.735253  2542 raft_consensus.cc:3055] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:16.735868  2542 raft_consensus.cc:740] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:16.736871  2542 consensus_queue.cc:260] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.740701  1614 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:16.747093  2580 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:16.749131  1654 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:57:16.741343  2661 log.cc:927] Time spent T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:57:16.722038  2578 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:16.710115  2467 consensus_queue.cc:237] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.699944  2646 consensus_queue.cc:237] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.753916  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:16.759392  2647 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:16.764822  2647 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:16.767001  2647 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.744879  2566 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:16.770998  1537 raft_consensus.cc:1275] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:16.774573  1535 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:16.775271  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 792) took 1268 ms. Trace:
I20260709 12:57:16.703362  2459 consensus_queue.cc:237] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.775652  1535 rpcz_store.cc:276] 0709 12:57:15.506790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.510236 (+  3446us) service_pool.cc:224] Handling call
0709 12:57:16.774119 (+1263883us) spinlock_profiling.cc:243] Waited 5.84 ms on lock 0x7b5800002798. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc86202afc0 00007fc862015929 00007fc8620153d2 00007fc85b58cbd4
0709 12:57:16.774331 (+   212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:16.774993 (+   662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:16.775210 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13431040}
I20260709 12:57:16.762379  2527 consensus_queue.cc:1059] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:57:16.756736  2652 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:16.745746  2520 consensus_queue.cc:1059] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:57:16.765682  2664 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:16.773347  2619 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:16.785362  2652 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.766885  2630 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:16.794449  2652 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:16.794818  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:57:16.795053  2652 raft_consensus.cc:3055] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:16.795487  2652 raft_consensus.cc:740] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:16.795734  2301 raft_consensus.cc:2393] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 2: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:57:16.796402  2652 consensus_queue.cc:260] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.798419  1537 raft_consensus.cc:1275] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:16.800782  2664 raft_consensus.cc:697] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:16.807878  1655 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:16.814590  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:16.816133  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:16.817751  1655 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:16.821584  1613 raft_consensus.cc:2393] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 3: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:16.822872  1613 raft_consensus.cc:1240] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:16.770153  2648 consensus_queue.cc:1059] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:57:16.824652  2566 raft_consensus.cc:3055] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:57:16.826574  2651 log.cc:927] Time spent T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.116s	user 0.001s	sys 0.001s
I20260709 12:57:16.821384  2638 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:16.827533  2566 raft_consensus.cc:740] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:16.797955  2549 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:16.802767  2300 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 3 LEARNER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:16.831578  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:16.833469  1655 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:16.833807  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:16.834667  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:16.833501  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:16.822754  2536 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:16.863185  1686 raft_consensus.cc:1240] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:16.863358  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:16.866861  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:16.868166  1655 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:16.871621  2526 raft_consensus.cc:3055] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:16.872159  2526 raft_consensus.cc:740] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:16.874233  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 805) took 1243 ms. Trace:
I20260709 12:57:16.840545  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:16.874713  1539 rpcz_store.cc:276] 0709 12:57:15.631237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:16.356904 (+725667us) service_pool.cc:224] Handling call
0709 12:57:16.432930 (+ 76026us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:16.435786 (+  2856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:16.874069 (+438283us) spinlock_profiling.cc:243] Waited 75.7 ms on lock 0x7b5400314cd0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:16.874184 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174182144}
I20260709 12:57:16.861997  2648 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.881768  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:16.883675  1615 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:16.885103  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:16.885521  1508 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:16.885885  1686 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:16.877358  1684 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 784) took 1998 ms (client timeout 1594 ms). Trace:
I20260709 12:57:16.889649  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:16.872697  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:16.873047  2300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32788 (request call id 17) took 1237 ms. Trace:
I20260709 12:57:16.889988  2598 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.891589  1505 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:16.879416  2580 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.903874  1505 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:16.906890  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:16.907550  1689 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:16.877700  2650 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:16.913448  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:16.914145  1689 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:16.915077  1655 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:16.905966  1610 raft_consensus.cc:2393] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 3: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:16.917966  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:16.918757  1689 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:16.905488  2606 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:16.872576  2566 consensus_queue.cc:260] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.888868  2584 consensus_queue.cc:1048] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:57:16.923166  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:16.926160  1689 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:57:16.896966  1539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51498
I20260709 12:57:16.928946  1539 raft_consensus.cc:606] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:57:16.915903  2578 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.909850  2564 raft_consensus.cc:697] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:57:16.933795  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 323584us
I20260709 12:57:16.905603  2565 consensus_queue.cc:1048] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
W20260709 12:57:16.889422  1684 rpcz_store.cc:269] 0709 12:57:14.878663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:14.883235 (+  4572us) service_pool.cc:224] Handling call
0709 12:57:15.388974 (+505739us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b5800190898. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc8620170a0 00007fc862016984 00007fc85b5916d4 00007fc85b591662
0709 12:57:16.877142 (+1488168us) spinlock_profiling.cc:243] Waited 50.9 ms on lock 0x7b54002887d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:16.877263 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124527232}
I20260709 12:57:16.898001  2300 rpcz_store.cc:276] 0709 12:57:15.649476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.662767 (+ 13291us) service_pool.cc:224] Handling call
0709 12:57:15.673628 (+ 10861us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:16.840386 (+1166758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:16.870424 (+ 30038us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:16.877131  2664 consensus_queue.cc:237] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.921666  2606 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:16.907759  2580 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.924587  2650 raft_consensus.cc:697] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 2 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:16.924162  2653 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:16.925222  2539 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:16.912783  2598 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.927588  2648 consensus_queue.cc:1059] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:57:16.925407  2533 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.932967  2655 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:16.966487  1689 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:16.950845  2583 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:16.971628  2637 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:16.979617  2609 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:16.960186  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:16.987440  2637 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.987566  2609 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.988384  2564 consensus_queue.cc:237] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.989648  2637 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:16.989810  1609 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 1. Current term is 2. Ops: []
W20260709 12:57:16.972931  2667 log.cc:927] Time spent T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:57:16.916539  2526 consensus_queue.cc:260] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:16.976406  2600 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:16.987602  2598 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:16.986806  2583 raft_consensus.cc:697] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:16.954685  2606 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:17.008234  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 122823us
I20260709 12:57:17.008551  1613 raft_consensus.cc:2393] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 3: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 12:57:17.010283  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 378120us
I20260709 12:57:17.047911  1615 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:17.150943  2619 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:17.152359  2619 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.124243  1508 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:17.091873  2551 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:17.126541  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 222623us
W20260709 12:57:17.126681  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 64832.2us
W20260709 12:57:17.128075  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 189679us
I20260709 12:57:17.051519  1686 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
W20260709 12:57:17.129797  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:17.006898  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:17.162957  2520 consensus_queue.cc:1048] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:57:17.167980  1508 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:57:17.138127  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:17.073928  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 158933us
I20260709 12:57:17.171087  2607 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:17.171635  2607 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:17.172103  2607 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:17.173237  2600 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.174285  2600 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.175851  1505 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:17.177883  2300 raft_consensus.cc:1275] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:17.178445  2600 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:17.084890  2533 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:17.080869  2561 raft_consensus.cc:3055] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:17.179752  2561 raft_consensus.cc:740] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:17.027436  2650 consensus_queue.cc:237] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.180059  2637 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:16.963173  2656 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.182142  1685 raft_consensus.cc:2393] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 3: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:17.181924  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:17.183409  2656 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:16.994065  2653 raft_consensus.cc:697] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 2 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:17.078029  2580 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:16.988021  1683 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:17.197263  2655 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.185709  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 675) took 1396 ms. Trace:
I20260709 12:57:17.198171  2655 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.199019  2578 consensus_queue.cc:1048] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:57:17.199501  2656 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:16.994323  2539 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.201901  2539 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.202878  1505 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:17.203224  2515 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.198899  1614 rpcz_store.cc:276] 0709 12:57:15.788737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.797317 (+  8580us) service_pool.cc:224] Handling call
0709 12:57:17.185226 (+1387909us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b540032a854. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:17.185481 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1881381760}
I20260709 12:57:17.090418  2606 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.206210  2655 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:17.206693  2606 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:17.089426  2605 consensus_queue.cc:260] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.204064  2515 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:17.208807  2605 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.211411  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:17.203850  2566 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:16.996656  2526 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.142068  2610 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:17.140393  2430 raft_consensus.cc:993] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:57:17.143397  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:17.146818  2654 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:17.148299  2669 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:57:17.150204  2579 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.166663  2613 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:17.053903  2583 consensus_queue.cc:237] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.239641  2467 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.185804  2561 consensus_queue.cc:260] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.185803  2653 consensus_queue.cc:237] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:17.188730  1616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 7) took 1555 ms (client timeout 1728 ms). Trace:
I20260709 12:57:17.189996  2638 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.190184  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:17.190694  2679 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:17.191309  2670 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 12:57:17.192152  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:17.178480  1508 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:17.161684  2619 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:17.200444  2656 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.212939  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:17.212678  1534 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:17.206840  2655 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:17.217258  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:17.255606  2655 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:17.256141  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 77798us
I20260709 12:57:17.217545  2665 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:17.256243  2656 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:17.258389  2655 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:17.218613  2430 raft_consensus.cc:1081] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:57:17.261008  2472 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:17.218938  2539 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:17.219264  2610 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:17.220116  1540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 389) took 1595 ms (client timeout 1595 ms). Trace:
I20260709 12:57:17.220741  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:17.221524  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 55835.2us
I20260709 12:57:17.162528  2658 consensus_queue.cc:1059] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:57:17.224313  2609 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:17.228781  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:17.208818  2530 raft_consensus.cc:3055] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:17.224200  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:17.227495  2607 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.241663  2644 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:17.244336  2579 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.242319  2520 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:17.090402  2647 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:17.243788  2266 leader_election.cc:336] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 1.728s (SENT)
I20260709 12:57:17.243408  1581 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:17.246045  1616 rpcz_store.cc:269] 0709 12:57:15.631276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.631726 (+   450us) service_pool.cc:224] Handling call
0709 12:57:17.186363 (+1554637us) spinlock_profiling.cc:243] Waited 975 ms on lock 0x7b5400445554. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:17.186622 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2242148608}
I20260709 12:57:17.236951  2606 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:17.254921  1533 raft_consensus.cc:2368] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3.
I20260709 12:57:17.257254  1508 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:17.217902  2533 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.281170  2652 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.279932  1617 raft_consensus.cc:2368] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3.
I20260709 12:57:17.282232  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 398) took 1080 ms. Trace:
I20260709 12:57:17.282567  1617 rpcz_store.cc:276] 0709 12:57:16.201511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:16.201854 (+   343us) service_pool.cc:224] Handling call
0709 12:57:17.189812 (+987958us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b5800091e98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc8620170a0 00007fc862016984 00007fc85b5916d4 00007fc85b591662
0709 12:57:17.282159 (+ 92347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2433280}
I20260709 12:57:17.263230  2670 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:17.264139  1540 rpcz_store.cc:269] 0709 12:57:15.624520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.813903 (+189383us) service_pool.cc:224] Handling call
0709 12:57:17.219704 (+1405801us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b5400219dd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:17.219927 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1456030464}
I20260709 12:57:17.267486  2530 raft_consensus.cc:740] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:17.270244  1535 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:17.267345  2610 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:17.277878  2524 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:17.278811  1690 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:17.279906  2266 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:17.258107  2665 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:17.287813  2647 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:17.265196  2578 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:17.280934  2533 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.292778  1608 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:17.293352  2688 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:17.293843  1508 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:17.294751  2609 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:57:17.295854  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:17.297194  2552 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:17.298288  2454 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:17.271770  2467 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.300706  2524 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:17.300836  2584 consensus_queue.cc:1048] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:17.302189  1438 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38804 (request call id 26) took 2599 ms. Trace:
I20260709 12:57:17.303179  2520 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.284336  1437 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54582 (request call id 147) took 3578 ms. Trace:
I20260709 12:57:17.264391  2654 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:17.323163  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 79939.9us
I20260709 12:57:17.299350  2530 consensus_queue.cc:260] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.274094  2644 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:17.317950  2609 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:17.309616  2606 raft_consensus.cc:697] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:17.328145  1438 rpcz_store.cc:276] 0709 12:57:14.702940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:14.703094 (+   154us) service_pool.cc:224] Handling call
0709 12:57:17.301974 (+2598880us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1254024,"reported_tablets":1}
I20260709 12:57:17.325167  2454 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:17.350690  2515 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:17.353274  1535 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:17.354408  2607 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:17.355043  2533 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:17.356909  2658 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:17.357493  2658 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:17.357720  2579 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:17.359965  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:17.360896  1542 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:17.361032  2618 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:17.361703  2618 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:17.362224  2430 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:57:17.362991  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 58709us
I20260709 12:57:17.364212  2618 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:17.347033  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:17.366570  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:17.366983  2653 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:17.367552  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:17.368208  1533 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:17.368861  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:17.369763  1539 raft_consensus.cc:2393] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 2: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:17.369635  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:17.370756  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:17.349861  1508 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:17.371551  1539 raft_consensus.cc:2393] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 2: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:17.372043  2675 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:17.344049  2609 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:17.373945  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:17.366387  2665 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:17.352313  2454 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:17.362869  2430 raft_consensus.cc:697] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:17.320830  2679 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.380730  2472 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:17.367044  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:17.374570  2658 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:17.391947  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:17.372820  2675 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.400916  1505 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:17.331007  2638 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:17.407014  1654 leader_election.cc:400] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3.
I20260709 12:57:17.407701  1654 leader_election.cc:403] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:57:17.395992  2472 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:17.399262  1655 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.595s (SENT) [suppressed 13 similar messages]
I20260709 12:57:17.351008  2578 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.414389  2607 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:17.411928  1539 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:17.415212  2472 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:17.331393  1437 rpcz_store.cc:276] 0709 12:57:13.705781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:13.705943 (+   162us) service_pool.cc:224] Handling call
0709 12:57:17.284072 (+3578129us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:14.040350 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:14.040947 (+   597us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:14.040988 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:57:14.041006 (+    18us) tablet.cc:662] Decoding operations
0709 12:57:14.041336 (+   330us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:14.041412 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:14.041441 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:57:14.041662 (+   221us) tablet.cc:701] Row locks acquired
0709 12:57:14.041680 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:57:14.049374 (+  7694us) write_op.cc:270] Start()
0709 12:57:14.049507 (+   133us) write_op.cc:276] Timestamp: P: 1783601834049304 usec, L: 0
0709 12:57:14.049531 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:57:14.065945 (+ 16414us) log.cc:844] Serialized 598 byte log entry
0709 12:57:14.521344 (+455399us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b54001b99d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d04ce28 00007fc860a87581 00007fc860a86d58 00007fc860a8b9f1 00007fc860a8b9a9 00007fc860a8b939 00007fc860a8b901 00007fc860a8ab2d 000000000038f354 000000000038f199
0709 12:57:15.225234 (+703890us) op_driver.cc:464] REPLICATION: finished
0709 12:57:15.647230 (+421996us) write_op.cc:301] APPLY: starting
0709 12:57:15.649776 (+  2546us) tablet.cc:1367] starting BulkCheckPresence
0709 12:57:15.664129 (+ 14353us) tablet.cc:1370] finished BulkCheckPresence
0709 12:57:15.672619 (+  8490us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:57:15.723968 (+ 51349us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:57:15.726219 (+  2251us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:57:15.726266 (+    47us) write_op.cc:312] APPLY: finished
0709 12:57:15.726462 (+   196us) log.cc:844] Serialized 22 byte log entry
0709 12:57:15.726648 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:15.726725 (+    77us) write_op.cc:454] Released schema lock
0709 12:57:15.726761 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 12:57:15.727663 (+   902us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:15.727697 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":397869,"apply.run_cpu_time_us":2121,"apply.run_wall_time_us":88898,"num_ops":1,"prepare.queue_time_us":21873,"prepare.run_cpu_time_us":54639,"prepare.run_wall_time_us":481180,"raft.queue_time_us":231160,"raft.run_cpu_time_us":14833,"raft.run_wall_time_us":300999,"replication_time_us":1111253,"spinlock_wait_cycles":36196608,"thread_start_us":684264,"threads_started":4,"wal-append.queue_time_us":504052,"wal-append.run_cpu_time_us":15149,"wal-append.run_wall_time_us":2211069}]]}
I20260709 12:57:17.448175  1542 raft_consensus.cc:2393] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 4: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:17.374061  2688 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:17.479004  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:17.480361  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:17.481372  2688 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:17.482102  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:17.482419  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:17.483383  1542 raft_consensus.cc:2368] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3.
I20260709 12:57:17.484373  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:17.485642  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:17.367669  2653 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.482564  2688 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:57:17.470810  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 125684us
I20260709 12:57:17.437031  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:17.461104  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:17.460810  1534 raft_consensus.cc:2393] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 3: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:17.445113  2598 raft_consensus.cc:1064] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
W20260709 12:57:17.449239  2693 log.cc:927] Time spent T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:57:17.456868  2692 log.cc:927] Time spent T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:57:17.450350  2467 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:17.446012  2675 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:17.438817  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:17.501559  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:17.501658  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 94981.4us
I20260709 12:57:17.450080  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:17.503455  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:17.506302  2578 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:17.506855  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:57:17.507912  2657 log.cc:927] Time spent T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.885s	user 0.004s	sys 0.001s
I20260709 12:57:17.477156  2520 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:17.452348  2430 consensus_queue.cc:237] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.432653  2679 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:17.517127  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 116391us
I20260709 12:57:17.517956  1683 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:17.513836  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 117219us
I20260709 12:57:17.499660  2607 raft_consensus.cc:697] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:17.517839  2565 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.520910  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:17.531890  1690 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
W20260709 12:57:17.531049  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 128995us
W20260709 12:57:17.502666  2598 raft_consensus.cc:1068] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Unable to promote non-voter 1d6516ff61104bdda54bde95e92fe579: Service unavailable: leader transfer in progress
I20260709 12:57:17.535975  2607 consensus_queue.cc:237] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.439199  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:17.537284  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:17.537509  2606 consensus_queue.cc:237] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.539377  2530 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.540115  2609 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.540875  1608 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:17.541108  1686 raft_consensus.cc:1240] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:17.541364  2670 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:17.541998  2564 consensus_queue.cc:1048] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:17.537196  2527 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:17.542999  2648 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3.
I20260709 12:57:17.547067  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:17.550480  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:17.550839  2516 consensus_queue.cc:1059] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:17.558207  2562 consensus_queue.cc:1048] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:17.541863  2644 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:17.573879  2654 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:17.574663  1440 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54606 (request call id 140) took 2592 ms. Trace:
I20260709 12:57:17.597023  1655 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:17.573768  2516 raft_consensus.cc:3055] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:17.576826  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:17.604065  1440 rpcz_store.cc:276] 0709 12:57:14.990392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:14.991295 (+   903us) service_pool.cc:224] Handling call
0709 12:57:17.574486 (+2583191us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":2}
I20260709 12:57:17.604544  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:17.605317  1682 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:17.605782  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:17.606439  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:17.577605  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:17.578622  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:17.607174  1682 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:17.580014  2584 consensus_queue.cc:1059] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:17.607656  1691 raft_consensus.cc:2393] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 3: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:17.608219  2584 raft_consensus.cc:3055] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:17.607615  1685 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:17.581313  1581 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:17.220881  2680 consensus_queue.cc:1175] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c262eac7fc904ae9bb91e450f6532e3f" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:57:17.588833  2669 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:17.611887  1537 raft_consensus.cc:2393] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 3: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 12:57:17.588948  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 345358us
I20260709 12:57:17.590154  2653 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:17.590111  2614 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:17.593025  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:17.594849  2658 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.596071  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:17.597527  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:17.597726  1615 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:17.595927  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:17.576277  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 819) took 1344 ms. Trace:
W20260709 12:57:17.632042  2698 log.cc:927] Time spent T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:57:17.609150  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:17.632923  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:17.633967  1687 raft_consensus.cc:2393] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 2: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:17.635353  1687 raft_consensus.cc:1275] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:17.590227  2583 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.608553  2516 raft_consensus.cc:740] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:17.608438  1683 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:17.640252  1614 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:17.608793  2584 raft_consensus.cc:740] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:17.643183  1685 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:17.597023  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:17.646694  1686 raft_consensus.cc:1275] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:17.561488  2565 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.652016  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:17.652910  2525 consensus_queue.cc:1048] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:57:17.653527  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:17.654837  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:17.655009  2516 consensus_queue.cc:260] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.656036  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:17.658375  1617 raft_consensus.cc:2393] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 3: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:17.657326  2644 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:17.657045  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:17.626546  1688 rpcz_store.cc:276] 0709 12:57:16.231871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:16.232026 (+   155us) service_pool.cc:224] Handling call
0709 12:57:16.232328 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:16.232667 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:16.232693 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:16.237100 (+  4407us) log.cc:844] Serialized 26 byte log entry
0709 12:57:16.492213 (+255113us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:16.492264 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:16.492345 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:17.507114 (+1014769us) spinlock_profiling.cc:243] Waited 3.42 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:57:17.575818 (+ 68704us) raft_consensus.cc:1685] finished
0709 12:57:17.575836 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:17.576099 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5709,"raft.queue_time_us":69316,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":7352,"spinlock_wait_cycles":7857920,"thread_start_us":211665,"threads_started":1,"wal-append.queue_time_us":352572}
I20260709 12:57:17.612805  2527 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:17.642602  2648 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:17.623390  2614 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.641388  2472 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.623390  2669 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.681931  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:17.656081  2516 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:17.755055  1505 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:17.721374  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 160833us
I20260709 12:57:17.755998  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:17.663933  2644 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:17.724989  2679 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:17.782334  2679 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.760623  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:17.784880  1610 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:57:17.786079  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:17.762921  2467 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.786758  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:17.781577  2564 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:17.693405  2598 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.740897  2613 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.702333  2658 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:17.718817  2609 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:17.792686  2467 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.795019  2551 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.796010  2638 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:17.796643  2564 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.799116  2578 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:17.802212  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:57:17.811304  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:17.741032  2618 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:57:17.840224  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:17.786957  1610 raft_consensus.cc:2393] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 3: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:17.703158  2527 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:17.789130  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:17.851444  1682 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:17.852963  1436 catalog_manager.cc:5697] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 1 to 2, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:17.861531  2551 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.908404  2578 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.910638  2551 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:17.910842  2618 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.895855  2598 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:17.913165  2702 log.cc:927] Time spent T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 12:57:17.776609  1533 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:17.852362  1508 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:17.787465  2607 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:17.881703  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:17.884414  1614 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:17.787544  2644 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:17.692521  2454 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:17.863760  2679 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:17.681087  2583 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:17.934593  2454 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:17.934712  2583 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:17.881088  2666 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:17.906294  1616 raft_consensus.cc:2393] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 3: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:17.913103  2618 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:17.906598  2298 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:17.935401  2666 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.907056  2534 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:17.939949  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:17.940402  2666 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:17.940943  1687 raft_consensus.cc:2393] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 3: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:17.941540  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:17.941730  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:17.937186  1540 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:17.942065  2564 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:17.942798  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:17.943097  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:17.944000  1533 raft_consensus.cc:2393] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 3: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:17.944936  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:17.907735  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 117245us
I20260709 12:57:17.915222  1539 raft_consensus.cc:1275] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:17.946177  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:17.946338  1655 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:17.948004  1655 leader_election.cc:400] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3.
I20260709 12:57:17.877369  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:17.921949  2669 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:17.950007  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:17.950850  2677 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:17.951709  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:17.919421  2607 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:17.952826  2607 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:17.952841  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:17.953646  1539 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:17.955714  1539 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:17.956780  2298 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:17.957271  2561 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.959309  1537 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:57:17.961246  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 109042us
I20260709 12:57:17.924933  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:17.927856  2472 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:17.910667  2578 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:17.713068  2584 consensus_queue.cc:260] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.915151  2613 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:17.932554  2619 raft_consensus.cc:3055] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:17.907192  2467 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:17.964655  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:17.959307  1539 raft_consensus.cc:1275] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:17.963147  1687 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:17.976439  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:17.977524  1690 raft_consensus.cc:2393] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 3: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:17.978528  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:17.965266  2551 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:17.991144  1537 raft_consensus.cc:1240] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: []
W20260709 12:57:17.995047  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 47281.3us
I20260709 12:57:17.999818  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:17.940310  2614 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:18.002744  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 121083us
I20260709 12:57:18.003732  2699 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:18.004307  2699 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:17.971565  2619 raft_consensus.cc:740] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:18.008401  2584 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:18.011777  2607 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.002246  1539 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:18.012152  2613 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:18.009223  2550 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:18.001415  1687 raft_consensus.cc:2393] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 2: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:18.015861  1610 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:17.983285  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 684) took 1169 ms. Trace:
I20260709 12:57:17.990255  2565 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:17.999044  2609 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:17.939980  2534 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.016995  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:18.016196  1655 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:18.016952  1537 raft_consensus.cc:1240] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:18.022590  1609 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:18.033049  1682 raft_consensus.cc:2393] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 2: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:18.033586  2534 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:18.030783  1533 raft_consensus.cc:2393] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 2: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:18.034456  2551 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:18.035087  2551 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.009267  2619 consensus_queue.cc:260] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.036844  2619 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:18.037287  2551 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:18.038796  1655 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:18.039019  1538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51498
I20260709 12:57:18.010150  2598 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:18.039745  1538 raft_consensus.cc:606] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:57:18.039860  1655 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:18.040670  2467 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:18.040907  1542 raft_consensus.cc:2368] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3.
I20260709 12:57:18.041410  2677 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:18.041813  2677 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:18.041898  2607 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:18.042199  2677 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:18.029465  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 93535.6us
I20260709 12:57:18.028605  1608 rpcz_store.cc:276] 0709 12:57:16.813487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:16.815485 (+  1998us) service_pool.cc:224] Handling call
0709 12:57:17.181392 (+365907us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b5800091e98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2ce9c 00007fc859f2ca5b 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc8620170a0 00007fc862016984 00007fc85b5916d4 00007fc85b591662
0709 12:57:17.969024 (+787632us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54001f5ed4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:17.971531 (+  2507us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":256850560}
I20260709 12:57:18.030301  2565 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.044715  1655 leader_election.cc:400] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3.
I20260709 12:57:18.049331  1655 leader_election.cc:403] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:57:18.055544  1655 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:18.041090  2467 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:18.060045  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:18.061136  2650 consensus_queue.cc:1048] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:18.062491  2648 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:18.064244  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:18.051095  2679 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:18.069285  2638 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:18.068159  1609 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:18.032543  2472 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:18.034020  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:18.069088  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:18.089821  1538 raft_consensus.cc:1275] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:18.075923  1614 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:18.069720  2646 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:18.078997  1687 raft_consensus.cc:2393] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 3: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:18.034123  2609 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.083537  1505 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:18.074326  2467 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:18.096158  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:18.102447  1538 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:18.096745  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:18.097162  2472 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.054105  2565 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.100275  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:18.101223  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:18.120409  1609 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:18.121507  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:18.122166  1609 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:18.123046  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:18.123602  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:18.112905  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:18.125525  2644 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.126183  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:18.126814  1614 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:18.126914  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:18.127588  1617 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:18.127708  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:18.113982  2583 raft_consensus.cc:2804] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:18.129005  2583 raft_consensus.cc:697] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:18.116874  2675 raft_consensus.cc:1064] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
W20260709 12:57:18.117156  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:18.117899  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:18.118310  2708 log.cc:927] Time spent T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.148s	user 0.000s	sys 0.004s
I20260709 12:57:18.112989  2566 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.104277  1686 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:18.114552  1608 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
W20260709 12:57:18.122190  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:18.128405  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:18.124276  1616 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:18.133623  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:18.134752  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:18.138921  1581 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:18.142558  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:18.139672  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:18.146754  1537 raft_consensus.cc:2393] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 2: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:18.147681  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:18.148335  2583 consensus_queue.cc:237] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:18.152172  2564 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:18.152827  2564 raft_consensus.cc:697] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:18.153782  2564 consensus_queue.cc:237] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.153861  1436 catalog_manager.cc:5697] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 1 to 2, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:18.148460  1686 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:18.156056  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:18.147702  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:18.148366  1581 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:18.153932  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:18.173683  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:18.116880  2565 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:18.177316  1614 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:18.123576  1609 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:57:18.156986  1537 raft_consensus.cc:2376] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2. Re-sending same reply.
W20260709 12:57:18.182273  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:18.142889  2675 raft_consensus.cc:1068] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Unable to promote non-voter 1d6516ff61104bdda54bde95e92fe579: Service unavailable: leader transfer in progress
W20260709 12:57:18.185000  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 47210.2us
I20260709 12:57:18.187668  1535 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:18.188956  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:18.190622  1535 raft_consensus.cc:1275] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:18.195459  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:18.174834  2515 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.197729  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:18.199501  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 43989.6us
I20260709 12:57:18.199682  1583 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:18.202957  2644 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:18.203182  1617 raft_consensus.cc:1275] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:18.203575  1536 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:18.204442  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:18.205448  1537 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:18.146762  2566 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.209057  2566 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:18.208904  2659 consensus_queue.cc:1059] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:18.209230  2472 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:18.209780  2659 raft_consensus.cc:3055] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:18.210145  2659 raft_consensus.cc:740] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:18.210949  2542 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:18.211503  2721 log.cc:927] Time spent T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:57:18.212805  1583 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:18.213413  1685 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:18.215231  2606 raft_consensus.cc:1064] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
W20260709 12:57:18.215756  2606 raft_consensus.cc:1068] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Unable to promote non-voter 1d6516ff61104bdda54bde95e92fe579: Service unavailable: leader transfer in progress
I20260709 12:57:18.217206  2552 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.217707  2552 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.211001  2659 consensus_queue.cc:260] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.220871  2552 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:18.221016  2659 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:18.221566  2536 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:18.221982  2536 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:18.222330  2536 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:18.205672  2669 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:57:18.224990  1684 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:18.227267  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:18.208293  2584 consensus_queue.cc:1048] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:57:18.229040  2618 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:18.229609  2618 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.230917  2459 consensus_queue.cc:1059] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:18.228844  2266 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:18.222259  1687 raft_consensus.cc:1275] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:18.232630  2714 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:18.235244  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:18.235880  1537 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:18.201064  2653 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:18.237466  2653 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.239305  1505 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:18.239475  2653 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:18.240259  1505 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:18.240541  2713 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.212s	user 0.002s	sys 0.000s
I20260709 12:57:18.241436  1685 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:18.242023  1583 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:18.227118  1610 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:18.242882  2669 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:18.243251  2669 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:18.243618  2669 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:18.243993  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:18.246941  1505 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:18.194866  2610 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:18.252113  1537 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:18.255867  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:18.264146  1617 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:18.261987  1654 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:18.265441  1505 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:18.221751  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:18.266589  2529 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:18.266510  2679 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:18.266764  2472 consensus_queue.cc:1048] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:18.267766  2618 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:18.268980  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:18.266782  1615 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:18.270417  1686 raft_consensus.cc:1240] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:18.265748  1654 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:18.273739  1654 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:18.282608  1654 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:18.284941  2677 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.285964  1581 leader_election.cc:400] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3.
I20260709 12:57:18.253733  2552 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:57:18.288892  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 43577.7us
I20260709 12:57:18.253249  2607 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:18.268998  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:18.261615  2680 consensus_queue.cc:1048] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:57:18.251081  2515 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.361958  1581 leader_election.cc:403] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:57:18.306569  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:18.347599  1536 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 776) took 3572 ms (client timeout 2077 ms). Trace:
I20260709 12:57:18.291329  1505 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:18.328155  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:18.362025  1583 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:18.378270  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 95733.9us
W20260709 12:57:18.377897  1536 rpcz_store.cc:269] 0709 12:57:14.766187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:14.770942 (+  4755us) service_pool.cc:224] Handling call
0709 12:57:15.522673 (+751731us) spinlock_profiling.cc:243] Waited 8.33 ms on lock 0x7b5800002798. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc8620170a0 00007fc862016984 00007fc85b5916d4 00007fc85b591662
0709 12:57:18.050729 (+2528056us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b5400390420. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85cfc8dc0 00007fc85d054e18 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:18.337927 (+287198us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b54002e8e54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:18.338072 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4822104576}
I20260709 12:57:18.336320  1610 raft_consensus.cc:2393] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 2: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:18.276882  2565 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:18.276955  2584 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:57:18.382114  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 90874.2us
I20260709 12:57:18.386538  1505 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:18.300966  2618 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:57:18.378921  1425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 186692us
I20260709 12:57:18.384282  1542 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:18.362561  2607 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:18.386859  1537 raft_consensus.cc:2393] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 3: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:18.387279  1654 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:18.287544  2679 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:57:18.389226  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 110862us
I20260709 12:57:18.388909  1583 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:18.342183  2724 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.362449  2552 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:18.387924  1505 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:18.383867  1541 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:18.304390  2610 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:57:18.398360  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:18.438146  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 50288.2us
I20260709 12:57:18.307217  2472 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:18.385911  2430 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:18.387878  2650 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:18.449163  1581 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:18.450438  1581 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:18.386055  2565 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:18.392544  2530 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:18.391319  2516 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.383611  1612 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:18.458469  2719 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:18.459164  2524 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:18.459607  2665 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:18.449044  2454 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:18.462882  2610 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:18.439477  2472 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:18.228598  1436 catalog_manager.cc:5697] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 1 to 2, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:18.465728  2515 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:18.466267  2534 raft_consensus.cc:1064] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:57:18.467844  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:18.468148  1609 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:18.469444  2650 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:18.436338  2552 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:18.441627  2653 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:18.448045  2430 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:18.454560  2619 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:57:18.470712  2614 raft_consensus.cc:3055] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:18.475739  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:18.477921  1613 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:18.425891  2607 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:18.486510  1617 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:18.477902  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:18.487136  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:18.476241  2646 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3.
I20260709 12:57:18.391309  2609 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:18.439591  2584 raft_consensus.cc:697] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:18.454842  2652 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:18.479892  2565 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:18.491652  2516 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.439570  2724 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.487708  2719 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:18.456897  2605 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:57:18.481438  2618 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
W20260709 12:57:18.568598  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:18.569235  2719 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:18.494079  2454 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:18.473726  2699 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:18.490290  2524 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:18.500149  2472 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:18.557268  2652 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:18.551141  2614 raft_consensus.cc:740] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:57:18.566243  2729 log.cc:927] Time spent T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:57:18.487792  2718 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:18.546430  2430 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:18.546715  2644 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3.
I20260709 12:57:18.585928  1615 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
W20260709 12:57:18.590958  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 142730us
I20260709 12:57:18.582913  2454 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:18.612321  1654 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:18.616451  2653 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:18.616917  2529 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:18.618427  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:18.620985  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:18.621253  2584 consensus_queue.cc:237] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.616966  2653 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:18.622275  2653 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:18.621701  1683 raft_consensus.cc:1240] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:18.622196  1690 raft_consensus.cc:2393] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 2: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:18.588231  2524 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:18.627842  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 182105us
I20260709 12:57:18.592007  2652 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:18.592308  2677 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:18.630453  1505 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:18.625080  2618 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:18.645620  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 195225us
I20260709 12:57:18.682452  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:18.652176  1655 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:18.670696  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:18.702548  1690 raft_consensus.cc:2393] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 3: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:18.668582  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:18.703362  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 314531us
W20260709 12:57:18.704411  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 52346.5us
I20260709 12:57:18.608333  2718 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.694387  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:57:18.684906  2728 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
W20260709 12:57:18.680935  2734 log.cc:927] Time spent T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:57:18.708834  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:18.711606  2650 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:18.712857  2736 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:18.686895  2561 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.006s	sys 0.014s
I20260709 12:57:18.719048  1687 raft_consensus.cc:2393] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 3: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:18.659301  2675 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:18.723341  2650 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.724345  2736 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.705456  2677 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:18.693519  2724 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:18.706033  2467 consensus_meta.cc:287] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.000s
W20260709 12:57:18.729323  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:18.720016  1655 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:57:18.729977  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:18.729847  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:18.705255  2536 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.731122  1581 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:18.732594  2680 raft_consensus.cc:1064] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:57:18.682857  1684 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50694
W20260709 12:57:18.733963  2726 log.cc:927] Time spent T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.354s	user 0.002s	sys 0.000s
I20260709 12:57:18.738021  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:18.739260  2606 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.753234  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:18.753302  2606 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.754066  2467 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.740613  2679 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.741338  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:18.758235  1687 raft_consensus.cc:2393] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 3: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:18.681636  1682 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:18.728876  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:18.761155  1690 raft_consensus.cc:2393] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 2: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:18.707922  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:18.749816  1689 raft_consensus.cc:1275] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:57:18.730484  2561 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.006s	sys 0.020s
I20260709 12:57:18.751511  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:18.729795  2542 consensus_meta.cc:287] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.002s
I20260709 12:57:18.772217  1583 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:18.756724  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:18.766710  2467 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:18.766853  2536 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:18.765053  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:18.767450  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:18.768456  1614 raft_consensus.cc:1240] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:18.730039  2675 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:18.765049  2736 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:18.773579  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:18.772782  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:18.708807  2618 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.767681  1684 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:18.748611  2516 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:18.729696  2669 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.703590  2614 consensus_queue.cc:260] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:18.781019  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:18.782953  1538 raft_consensus.cc:2393] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 2: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:18.782411  1685 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:18.783738  1505 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:18.759910  2724 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:18.746160  2430 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.750360  2646 consensus_queue.cc:1059] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:57:18.750852  2648 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
W20260709 12:57:18.812023  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 105159us
I20260709 12:57:18.785928  1583 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:18.787876  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 67959.6us
I20260709 12:57:18.760398  2679 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.780200  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:18.784735  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:18.974202  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:18.784024  2675 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:18.980147  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 847) took 1066 ms. Trace:
I20260709 12:57:18.856037  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:18.779691  2551 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:18.921133  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:18.924384  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:18.973052  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 791) took 3466 ms. Trace:
I20260709 12:57:18.629261  1436 catalog_manager.cc:5697] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 2 to 3, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 3 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:18.776615  2677 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:18.919601  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:18.980404  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 196750us
I20260709 12:57:18.828024  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:18.986277  1691 raft_consensus.cc:2393] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 3: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 12:57:18.899581  2744 log.cc:927] Time spent T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:57:18.986641  1688 rpcz_store.cc:276] 0709 12:57:17.913289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:17.982600 (+ 69311us) service_pool.cc:224] Handling call
0709 12:57:17.982969 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:17.983995 (+  1026us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:17.984024 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:17.999129 (+ 15105us) log.cc:844] Serialized 26 byte log entry
0709 12:57:18.072194 (+ 73065us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:18.072232 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:18.072298 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:18.733309 (+661011us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:57:18.974731 (+241422us) raft_consensus.cc:1685] finished
0709 12:57:18.974757 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:18.980069 (+  5312us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":681,"raft.queue_time_us":1269,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":6014,"spinlock_wait_cycles":6585600,"thread_start_us":18957,"threads_started":1,"wal-append.queue_time_us":228091}
W20260709 12:57:18.992429  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:18.993430  2750 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:19.001204  2750 raft_consensus.cc:697] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:19.002130  2750 consensus_queue.cc:237] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.003664  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:18.971473  2618 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:19.004393  1688 raft_consensus.cc:2468] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 3.
I20260709 12:57:18.969941  2652 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.005676  2269 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:19.005916  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:19.006641  2652 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:18.909101  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:18.988350  1614 raft_consensus.cc:2393] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 3: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:18.996551  1617 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:19.007155  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:19.007826  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:18.997761  1505 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:18.835237  2606 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:18.788077  2748 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:18.993796  2756 consensus_queue.cc:1059] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:57:18.907383  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:57:18.999699  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:18.905159  2607 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.882035  1612 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:18.812099  1684 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:18.816829  2467 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:18.811141  2530 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:18.986756  2650 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:18.900280  2754 log.cc:927] Time spent T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:57:19.009776  1613 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:19.016101  2677 raft_consensus.cc:697] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 2 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:18.985934  2578 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:18.857056  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:19.012883  1538 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:19.035669  2578 raft_consensus.cc:697] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:19.035841  2653 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.036788  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:19.036609  2578 consensus_queue.cc:237] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.037526  1538 raft_consensus.cc:2393] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 2: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:19.038287  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:19.012823  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 226977us
I20260709 12:57:19.038859  1538 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:19.010711  1581 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:19.013996  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:19.007437  2699 raft_consensus.cc:2804] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:19.035804  1610 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:19.041066  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:19.041563  2718 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:19.041793  1615 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:19.041002  2699 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:19.042467  2699 raft_consensus.cc:3060] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:18.996395  2749 raft_consensus.cc:3055] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:19.015347  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:18.857197  2552 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.006837  1688 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:18.991616  1541 rpcz_store.cc:276] 0709 12:57:15.506481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:15.508843 (+  2362us) service_pool.cc:224] Handling call
0709 12:57:16.341433 (+832590us) spinlock_profiling.cc:243] Waited 6.92 ms on lock 0x7b5800002798. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc86202afc0 00007fc862015929 00007fc8620153d2 00007fc85b58cbd4
0709 12:57:18.341207 (+1999774us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:18.436576 (+ 95369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:18.972800 (+536224us) spinlock_profiling.cc:243] Waited 2 s on lock 0x7b54002e8e50. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:18.972967 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4609367168}
I20260709 12:57:19.018654  2756 raft_consensus.cc:3055] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:19.011790  2598 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:19.021014  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:19.021080  1655 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:18.903009  2454 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.991561  2724 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.961211  2524 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:19.023000  2566 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:19.024528  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:19.024755  2565 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:18.999406  2551 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.027240  2467 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.029539  2472 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:19.016454  2610 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:18.867753  1683 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:19.032644  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:19.068270  2648 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:19.019882  2680 consensus_queue.cc:237] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:19.104241  2454 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:19.066334  2669 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:19.105471  2430 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:19.030650  2719 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.107004  2675 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.107514  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:19.023399  2618 consensus_queue.cc:1048] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:57:18.786787  1611 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
W20260709 12:57:19.116431  1611 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 698) took 1678 ms (client timeout 2115 ms). Trace:
W20260709 12:57:19.039599  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:19.045192  1583 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:19.045835  2749 raft_consensus.cc:740] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:19.056464  1505 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:19.104251  2658 raft_consensus.cc:1064] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
W20260709 12:57:19.119905  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 63543.2us
I20260709 12:57:19.057019  1654 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:57:19.123756  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 66835.2us
I20260709 12:57:19.058749  1617 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
W20260709 12:57:19.065797  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 44804.3us
I20260709 12:57:19.125111  1655 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:19.126127  1655 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:19.127369  1655 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:19.065081  1614 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:19.066298  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:19.131290  2566 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:19.042327  1610 raft_consensus.cc:1240] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:19.046655  2644 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:19.067291  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:19.067911  1615 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:19.132612  2618 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:19.133019  2618 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:19.133391  2618 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:19.102757  2565 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:19.132144  2751 log.cc:927] Time spent T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.169s	user 0.002s	sys 0.003s
I20260709 12:57:19.040899  2653 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:19.019661  1436 catalog_manager.cc:5697] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 1 to 2, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:19.143437  1436 catalog_manager.cc:5697] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 1 to 2, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:19.078711  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:19.082201  1540 raft_consensus.cc:2393] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 3: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:19.082959  1535 raft_consensus.cc:1240] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:19.066355  2598 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:19.066798  2607 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:19.089452  1542 raft_consensus.cc:1240] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:19.118079  2527 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.033385  2650 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.148862  2527 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.149190  2650 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.150167  2749 consensus_queue.cc:260] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.151302  2650 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:19.151703  2527 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:19.139927  2515 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:19.153481  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:19.090507  1608 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:19.102963  2679 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:19.091511  2551 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:19.092428  2731 log.cc:927] Time spent T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.483s	user 0.001s	sys 0.001s
I20260709 12:57:19.132285  2644 raft_consensus.cc:697] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:19.094352  2610 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.095150  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:19.097414  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:19.064687  2756 raft_consensus.cc:740] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:19.098206  2748 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:19.156822  2598 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.054666  2677 consensus_queue.cc:237] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.100659  1616 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:19.101965  2724 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:19.100165  2524 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:19.102108  2552 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:19.112429  1537 raft_consensus.cc:2393] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 4: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:19.102818  2561 raft_consensus.cc:1064] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:57:19.105556  2659 raft_consensus.cc:1064] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:57:19.108430  2719 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:19.115368  2614 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:19.118125  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 72986.9us
I20260709 12:57:19.183552  1583 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:19.119179  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:19.128222  1654 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:19.129201  1655 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:19.130164  1505 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:19.130836  2619 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:19.073521  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:19.175891  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:19.131503  1612 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:19.142288  1685 raft_consensus.cc:2393] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 2: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:19.147657  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:57:19.188961  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 59819.4us
I20260709 12:57:19.189584  1540 raft_consensus.cc:2368] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3.
I20260709 12:57:19.100131  2699 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:19.112954  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:19.117449  1683 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:19.131810  2566 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:19.093889  2472 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:19.151547  2749 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.147640  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:19.116938  1611 rpcz_store.cc:269] 0709 12:57:17.438155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:17.438401 (+   246us) service_pool.cc:224] Handling call
0709 12:57:19.116264 (+1677863us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54001f68d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:19.116370 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2925499776}
I20260709 12:57:19.208207  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 852) took 1275 ms. Trace:
I20260709 12:57:19.135668  2430 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.141712  2454 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:19.145478  1436 catalog_manager.cc:5697] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 1 to 2, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:19.099262  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:19.177609  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 858) took 1150 ms. Trace:
I20260709 12:57:19.187319  1583 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:19.138559  1686 raft_consensus.cc:1275] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:57:19.188138  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 59999.5us
I20260709 12:57:19.176819  2467 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:19.191162  1508 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:19.178227  2551 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:19.175865  1541 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
W20260709 12:57:19.198122  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 68069.5us
I20260709 12:57:19.207268  1655 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:19.208803  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:19.183969  2675 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:19.216116  1654 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:19.224265  1654 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:19.199898  2566 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.199729  2679 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:19.202937  2515 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:19.220913  1655 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:19.203198  2552 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:19.217092  1583 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:19.215189  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:19.227509  2610 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:19.226326  1654 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:19.229972  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:19.208645  1539 rpcz_store.cc:276] 0709 12:57:17.927756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:18.027147 (+ 99391us) service_pool.cc:224] Handling call
0709 12:57:18.042652 (+ 15505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:18.090564 (+ 47912us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:18.090594 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:18.117530 (+ 26936us) log.cc:844] Serialized 26 byte log entry
0709 12:57:18.374522 (+256992us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:18.374565 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:18.374655 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:19.091838 (+717183us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:57:19.188233 (+ 96395us) raft_consensus.cc:1685] finished
0709 12:57:19.188255 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:19.203418 (+ 15163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20846,"raft.queue_time_us":27674,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":145,"spinlock_wait_cycles":8160512,"thread_start_us":256565,"threads_started":1,"wal-append.queue_time_us":429174}
I20260709 12:57:19.211632  2454 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:19.234444  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:19.241742  1505 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:19.237648  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 51149us
I20260709 12:57:19.244335  1583 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:19.221591  2653 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:19.221438  2619 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:19.222728  2430 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.239346  1655 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:19.185236  2756 consensus_queue.cc:260] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.248068  1583 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:19.268769  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:19.228641  2646 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:19.275089  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 432) took 1036 ms. Trace:
I20260709 12:57:19.230302  2467 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:57:19.247745  2761 log.cc:927] Time spent T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:57:19.225121  2607 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:19.284793  1583 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:19.232856  2515 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:19.286475  1542 rpcz_store.cc:276] 0709 12:57:18.238243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:18.391809 (+153566us) service_pool.cc:224] Handling call
0709 12:57:18.447930 (+ 56121us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:19.148165 (+700235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:19.274796 (+126631us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b54002e7f54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:19.275022 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1472128768}
I20260709 12:57:19.247117  2454 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.236243  2552 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:19.281498  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:19.236981  2565 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 12:57:19.240437  2638 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:19.240509  2606 consensus_queue.cc:1059] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 12:57:19.276724  2610 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:19.245445  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:19.315933  2756 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.316697  1615 raft_consensus.cc:1275] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:19.282886  2550 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:19.278503  2619 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:19.286754  2747 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:57:19.321336  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 75077.7us
W20260709 12:57:19.328162  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 101942us
I20260709 12:57:19.330257  1583 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:19.288590  2467 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:19.244861  2666 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.229498  2551 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:19.332978  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:19.333611  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 426) took 1095 ms. Trace:
I20260709 12:57:19.225955  2644 consensus_queue.cc:237] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.244825  2736 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 12:57:19.310972  2748 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:19.311514  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:19.334196  2650 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:57:19.320303  2755 log.cc:927] Time spent T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.214s	user 0.000s	sys 0.003s
I20260709 12:57:19.316087  2515 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.284175  2675 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:57:19.341090  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 99405.6us
I20260709 12:57:19.214622  1682 rpcz_store.cc:276] 0709 12:57:18.023047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:18.033726 (+ 10679us) service_pool.cc:224] Handling call
0709 12:57:19.162822 (+1129096us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b540008edd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:19.173116 (+ 10294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1083996544}
I20260709 12:57:19.329067  2552 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.318104  2646 raft_consensus.cc:697] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:19.346372  1615 raft_consensus.cc:1275] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:19.350734  1616 rpcz_store.cc:276] 0709 12:57:18.238015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:18.475416 (+237401us) service_pool.cc:224] Handling call
0709 12:57:19.333380 (+857964us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b540008c0d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:19.333526 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1271710592}
I20260709 12:57:19.350378  1617 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:19.351315  1583 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:19.409093  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:57:19.413012  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 61779.7us
W20260709 12:57:19.342808  2758 log.cc:927] Time spent T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:57:19.313768  2679 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.383932  1508 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:19.342829  2607 raft_consensus.cc:3055] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:19.340318  2610 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:19.352995  2467 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:19.346838  2619 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.336638  2530 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:19.345139  2550 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:19.349035  2747 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:19.396261  2675 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:19.379520  2524 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:57:19.390574  2760 log.cc:927] Time spent T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:57:19.345234  2542 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:19.387224  1610 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:19.422466  2699 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:19.428046  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 44183.1us
I20260709 12:57:19.414378  1533 raft_consensus.cc:1275] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:19.410058  2767 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.413800  2527 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:57:19.413616  2759 log.cc:927] Time spent T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 12:57:19.431607  2610 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.430163  2607 raft_consensus.cc:740] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:19.476279  1508 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:19.449955  2524 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:19.436103  2768 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:19.438512  2550 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.420331  2584 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:57:19.450089  2675 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.512701  1508 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:19.514302  1508 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:19.442842  2747 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.396253  2650 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:19.522802  2302 raft_consensus.cc:1240] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:19.524221  2650 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:19.397114  2658 consensus_queue.cc:237] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:19.516959  2724 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:19.490057  2430 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:19.439127  2774 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.529683  2774 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.517050  1609 raft_consensus.cc:1275] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:19.478615  2638 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:19.487388  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:19.487633  2736 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:19.430433  2679 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.501886  2524 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.546376  1508 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:19.559155  1508 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:19.452267  2536 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:57:19.386895  1436 catalog_manager.cc:5697] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 1 to 2, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
W20260709 12:57:19.555924  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 80300.6us
I20260709 12:57:19.528450  1683 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:19.532224  2774 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:19.549762  2301 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 2 LEARNER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:19.488389  1684 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:19.566576  1508 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:57:19.559336  2750 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.013s	sys 0.015s
I20260709 12:57:19.561074  2724 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:19.562003  2680 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:19.498683  2646 consensus_queue.cc:237] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.490316  2767 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:19.614115  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:19.608843  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:57:19.577807  2750 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.013s	sys 0.015s
I20260709 12:57:19.598747  1508 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:57:19.614828  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 44431us
I20260709 12:57:19.567523  2650 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:19.623152  1581 leader_election.cc:400] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3.
I20260709 12:57:19.623553  1581 leader_election.cc:403] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:57:19.553072  2638 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:57:19.607115  2765 log.cc:927] Time spent T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
W20260709 12:57:19.626438  2762 log.cc:927] Time spent T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.228s	user 0.001s	sys 0.001s
I20260709 12:57:19.614392  2578 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:57:19.608548  2764 log.cc:927] Time spent T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:57:19.557750  2430 consensus_queue.cc:1059] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:57:19.557410  2736 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:19.619527  2752 log.cc:927] Time spent T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.742s	user 0.001s	sys 0.003s
I20260709 12:57:19.596488  2551 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:19.638895  1581 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:19.631943  2550 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:19.630155  2454 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.647245  1614 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:19.579757  2648 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:19.606392  2771 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:57:19.687853  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:19.716187  2644 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.625154  2652 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.640123  2583 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:19.573639  2607 consensus_queue.cc:260] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:19.698271  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 59482.3us
I20260709 12:57:19.687034  2777 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.620149  2658 consensus_queue.cc:1048] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
W20260709 12:57:19.696194  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 61680.2us
I20260709 12:57:19.633661  2472 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:19.620916  2515 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.652884  2614 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.693305  2769 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:19.634318  2650 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.690865  2605 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:19.693746  2677 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:19.625845  2618 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.636305  2776 consensus_queue.cc:1059] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.238s
I20260709 12:57:19.745862  2516 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:19.784754  2516 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:19.691533  2718 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
W20260709 12:57:19.760648  2778 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:57:19.785014  2776 raft_consensus.cc:3055] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:19.785524  2776 raft_consensus.cc:740] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:19.786556  2776 consensus_queue.cc:260] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.748039  2770 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:19.765038  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 743) took 1029 ms. Trace:
I20260709 12:57:19.761526  2472 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.788676  1687 rpcz_store.cc:276] 0709 12:57:18.735286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:19.121974 (+386688us) service_pool.cc:224] Handling call
0709 12:57:19.157422 (+ 35448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:19.160882 (+  3460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:19.160918 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:19.164909 (+  3991us) log.cc:844] Serialized 26 byte log entry
0709 12:57:19.294977 (+130068us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:19.708430 (+413453us) log.cc:844] Serialized 14 byte log entry
0709 12:57:19.708661 (+   231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:19.708732 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:19.764791 (+ 56059us) raft_consensus.cc:1685] finished
0709 12:57:19.764813 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:19.764973 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6105,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":47331,"thread_start_us":511207,"threads_started":2,"wal-append.queue_time_us":230051}
I20260709 12:57:19.747083  2644 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.791113  2770 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:19.792443  2534 raft_consensus.cc:1068] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f: Unable to promote non-voter 1d6516ff61104bdda54bde95e92fe579: Illegal state: Replica c262eac7fc904ae9bb91e450f6532e3f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:57:19.758049  1684 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:19.765781  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 745) took 1030 ms. Trace:
I20260709 12:57:19.757117  2607 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.755304  2583 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.751068  2467 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.780512  2677 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:19.760978  2766 log.cc:927] Time spent T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 12:57:19.787460  2516 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.774159  2302 raft_consensus.cc:1275] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:19.806905  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 431) took 1568 ms. Trace:
I20260709 12:57:19.750414  2652 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.795288  1691 rpcz_store.cc:276] 0709 12:57:18.735794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:19.126214 (+390420us) service_pool.cc:224] Handling call
0709 12:57:19.126553 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:19.135224 (+  8671us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:19.135257 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:19.154713 (+ 19456us) log.cc:844] Serialized 26 byte log entry
0709 12:57:19.234468 (+ 79755us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:19.746143 (+511675us) log.cc:844] Serialized 14 byte log entry
0709 12:57:19.746444 (+   301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:19.746513 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:19.765566 (+ 19053us) raft_consensus.cc:1685] finished
0709 12:57:19.765587 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:19.765722 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4554,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":4085,"thread_start_us":524287,"threads_started":2,"wal-append.queue_time_us":175269}
W20260709 12:57:19.782855  2566 consensus_meta.cc:287] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.556s	user 0.010s	sys 0.000s
I20260709 12:57:19.816996  1536 rpcz_store.cc:276] 0709 12:57:18.238021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:18.391399 (+153378us) service_pool.cc:224] Handling call
0709 12:57:18.440193 (+ 48794us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:18.445539 (+  5346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:18.445576 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:18.478610 (+ 33034us) log.cc:844] Serialized 26 byte log entry
0709 12:57:18.625856 (+147246us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:18.625932 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:18.626062 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:19.287745 (+661683us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:57:19.777181 (+489436us) raft_consensus.cc:1685] finished
0709 12:57:19.777207 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:19.806791 (+ 29584us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4934,"raft.queue_time_us":8372,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":4036,"spinlock_wait_cycles":30480768,"thread_start_us":125148,"threads_started":1,"wal-append.queue_time_us":215173}
I20260709 12:57:19.798131  2776 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:19.757004  2777 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.830682  2650 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:19.831243  2777 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:19.818385  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:50694 (request call id 720) took 1129 ms. Trace:
I20260709 12:57:19.824653  2699 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.847848  2767 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:19.850595  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 100548us
I20260709 12:57:19.866674  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 437) took 1037 ms. Trace:
W20260709 12:57:19.869897  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 271195us
I20260709 12:57:19.867130  1613 rpcz_store.cc:276] 0709 12:57:18.829436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:19.120215 (+290779us) service_pool.cc:224] Handling call
0709 12:57:19.159877 (+ 39662us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:19.161690 (+  1813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:19.161710 (+    20us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:19.179227 (+ 17517us) log.cc:844] Serialized 26 byte log entry
0709 12:57:19.217652 (+ 38425us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:19.217690 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:19.217755 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:19.866450 (+648695us) raft_consensus.cc:1685] finished
0709 12:57:19.866470 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:19.866611 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1106,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":8457,"thread_start_us":37724,"threads_started":1,"wal-append.queue_time_us":107580}
I20260709 12:57:19.871683  1508 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:19.828356  2566 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:19.873914  1508 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:19.875682  1508 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:19.876390  2790 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:19.877341  1540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51498
I20260709 12:57:19.877909  1540 raft_consensus.cc:606] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:57:19.877264  2790 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:19.879129  2583 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:19.881042  2768 raft_consensus.cc:3055] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:19.881434  2768 raft_consensus.cc:740] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:19.882176  2768 consensus_queue.cc:260] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:19.882695  2610 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.886257  1540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51498
I20260709 12:57:19.886828  1540 raft_consensus.cc:606] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:57:19.887367  2524 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.889660  2302 raft_consensus.cc:1240] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:19.890461  2677 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:19.857275  2736 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:19.871498  2638 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:19.849640  1684 rpcz_store.cc:276] 0709 12:57:18.681140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:18.682689 (+  1549us) service_pool.cc:224] Handling call
0709 12:57:19.806758 (+1124069us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:19.891259  2666 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:19.891853  2472 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:19.874240  2782 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:19.873916  2454 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:19.892879  2771 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:19.893335  2771 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:19.893705  2771 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:19.894652  1688 raft_consensus.cc:2393] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 3: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 12:57:19.896224  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:19.877830  2724 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:19.883100  2768 raft_consensus.cc:3060] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:19.909824  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:19.867601  2605 consensus_queue.cc:1048] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:57:19.893067  2527 consensus_queue.cc:1048] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:57:19.912465  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:19.913877  2467 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:19.892942  2782 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.896835  2644 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:19.914492  1683 raft_consensus.cc:2368] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4.
I20260709 12:57:19.904502  2269 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:19.907052  2747 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.923166  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:19.923939  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:19.924886  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:19.908444  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:19.909207  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:19.906332  2550 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:19.853721  2699 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:19.875730  2515 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:19.898689  2610 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:19.898377  2638 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:57:19.925618  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:19.926367  1686 raft_consensus.cc:1275] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:19.927552  1687 raft_consensus.cc:2393] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 3: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:19.911911  2666 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:19.922623  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:19.942266  1683 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:19.942777  2805 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:19.943341  1686 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:19.943674  1683 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:19.942866  1687 raft_consensus.cc:1275] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 12:57:19.943954  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 44947.4us
I20260709 12:57:19.936661  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 439) took 1175 ms. Trace:
I20260709 12:57:19.947190  1611 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:19.927580  2566 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:19.930714  2619 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.921388  2552 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.943416  2747 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:19.954942  2756 consensus_meta.cc:287] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.607s	user 0.012s	sys 0.003s
I20260709 12:57:19.968590  1614 raft_consensus.cc:1240] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:19.945602  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 12:57:19.962152  2749 consensus_meta.cc:287] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.754s	user 0.012s	sys 0.004s
I20260709 12:57:19.950870  1610 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:19.961143  1609 raft_consensus.cc:1240] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:19.948704  2638 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.974176  2619 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:19.958742  2666 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:19.986359  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:57:19.983983  1425 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 96219.4us
I20260709 12:57:19.989228  1691 raft_consensus.cc:2376] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3. Re-sending same reply.
I20260709 12:57:19.994570  2299 raft_consensus.cc:1275] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 2 LEARNER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:19.947544  1534 rpcz_store.cc:276] 0709 12:57:18.761678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:18.907053 (+145375us) service_pool.cc:224] Handling call
0709 12:57:19.926963 (+1019910us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b540010b8d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:19.934170 (+  7207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":336329472}
I20260709 12:57:19.982561  2524 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:19.998611  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:20.000640  1691 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:19.983464  2302 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:57:20.004312  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:57:19.993062  2598 consensus_meta.cc:287] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.811s	user 0.004s	sys 0.013s
I20260709 12:57:20.009315  1583 leader_election.cc:400] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4.
I20260709 12:57:20.009747  1583 leader_election.cc:403] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:57:20.011229  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:20.004349  1682 raft_consensus.cc:2410] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:20.001986  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:20.026317  1583 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:20.031961  1583 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:20.016276  1684 raft_consensus.cc:2410] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:20.007915  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:20.039587  1583 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:20.043634  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:20.016109  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:20.024695  2524 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4.
I20260709 12:57:20.046499  1583 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:20.027573  2782 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:20.031847  2783 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:20.009718  2598 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:20.050061  1656 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 12:57:20.041002  2550 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:20.038061  2644 consensus_queue.cc:1048] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:57:20.045506  2779 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:20.042990  2658 consensus_queue.cc:1048] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:57:20.186946  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:20.187319  1613 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:20.188253  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:20.060222  1609 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:20.084610  2550 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:20.208215  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:20.085109  2619 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:20.211899  2619 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:20.212425  2619 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:20.208832  2779 raft_consensus.cc:697] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:20.214856  2779 consensus_queue.cc:237] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:20.219121  2803 log.cc:927] Time spent T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
W20260709 12:57:20.196992  2561 raft_consensus.cc:1068] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f: Unable to promote non-voter 1d6516ff61104bdda54bde95e92fe579: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }.
  Pending config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:20.185161  2749 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:20.184998  2552 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:20.045929  2798 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.181s
I20260709 12:57:20.217941  2550 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:20.246235  2808 log.cc:927] Time spent T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.151s	user 0.000s	sys 0.008s
W20260709 12:57:20.246870  2675 consensus_meta.cc:287] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.697s	user 0.006s	sys 0.004s
I20260709 12:57:20.247284  2675 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:20.210539  2797 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:20.205222  2750 consensus_queue.cc:1048] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:57:20.225920  2749 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:20.256242  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 731) took 1528 ms. Trace:
I20260709 12:57:20.256805  1688 rpcz_store.cc:276] 0709 12:57:18.727588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:19.065163 (+337575us) service_pool.cc:224] Handling call
0709 12:57:20.255989 (+1190826us) spinlock_profiling.cc:243] Waited 748 ms on lock 0x7b54000df054. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:20.256167 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1719300864}
I20260709 12:57:20.225845  2747 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:20.223855  1613 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:20.243237  2638 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:20.270433  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:20.262996  2807 log.cc:927] Time spent T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 12:57:20.259078  2749 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:20.260447  2561 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:20.263461  2747 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
W20260709 12:57:20.290185  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:20.259578  2797 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:20.289635  2812 log.cc:927] Time spent T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 12:57:20.316632  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 127426us
I20260709 12:57:20.291219  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:20.306269  1609 raft_consensus.cc:1240] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:57:20.322515  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:20.288774  2561 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:20.336145  1536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51498
I20260709 12:57:20.336982  1536 raft_consensus.cc:606] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:57:20.331905  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 752) took 1193 ms. Trace:
W20260709 12:57:20.345538  2742 log.cc:927] Time spent T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.929s	user 0.003s	sys 0.010s
W20260709 12:57:20.346230  2614 consensus_meta.cc:287] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.004s
I20260709 12:57:20.346671  2614 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3.
I20260709 12:57:20.348285  2797 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:20.351127  2679 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:20.354605  2619 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:20.357280  2619 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:20.360214  2659 raft_consensus.cc:1068] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f: Unable to promote non-voter 1d6516ff61104bdda54bde95e92fe579: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }.
  Pending config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:57:20.361903  2607 consensus_meta.cc:287] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.000s
I20260709 12:57:20.364096  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:20.365715  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:20.366619  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:20.367487  2516 consensus_meta.cc:287] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.542s	user 0.006s	sys 0.005s
I20260709 12:57:20.368088  1691 raft_consensus.cc:1275] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:57:20.368759  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:20.369303  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:20.371188  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:20.369156  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:20.367249  1687 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:20.374778  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:20.375417  1535 raft_consensus.cc:1240] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:20.367167  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:20.367887  2516 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:20.377986  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 744) took 1241 ms. Trace:
I20260709 12:57:20.409451  1615 rpcz_store.cc:276] 0709 12:57:19.136229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:20.292539 (+1156310us) service_pool.cc:224] Handling call
0709 12:57:20.294575 (+  2036us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:20.295326 (+   751us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:20.295365 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:20.296348 (+   983us) log.cc:844] Serialized 26 byte log entry
0709 12:57:20.333753 (+ 37405us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:20.333791 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:20.333859 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:20.377776 (+ 43917us) raft_consensus.cc:1685] finished
0709 12:57:20.377795 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:20.377929 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":264,"raft.queue_time_us":2525,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":215,"thread_start_us":36748,"threads_started":1,"wal-append.queue_time_us":61325}
I20260709 12:57:20.340988  2598 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:20.412838  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:20.413635  1688 raft_consensus.cc:2368] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3.
I20260709 12:57:20.386368  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:20.415192  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:20.415838  1537 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:20.417840  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:20.418056  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:20.420887  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:20.422115  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:20.422820  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:20.420960  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:20.384884  1689 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:20.405048  1682 raft_consensus.cc:2393] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 3: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:20.423707  1540 raft_consensus.cc:2393] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 3: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:20.418354  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:20.340452  1612 rpcz_store.cc:276] 0709 12:57:19.138093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:19.228995 (+ 90902us) service_pool.cc:224] Handling call
0709 12:57:20.278427 (+1049432us) spinlock_profiling.cc:243] Waited 6.99 ms on lock 0x7b5800091e98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc8620170a0 00007fc862016984 00007fc85b5916d4 00007fc85b591662
0709 12:57:20.331819 (+ 53392us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16065920}
I20260709 12:57:20.430117  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:20.431514  1616 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:20.420249  1535 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:57:20.430088  1691 raft_consensus.cc:2368] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3.
I20260709 12:57:20.410316  2675 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:20.433022  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:20.432523  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:20.439118  1613 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:20.439296  1614 raft_consensus.cc:2393] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 3: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:20.436734  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:20.432049  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:20.437644  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:20.440930  1535 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:57:20.442833  2748 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:20.424726  2659 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:20.447973  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:20.448935  1537 raft_consensus.cc:2368] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3.
I20260709 12:57:20.449282  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:20.445580  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:20.433862  2648 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:20.451648  1654 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:20.452212  1535 raft_consensus.cc:3055] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:20.452319  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:20.450485  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:20.457497  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:20.459071  2659 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:20.459887  2813 log.cc:927] Time spent T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:57:20.460403  2534 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:20.461292  2659 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:20.461009  2534 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:20.461956  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:20.462577  1612 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:20.463516  2534 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:20.453099  2638 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:20.464949  2638 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:20.467087  2638 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:20.468024  2566 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:20.468453  2566 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:20.468852  2566 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:20.471416  2598 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:20.472132  2565 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:20.440200  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:20.473779  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:20.474206  1691 raft_consensus.cc:2393] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 2: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:20.474285  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:20.435523  2776 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:20.447273  1533 raft_consensus.cc:1240] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:57:20.456820  1535 raft_consensus.cc:740] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:20.477996  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:20.477008  1688 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:20.478852  1687 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:20.448307  2679 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:20.452857  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:20.488131  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:20.488790  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:20.489269  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:20.489571  1687 raft_consensus.cc:2410] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:20.490558  1691 raft_consensus.cc:2393] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 4: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:20.455796  2515 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:20.473304  2648 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:20.455538  2747 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:20.485191  1535 consensus_queue.cc:260] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:20.495705  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:20.491415  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:20.451308  1541 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:57:20.492821  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:20.495358  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 743) took 1443 ms. Trace:
I20260709 12:57:20.497948  1617 rpcz_store.cc:276] 0709 12:57:19.044405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:19.416654 (+372249us) service_pool.cc:224] Handling call
0709 12:57:19.417008 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:19.417265 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:19.417294 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:19.436987 (+ 19693us) log.cc:844] Serialized 26 byte log entry
0709 12:57:19.618198 (+181211us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:19.618231 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:19.618298 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:20.465716 (+847418us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b24002b94a8. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859dea9c4 00007fc859de8acb 00007fc859fa3dc9 00007fc859fa3a55 00007fc859fa2fb0 00007fc85cc19488 00007fc85cc19be8 00007fc85cbf1398 00007fc85cbec76a 00007fc85cbebbb6
0709 12:57:20.472541 (+  6825us) raft_consensus.cc:1685] finished
0709 12:57:20.472561 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:20.487968 (+ 15407us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7338752,"thread_start_us":110227,"threads_started":1,"wal-append.queue_time_us":223987}
I20260709 12:57:20.499631  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:20.500427  1617 raft_consensus.cc:2393] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 4: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:20.502310  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:20.496577  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:20.495952  1535 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:57:20.503968  1687 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 2: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:20.502367  1614 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:20.507247  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:20.509593  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:20.510913  1615 raft_consensus.cc:2368] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4.
I20260709 12:57:20.472637  2565 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:20.514395  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:20.516034  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:20.516203  2771 consensus_meta.cc:287] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.622s	user 0.009s	sys 0.003s
I20260709 12:57:20.453209  2748 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:20.517819  1687 raft_consensus.cc:2410] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:20.495244  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:20.482422  2605 consensus_queue.cc:1048] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:57:20.525565  1616 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:20.526292  1687 raft_consensus.cc:1240] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 4. Ops: []
I20260709 12:57:20.531929  1535 raft_consensus.cc:2410] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:57:20.533082  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:20.533737  1535 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:57:20.509428  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:20.538614  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:20.491187  2679 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:20.537405  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:20.488521  2776 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:20.497279  2515 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:20.542902  1687 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:20.547837  1535 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:20.530648  2561 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:20.548913  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:20.524606  2771 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:20.549783  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:20.551292  1540 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:20.556295  1535 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:20.552333  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:20.556897  1533 raft_consensus.cc:2393] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 3: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:20.567106  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:20.569247  1540 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:57:20.570134  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:20.565373  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 109574us
I20260709 12:57:20.542598  1682 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:20.577560  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:20.578735  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:20.563794  2516 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:20.574589  2648 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:20.579591  1535 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:20.587561  2648 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:20.566673  1541 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:20.592331  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 867) took 1520 ms. Trace:
I20260709 12:57:20.588089  2648 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:20.595451  2776 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:20.596668  2823 consensus_queue.cc:1048] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:57:20.606053  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:20.613408  1540 raft_consensus.cc:1275] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:57:20.601009  1539 rpcz_store.cc:276] 0709 12:57:19.071772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:19.242852 (+171080us) service_pool.cc:224] Handling call
0709 12:57:19.282671 (+ 39819us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:19.394626 (+111955us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:57:19.413261 (+ 18635us) log.cc:844] Serialized 14 byte log entry
0709 12:57:19.501020 (+ 87759us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:19.501084 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:19.501129 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:20.592094 (+1090965us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54003147d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:20.592140 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:20.592278 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29727,"prepare.queue_time_us":18799,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":6543,"raft.queue_time_us":13746,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":6277,"spinlock_wait_cycles":256983296,"thread_start_us":74002,"threads_started":1,"wal-append.queue_time_us":150564}
I20260709 12:57:20.623147  2749 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:20.624915  2699 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:20.626806  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:57:20.619261  2566 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:20.630460  1691 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:20.621104  2776 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:20.640880  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:20.649353  1539 raft_consensus.cc:1240] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:20.649513  2648 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:20.650883  2810 log.cc:927] Time spent T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.421s	user 0.003s	sys 0.000s
W20260709 12:57:20.642009  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 67593.1us
I20260709 12:57:20.633572  2749 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:20.654450  1654 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:20.642158  2826 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:20.642629  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:20.654979  2652 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:20.655479  1609 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 3.
I20260709 12:57:20.655591  2652 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:20.643707  2566 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:20.644073  2770 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:20.644717  2748 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:20.656813  2748 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:20.657073  2771 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:20.657323  2748 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:20.646238  1538 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:20.660899  2561 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:20.661476  2561 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:20.662148  2748 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:20.662889  2266 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:20.663625  2561 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:20.647204  1610 consensus_meta.cc:287] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.599s	user 0.006s	sys 0.002s
I20260709 12:57:20.664608  1610 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:20.665452  2550 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:20.667620  2550 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:20.668543  2515 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:20.670172  1614 raft_consensus.cc:2393] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 3: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:20.659201  1612 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:20.647871  2776 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:20.670521  2826 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:20.671902  1691 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:20.656212  2652 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:20.647362  1533 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:20.673902  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:20.674757  2299 raft_consensus.cc:2393] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 4: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:57:20.675094  2652 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:20.674541  2565 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:20.674540  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:20.672739  2776 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:20.659854  1654 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:20.676185  1533 raft_consensus.cc:2393] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 3: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:20.670343  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:20.677282  1539 raft_consensus.cc:2393] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 4: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:20.677526  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:20.678066  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:20.678385  1533 raft_consensus.cc:2368] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3.
I20260709 12:57:20.646988  1688 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:20.681556  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:20.687888  1654 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:20.693461  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:20.704932  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:20.706301  1655 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:20.708406  2749 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:20.675732  2618 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:20.678578  2826 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:20.712878  1654 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:20.714628  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:20.713749  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:20.713771  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:20.692970  2776 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:20.708940  2749 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:20.790366  1539 raft_consensus.cc:2393] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 4: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 12:57:20.736994  2820 log.cc:927] Time spent T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6: Append to log took a long time: real 0.252s	user 0.000s	sys 0.002s
I20260709 12:57:20.775327  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:20.731531  2826 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:20.788166  2666 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:20.793388  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:20.789909  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:20.794734  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:20.795437  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:20.796053  1614 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:20.795946  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:20.790241  1615 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:20.791441  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:20.781327  2827 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:20.814594  2648 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:20.822053  2827 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:20.824292  2827 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:20.824594  1539 raft_consensus.cc:2468] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:20.825564  1542 raft_consensus.cc:1275] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:20.826017  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:20.729974  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:20.729562  1609 raft_consensus.cc:1240] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:20.796867  2776 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:20.767979  2515 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:20.748095  2769 raft_consensus.cc:993] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8: : Instructing follower 1d6516ff61104bdda54bde95e92fe579 to start an election
W20260709 12:57:20.777292  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:20.828059  2699 raft_consensus.cc:2804] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:20.808512  2749 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:20.829288  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:20.830561  2679 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:20.831786  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 118985us
I20260709 12:57:20.835331  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:20.840555  1615 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:20.841570  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:20.842271  1616 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:20.836356  2776 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:20.846732  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 136871us
I20260709 12:57:20.839426  2565 raft_consensus.cc:1081] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Signalling peer 1d6516ff61104bdda54bde95e92fe579 to start an election
I20260709 12:57:20.838802  2515 raft_consensus.cc:697] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:20.838012  1533 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:20.850458  1505 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:20.840590  1654 leader_election.cc:400] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4.
I20260709 12:57:20.851306  1654 leader_election.cc:403] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:57:20.851468  1655 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:20.851977  1609 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:20.838305  1614 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:20.852617  1505 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:20.858505  2605 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:20.851814  2566 consensus_queue.cc:1059] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:57:20.859097  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:20.859757  2841 raft_consensus.cc:3055] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:20.860106  2841 raft_consensus.cc:740] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:20.860898  2841 consensus_queue.cc:260] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:20.861830  2841 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:20.858631  1505 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:20.864332  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:20.871445  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:20.874888  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:20.875777  1505 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:20.877439  1654 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:20.857033  1655 leader_election.cc:400] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3.
I20260709 12:57:20.877267  1690 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
W20260709 12:57:20.849550  2565 raft_consensus.cc:1084] unable to start election on peer 1d6516ff61104bdda54bde95e92fe579: Not found: unknown peer
I20260709 12:57:20.878494  2675 raft_consensus.cc:2764] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:57:20.878486  1690 pending_rounds.cc:85] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 1
I20260709 12:57:20.881105  1690 pending_rounds.cc:107] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:57:20.881335  1690 raft_consensus.cc:2889] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:20.877331  2605 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:20.878441  1655 leader_election.cc:403] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:57:20.878988  1615 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:20.854130  2770 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:20.882454  2515 consensus_queue.cc:237] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:20.856546  2827 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:20.888984  1654 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:20.877147  2756 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:57:20.884620  2798 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:20.902964  1654 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:20.904915  1583 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:20.906424  2782 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:20.907979  2750 consensus_queue.cc:1059] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:20.908931  2750 raft_consensus.cc:3055] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:20.909300  2750 raft_consensus.cc:740] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:20.910261  2750 consensus_queue.cc:260] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:20.911744  2750 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:20.913296  2826 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3.
I20260709 12:57:20.914088  2826 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:20.914549  2826 raft_consensus.cc:697] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:20.915495  2826 consensus_queue.cc:237] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:20.923296  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:20.927372  2798 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:20.930034  2798 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:20.901387  2835 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:20.931241  2835 raft_consensus.cc:697] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:20.932322  2835 consensus_queue.cc:237] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:20.878333  2598 consensus_queue.cc:1048] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:57:20.903573  2747 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:20.946646  2747 raft_consensus.cc:697] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:20.947664  2747 consensus_queue.cc:237] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:20.957008  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 78967us
I20260709 12:57:20.957901  1505 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:20.904585  1616 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
W20260709 12:57:20.958850  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:20.961103  1505 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:20.958937  2771 consensus_queue.cc:1048] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:57:20.965423  2648 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:20.963091  1505 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:20.961138  2598 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:20.970443  2675 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:20.970985  2771 raft_consensus.cc:2764] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:57:20.968981  2648 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:20.970054  2605 consensus_queue.cc:1059] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:57:20.995644  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:20.960572  2776 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:20.999126  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 96244.9us
I20260709 12:57:21.005458  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:21.008145  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:21.008821  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:21.009670  1613 raft_consensus.cc:2368] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3.
I20260709 12:57:21.012038  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:21.013127  1615 raft_consensus.cc:2393] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 3: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:21.016929  1508 leader_election.cc:400] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3.
I20260709 12:57:20.971937  2565 consensus_queue.cc:1059] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:57:21.017743  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:20.990823  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:21.021258  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:21.022114  1616 raft_consensus.cc:2368] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3.
I20260709 12:57:21.018920  1615 raft_consensus.cc:2393] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 3: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 12:57:21.019819  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 162945us
I20260709 12:57:21.020149  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:21.025266  1617 raft_consensus.cc:2393] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 3: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:21.027614  1687 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 3: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:20.986739  2749 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:21.030802  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:21.031291  1655 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:21.035868  1654 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:21.018069  2515 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:21.017884  2566 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:21.061658  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 89200.3us
I20260709 12:57:21.032338  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:21.057603  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:21.060704  2598 raft_consensus.cc:697] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:21.054165  2566 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:21.070286  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:21.084635  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 53459.3us
I20260709 12:57:21.082454  1505 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:21.054729  2515 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:21.074610  2771 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:21.086407  1655 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:21.061905  2675 raft_consensus.cc:697] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:21.077229  1609 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:21.079823  2610 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:21.092402  1655 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:21.083657  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:21.083150  2679 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:21.082814  1612 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:21.098590  1655 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:21.097986  2834 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:21.108008  1505 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:21.109124  1505 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:21.092043  1682 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:21.110872  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:21.104153  2849 raft_consensus.cc:3055] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:21.111737  2849 raft_consensus.cc:740] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:21.112676  2849 consensus_queue.cc:260] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:21.113930  2849 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:21.117946  2846 log.cc:927] Time spent T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260709 12:57:21.119524  2844 log.cc:927] Time spent T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:57:21.121992  1609 raft_consensus.cc:1275] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:21.122918  2756 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4.
I20260709 12:57:21.124109  2675 consensus_queue.cc:237] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:21.124922  2515 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:21.127053  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:21.127249  1655 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:21.127592  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:21.128394  1655 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:21.128762  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:21.129341  1688 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:21.129611  1655 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:21.129901  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:21.130149  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:21.130755  1688 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:21.130867  1610 raft_consensus.cc:2410] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:21.131587  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:21.131868  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:21.133051  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:21.133172  2769 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:21.133625  2769 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:21.133980  2769 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:21.137324  2749 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:21.137984  2749 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:21.138255  1682 raft_consensus.cc:2393] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 3: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:21.094326  2771 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:21.139822  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:21.140518  2771 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:21.129928  2515 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:21.141703  2515 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:21.142123  2515 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:21.142459  2515 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:21.145702  2679 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:21.134065  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:21.130848  1655 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:21.149957  1655 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:21.150897  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:21.079242  2848 consensus_queue.cc:1059] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:57:21.127846  1615 raft_consensus.cc:2393] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 3: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:21.153533  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:21.147095  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:21.094604  2827 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:21.155794  2610 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:21.159600  1581 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:21.161221  2658 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:21.239440  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 79917.4us
I20260709 12:57:21.126850  2776 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:21.230664  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:21.138372  2749 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:21.248716  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:21.249486  1533 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:57:21.250245  2565 raft_consensus.cc:3055] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:21.250743  2565 raft_consensus.cc:740] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:21.251662  2565 consensus_queue.cc:260] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:21.106346  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:21.263185  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:21.263466  2565 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:21.263890  1684 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
W20260709 12:57:21.265283  1488 auto_rebalancer.cc:893] Removing replace marker failed: Replica dbe6a89d0e1c4137b3a1b17bf4b520d8 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 12:57:21.266019  1488 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 07ac6d2e7442458585e7eca31089d547 already in progress
I20260709 12:57:21.265369  2756 raft_consensus.cc:3055] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:57:21.266305  1488 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 07ac6d2e7442458585e7eca31089d547 already in progress
I20260709 12:57:21.232825  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:21.266595  2756 raft_consensus.cc:740] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:21.267015  1535 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:21.267520  2756 consensus_queue.cc:260] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:21.268748  2756 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:21.233667  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 83805.3us
I20260709 12:57:21.234452  2679 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:21.297374  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:21.300287  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:57:21.307029  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 223441us
W20260709 12:57:21.308825  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:21.310721  1508 leader_election.cc:400] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3.
I20260709 12:57:21.237341  1540 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:21.240245  1581 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:21.311935  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 71787us
I20260709 12:57:21.312080  1535 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:21.145612  1505 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:21.312922  1508 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:57:21.230952  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 195200us
I20260709 12:57:21.254433  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:21.314258  1654 leader_election.cc:400] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3.
I20260709 12:57:21.314554  1654 leader_election.cc:403] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:57:21.314756  1541 raft_consensus.cc:2393] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 3: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:21.254731  2699 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:21.315567  2699 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:21.256891  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:21.258193  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:21.311048  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:21.234884  2834 raft_consensus.cc:697] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:21.312961  1581 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:21.313373  2750 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:21.318571  1581 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:21.318423  2834 consensus_queue.cc:237] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:21.319306  2750 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:21.319690  2750 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:21.320062  2750 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:21.320516  2798 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:21.244810  1687 raft_consensus.cc:1240] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:21.316877  1542 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:21.320158  1581 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:21.323341  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:21.245577  2841 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:21.326438  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 55245.1us
W20260709 12:57:21.299639  2807 log.cc:927] Time spent T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:57:21.141752  2648 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:21.238735  2852 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:21.241092  2771 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.090s
I20260709 12:57:21.327847  1581 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:21.296629  2749 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:21.298521  2784 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:21.343374  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:21.329834  1654 leader_election.cc:400] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3.
I20260709 12:57:21.325863  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:21.322629  2854 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:57:21.368621  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 223088us
I20260709 12:57:21.371483  2666 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:21.373896  2675 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:21.374213  2666 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:21.364902  1654 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:21.232750  2598 consensus_queue.cc:237] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:21.375501  1655 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:21.331210  2821 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:21.340392  2827 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3.
I20260709 12:57:21.291116  2658 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:21.385953  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:21.387359  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:21.390349  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:21.391103  1536 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:57:21.380635  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:21.392372  1537 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:21.364843  1689 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:21.347868  2768 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:21.329830  2605 consensus_queue.cc:1059] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:57:21.403024  1540 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:21.361725  2784 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:21.406100  1655 leader_election.cc:400] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3.
I20260709 12:57:21.407015  1655 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:21.408133  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:21.408993  1615 raft_consensus.cc:2368] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3.
I20260709 12:57:21.410753  1655 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:21.340862  2756 consensus_queue.cc:1059] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:57:21.413882  1505 leader_election.cc:400] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3.
I20260709 12:57:21.414237  1505 leader_election.cc:403] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:57:21.342162  2841 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:21.418531  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:21.419262  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:21.447414  1655 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:21.403301  1654 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:21.447559  1537 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
W20260709 12:57:21.448124  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 63277us
I20260709 12:57:21.450472  1581 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:21.454420  1655 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:21.412411  2784 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:21.452064  2823 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:21.417740  2855 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:57:21.465479  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 62243.4us
I20260709 12:57:21.418249  2856 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:21.445683  2854 raft_consensus.cc:697] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:21.446763  2610 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:21.445549  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:21.466938  1655 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:57:21.416728  2852 raft_consensus.cc:697] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 12:57:21.460366  2820 log.cc:927] Time spent T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:57:21.411015  2776 consensus_queue.cc:1059] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:57:21.405014  2768 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:21.459652  2566 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:21.417578  2618 consensus_queue.cc:1048] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:57:21.476531  2856 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:21.448822  2782 consensus_queue.cc:1048] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
W20260709 12:57:21.487680  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 174861us
I20260709 12:57:21.461531  2865 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:21.463847  2756 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:21.477720  2835 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:21.475255  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:21.506047  1508 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:21.529928  1508 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:21.519061  1535 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:21.520017  1536 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:21.486377  2527 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:21.489435  2848 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:21.513706  1655 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:21.505558  1612 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:57:21.537740  2850 log.cc:927] Time spent T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 12:57:21.532531  2527 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 12:57:21.541175  2860 log.cc:927] Time spent T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:57:21.515849  2566 raft_consensus.cc:2804] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:21.512782  2856 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:21.569729  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 119337us
W20260709 12:57:21.579778  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 123569us
I20260709 12:57:21.573875  1508 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:21.534467  2606 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3.
I20260709 12:57:21.534682  2607 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:21.517859  2776 consensus_queue.cc:1048] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 12:57:21.570547  2527 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:21.607093  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 193323us
W20260709 12:57:21.620882  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 47086us
W20260709 12:57:21.638703  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:21.580788  2679 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:21.669479  2817 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:21.578155  2566 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:21.673215  2566 raft_consensus.cc:3060] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:21.672200  1690 raft_consensus.cc:1275] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:21.684209  2852 consensus_queue.cc:237] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:21.653973  1508 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:21.655936  1583 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:21.656412  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:57:21.656805  2859 log.cc:927] Time spent T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:57:21.702379  1613 raft_consensus.cc:1240] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3. Ops: []
W20260709 12:57:21.658007  2861 log.cc:927] Time spent T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.209s	user 0.000s	sys 0.000s
I20260709 12:57:21.658941  2750 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:21.659619  2870 log.cc:927] Time spent T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:57:21.604939  2872 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:21.690085  1583 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:21.603861  2614 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:21.657377  2862 log.cc:927] Time spent T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 12:57:21.680161  2699 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:57:21.658875  2868 log.cc:927] Time spent T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:57:21.706820  2607 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:21.691332  1508 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:21.715492  1583 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:21.715883  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 241595us
I20260709 12:57:21.654452  2648 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:21.690608  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:21.700312  2865 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:57:21.727473  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 213874us
I20260709 12:57:21.705016  1612 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:21.752244  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:21.743577  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 52353.2us
I20260709 12:57:21.694100  2851 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:21.713426  2658 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:21.752262  1655 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:21.769924  1655 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:21.724437  2872 raft_consensus.cc:697] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:21.727917  2675 raft_consensus.cc:697] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:21.740098  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:21.741246  2841 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:21.794463  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:21.724180  2614 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:21.801460  2675 consensus_queue.cc:237] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:21.786768  2835 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:57:21.803195  2565 consensus_meta.cc:287] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.539s	user 0.004s	sys 0.004s
I20260709 12:57:21.803695  2879 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:21.798594  1533 raft_consensus.cc:2393] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 3: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:21.689344  2854 consensus_queue.cc:237] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:21.795270  1537 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:21.784680  2648 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:21.766376  2871 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:21.775918  2658 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 12:57:21.803990  2869 log.cc:927] Time spent T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:57:21.808384  2864 log.cc:927] Time spent T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 12:57:21.807179  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:21.791216  1608 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:21.812579  2879 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:21.810356  2768 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:21.826537  1655 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:21.817523  2515 consensus_meta.cc:287] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.675s	user 0.010s	sys 0.000s
I20260709 12:57:21.826337  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:21.820302  2648 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:21.828648  2584 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:57:21.845783  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 130380us
I20260709 12:57:21.822854  2888 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:21.830518  2879 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:21.839205  2835 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:21.827518  2658 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:21.851096  2769 consensus_meta.cc:287] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.717s	user 0.013s	sys 0.000s
I20260709 12:57:21.844573  2648 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:21.849305  2584 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:21.868841  1583 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:21.840214  2515 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:21.848570  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:21.840363  2749 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:21.861573  2835 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:21.862586  2750 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:21.870878  2584 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:21.897110  2784 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:21.875392  2835 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:21.879587  2893 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:21.901149  2515 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:21.901527  2893 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:21.878011  1533 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:21.887425  2679 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:21.905599  1683 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:21.901990  2893 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:21.912550  2610 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:21.913688  2614 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:21.856865  2888 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:21.846100  2872 consensus_queue.cc:237] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:21.903635  1533 raft_consensus.cc:1275] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:21.868019  2769 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:21.879420  2699 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:21.895164  2891 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:21.917002  1533 raft_consensus.cc:1275] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:21.917438  2891 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:21.919307  2769 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:21.919652  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:21.920693  1534 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:21.912267  2747 raft_consensus.cc:3055] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:21.878754  2542 consensus_queue.cc:1059] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:57:21.890942  2566 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:21.922264  2747 raft_consensus.cc:740] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:21.923230  2747 consensus_queue.cc:260] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:21.913919  2848 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:21.924772  2848 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:21.924103  2566 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:21.927289  1541 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:21.928844  1541 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 12:57:21.921924  2749 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:21.926136  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:21.893256  1691 raft_consensus.cc:2393] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 3: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:21.933713  1540 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:21.924230  2747 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:22.021260  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 150068us
I20260709 12:57:21.929190  1541 pending_rounds.cc:85] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 3
I20260709 12:57:21.899470  2784 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:22.035723  2614 consensus_queue.cc:1048] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:22.029102  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:57:22.031308  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:22.023126  2891 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:22.019269  2756 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:22.048676  1583 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:22.023386  1611 raft_consensus.cc:1240] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:22.027310  1541 pending_rounds.cc:107] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.4
I20260709 12:57:22.062683  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:22.067289  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:22.067790  1687 raft_consensus.cc:2410] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:22.063412  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:22.068109  1690 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 3: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:22.023540  2566 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:21.961270  2648 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:22.046044  2747 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:22.055588  2749 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:22.073282  1541 raft_consensus.cc:2917] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted by new leader
I20260709 12:57:22.024670  2856 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:22.081638  2302 raft_consensus.cc:2393] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 4: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:57:22.082595  2658 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:22.084031  1533 raft_consensus.cc:1240] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:22.066934  2895 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:22.080811  2566 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:22.083560  2747 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:22.105052  2891 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:22.100313  1541 raft_consensus.cc:2889] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:22.089197  2749 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:22.130942  2749 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:22.131996  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:22.112241  1682 raft_consensus.cc:1240] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: []
W20260709 12:57:22.181713  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:22.115444  2895 raft_consensus.cc:697] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:57:22.191684  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:22.197156  2856 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:22.187103  2896 log.cc:927] Time spent T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:57:22.199090  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:22.198938  2848 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:22.188676  1612 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:22.183857  2888 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:22.201917  2584 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:22.202603  2527 consensus_meta.cc:287] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.001s
I20260709 12:57:22.203094  2527 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:22.206037  2849 raft_consensus.cc:3055] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:22.206545  2849 raft_consensus.cc:740] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:22.207531  2899 consensus_queue.cc:1059] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:22.208562  2899 raft_consensus.cc:3055] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:22.208920  2899 raft_consensus.cc:740] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:22.209789  2899 consensus_queue.cc:260] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:22.210762  2899 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:22.184052  2902 log.cc:927] Time spent T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:57:22.213558  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:22.214326  1689 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:22.217386  2881 raft_consensus.cc:3055] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:22.217877  2881 raft_consensus.cc:740] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:22.218820  2881 consensus_queue.cc:260] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:22.220652  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:22.221530  1609 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 3: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:22.200227  2895 consensus_queue.cc:237] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:22.224790  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 910) took 1122 ms. Trace:
I20260709 12:57:22.207331  2849 consensus_queue.cc:260] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:22.208746  1615 raft_consensus.cc:1240] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:22.225193  1688 rpcz_store.cc:276] 0709 12:57:21.102506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:21.131342 (+ 28836us) service_pool.cc:224] Handling call
0709 12:57:22.224598 (+1093256us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b54003b6ad4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:22.224732 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":754167168}
I20260709 12:57:22.226876  2527 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:22.227581  2881 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:22.221381  1583 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:22.233518  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:22.234174  1538 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:22.235409  1538 raft_consensus.cc:1275] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:22.236232  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:22.217252  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:22.240928  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:22.153658  2891 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:22.237568  1687 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
W20260709 12:57:22.220971  2897 log.cc:927] Time spent T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:57:22.293246  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:57:22.381632  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:22.369395  1581 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:22.292989  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:22.386029  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:22.256742  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:22.292608  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:22.393838  1537 raft_consensus.cc:2393] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 3: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:22.267347  1655 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:22.257653  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:22.398705  1583 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:22.401996  1581 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:22.242030  2907 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:57:22.380615  2550 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:22.385736  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:22.403793  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:22.404340  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 137097us
W20260709 12:57:22.402235  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 107698us
I20260709 12:57:22.410722  1581 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:22.257222  2901 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:22.201960  2879 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:22.255357  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:22.413339  2901 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:22.413537  2855 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:22.413934  2855 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:22.254916  2849 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:22.415243  1655 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:57:22.256023  2903 log.cc:927] Time spent T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:57:22.258425  1689 raft_consensus.cc:2955] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:22.254673  2771 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:22.385385  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:22.384814  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:22.257375  2747 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:22.424441  1581 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:22.398097  1608 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:22.394845  2858 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:22.434888  2771 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:22.440542  2858 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:22.441054  2879 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:22.435019  2749 consensus_queue.cc:1048] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:57:22.442317  2771 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:22.338229  1534 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:22.413774  1541 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:22.432082  2856 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:57:22.444825  2909 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:22.446110  2566 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:22.413782  2901 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:22.333701  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:22.414749  2798 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:22.414310  2855 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:22.414644  2644 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:22.437575  2747 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:57:22.438864  2893 consensus_meta.cc:287] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.530s	user 0.004s	sys 0.005s
I20260709 12:57:22.333065  2835 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:22.400322  2784 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:22.442795  2858 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:22.449261  1539 raft_consensus.cc:2468] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:22.453616  1616 raft_consensus.cc:1240] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:22.430845  1533 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:22.433557  2679 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:22.450865  1610 raft_consensus.cc:2368] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3.
I20260709 12:57:22.458863  2644 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:22.430591  2648 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:22.414880  2782 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
W20260709 12:57:22.480888  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:22.462021  1685 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:22.454926  2879 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:22.414361  2550 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:22.459089  2848 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:22.476595  1682 raft_consensus.cc:2393] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 2: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:22.507513  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:22.522830  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:22.523689  1539 raft_consensus.cc:2368] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for earlier term 3. Current term is 4.
I20260709 12:57:22.473452  2679 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:22.484046  2644 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:22.462021  2893 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:22.496405  2879 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 12:57:22.549981  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 125620us
I20260709 12:57:22.556646  1581 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:22.529731  2679 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:22.580708  1613 raft_consensus.cc:1240] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:22.556417  2879 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:22.604820  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:22.556025  2584 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:22.615341  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 58777.8us
I20260709 12:57:22.616745  1581 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:22.620585  2267 leader_election.cc:400] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 3 pre-election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for earlier term 3. Current term is 4.
I20260709 12:57:22.620980  2267 leader_election.cc:403] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:57:22.621464  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 71125.2us
I20260709 12:57:22.622103  2888 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:57:22.625571  2550 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:22.255188  2527 raft_consensus.cc:2955] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:22.625640  1541 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:22.635351  1542 raft_consensus.cc:1240] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:22.637234  1610 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:22.643887  2888 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for earlier term 3. Current term is 4.
I20260709 12:57:22.647734  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:22.663161  1612 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:22.650590  2302 raft_consensus.cc:1240] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:22.646667  2584 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:22.609253  2817 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:57:22.649930  2906 log.cc:927] Time spent T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 12:57:22.654973  2606 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:57:22.657768  2914 log.cc:927] Time spent T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 12:57:22.665977  2584 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:22.661414  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 44735.7us
I20260709 12:57:22.648746  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:22.670149  2584 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:22.670487  1616 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:22.668746  2606 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:22.646085  2835 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:22.658679  2893 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:22.673924  2606 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:22.678576  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 779) took 1271 ms. Trace:
I20260709 12:57:22.668641  2644 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:22.679670  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:22.675546  1581 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:22.666478  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 240678us
I20260709 12:57:22.678669  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:22.687912  1655 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:22.691403  1655 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:22.679296  1617 rpcz_store.cc:276] 0709 12:57:21.406857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:21.426353 (+ 19496us) service_pool.cc:224] Handling call
0709 12:57:21.426763 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:21.454237 (+ 27474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:21.454266 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:22.128631 (+674365us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b480024e7d8. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc861f7aaa1 00007fc861f71b37 00007fc861f719ca 00007fc86206926f 00007fc862068f37 00007fc86207d55c 00007fc86207d508 00007fc86207d488 00007fc86207d443 00007fc86207c6ec 00007fc860fa6a96
0709 12:57:22.432611 (+303980us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b2c00125b38. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85b94aa11 00007fc85b95a372 00007fc85d08ca01 00007fc85d05143a 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2
0709 12:57:22.448298 (+ 15687us) log.cc:844] Serialized 26 byte log entry
0709 12:57:22.605545 (+157247us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:22.605580 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:22.605702 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:22.678304 (+ 72602us) raft_consensus.cc:1685] finished
0709 12:57:22.678330 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:22.678486 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8674,"raft.queue_time_us":10884,"raft.run_cpu_time_us":3880,"raft.run_wall_time_us":666064,"spinlock_wait_cycles":8341120,"thread_start_us":144965,"threads_started":1,"wal-append.queue_time_us":193147}
I20260709 12:57:22.687937  1540 raft_consensus.cc:2468] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 4.
I20260709 12:57:22.686084  1687 raft_consensus.cc:2468] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 4.
I20260709 12:57:22.696452  1655 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:57:22.695335  2908 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:22.697666  2886 raft_consensus.cc:2804] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:22.697170  2835 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:22.698920  2835 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:22.699298  2835 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:22.700021  2515 consensus_queue.cc:1059] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:22.700744  2826 raft_consensus.cc:3055] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:22.701138  2826 raft_consensus.cc:740] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:22.702184  2845 raft_consensus.cc:3055] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:22.697180  2648 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:22.698233  2566 consensus_queue.cc:1059] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:22.698208  2886 raft_consensus.cc:697] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:22.665164  2881 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:22.707062  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:22.688225  2891 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:22.702570  2845 raft_consensus.cc:740] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:22.710812  2779 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:22.714701  2606 consensus_queue.cc:1059] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:57:22.719233  2269 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 12:57:22.720698  2302 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 1 LEARNER]: Advancing to term 3
I20260709 12:57:22.721556  2849 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:22.722533  2644 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:22.723500  2918 consensus_queue.cc:1059] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:22.723023  1505 leader_election.cc:400] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3.
I20260709 12:57:22.723111  2301 raft_consensus.cc:2955] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:22.724586  2909 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:22.725355  1581 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:22.725880  2542 consensus_queue.cc:1048] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:22.773432  2550 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:22.773591  2918 raft_consensus.cc:3055] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:22.773962  2918 raft_consensus.cc:740] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:22.774729  2909 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:22.776983  2909 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:22.726755  2881 raft_consensus.cc:697] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:22.734005  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 908) took 1647 ms. Trace:
W20260709 12:57:22.735461  2899 consensus_meta.cc:287] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.524s	user 0.008s	sys 0.012s
I20260709 12:57:22.736141  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:22.741077  1583 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:22.742841  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:22.782573  1687 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:22.743625  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:22.743692  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:22.745574  2679 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:22.707821  2911 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:22.697420  2848 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:57:22.734092  2855 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:22.751241  1440 catalog_manager.cc:5697] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 1 to 2, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:57:22.760149  2826 consensus_queue.cc:260] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:22.761466  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:57:22.762890  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 1.00828e+06us
I20260709 12:57:22.788208  1684 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:22.763649  1691 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 915) took 1522 ms (client timeout 1787 ms). Trace:
W20260709 12:57:22.793742  1691 rpcz_store.cc:269] 0709 12:57:21.240781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:21.299978 (+ 59197us) service_pool.cc:224] Handling call
0709 12:57:22.763447 (+1463469us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b5400337cd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:22.763592 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1331679488}
I20260709 12:57:22.716146  2798 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:22.770673  1505 leader_election.cc:403] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 12:57:22.772460  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 47200.8us
I20260709 12:57:22.784834  1538 raft_consensus.cc:2393] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 4: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:22.787971  2911 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:22.795746  1581 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:22.788539  2644 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:57:22.791936  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 92852us
I20260709 12:57:22.798470  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:22.799443  1689 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:22.705714  2865 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:22.767295  2779 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:22.796425  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 73554.9us
W20260709 12:57:22.772045  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 61759us
I20260709 12:57:22.796963  1508 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:22.778601  2891 raft_consensus.cc:2804] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:22.796830  2917 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:22.799320  1682 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:22.770547  2849 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:22.806617  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:22.811491  1505 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:22.810411  2865 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:22.798448  2770 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3.
I20260709 12:57:22.815730  1689 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:22.779716  2886 consensus_queue.cc:237] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:22.826232  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:22.829063  1505 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:22.800815  2550 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:22.829246  1617 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 2.
I20260709 12:57:22.811919  1687 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:22.795900  2771 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:57:22.810510  2848 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:22.824635  2606 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:22.833590  2849 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:22.774758  2918 consensus_queue.cc:260] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:22.835279  2899 consensus_queue.cc:1059] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:22.810369  2826 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:22.841849  2854 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:22.836779  2881 consensus_queue.cc:237] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:22.844074  2858 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:22.781759  1683 rpcz_store.cc:276] 0709 12:57:21.087063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:21.262493 (+175430us) service_pool.cc:224] Handling call
0709 12:57:21.262774 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:21.906044 (+643270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:22.733701 (+827657us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b540041da54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:22.733929 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1476300032}
I20260709 12:57:22.846915  2865 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:22.799994  2798 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:22.822889  2817 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:22.854799  1583 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:22.823204  2891 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:22.824985  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:22.822034  2769 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:57:22.859166  2550 raft_consensus.cc:697] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:57:22.861121  2915 log.cc:927] Time spent T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 12:57:22.855799  2606 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:22.859681  2854 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:22.861690  2908 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:22.857015  2901 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:22.862360  2302 raft_consensus.cc:1275] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 3 LEARNER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:22.811565  2835 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:22.872970  2911 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:22.918025  2835 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:22.918395  2550 consensus_queue.cc:237] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:22.872676  1440 catalog_manager.cc:5697] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:22.823382  2584 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:22.921502  2756 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:57:22.873627  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 160140us
I20260709 12:57:22.862314  2679 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:22.898849  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 44140.2us
W20260709 12:57:22.899106  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 102235us
W20260709 12:57:22.899356  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 70378.8us
I20260709 12:57:22.874596  2858 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:22.897868  2817 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:22.807396  2845 consensus_queue.cc:260] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:22.957118  2845 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:22.960012  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 489) took 1182 ms. Trace:
I20260709 12:57:22.960458  1534 rpcz_store.cc:276] 0709 12:57:21.777571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:21.785169 (+  7598us) service_pool.cc:224] Handling call
0709 12:57:22.959827 (+1174658us) spinlock_profiling.cc:243] Waited 92.1 ms on lock 0x7b5400247054. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:22.959951 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211838720}
I20260709 12:57:22.910126  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:22.965353  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:22.900030  2891 raft_consensus.cc:3060] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:22.898672  2918 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:22.858911  2848 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:22.912364  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:22.914011  1610 raft_consensus.cc:1275] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:22.914002  1616 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:22.905483  2879 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:22.828266  2917 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:22.922786  1617 raft_consensus.cc:1275] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:22.897670  1684 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:22.903113  2883 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:22.905313  2854 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:22.905683  2606 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:22.925343  1612 raft_consensus.cc:2368] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for earlier term 3. Current term is 4.
I20260709 12:57:22.927388  2798 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:22.933837  2901 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:22.935098  1611 raft_consensus.cc:2393] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 4: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:22.925401  1583 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:22.936743  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 782) took 1281 ms. Trace:
I20260709 12:57:22.937668  2584 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:22.938220  2916 log.cc:927] Time spent T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 12:57:22.939070  2855 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:22.939391  2779 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:22.943904  1682 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:22.944672  1436 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54590 (request call id 139) took 6193 ms. Trace:
I20260709 12:57:22.945465  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 490) took 1475 ms. Trace:
I20260709 12:57:23.010474  2901 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:57:22.966018  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:22.965883  1655 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:22.968160  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:57:22.988281  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:22.989573  1508 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:57:23.022388  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 56622.9us
I20260709 12:57:23.024822  1654 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:23.025672  1508 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:23.026839  1508 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:57:22.990715  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:22.999547  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:23.002116  2883 raft_consensus.cc:697] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:22.991401  2924 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:23.003855  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:57:23.005596  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 80255.3us
I20260709 12:57:22.991645  2679 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:22.952603  2858 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:23.020362  1615 rpcz_store.cc:276] 0709 12:57:21.470325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:21.471976 (+  1651us) service_pool.cc:224] Handling call
0709 12:57:22.129460 (+657484us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b5800091e98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc86202afc0 00007fc862015929 00007fc8620153d2 00007fc85b58cbd4
0709 12:57:22.129710 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:22.225804 (+ 96094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:22.945234 (+719430us) spinlock_profiling.cc:243] Waited 78.8 ms on lock 0x7b54002a67d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:22.945405 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188656640}
I20260709 12:57:23.008029  1608 rpcz_store.cc:276] 0709 12:57:21.654938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:21.852084 (+197146us) service_pool.cc:224] Handling call
0709 12:57:21.874855 (+ 22771us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:22.440127 (+565272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:22.936514 (+496387us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b540032a854. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:22.936690 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1097810688}
I20260709 12:57:23.047260  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:23.047993  1608 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:23.045596  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:23.049068  2679 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.050244  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:23.051087  2679 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:23.052244  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:23.053364  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:23.053668  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:23.055876  2855 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:23.056560  2855 raft_consensus.cc:697] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:23.056702  1610 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:23.057785  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:23.057564  2855 consensus_queue.cc:237] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.058414  1610 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:57:23.059324  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:23.029645  2644 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:23.020234  2865 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:23.061983  2909 raft_consensus.cc:3055] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:23.062453  2865 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.061300  1615 raft_consensus.cc:1275] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:23.064534  2865 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:23.065006  1615 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:23.066884  1612 raft_consensus.cc:1240] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:57:23.068184  1612 raft_consensus.cc:1275] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:23.068905  2675 raft_consensus.cc:3055] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:23.069362  2675 raft_consensus.cc:740] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:23.070236  2675 consensus_queue.cc:260] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:23.071497  2675 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:23.075047  2925 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:23.076941  1610 raft_consensus.cc:1240] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:23.061928  2644 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.055943  2924 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.081194  2883 consensus_queue.cc:237] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:23.082921  2924 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:23.030077  2638 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:23.083513  2854 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:23.080366  2644 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:23.084553  2638 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:23.093443  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 68700.9us
I20260709 12:57:23.094980  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:23.095599  1537 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:23.048745  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:23.095922  1583 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:23.096426  1538 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:23.097541  1654 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:23.075769  2606 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:23.099910  1616 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:23.102205  1654 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:23.104231  1583 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:57:23.035928  2922 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
W20260709 12:57:23.107698  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 76160.3us
W20260709 12:57:23.036976  2923 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:57:23.111567  2865 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:23.088517  2901 raft_consensus.cc:697] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:23.106631  2527 consensus_queue.cc:1059] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:57:23.114880  2865 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.115775  2901 consensus_queue.cc:237] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.117496  2865 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:23.109066  2886 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:23.080029  2817 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.121500  2817 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:23.121898  2266 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:23.122721  1614 raft_consensus.cc:2393] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 4: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:23.123428  2266 leader_election.cc:400] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 3 pre-election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for earlier term 3. Current term is 4.
I20260709 12:57:23.124366  2882 consensus_queue.cc:1048] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:23.125295  2886 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:23.125808  2886 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.126946  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:23.128135  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:23.128283  2756 consensus_queue.cc:1048] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:23.128794  1536 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:23.129593  2925 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:23.128159  2854 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:23.136683  2888 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:23.136952  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:23.137297  2888 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:23.137666  1540 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:23.114557  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:23.062501  2909 raft_consensus.cc:740] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:23.097350  2610 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:23.137739  2888 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:23.194845  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:23.195894  1541 raft_consensus.cc:2393] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 3: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:23.080137  2858 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.204622  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:23.154731  2301 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 12:57:23.156100  2908 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:23.094767  2747 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:23.101001  2872 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:23.157073  2899 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:23.158118  2527 raft_consensus.cc:3055] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:23.161038  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:23.162380  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:23.162781  2666 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:23.163492  1581 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:23.164059  2817 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:23.101239  2679 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:23.103297  2826 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:23.156628  2542 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:23.107208  2584 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:23.138232  2892 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:23.202864  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:23.155417  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 51267.9us
I20260709 12:57:23.154289  1538 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
W20260709 12:57:23.215188  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 188404us
I20260709 12:57:23.216274  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:23.112392  2648 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 12:57:23.210421  2301 pending_rounds.cc:85] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579: Aborting all ops after (but not including) 3
I20260709 12:57:23.215353  1654 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:57:23.227188  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 63775.5us
I20260709 12:57:23.195091  2610 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.233721  1508 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:23.241672  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:23.215855  2527 raft_consensus.cc:740] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:23.246917  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:23.243877  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:23.248334  1691 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:23.251245  1686 raft_consensus.cc:2393] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 4: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:23.249148  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:23.230232  1534 raft_consensus.cc:1240] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 12:57:23.224282  2899 raft_consensus.cc:697] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:23.260756  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:23.265926  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:23.225965  2666 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.260772  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:23.263864  1691 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:23.243546  2301 pending_rounds.cc:107] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.4
I20260709 12:57:23.280953  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:23.217764  2908 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.238708  2679 raft_consensus.cc:697] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:23.236824  2879 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:23.218703  2747 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:23.261394  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:23.273548  1613 raft_consensus.cc:1240] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:23.276063  2888 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:23.232803  2550 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.282615  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:23.248405  2893 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:23.301935  2606 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:23.284809  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:23.244640  2584 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.302453  2893 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.255715  2771 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:23.287739  1684 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:23.280890  2301 raft_consensus.cc:2917] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted by new leader
I20260709 12:57:23.303978  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:23.020251  1436 rpcz_store.cc:276] 0709 12:57:16.751638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:16.753219 (+  1581us) service_pool.cc:224] Handling call
0709 12:57:22.944584 (+6191365us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:19.945181 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:20.073305 (+128124us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:20.088279 (+ 14974us) write_op.cc:435] Acquired schema lock
0709 12:57:20.095307 (+  7028us) tablet.cc:662] Decoding operations
0709 12:57:20.247262 (+151955us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:20.247371 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:20.247407 (+    36us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:57:20.248148 (+   741us) tablet.cc:701] Row locks acquired
0709 12:57:20.248198 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:57:20.248385 (+   187us) write_op.cc:270] Start()
0709 12:57:20.248575 (+   190us) write_op.cc:276] Timestamp: P: 1783601840248329 usec, L: 0
0709 12:57:20.248656 (+    81us) op_driver.cc:348] REPLICATION: starting
0709 12:57:20.275104 (+ 26448us) log.cc:844] Serialized 3311 byte log entry
0709 12:57:20.685674 (+410570us) spinlock_profiling.cc:243] Waited 7.37 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:57:20.907290 (+221616us) op_driver.cc:464] REPLICATION: finished
0709 12:57:20.976537 (+ 69247us) write_op.cc:301] APPLY: starting
0709 12:57:20.976692 (+   155us) tablet.cc:1367] starting BulkCheckPresence
0709 12:57:20.977098 (+   406us) tablet.cc:1370] finished BulkCheckPresence
0709 12:57:20.977156 (+    58us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:57:21.240975 (+263819us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:57:21.367344 (+126369us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:57:21.367404 (+    60us) write_op.cc:312] APPLY: finished
0709 12:57:21.371801 (+  4397us) log.cc:844] Serialized 64 byte log entry
0709 12:57:21.372001 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:21.372115 (+   114us) write_op.cc:454] Released schema lock
0709 12:57:21.372175 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:57:21.372636 (+   461us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:21.372666 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":556478,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":68794,"apply.run_cpu_time_us":6521,"apply.run_wall_time_us":396139,"num_ops":8,"prepare.queue_time_us":65824,"prepare.run_cpu_time_us":42997,"prepare.run_wall_time_us":459239,"raft.queue_time_us":80137,"raft.run_cpu_time_us":10643,"raft.run_wall_time_us":97697,"replication_time_us":647177,"spinlock_wait_cycles":16961408,"thread_start_us":217569,"threads_started":4,"wal-append.queue_time_us":181283,"wal-append.run_cpu_time_us":25073,"wal-append.run_wall_time_us":2045868}]]}
I20260709 12:57:23.289506  2921 consensus_queue.cc:1059] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:23.290156  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:23.290547  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:23.281121  2882 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:57:23.233546  2909 consensus_queue.cc:260] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.290208  2835 consensus_queue.cc:1059] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:23.291911  2666 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:23.292714  2929 log.cc:927] Time spent T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 12:57:23.293402  2930 log.cc:927] Time spent T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:57:23.293517  2527 consensus_queue.cc:260] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.250131  2924 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:23.296332  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:23.258397  2515 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:23.228767  2817 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.249197  2638 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:23.300819  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:23.301683  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:23.315574  1616 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:23.319453  1505 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:23.290480  2858 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:23.237656  2542 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.305584  1542 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:23.286187  1654 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:23.282151  2849 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:23.314098  1655 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:23.304417  2893 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:23.310985  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:23.339643  1616 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
W20260709 12:57:23.305938  2927 log.cc:927] Time spent T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.336s	user 0.000s	sys 0.004s
I20260709 12:57:23.333953  1538 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:23.281214  2826 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
W20260709 12:57:23.340431  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 54337.8us
I20260709 12:57:23.312445  2515 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:23.304669  2301 raft_consensus.cc:2889] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 4 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:23.270440  2756 consensus_queue.cc:1059] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
W20260709 12:57:23.310444  2931 log.cc:927] Time spent T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:57:23.305855  2921 raft_consensus.cc:3055] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:23.353906  2921 raft_consensus.cc:740] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:23.354889  2921 consensus_queue.cc:260] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.356134  2921 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:23.347112  1654 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:23.362475  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:23.310758  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:23.309422  2747 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:23.308895  2835 raft_consensus.cc:3055] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:23.311295  2527 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:23.304957  1612 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:23.352373  2515 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:23.364828  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:23.379334  1614 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:23.332660  2935 consensus_queue.cc:1059] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:57:23.320952  1682 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:23.350255  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:23.368891  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:23.369817  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 123502us
I20260709 12:57:23.340372  2917 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:23.346308  2849 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.372663  2835 raft_consensus.cc:740] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:23.346514  2638 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:23.346592  2882 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:23.494026  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:23.357030  2679 consensus_queue.cc:237] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.333248  2771 consensus_queue.cc:1059] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:57:23.497576  2648 raft_consensus.cc:1064] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
W20260709 12:57:23.384634  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 65281.9us
I20260709 12:57:23.498025  2638 raft_consensus.cc:697] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:23.391307  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:23.371263  2855 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:23.498950  1505 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:23.396215  1581 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:23.500451  2872 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:23.500855  2872 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:23.501199  2872 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:23.501274  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:23.501503  2854 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:23.502002  1689 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:23.502868  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:23.503860  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:23.373456  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:23.509402  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:23.510473  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:23.510639  2817 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:23.511011  1691 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:23.511868  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:23.459303  1688 raft_consensus.cc:1240] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:23.514142  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:23.514753  1688 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:23.378444  2858 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:23.311614  2924 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.467525  2606 raft_consensus.cc:3055] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:23.516716  2606 raft_consensus.cc:740] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:23.517686  2606 consensus_queue.cc:260] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.518967  2606 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:23.520964  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:23.498984  1685 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:23.523986  1537 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:23.508855  2886 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:23.529476  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:57:23.524963  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 59695.5us
I20260709 12:57:23.395292  2934 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:23.396060  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:23.480394  2888 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 2 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:23.485145  2610 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:23.552330  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 156197us
I20260709 12:57:23.490983  2908 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:23.497486  2771 raft_consensus.cc:3055] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:23.286681  2901 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:23.396189  1687 raft_consensus.cc:2393] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 4: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:23.504746  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:23.374559  2899 consensus_queue.cc:237] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.515925  2858 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.515599  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:23.569947  1688 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:23.526476  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:23.570973  1691 raft_consensus.cc:2410] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:23.527240  1542 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:23.471603  1614 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:23.528249  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:23.473950  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:23.575196  1583 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:23.576565  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:23.577543  1687 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:23.553941  1540 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:23.554512  1581 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:23.483520  2917 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:23.463104  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:23.583040  2917 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.583562  1611 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
W20260709 12:57:23.498060  2648 raft_consensus.cc:1068] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d: Unable to promote non-voter 1d6516ff61104bdda54bde95e92fe579: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:57:23.585788  2917 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:23.589210  1581 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:23.560542  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:23.504997  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:23.540901  2934 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:23.560227  2918 consensus_meta.cc:287] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.574s	user 0.000s	sys 0.010s
I20260709 12:57:23.556576  2770 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:23.573263  1689 raft_consensus.cc:2393] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 2: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:23.498980  2638 consensus_queue.cc:237] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.582396  1691 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:23.557183  2771 raft_consensus.cc:740] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:23.477255  1534 raft_consensus.cc:1240] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:57:23.627367  2770 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.629609  2770 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:23.582406   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:23.571372  1684 raft_consensus.cc:2393] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 4: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:23.563740  2924 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:23.616027  1691 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:57:23.571991  1609 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:23.622136  1688 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:23.594166  2644 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:23.571485  2584 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:23.609544  2925 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:23.633885  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 44810.4us
I20260709 12:57:23.644448  1581 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:23.571259  2747 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
W20260709 12:57:23.589737  2891 consensus_meta.cc:287] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.595s	user 0.005s	sys 0.005s
I20260709 12:57:23.609949  2934 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:23.611466  2666 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:23.607240  2542 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:23.566548  2901 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.698879  2848 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:23.624150  2826 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:23.625870  1612 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:23.694898  1685 raft_consensus.cc:1240] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:23.615034  2893 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.038s
W20260709 12:57:23.696689  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 196643us
I20260709 12:57:23.569483  2835 consensus_queue.cc:260] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.651566  2892 raft_consensus.cc:697] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:23.695314  2644 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:23.747884  2835 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:23.623548  2917 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:57:23.711234  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 54881.1us
I20260709 12:57:23.697999  2817 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:23.638710  1689 raft_consensus.cc:1240] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:23.659366  2925 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.717522  1683 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:23.717715  2901 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:23.711875  2771 consensus_queue.cc:260] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:23.725157  2942 log.cc:927] Time spent T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 12:57:23.726133  2947 log.cc:927] Time spent T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:57:23.685614  2891 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:23.737649  2666 raft_consensus.cc:697] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:23.746901  2858 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:23.747148  1685 raft_consensus.cc:1240] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:23.748281  2892 consensus_queue.cc:237] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.753123  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:23.861701  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:23.862370  1540 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:23.862594  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:23.863835  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:23.754209  1505 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:23.752460  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:23.810751  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:23.748414  1684 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:23.757750  2849 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:23.865011  1539 raft_consensus.cc:2393] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 5: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 12:57:23.869611  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 115469us
I20260709 12:57:23.744120  2826 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.870187  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:23.870620  1505 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:23.755671  2675 consensus_queue.cc:1059] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.103s
I20260709 12:57:23.748852  2917 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.875753  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:23.749565  2644 consensus_queue.cc:1059] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.111s
I20260709 12:57:23.845096  2266 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:23.762245  2515 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.763849  2934 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:24.063871  2959 log.cc:927] Time spent T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:57:24.352092  1686 raft_consensus.cc:1240] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:24.260809  2835 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:24.355100  2835 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:24.063064  2957 log.cc:927] Time spent T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:57:24.356727  1539 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:23.952487  2826 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:24.359691  2835 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:23.955108  1688 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:57:23.881814  2849 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:24.361644  2849 raft_consensus.cc:697] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 12:57:24.125488  2872 consensus_meta.cc:287] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.624s	user 0.009s	sys 0.000s
I20260709 12:57:23.914252  1655 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:24.363871  2872 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:24.365036  2917 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:24.085323  2925 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:24.275117  2638 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:24.367694  2638 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:24.300104  2901 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.368584  1688 pending_rounds.cc:85] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 1
I20260709 12:57:24.367791  2934 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:24.358840  2644 raft_consensus.cc:3055] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:24.368234  2826 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:23.930579  2924 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:24.368997  1688 pending_rounds.cc:107] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:57:24.369863  2924 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:24.370119  1688 raft_consensus.cc:2889] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:24.370282  2924 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:24.372510  2872 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:24.373505  1654 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:24.373816  2644 raft_consensus.cc:740] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:24.374845  2644 consensus_queue.cc:260] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:57:24.365731  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 451586us
W20260709 12:57:24.376833  2881 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.005s	sys 0.006s
I20260709 12:57:23.914193  2648 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:24.377233  2917 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:57:24.378847  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:24.379405  1654 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:23.864019  2945 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:24.381131  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:24.379745  1655 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:23.951267  2952 log.cc:927] Time spent T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 12:57:24.368964  2901 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:24.380132  2679 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:57:23.997112  2955 log.cc:927] Time spent T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:57:24.386041  2826 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:24.386556  1690 raft_consensus.cc:2368] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3.
I20260709 12:57:24.388113  2515 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:24.390043  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 960) took 1150 ms. Trace:
I20260709 12:57:24.391316  1687 raft_consensus.cc:1240] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:24.390460  1690 rpcz_store.cc:276] 0709 12:57:23.239807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:23.242583 (+  2776us) service_pool.cc:224] Handling call
0709 12:57:24.389832 (+1147249us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540008e8d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:24.389985 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2571119872}
I20260709 12:57:24.394397  1655 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:24.377170  2881 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.005s	sys 0.006s
I20260709 12:57:23.868835  2771 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:24.397372  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:23.932901  2301 raft_consensus.cc:1240] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:24.402384  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:24.402810  2638 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:24.403451  2638 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:24.403978  2638 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:24.404739  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:24.405064  1683 raft_consensus.cc:1275] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:24.405632  1685 raft_consensus.cc:2393] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 3: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:24.402285  2835 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:24.406172  2638 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:24.406522  2835 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:24.408524  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:24.409242  1683 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:57:24.410341  1684 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:24.410624  1682 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:57:24.396332  1655 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:24.403471  1690 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:24.413030  1655 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:24.408703  2835 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:23.998975  2891 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:24.380247  1654 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:24.415385  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:24.384326  2901 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:24.411896  2921 consensus_meta.cc:287] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 1.041s	user 0.010s	sys 0.000s
W20260709 12:57:24.423592  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:24.410905  2924 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:24.412109  2527 consensus_meta.cc:287] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 1.036s	user 0.001s	sys 0.010s
I20260709 12:57:24.426991  2849 consensus_queue.cc:237] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:24.393369  2648 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.952204  2666 consensus_queue.cc:237] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:24.429348  2835 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:24.417078  1682 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
W20260709 12:57:24.432662  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 672090us
I20260709 12:57:24.435956  2648 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:24.417577  2638 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:24.449366  2638 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:24.449766  2638 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:24.399200  2515 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:24.427568  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:24.571525  1685 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:24.411931  2972 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:24.425479  2891 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:24.426282  2679 raft_consensus.cc:697] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:57:24.623617  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 198106us
I20260709 12:57:24.428689  2826 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:24.625622  2970 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:24.656919  2826 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:24.621146  2972 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:57:24.668617  2947 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.021s	sys 0.025s
I20260709 12:57:24.637508  2974 consensus_queue.cc:1059] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:57:24.669322  2826 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:57:24.678647  2947 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.022s	sys 0.025s
I20260709 12:57:24.686600  2974 raft_consensus.cc:3055] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:24.687196  2974 raft_consensus.cc:740] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:24.664598  2970 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:57:24.298913  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:24.688539  2924 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:24.704242  2970 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:24.678005  2679 consensus_queue.cc:237] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:24.706446  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:24.693143  2872 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:24.707602  2872 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:24.709841  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:24.693424  2956 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.714623  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:24.716507  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:24.716023  1685 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:24.709190  2921 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.714116  2924 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.688418  2974 consensus_queue.cc:260] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:24.717098  2956 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:24.736904  2956 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:24.737345  2972 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:24.739086  2872 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:24.739940  1684 raft_consensus.cc:2410] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:24.715791  2638 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:24.733564  2648 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:24.726169  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:24.748935  2977 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.751154  2977 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:24.754136  2977 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:24.725940  2924 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:24.759140  2924 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:24.725410  2921 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:23.882553  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:24.777014  2921 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:24.777292  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 970) took 1022 ms. Trace:
I20260709 12:57:24.768383  1533 raft_consensus.cc:1240] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:24.743551  2648 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:24.781271  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 523) took 1510 ms. Trace:
I20260709 12:57:24.781693  1533 rpcz_store.cc:276] 0709 12:57:23.271036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:23.486021 (+214985us) service_pool.cc:224] Handling call
0709 12:57:23.486363 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:24.780236 (+1293873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:24.781005 (+   769us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54002e8454. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:24.781202 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2948046720}
I20260709 12:57:24.782366  2648 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:24.778083  2638 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:24.766396  2301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32802 (request call id 22) took 1109 ms. Trace:
I20260709 12:57:24.783564  2638 consensus_queue.cc:1059] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:24.783209  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:24.784781  2638 raft_consensus.cc:3055] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:24.785287  2638 raft_consensus.cc:740] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:24.786185  2638 consensus_queue.cc:260] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:24.786540  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:24.779752  1540 rpcz_store.cc:276] 0709 12:57:23.754643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:23.862958 (+108315us) service_pool.cc:224] Handling call
0709 12:57:24.777220 (+914262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:24.784902  2945 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:24.791095  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:24.792922  2945 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:24.783285  2301 rpcz_store.cc:276] 0709 12:57:23.700767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:23.709225 (+  8458us) service_pool.cc:224] Handling call
0709 12:57:23.715656 (+  6431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:24.401657 (+686001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:24.766003 (+364346us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54005f0354. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:24.766281 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":362678528}
I20260709 12:57:24.794880  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:24.795563  1533 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:24.796720  1655 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:24.792140  2638 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:24.800841  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:24.801160  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:24.801725  1540 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:24.802786  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:24.802924  1655 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:24.803958  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:24.804904  1540 raft_consensus.cc:2393] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 4: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:24.807994  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:24.808776  1540 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:24.810331  1533 raft_consensus.cc:2393] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 3: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:24.811802  1655 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:24.812032  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:24.812872  1533 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:24.788354  2826 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:24.813755  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 96771.7us
I20260709 12:57:24.813972  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:24.805306  2921 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:24.809616  2648 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:24.818486  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:24.818584  1655 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:24.814414  2977 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:24.819739  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:24.819269  1533 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:24.818068  2921 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:24.820991  2921 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:24.821256  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:24.090857  1508 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:24.822736  1540 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:24.820379  2977 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:57:24.822784  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 732035us
I20260709 12:57:24.819249  2648 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:24.824131  1655 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:24.825408  2983 consensus_queue.cc:1059] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:57:24.827247  2972 raft_consensus.cc:3055] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:24.821115  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:24.821942  1533 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:57:24.825968  2977 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:24.827719  2779 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.829386  2779 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:24.829811  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:24.830561  1533 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:24.830667  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:24.831291  1534 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:24.831370  2779 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:24.831769  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:24.832211  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:24.832578  2849 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.833000  2542 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:24.833730  1534 raft_consensus.cc:1275] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:24.833499  2542 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:24.834110  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 969) took 1079 ms. Trace:
I20260709 12:57:24.825517  1508 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:24.826715  2917 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:24.835136  2917 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:24.835557  2542 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:24.827602  2972 raft_consensus.cc:740] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:24.835743  2917 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.836603  1655 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:24.836643  2972 consensus_queue.cc:260] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:24.837639  1655 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:24.837874  2972 raft_consensus.cc:3060] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:24.838745  2983 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:24.824136  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:24.835251  2944 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.839696  2666 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:24.838953  1656 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:24.840158  2584 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.840216  2666 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:24.840821  2584 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:24.841392  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 971) took 1086 ms. Trace:
I20260709 12:57:24.842360  2666 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:24.842658  2584 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:24.843294  2983 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:24.843772  2983 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:24.843453  2917 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:24.841771  1540 rpcz_store.cc:276] 0709 12:57:23.754874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:24.840685 (+1085811us) service_pool.cc:224] Handling call
0709 12:57:24.840962 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:24.841112 (+   150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:24.841135 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:24.841174 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:24.841202 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:24.841253 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:24.841344 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:24.846391  1540 raft_consensus.cc:3055] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:24.849798  2982 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:24.849723  1540 raft_consensus.cc:740] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:24.850521  2982 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:24.834479  1533 rpcz_store.cc:276] 0709 12:57:23.754399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:24.833435 (+1079036us) service_pool.cc:224] Handling call
0709 12:57:24.833677 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:24.833825 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:24.833850 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:24.833891 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:24.833919 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:24.833968 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:24.834061 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:24.853297  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 795) took 1476 ms. Trace:
I20260709 12:57:24.851413  1540 consensus_queue.cc:260] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:24.839480  2944 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:24.853528  2983 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:24.854928  1687 rpcz_store.cc:276] 0709 12:57:23.377267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:23.613423 (+236156us) service_pool.cc:224] Handling call
0709 12:57:24.391100 (+777677us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:24.391749 (+   649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:24.853094 (+461345us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b540008e8d0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:24.853231 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1735103360}
I20260709 12:57:24.857856  2977 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:24.855147  1540 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:24.855126  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:24.835796  1508 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:24.834913  2648 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:24.870373  1655 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:24.872313  1508 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:24.877018  1508 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:24.859401  2982 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.878546  1540 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:24.869462  2924 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:24.869627  2937 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:24.834324  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 967) took 1080 ms. Trace:
I20260709 12:57:24.870019  2970 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:24.881186  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 973) took 1125 ms. Trace:
I20260709 12:57:24.881457  1508 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:24.881633  2934 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:24.880980  2849 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:57:24.885749  2924 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:24.887032  2970 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:24.886152  2934 raft_consensus.cc:697] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:24.881466  2872 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:57:24.889041  2934 consensus_queue.cc:237] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:24.886821  2985 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.877976  2771 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:24.891981  2945 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:24.893795  2826 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:24.894104  2945 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:24.894708  2924 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:24.895807  2977 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:24.896389  2977 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:24.896767  2977 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:24.897099  2977 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.897920  2937 consensus_queue.cc:1059] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:24.899683  2937 consensus_queue.cc:1059] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:24.900753  2858 raft_consensus.cc:3055] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:24.901167  2858 raft_consensus.cc:740] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:24.901717  2983 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:24.901947  2858 consensus_queue.cc:260] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:24.903071  2944 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:24.905251  1508 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:24.885221  1540 rpcz_store.cc:276] 0709 12:57:23.756195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:24.845986 (+1089791us) service_pool.cc:224] Handling call
0709 12:57:24.846288 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:24.880868 (+ 34580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:24.881115 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:24.906723  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:24.907305  1540 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:24.909149  2917 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:24.909819  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 70963.5us
I20260709 12:57:24.910804  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 972) took 1520 ms. Trace:
I20260709 12:57:24.911187  1691 rpcz_store.cc:276] 0709 12:57:23.380555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:23.640011 (+259456us) service_pool.cc:224] Handling call
0709 12:57:23.640292 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:24.362932 (+722640us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:24.362974 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:24.363019 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:24.363051 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:24.900273 (+537222us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b5400158e54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:24.900321 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:24.900447 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1661467392}
I20260709 12:57:24.914240  1540 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:24.916157  1655 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:24.916375  2986 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:24.916893  2986 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:24.913307  2917 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.921056  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 975) took 1045 ms. Trace:
W20260709 12:57:24.923807  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:24.924958  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:24.925985  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:24.927314  2872 consensus_queue.cc:1059] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:24.928169  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:24.928838  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:24.931030  2826 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:24.931813  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:24.932132  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 525) took 1660 ms. Trace:
I20260709 12:57:24.932425  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:24.938302  1540 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:24.938508  1691 raft_consensus.cc:2410] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:24.903115  2858 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:24.868374  2638 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:24.914587  2849 raft_consensus.cc:3055] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:57:24.944315  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:24.947319  1687 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:24.921556  2771 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:24.944628  2983 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:24.977887  2849 raft_consensus.cc:740] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:24.977397  1542 rpcz_store.cc:276] 0709 12:57:23.271486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:23.571618 (+300132us) service_pool.cc:224] Handling call
0709 12:57:23.571927 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:23.608033 (+ 36106us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:23.608070 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:23.608117 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:23.608151 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:24.931894 (+1323743us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b54000744d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:24.931942 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:24.932076 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82529024}
I20260709 12:57:24.976215  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:24.982513  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:24.983198  1542 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:24.943820  2925 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:57:24.988956  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 72900.6us
I20260709 12:57:24.882884  1534 rpcz_store.cc:276] 0709 12:57:23.753846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:24.833114 (+1079268us) service_pool.cc:224] Handling call
0709 12:57:24.833412 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:24.834081 (+   669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:24.834274 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:24.991185  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 792) took 1615 ms. Trace:
I20260709 12:57:24.946890  2956 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:24.921236  2986 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:24.975385  2771 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:24.974241  2935 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:24.990355  1687 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:24.991575  1686 rpcz_store.cc:276] 0709 12:57:23.376555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:23.609492 (+232937us) service_pool.cc:224] Handling call
0709 12:57:23.614863 (+  5371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:24.353521 (+738658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:24.990937 (+637416us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b540041bc54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:24.991125 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1695128320}
I20260709 12:57:24.948081  2921 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:24.997471  2771 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:24.990870  1682 raft_consensus.cc:2393] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 4: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:24.998406  1540 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:24.970606  2638 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:24.946636  2917 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.008446  1542 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:25.011937  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:24.975126  2826 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.000330  2935 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.027135  1685 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:24.995273  2983 raft_consensus.cc:697] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:24.996853  2956 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:25.029012  2987 log.cc:927] Time spent T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:57:25.028766  2983 consensus_queue.cc:237] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.030265  2956 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:25.023553  1540 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:25.032035  1540 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:25.032306  2849 consensus_queue.cc:260] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.033478  2849 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.034428  1542 raft_consensus.cc:1275] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:57:25.022950  2638 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:25.028239  2935 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:25.033663  2954 log.cc:927] Time spent T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 1.288s	user 0.007s	sys 0.007s
I20260709 12:57:25.043176  2648 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.048877  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 522) took 1685 ms. Trace:
I20260709 12:57:25.029554  2845 raft_consensus.cc:3055] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:25.040624  1690 raft_consensus.cc:1275] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:25.041606  2970 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:25.049827  2845 raft_consensus.cc:740] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:25.050642  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:25.050863  2845 consensus_queue.cc:260] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.052776  2817 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:25.053305  2817 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:25.040597  2771 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.054948  2638 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.055359  2985 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:25.057062  2638 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:23.887236  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:25.059227  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:25.061257  1542 raft_consensus.cc:1275] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:57:25.061687  1542 pending_rounds.cc:85] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 1
I20260709 12:57:25.061918  1542 pending_rounds.cc:107] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:57:25.049625  2648 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:25.062161  1542 raft_consensus.cc:2889] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:25.043061  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:25.062661  2648 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:24.992751  2925 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.049284  1616 rpcz_store.cc:276] 0709 12:57:23.363530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:23.363620 (+    90us) service_pool.cc:224] Handling call
0709 12:57:23.363905 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:23.364325 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:23.364353 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:23.364816 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 12:57:23.640511 (+275695us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:23.640553 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:23.640623 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:25.033130 (+1392507us) spinlock_profiling.cc:243] Waited 9 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:57:25.048564 (+ 15434us) raft_consensus.cc:1685] finished
0709 12:57:25.048586 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:25.048809 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":329,"raft.queue_time_us":81,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":3589,"spinlock_wait_cycles":20705024,"thread_start_us":180038,"threads_started":1,"wal-append.queue_time_us":334504}
I20260709 12:57:25.046921  2909 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:25.068593  2982 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:25.069262  2958 log.cc:927] Time spent T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 1.325s	user 0.009s	sys 0.017s
I20260709 12:57:25.070405  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 515) took 1807 ms. Trace:
I20260709 12:57:25.070832  2935 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:25.070792  1541 rpcz_store.cc:276] 0709 12:57:23.262808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:23.394582 (+131774us) service_pool.cc:224] Handling call
0709 12:57:23.394973 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:23.395348 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:23.395378 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:23.461213 (+ 65835us) log.cc:844] Serialized 26 byte log entry
0709 12:57:23.594050 (+132837us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:23.594095 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:23.594175 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:25.068019 (+1473844us) spinlock_profiling.cc:243] Waited 7.09 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:57:25.070132 (+  2113us) raft_consensus.cc:1685] finished
0709 12:57:25.070153 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:25.070349 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1241,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":65234,"spinlock_wait_cycles":16315776,"thread_start_us":35849,"threads_started":1,"wal-append.queue_time_us":163223}
I20260709 12:57:25.072558  2771 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:25.078044  2771 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:25.071264  2982 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:25.079197  2977 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.081233  1684 raft_consensus.cc:2393] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 3: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:25.082330  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:25.083288  2302 raft_consensus.cc:2393] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 4: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:57:25.083168  2771 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:25.085199  2299 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 3 LEARNER]: Advancing to term 5
I20260709 12:57:25.086413  2550 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:25.087071  2771 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:25.086966  2550 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:25.090448  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:25.082223  2977 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:25.096724  2909 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:25.097306  2909 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.098351  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:25.099228  1616 raft_consensus.cc:2410] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:25.099416  2909 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:25.092173  1654 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:57:25.101598  2985 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:25.101997  2985 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:25.102346  2985 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.106774  1440 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38804 (request call id 28) took 6900 ms. Trace:
I20260709 12:57:25.108800  1616 raft_consensus.cc:1240] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 12:57:25.113407  1654 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 1.565s (SENT) [suppressed 7 similar messages]
I20260709 12:57:25.116076  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:25.118937  1616 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:25.033504  1540 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:25.126683  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 134726us
I20260709 12:57:25.128913  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:25.129597  1539 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:25.129684  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:25.130671  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:25.131139  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:25.131280  1655 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:25.132498  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:25.133158  1542 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:25.133754  1655 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:25.134052  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:25.134649  1542 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:25.140035  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:25.140807  1616 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.145162  1655 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:25.146517  1539 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:25.150964  1542 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:25.152078  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:25.152884  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:25.155452  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:25.157231  1539 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.157346  1541 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:25.159921  1616 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:25.121776  2956 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:25.161239  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:25.161684  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:25.118139  2977 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:25.107434  1440 rpcz_store.cc:276] 0709 12:57:18.206244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:18.206424 (+   180us) service_pool.cc:224] Handling call
0709 12:57:25.106690 (+6900266us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:23.139109 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:23.205729 (+ 66620us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:23.210233 (+  4504us) write_op.cc:435] Acquired schema lock
0709 12:57:23.212887 (+  2654us) tablet.cc:662] Decoding operations
0709 12:57:23.258141 (+ 45254us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:23.268413 (+ 10272us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:23.281501 (+ 13088us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:57:23.291740 (+ 10239us) tablet.cc:701] Row locks acquired
0709 12:57:23.291761 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:57:23.291925 (+   164us) write_op.cc:270] Start()
0709 12:57:23.292051 (+   126us) write_op.cc:276] Timestamp: P: 1783601843291878 usec, L: 0
0709 12:57:23.292075 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:57:23.292740 (+   665us) log.cc:844] Serialized 981 byte log entry
0709 12:57:24.737385 (+1444645us) op_driver.cc:464] REPLICATION: finished
0709 12:57:24.851060 (+113675us) write_op.cc:301] APPLY: starting
0709 12:57:24.851162 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 12:57:24.851272 (+   110us) tablet.cc:1370] finished BulkCheckPresence
0709 12:57:24.851377 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:57:24.852224 (+   847us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:57:24.852393 (+   169us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:57:24.852447 (+    54us) write_op.cc:312] APPLY: finished
0709 12:57:24.852674 (+   227us) log.cc:844] Serialized 28 byte log entry
0709 12:57:24.855928 (+  3254us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:24.856028 (+   100us) write_op.cc:454] Released schema lock
0709 12:57:24.856078 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:57:24.856456 (+   378us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:24.856502 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":942756,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":113420,"apply.run_cpu_time_us":1992,"apply.run_wall_time_us":5366,"num_ops":2,"prepare.queue_time_us":159559,"prepare.run_cpu_time_us":28829,"prepare.run_wall_time_us":420493,"raft.queue_time_us":784250,"raft.run_cpu_time_us":39201,"raft.run_wall_time_us":77662,"replication_time_us":1445144,"thread_start_us":1116957,"threads_started":4,"wal-append.queue_time_us":294449}]]}
I20260709 12:57:25.120697  2648 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.114388  2935 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.148783  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:25.126365  2909 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:25.127200  2872 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:25.171770  1542 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.149600  2835 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:25.169318  1539 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
W20260709 12:57:25.187114  1583 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.264s	user 0.004s	sys 0.018s
I20260709 12:57:25.175572  1540 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:25.153023  2515 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:25.183665  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:25.190001  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:25.181373  1608 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:25.193028  1539 raft_consensus.cc:2393] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 3: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 12:57:25.187505  1583 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.264s	user 0.004s	sys 0.018s
I20260709 12:57:25.171444  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:25.198392  2267 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:25.198760  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:25.199321  1682 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:25.199501  2970 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.200074  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:25.201900  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:25.204329  1686 raft_consensus.cc:1240] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: []
W20260709 12:57:25.202791  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:25.177724  2925 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:25.201891  1542 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
W20260709 12:57:25.202986  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 89617.5us
I20260709 12:57:25.178009  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:57:25.207214  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:25.213261  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 51758.9us
I20260709 12:57:25.213251  2944 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:25.213521  2945 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:25.214126  2944 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.214218  2945 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.216406  2944 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:25.217092  2542 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:25.217721  2542 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.220105  2542 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:25.221160  1583 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:25.222610  1583 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:25.223205  2542 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:25.216531  2945 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:25.224435  2944 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:25.225025  2944 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:25.225579  1583 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:25.179817  2991 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:25.240430  1655 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:25.226915  1583 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:25.176697  2977 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.174520  2956 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:25.247701  1583 leader_election.cc:400] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3.
I20260709 12:57:25.200783  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:25.180986  2679 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:57:25.250684  1583 leader_election.cc:403] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:57:25.209707  1608 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:25.265657  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:25.242803  2779 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:25.207135  1609 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:25.194243  2872 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.245369  2944 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:25.269397  1690 raft_consensus.cc:2393] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 3: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:25.268021  2858 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:25.194049  2909 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.243885  2991 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:25.224558  2542 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:25.247324  2945 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:25.265946  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:25.250414  2964 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:25.267691  2267 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:25.262154  2925 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:25.287277  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:25.293807  1690 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:25.284734  1534 raft_consensus.cc:3060] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:25.275007  2992 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:25.283259  2893 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3.
I20260709 12:57:25.285634  2991 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:25.272403  2779 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:25.252421  2666 consensus_queue.cc:1059] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:57:25.285811  2542 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.285365  2945 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:25.294548  2925 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.297992  2648 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:25.285872  2964 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:25.296084  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:25.297410  2638 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:25.309455  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 69158.1us
I20260709 12:57:25.287683  2858 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.302119  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:25.295063  2301 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:25.298887  2835 raft_consensus.cc:697] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:25.292950  2993 consensus_queue.cc:1048] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:57:25.438134  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:25.439085  1691 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:25.440214  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:25.427292  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 520) took 2064 ms. Trace:
I20260709 12:57:25.437911  1655 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:25.438211  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 190772us
I20260709 12:57:25.347002  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:25.444270  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:25.445636  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:25.440747  1613 rpcz_store.cc:276] 0709 12:57:23.363000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:23.363114 (+   114us) service_pool.cc:224] Handling call
0709 12:57:23.379008 (+ 15894us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:23.379349 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:23.379376 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:23.500557 (+121181us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b2c00125b38. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85b94aa11 00007fc85b95a372 00007fc85d08ca01 00007fc85d05143a 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2
0709 12:57:23.500940 (+   383us) log.cc:844] Serialized 26 byte log entry
0709 12:57:23.695785 (+194845us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:23.695830 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:23.695906 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:25.426926 (+1731020us) raft_consensus.cc:1685] finished
0709 12:57:25.426953 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:25.427215 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42555,"raft.queue_time_us":344,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":9825,"spinlock_wait_cycles":23936256,"thread_start_us":194449,"threads_started":1,"wal-append.queue_time_us":356336,"wal-append.run_cpu_time_us":8965,"wal-append.run_wall_time_us":1504672}
I20260709 12:57:25.300357  2515 raft_consensus.cc:697] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:25.452570  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:25.470824  2999 log.cc:927] Time spent T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 12:57:25.436295  2985 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:25.471560  3007 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:25.472129  3007 raft_consensus.cc:697] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:25.364841  3002 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:25.470400  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:25.475520  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:25.474056  3002 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:25.476172  1609 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:25.470683  2925 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:25.476853  2779 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:25.478581  3002 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:25.480415  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:25.480994  2909 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:25.482064  2299 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 5 LEARNER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:57:25.472998  2985 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:25.417521  2935 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:25.473064  3007 consensus_queue.cc:237] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.473482  1507 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:25.484020  2935 raft_consensus.cc:2804] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:25.484567  2935 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:25.451843  2638 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.484931  2872 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:25.485822  2977 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:25.486117  2835 consensus_queue.cc:237] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.486682  2638 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:25.415843  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 164811us
I20260709 12:57:25.475390  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:57:25.488802  2301 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.311017  2945 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:25.440492  2644 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.491379  1690 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
W20260709 12:57:25.457366  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:25.491339  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:57:25.495095  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:25.495683  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:25.462239  1655 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:25.347213  3000 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:25.436427  2996 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:25.371297  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:25.446617  2964 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:25.500727  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 45803.1us
I20260709 12:57:25.518159  3008 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:25.518522  2858 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:25.499904  2996 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:25.520123  1608 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:25.519928  2817 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.521200  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:25.521932  2996 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:25.522239  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:25.522549  2817 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:25.306643  2992 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.484947  2935 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:25.521865  1608 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:25.497110  2848 raft_consensus.cc:1064] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:57:25.525694  1613 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:25.488832  1609 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:25.527792  2970 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:25.529784  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 802) took 2150 ms. Trace:
I20260709 12:57:25.530236  1688 rpcz_store.cc:276] 0709 12:57:23.379026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:23.638456 (+259430us) service_pool.cc:224] Handling call
0709 12:57:23.638717 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:24.370771 (+732054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:25.529508 (+1158737us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b5400388e54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:25.529713 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":726730496}
I20260709 12:57:25.531493  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:25.532063  1688 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:25.523129  1683 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:25.538077  1691 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:25.538892  3010 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:25.539443  3010 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.518208  2515 consensus_queue.cc:237] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.545647  3011 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:25.548203  3011 raft_consensus.cc:697] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 5 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:25.549276  3011 consensus_queue.cc:237] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:24.937127  1533 rpcz_store.cc:276] 0709 12:57:23.876140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:24.861930 (+985790us) service_pool.cc:224] Handling call
0709 12:57:24.862263 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:24.862462 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:57:24.868810 (+  6348us) log.cc:844] Serialized 14 byte log entry
0709 12:57:24.920718 (+ 51908us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:24.920768 (+    50us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:24.920811 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:24.920871 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:24.920998 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7933,"prepare.queue_time_us":7366,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":38,"raft.queue_time_us":8854,"thread_start_us":43573,"threads_started":1,"wal-append.queue_time_us":45625}
I20260709 12:57:25.452530  2584 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:57:25.551505  2944 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.553485  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:25.554345  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 517) took 2291 ms. Trace:
I20260709 12:57:25.554771  1536 rpcz_store.cc:276] 0709 12:57:23.263297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:23.473082 (+209785us) service_pool.cc:224] Handling call
0709 12:57:23.473626 (+   544us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:57:23.474211 (+   585us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:23.474263 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:57:23.475211 (+   948us) log.cc:844] Serialized 52 byte log entry
0709 12:57:23.696345 (+221134us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:23.705348 (+  9003us) log.cc:844] Serialized 14 byte log entry
0709 12:57:23.705961 (+   613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:23.706164 (+   203us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:24.007563 (+301399us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b18003be240. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f643f3 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd 000000000038f354 000000000038f199 00007fc859f4783a
0709 12:57:25.553990 (+1546427us) raft_consensus.cc:1685] finished
0709 12:57:25.554105 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:25.554274 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8675,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":42,"raft.queue_time_us":391,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":3679,"spinlock_wait_cycles":7002368,"thread_start_us":220604,"threads_started":1,"wal-append.queue_time_us":279734,"wal-append.run_cpu_time_us":11135,"wal-append.run_wall_time_us":1657558}
I20260709 12:57:25.561811  2989 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:25.562615  1654 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:25.562435  2989 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.562916  3010 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:25.563539  3011 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:25.497876  3000 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:25.564640  2989 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:25.563453  2986 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:25.564494  3000 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.568087  2986 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.567595  1654 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:25.571866  2991 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.571606  2638 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:25.573040  2638 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:25.573585  2638 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:25.570184  2986 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:25.580685  1611 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:25.581023  1654 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:25.582856  1654 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:25.583778  3010 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:25.584417  2977 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:25.584304  3010 raft_consensus.cc:697] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:25.586237  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:25.586951  1611 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:25.586745  3010 consensus_queue.cc:237] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.587973  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:25.589651  2992 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:25.593888  2542 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.611370  1654 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:25.617944  1654 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:25.697732  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 249416us
W20260709 12:57:25.700838  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 82984.3us
I20260709 12:57:25.704648  1508 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:25.710173  1508 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:25.711450  1583 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:25.712869  1583 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:25.712932  1508 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:25.555428  2550 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:25.573858  2991 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:25.718381  1688 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:25.722011  1687 raft_consensus.cc:1240] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:25.726343  2944 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:25.700372  2992 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:25.727957  1534 raft_consensus.cc:2468] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 5.
I20260709 12:57:25.733712  1583 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:57:25.738135  1582 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:49296 dropped due to backpressure: service queue is full with 50 items
I20260709 12:57:25.732674  2972 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:25.739264  2972 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.741387  2972 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:25.742326  2963 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:25.742753  2963 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:25.743053  2963 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:25.745288  3014 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:25.745682  3014 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:25.745993  3014 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:25.746222  2848 consensus_queue.cc:237] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:25.749751  3006 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:25.750356  3006 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:25.753153  2945 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.754305  2849 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:25.754837  2849 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.755261  2945 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:25.719040  2666 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:25.755757  2666 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:25.756119  2666 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:25.718986  2858 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:57:25.718847  2872 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:25.762326  2872 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:25.762739  2872 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:25.764724  2542 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:25.765331  3000 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:25.766616  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:25.768518  1655 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:25.712582  2989 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:25.714733  2986 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:25.767630  2267 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:25.731552  1684 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:25.728420  2925 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:25.705857  2817 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:57:25.767541  3000 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:25.734673  2992 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:25.719682  2996 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 12:57:25.731335  2909 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:57:25.738441  1582 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:49296 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 818)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 542)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 541)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 565)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 835)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 808)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 561)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 566)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 560)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 830)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 559)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 570)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 564)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 568)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 539)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 544)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 546)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 549)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 806)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 810)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 812)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 813)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 815)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 816)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 819)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 820)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 827)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 832)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 834)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 562)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 563)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 567)
I20260709 12:57:25.770697  3006 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:25.792986  1655 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:25.828948  1508 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:25.831352  1616 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:25.792163  2970 raft_consensus.cc:2804] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:57:25.885370  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:25.783138  2925 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:25.786036  2992 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:25.887480  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 94598.9us
I20260709 12:57:25.777011  2301 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
W20260709 12:57:25.791615  2899 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.729s	user 0.005s	sys 0.028s
I20260709 12:57:25.792321  1610 raft_consensus.cc:1240] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:57:25.782675  2584 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:25.898505  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 164873us
I20260709 12:57:25.920893  1583 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:25.792215  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:25.902532  2858 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:25.830168  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 62650.2us
I20260709 12:57:25.908928  1655 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:25.830415  2550 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 12:57:25.895654  2925 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.899829  2515 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:26.010625  2515 raft_consensus.cc:697] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:26.011554  2515 consensus_queue.cc:237] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:26.016806  2977 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:26.017503  2977 raft_consensus.cc:697] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:26.018497  2977 consensus_queue.cc:237] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:26.022146  2638 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.973670  1583 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:57:26.026208  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 52605.5us
I20260709 12:57:26.027871  2644 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:26.028326  2644 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:26.034085  2644 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:25.945609  3028 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:26.035598  2858 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:26.038084  2858 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:26.042289  3028 raft_consensus.cc:697] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:26.043516  3028 consensus_queue.cc:237] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:26.058302  3024 consensus_queue.cc:1059] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:26.069530  2638 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:25.914368  1582 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:49312 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 818)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 542)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 541)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 565)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 835)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 808)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 561)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 566)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 560)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 830)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 559)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 570)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 564)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 568)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 539)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 544)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 546)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 549)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 806)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 810)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 812)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 813)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 815)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 816)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 819)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 820)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 827)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 832)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 834)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 562)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 563)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 567)
I20260709 12:57:25.898021  2970 raft_consensus.cc:697] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 5 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:57:25.820379  3007 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:25.792584  2986 raft_consensus.cc:697] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:57:25.952934  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:26.106178  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:25.915618  2648 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.039s
W20260709 12:57:25.919310  2899 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.857s	user 0.005s	sys 0.032s
I20260709 12:57:25.954896  3015 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:25.972078  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:25.972306  3020 log.cc:927] Time spent T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
I20260709 12:57:25.973023  2542 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:25.974009  1611 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:25.973845  2666 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:25.974407  3016 log.cc:927] Time spent T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:57:25.975023  2835 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:25.944418  2584 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:25.973599  2944 consensus_queue.cc:1059] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:57:26.009311  2849 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:25.903942  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 195592us
I20260709 12:57:25.908083  2989 raft_consensus.cc:697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:26.107746  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:26.108363  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 279511us
W20260709 12:57:26.106276  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 155089us
I20260709 12:57:26.108436  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:26.111749  1505 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:25.990077  2964 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:26.140661  2835 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:26.156183  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:26.156340  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:26.173367  1536 raft_consensus.cc:1275] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:26.179035  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:26.179792  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:26.180294  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:26.179805  1539 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:26.181324  1540 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:26.182096  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:26.182677  1539 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:26.180562  1536 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:26.204180  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:26.168148  2584 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:26.112586  1583 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:25.996147  2935 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:26.217021  2935 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:26.097666  3007 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:26.120326  3015 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:26.217667  3007 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:26.113710  2858 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:26.218295  2858 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:26.149436  2986 consensus_queue.cc:237] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:26.197343  2909 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:26.221849  2909 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:26.144953  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:26.223281  1691 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:26.223883  2909 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:26.146029  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:26.225759  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:26.226788  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:26.227761  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:26.228654  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:26.220309  2858 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:26.224196  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:26.229393  1534 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:26.229936  2845 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:26.231436  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:57:26.231705  2301 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 4 LEARNER]: Advancing to term 5
I20260709 12:57:26.232035  2302 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:23.929519  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:26.228286  1688 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:26.144559  3014 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:26.211620  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:26.168453  2970 consensus_queue.cc:237] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:26.211716  2996 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:26.167001  2835 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:26.217713  3015 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:26.134207  1610 raft_consensus.cc:2393] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 2: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 12:57:26.245746  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 133282us
I20260709 12:57:26.253572  2817 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:26.255792  2817 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:26.256170  2817 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:26.256567  2666 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:26.256727  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 514) took 2995 ms. Trace:
I20260709 12:57:26.257184  1538 rpcz_store.cc:276] 0709 12:57:23.261177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:23.346147 (+ 84970us) service_pool.cc:224] Handling call
0709 12:57:23.349172 (+  3025us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:23.349533 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:23.349558 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:23.350006 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 12:57:23.558765 (+208759us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:23.558811 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:23.558889 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:26.256443 (+2697554us) raft_consensus.cc:1685] finished
0709 12:57:26.256495 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:26.256663 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":477,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"thread_start_us":208394,"threads_started":1,"wal-append.queue_time_us":307318,"wal-append.run_cpu_time_us":18453,"wal-append.run_wall_time_us":1732332}
I20260709 12:57:26.260663  3027 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:26.263398  2302 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:26.264922  1507 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:26.265928  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:26.266388  2964 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:26.267043  3022 raft_consensus.cc:2804] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:26.267153  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:26.267673  3022 raft_consensus.cc:697] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:26.244242  1536 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:26.275434  1691 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:26.270516  1583 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:26.199888  2963 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:26.241144  2872 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:26.282126  3014 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:26.283236  2992 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:26.316082  1539 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:26.250785  2996 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:26.242183  2989 consensus_queue.cc:237] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:26.322871  1542 raft_consensus.cc:2393] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 4: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:26.289951  2301 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 5 LEARNER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:57:26.291972  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 825) took 1366 ms. Trace:
I20260709 12:57:26.268556  3022 consensus_queue.cc:237] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:26.292850  3015 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:26.293769  1683 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:26.294642  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 547) took 1124 ms. Trace:
I20260709 12:57:26.297901  1688 raft_consensus.cc:1275] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:26.342478  1616 rpcz_store.cc:276] 0709 12:57:25.170589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:25.171534 (+   945us) service_pool.cc:224] Handling call
0709 12:57:26.294417 (+1122883us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b54002576d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:26.294568 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1478757248}
I20260709 12:57:26.116292  1582 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:49312 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 542)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 541)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 565)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 835)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 808)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 561)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 566)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 560)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 830)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 559)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 573)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 570)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 564)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 568)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 539)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 544)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 546)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 549)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 806)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 810)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 812)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 813)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 815)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 816)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 819)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 820)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 827)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 832)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 834)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 562)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 563)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 567)
I20260709 12:57:26.309613  1691 raft_consensus.cc:1240] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:26.286110  1611 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:26.296051  2817 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:26.322113  2644 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:26.304198  1437 catalog_manager.cc:5697] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 1 to 2, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
W20260709 12:57:26.329237  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:26.326741  1685 rpcz_store.cc:276] 0709 12:57:24.925821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:24.925928 (+   107us) service_pool.cc:224] Handling call
0709 12:57:26.291759 (+1365831us) spinlock_profiling.cc:243] Waited 41.3 ms on lock 0x7b5400158954. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:26.291897 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94945152}
I20260709 12:57:26.318941  3024 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:26.345891  1691 raft_consensus.cc:1240] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:57:26.367089  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:26.239482  1581 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:58006 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 542)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 541)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 565)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 835)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 808)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 561)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 566)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 560)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 830)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 559)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 573)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 570)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 564)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 568)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 539)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 544)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 546)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 549)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 806)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 810)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 812)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 813)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 815)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 816)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 819)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 820)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 827)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 832)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 834)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 562)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 563)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 567)
W20260709 12:57:26.368104  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:26.368621  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:26.363394  1437 catalog_manager.cc:5697] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 3 to 4, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 4 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:26.339026  2301 pending_rounds.cc:85] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579: Aborting all ops after (but not including) 3
I20260709 12:57:26.405133  1685 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 5 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:26.405766  1437 catalog_manager.cc:5697] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 1 to 2, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:26.407863  1688 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:26.404840  2301 pending_rounds.cc:107] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:57:26.370085  3024 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:26.414687  1582 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:49296 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 541)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 565)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 835)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 808)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 561)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 566)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 560)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 830)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 559)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 573)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 570)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 564)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 576)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 568)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 539)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 544)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 546)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 549)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 806)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 810)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 812)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 813)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 815)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 816)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 819)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 820)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 827)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 832)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 834)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 562)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 563)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 567)
I20260709 12:57:26.417210  2648 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:26.441031  2648 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:26.417482  1655 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:26.442862  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 163625us
W20260709 12:57:26.408810  2266 leader_election.cc:336] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:58006 dropped due to backpressure: service queue is full with 50 items
I20260709 12:57:26.352245  2925 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:26.409050  3029 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:26.444182  2858 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:26.442708  3024 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:26.443897  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:26.452750  2972 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:26.487700  2858 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:26.409535  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 553) took 1191 ms. Trace:
I20260709 12:57:26.457113  2996 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:26.459457  3015 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:26.457643  2644 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:26.445113  1655 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:26.454630  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 828) took 1528 ms. Trace:
I20260709 12:57:26.471226  1612 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 2.
I20260709 12:57:26.454828  2301 raft_consensus.cc:2889] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 5 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:26.489730  2972 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:26.859860  2972 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:26.420049  1437 catalog_manager.cc:5697] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 1 to 2, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:26.865381  1437 catalog_manager.cc:5697] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 1 to 2, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:26.866902  1437 catalog_manager.cc:5697] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 1 to 2, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:26.454187  1582 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:49296 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 541)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 565)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 835)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 808)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 561)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 566)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 560)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 830)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 559)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 573)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 570)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 564)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 576)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 568)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 539)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 544)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 546)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 549)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 806)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 810)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 812)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 813)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 815)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 816)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 819)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 820)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 827)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 832)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 834)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 562)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 563)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 567)
W20260709 12:57:26.869808  1582 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:49296 dropped due to backpressure: service queue is full with 50 items [suppressed 5 similar messages]
I20260709 12:57:26.870018  1582 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:49296 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 835)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 808)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 561)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 566)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 560)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 830)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 559)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 573)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 570)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 564)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 576)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 568)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 838)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 840)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 539)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 544)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 546)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 549)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 806)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 810)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 812)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 813)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 815)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 816)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 819)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 820)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 827)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 832)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 834)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 562)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 563)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 567)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 839)
I20260709 12:57:26.412221  2992 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:26.436703  3010 consensus_queue.cc:1048] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 12:57:26.512152  1611 rpcz_store.cc:276] 0709 12:57:25.213059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:25.773246 (+560187us) service_pool.cc:224] Handling call
0709 12:57:26.371205 (+597959us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:26.873401  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:26.874191  1611 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 835) took 1351 ms (client timeout 1759 ms). Trace:
W20260709 12:57:26.874576  1611 rpcz_store.cc:269] 0709 12:57:25.522914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.873117 (+1350203us) service_pool.cc:224] Handling call
0709 12:57:26.874132 (+  1015us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:26.876046  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:26.554258  2996 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:26.876739  2996 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:26.878800  2996 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:26.453263  2648 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:26.878508  1582 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:49296 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 808)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 561)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 566)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 560)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 830)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 559)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 573)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 570)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 564)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 576)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 568)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 838)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 842)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 539)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 544)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 546)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 549)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 806)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 810)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 812)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 813)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 815)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 816)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 819)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 820)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 827)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 832)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 834)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 562)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 563)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 567)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 839)
I20260709 12:57:26.607954  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:26.882511  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:26.883271  1537 raft_consensus.cc:2393] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 4: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:26.884088  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:26.608505  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:26.609026  1539 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:26.884768  1535 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:26.885310  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:26.610680  1534 raft_consensus.cc:1275] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:26.885594  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:26.886260  1535 raft_consensus.cc:2368] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6.
I20260709 12:57:26.886556  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:26.886955  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:26.887528  1535 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:26.887673  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:26.888334  1534 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:26.889182  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:26.612005  2542 raft_consensus.cc:3055] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:26.612869  3028 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:26.613778  3007 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:26.487397  3029 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:26.616061  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:26.479344  2817 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:26.611464  2858 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:26.474858  2872 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:26.610683  2899 raft_consensus.cc:3055] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:26.618501  2917 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:26.626415  2924 raft_consensus.cc:3055] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:26.555320  2925 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:26.613315  2963 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:26.620209  3024 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:26.634037  1682 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
W20260709 12:57:26.638934  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:26.642194  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:26.643849  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:26.654809  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 995) took 1457 ms. Trace:
I20260709 12:57:26.666987  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:26.672740  2550 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:26.704144  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 836) took 1256 ms. Trace:
W20260709 12:57:26.716444  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 271462us
I20260709 12:57:26.716693  2848 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:26.721123  1538 raft_consensus.cc:1275] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:57:26.722762  1583 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:26.723714  2835 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:26.724016  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:26.727010  3050 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:26.729274  2991 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:26.729882  2826 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:26.730137  1656 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 12:57:26.731204  3027 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:26.732924  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:26.737784  2974 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:26.751011  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:26.754164  2956 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:26.770200  2266 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:26.775076  3030 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:26.781970  3033 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:26.785319  3006 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:26.787053  3014 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:26.789083  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 997) took 1590 ms. Trace:
I20260709 12:57:26.791055  2893 raft_consensus.cc:3055] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:26.792747  3022 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:26.796247  1542 raft_consensus.cc:1240] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:26.799212  2989 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:26.815061  3031 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:26.819178  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:26.833053  1615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 533) took 1721 ms (client timeout 1565 ms). Trace:
I20260709 12:57:26.836002  2921 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:26.842365  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:26.843767  3003 raft_consensus.cc:1064] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:57:26.844115  2935 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:57:26.845669  1612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 13) took 2972 ms (client timeout 2211 ms). Trace:
I20260709 12:57:26.844781  1689 rpcz_store.cc:276] 0709 12:57:24.926618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:24.990039 (+ 63421us) service_pool.cc:224] Handling call
0709 12:57:24.991414 (+  1375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:25.155569 (+164155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:25.155606 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:26.283059 (+1127453us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b2c00128aa8. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85b94aa11 00007fc85b95a372 00007fc85d08ca01 00007fc85d05143a 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2
0709 12:57:26.283499 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 12:57:26.324812 (+ 41313us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:26.324847 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:26.324921 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:26.454346 (+129425us) raft_consensus.cc:1685] finished
0709 12:57:26.454368 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:26.454570 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1599,"raft.queue_time_us":30560,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":128,"spinlock_wait_cycles":6275456,"thread_start_us":201406,"threads_started":2,"wal-append.queue_time_us":122390}
I20260709 12:57:26.847600  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:26.848879  3011 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:26.850206  1508 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:26.994979  2970 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:26.852160  2982 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:26.995224  1655 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:26.995687  2982 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:26.610864  1540 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:57:26.996258  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 626702us
I20260709 12:57:26.996527  2648 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:26.898739  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:26.997334  3011 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:26.997526  2996 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:26.997246  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:26.999336  3011 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:26.999962  3003 raft_consensus.cc:1068] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d: Unable to promote non-voter 1d6516ff61104bdda54bde95e92fe579: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }.
  Pending config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:26.999897  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:27.000583  1540 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:26.998668  2982 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:27.001499  2989 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:27.002461  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 272404us
I20260709 12:57:27.003466  2989 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:27.003636  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 153527us
I20260709 12:57:27.004086  2989 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:27.004442  2989 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:27.004832  2989 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:27.005509  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:27.006647  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:27.007308  1536 raft_consensus.cc:2368] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6.
I20260709 12:57:27.004736  2982 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:57:27.008715  1610 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 537) took 1896 ms (client timeout 2106 ms). Trace:
W20260709 12:57:27.009088  1615 rpcz_store.cc:269] 0709 12:57:25.111201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.832822 (+1721621us) service_pool.cc:211] Skipping call since client already timed out
0709 12:57:26.832969 (+   147us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:57:26.892166  1581 leader_election.cc:400] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6.
I20260709 12:57:27.010758  2970 consensus_queue.cc:1048] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:57:27.012125  2982 raft_consensus.cc:697] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:27.012588  2935 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.013119  2982 consensus_queue.cc:237] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:27.014369  3027 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:27.009297  1610 rpcz_store.cc:269] 0709 12:57:25.112209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.750719 (+1638510us) service_pool.cc:224] Handling call
0709 12:57:27.008652 (+257933us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.015710  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:27.015940  2944 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:27.015331  2648 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:27.016379  2944 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:27.016839  2944 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.017541  2996 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:27.017258  2648 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.018010  2996 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.019443  2648 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:27.010771  1581 leader_election.cc:403] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:57:27.024085  1613 raft_consensus.cc:2393] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 2: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 12:57:27.024678  1613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 565) took 1320 ms (client timeout 1565 ms). Trace:
W20260709 12:57:27.025086  1613 rpcz_store.cc:269] 0709 12:57:25.704376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.818845 (+1114469us) service_pool.cc:224] Handling call
0709 12:57:27.024623 (+205778us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.025683  2515 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:27.026057  1616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 542) took 1911 ms (client timeout 2099 ms). Trace:
I20260709 12:57:27.026171  2515 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:57:27.026468  1616 rpcz_store.cc:269] 0709 12:57:25.115132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.847298 (+1732166us) service_pool.cc:224] Handling call
0709 12:57:27.026004 (+178706us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:57:27.027474  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 135457us
I20260709 12:57:27.027828  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:27.028504  2515 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:27.028967  2826 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:26.890508  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:27.029695  1608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 541) took 1916 ms (client timeout 2128 ms). Trace:
W20260709 12:57:27.030036  1608 rpcz_store.cc:269] 0709 12:57:25.114839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.643564 (+1528725us) service_pool.cc:224] Handling call
0709 12:57:27.029639 (+386075us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.030834  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:26.940994  1611 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 550) took 1745 ms (client timeout 2088 ms). Trace:
I20260709 12:57:27.031698  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:27.016623  1610 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 561) took 1313 ms (client timeout 1589 ms). Trace:
I20260709 12:57:27.032591  2848 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:27.033071  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:27.019444  2991 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.032631  1686 raft_consensus.cc:2393] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 4: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:27.028689  3014 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6.
I20260709 12:57:27.020956  1683 rpcz_store.cc:276] 0709 12:57:25.197760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:25.537455 (+339695us) service_pool.cc:224] Handling call
0709 12:57:26.293569 (+756114us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:26.351427 (+ 57858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:26.654575 (+303148us) spinlock_profiling.cc:243] Waited 756 ms on lock 0x7b5400158950. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:26.654744 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1738093952}
W20260709 12:57:27.032842  1610 rpcz_store.cc:269] 0709 12:57:25.703299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.015437 (+1312138us) service_pool.cc:224] Handling call
0709 12:57:27.016559 (+  1122us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:57:27.016824  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 294165us
I20260709 12:57:27.035521  1534 raft_consensus.cc:2393] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 3: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:27.035939  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.036550  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:27.009209  2550 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.037917  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:27.038163  1583 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:27.039072  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:27.039624  2550 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:27.036840  1539 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
W20260709 12:57:27.020655  1612 rpcz_store.cc:269] 0709 12:57:23.873650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:23.881321 (+  7671us) service_pool.cc:224] Handling call
0709 12:57:26.845552 (+2964231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.040367  3028 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.040674  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:26.851629  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:27.071393  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:27.074426  2302 raft_consensus.cc:1275] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 3 LEARNER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:57:27.079640  2974 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:27.082748  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:27.089767  2872 raft_consensus.cc:1064] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:57:27.041554  2848 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.008373  1690 rpcz_store.cc:276] 0709 12:57:25.447241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:25.452296 (+  5055us) service_pool.cc:224] Handling call
0709 12:57:26.703943 (+1251647us) spinlock_profiling.cc:243] Waited 34.5 ms on lock 0x7b54002891d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:26.704078 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79412608}
I20260709 12:57:27.101164  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:27.101935  1690 raft_consensus.cc:2393] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 4: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:27.101599  2989 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.102828  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:27.103545  1690 raft_consensus.cc:2393] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 4: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 12:57:27.008844  1614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 536) took 1896 ms (client timeout 2010 ms). Trace:
I20260709 12:57:27.008127  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:57:27.104632  1614 rpcz_store.cc:269] 0709 12:57:25.111962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.842087 (+1730125us) service_pool.cc:224] Handling call
0709 12:57:27.008787 (+166700us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:57:27.041531  1611 rpcz_store.cc:269] 0709 12:57:25.195366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.875242 (+1679876us) service_pool.cc:224] Handling call
0709 12:57:26.940908 (+ 65666us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.105683  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:26.998745  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:27.106482  1614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 557) took 1892 ms (client timeout 2189 ms). Trace:
I20260709 12:57:27.106873  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:27.102841  1541 raft_consensus.cc:2393] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 3: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:27.107965  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:27.108541  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:27.109000  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:27.109670  1537 raft_consensus.cc:2393] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 3: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:27.109543  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:27.110098  1541 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:57:27.110365  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:27.110853  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:27.111356  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:27.111714  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:47506
I20260709 12:57:27.010211  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:27.112726  1538 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.104252  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:27.032004  1684 rpcz_store.cc:276] 0709 12:57:25.198236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:25.554541 (+356305us) service_pool.cc:224] Handling call
0709 12:57:25.554851 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:25.783007 (+228156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:26.788805 (+1005798us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b5400391f54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:26.789017 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":352659328}
I20260709 12:57:27.041702  2826 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.040979  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.015453  2935 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:26.996507  1682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 1002) took 1792 ms (client timeout 2214 ms). Trace:
I20260709 12:57:27.031827  1608 raft_consensus.cc:2393] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 3: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 12:57:27.028605  1616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 809) took 1813 ms (client timeout 2092 ms). Trace:
I20260709 12:57:27.009426  3050 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:27.031698  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:27.033818  1581 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:27.020210  2996 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:27.045408  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:27.138146  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 43785us
I20260709 12:57:27.138523  1542 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
W20260709 12:57:27.138614  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 104872us
I20260709 12:57:27.139642  3050 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:27.140012  1581 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:27.140223  3033 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:27.140651  3033 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:27.141116  3033 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:27.140589  1542 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:27.141811  1581 leader_election.cc:400] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6.
I20260709 12:57:27.142482  3066 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:26.889750  1582 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:49296 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 560)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 817)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 830)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 559)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 573)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 570)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 564)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 576)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 568)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 845)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 838)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 842)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 843)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 539)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 544)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 546)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 549)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 806)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 810)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 812)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 813)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 815)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 816)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 819)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 820)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 827)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 832)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 834)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 562)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 563)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 567)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 839)
W20260709 12:57:27.036739  1610 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 543) took 1900 ms (client timeout 2212 ms). Trace:
I20260709 12:57:27.007179  1540 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
W20260709 12:57:27.143816  1610 rpcz_store.cc:269] 0709 12:57:25.135928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.035631 (+1899703us) service_pool.cc:224] Handling call
0709 12:57:27.036686 (+  1055us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.144554  1540 raft_consensus.cc:1240] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:27.143555  1542 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:57:27.046561  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:27.144531  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 57475.5us
I20260709 12:57:27.146585  1542 raft_consensus.cc:1240] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:27.147450  1583 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:27.147578  1534 raft_consensus.cc:1240] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:27.144768  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.047814  2944 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.001135  3024 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:27.044096  3007 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:27.048424  3014 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:27.049456  2550 consensus_queue.cc:1048] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:57:27.148985  3014 raft_consensus.cc:697] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:27.148506  1610 raft_consensus.cc:2393] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 3: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:27.149331  1581 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:27.049571  3006 consensus_queue.cc:1059] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:57:27.150142  2944 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:27.060559  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:27.150348  3014 consensus_queue.cc:237] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.151587  2944 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.152122  1534 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:27.026155  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:57:27.152884  1613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 554) took 1939 ms (client timeout 2092 ms). Trace:
W20260709 12:57:27.153227  1613 rpcz_store.cc:269] 0709 12:57:25.213368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.025820 (+1812452us) service_pool.cc:224] Handling call
0709 12:57:27.152828 (+127008us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:26.884778  2972 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.145638  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:27.155057  2299 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:27.061882  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:27.155933  1688 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:27.151577  1581 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:27.157464  3006 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:27.062150  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:27.052659  3030 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:26.997067  1655 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:27.161966  3033 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.053020  2924 raft_consensus.cc:740] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:27.063122  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:27.053275  2964 consensus_queue.cc:1059] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:57:27.162741  3007 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:27.163185  2964 consensus_queue.cc:1243] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:57:27.163774  2964 raft_consensus.cc:3055] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:27.053072  2542 raft_consensus.cc:740] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:27.164106  2964 raft_consensus.cc:740] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:27.053741  2779 consensus_queue.cc:1059] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:57:27.008167  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:27.164785  2542 consensus_queue.cc:260] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.165557  3014 raft_consensus.cc:3055] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:27.056582  1609 raft_consensus.cc:2393] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 4: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:27.050266  2817 consensus_queue.cc:1059] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:57:27.165977  3014 raft_consensus.cc:740] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:27.058125  1683 raft_consensus.cc:1275] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:57:27.163203  3007 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:27.057021  3027 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.166409  2817 consensus_queue.cc:1243] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:57:27.166862  3014 consensus_queue.cc:260] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.167407  3006 consensus_queue.cc:1059] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:27.052965  3022 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.008715  1617 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 3.
I20260709 12:57:27.040102  3029 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:27.042460  3028 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:27.052809  3031 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:26.999599  2893 raft_consensus.cc:740] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:57:27.052124  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:27.092867  2982 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:27.104806  1535 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.010948  2835 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.105760  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:27.010176  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:57:27.106815  1614 rpcz_store.cc:269] 0709 12:57:25.214135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.105415 (+1891280us) service_pool.cc:224] Handling call
0709 12:57:27.106428 (+  1013us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.045068  2991 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:27.070600  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:27.168744  3014 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.166080  1685 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:27.205732  1611 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 560) took 1502 ms (client timeout 1705 ms). Trace:
W20260709 12:57:27.206137  1611 rpcz_store.cc:269] 0709 12:57:25.703013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.105488 (+1402475us) service_pool.cc:224] Handling call
0709 12:57:27.205668 (+100180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1280}
I20260709 12:57:27.155509  2972 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:27.164934  2964 consensus_queue.cc:260] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.208086  1691 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:27.208765  2964 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:27.209573  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:57:27.209818  1617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 14) took 2159 ms (client timeout 2059 ms). Trace:
I20260709 12:57:27.135143  2826 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:27.135504  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:27.117144  1612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 569) took 1384 ms (client timeout 1622 ms). Trace:
W20260709 12:57:27.117513  1682 rpcz_store.cc:269] 0709 12:57:25.204140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:25.445355 (+241215us) service_pool.cc:224] Handling call
0709 12:57:26.996303 (+1550948us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400389354. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:26.996423 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2728482560}
I20260709 12:57:27.166759  1683 pending_rounds.cc:85] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 5
I20260709 12:57:27.117146  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:27.223560  1617 rpcz_store.cc:269] 0709 12:57:25.050353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.732671 (+1682318us) service_pool.cc:224] Handling call
0709 12:57:27.209755 (+477084us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:57:27.134734  2872 raft_consensus.cc:1068] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Unable to promote non-voter 1d6516ff61104bdda54bde95e92fe579: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:57:27.137049  1537 raft_consensus.cc:1240] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:27.209506  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:27.224804  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:57:27.137636  1608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 566) took 1433 ms (client timeout 1619 ms). Trace:
W20260709 12:57:27.137542  1616 rpcz_store.cc:269] 0709 12:57:25.215213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.027563 (+1812350us) service_pool.cc:224] Handling call
0709 12:57:27.028554 (+   991us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.136775  2989 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:27.149878  2550 consensus_queue.cc:1059] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:27.052992  3000 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:27.150113  1610 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 817) took 1844 ms (client timeout 2136 ms). Trace:
I20260709 12:57:27.225319  1684 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.152442  1542 raft_consensus.cc:1275] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:27.210255  1691 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.226379  3000 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:27.227790  2963 raft_consensus.cc:3055] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:27.227921  1687 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:57:27.228171  2963 raft_consensus.cc:740] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:57:27.226505  1608 rpcz_store.cc:269] 0709 12:57:25.704662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.030614 (+1325952us) service_pool.cc:224] Handling call
0709 12:57:27.137554 (+106940us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.228535  1687 pending_rounds.cc:85] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 3
I20260709 12:57:27.229533  1687 pending_rounds.cc:107] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:57:27.229805  1687 raft_consensus.cc:2889] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:57:27.167904  1609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 824) took 1693 ms (client timeout 1762 ms). Trace:
I20260709 12:57:27.168377  3027 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:27.052114  2899 raft_consensus.cc:740] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:27.229449  2963 consensus_queue.cc:260] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:27.226308  1610 rpcz_store.cc:269] 0709 12:57:25.305650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.144512 (+1838862us) service_pool.cc:224] Handling call
0709 12:57:27.150056 (+  5544us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.231182  2899 consensus_queue.cc:260] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.232128  2899 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.233484  3022 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:27.211524  2835 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:27.164119  3033 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:27.238619  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 90129.9us
I20260709 12:57:27.239658  1583 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:27.240137  2982 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.241324  1583 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:27.162182  3030 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:27.143576  1533 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:27.244751  3066 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:57:27.162638  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 165651us
I20260709 12:57:27.187424  1688 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
W20260709 12:57:27.222347  1612 rpcz_store.cc:269] 0709 12:57:25.732763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.040740 (+1307977us) service_pool.cc:224] Handling call
0709 12:57:27.117086 (+ 76346us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.245980  3066 consensus_queue.cc:1059] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:27.136567  1538 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
W20260709 12:57:27.222343  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:27.223114  2893 consensus_queue.cc:260] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.249003  2893 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.247057  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:27.249776  3000 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:27.250226  1688 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:27.251266  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:27.251977  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 835) took 1805 ms. Trace:
I20260709 12:57:27.095813  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:27.148962  3024 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.225133  2779 raft_consensus.cc:3055] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:27.225217  1689 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.252655  2779 raft_consensus.cc:740] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:27.253508  2779 consensus_queue.cc:260] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.254657  2779 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:27.254586  1683 pending_rounds.cc:107] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:57:27.255486  1683 raft_consensus.cc:2889] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:57:27.230405  1609 rpcz_store.cc:269] 0709 12:57:25.474073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:26.615787 (+1141714us) service_pool.cc:224] Handling call
0709 12:57:27.167824 (+552037us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.246424  1655 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:27.262055  1655 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:27.263019  2826 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:27.263449  2826 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:27.263849  2826 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.264286  2972 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:27.264703  2972 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:27.265035  2972 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.252368  1687 rpcz_store.cc:276] 0709 12:57:25.446976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:25.731315 (+284339us) service_pool.cc:224] Handling call
0709 12:57:25.731560 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:27.230223 (+1498663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:27.251737 (+ 21514us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b5400159854. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:27.251917 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3440768768}
I20260709 12:57:27.271437  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:27.272039  1687 raft_consensus.cc:2468] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:27.272888  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:27.273896  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:27.273646  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 113239us
I20260709 12:57:27.274611  1687 raft_consensus.cc:2393] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 2: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:27.274724  1581 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:27.275223  2826 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.275903  1581 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:27.260385  1689 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:27.277236  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:27.277904  1689 raft_consensus.cc:2393] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 4: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:27.163316  2924 consensus_queue.cc:260] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.205068  3007 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:27.223147  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 76684.2us
I20260709 12:57:27.278843  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:27.134289  1690 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:27.259904  2963 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:27.279189  2924 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:27.280197  1508 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:27.281730  2858 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:27.282141  2858 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:27.282603  2858 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.166082  2542 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.285284  3024 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:27.286018  3024 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:27.287699  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:27.222965  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:27.298400  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:27.252382  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:27.299799  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:27.209873  3031 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:27.292346  3071 log.cc:927] Time spent T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.127s	user 0.008s	sys 0.009s
I20260709 12:57:27.245036  2944 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:27.294095  2826 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:27.256575  2899 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:27.301751  1535 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:27.278652  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:27.302393  1541 raft_consensus.cc:606] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
W20260709 12:57:27.301846  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 60583.8us
I20260709 12:57:27.302883  1541 raft_consensus.cc:614] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:27.247464  3066 consensus_queue.cc:1243] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:57:27.303447  1583 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:57:27.296615  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 93218.3us
I20260709 12:57:27.300055  1688 raft_consensus.cc:2368] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 3. Current term is 4.
I20260709 12:57:27.301790  2899 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:27.312302  2899 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.292640  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:27.313094  1683 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:27.314960  1508 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:27.317406  2924 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:27.317929  2924 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:27.318081  2299 raft_consensus.cc:1275] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:57:27.318379  2924 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:27.319804  3027 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:27.304208  3066 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:27.320665  3066 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:27.321061  3066 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:27.321702  3027 consensus_queue.cc:1048] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:57:27.322642  2899 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:27.298393  3065 log.cc:927] Time spent T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:57:27.325116  2899 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:27.307956  3072 consensus_queue.cc:1048] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:57:27.327246  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:27.327884  1689 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:27.310570  3069 raft_consensus.cc:3055] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:27.329073  3069 raft_consensus.cc:740] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:27.329960  3069 consensus_queue.cc:260] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.332949  3069 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.336359  1691 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:27.260272  1684 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:27.340637  1689 raft_consensus.cc:1240] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:27.341285  1685 raft_consensus.cc:2410] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 12:57:27.325954  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:27.401794  1687 raft_consensus.cc:1240] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:27.403596  1687 raft_consensus.cc:1240] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:27.404837  1687 raft_consensus.cc:1240] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:27.406688  1687 raft_consensus.cc:1240] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:27.284389  2982 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:27.304831  1583 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:27.331894  1688 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: []
W20260709 12:57:27.409179  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 104422us
I20260709 12:57:27.409896  1583 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:27.294484  3007 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.409803  1688 raft_consensus.cc:1240] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:27.411180  1690 raft_consensus.cc:2393] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 5: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:27.411816  1688 raft_consensus.cc:1240] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:27.147163  1582 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:49296 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 830)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 559)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 573)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 570)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 564)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 576)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 568)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 845)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 838)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 852)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 842)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 853)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 848)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 851)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 849)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 847)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 846)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 850)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 843)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 854)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 855)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 539)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 544)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 546)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 549)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 806)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 810)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 812)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 813)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 815)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 816)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 819)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 820)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 827)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 832)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 834)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 562)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 563)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 567)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 839)
I20260709 12:57:27.413419  3069 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:27.344569  2972 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.413877  1688 raft_consensus.cc:1240] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:27.413945  3069 raft_consensus.cc:697] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:27.415274  2972 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:27.136972  2848 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.416055  3075 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:27.416863  3075 raft_consensus.cc:697] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:27.417209  1688 raft_consensus.cc:1240] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:27.417544  1686 raft_consensus.cc:2393] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 4: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:27.417769  1691 raft_consensus.cc:1275] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:57:27.296241  1615 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:27.428937  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:27.430569  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.431547  1611 raft_consensus.cc:2410] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:27.388530  3066 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.389511  2817 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:27.391723  1683 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
W20260709 12:57:27.431985  1611 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 821) took 1958 ms (client timeout 2358 ms). Trace:
I20260709 12:57:27.394510  1684 raft_consensus.cc:1240] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
W20260709 12:57:27.432466  1611 rpcz_store.cc:269] 0709 12:57:25.473129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.430261 (+1957132us) service_pool.cc:224] Handling call
0709 12:57:27.431925 (+  1664us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.433138  1683 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:27.434119  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.396533  1689 raft_consensus.cc:1240] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:27.431923  1687 raft_consensus.cc:1240] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:27.435001  1616 raft_consensus.cc:2410] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:27.435921  2982 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:27.397293  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:27.397465  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.436842  1614 raft_consensus.cc:2393] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 4: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:27.396072  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:27.437213  3066 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:27.437235  1614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 830) took 1961 ms (client timeout 2045 ms). Trace:
I20260709 12:57:27.399736  2924 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.410038  1685 raft_consensus.cc:1275] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:57:27.437841  1614 rpcz_store.cc:269] 0709 12:57:25.488578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.397248 (+1908670us) service_pool.cc:224] Handling call
0709 12:57:27.437181 (+ 39933us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.438138  2982 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:27.263347  1655 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:27.438959  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:27.439193  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 175917us
I20260709 12:57:27.439834  1614 raft_consensus.cc:2410] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:27.415153  3069 consensus_queue.cc:237] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.418779  2848 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:27.436157  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.418534  3075 consensus_queue.cc:237] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.423132  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:27.425149  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:27.426772  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:57:27.432641  1615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 808) took 2217 ms (client timeout 2076 ms). Trace:
W20260709 12:57:27.440270  1614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 825) took 1966 ms (client timeout 2570 ms). Trace:
W20260709 12:57:27.452811  1614 rpcz_store.cc:269] 0709 12:57:25.474345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.438715 (+1964370us) service_pool.cc:224] Handling call
0709 12:57:27.440209 (+  1494us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.453635  2301 raft_consensus.cc:1275] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:27.454018  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.454823  1614 raft_consensus.cc:2393] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 4: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:27.455235  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 575) took 1103 ms. Trace:
I20260709 12:57:27.456439  1682 raft_consensus.cc:2393] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 4: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 12:57:27.443226  1616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 811) took 2227 ms (client timeout 2705 ms). Trace:
I20260709 12:57:27.442236  2826 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:27.442516  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.457984  2826 raft_consensus.cc:697] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:27.458403  1617 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:27.458949  2826 consensus_queue.cc:237] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.440313  2982 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:27.459692  2924 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:27.444931  2835 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:57:27.441885  1655 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:27.428414  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:27.465655  1691 raft_consensus.cc:2393] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 3: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:27.466140  2515 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:27.466547  2515 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:27.466872  2515 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:27.429311  2858 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.468834  2858 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:27.420388  3007 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:27.469686  2648 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:27.470773  3007 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:27.455652  2848 consensus_queue.cc:1048] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:57:27.476045  2515 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:27.384699  1508 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
W20260709 12:57:27.525496  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:27.526288  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 141563us
I20260709 12:57:27.530611  1508 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:27.533864  1440 catalog_manager.cc:5697] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 2 to 4, term changed from 2 to 3, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to <none>, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:27.537206  1440 catalog_manager.cc:5697] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 3 to 5, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:27.542382  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:27.543702  1535 raft_consensus.cc:2410] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:27.539952  1440 catalog_manager.cc:5697] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 1 to 3, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:57:27.545862  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:27.549239  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:27.549472  1540 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:27.549743  1541 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:57:27.550345  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:27.350876  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 75053.8us
I20260709 12:57:27.552244  1581 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:27.553239  1539 raft_consensus.cc:1275] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:57:27.553678  1539 pending_rounds.cc:85] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 1
I20260709 12:57:27.553910  1539 pending_rounds.cc:107] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:57:27.554224  1539 raft_consensus.cc:2889] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:27.554557  1581 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:27.548903  1582 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:49296 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 576)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 568)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 845)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 838)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 852)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 842)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 853)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 848)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 851)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 859)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 849)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 863)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 864)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 847)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 846)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 850)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 843)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 861)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 854)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 855)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 860)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 857)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 858)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 865)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 862)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 539)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 544)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 546)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 549)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 806)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 810)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 812)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 813)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 815)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 816)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 819)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 820)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 827)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 832)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 834)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 562)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 563)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 567)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 839)
I20260709 12:57:27.559880  1581 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:27.419793  1583 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:57:27.564096  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 144247us
I20260709 12:57:27.568167  1437 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54606 (request call id 141) took 7091 ms. Trace:
I20260709 12:57:27.569278  1583 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:27.432698  1609 raft_consensus.cc:2410] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:57:27.431844  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:27.575675  1609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 558) took 1873 ms (client timeout 2122 ms). Trace:
W20260709 12:57:27.575906  1610 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 571) took 1838 ms (client timeout 2033 ms). Trace:
I20260709 12:57:27.576395  1583 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:57:27.437918  1612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 559) took 1735 ms (client timeout 1927 ms). Trace:
I20260709 12:57:27.577816  1613 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:27.455575  1614 rpcz_store.cc:276] 0709 12:57:26.351847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.453740 (+1101893us) service_pool.cc:224] Handling call
0709 12:57:27.455182 (+  1442us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.579305  1508 leader_election.cc:400] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 3. Current term is 4.
I20260709 12:57:27.579770  1508 leader_election.cc:403] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:57:27.457715  1616 rpcz_store.cc:269] 0709 12:57:25.215731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.433789 (+2218058us) service_pool.cc:224] Handling call
0709 12:57:27.435412 (+  1623us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:57:27.580435  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 45463.7us
W20260709 12:57:27.581494  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 151364us
I20260709 12:57:27.592901  2944 consensus_queue.cc:1059] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:27.593971  2944 consensus_queue.cc:1243] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:57:27.594659  2944 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:27.596772  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:27.581751  3031 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:27.597880  1539 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
W20260709 12:57:27.458905  1617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 570) took 1721 ms (client timeout 1913 ms). Trace:
I20260709 12:57:27.584719  3069 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:57:27.600292  1617 rpcz_store.cc:269] 0709 12:57:25.737334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.442179 (+1704845us) service_pool.cc:224] Handling call
0709 12:57:27.458854 (+ 16675us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:57:27.601272  1654 leader_election.cc:336] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 1.565s (SENT)
I20260709 12:57:27.437137  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.603049  1611 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:27.603417  1508 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:27.603571  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:27.581851  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:27.566165  1582 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:49296 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 576)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 568)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 845)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 838)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 852)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 842)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 853)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 848)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 851)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 859)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 849)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 863)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 864)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 847)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 846)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 850)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 843)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 861)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 867)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 854)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 855)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 860)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 857)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 858)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 868)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 865)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 862)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 539)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 544)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 546)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 549)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 806)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 807)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 810)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 812)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 813)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 815)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 816)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 819)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 820)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 827)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 832)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 834)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 562)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 563)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 567)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 839)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 869)
I20260709 12:57:27.588084  2872 raft_consensus.cc:2764] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:57:27.585677  2779 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:27.588861  2858 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:27.605942  2858 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:27.591619  2899 consensus_queue.cc:1059] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:27.596994  2964 raft_consensus.cc:3055] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:27.584235  2515 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:27.606971  2964 raft_consensus.cc:740] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:27.607944  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:27.590581  2893 consensus_queue.cc:1059] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:27.604892  3022 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:57:27.455996  1615 rpcz_store.cc:269] 0709 12:57:25.214948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.009944 (+1794996us) service_pool.cc:224] Handling call
0709 12:57:27.432446 (+422502us) spinlock_profiling.cc:243] Waited 84.7 ms on lock 0x7b54002a58d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:27.432581 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194717440}
I20260709 12:57:27.605826  2779 raft_consensus.cc:697] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:57:27.582945  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:27.587707  2817 consensus_queue.cc:1059] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:27.605829  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:27.601928  1654 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:27.607988  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:27.578300  1612 rpcz_store.cc:269] 0709 12:57:25.702735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.395787 (+1693052us) service_pool.cc:224] Handling call
0709 12:57:27.437859 (+ 42072us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.606397  2858 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:27.608444  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:27.620877  1539 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:27.621332  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:27.622220  1612 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:27.608326  2964 consensus_queue.cc:260] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.623847  2964 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.562741  1581 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:27.601821  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:57:27.578657  1613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 826) took 2104 ms (client timeout 2160 ms). Trace:
I20260709 12:57:27.616191  3022 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:27.580123  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:27.604772  1508 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:27.628192  1617 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:27.626708  1613 rpcz_store.cc:269] 0709 12:57:25.474608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.435856 (+1961248us) service_pool.cc:224] Handling call
0709 12:57:27.578565 (+142709us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.584947  2542 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:27.590605  3028 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.627271  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:27.654450  1541 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
W20260709 12:57:27.576175  1609 rpcz_store.cc:269] 0709 12:57:25.702430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.428604 (+1726174us) service_pool.cc:224] Handling call
0709 12:57:27.575431 (+146827us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.627386  3022 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:27.658195  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:27.568651  1437 rpcz_store.cc:276] 0709 12:57:20.487971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:20.492499 (+  4528us) service_pool.cc:224] Handling call
0709 12:57:27.567927 (+7075428us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:27.077772 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:27.078329 (+   557us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:27.078370 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:57:27.078387 (+    17us) tablet.cc:662] Decoding operations
0709 12:57:27.084033 (+  5646us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:27.084115 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:27.084149 (+    34us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:57:27.084692 (+   543us) tablet.cc:701] Row locks acquired
0709 12:57:27.084713 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:57:27.084863 (+   150us) write_op.cc:270] Start()
0709 12:57:27.084985 (+   122us) write_op.cc:276] Timestamp: P: 1783601847084818 usec, L: 0
0709 12:57:27.085009 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:57:27.085703 (+   694us) log.cc:844] Serialized 2481 byte log entry
0709 12:57:27.404273 (+318570us) op_driver.cc:464] REPLICATION: finished
0709 12:57:27.409504 (+  5231us) write_op.cc:301] APPLY: starting
0709 12:57:27.409582 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 12:57:27.409746 (+   164us) tablet.cc:1370] finished BulkCheckPresence
0709 12:57:27.409868 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:57:27.411464 (+  1596us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:57:27.411653 (+   189us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:57:27.411695 (+    42us) write_op.cc:312] APPLY: finished
0709 12:57:27.411941 (+   246us) log.cc:844] Serialized 52 byte log entry
0709 12:57:27.412115 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:27.412212 (+    97us) write_op.cc:454] Released schema lock
0709 12:57:27.412256 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:57:27.412969 (+   713us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:27.413004 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":31885,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":4990,"apply.run_cpu_time_us":2286,"apply.run_wall_time_us":3074,"num_ops":6,"prepare.queue_time_us":199447,"prepare.run_cpu_time_us":9348,"prepare.run_wall_time_us":156843,"raft.queue_time_us":78715,"raft.run_cpu_time_us":880,"raft.run_wall_time_us":7012,"replication_time_us":319123,"spinlock_wait_cycles":29952,"thread_start_us":391518,"threads_started":4,"wal-append.queue_time_us":147211}]]}
W20260709 12:57:27.576421  1610 rpcz_store.cc:269] 0709 12:57:25.737662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.431597 (+1693935us) service_pool.cc:224] Handling call
0709 12:57:27.575696 (+144099us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.653100  2899 consensus_queue.cc:1243] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:57:27.664335  1535 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.665438  2989 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:27.665851  2996 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 12:57:27.624553  1611 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 564) took 1912 ms (client timeout 2331 ms). Trace:
I20260709 12:57:27.661018  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:27.665855  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 61291.6us
I20260709 12:57:27.668438  2550 raft_consensus.cc:3055] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:57:27.670370  1638 debug-util.cc:398] Leaking SignalData structure 0x7b08001720a0 after lost signal to thread 434
I20260709 12:57:27.671445  1616 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:27.673694  2550 raft_consensus.cc:740] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:27.676131  3031 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:27.677402  2550 consensus_queue.cc:260] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:27.677951  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 101772us
I20260709 12:57:27.678234  3030 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:27.678962  3030 raft_consensus.cc:697] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:27.679059  2550 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.680384  3030 consensus_queue.cc:237] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.680882  2817 consensus_queue.cc:1059] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:27.682116  2817 raft_consensus.cc:3055] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:27.682483  2817 raft_consensus.cc:740] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:27.683499  2817 consensus_queue.cc:260] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.684877  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.686582  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.687425  1615 raft_consensus.cc:2393] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 4: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:27.670476  2893 consensus_queue.cc:1243] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:57:27.689220  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:27.690171  1688 raft_consensus.cc:2393] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 4: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:27.688839  2817 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:27.691576  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:27.688686  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:27.688395  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:27.693202  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:27.705876  1615 raft_consensus.cc:2393] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 4: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:27.706007  1682 raft_consensus.cc:2368] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4.
I20260709 12:57:27.693802  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:27.708612  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 146127us
W20260709 12:57:27.704622  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:27.692441  1691 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
W20260709 12:57:27.673926  1611 rpcz_store.cc:269] 0709 12:57:25.704087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.436855 (+1732768us) service_pool.cc:224] Handling call
0709 12:57:27.616412 (+179557us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.703558  2996 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.711591  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.712574  1611 raft_consensus.cc:2368] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3.
I20260709 12:57:27.712960  2996 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:27.713548  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.714531  1611 raft_consensus.cc:2368] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 3. Current term is 4.
I20260709 12:57:27.715694  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:27.717465  1686 raft_consensus.cc:1217] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Deduplicated request from leader. Original: 1.1->[2.2-3.3]   Dedup: 2.2->[3.3-3.3]
I20260709 12:57:27.718066  1686 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: [2.2-3.3]
I20260709 12:57:27.718428  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:27.718551  1685 raft_consensus.cc:1240] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:27.704007  2989 raft_consensus.cc:697] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:27.720623  2989 consensus_queue.cc:237] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.722297  1687 raft_consensus.cc:1240] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:27.723006  1614 raft_consensus.cc:2410] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:57:27.723445  1614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 831) took 2229 ms (client timeout 2652 ms). Trace:
I20260709 12:57:27.721060  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:27.724074  1583 leader_election.cc:400] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4.
I20260709 12:57:27.724545  1583 leader_election.cc:403] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:57:27.724669  1682 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:27.725747  1541 raft_consensus.cc:1240] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:27.726024  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:27.726378  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:27.727116  1537 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.729624  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:27.731061  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:27.732766  2996 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:27.733135  1536 raft_consensus.cc:2393] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 4: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:27.734210  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:27.735445  1533 raft_consensus.cc:1240] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:27.704886  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.729781  1542 raft_consensus.cc:1275] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:57:27.703338  1638 debug-util.cc:398] Leaking SignalData structure 0x7b08000c53e0 after lost signal to thread 1474
I20260709 12:57:27.732797  1541 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:27.728897  1535 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:27.731810  1617 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
W20260709 12:57:27.739018  1617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 568) took 2024 ms (client timeout 2575 ms). Trace:
W20260709 12:57:27.739530  1617 rpcz_store.cc:269] 0709 12:57:25.715095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.601422 (+1886327us) service_pool.cc:224] Handling call
0709 12:57:27.738963 (+137541us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.740653  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.741536  1617 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:27.742681  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.744091  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:27.744947  1617 raft_consensus.cc:2393] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 3: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:27.699723  3027 raft_consensus.cc:1064] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
W20260709 12:57:27.745633  3027 raft_consensus.cc:1068] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Unable to promote non-voter 1d6516ff61104bdda54bde95e92fe579: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:57:27.745869  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.730170  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:27.746694  1534 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.747128  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.749145  1539 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:27.749629  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.749191  1617 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:27.750614  1610 raft_consensus.cc:2393] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 4: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:27.751197  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:27.751617  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.752051  1617 raft_consensus.cc:2393] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 4: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:27.672397  3075 raft_consensus.cc:3055] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:27.752842  2515 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:27.752900  3075 raft_consensus.cc:740] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:27.753636  2996 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:27.754515  2899 raft_consensus.cc:3055] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:27.754900  3075 consensus_queue.cc:260] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.756047  2996 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:27.756088  3075 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:27.757436  3096 log.cc:927] Time spent T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 12:57:27.723803  1614 rpcz_store.cc:269] 0709 12:57:25.493714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.579450 (+2085736us) service_pool.cc:224] Handling call
0709 12:57:27.723393 (+143943us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.745034  1581 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:27.753201  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 152049us
W20260709 12:57:27.738962  1638 debug-util.cc:398] Leaking SignalData structure 0x7b08001f5120 after lost signal to thread 1566
I20260709 12:57:27.763711  1541 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:27.762979  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 576) took 1269 ms. Trace:
I20260709 12:57:27.764832  1616 rpcz_store.cc:276] 0709 12:57:26.405317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.581287 (+1175970us) service_pool.cc:224] Handling call
0709 12:57:27.674797 (+ 93510us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.740715  1608 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:27.766749  1537 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
W20260709 12:57:27.769490  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 45621.4us
W20260709 12:57:27.771365  1608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 573) took 1663 ms (client timeout 1530 ms). Trace:
I20260709 12:57:27.772969  2817 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:27.766301  1638 debug-util.cc:398] Leaking SignalData structure 0x7b0800339800 after lost signal to thread 1567
W20260709 12:57:27.771785  1608 rpcz_store.cc:269] 0709 12:57:26.104680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.397066 (+1292386us) service_pool.cc:224] Handling call
0709 12:57:27.768203 (+371137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.769743  1690 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:27.754928  2899 raft_consensus.cc:740] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:27.779839  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.782480  2899 consensus_queue.cc:260] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.785825  3014 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:27.789196  3033 consensus_queue.cc:1059] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:27.790220  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.791501  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:27.792081  1608 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:27.792203  1688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50688
I20260709 12:57:27.792994  1688 raft_consensus.cc:606] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Received request to transfer leadership
I20260709 12:57:27.789707  2899 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:27.795007  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:27.797425  1638 debug-util.cc:398] Leaking SignalData structure 0x7b0800265120 after lost signal to thread 1641
W20260709 12:57:27.799062  1638 debug-util.cc:398] Leaking SignalData structure 0x7b0800380ac0 after lost signal to thread 1715
I20260709 12:57:27.799207  1688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50688
W20260709 12:57:27.786149  1654 leader_election.cc:336] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 1.619s (SENT)
I20260709 12:57:27.800423  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:27.801119  1583 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:27.801246  1613 raft_consensus.cc:2376] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4. Re-sending same reply.
I20260709 12:57:27.801937  2779 consensus_queue.cc:237] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.802143  1583 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:27.803781  3014 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:27.804066  2893 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:27.804204  3014 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:27.804678  3014 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:27.804738  2893 raft_consensus.cc:697] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:27.800575  1654 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:27.806128  2826 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:27.805891  2893 consensus_queue.cc:237] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.809609  1688 raft_consensus.cc:606] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Received request to transfer leadership
W20260709 12:57:27.796305  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:27.810495  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:27.810042  1615 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:27.814205  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:27.815176  1614 raft_consensus.cc:2410] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:57:27.816001  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:57:27.799634  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 54758.2us
I20260709 12:57:27.817538  1614 raft_consensus.cc:2393] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 3: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:27.818387  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.819198  1614 raft_consensus.cc:2393] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 4: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:27.819047  1581 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:27.820084  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.821316  3033 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:27.822470  1614 raft_consensus.cc:2393] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 3: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:27.772028  1682 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:27.802402  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:27.828933  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:27.843659  1581 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:27.843822  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:27.845114  1613 raft_consensus.cc:2410] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:57:27.846375  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:27.795581  1534 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:27.847935  1616 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:27.852778  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:27.844573  2817 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4.
I20260709 12:57:27.858511  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.856372  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:27.832079  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.859464  1616 raft_consensus.cc:2410] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:27.858282  2826 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:57:27.869908  1655 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:27.871344  1655 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:27.871842  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:27.881772  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.882205  1581 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:27.882808  1615 raft_consensus.cc:2410] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:27.884131  1615 raft_consensus.cc:1240] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 1. Current term is 3. Ops: []
I20260709 12:57:27.888785  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 544) took 2750 ms. Trace:
I20260709 12:57:27.873958  3000 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:27.876534  2974 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:27.891556  2974 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:27.891970  2974 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:27.862604  3027 consensus_queue.cc:1059] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:57:27.893888  3027 raft_consensus.cc:3055] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:27.894268  3027 raft_consensus.cc:740] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:27.895277  3027 consensus_queue.cc:260] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.879294  1583 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:27.879462  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:57:27.880527  1638 debug-util.cc:398] Leaking SignalData structure 0x7b0800391980 after lost signal to thread 2327
I20260709 12:57:27.883877  3029 consensus_queue.cc:1059] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:27.884426  2872 consensus_queue.cc:1059] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:27.884655  2542 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:27.884930  2817 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:27.856024  2964 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:27.886696  2935 consensus_queue.cc:1059] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:27.887560  2925 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:27.873078  2515 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:27.872901  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.849614  3022 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:27.878715  3007 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:27.870146  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 539) took 2757 ms. Trace:
I20260709 12:57:27.896927  1615 rpcz_store.cc:276] 0709 12:57:25.138207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.883539 (+2745332us) service_pool.cc:224] Handling call
0709 12:57:27.883924 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:27.888496 (+  4572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:27.888700 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.898337  1608 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:27.900754  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.901141  1614 raft_consensus.cc:2393] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 4: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:27.911603  1617 raft_consensus.cc:2376] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4. Re-sending same reply.
I20260709 12:57:27.922927  1533 raft_consensus.cc:1275] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:27.916837  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:27.918618  1542 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:27.897032  3031 raft_consensus.cc:3055] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:27.921986  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:27.927713  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:27.924429  3031 raft_consensus.cc:740] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:27.911664  3027 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:27.912263  2893 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:27.935659  2972 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:27.937227  1608 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:27.938235  1617 raft_consensus.cc:1240] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4. Ops: []
W20260709 12:57:27.940821  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 69581.1us
I20260709 12:57:27.941691  1535 raft_consensus.cc:2393] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 6: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:27.922549  2964 raft_consensus.cc:697] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:27.956970  1688 raft_consensus.cc:2368] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 4. Current term is 5.
W20260709 12:57:27.950150  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 66302.3us
I20260709 12:57:27.950194  1690 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:27.921862  1612 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:27.908946  3014 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:27.962639  1614 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:27.963507  1655 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:27.964218  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 549) took 2774 ms. Trace:
I20260709 12:57:27.964548  1617 rpcz_store.cc:276] 0709 12:57:25.179283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.923154 (+2743871us) service_pool.cc:224] Handling call
0709 12:57:27.938043 (+ 14889us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:27.953036 (+ 14993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:27.953239 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.974391  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 538) took 2850 ms. Trace:
I20260709 12:57:28.021410  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 546) took 2805 ms. Trace:
W20260709 12:57:28.021701  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 81947.4us
I20260709 12:57:28.021883  1614 rpcz_store.cc:276] 0709 12:57:25.164604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.926266 (+2761662us) service_pool.cc:224] Handling call
0709 12:57:27.942465 (+ 16199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:27.963147 (+ 20682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:27.969600 (+  6453us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.974905  1616 rpcz_store.cc:276] 0709 12:57:25.112431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.902015 (+2789584us) service_pool.cc:224] Handling call
0709 12:57:27.936663 (+ 34648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:27.962897 (+ 26234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:27.962929 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:27.962973 (+    44us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:27.963001 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:27.963056 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:27.963177 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:57:28.026762  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 53625.4us
I20260709 12:57:28.030509  2817 consensus_queue.cc:1059] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:57:28.034003  2817 raft_consensus.cc:3055] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:28.034475  2817 raft_consensus.cc:740] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:28.035153  2964 consensus_queue.cc:237] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:28.035665  2817 consensus_queue.cc:260] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:28.036592  1438 catalog_manager.cc:5697] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index 4 to 2, term changed from 3 to 2, leader changed from <none> to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from VOTER to NON_VOTER. New cstate: current_term: 2 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:57:28.037654  2817 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:28.038579  1438 catalog_manager.cc:5697] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 1 to 2, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
W20260709 12:57:28.040621  1427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 117284us
I20260709 12:57:28.043112  1608 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 4. Ops: []
I20260709 12:57:28.043931  1613 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:28.044575  1655 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:28.043766  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 806) took 2829 ms. Trace:
I20260709 12:57:28.068796  1608 rpcz_store.cc:276] 0709 12:57:25.214417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.973936 (+2759519us) service_pool.cc:224] Handling call
0709 12:57:28.042911 (+ 68975us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:28.043511 (+   600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:28.043710 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:28.046476  1610 raft_consensus.cc:1240] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:28.048847  1581 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:28.049582  1614 raft_consensus.cc:1240] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:28.072119  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 807) took 2857 ms. Trace:
I20260709 12:57:28.072556  1614 rpcz_store.cc:276] 0709 12:57:25.214676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:28.026176 (+2811500us) service_pool.cc:224] Handling call
0709 12:57:28.049418 (+ 23242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:28.071846 (+ 22428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:28.072066 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:28.050740  2996 raft_consensus.cc:3055] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:28.024410  2893 raft_consensus.cc:697] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:57:28.055534  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:27.957444  3007 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:28.059235  3014 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:28.060631  3031 consensus_queue.cc:260] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:28.062240  1611 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:27.924119  1609 rpcz_store.cc:276] 0709 12:57:25.112679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.869054 (+2756375us) service_pool.cc:224] Handling call
0709 12:57:27.869498 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:27.869739 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:27.869779 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:27.869845 (+    66us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:27.869879 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:27.869942 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:27.870062 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:27.943185  2858 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:28.063993  1617 raft_consensus.cc:1240] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:28.065232  2515 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:28.086983  2515 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:28.087224  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 815) took 2814 ms. Trace:
I20260709 12:57:28.087353  2515 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:28.066215  2872 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:28.090902  1614 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 3. Current term is 4. Ops: []
W20260709 12:57:28.091387  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 68975.6us
I20260709 12:57:28.091683  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 819) took 2668 ms. Trace:
I20260709 12:57:28.092131  1614 rpcz_store.cc:276] 0709 12:57:25.423773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:28.073371 (+2649598us) service_pool.cc:224] Handling call
0709 12:57:28.074617 (+  1246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:28.091392 (+ 16775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:28.091618 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:28.067176  1508 leader_election.cc:400] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 4. Current term is 5.
I20260709 12:57:28.022688  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 845) took 1133 ms. Trace:
I20260709 12:57:28.040069  1438 catalog_manager.cc:5697] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:28.050885  1613 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:28.095431  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 813) took 2879 ms. Trace:
I20260709 12:57:28.095793  1613 rpcz_store.cc:276] 0709 12:57:25.216233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:28.049958 (+2833725us) service_pool.cc:224] Handling call
0709 12:57:28.050431 (+   473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:28.095111 (+ 44680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:28.095363 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:28.087587  1617 rpcz_store.cc:276] 0709 12:57:25.272443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:28.063195 (+2790752us) service_pool.cc:224] Handling call
0709 12:57:28.063704 (+   509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:28.086956 (+ 23252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:28.087158 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:57:28.089707  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:28.094748  1508 leader_election.cc:403] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:57:28.048300  2974 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:28.084048  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 812) took 2866 ms. Trace:
I20260709 12:57:28.102689  1438 catalog_manager.cc:5697] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 1 to 2, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:28.074918  2996 raft_consensus.cc:740] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:28.111202  1540 raft_consensus.cc:2393] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 5: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:28.099769  2899 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:28.111229  1616 raft_consensus.cc:1240] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:28.113519  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 810) took 2898 ms. Trace:
I20260709 12:57:28.113891  1616 rpcz_store.cc:276] 0709 12:57:25.215470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:28.029268 (+2813798us) service_pool.cc:224] Handling call
0709 12:57:28.101992 (+ 72724us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:28.113250 (+ 11258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:28.113460 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:28.115968  2893 consensus_queue.cc:237] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:28.117268  2835 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:28.117753  2835 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:28.118119  2835 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:28.120347  1609 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:57:28.120888  1617 raft_consensus.cc:1240] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:28.121116  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 834) took 2620 ms. Trace:
I20260709 12:57:28.121611  1609 rpcz_store.cc:276] 0709 12:57:25.500316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:28.101528 (+2601212us) service_pool.cc:224] Handling call
0709 12:57:28.119893 (+ 18365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:28.120827 (+   934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:28.121055 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:28.123436  2996 consensus_queue.cc:260] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:28.111405  3000 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:57:28.125137  2996 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:28.126047  3000 consensus_queue.cc:1059] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:28.126497  2858 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:28.127118  3105 consensus_queue.cc:1048] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
W20260709 12:57:28.128537  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 79835.8us
I20260709 12:57:28.132434  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 832) took 2636 ms. Trace:
I20260709 12:57:28.132897  1617 rpcz_store.cc:276] 0709 12:57:25.495905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:28.101039 (+2605134us) service_pool.cc:224] Handling call
0709 12:57:28.120626 (+ 19587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:28.132114 (+ 11488us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:28.132360 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:28.140373  1613 raft_consensus.cc:1240] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 3. Current term is 5. Ops: []
I20260709 12:57:28.141301  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 827) took 2666 ms. Trace:
I20260709 12:57:28.141739  1613 rpcz_store.cc:276] 0709 12:57:25.474875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:28.103890 (+2629015us) service_pool.cc:224] Handling call
0709 12:57:28.140163 (+ 36273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:28.141006 (+   843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:28.141227 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:28.072160  3110 consensus_queue.cc:1059] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:57:28.112067  1438 catalog_manager.cc:5697] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 1 to 3, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:28.099890  1610 rpcz_store.cc:276] 0709 12:57:25.215981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:28.045703 (+2829722us) service_pool.cc:224] Handling call
0709 12:57:28.046189 (+   486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:28.075423 (+ 29234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:28.082375 (+  6952us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:28.098764  1612 rpcz_store.cc:276] 0709 12:57:26.889445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.620873 (+731428us) service_pool.cc:224] Handling call
0709 12:57:27.969311 (+348438us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:28.160925  1614 raft_consensus.cc:1240] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:28.127861  3031 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:28.163229  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 820) took 2690 ms. Trace:
I20260709 12:57:28.164104  1614 rpcz_store.cc:276] 0709 12:57:25.472745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:28.101098 (+2628353us) service_pool.cc:224] Handling call
0709 12:57:28.129994 (+ 28896us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:28.162956 (+ 32962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:28.163164 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:28.167048  1613 raft_consensus.cc:1275] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:28.168104  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 839) took 1298 ms. Trace:
I20260709 12:57:28.168427  1613 rpcz_store.cc:276] 0709 12:57:26.869230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:28.157688 (+1288458us) service_pool.cc:224] Handling call
0709 12:57:28.166725 (+  9037us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:28.167447 (+   722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:28.168049 (+   602us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:28.168550  1616 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:28.171030  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 562) took 2467 ms. Trace:
I20260709 12:57:28.171379  1616 rpcz_store.cc:276] 0709 12:57:25.703580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:28.138010 (+2434430us) service_pool.cc:224] Handling call
0709 12:57:28.168365 (+ 30355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:28.170758 (+  2393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:28.170972 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:28.194814  3029 raft_consensus.cc:3055] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:28.195377  3029 raft_consensus.cc:740] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:28.207974  2982 raft_consensus.cc:3055] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:28.208586  2982 raft_consensus.cc:740] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:28.209743  2982 consensus_queue.cc:260] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:28.210705  3106 log.cc:927] Time spent T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:57:28.211220  2982 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:28.165405  3022 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:28.214352  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 849) took 1069 ms. Trace:
I20260709 12:57:28.214867  1611 rpcz_store.cc:276] 0709 12:57:27.144908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.715237 (+570329us) service_pool.cc:224] Handling call
0709 12:57:28.214133 (+498896us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b540032b254. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:28.214277 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":394447744}
I20260709 12:57:28.216758  2924 raft_consensus.cc:3055] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:28.217257  2924 raft_consensus.cc:740] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:28.218302  2924 consensus_queue.cc:260] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:28.219749  2924 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:28.229666  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:28.231329  2974 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:28.231623  1612 raft_consensus.cc:1275] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:57:28.232214  1612 pending_rounds.cc:85] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f: Aborting all ops after (but not including) 1
I20260709 12:57:28.232703  1612 pending_rounds.cc:107] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:57:28.233096  1612 raft_consensus.cc:2889] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:28.234110  1581 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:28.235847  1682 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:28.238386  1614 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:28.239316  1617 raft_consensus.cc:1275] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:28.240005  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 567) took 2531 ms. Trace:
I20260709 12:57:28.240337  1617 rpcz_store.cc:276] 0709 12:57:25.708954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:28.146822 (+2437868us) service_pool.cc:224] Handling call
0709 12:57:28.176720 (+ 29898us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:28.239745 (+ 63025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:28.239944 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:28.243353  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:28.244083  2989 raft_consensus.cc:3055] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:28.244351  3030 consensus_queue.cc:1048] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:28.244859  2899 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:28.245261  1688 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:28.245487  2899 raft_consensus.cc:697] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:28.246174  2989 raft_consensus.cc:740] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:28.246507  2899 consensus_queue.cc:237] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:28.248744  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 62776.2us
W20260709 12:57:28.249644  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:28.255303  1438 catalog_manager.cc:5697] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 1 to 3, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:28.196342  3029 consensus_queue.cc:260] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:28.263134  2835 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:28.264636  3029 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:28.269380  3028 consensus_meta.cc:287] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.000s
I20260709 12:57:28.174026  3110 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 4. Current term is 5.
I20260709 12:57:28.257292  1438 catalog_manager.cc:5697] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 1 to 2, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:28.280756  2972 consensus_queue.cc:1059] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:28.281765  2974 raft_consensus.cc:3055] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:28.282163  2974 raft_consensus.cc:740] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:28.284597  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:28.285480  1536 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:28.285948  1540 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:28.286849  2779 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:28.289002  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:28.289799  1535 raft_consensus.cc:2393] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 5: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:28.294565  1684 raft_consensus.cc:2393] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 5: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 12:57:28.300388  1505 leader_election.cc:336] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 1.569s (SENT)
W20260709 12:57:28.300768  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:28.305009  1536 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:28.307781  1688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50688
I20260709 12:57:28.308506  1688 raft_consensus.cc:606] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Received request to transfer leadership
I20260709 12:57:28.314030  1608 raft_consensus.cc:1240] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:28.247164  2989 consensus_queue.cc:260] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:28.320528  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 816) took 3021 ms. Trace:
I20260709 12:57:28.321378  2835 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:28.322008  3014 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.322589  3014 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:28.322890  3007 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:28.320921  1608 rpcz_store.cc:276] 0709 12:57:25.293288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:28.069614 (+2776326us) service_pool.cc:224] Handling call
0709 12:57:28.097887 (+ 28273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:28.313821 (+215934us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b5400436320. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85cfc8dc0 00007fc85d0531c0 00007fc85d054231 00007fc85d050d8f 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c
0709 12:57:28.314587 (+   766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:28.314826 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45999360}
W20260709 12:57:28.327520  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 48524us
I20260709 12:57:28.277729  3028 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 3. Current term is 4.
I20260709 12:57:28.351197  1655 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:28.353609  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 53271us
I20260709 12:57:28.277238  2893 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 12:57:28.364193  1438 catalog_manager.cc:5697] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:28.365803  1438 catalog_manager.cc:5697] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:28.367228  1438 catalog_manager.cc:5697] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:28.371654  2989 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:28.359388  2835 consensus_queue.cc:1048] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:57:28.388599  3014 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:28.392143  3115 log.cc:927] Time spent T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:57:28.393122  1536 raft_consensus.cc:1217] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[2.2-4.3]   Dedup: 4.3->[]
I20260709 12:57:28.416106  1538 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:28.393707  1655 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:28.394312  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:28.415418  1438 catalog_manager.cc:5697] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:28.401245  2515 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:28.416438  1536 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 4. Current term is 5. Ops: [2.2-4.3]
W20260709 12:57:28.364105  1505 leader_election.cc:336] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:49296 dropped due to backpressure: service queue is full with 50 items
I20260709 12:57:28.397359  2974 consensus_queue.cc:260] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:28.420107  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 59332.1us
I20260709 12:57:28.408761  2972 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:57:28.429847  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 362812us
I20260709 12:57:28.440317  2972 raft_consensus.cc:697] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:28.441488  2972 consensus_queue.cc:237] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:28.444936  2974 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:28.446995  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:28.447777  1539 raft_consensus.cc:2368] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4.
I20260709 12:57:28.447646  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:28.448712  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:57:28.448879  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 84820.6us
I20260709 12:57:28.449445  1539 raft_consensus.cc:2393] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 4: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:28.449555  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:28.450227  1533 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:57:28.432920  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:28.451316  1540 raft_consensus.cc:2393] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 4: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:28.432891  1655 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:28.453146  1655 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:28.453994  2982 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:28.454314  1655 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:28.454586  2982 raft_consensus.cc:697] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 5 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:28.455483  2991 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:28.456692  3119 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:28.457160  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:28.457304  3119 raft_consensus.cc:697] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:57:28.457870  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:28.457809  1534 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:28.434985  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:28.458288  3119 consensus_queue.cc:237] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:28.426515  2835 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:28.459442  2835 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:28.459794  2835 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:28.449926  1505 leader_election.cc:336] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:49296 dropped due to backpressure: service queue is full with 50 items
I20260709 12:57:28.455693  2982 consensus_queue.cc:237] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:28.466477  2515 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:28.463402  1438 catalog_manager.cc:5697] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:28.469345  1505 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:57:28.471067  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:28.477651  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:28.479720  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:28.502884  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:28.503461  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:28.473441  2924 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:28.473873  2991 raft_consensus.cc:697] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:57:28.515769  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:28.517905  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:57:28.520751  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 70896.6us
W20260709 12:57:28.522308  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:28.522848  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:28.524394  1608 raft_consensus.cc:1240] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4. Ops: []
W20260709 12:57:28.527956  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:28.528384  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:28.531155  1614 raft_consensus.cc:1275] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:28.539444  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:28.517335  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:28.519381  2893 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.545416  1617 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:57:28.545910  1617 pending_rounds.cc:85] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f: Aborting all ops after (but not including) 2
I20260709 12:57:28.546996  1617 pending_rounds.cc:107] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:57:28.547250  1617 raft_consensus.cc:2889] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:28.545938  1615 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:28.555408  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:28.565192  1533 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:28.563898  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:28.568506  1539 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:28.588723  3120 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.595260  1537 raft_consensus.cc:1240] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:57:28.638924  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 184715us
I20260709 12:57:28.540628  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 563) took 2820 ms. Trace:
W20260709 12:57:28.599515  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:28.599884  1608 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:28.600723  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 600) took 1004 ms. Trace:
I20260709 12:57:28.601258  1535 raft_consensus.cc:1240] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:57:28.603408  1542 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:57:28.607287  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:28.611852  2964 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.613621  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:28.614843  1581 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:28.545876  2826 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:28.563427  2893 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:28.656706  2515 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:28.567276  2924 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.627475  1541 raft_consensus.cc:1240] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:28.555224  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:28.626534  1540 pending_rounds.cc:85] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 1
I20260709 12:57:28.632381  1615 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:28.666297  1540 pending_rounds.cc:107] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:57:28.666628  1540 raft_consensus.cc:2889] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:28.668385  3120 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:28.671016  3120 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:28.666996  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:57:28.673267  3123 log.cc:927] Time spent T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.108s	user 0.000s	sys 0.002s
I20260709 12:57:28.565812  1505 leader_election.cc:400] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3.
I20260709 12:57:28.596290  1536 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:28.642149  1538 rpcz_store.cc:276] 0709 12:57:27.596062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:27.605507 (+  9445us) service_pool.cc:224] Handling call
0709 12:57:28.570407 (+964900us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b54000749d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:28.600566 (+ 30159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1692793728}
I20260709 12:57:28.646296  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:28.675845  1617 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:28.644402  1614 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 3.
I20260709 12:57:28.625366  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:28.677294  1533 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:28.662177  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:28.678536  1608 raft_consensus.cc:2376] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3. Re-sending same reply.
I20260709 12:57:28.680366  1505 leader_election.cc:403] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:57:28.681103  3120 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3.
I20260709 12:57:28.680832  2991 consensus_queue.cc:237] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:28.681443  1610 raft_consensus.cc:1275] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:57:28.682228  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 116598us
I20260709 12:57:28.683130  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:28.684006  1612 raft_consensus.cc:2393] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 4: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:28.685886  2964 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:28.677496  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:57:28.688162  2964 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:28.688653  2302 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:28.683154  1505 leader_election.cc:400] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 3. Current term is 4.
I20260709 12:57:28.693828  2899 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:28.698372  1613 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:57:28.707290  1613 pending_rounds.cc:85] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f: Aborting all ops after (but not including) 1
I20260709 12:57:28.707612  1613 pending_rounds.cc:107] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:57:28.707875  1613 raft_consensus.cc:2889] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:28.699239  1616 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:57:28.704403  1505 leader_election.cc:403] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:57:28.710075  1611 raft_consensus.cc:2410] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:57:28.710410  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:28.663795  3028 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.711381  3028 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:28.713606  3028 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:28.715838  1537 raft_consensus.cc:1275] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:57:28.717938  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 103175us
I20260709 12:57:28.717165  1612 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:28.727825  1539 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:28.698979  1534 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:28.644739  1609 rpcz_store.cc:276] 0709 12:57:25.703817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:28.122543 (+2418726us) service_pool.cc:224] Handling call
0709 12:57:28.122943 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:28.123306 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:57:28.163316 (+ 40010us) log.cc:844] Serialized 14 byte log entry
0709 12:57:28.477284 (+313968us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:28.502788 (+ 25504us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:28.508037 (+  5249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:28.518050 (+ 10013us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:28.523897 (+  5847us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2114,"prepare.queue_time_us":33685,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":1900,"raft.queue_time_us":6539,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":8684,"thread_start_us":278490,"threads_started":1,"wal-append.queue_time_us":364370}
I20260709 12:57:28.659777  2972 consensus_queue.cc:1048] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 12:57:28.721515  3028 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 3. Current term is 4.
I20260709 12:57:28.704355  2924 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:28.749156  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:28.756148  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:28.760416  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:28.761957  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:28.762735  1612 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
W20260709 12:57:28.765838  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 82830.8us
W20260709 12:57:28.770522  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:28.734113  2826 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:28.778339  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:28.779336  2848 raft_consensus.cc:993] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d: : Instructing follower dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
W20260709 12:57:28.779604  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:28.779827  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:28.780771  1611 raft_consensus.cc:2393] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 5: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:28.781216  1505 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:28.784804  1581 leader_election.cc:400] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4.
I20260709 12:57:28.789193  1581 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:28.801151  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:28.801962  1613 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:28.782733  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:28.827056  1581 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:28.835343  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:28.788126  3111 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:28.790124  3007 raft_consensus.cc:1081] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Signalling peer dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:57:28.836416  1613 raft_consensus.cc:2410] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:57:28.836923  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:28.828001  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 50572.4us
I20260709 12:57:28.844231  3116 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.797281  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:57:28.860059  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:28.835749  3033 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:28.829355  2964 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.840714  3111 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:28.859288  3031 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:28.868338  1612 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:28.876892  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:28.844937  2299 raft_consensus.cc:2955] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:28.868924  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:28.880630  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 53666.8us
I20260709 12:57:28.881378  1613 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:28.844916  3116 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:28.886051  1683 raft_consensus.cc:1275] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:28.876971  3111 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:28.890606  2996 raft_consensus.cc:1064] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:57:28.893174  2996 consensus_queue.cc:237] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:28.897099  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:28.898904  1505 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:28.906265  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:28.906445  2848 raft_consensus.cc:2955] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:28.908802  2302 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:28.909204  2301 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 5 LEARNER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:57:28.909546  3111 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:28.910778  2989 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:28.911644  3111 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:28.920145  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:28.920466  2996 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:28.921180  2996 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:28.922588  2893 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:28.923887  2996 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:28.927764  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:28.878016  2964 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:28.897851  3014 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:28.934391  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:28.901311  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:28.941882  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:28.943599  1613 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
W20260709 12:57:28.945573  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 46758.4us
I20260709 12:57:28.928978  2925 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:28.928416  1611 raft_consensus.cc:2376] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6. Re-sending same reply.
I20260709 12:57:28.960083  1505 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:28.951093  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:28.961261  1613 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:28.961180  1581 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:28.964217  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:28.969859  1581 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:28.965009  1616 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:28.964720  1610 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:28.974296  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:57:28.975646  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:28.964865  3075 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:57:28.978339  3075 consensus_queue.cc:1048] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:57:28.979144  2835 consensus_meta.cc:287] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.000s
I20260709 12:57:28.960021  2935 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:28.941458  3014 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:28.949676  2925 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:28.979529  2835 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:28.942713  3031 consensus_queue.cc:1059] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:57:28.958889  3033 consensus_queue.cc:1059] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
W20260709 12:57:28.993527  3140 log.cc:927] Time spent T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 12:57:28.993726  1654 leader_election.cc:336] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 1.530s (SENT)
I20260709 12:57:28.973055  2893 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:28.974220  2924 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:28.975419  2826 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:29.002094  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:28.998018  1505 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:29.004050  1616 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:28.984572  3075 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:29.006956  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.009127  3151 raft_consensus.cc:3055] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:29.010221  2835 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:29.013459  2964 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:29.015982  3138 log.cc:927] Time spent T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:57:28.988706  3120 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.017319  3116 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:28.997372  2935 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.001840  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:28.990259  2925 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:28.996621  2893 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:29.020767  3014 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.053066  1610 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
W20260709 12:57:29.054356  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 59387us
I20260709 12:57:29.055266  1505 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:29.055423  2899 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:29.026726  3151 raft_consensus.cc:740] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:29.060652  3116 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:29.039074  2964 raft_consensus.cc:3055] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:29.061764  2964 raft_consensus.cc:740] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:29.062505  2964 consensus_queue.cc:260] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.063922  2964 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:29.032856  1612 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:29.030581  1611 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
W20260709 12:57:29.025115  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 48645.2us
W20260709 12:57:29.027557  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:29.027660  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.068207  1688 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:57:29.035050  2924 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:29.005335  3029 consensus_queue.cc:1048] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:57:29.078374  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:29.052191  2935 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.052415  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:29.052600  2893 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:29.064292  3142 log.cc:927] Time spent T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:57:29.070480  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 100708us
I20260709 12:57:29.029742  3075 raft_consensus.cc:697] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:29.080070  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:29.080941  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:29.081544  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:29.029875  1609 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:29.089180  1687 raft_consensus.cc:2368] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 4. Current term is 5.
I20260709 12:57:29.092859  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:29.093571  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:29.095538  1614 raft_consensus.cc:2393] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 4: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:29.097749  1688 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
W20260709 12:57:29.102494  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:29.104035  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:29.109855  1683 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:29.111572  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:29.111652  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:29.115221  1505 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:29.117342  1615 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:29.123178  1539 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:29.124415  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:29.127664  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:29.127918  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:29.126223  1540 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:57:29.130100  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:29.131705  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:29.129678  1615 raft_consensus.cc:2376] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5. Re-sending same reply.
W20260709 12:57:29.132221  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:29.132791  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:29.133545  3111 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:29.116117  2924 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:29.134459  2924 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.133817  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:29.129815  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:29.130827  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.141181  1617 raft_consensus.cc:2393] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 4: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:29.142108  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:29.142795  1539 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:29.143369  1614 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:29.144304  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.144891  1614 raft_consensus.cc:2376] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4. Re-sending same reply.
I20260709 12:57:29.145867  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.125613  3155 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.139707  3111 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:29.146486  1614 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:29.119889  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:29.151263  1608 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:29.155604  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:29.156363  1534 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
W20260709 12:57:29.158371  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:29.159240  2989 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:29.160557  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.161379  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:29.162086  1610 raft_consensus.cc:2376] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4. Re-sending same reply.
I20260709 12:57:29.163039  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:29.163671  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:29.142534  3109 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:29.165733  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:29.165606  3109 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:29.168048  3109 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:29.088891  3151 consensus_queue.cc:260] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.168948  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:29.169224  3151 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:29.164291  1608 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.170125  1613 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:29.122934  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:29.171619  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.172353  1613 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:29.153004  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.173914  1614 raft_consensus.cc:2410] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:57:29.175264  1617 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:29.176803  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.176970  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.177515  1613 raft_consensus.cc:2376] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4. Re-sending same reply.
I20260709 12:57:29.179668  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:29.180449  1613 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:29.181066  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:29.183221  1614 raft_consensus.cc:2376] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3. Re-sending same reply.
I20260709 12:57:29.164250  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:29.119927  3014 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:57:29.190306  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.142134  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:29.192997  1508 leader_election.cc:400] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 4. Current term is 5.
I20260709 12:57:29.193745  1508 leader_election.cc:403] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:57:29.193619  1617 raft_consensus.cc:2376] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4. Re-sending same reply.
I20260709 12:57:29.195801  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:29.171725  3111 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.196903  1508 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:29.196899  1691 raft_consensus.cc:1240] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:29.197127  1614 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:57:29.198282  1654 leader_election.cc:336] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 1.681s (SENT)
I20260709 12:57:29.191843  2924 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.202324  1505 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:29.199808  1615 raft_consensus.cc:1275] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:29.199837  1617 raft_consensus.cc:2376] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4. Re-sending same reply.
I20260709 12:57:29.206964  1505 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:29.208755  3164 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:29.209286  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40880327f92147c1936b74eee0e6724d"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:57:29.209496  3164 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:29.199115  1609 raft_consensus.cc:2376] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3. Re-sending same reply.
I20260709 12:57:29.208200  1505 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:29.210718  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.211344  1609 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 5.
I20260709 12:57:29.191285  3120 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:29.212631  1505 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:29.212253  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.212903  1614 raft_consensus.cc:606] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:29.223591  1537 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:57:29.223951  1608 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:29.224841  2925 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.227370  1615 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:29.198836  2935 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:29.233062  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.146991  3155 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.177338  3075 consensus_queue.cc:237] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.216975  2924 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:29.235930  2925 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.237048  1608 raft_consensus.cc:1275] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:29.229614  1508 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:29.245239  1613 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:29.256338  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:29.257958  1608 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:57:29.258415  1608 pending_rounds.cc:85] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f: Aborting all ops after (but not including) 2
I20260709 12:57:29.258687  1608 pending_rounds.cc:107] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:57:29.258980  1608 raft_consensus.cc:2889] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:29.263322  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.263988  1614 raft_consensus.cc:2376] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3. Re-sending same reply.
I20260709 12:57:29.265432  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:29.266093  1614 raft_consensus.cc:2376] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4. Re-sending same reply.
I20260709 12:57:29.248821  2996 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:29.249212  2989 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:57:29.269418  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 71176.2us
I20260709 12:57:29.216010  3031 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
W20260709 12:57:29.270053  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 64825us
I20260709 12:57:29.218678  3014 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:57:29.279594  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.251333  1612 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:29.260026  3164 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:29.224340  2893 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.279198  1581 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:29.283465  1505 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:29.284569  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.285043  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.290118  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:29.290649  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.291973  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.292586  1614 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:29.283777  3164 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:29.295187  3164 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:29.271745  2989 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:29.296695  2989 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:29.297122  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:29.298107  1612 raft_consensus.cc:2410] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:57:29.291976  1609 raft_consensus.cc:1275] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:29.300405  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:29.300406  1615 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:29.303767  3155 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.290759  1608 raft_consensus.cc:2376] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5. Re-sending same reply.
W20260709 12:57:29.306059  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:29.309206  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:29.310043  1488 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:57:29.310490  1488 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for d127be99e2af41c0808e03480c1b64e3 already in progress
W20260709 12:57:29.310778  1488 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for d127be99e2af41c0808e03480c1b64e3 already in progress
I20260709 12:57:29.304883  3030 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:29.313819  1611 raft_consensus.cc:2393] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 4: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:29.317166  3111 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.320706  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:29.284732  1581 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:29.347707  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:29.348824  1613 raft_consensus.cc:2393] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 6: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:29.358750  2996 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:29.359936  1616 raft_consensus.cc:1240] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:29.358816  3111 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.356503  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:29.364068  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 94321.4us
I20260709 12:57:29.364909  1505 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:29.371706  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:29.372617  3120 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:29.373075  3120 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:29.373459  3120 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:29.372900  1610 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:29.379355  3155 consensus_queue.cc:1059] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:29.380627  3166 raft_consensus.cc:3055] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:29.381008  3166 raft_consensus.cc:740] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:29.381822  3166 consensus_queue.cc:260] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:29.384550  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 60862.8us
I20260709 12:57:29.389153  1687 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:29.372684  1684 raft_consensus.cc:2393] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 2: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 12:57:29.391284  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:29.392204  2893 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.394191  3014 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.394686  3014 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.397048  3014 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.399178  3158 raft_consensus.cc:993] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:57:29.398952  2989 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.399811  3158 raft_consensus.cc:1081] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:57:29.407577  2893 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:29.409297  2893 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:29.410216  2893 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:29.410686  1609 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:29.406154  3030 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:57:29.404834  3164 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.417305  2848 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:29.418392  1505 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:29.408697  3111 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.420272  2924 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:29.419993  3111 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.364334  2964 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.419281  2996 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:29.422072  2996 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:29.422817  3111 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.416663  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:29.419706  3166 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:29.425475  1440 catalog_manager.cc:5697] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:29.426569  2996 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:29.426723  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:29.362807  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.426878  1440 catalog_manager.cc:5697] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:57:29.428323  1440 catalog_manager.cc:5697] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 1 to 3, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:29.428853  1612 raft_consensus.cc:2368] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 4. Current term is 5.
I20260709 12:57:29.407984  2935 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 4. Current term is 5.
I20260709 12:57:29.424258  3120 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.432703  2848 consensus_queue.cc:1059] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:29.434427  3000 raft_consensus.cc:3055] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:29.434809  3000 raft_consensus.cc:740] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:29.435679  3000 consensus_queue.cc:260] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.441992  3164 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.425094  2964 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:29.447527  3120 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.448653  1505 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:29.451968  3111 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.452965  3111 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.451993  2996 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:29.460678  3111 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.462756  3000 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:29.413853  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 128862us
I20260709 12:57:29.462863  1505 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:29.468868  1690 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40880327f92147c1936b74eee0e6724d"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50708
I20260709 12:57:29.469816  1690 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:29.470352  1690 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:29.470666  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:29.476421  2996 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:29.477171  2996 raft_consensus.cc:697] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:29.478225  2996 consensus_queue.cc:237] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:29.484284  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:29.487345  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:29.483922  1581 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:29.494565  1581 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
W20260709 12:57:29.497570  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:29.500005  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:29.507748  1505 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:29.504029  1690 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.497682  2935 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.496842  2826 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.505435  3033 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:29.475754  2848 consensus_queue.cc:1048] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:57:29.511977  1438 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54582 (request call id 148) took 6518 ms. Trace:
I20260709 12:57:29.501910  3154 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:29.501868  2817 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.502110  3151 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:29.514082  3033 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:29.513789  2826 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.514422  1438 rpcz_store.cc:276] 0709 12:57:22.993682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:22.994002 (+   320us) service_pool.cc:224] Handling call
0709 12:57:29.511899 (+6517897us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:28.755863 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:28.756448 (+   585us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:28.756510 (+    62us) write_op.cc:435] Acquired schema lock
0709 12:57:28.756530 (+    20us) tablet.cc:662] Decoding operations
0709 12:57:28.757680 (+  1150us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:28.757745 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:28.757780 (+    35us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:57:28.758904 (+  1124us) tablet.cc:701] Row locks acquired
0709 12:57:28.758920 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:57:28.759096 (+   176us) write_op.cc:270] Start()
0709 12:57:28.759220 (+   124us) write_op.cc:276] Timestamp: P: 1783601848759036 usec, L: 0
0709 12:57:28.759239 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:57:28.759970 (+   731us) log.cc:844] Serialized 4862 byte log entry
0709 12:57:28.997230 (+237260us) op_driver.cc:464] REPLICATION: finished
0709 12:57:29.039212 (+ 41982us) spinlock_profiling.cc:243] Waited 6.14 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc859f470ac 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc860a87ef0
0709 12:57:29.182167 (+142955us) write_op.cc:301] APPLY: starting
0709 12:57:29.182246 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 12:57:29.182497 (+   251us) tablet.cc:1370] finished BulkCheckPresence
0709 12:57:29.182518 (+    21us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:57:29.206195 (+ 23677us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:57:29.206448 (+   253us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:57:29.206494 (+    46us) write_op.cc:312] APPLY: finished
0709 12:57:29.206786 (+   292us) log.cc:844] Serialized 88 byte log entry
0709 12:57:29.206954 (+   168us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:29.207082 (+   128us) write_op.cc:454] Released schema lock
0709 12:57:29.207129 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:57:29.207501 (+   372us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:29.207529 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7248,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":180504,"apply.run_cpu_time_us":3779,"apply.run_wall_time_us":25317,"num_ops":12,"prepare.queue_time_us":240965,"prepare.run_cpu_time_us":4443,"prepare.run_wall_time_us":4442,"replication_time_us":221573,"spinlock_wait_cycles":14130432,"thread_start_us":172069,"threads_started":2}]]}
I20260709 12:57:29.525282  1690 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:29.526539  1689 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:57:29.506245  2964 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:29.515110  3164 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:29.533339  1505 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:29.529139  3033 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.507062  3149 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
W20260709 12:57:29.544606  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:29.514012  2935 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.544297  2835 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:29.534391  3164 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:29.527186  2817 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.528561  3151 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.537993  3158 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.530285  3030 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:57:29.533743  2848 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:57:29.538951  2989 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.541953  2925 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:57:29.555557  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 47402.1us
I20260709 12:57:29.550509  3164 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.551988  3156 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.563525  2899 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.564069  2899 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.561034  1654 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:29.566231  2899 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.568784  1505 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:29.556161  3075 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.569693  3075 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.571916  3075 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.572016  2989 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:29.572531  3111 consensus_queue.cc:1059] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:29.573660  3111 raft_consensus.cc:3055] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:29.574045  3111 raft_consensus.cc:740] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:29.574780  1536 raft_consensus.cc:1275] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:29.575181  1542 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:57:29.575325  1539 raft_consensus.cc:1275] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:29.576037  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:29.576674  1541 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:29.573665  2266 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:29.577945  3136 raft_consensus.cc:2804] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:29.578199  3136 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:29.578444  2817 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.578508  3136 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:29.581687  3014 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.582278  3014 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.582769  3151 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.583354  3151 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.583765  3151 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.584313  3014 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.585053  3014 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:29.585686  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:29.585572  3014 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.586196  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:29.586966  1682 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:29.586337  1687 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:29.587626  3014 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.553200  3158 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.586966  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:29.588827  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:29.589392  1542 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:29.590293  1539 raft_consensus.cc:2410] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:57:29.574896  3111 consensus_queue.cc:260] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.586127  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:29.591512  1690 raft_consensus.cc:1275] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:29.593427  1583 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:29.596524  2848 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:29.549881  3132 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:57:29.597453  2848 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:29.554016  3155 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:57:29.600127  2935 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.601090  3111 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.602123  3158 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.602664  2893 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.603327  2826 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:29.592267  3156 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.605093  1536 raft_consensus.cc:1240] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:29.606042  3156 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.606809  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:29.607709  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:29.608302  2935 consensus_queue.cc:1059] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:29.603540  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:29.609355  2935 raft_consensus.cc:3055] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:29.609696  2935 raft_consensus.cc:740] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:29.610852  1616 raft_consensus.cc:1275] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:57:29.612372  1612 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:29.572438  2989 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:29.613505  2989 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.604080  2817 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:29.614821  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:29.603799  1689 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:29.617589  1583 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:29.626592  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:29.628419  3030 consensus_queue.cc:1048] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:29.628830  2893 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.631767  1581 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:29.632005  1609 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:29.633646  1440 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38804 (request call id 30) took 1429 ms. Trace:
I20260709 12:57:29.639014  3030 consensus_queue.cc:1059] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:29.640105  3156 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:29.640713  3156 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:29.641103  3156 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:29.647166  1539 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
W20260709 12:57:29.651237  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 56397.9us
I20260709 12:57:29.652984  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:29.634775  2817 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:29.636243  3158 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:57:29.655006  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:29.657204  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:29.664222  1533 raft_consensus.cc:2410] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:29.640081  3030 raft_consensus.cc:3055] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:29.653772  1538 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 1.
I20260709 12:57:29.653210  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:29.665585  1535 raft_consensus.cc:2393] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 2: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:29.659166  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:29.662432  1617 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:29.634176  1440 rpcz_store.cc:276] 0709 12:57:28.189494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:28.189659 (+   165us) service_pool.cc:224] Handling call
0709 12:57:29.618602 (+1428943us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:29.563761 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:29.564289 (+   528us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:29.564324 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:57:29.564341 (+    17us) tablet.cc:662] Decoding operations
0709 12:57:29.564897 (+   556us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:29.564972 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:29.564998 (+    26us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:57:29.565331 (+   333us) tablet.cc:701] Row locks acquired
0709 12:57:29.565349 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:57:29.565496 (+   147us) write_op.cc:270] Start()
0709 12:57:29.565613 (+   117us) write_op.cc:276] Timestamp: P: 1783601849565444 usec, L: 0
0709 12:57:29.565636 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:57:29.566248 (+   612us) log.cc:844] Serialized 1364 byte log entry
0709 12:57:29.568616 (+  2368us) op_driver.cc:464] REPLICATION: finished
0709 12:57:29.569101 (+   485us) write_op.cc:301] APPLY: starting
0709 12:57:29.569186 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:57:29.569323 (+   137us) tablet.cc:1370] finished BulkCheckPresence
0709 12:57:29.569412 (+    89us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:57:29.569823 (+   411us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:57:29.569984 (+   161us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:57:29.570030 (+    46us) write_op.cc:312] APPLY: finished
0709 12:57:29.570256 (+   226us) log.cc:844] Serialized 34 byte log entry
0709 12:57:29.570445 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:29.570540 (+    95us) write_op.cc:454] Released schema lock
0709 12:57:29.570585 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:57:29.570964 (+   379us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:29.570997 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":48181,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":249,"apply.run_cpu_time_us":1805,"apply.run_wall_time_us":1804,"num_ops":3,"prepare.queue_time_us":130934,"prepare.run_cpu_time_us":2789,"prepare.run_wall_time_us":2788,"replication_time_us":2809,"thread_start_us":104731,"threads_started":1}]]}
I20260709 12:57:29.666985  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:57:29.667970  1609 raft_consensus.cc:606] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:29.634056  3014 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:57:29.671752  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:29.672466  1539 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:29.651352  2893 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:29.663746  2817 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:29.660651  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:29.674839  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:29.665650  3158 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:29.666697  3030 raft_consensus.cc:740] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:29.688925  1538 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:29.677430  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:29.697168  1535 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:29.670219  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:29.707793  2924 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:29.695261  2817 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:29.706959  3120 consensus_queue.cc:1048] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:57:29.709069  3151 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.713382  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:29.698742  3164 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.713781  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:29.714263  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:29.716046  3164 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.695773  3158 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:29.692598  3175 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:57:29.720712  1539 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:29.677452  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:29.723666  3149 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:29.719436  1542 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:29.736152  1581 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:29.739190  1582 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:29.741161  2935 consensus_queue.cc:260] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.742285  2935 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:29.745451  3033 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.759140  1617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
W20260709 12:57:29.761220  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:29.760661  1617 raft_consensus.cc:606] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:29.763060  1617 raft_consensus.cc:614] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:29.764981  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:29.765964  1542 raft_consensus.cc:2410] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:57:29.720592  1534 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:29.770462  1535 raft_consensus.cc:1275] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:57:29.770495  1689 raft_consensus.cc:1275] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:29.695649  2893 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:29.770777  2924 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:29.777750  1687 raft_consensus.cc:1240] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
W20260709 12:57:29.781018  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:29.781405  1583 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:29.771449  1505 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:29.784965  2899 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:29.785437  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:29.785854  2817 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.786782  2924 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.787853  3155 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:29.788945  2924 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.789212  3014 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:29.789584  3014 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:29.789953  3014 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.790956  3075 consensus_queue.cc:1048] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:29.797253  3014 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.798804  3136 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:29.807564  3158 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.733454  2996 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:57:29.812788  2989 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:29.818892  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 82842.2us
I20260709 12:57:29.803890  3156 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.828272  1581 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:29.829718  1581 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:29.831323  1581 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:29.832670  1581 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
W20260709 12:57:29.824121  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 98888us
I20260709 12:57:29.821897  1437 catalog_manager.cc:5697] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index 2 to 4, term changed from 2 to 4, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to <none>, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 12:57:29.834367  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 62997us
I20260709 12:57:29.732659  3030 consensus_queue.cc:260] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.833820  3151 raft_consensus.cc:2804] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:29.841506  3151 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:29.841972  3151 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:29.842386  1654 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:29.837373  3166 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:29.843288  3166 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:29.843649  3166 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:29.843966  3166 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:29.844938  2817 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.845315  2848 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:29.834576  2924 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:29.845748  2848 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:29.834206  3075 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:29.846134  2848 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:29.838032  2964 consensus_queue.cc:1059] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:57:29.848757  1654 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:29.849490  2964 raft_consensus.cc:3055] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:29.849581  3149 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:29.849763  1505 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:29.850113  3149 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:29.850561  3149 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:29.848244  3030 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:29.851193  2989 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.833933  3155 consensus_queue.cc:1059] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:57:29.851475  1505 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:29.852442  3155 raft_consensus.cc:3055] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:29.852818  3155 raft_consensus.cc:740] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:29.852975  2935 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:29.853809  2935 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:29.853703  3155 consensus_queue.cc:260] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.855060  3155 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:29.849905  2964 raft_consensus.cc:740] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:29.857762  2964 consensus_queue.cc:260] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.858364  1684 raft_consensus.cc:1275] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:57:29.858665  1654 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:29.858978  2964 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:29.859525  3180 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:29.852917  1505 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:57:29.861822  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:29.840446  1437 catalog_manager.cc:5697] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 1 to 4, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 4 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:29.868896  1687 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:29.869247  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:29.869866  1684 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:29.870508  3149 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.871914  1654 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:29.885244  1437 catalog_manager.cc:5697] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 1 to 4, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:29.874267  1505 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:29.890399  1437 catalog_manager.cc:5697] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 1 to 3, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:29.891973  1437 catalog_manager.cc:5697] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:29.864967  2924 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:29.899475  1505 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:29.900588  2835 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.901129  2835 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.903198  2835 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:29.903867  3111 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:29.904326  3111 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:29.904724  3111 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:29.908429  2935 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:29.910813  1505 leader_election.cc:400] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 4. Current term is 5.
I20260709 12:57:29.913002  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.913746  1617 raft_consensus.cc:2393] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 6: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:29.872653  3154 consensus_queue.cc:1048] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:57:29.916795  3156 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.920748  1616 raft_consensus.cc:1275] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:57:29.923022  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:29.926399  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.927049  1616 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:29.928900  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.929701  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.932358  1615 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:29.931293  1610 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:57:29.934172  1616 raft_consensus.cc:2393] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 7: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:29.934845  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:29.938771  1611 raft_consensus.cc:2368] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 4. Current term is 5.
I20260709 12:57:29.937048  1615 raft_consensus.cc:1275] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:29.937793  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.939718  3164 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.940328  1610 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:29.940352  3164 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.942083  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.943194  3164 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.944183  3164 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:29.944912  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.944729  3164 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:29.944353  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:29.946280  1615 raft_consensus.cc:2393] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 2: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:29.947157  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.947981  3164 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:29.948796  1616 raft_consensus.cc:2393] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 4: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:29.950387  1534 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:57:29.969848  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:29.970009  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:29.971166  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:29.971701  1534 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.953457  1533 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:29.973315  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:29.973904  1533 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:29.974654  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:29.954279  1541 raft_consensus.cc:1240] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:29.955654  1540 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:29.957340  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:29.958467  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:29.976817  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:29.978570  1533 raft_consensus.cc:1240] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:57:29.962648  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:29.964082  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.983844  1614 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:29.984277  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.984712  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:29.985236  1614 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:29.985324  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:29.964776  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:29.977392  1539 raft_consensus.cc:2393] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 5: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:29.968169  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.977478  1541 raft_consensus.cc:2376] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4. Re-sending same reply.
I20260709 12:57:29.980901  1437 catalog_manager.cc:5697] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:29.982237  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.894986  3175 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:29.981691  1533 raft_consensus.cc:1240] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:29.976773  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:29.990003  1540 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:29.988269  1615 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:29.990655  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.991161  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:29.991274  1617 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:29.991957  1615 raft_consensus.cc:2393] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 5: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 12:57:29.993546  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 70373.2us
I20260709 12:57:29.994738  1542 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
W20260709 12:57:29.995342  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 162778us
I20260709 12:57:29.996711  1581 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:29.995899  1615 raft_consensus.cc:1240] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:29.997032  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:29.998858  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:30.001248  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:57:29.983728  3186 log.cc:927] Time spent T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:57:29.993909  1437 catalog_manager.cc:5697] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:30.000207  1541 raft_consensus.cc:2955] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:30.003345  1437 catalog_manager.cc:5697] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 2 to 4, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 4 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:29.997927  1581 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:30.005195  1437 catalog_manager.cc:5697] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 3 to 4, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 4 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:30.008611  1616 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:30.014797  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:30.015560  1616 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:30.009584  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:30.013172  1437 catalog_manager.cc:5697] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 3 to 4, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 4 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:30.002743  3156 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:30.020824  1655 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:30.022101  1437 catalog_manager.cc:5697] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 2 to 3, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:29.998610  3166 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:30.024298  1437 catalog_manager.cc:5697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } }
I20260709 12:57:30.025141  1654 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:30.019999  1581 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:30.026652  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:30.027413  1609 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:30.027415  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:30.016031  1611 raft_consensus.cc:2393] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 4: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:30.034467  1614 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:30.008433  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:30.026705  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:30.045523  1437 catalog_manager.cc:5697] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:30.047233  1437 catalog_manager.cc:5697] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 3 to 4, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 4 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:30.025511  3166 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:30.054881  1542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:51512
I20260709 12:57:30.089622  1505 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
W20260709 12:57:30.091028  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 71111.8us
I20260709 12:57:30.027655  3155 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:30.093175  1505 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:30.028503  3156 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:30.021250  3175 consensus_queue.cc:1059] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:57:30.008183  3151 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:30.099543  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:30.101253  1581 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:30.103107  1685 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:30.029400  2989 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.045312  3136 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:30.094961  3031 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:30.101279  1437 catalog_manager.cc:5697] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 2 to 3, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
W20260709 12:57:30.115908  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 90837.6us
W20260709 12:57:30.128608  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:30.143313  1437 catalog_manager.cc:5697] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 2 to 4, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 4 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:30.101267  3156 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:30.145231  1437 catalog_manager.cc:5697] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 1 to 4, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 4 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:30.100525  3158 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:30.106335  2893 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:30.103886  2925 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:30.155539  1437 catalog_manager.cc:5697] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 2 to 5, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 5 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:30.096623  3164 consensus_queue.cc:1048] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:57:30.104878  3132 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:30.185745  1654 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:30.133282  3175 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:30.173096  1437 catalog_manager.cc:5697] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 2 to 3, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:30.153285  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:30.146412  3149 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:30.119982  2899 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:30.153970  3120 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:30.153481  2299 raft_consensus.cc:1240] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:30.185477  1610 raft_consensus.cc:2393] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 2: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:30.196739  1437 catalog_manager.cc:5697] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:30.121309  2989 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:30.167922  3174 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.130107  3166 consensus_queue.cc:1048] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:57:30.202634  3033 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:30.205686  3149 raft_consensus.cc:3055] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:57:30.205989  3188 log.cc:927] Time spent T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:57:30.167505  3031 raft_consensus.cc:697] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:30.172190  2925 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:30.207737  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 64942.6us
I20260709 12:57:30.193583  3175 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:30.188273  3132 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:30.219120  1437 catalog_manager.cc:5697] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 3 to 4, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 4 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
W20260709 12:57:30.219332  3187 log.cc:927] Time spent T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:57:30.203982  3014 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:30.237488  1437 catalog_manager.cc:5697] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
W20260709 12:57:30.238978  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 53333us
I20260709 12:57:30.220022  3149 raft_consensus.cc:740] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:30.210321  2924 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:57:30.220659  3136 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:30.236445  2925 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:30.187840  3196 consensus_queue.cc:1059] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:57:30.239265  3175 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:30.238950  3132 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:30.279102  1437 catalog_manager.cc:5697] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 3 to 4, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 4 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
W20260709 12:57:30.293105  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 195759us
I20260709 12:57:30.236544  3174 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:30.312294  1505 leader_election.cc:400] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 4. Current term is 5.
I20260709 12:57:30.275596  3155 raft_consensus.cc:697] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:30.310534  1654 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:30.302289  1542 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:30.313131  1542 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:30.236858  2848 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:30.315659  1505 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:30.312876  1437 catalog_manager.cc:5697] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index 2 to 4, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:30.287745  3164 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:30.323093  1437 catalog_manager.cc:5697] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 1 to 3, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:30.322955  1540 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:30.325980  1437 catalog_manager.cc:5697] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:30.331593  1437 catalog_manager.cc:5697] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 2 to 5, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 5 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:30.333230  1505 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:30.335090  3155 consensus_queue.cc:237] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:30.330749  1542 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:30.318614  3151 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:30.356760  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:30.357491  1611 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:30.357899  3111 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:30.358780  1685 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:30.359032  1535 raft_consensus.cc:1240] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:30.342223  1654 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:30.360040  3111 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:30.341538  3192 log.cc:927] Time spent T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:57:30.340967  3193 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:30.361162  1654 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:30.328670  2826 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:30.331137  3164 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:30.334353  1534 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:30.344118  3197 raft_consensus.cc:3055] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:30.363907  3197 raft_consensus.cc:740] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:30.364571  3164 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:30.348656  3191 log.cc:927] Time spent T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
W20260709 12:57:30.365248  3030 consensus_meta.cc:287] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.000s
I20260709 12:57:30.364845  3197 consensus_queue.cc:260] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:30.285046  3031 consensus_queue.cc:237] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:30.363313  2835 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:30.358089  1612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
W20260709 12:57:30.342777  3195 log.cc:927] Time spent T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:57:30.386685  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:30.366024  1613 raft_consensus.cc:2410] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:57:30.354218  3201 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:30.368700  3175 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:30.362334  1654 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:30.351436  3120 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 12:57:30.370154  3194 log.cc:927] Time spent T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.061s	user 0.002s	sys 0.000s
I20260709 12:57:30.339524  3149 consensus_queue.cc:260] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:30.334187  3184 log.cc:927] Time spent T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260709 12:57:30.308430  3136 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:57:30.351395  3075 consensus_meta.cc:287] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.000s
W20260709 12:57:30.341403  3190 log.cc:927] Time spent T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:57:30.368500  2989 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:30.361768  3174 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:30.361681  3193 raft_consensus.cc:697] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:30.370638  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
W20260709 12:57:30.371685  1684 consensus_meta.cc:287] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.501s	user 0.005s	sys 0.002s
I20260709 12:57:30.367614  2848 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:30.382715  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:30.433265  1540 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:30.434167  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 404994us
I20260709 12:57:30.389623  2835 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:30.398087  3175 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:30.386472  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:30.342267  3200 consensus_queue.cc:1048] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:57:30.388335  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:30.367040  3180 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:30.436848  1535 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
W20260709 12:57:30.401553  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 68675.1us
I20260709 12:57:30.388901  1437 catalog_manager.cc:5697] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 1 to 2, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 2 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:30.439738  1505 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:30.404052  1542 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:30.406641  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:30.399921  3120 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:30.398342  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:30.385492  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:30.398186  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:30.444222  1538 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:30.440719  1541 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:30.442366  1540 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:30.432081  2996 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:30.422170  2893 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.421846  3164 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.448341  1437 catalog_manager.cc:5697] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 2 to 4, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 4 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:30.431632  1684 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:30.433410  3075 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:30.463714  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:30.459532  1541 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:30.479365  1655 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:30.444074  2301 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:30.443852  3149 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:30.490005  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 50337.3us
I20260709 12:57:30.491262  1505 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:30.445657  3111 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:30.495906  1536 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:30.496030  1655 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:30.496840  1537 raft_consensus.cc:1240] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:30.438004  1611 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 6.
I20260709 12:57:30.453747  1534 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:30.455014  2848 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:57:30.505807  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:30.445664  3201 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:30.505190  1542 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:30.506742  1505 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:30.516353  1505 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:30.511451  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:30.515110  1581 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:30.519568  1536 raft_consensus.cc:1275] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:30.518626  1581 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:30.527276  1581 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:30.476294  2893 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:30.476667  2925 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:30.529940  1581 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:30.507157  2924 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:30.489656  3175 consensus_queue.cc:1048] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:57:30.529856  1505 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:30.532334  3000 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.019s	sys 0.005s
I20260709 12:57:30.489936  3164 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:30.525094  3111 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:30.529345  3014 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:30.546852  1505 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:30.548048  1505 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:30.542246  1538 raft_consensus.cc:2410] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:30.543649  1608 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:30.548929  1505 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:30.533592  3174 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:30.503728  3132 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
W20260709 12:57:30.539613  3000 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.020s	sys 0.005s
I20260709 12:57:30.535818  3033 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:57:30.569087  1505 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:30.579128  1541 raft_consensus.cc:1275] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:57:30.572454  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 191490us
I20260709 12:57:30.532560  3206 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:57:30.580363  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:30.578696  1583 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:30.544764  1612 raft_consensus.cc:606] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:30.546238  3111 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:30.609206  3197 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:30.616756  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 120799us
I20260709 12:57:30.617916  1655 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:30.619366  3200 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:30.620232  3200 consensus_queue.cc:1059] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:57:30.624164  3200 raft_consensus.cc:3055] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:30.627722  3200 raft_consensus.cc:740] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:30.628702  3200 consensus_queue.cc:260] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:30.630165  3200 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:30.569525  3201 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:30.536557  3156 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:30.533720  3180 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:57:30.568634  2935 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:57:30.656529  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 87506us
I20260709 12:57:30.586084  3206 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:30.648823  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 70217.8us
I20260709 12:57:30.568038  2826 raft_consensus.cc:697] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 2 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:30.578536  2817 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.578225  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:57:30.578281  3014 raft_consensus.cc:697] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:30.642280  3174 raft_consensus.cc:697] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:30.572140  2989 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:30.659054  2835 raft_consensus.cc:697] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:30.642239  2924 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:30.571381  2266 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:30.706619  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:30.642467  1612 raft_consensus.cc:614] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:30.644745  3201 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:30.657614  3151 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:30.659865  3154 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.642130  3111 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:30.725842  3210 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:30.727187  3210 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:30.727629  3210 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:30.732076  3136 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:30.700788  2299 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:30.734481  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:30.726670  3154 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:30.708002  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 46339.7us
I20260709 12:57:30.535796  3193 consensus_queue.cc:237] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:30.669281  3206 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:30.650002  3000 consensus_queue.cc:1059] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:57:30.668409  3220 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:30.667832  2848 raft_consensus.cc:697] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:30.681710  3196 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:30.721167  3201 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:30.725785  2925 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:30.704135  2989 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:30.726591  3213 log.cc:927] Time spent T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:57:30.761408  1583 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:30.763904  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:30.764978  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:30.717942  3197 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:30.716395  3155 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.789358  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:57:30.770654  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 225699us
I20260709 12:57:30.789959  3155 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:30.790614  3151 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:30.791164  3151 raft_consensus.cc:697] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:30.792003  3155 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:30.780620  3204 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.725186  3209 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 12:57:30.693264  2817 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:30.793670  2267 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:30.794648  2817 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:30.792047  3151 consensus_queue.cc:237] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:30.765882  3109 raft_consensus.cc:2804] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:30.772760  2826 consensus_queue.cc:237] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:30.779237  3014 consensus_queue.cc:237] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:30.737351  3164 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:30.782150  3174 consensus_queue.cc:237] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:30.782801  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:30.796766  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:30.786120  2989 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:30.801873  2817 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:30.802743  3196 raft_consensus.cc:697] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:30.806281  3109 raft_consensus.cc:697] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 6 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
W20260709 12:57:30.821499  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 422254us
I20260709 12:57:30.822342  1654 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:30.809490  2899 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.811484  3197 raft_consensus.cc:697] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 5 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:30.813185  3166 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.792827  3204 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:30.836117  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:30.836438  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:30.837694  1540 raft_consensus.cc:2393] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 5: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:30.838142  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:30.838685  1539 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:30.837738  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:30.839558  1541 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:30.840116  3226 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:57:30.844841  1655 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.787s (SENT) [suppressed 75 similar messages]
I20260709 12:57:30.824836  2848 consensus_queue.cc:237] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:30.848348  3166 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:30.844908  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:30.849920  2299 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:30.850646  3166 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:30.853869  1654 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:30.856714  3226 raft_consensus.cc:697] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:30.851445  3197 consensus_queue.cc:237] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:30.858214  3232 log.cc:927] Time spent T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:57:30.857824  3226 consensus_queue.cc:237] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:30.851784  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:30.804428  2835 consensus_queue.cc:237] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:30.860605  3175 consensus_queue.cc:1048] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:30.849990  1612 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 5.
I20260709 12:57:30.860675  2996 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:30.861792  3109 consensus_queue.cc:237] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:30.866573  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:30.867347  1539 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:30.870738  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:30.870522  3196 consensus_queue.cc:237] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:30.871378  1684 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:30.827943  3132 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:30.887105  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 228977us
I20260709 12:57:30.887820  1505 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:30.881184  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:30.890578  1654 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:30.820784  2817 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:30.888906  1689 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:30.828557  2899 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:30.898780  1583 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:30.868466  1534 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:30.889766  3175 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:30.890025  3149 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:30.933542  1654 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:30.907212  3000 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:30.909925  3031 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:30.935235  2301 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:30.944087  3219 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:30.944952  3136 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:30.874948  3210 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:30.919590  3164 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:57:30.963515  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 61233.9us
I20260709 12:57:30.894472  3220 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:57:30.981379  1608 raft_consensus.cc:1275] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:30.980427  1617 raft_consensus.cc:1240] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:57:30.987246  3166 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:30.987810  3166 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:30.990125  3166 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:30.991115  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:30.991765  1617 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:30.939878  2835 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:30.998191  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:31.002103  1614 raft_consensus.cc:2393] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 5: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:30.999394  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:31.004145  1608 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:30.933604  3149 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:31.012375  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:30.934053  3175 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:31.007161  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 47995.8us
I20260709 12:57:30.942380  3132 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 12:57:31.025254  1617 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:31.009356  1539 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:57:30.983235  3164 raft_consensus.cc:697] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:31.021624  1654 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:31.022172  1505 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:31.024457  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:31.074648  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 655) took 1069 ms. Trace:
I20260709 12:57:31.005406  1682 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
W20260709 12:57:31.076593  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:31.018832  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:31.078045  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:57:31.083492  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 61402.6us
I20260709 12:57:31.018523  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:31.085676  1538 raft_consensus.cc:2376] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4. Re-sending same reply.
W20260709 12:57:31.086474  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 64922.8us
I20260709 12:57:31.020051  2924 raft_consensus.cc:697] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:31.077325  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:31.069041  2935 raft_consensus.cc:697] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:31.081422  1537 rpcz_store.cc:276] 0709 12:57:30.005698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:30.500447 (+494749us) service_pool.cc:224] Handling call
0709 12:57:30.509612 (+  9165us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:30.509803 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:57:30.530444 (+ 20641us) log.cc:844] Serialized 14 byte log entry
0709 12:57:30.902378 (+371934us) log.cc:844] Serialized 14 byte log entry
0709 12:57:31.026765 (+124387us) log.cc:844] Serialized 14 byte log entry
0709 12:57:31.073161 (+ 46396us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:31.073227 (+    66us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:31.074375 (+  1148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:31.074455 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:31.074587 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":299781,"prepare.queue_time_us":25197,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":7650,"raft.queue_time_us":324238,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":26989,"spinlock_wait_cycles":39834496,"thread_start_us":249549,"threads_started":2,"wal-append.queue_time_us":196476}
I20260709 12:57:31.095170  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:31.091476  1682 pending_rounds.cc:85] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 2
W20260709 12:57:31.099507  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:31.098316  1505 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:31.123046  3247 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:31.123564  3247 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:31.123925  3247 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:31.026738  2989 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:31.107764  1682 pending_rounds.cc:107] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:57:31.147364  3210 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:31.147727  3215 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:31.101344  1611 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:31.109354  3193 consensus_queue.cc:1059] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 12:57:31.150022  1682 raft_consensus.cc:2889] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:31.096165  3216 consensus_queue.cc:1048] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:57:31.126768  2835 consensus_queue.cc:1048] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:57:31.178310  3206 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:31.144359  3166 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.151847  2817 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:31.127315  3204 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:31.155820  3120 consensus_meta.cc:287] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.692s	user 0.009s	sys 0.003s
I20260709 12:57:31.196043  3246 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:31.195765  3235 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 12:57:31.155376  3215 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:31.201020  2899 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:31.204630  3243 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:31.180923  3166 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:31.210155  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 107816us
W20260709 12:57:31.212793  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 119344us
I20260709 12:57:31.206817  3215 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:31.204376  3245 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.208060  3204 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.202538  3120 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:31.220837  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 316870us
I20260709 12:57:31.206112  3246 raft_consensus.cc:697] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:31.216887  3206 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:31.250847  1583 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:31.200609  2924 consensus_queue.cc:237] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:31.193011  3164 consensus_queue.cc:237] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:31.256803  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:31.257668  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:31.258050  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:31.258512  1614 raft_consensus.cc:2410] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:57:31.258991  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:31.259546  1617 raft_consensus.cc:2410] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:57:31.217638  3111 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:31.205221  3243 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:31.267098  3149 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:31.227139  3204 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:31.209312  2935 consensus_queue.cc:237] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:31.268977  3252 log.cc:927] Time spent T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:57:31.268334  3246 consensus_queue.cc:237] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:31.269582  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:31.268163  2899 raft_consensus.cc:993] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:57:31.273316  1583 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:31.283530  1617 raft_consensus.cc:1240] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:57:31.283367  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:31.255455  3175 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:31.300040  3203 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.256822  3031 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:31.313462  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:31.229100  3201 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:31.328173  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:31.329875  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:31.331276  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:31.332034  1617 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:31.333277  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:31.336627  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:31.337477  1690 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:31.334852  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:57:31.360432  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 87188.9us
I20260709 12:57:31.360821  1533 raft_consensus.cc:1240] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:31.229897  3245 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:31.361317  1583 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:31.371878  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:31.373026  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:31.337796  2899 raft_consensus.cc:1081] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:57:31.320721  3149 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:31.375154  1536 raft_consensus.cc:2393] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 6: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:31.376340  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:31.383390  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:57:31.381187  3241 log.cc:927] Time spent T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.210s	user 0.000s	sys 0.002s
I20260709 12:57:31.364907  1611 raft_consensus.cc:2393] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 2: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:31.397478  1608 raft_consensus.cc:2376] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6. Re-sending same reply.
I20260709 12:57:31.397666  1689 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:31.385221  3206 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.389714  3185 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.343114  2826 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:31.407223  1690 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:31.399706  1617 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:31.372186  3075 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:31.369808  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:31.411516  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:31.412218  1617 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:31.406100  1691 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:31.409548  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:31.381880  2989 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:31.393759  3031 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:31.416966  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:31.400866  3204 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:31.326188  3203 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:31.411521  3075 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:31.421291  1617 raft_consensus.cc:1240] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:31.422389  3260 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:31.423396  3258 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:57:31.429759  3245 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:31.457599  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:31.466082  1690 raft_consensus.cc:2393] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 6: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:31.396817  3149 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:31.415727  3031 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:31.458498  1655 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:31.463581  1617 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:57:31.408272  3206 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:31.467080  1686 raft_consensus.cc:1275] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:31.419229  3166 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:31.430902  3204 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.459273  3075 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:31.415982  2826 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:31.492540  1616 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:31.467145  3031 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:31.467736  3120 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:31.487097  3204 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:31.485877  3132 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:31.413793  3185 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:31.502563  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:31.496714  1611 raft_consensus.cc:1240] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:57:31.504325  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:31.513622  3265 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:31.514266  3265 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:31.515465  3203 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:31.520946  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:31.520836  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:31.469344  3260 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:31.521373  3265 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:31.502242  3243 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:31.525066  3259 log.cc:927] Time spent T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.157s	user 0.000s	sys 0.002s
I20260709 12:57:31.524256  1611 raft_consensus.cc:1240] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:31.529616  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:31.513808  3204 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:31.532987  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:31.532835  1541 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:31.533708  1684 raft_consensus.cc:3055] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:31.507680  3132 raft_consensus.cc:697] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 2 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:31.524922  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:31.536190  1687 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:31.534266  1684 raft_consensus.cc:740] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:31.536607  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:31.537250  1539 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:31.533875  1505 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:31.542474  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:31.544235  1538 raft_consensus.cc:1275] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:31.537312  1684 consensus_queue.cc:260] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:31.549546  3132 consensus_queue.cc:237] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:31.552743  1534 raft_consensus.cc:1240] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:57:31.553040  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:31.553723  3075 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:31.408846  2924 raft_consensus.cc:2955] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index 2 to 5, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:31.555303  3154 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:31.555743  3075 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:31.559250  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:31.542562  1617 raft_consensus.cc:2955] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:31.558102  3185 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:57:31.564723  3250 log.cc:927] Time spent T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
I20260709 12:57:31.544663  3243 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:31.572108  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:31.575158  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:31.575904  1538 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:31.567605  3243 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:31.579257  3243 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:31.582335  3260 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:31.586128  3228 consensus_queue.cc:1059] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.087s
I20260709 12:57:31.587076  3175 raft_consensus.cc:3055] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:31.587491  3175 raft_consensus.cc:740] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:31.589313  2893 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:31.591394  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:31.595355  2301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32802 (request call id 44) took 1225 ms. Trace:
I20260709 12:57:31.633525  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:31.603622  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:31.637346  1613 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:31.647197  2298 raft_consensus.cc:1240] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:31.648821  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:31.649559  1609 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:31.650528  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:31.651091  1609 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:31.652583  3200 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.653126  3200 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:31.655601  3200 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:31.658608  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:31.659339  2302 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:31.661734  3206 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:31.664402  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:31.665663  1505 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:31.666285  3149 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:31.667968  3215 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:31.670116  3215 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:31.671695  3031 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:31.673892  3031 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:31.674971  2826 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:31.573746  3265 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:31.676507  3265 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:31.677740  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:31.678403  1616 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:31.685142  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:31.685915  1534 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:31.686828  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:31.687474  1538 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:31.688340  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:31.693289  1539 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 4: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:31.695125  1687 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:31.694217  1536 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:57:31.600091  3239 log.cc:927] Time spent T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.521s	user 0.002s	sys 0.000s
I20260709 12:57:31.699105  1541 raft_consensus.cc:1275] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 12:57:31.700825  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:31.734331  1538 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:31.701103  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:31.733909  1541 pending_rounds.cc:85] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 1
I20260709 12:57:31.735989  1541 pending_rounds.cc:107] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:57:31.736276  1541 raft_consensus.cc:2889] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:31.702732  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:31.738345  1536 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:31.710333  1581 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:31.741120  1581 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:31.732105  1535 raft_consensus.cc:1275] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 12:57:31.709610  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:31.743767  1540 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:31.727336  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:31.746682  1542 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:31.755421  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:31.702450  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:31.756903  1539 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:31.596436  2301 rpcz_store.cc:276] 0709 12:57:30.370132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:30.370313 (+   181us) service_pool.cc:224] Handling call
0709 12:57:31.595153 (+1224840us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b540063e554. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:31.595275 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10335488}
I20260709 12:57:31.769389  3155 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:31.769946  3155 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:31.770287  3155 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:31.712134  3264 log.cc:927] Time spent T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.226s	user 0.000s	sys 0.002s
W20260709 12:57:31.710589  3253 log.cc:927] Time spent T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.440s	user 0.000s	sys 0.002s
I20260709 12:57:31.774219  1581 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:31.774271  3014 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:31.781852  3014 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:31.782256  3014 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:31.699131  3243 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:31.785439  3151 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:31.785687  3243 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:31.786058  3151 raft_consensus.cc:697] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:31.787607  3151 consensus_queue.cc:237] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:31.788399  3156 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:31.696897  1611 raft_consensus.cc:2368] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 5. Current term is 6.
I20260709 12:57:31.699508  3225 raft_consensus.cc:3055] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:31.790097  3225 raft_consensus.cc:740] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:31.790654  1581 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:31.714825  3262 log.cc:927] Time spent T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.295s	user 0.000s	sys 0.000s
I20260709 12:57:31.792014  3111 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:31.794036  1581 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:31.812194  3156 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:31.813253  3156 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:31.813616  3156 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:31.817353  3261 log.cc:927] Time spent T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.350s	user 0.002s	sys 0.000s
I20260709 12:57:31.819201  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:31.820083  1533 raft_consensus.cc:2410] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:31.820710  3185 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:31.821133  3185 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:31.821455  3185 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:31.822180  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:31.822739  1612 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:31.823915  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:31.824591  1537 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:31.678515  3265 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:31.704500  3247 consensus_meta.cc:287] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.003s
I20260709 12:57:31.823200  3154 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:57:31.704552  3200 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:31.842535  3200 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:31.842989  3200 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:57:31.843312  3254 log.cc:927] Time spent T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.574s	user 0.002s	sys 0.000s
I20260709 12:57:31.846285  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:31.790967  3225 consensus_queue.cc:260] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:31.847560  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:31.849169  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:31.849748  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:31.850797  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:31.851184  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:31.851444  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:31.851854  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:31.852003  1682 raft_consensus.cc:2376] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2. Re-sending same reply.
I20260709 12:57:31.852408  1686 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:31.853066  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:31.853222  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:31.853751  1690 raft_consensus.cc:2393] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 5: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:31.695243  3206 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:31.838515  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:31.857488  1533 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:31.860111  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:31.861536  3225 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:31.862880  1533 raft_consensus.cc:1275] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:57:31.853803  1682 raft_consensus.cc:2376] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5. Re-sending same reply.
I20260709 12:57:31.855581  1505 leader_election.cc:400] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 5. Current term is 6.
I20260709 12:57:31.855908  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:31.871628  1689 raft_consensus.cc:2376] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2. Re-sending same reply.
I20260709 12:57:31.857091  3206 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:31.857126  1687 raft_consensus.cc:1240] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:31.863569  3247 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:31.878053  3206 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:31.878799  3247 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:31.837368  3256 log.cc:927] Time spent T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.569s	user 0.002s	sys 0.002s
I20260709 12:57:31.864311  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:31.865352  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:31.871106  1505 leader_election.cc:403] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:57:31.841584  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:31.873770  3201 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:31.875113  3156 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:31.875984  3260 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:31.911190  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:31.912948  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 57519.3us
I20260709 12:57:31.848202  1611 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:31.898988  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:31.901912  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:31.884075  1613 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:31.904737  1540 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
W20260709 12:57:31.905236  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 165514us
I20260709 12:57:31.905405  1617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:57:31.920768  1617 raft_consensus.cc:606] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:31.921178  1617 raft_consensus.cc:614] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:31.922273  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:31.922369  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:31.906018  1538 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:31.923215  1617 raft_consensus.cc:2368] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5.
I20260709 12:57:31.926185  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:31.926672  1505 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:31.926904  1617 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:31.907078  2298 raft_consensus.cc:1240] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:31.907650  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:31.905308  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:57:31.909622  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 45581.5us
I20260709 12:57:31.910316  1684 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:31.910686  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:31.911432  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:31.914142  1581 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:31.906729  1616 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:31.934845  1581 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:31.935038  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:31.936003  1616 raft_consensus.cc:2393] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 3: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:31.937434  1609 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:31.937768  1616 raft_consensus.cc:1240] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:57:31.939307  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:31.941843  1505 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:31.943822  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:31.928761  1583 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.046s	sys 0.058s
I20260709 12:57:31.929252  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:31.930001  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:31.944777  1583 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.046s	sys 0.058s
I20260709 12:57:31.946182  1612 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:31.948414  1505 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:31.948948  1686 raft_consensus.cc:2393] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 5: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:31.923260  1691 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:31.953922  1505 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:31.956578  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:31.956169  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:31.959658  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:31.968398  1581 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:31.969882  1505 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:31.953964  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:32.025350  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:32.022379  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:32.026129  1612 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:57:32.026875  1685 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:57:32.009769  1581 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:31.977133  1608 raft_consensus.cc:2393] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 4: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:32.029035  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:32.030367  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:31.588406  3175 consensus_queue.cc:260] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:32.037178  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:32.035326  1654 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:32.038308  1612 raft_consensus.cc:1240] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:57:31.947623  3216 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.030879  1617 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:57:32.035709  1684 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:31.919139  3247 consensus_queue.cc:1059] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 12:57:31.955843  3075 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:57:32.031220  3193 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.012s	sys 0.044s
I20260709 12:57:32.010094  3030 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:32.016198  3270 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:31.955893  3031 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:31.967866  3201 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:32.015774  3211 consensus_queue.cc:1048] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
W20260709 12:57:32.057642  1614 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.018s	sys 0.025s
I20260709 12:57:32.097651  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:32.093140  1616 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:57:31.967988  3120 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:32.103186  3155 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:32.106699  3132 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.001s	sys 0.015s
I20260709 12:57:32.100805  1617 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:57:32.107376  3246 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.057s	sys 0.068s
I20260709 12:57:32.124926  1685 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:32.077832  3268 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.113659  3204 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:32.129217  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 94036.6us
I20260709 12:57:32.077653  1611 raft_consensus.cc:1240] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:32.171881  3248 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:57:31.955967  2893 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.142s
I20260709 12:57:31.924378  3260 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:32.082056  3230 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:57:32.143599  3193 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.013s	sys 0.045s
W20260709 12:57:32.159301  1614 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.018s	sys 0.029s
I20260709 12:57:32.159592  1687 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
W20260709 12:57:32.216496  3210 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.002s	sys 0.034s
W20260709 12:57:32.216979  3210 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.002s	sys 0.034s
W20260709 12:57:32.216715  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:32.092453  3247 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:32.096976  3215 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:32.126407  1612 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:57:32.096935  2924 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.013s	sys 0.015s
W20260709 12:57:32.234210  2924 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.014s	sys 0.016s
I20260709 12:57:31.979601  3206 consensus_queue.cc:1048] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.178s
I20260709 12:57:32.099282  3075 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:32.128700  1613 raft_consensus.cc:2393] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 6: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:32.170668  1654 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:32.165426  3132 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.001s	sys 0.015s
I20260709 12:57:32.143240  3030 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:32.168395  3246 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.057s	sys 0.068s
W20260709 12:57:32.236717  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 66136.1us
I20260709 12:57:32.238090  1654 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:32.239570  1654 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:32.240420  1654 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:32.241539  3276 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:32.241907  3132 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:32.242141  3276 raft_consensus.cc:697] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:32.235967  3075 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:32.243650  3276 consensus_queue.cc:237] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:32.236663  3030 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:32.242446  3132 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:32.250747  1654 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:32.162770  3270 raft_consensus.cc:697] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:32.252866  3132 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:32.240288  3224 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:32.240660  2835 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:57:32.177150  3164 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.001s	sys 0.026s
I20260709 12:57:32.158996  3031 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:32.157580  2848 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.007s	sys 0.010s
I20260709 12:57:32.268380  1609 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
W20260709 12:57:32.293905  1655 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.025s	sys 0.061s
W20260709 12:57:32.314510  1655 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.025s	sys 0.061s
W20260709 12:57:32.314982  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 840975us
W20260709 12:57:32.203070  3257 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.000s	sys 0.012s
I20260709 12:57:32.092519  3216 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:32.259441  3247 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 12:57:32.298931  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:32.298341  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 48245.4us
W20260709 12:57:32.267737  3242 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.013s	sys 0.001s
W20260709 12:57:32.292202  2989 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.004s	sys 0.007s
I20260709 12:57:32.187386  3155 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:32.295023  3196 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:32.313530  3031 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:57:32.308945  3164 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.001s	sys 0.026s
I20260709 12:57:32.185259  3204 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:32.313936  2848 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.008s	sys 0.011s
I20260709 12:57:32.264111  3230 raft_consensus.cc:697] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:32.295559  3206 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:32.326153  3257 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.000s	sys 0.013s
I20260709 12:57:32.269166  3290 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:57:32.364719  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 355025us
I20260709 12:57:32.294860  3273 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:57:32.400177  3242 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.003s	user 0.013s	sys 0.002s
W20260709 12:57:32.407752  2989 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.912s	user 0.005s	sys 0.008s
I20260709 12:57:32.176685  3268 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:32.269755  3185 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:32.508868  1581 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:32.404736  3247 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:32.407189  3220 consensus_queue.cc:1059] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.099s
I20260709 12:57:32.519361  3273 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:32.641120  3284 log.cc:927] Time spent T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:57:32.469197  3000 consensus_queue.cc:1059] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.198s
I20260709 12:57:32.641850  1612 raft_consensus.cc:1275] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:57:32.497248  2935 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.971s	user 0.024s	sys 0.035s
I20260709 12:57:32.500046  3210 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.421293  3156 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:32.475711  3215 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.150s
I20260709 12:57:32.642884  3268 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:57:32.645782  3200 consensus_meta.cc:287] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.802s	user 0.006s	sys 0.002s
I20260709 12:57:32.649315  3220 raft_consensus.cc:3055] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:32.649891  3270 consensus_queue.cc:237] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:32.652840  3216 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:57:32.625408  3275 log.cc:927] Time spent T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.304s	user 0.000s	sys 0.000s
W20260709 12:57:32.626536  3286 log.cc:927] Time spent T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.217s	user 0.000s	sys 0.000s
I20260709 12:57:32.682232  2989 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.780771  2989 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:32.782972  2989 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:32.683156  3243 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:32.735670  3273 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:32.701753  3030 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:32.702749  3230 consensus_queue.cc:237] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:32.501214  3211 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.508339  3164 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.791918  3243 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:32.792676  3164 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:32.793741  3257 raft_consensus.cc:3055] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:32.794150  3257 raft_consensus.cc:740] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:32.794342  3243 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:32.794958  3164 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:32.517522  3206 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:32.796357  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 672) took 1509 ms. Trace:
I20260709 12:57:32.796152  3211 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:32.797081  3206 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:32.507644  3193 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.197s
I20260709 12:57:32.524629  3290 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:32.682169  3287 log.cc:927] Time spent T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
W20260709 12:57:32.707293  3014 consensus_meta.cc:287] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.925s	user 0.010s	sys 0.000s
W20260709 12:57:32.719203  3248 consensus_meta.cc:287] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.547s	user 0.006s	sys 0.003s
I20260709 12:57:32.806200  3248 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 5. Current term is 6.
W20260709 12:57:32.720527  3225 consensus_meta.cc:287] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.859s	user 0.010s	sys 0.000s
W20260709 12:57:32.722064  1508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.054s	sys 0.045s
W20260709 12:57:32.807337  1508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.054s	sys 0.045s
I20260709 12:57:32.807440  3014 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:32.807835  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 639581us
I20260709 12:57:32.809163  1610 raft_consensus.cc:2393] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 5: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:32.809579  3014 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:32.803761  3215 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:32.422523  2835 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:32.406744  3209 consensus_queue.cc:1059] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.101s
I20260709 12:57:32.806969  3000 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:32.726284  1582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.037s	sys 0.033s
W20260709 12:57:32.729760  1583 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.024s	sys 0.055s
W20260709 12:57:32.832286  1582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.037s	sys 0.033s
W20260709 12:57:32.723209  3201 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.004s	sys 0.018s
I20260709 12:57:32.740993  2848 consensus_queue.cc:1059] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
W20260709 12:57:32.727555  3233 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.360s	user 0.035s	sys 0.079s
W20260709 12:57:32.857071  3233 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.492s	user 0.035s	sys 0.080s
I20260709 12:57:32.857558  3209 raft_consensus.cc:3055] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:32.858229  3209 raft_consensus.cc:740] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:32.859336  3209 consensus_queue.cc:260] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:32.732714  3224 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:57:32.732774  1611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.000s	sys 0.020s
W20260709 12:57:32.861550  1611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.000s	sys 0.021s
I20260709 12:57:32.803884  3257 consensus_queue.cc:260] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:32.742523  2935 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.216s	user 0.024s	sys 0.040s
I20260709 12:57:32.520397  3196 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:32.767791  3220 raft_consensus.cc:740] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:32.869803  3257 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:32.777256  2996 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.796756  1616 rpcz_store.cc:276] 0709 12:57:31.286442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:31.938815 (+652373us) service_pool.cc:224] Handling call
0709 12:57:32.092917 (+154102us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:32.159774 (+ 66857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:32.796138 (+636364us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b5400446bd0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:32.796292 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351358720}
I20260709 12:57:32.816234  1538 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
W20260709 12:57:32.832439  1583 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.024s	sys 0.055s
W20260709 12:57:32.730034  1689 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.005s	sys 0.017s
I20260709 12:57:32.834220  1505 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:32.876703  1689 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.005s	sys 0.017s
I20260709 12:57:32.473980  3265 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:32.890008  3265 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:32.891402  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 681) took 1580 ms. Trace:
I20260709 12:57:32.892112  3265 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:32.833791  3201 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.004s	sys 0.018s
I20260709 12:57:32.894646  3201 raft_consensus.cc:697] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:32.895521  3201 consensus_queue.cc:237] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:32.810495  3215 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:32.897854  3215 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:32.807126  3225 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:32.898463  3225 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:32.898835  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 20) took 1188 ms. Trace:
I20260709 12:57:32.899212  1612 rpcz_store.cc:276] 0709 12:57:31.710019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:32.251904 (+541885us) service_pool.cc:224] Handling call
0709 12:57:32.252189 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:32.737845 (+485656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:32.898614 (+160769us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b5400445554. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:32.898782 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":622748544}
I20260709 12:57:32.837598  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:32.900223  1690 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 4.
W20260709 12:57:32.838158  3288 log.cc:927] Time spent T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:57:32.838438  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:32.838698  3030 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:32.838630  3000 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:32.811095  3211 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:32.912622  3000 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:32.912997  3211 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:32.913527  3211 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:32.915611  3211 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:32.835691  2835 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:32.840704  3216 consensus_queue.cc:1059] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:32.842208  3290 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:32.772269  3200 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:32.842511  3242 consensus_queue.cc:1048] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:32.837641  3248 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:32.842260  1508 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:32.752722  3210 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:32.918309  1534 raft_consensus.cc:2393] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 6: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:32.917549  3248 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:32.919117  3210 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:32.804427  3243 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:32.926349  1534 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 1122) took 1221 ms (client timeout 1565 ms). Trace:
I20260709 12:57:32.926564  3243 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:32.869056  3196 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:32.926789  1534 rpcz_store.cc:269] 0709 12:57:31.698118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:31.700890 (+  2772us) service_pool.cc:224] Handling call
0709 12:57:32.919296 (+1218406us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400314cd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:32.919412 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2719489920}
I20260709 12:57:32.804780  3164 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:32.888262  2996 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:32.870267  3220 consensus_queue.cc:260] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:32.893002  3209 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:32.934183  3283 log.cc:927] Time spent T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.414s	user 0.008s	sys 0.002s
I20260709 12:57:32.891783  1608 rpcz_store.cc:276] 0709 12:57:31.310740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:32.083563 (+772823us) service_pool.cc:224] Handling call
0709 12:57:32.083924 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:32.208821 (+124897us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:32.208852 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:32.209553 (+   701us) log.cc:844] Serialized 26 byte log entry
0709 12:57:32.340764 (+131211us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:32.420753 (+ 79989us) log.cc:844] Serialized 14 byte log entry
0709 12:57:32.890824 (+470071us) spinlock_profiling.cc:243] Waited 5.34 ms on lock 0x7b18002a2680. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859edec0a 00007fc86361e219 00007fc859f66a40 00007fc859f614e4 00007fc859f61455 00007fc85d049060 00007fc85d05b716 00007fc85d06c287 00007fc85d06c208
0709 12:57:32.890997 (+   173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:32.891061 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:32.891100 (+    39us) raft_consensus.cc:1685] finished
0709 12:57:32.891196 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:32.891343 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58654,"prepare.queue_time_us":79768,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":2416,"raft.queue_time_us":186914,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":13948,"spinlock_wait_cycles":12285312,"thread_start_us":209299,"threads_started":2,"wal-append.queue_time_us":636303}
I20260709 12:57:32.906965  3225 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:32.910967  1612 raft_consensus.cc:1240] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:57:32.930493  3196 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:32.917479  2835 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:32.712023  3132 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:32.917893  3200 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:32.930339  3185 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:32.877364  3204 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:32.931654  3164 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:32.933015  2996 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:32.933624  3243 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:32.927115  3248 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:32.933771  3220 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:32.938867  1608 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:57:32.965564  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 689) took 1047 ms. Trace:
W20260709 12:57:32.912494  3282 log.cc:927] Time spent T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.269s	user 0.006s	sys 0.004s
W20260709 12:57:32.939422  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 430666us
I20260709 12:57:32.939990  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 688) took 1023 ms. Trace:
I20260709 12:57:32.968326  1612 rpcz_store.cc:276] 0709 12:57:31.916768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:32.910434 (+993666us) service_pool.cc:224] Handling call
0709 12:57:32.910760 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:32.939184 (+ 28424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:32.939908 (+   724us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:32.946492  3151 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:57:32.944981  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 110832us
I20260709 12:57:32.967868  1581 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:32.872349  3247 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:32.900519  3031 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:32.954137  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 111992us
I20260709 12:57:32.954624  3242 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:57:32.961277  3281 log.cc:927] Time spent T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.486s	user 0.000s	sys 0.001s
I20260709 12:57:32.952601  3215 raft_consensus.cc:3055] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:32.964046  1583 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:33.004629  3132 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:33.004842  3215 raft_consensus.cc:740] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:33.005730  3215 consensus_queue.cc:260] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:33.006677  3031 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:32.975004  2899 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:57:33.006191  3185 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:33.024267  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:32.965938  1608 rpcz_store.cc:276] 0709 12:57:31.917835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:32.938302 (+1020467us) service_pool.cc:224] Handling call
0709 12:57:32.938643 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:32.965273 (+ 26630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:32.965505 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:32.920617  3260 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:32.972258  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 941) took 1443 ms. Trace:
I20260709 12:57:32.973706  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 1131) took 1034 ms. Trace:
I20260709 12:57:33.070011  1538 rpcz_store.cc:276] 0709 12:57:31.938937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:31.939064 (+   127us) service_pool.cc:224] Handling call
0709 12:57:32.973535 (+1034471us) spinlock_profiling.cc:243] Waited 867 ms on lock 0x7b54002e8454. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:32.973648 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1995028736}
I20260709 12:57:33.071473  1613 rpcz_store.cc:276] 0709 12:57:31.528866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:32.236436 (+707570us) service_pool.cc:224] Handling call
0709 12:57:32.937592 (+701156us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:32.937818 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:32.937846 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:32.937890 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:32.937922 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:32.937994 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:32.972081 (+ 34087us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b54001f68d0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:32.972197 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1611867904}
I20260709 12:57:32.949249  3246 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:33.087055  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:33.087993  1608 raft_consensus.cc:2393] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 5: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 12:57:32.943823  2924 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.005s	sys 0.025s
I20260709 12:57:32.984957  1508 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:33.090261  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:33.002761  1581 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:33.025066  1612 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
W20260709 12:57:33.025692  3075 consensus_meta.cc:287] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.782s	user 0.015s	sys 0.003s
W20260709 12:57:33.091158  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 106277us
I20260709 12:57:33.091434  3075 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:32.975430  3151 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:33.088498  3120 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.027s	sys 0.036s
I20260709 12:57:33.089870  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:33.098256  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 95585.1us
I20260709 12:57:33.098455  1613 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
W20260709 12:57:33.074599  1655 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.007s	sys 0.053s
I20260709 12:57:33.095008  1508 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:33.038342  3164 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:33.091884  3300 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:57:33.100180  1655 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.007s	sys 0.053s
W20260709 12:57:33.093180  2924 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.005s	sys 0.025s
W20260709 12:57:33.097494  2964 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.834s	user 0.010s	sys 0.039s
I20260709 12:57:33.102887  1508 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:33.103579  3243 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:33.104277  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:33.112944  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:33.111117  1581 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:33.114118  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:33.100069  3120 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.027s	sys 0.036s
I20260709 12:57:33.102382  1505 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:33.104847  3247 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:33.119954  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:33.120577  1541 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:33.121860  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:33.105176  3294 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:57:33.106060  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 696912us
I20260709 12:57:33.095162  3246 raft_consensus.cc:697] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:33.097936  3151 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:33.110602  1508 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:33.115299  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:33.119024  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:33.139195  1538 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:33.139873  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:33.122439  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:33.108371  3260 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.123613  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:33.112171  2964 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.010s	sys 0.039s
I20260709 12:57:33.008033  3273 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:33.123670  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:33.127573  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:33.135824  1541 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:33.122480  1536 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:33.146176   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:57:33.148531   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:57:33.144964  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:33.149847  1613 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
W20260709 12:57:33.150022  1657 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.016s	sys 0.040s
I20260709 12:57:33.151301  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:33.154137  1537 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:33.119539  3120 raft_consensus.cc:697] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:33.156440  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:57:33.156980  1657 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.017s	sys 0.040s
I20260709 12:57:33.157150  1536 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:33.159520  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:33.160876  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:33.152318  1533 raft_consensus.cc:2393] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 5: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:33.153096  1540 raft_consensus.cc:1275] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:33.148661  1655 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:33.146140  3132 consensus_queue.cc:1048] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:57:33.167006  1616 raft_consensus.cc:1240] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:33.138934  3248 raft_consensus.cc:2804] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:33.162119  1687 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50708
I20260709 12:57:33.162582  3211 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.118449  3164 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:33.125882  3307 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:33.165127  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:33.187340  1685 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:33.160351  1688 raft_consensus.cc:2393] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 5: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:33.170015  1655 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:33.171000  3196 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:33.143949  3031 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:33.172370  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 61841.5us
I20260709 12:57:33.190135  1581 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:33.172608  1533 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:57:33.173579  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:33.173807  1687 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:33.191475  1687 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:33.191151  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:33.149848  1538 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:33.175915  1505 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:33.183632  1536 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:33.163467  3296 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.184237  2924 raft_consensus.cc:3055] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:33.185151  3243 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:33.186560  1691 raft_consensus.cc:1275] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 12:57:33.205686  1691 pending_rounds.cc:85] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 1
I20260709 12:57:33.205991  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:33.205969  1691 pending_rounds.cc:107] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:57:33.207633  1691 raft_consensus.cc:2889] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:33.207960  1691 pending_rounds.cc:107] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:57:33.180795  3248 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:33.149902  3294 raft_consensus.cc:697] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:33.210734  3291 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:33.200709  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:33.201404  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:33.230121  1581 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:33.214251  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:33.213552  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:33.232020  1684 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:33.233079  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:33.220116  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:33.235096  1682 raft_consensus.cc:2410] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:57:33.236791  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:33.233687  1684 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:33.224982  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:33.233418  1581 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:33.223985  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:33.222153  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 687) took 1305 ms. Trace:
I20260709 12:57:33.242751  1616 rpcz_store.cc:276] 0709 12:57:31.916523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:32.888363 (+971840us) service_pool.cc:224] Handling call
0709 12:57:32.889833 (+  1470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:33.167431 (+277598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:33.221831 (+ 54400us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54002576d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:33.222079 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":637046016}
W20260709 12:57:33.203492  1654 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.015s	sys 0.065s
I20260709 12:57:33.203716  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:33.201795  1655 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:33.208312  1691 raft_consensus.cc:2889] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:33.209167  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:33.222810  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 945) took 1425 ms. Trace:
W20260709 12:57:33.186862  1617 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.003s	sys 0.020s
I20260709 12:57:33.137144  3316 consensus_queue.cc:1048] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.071s
W20260709 12:57:33.209808  1615 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.281s	user 0.011s	sys 0.009s
I20260709 12:57:33.181393  3299 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:33.180634  3154 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.154479  3260 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:33.245980  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:33.267074  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:33.267976  1688 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:33.268525  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:33.246582  1654 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.015s	sys 0.065s
I20260709 12:57:33.204280  2924 raft_consensus.cc:740] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:33.269459  1616 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 3.
I20260709 12:57:33.269781  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:33.247359  1686 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:33.247251  1610 rpcz_store.cc:276] 0709 12:57:31.796957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:31.905037 (+108080us) service_pool.cc:224] Handling call
0709 12:57:33.222578 (+1317541us) spinlock_profiling.cc:243] Waited 877 ms on lock 0x7b54002580d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:33.222710 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2016350976}
W20260709 12:57:33.247797  1617 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.003s	sys 0.020s
I20260709 12:57:33.230115  1537 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
W20260709 12:57:33.253522  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:33.188546  3164 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:33.189254  3000 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:33.237533  1682 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
W20260709 12:57:33.258780  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 57088.5us
W20260709 12:57:33.265400  1615 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.328s	user 0.011s	sys 0.009s
I20260709 12:57:33.230949  3248 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:57:33.278399  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 868878us
I20260709 12:57:33.223244  3291 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:33.279868  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:33.270519  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:33.286619  1655 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:33.217105  3298 log.cc:927] Time spent T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:57:33.286872  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:33.264393  3206 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:57:33.289314  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 55989.9us
I20260709 12:57:33.211055  3307 raft_consensus.cc:697] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:33.227792  3300 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:33.271296  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:33.212059  3297 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:33.293854  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:33.317456  1609 raft_consensus.cc:1240] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: [2.2-4.3]
W20260709 12:57:33.293818  3276 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.047s	user 0.010s	sys 0.021s
W20260709 12:57:33.318265  3276 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.071s	user 0.010s	sys 0.021s
I20260709 12:57:33.264683  3132 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:33.298945  1682 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:33.289175  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:33.300943  1612 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:33.288766  3302 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:33.302380  1655 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:33.202626  3031 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:33.304973  1581 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:33.297986  1687 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:33.270503  3154 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:33.263447  3243 raft_consensus.cc:697] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:33.314750  1684 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:33.185748  3120 consensus_queue.cc:237] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:33.199393  3211 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:33.284818  3164 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:33.318071  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:33.298070  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:33.332566  1614 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.062s	user 0.012s	sys 0.019s
W20260709 12:57:33.356455  1507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.007s	sys 0.017s
I20260709 12:57:33.211422  3306 consensus_queue.cc:1059] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.099s
I20260709 12:57:33.207098  3296 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:33.339185  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 694) took 1395 ms. Trace:
I20260709 12:57:33.308111  3000 raft_consensus.cc:2764] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:57:33.349623  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:33.281530  2893 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:33.261399  3174 consensus_queue.cc:1048] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:57:33.301298  3291 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:33.354811  1685 raft_consensus.cc:2393] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 5: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:33.355935  1687 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:33.357538  1507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.008s	sys 0.017s
I20260709 12:57:33.357226  1691 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
W20260709 12:57:33.357465  1614 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.091s	user 0.013s	sys 0.019s
I20260709 12:57:33.360877  1583 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:33.362332  1684 raft_consensus.cc:1240] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:33.305668  3293 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:33.309566  3206 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:33.363838  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 58974.8us
I20260709 12:57:33.403865  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 661) took 2123 ms. Trace:
W20260709 12:57:33.364784  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 62486.4us
W20260709 12:57:33.349020  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 47485.2us
I20260709 12:57:33.376488  1609 rpcz_store.cc:276] 0709 12:57:31.943937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:33.316682 (+1372745us) service_pool.cc:224] Handling call
0709 12:57:33.317129 (+   447us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:57:33.338817 (+ 21688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:33.339112 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:33.291357  2964 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 12:57:33.383384  1682 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:33.404284  1614 rpcz_store.cc:276] 0709 12:57:31.274150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:31.274336 (+   186us) service_pool.cc:224] Handling call
0709 12:57:31.274685 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:31.275050 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:31.275111 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:31.296842 (+ 21731us) log.cc:844] Serialized 26 byte log entry
0709 12:57:31.414127 (+117285us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:32.207231 (+793104us) log.cc:844] Serialized 14 byte log entry
0709 12:57:33.397364 (+1190133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:33.397449 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:33.397489 (+    40us) raft_consensus.cc:1685] finished
0709 12:57:33.397499 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:33.397609 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":502498,"prepare.queue_time_us":16058,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":42,"raft.queue_time_us":214360,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":55313,"spinlock_wait_cycles":1357696,"thread_start_us":2000950,"threads_started":3,"wal-append.queue_time_us":187423,"wal-append.run_cpu_time_us":2664,"wal-append.run_wall_time_us":1717498}
W20260709 12:57:33.386350  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:33.211050  3246 consensus_queue.cc:237] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:33.356128  3230 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.015s	sys 0.012s
I20260709 12:57:33.351763  3075 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:33.396340  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 193789us
I20260709 12:57:33.431061  1691 raft_consensus.cc:3055] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:33.376031  3216 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.392860  3155 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:33.378930  3300 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.417450  1687 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:57:33.394824  3297 raft_consensus.cc:697] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:33.404358  1581 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:33.420584  1654 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:33.352895  3270 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.013s	sys 0.031s
W20260709 12:57:33.448655  3270 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.013s	sys 0.031s
W20260709 12:57:33.448951  3309 log.cc:927] Time spent T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.130s	user 0.000s	sys 0.004s
I20260709 12:57:33.450012  3243 consensus_queue.cc:237] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:33.450438  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:33.451048  2298 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:33.222496  3294 consensus_queue.cc:237] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:33.453723  3296 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:33.387768  3308 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:57:33.428930  1540 raft_consensus.cc:1240] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:33.270347  3299 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:33.430701  1690 raft_consensus.cc:1275] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 12:57:33.461791  1654 leader_election.cc:400] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5.
I20260709 12:57:33.356621  3310 consensus_queue.cc:1059] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
W20260709 12:57:33.480100  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 75855.7us
I20260709 12:57:33.425128  3293 raft_consensus.cc:697] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:33.483327  2266 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:33.405838  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1138) took 1478 ms. Trace:
W20260709 12:57:33.432394  1508 leader_election.cc:336] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 1.584s (SENT)
I20260709 12:57:33.432417  1614 raft_consensus.cc:1240] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: []
W20260709 12:57:33.489207  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 56861us
I20260709 12:57:33.489336  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 695) took 1545 ms. Trace:
W20260709 12:57:33.489894  1508 leader_election.cc:336] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 1.649s (SENT)
I20260709 12:57:33.431545  1691 raft_consensus.cc:740] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:33.489732  1614 rpcz_store.cc:276] 0709 12:57:31.944190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:33.431980 (+1487790us) service_pool.cc:224] Handling call
0709 12:57:33.432254 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:33.489065 (+ 56811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:33.489267 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:33.489895  1507 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:33.389365  1611 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.027s	sys 0.034s
I20260709 12:57:33.400173  3274 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:33.446542  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:33.417618  3206 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:57:33.427518  3230 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.015s	sys 0.012s
I20260709 12:57:33.421831  3200 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:33.459501  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:33.491856  3312 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:57:33.490969  1691 consensus_queue.cc:260] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:33.516785  1689 rpcz_store.cc:276] 0709 12:57:31.920829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:32.053705 (+132876us) service_pool.cc:224] Handling call
0709 12:57:32.054046 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:32.054265 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:57:32.144671 (+ 90406us) log.cc:844] Serialized 14 byte log entry
0709 12:57:33.397788 (+1253117us) log.cc:844] Serialized 14 byte log entry
0709 12:57:33.398917 (+  1129us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:33.398965 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:33.399004 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:33.399062 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:33.399167 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78204,"prepare.queue_time_us":99894,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":72537,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":22042,"thread_start_us":1183144,"threads_started":2,"wal-append.queue_time_us":964014}
I20260709 12:57:33.555398  1691 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:33.492306  1508 leader_election.cc:336] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 1.674s (SENT)
I20260709 12:57:33.461122  3303 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.441859  3276 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.425312  2835 consensus_queue.cc:1048] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:57:33.377826  2924 consensus_queue.cc:260] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:57:33.543419  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:33.552783  2302 raft_consensus.cc:1275] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:57:33.455570  3300 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:33.395633  2893 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:33.556857  1508 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:33.486266  3270 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:33.669502  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 177235us
I20260709 12:57:33.558668  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:33.557417  2298 raft_consensus.cc:1240] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:33.673295  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:57:33.673859  2302 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:33.608465  1688 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
W20260709 12:57:33.627753  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 140230us
W20260709 12:57:33.610458  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 249686us
I20260709 12:57:33.606254  1655 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:33.540884  3302 raft_consensus.cc:697] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:33.602433  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:33.562326  3014 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:33.547667  3260 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:33.493060  3209 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:33.550501  3316 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:33.492738  2935 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:33.548434  2925 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:33.545042  3075 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.455870  3216 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:33.494484  3155 raft_consensus.cc:697] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:57:33.621529  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:33.544263  3201 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:33.542619  1611 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.032s	sys 0.043s
I20260709 12:57:33.541741  3225 consensus_queue.cc:1059] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 12:57:33.429327  3000 consensus_queue.cc:1059] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:57:33.604786  3296 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:33.663512  1614 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:33.562002  3311 consensus_queue.cc:1059] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:57:33.677495  1583 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:33.566579  3200 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:33.679248  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:33.732964  1540 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:33.658042  3175 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:33.436875  3307 consensus_queue.cc:237] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:33.698173  1686 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:33.679309  2989 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:33.687436  3332 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.663069  3276 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:33.561774  3312 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:33.676403  3273 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:33.481089  3308 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:33.716977  2302 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:33.694972  3154 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:33.731783  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 54383.9us
I20260709 12:57:33.582261  3303 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:33.701449  3211 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:33.549496  3293 consensus_queue.cc:237] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:33.736017  1538 raft_consensus.cc:1275] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:57:33.680007  3270 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:33.701457  2925 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:33.704999  3209 raft_consensus.cc:697] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:33.715196  3228 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:33.739428  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:33.700269  3310 consensus_queue.cc:1059] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
W20260709 12:57:33.736099  3220 consensus_meta.cc:287] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.771s	user 0.007s	sys 0.004s
I20260709 12:57:33.735622  3000 consensus_queue.cc:1243] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:57:33.745170  1583 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:33.699673  3316 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:33.734364  3296 raft_consensus.cc:697] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:33.705559  2935 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:33.740134  3260 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:33.714051  3075 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:33.752908  1614 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 5.
I20260709 12:57:33.729728  3201 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:33.824523  3317 log.cc:927] Time spent T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
I20260709 12:57:33.713616  3320 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:33.850660  3316 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:33.848361  1690 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
W20260709 12:57:33.849087  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 103997us
I20260709 12:57:33.753203  2925 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:33.825729  3273 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.853850  2964 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:33.825418  3224 consensus_queue.cc:1048] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:57:33.660712  3297 consensus_queue.cc:237] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:33.825337  3154 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:33.751228  3332 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:33.842399  3303 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:33.867172  1690 pending_rounds.cc:85] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 2
W20260709 12:57:33.873008  3325 log.cc:927] Time spent T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:57:33.855777  3311 raft_consensus.cc:3055] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:57:33.865087  3319 log.cc:927] Time spent T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
W20260709 12:57:33.884447  3330 log.cc:927] Time spent T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 12:57:33.742162  3302 consensus_queue.cc:237] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:33.888527  1616 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:33.859254  1614 raft_consensus.cc:1275] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:57:33.846575  3155 consensus_queue.cc:237] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:33.910327  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 691) took 1976 ms. Trace:
I20260709 12:57:33.911612  1614 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:33.911911  1616 rpcz_store.cc:276] 0709 12:57:31.934194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:33.306771 (+1372577us) service_pool.cc:224] Handling call
0709 12:57:33.307129 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:33.888333 (+581204us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b5400436d20. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85cfc8dc0 00007fc85d0531c0 00007fc85d054231 00007fc85d050d8f 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c
0709 12:57:33.910053 (+ 21720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:33.910273 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":258517760}
I20260709 12:57:33.900328  1583 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:33.864140  3299 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:33.900235  3321 log.cc:927] Time spent T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
I20260709 12:57:33.900146  3300 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:33.904466  1690 pending_rounds.cc:107] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:57:33.921540  1690 raft_consensus.cc:2889] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:33.905040  1691 raft_consensus.cc:1275] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:57:33.925037  1691 pending_rounds.cc:85] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 2
I20260709 12:57:33.925945  1691 pending_rounds.cc:107] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:57:33.925109  1583 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:33.927237  1691 raft_consensus.cc:2889] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:33.927495  2964 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:33.916148  1540 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:33.932399  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:33.906040  3311 raft_consensus.cc:740] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:33.906515  3154 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:33.933379  3327 log.cc:927] Time spent T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
I20260709 12:57:33.887544  3273 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:33.945071  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 684) took 2565 ms. Trace:
I20260709 12:57:33.935946  1583 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:33.969463  1617 rpcz_store.cc:276] 0709 12:57:31.367932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:32.166087 (+798155us) service_pool.cc:224] Handling call
0709 12:57:32.166460 (+   373us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:57:32.399284 (+232824us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:57:33.278871 (+879587us) log.cc:844] Serialized 14 byte log entry
0709 12:57:33.503625 (+224754us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:57:33.542989 (+ 39364us) log.cc:844] Serialized 52 byte log entry
0709 12:57:33.543125 (+   136us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:33.556121 (+ 12996us) log.cc:844] Serialized 14 byte log entry
0709 12:57:33.556453 (+   332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:33.556569 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:33.932962 (+376393us) raft_consensus.cc:1685] finished
0709 12:57:33.932981 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:33.933122 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18126,"prepare.queue_time_us":108304,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":84,"raft.queue_time_us":130814,"raft.run_cpu_time_us":485,"raft.run_wall_time_us":49249,"thread_start_us":1065374,"threads_started":3,"wal-append.queue_time_us":358801}
I20260709 12:57:33.971279  3270 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:33.920143  2893 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:33.911278  3303 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:57:33.886380  3320 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:33.980516  1540 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
W20260709 12:57:33.981309  3334 log.cc:927] Time spent T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 12:57:33.934779  2826 raft_consensus.cc:3055] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:33.974730  3200 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:33.906139  3209 consensus_queue.cc:237] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:33.984210  2826 raft_consensus.cc:740] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:33.984902  3201 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:33.985132  2826 consensus_queue.cc:260] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:33.985919  2935 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:33.928925  3299 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:33.984902  3075 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:33.988955  3312 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:33.990017  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 936) took 2462 ms. Trace:
I20260709 12:57:33.990479  3014 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:57:33.992218  3314 log.cc:927] Time spent T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.304s	user 0.000s	sys 0.001s
I20260709 12:57:33.993407  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 950) took 1030 ms. Trace:
I20260709 12:57:33.993948  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 952) took 1030 ms. Trace:
I20260709 12:57:33.969240  3216 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:33.972803  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:33.909910  3296 consensus_queue.cc:237] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:33.990345  3164 consensus_meta.cc:287] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.610s	user 0.007s	sys 0.000s
I20260709 12:57:34.005416  1609 rpcz_store.cc:276] 0709 12:57:32.962965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:33.462775 (+499810us) service_pool.cc:224] Handling call
0709 12:57:33.463085 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:33.553965 (+ 90880us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:33.554000 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:33.554045 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:33.554074 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:33.993165 (+439091us) spinlock_profiling.cc:243] Waited 90.7 ms on lock 0x7b540011d5d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:33.993214 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:33.993346 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":208514816}
I20260709 12:57:34.005471  1608 rpcz_store.cc:276] 0709 12:57:32.963446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:33.604634 (+641188us) service_pool.cc:224] Handling call
0709 12:57:33.631893 (+ 27259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:33.882251 (+250358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:33.882281 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:33.882324 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:33.882352 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:33.993717 (+111365us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b54000672d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:33.993767 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:33.993891 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":106,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":22524,"spinlock_wait_cycles":575019776}
I20260709 12:57:34.009124  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:33.969069  2964 consensus_queue.cc:1048] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:57:34.018472  3320 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:34.018699  3278 log.cc:927] Time spent T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 1.357s	user 0.014s	sys 0.005s
I20260709 12:57:34.022742  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:33.934458  3311 consensus_queue.cc:260] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:34.025502  1534 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:34.031208  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 95336.4us
I20260709 12:57:34.037932  1583 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:34.000711  3308 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:34.041320  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:34.058772  1534 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:34.058578  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:34.061401  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:34.060322  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:34.065320  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:34.045517  1583 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:34.067965  1583 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:34.065768  1534 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:34.033223  2893 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:34.070250  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:34.064769  2299 raft_consensus.cc:2393] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 6: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:34.070395  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:57:34.068531  3318 log.cc:927] Time spent T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.284s	user 0.000s	sys 0.007s
W20260709 12:57:34.080050  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 473892us
I20260709 12:57:34.040609  3075 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:57:34.079188  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 376227us
W20260709 12:57:34.044010  3248 consensus_meta.cc:287] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.740s	user 0.008s	sys 0.003s
W20260709 12:57:34.085894  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:34.058543  3276 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:34.088899  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:34.089676  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 414225us
I20260709 12:57:34.068647  3299 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:34.035665  3164 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:34.097035  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:34.105139  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:34.085695  3326 log.cc:927] Time spent T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 12:57:34.097934  1538 raft_consensus.cc:2368] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4.
W20260709 12:57:34.100685  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:34.079357  3294 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:34.078858  2893 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:34.001964  1611 rpcz_store.cc:276] 0709 12:57:31.527621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:32.172146 (+644525us) service_pool.cc:224] Handling call
0709 12:57:32.172551 (+   405us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:57:32.862119 (+689568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:32.862154 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:57:32.863074 (+   920us) log.cc:844] Serialized 52 byte log entry
0709 12:57:33.733421 (+870347us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:33.735895 (+  2474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:33.740113 (+  4218us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:33.989784 (+249671us) raft_consensus.cc:1685] finished
0709 12:57:33.989810 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:33.989957 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":476520,"raft.queue_time_us":147597,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":67896,"thread_start_us":1540079,"threads_started":2,"wal-append.queue_time_us":685825}
I20260709 12:57:34.114992  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:34.116267  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:34.116930  1538 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:34.117789  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:34.118592  1538 raft_consensus.cc:2410] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:57:34.119623  1538 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:34.121003  1538 raft_consensus.cc:1240] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:57:34.122253  1538 raft_consensus.cc:1240] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:34.104074  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:34.112581  2893 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:34.109733  3294 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:34.104063  3156 consensus_queue.cc:1059] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:57:34.093770  3248 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:57:33.996737  3265 consensus_queue.cc:1175] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1d6516ff61104bdda54bde95e92fe579" responder_term: 6 status { last_received { term: 5 index: 5 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:57:34.123469  3332 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:34.140559  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 404817us
I20260709 12:57:34.145182  1538 raft_consensus.cc:1240] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:34.147599  1539 raft_consensus.cc:2393] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 7: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:34.148655  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1138) took 1029 ms. Trace:
I20260709 12:57:34.130146  3294 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:34.126420  3132 consensus_queue.cc:1059] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:57:34.149101  1542 rpcz_store.cc:276] 0709 12:57:33.119307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:33.120108 (+   801us) service_pool.cc:224] Handling call
0709 12:57:33.120363 (+   255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:33.129869 (+  9506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:33.129902 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:33.130393 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 12:57:33.437950 (+307557us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:33.437995 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:33.438072 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:34.148441 (+710369us) raft_consensus.cc:1685] finished
0709 12:57:34.148459 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:34.148597 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27713,"raft.queue_time_us":18194,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":7968,"thread_start_us":272376,"threads_started":1,"wal-append.queue_time_us":604152}
I20260709 12:57:34.156065  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:34.157510  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:34.165402  1542 raft_consensus.cc:1240] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:34.167048  1542 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:57:34.169559  1542 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:57:34.169842  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:34.168774  1655 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:34.152863  3000 consensus_queue.cc:1059] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
W20260709 12:57:34.162773  3185 consensus_meta.cc:287] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 1.094s	user 0.014s	sys 0.000s
I20260709 12:57:34.176438  1655 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:34.153198  3276 consensus_queue.cc:1059] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:57:34.177053  1542 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:34.176638  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:34.177655  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 62335.2us
W20260709 12:57:34.178864  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 86584.1us
I20260709 12:57:34.186005  1583 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:57:34.192945  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 76867us
I20260709 12:57:34.194316  1655 leader_election.cc:400] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4.
I20260709 12:57:34.194679  1655 leader_election.cc:403] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:57:34.202391  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:34.203490  1691 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:34.203799   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:57:34.192301  3340 log.cc:927] Time spent T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:57:34.182864  3185 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:34.189517  3226 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:57:34.206965  1508 leader_election.cc:336] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 1.913s (SENT)
I20260709 12:57:34.198510  3307 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:57:34.211282  1508 leader_election.cc:336] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 1.971s (SENT)
W20260709 12:57:34.202519  3151 consensus_meta.cc:287] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 1.052s	user 0.010s	sys 0.002s
I20260709 12:57:34.175256  3345 consensus_queue.cc:1048] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:57:34.215770  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:34.227036  1535 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:34.227576  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 1147) took 1105 ms. Trace:
I20260709 12:57:34.199160  3156 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:57:34.227957  1535 rpcz_store.cc:276] 0709 12:57:33.121780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:33.121976 (+   196us) service_pool.cc:224] Handling call
0709 12:57:34.215616 (+1093640us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b5800002798. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc8620170a0 00007fc862016984 00007fc85b5916d4 00007fc85b591662
0709 12:57:34.227513 (+ 11897us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2553728}
I20260709 12:57:34.217201  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:34.239069  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:34.193336  3320 consensus_queue.cc:1048] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:57:34.212338  1610 raft_consensus.cc:1240] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:34.216816  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 962) took 1236 ms. Trace:
I20260709 12:57:34.214350  1508 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:34.193115  3216 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:57:34.241219  1535 raft_consensus.cc:1240] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:34.244073  1612 rpcz_store.cc:276] 0709 12:57:32.980667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:33.173102 (+192435us) service_pool.cc:224] Handling call
0709 12:57:34.216617 (+1043515us) spinlock_profiling.cc:243] Waited 71.7 ms on lock 0x7b54000023d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:34.216740 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164989312}
I20260709 12:57:34.245813  1535 raft_consensus.cc:1240] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:57:34.237047  3267 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:34.239046  3164 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:34.202718  3204 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:57:34.228164  3307 raft_consensus.cc:697] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:34.208202  3299 consensus_queue.cc:1048] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
W20260709 12:57:34.261458  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 50209.4us
W20260709 12:57:34.272308  1508 leader_election.cc:336] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 1.974s (SENT)
I20260709 12:57:34.272912  1508 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:57:34.274073  1508 leader_election.cc:336] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 2.008s (SENT)
I20260709 12:57:34.218104  3356 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4.
I20260709 12:57:34.211760  3350 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:34.274528  1508 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:34.249963  3248 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:34.290988  3294 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:34.292583  3291 consensus_meta.cc:287] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.887s	user 0.015s	sys 0.009s
I20260709 12:57:34.245282  3276 consensus_queue.cc:1059] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:57:34.240303  3297 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:34.281008  3307 consensus_queue.cc:237] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:34.264746  3164 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:57:34.279902  3175 consensus_meta.cc:287] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.543s	user 0.003s	sys 0.011s
I20260709 12:57:34.299366  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:34.293010  3291 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:34.282982  3350 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:34.296223  1508 leader_election.cc:336] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 2.188s (SENT)
I20260709 12:57:34.306210  1508 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:34.259735  3267 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:34.301363  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:34.284981  3300 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:34.302641  3175 consensus_queue.cc:1059] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:34.303308  2269 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:34.303707  3362 raft_consensus.cc:3055] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:34.302736  3255 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:34.229353  3151 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
W20260709 12:57:34.305760  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:34.289724  3216 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:34.307278  1688 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 6.
I20260709 12:57:34.294330  3260 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:34.296905  3356 raft_consensus.cc:3055] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:34.314997  1533 raft_consensus.cc:1240] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:34.305308  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
W20260709 12:57:34.328112  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 148052us
I20260709 12:57:34.311115  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:34.302554  3276 consensus_queue.cc:1059] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:57:34.308070  3350 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:34.302434  3297 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:34.357872  3255 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:34.361446  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 58360.8us
I20260709 12:57:34.325923  3356 raft_consensus.cc:740] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:34.312623  3362 raft_consensus.cc:740] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:34.313616  3193 raft_consensus.cc:3055] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:34.312884  3226 raft_consensus.cc:697] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 5 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:34.324389  3294 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:34.346159  3267 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:34.367596  3193 raft_consensus.cc:740] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:34.364740  3000 raft_consensus.cc:3055] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:57:34.373988  3360 log.cc:927] Time spent T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:57:34.316679  2893 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:34.358731  3136 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:34.376999  3274 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:34.377578  3274 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:34.370180  1654 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:34.371241  3331 raft_consensus.cc:3055] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:34.371487  2835 consensus_queue.cc:1059] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:34.366875  3356 consensus_queue.cc:260] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:34.377188  2893 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:34.367839  3257 consensus_queue.cc:1059] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:57:34.381641  3193 consensus_queue.cc:260] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:34.374099  3000 raft_consensus.cc:740] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:34.386567  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1180) took 1029 ms. Trace:
I20260709 12:57:34.365198  3276 consensus_queue.cc:1059] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
W20260709 12:57:34.387287  3206 consensus_meta.cc:287] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.822s	user 0.009s	sys 0.005s
I20260709 12:57:34.386940  3000 consensus_queue.cc:260] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:34.384841  3365 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:57:34.377010  3348 log.cc:927] Time spent T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:57:34.388695  3297 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:34.391830  3291 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:34.392167  3215 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:34.386945  1690 rpcz_store.cc:276] 0709 12:57:33.357534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:33.461465 (+103931us) service_pool.cc:224] Handling call
0709 12:57:33.461744 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:33.921965 (+460221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:34.386329 (+464364us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b540029b3d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:34.386511 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":888314624}
I20260709 12:57:34.395776  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:34.397945  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:34.398833  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:34.400663  1689 raft_consensus.cc:2393] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 6: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:34.401754  1690 raft_consensus.cc:2393] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 5: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:34.402443  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:34.405797  1684 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:34.390322  3316 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:34.386102  3151 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:34.406543  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:34.407197  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:34.388165  2925 consensus_meta.cc:287] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.503s	user 0.019s	sys 0.000s
I20260709 12:57:34.406723  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:34.407819  3276 raft_consensus.cc:3055] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:34.387656  3206 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:34.412616  2835 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:34.401783  3226 consensus_queue.cc:237] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:34.413107  2835 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:34.414279  3206 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:34.407148  3365 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:34.415067  3365 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:34.415148  2835 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:34.388455  3331 raft_consensus.cc:740] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:34.388181  3000 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:34.412428  3276 raft_consensus.cc:740] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:34.416178  3356 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:34.411492  3257 raft_consensus.cc:3055] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:34.423727  3331 consensus_queue.cc:260] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:34.420974  3276 consensus_queue.cc:260] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:34.416260  2925 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:34.421576  3316 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:34.440184  1534 raft_consensus.cc:2393] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 5: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 12:57:34.440586  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 201973us
W20260709 12:57:34.442062  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:34.430691  3257 raft_consensus.cc:740] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:34.440709  3164 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:34.456053  3331 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:34.473625  1655 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:34.437543  3366 consensus_queue.cc:1059] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:57:34.474285  3350 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:34.481860  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:34.488858  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 670) took 1066 ms. Trace:
I20260709 12:57:34.489336  1533 rpcz_store.cc:276] 0709 12:57:33.420044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:33.420908 (+   864us) service_pool.cc:224] Handling call
0709 12:57:33.421205 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:34.326172 (+904967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:34.486223 (+160051us) spinlock_profiling.cc:243] Waited 894 ms on lock 0x7b54003151d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:34.486431 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2055311104}
I20260709 12:57:34.491405  1533 raft_consensus.cc:1240] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:34.492033  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 690) took 1001 ms. Trace:
I20260709 12:57:34.492339  1533 rpcz_store.cc:276] 0709 12:57:33.490595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:34.490864 (+1000269us) service_pool.cc:224] Handling call
0709 12:57:34.491221 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:34.491797 (+   576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:34.491976 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:34.495313  2925 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:34.495195  3031 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:34.501976  1533 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:34.495419  3220 raft_consensus.cc:3055] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:57:34.500239  3243 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.010s	sys 0.016s
I20260709 12:57:34.506362   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:34.515996  1583 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:57:34.516760  3243 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.010s	sys 0.016s
I20260709 12:57:34.517239  1690 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:57:34.517745  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:34.519176  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:34.523581  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:34.523875  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:34.500011  3350 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:34.496565  3175 consensus_queue.cc:1059] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:57:34.525172  3367 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:34.487782  3257 consensus_queue.cc:260] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:34.504878  3220 raft_consensus.cc:740] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:34.532390  1583 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:34.537398  3203 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:57:34.543644  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:34.690927  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:34.529742  3307 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:34.577358  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:34.578300  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:34.522133  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:57:34.611327  3356 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:34.526033  3274 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:34.612739  1684 raft_consensus.cc:2410] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:57:34.527611  3175 consensus_queue.cc:1059] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 12:57:34.529392  3364 consensus_queue.cc:1059] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 12:57:34.625422  3375 raft_consensus.cc:3055] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:57:34.627127  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 223318us
I20260709 12:57:34.705914  3331 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:34.628453  3220 consensus_queue.cc:260] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:34.632990  3243 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:34.644385  1690 raft_consensus.cc:2410] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:57:34.667953  3365 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:34.684746  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 208886us
W20260709 12:57:34.637153  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 268559us
I20260709 12:57:34.686648  3193 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:34.687259  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 1165) took 1469 ms. Trace:
I20260709 12:57:34.731086  1691 raft_consensus.cc:2393] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 5: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 12:57:34.689206  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 156917us
I20260709 12:57:34.710598  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:34.630995  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1179) took 1334 ms. Trace:
I20260709 12:57:34.722606  3375 raft_consensus.cc:740] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:57:34.723695  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:34.710558  3307 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:34.726717  2302 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 5 LEARNER]: Advancing to term 6
I20260709 12:57:34.718722  2301 raft_consensus.cc:2393] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 5: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:57:34.731204  1685 rpcz_store.cc:276] 0709 12:57:33.217565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:33.233826 (+ 16261us) service_pool.cc:224] Handling call
0709 12:57:34.687008 (+1453182us) spinlock_profiling.cc:243] Waited 41 ms on lock 0x7b54000deb54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:34.687170 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94366080}
I20260709 12:57:34.732451  1682 rpcz_store.cc:276] 0709 12:57:33.296154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:33.422163 (+126009us) service_pool.cc:224] Handling call
0709 12:57:33.422519 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:33.424999 (+  2480us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 12:57:33.425036 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:33.425550 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 12:57:34.295152 (+869602us) spinlock_profiling.cc:243] Waited 8.6 ms on lock 0x7b18002e8d60. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf10d1 00007fc85d00ca0f
0709 12:57:34.501175 (+206023us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:34.501211 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:34.501273 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:34.630697 (+129424us) raft_consensus.cc:1685] finished
0709 12:57:34.630718 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:34.630930 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7823,"raft.queue_time_us":3275,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":11636,"spinlock_wait_cycles":19777920,"thread_start_us":205851,"threads_started":1,"wal-append.queue_time_us":1173675}
I20260709 12:57:34.734433  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:34.739142  1683 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:34.737880  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42356 (request call id 45) took 1299 ms. Trace:
I20260709 12:57:34.731956  1583 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:57:34.731177  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:34.714785  3356 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:34.739398  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:34.739939  1534 rpcz_store.cc:276] 0709 12:57:33.438245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:34.069962 (+631717us) service_pool.cc:224] Handling call
0709 12:57:34.737633 (+667671us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b5400186ad4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:34.737793 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":831084928}
I20260709 12:57:34.741063  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:34.728312  3377 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:34.734375  3307 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:34.744102  3331 consensus_queue.cc:1059] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:57:34.753930  3331 raft_consensus.cc:3055] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:34.754331  3331 raft_consensus.cc:740] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:34.755203  3311 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:34.756783  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:34.752580  3365 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:34.757040  3375 consensus_queue.cc:260] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:34.752110  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:34.759012  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:34.759498  3356 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:34.759842  1685 raft_consensus.cc:2393] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 6: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:34.757452  1682 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:34.757789  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1165) took 1181 ms. Trace:
I20260709 12:57:34.761153  1533 rpcz_store.cc:276] 0709 12:57:33.576447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:34.504631 (+928184us) service_pool.cc:224] Handling call
0709 12:57:34.504964 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:34.522920 (+ 17956us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:34.522960 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:34.523519 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 12:57:34.684872 (+161353us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:34.684916 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:34.684987 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:34.757556 (+ 72569us) raft_consensus.cc:1685] finished
0709 12:57:34.757575 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:34.757734 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":3330,"thread_start_us":75979,"threads_started":1,"wal-append.queue_time_us":130159}
I20260709 12:57:34.762804  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:34.763320  1533 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:57:34.750408  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:34.760720  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:34.732111  3220 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:34.732287  3000 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:34.766778  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:34.769537  3000 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:34.764844  3365 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:34.776669  3305 raft_consensus.cc:3055] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:34.756798  3215 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:34.784098  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:34.785442  3000 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:34.786823  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:34.794341  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:34.789291  1535 raft_consensus.cc:1240] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:34.744534  3260 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:34.731105  3243 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:34.795521  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 689) took 1310 ms. Trace:
I20260709 12:57:34.806371  3260 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:34.797312  3255 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:34.797297  1533 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:34.806979  3260 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:34.797940  3365 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:34.793726  3305 raft_consensus.cc:740] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:34.808614  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 693) took 1232 ms. Trace:
I20260709 12:57:34.809365  3305 consensus_queue.cc:260] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:34.810302  1689 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:34.810572  1534 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:34.808328  3362 consensus_queue.cc:260] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:34.812065  3362 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:34.813336  3243 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:34.806679  1535 rpcz_store.cc:276] 0709 12:57:33.484951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:34.262693 (+777742us) service_pool.cc:224] Handling call
0709 12:57:34.263056 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:34.789137 (+526081us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b5400213f20. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85cfc8dc0 00007fc85d0531c0 00007fc85d054231 00007fc85d050d8f 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c
0709 12:57:34.795240 (+  6103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:34.795461 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78960000}
I20260709 12:57:34.814999  1535 raft_consensus.cc:1240] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:34.748102  2269 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:34.815583  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 694) took 1237 ms. Trace:
I20260709 12:57:34.801554  1683 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:34.817364  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:34.818578  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:34.804709  3215 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:34.755213  3331 consensus_queue.cc:260] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:34.820060  3331 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:34.821218  3215 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:34.797668  3274 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:34.822930  3290 raft_consensus.cc:3055] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:34.823005  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:34.823488  3290 raft_consensus.cc:740] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:34.823763  1505 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:34.824419  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:34.825400  1612 raft_consensus.cc:1240] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6. Ops: []
W20260709 12:57:34.816146  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 81067.1us
I20260709 12:57:34.829247  1608 raft_consensus.cc:1240] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:34.821765  3136 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:34.829844  3136 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:34.828563  1611 raft_consensus.cc:1240] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:34.830255  3136 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:34.825573  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:34.831673  2996 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:34.832156  2996 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:34.809001  1533 rpcz_store.cc:276] 0709 12:57:33.576664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:34.807754 (+1231090us) service_pool.cc:224] Handling call
0709 12:57:34.808077 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:34.808249 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:34.808274 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:34.808316 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:34.808345 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:34.808405 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:34.808548 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:34.833611  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:34.816001  1535 rpcz_store.cc:276] 0709 12:57:33.578177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:34.814516 (+1236339us) service_pool.cc:224] Handling call
0709 12:57:34.814832 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:34.815351 (+   519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:34.815530 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:34.809909  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:34.829147  1612 raft_consensus.cc:1240] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:34.816440  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 670) took 3530 ms. Trace:
I20260709 12:57:34.833984  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:34.842329  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1166) took 1180 ms. Trace:
I20260709 12:57:34.842785  1533 rpcz_store.cc:276] 0709 12:57:33.661741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:34.841528 (+1179787us) service_pool.cc:224] Handling call
0709 12:57:34.841850 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:34.842013 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:34.842037 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:34.842078 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:34.842106 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:34.842157 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:34.842273 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:34.835018  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:34.837477  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:34.836830  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:34.837281  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:34.844913  1533 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:57:34.845562  1617 raft_consensus.cc:2410] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:57:34.846779  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:34.846570  1582 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:34.849260  1615 rpcz_store.cc:276] 0709 12:57:31.285911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:31.906681 (+620770us) service_pool.cc:224] Handling call
0709 12:57:31.918827 (+ 12146us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:31.919171 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:31.919202 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:31.919636 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 12:57:33.287506 (+1367870us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:33.287543 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:33.287609 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:34.085391 (+797782us) raft_consensus.cc:1685] finished
0709 12:57:34.085410 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:34.816189 (+730779us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b54001f63d0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:34.816381 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":656,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":23756,"spinlock_wait_cycles":27218176,"thread_start_us":1358857,"threads_started":1,"wal-append.queue_time_us":1495849}
I20260709 12:57:34.861783  1617 raft_consensus.cc:1240] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:34.845559  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1167) took 1178 ms. Trace:
I20260709 12:57:34.863220  1533 rpcz_store.cc:276] 0709 12:57:33.667013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:34.844363 (+1177350us) service_pool.cc:224] Handling call
0709 12:57:34.844701 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:34.845317 (+   616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:34.845510 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:34.864921  1609 raft_consensus.cc:1240] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:57:34.822006  1685 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
W20260709 12:57:34.835166  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:34.866122  1533 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:57:34.810405  3305 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:34.868348  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:34.868853  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:34.768821  3377 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:34.821914  3367 raft_consensus.cc:3055] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:34.873483  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:34.881125  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:34.885464  1691 raft_consensus.cc:2376] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4. Re-sending same reply.
I20260709 12:57:34.879207  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:34.887871  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:34.889128  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:34.878086  1616 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:34.874743  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:34.883181  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:34.867982  3243 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:34.836437  2996 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:57:34.890515  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:34.866765  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:34.872253  3299 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:34.887039  3215 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:34.903903  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:34.904740  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:34.883827  1609 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:34.895998  1535 raft_consensus.cc:1240] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:34.891716  1613 raft_consensus.cc:2393] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 4: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:34.897423  1683 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:34.898221  1615 raft_consensus.cc:2393] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 5: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:34.824303  3290 consensus_queue.cc:260] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:34.900588  3226 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:34.901235  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:34.901719  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:34.907976  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:34.909019  1655 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:34.911919  1691 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:34.884985  3367 raft_consensus.cc:740] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:34.916994  1617 raft_consensus.cc:1275] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:34.938072  1612 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:34.948875  1616 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:57:34.916659  3220 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:34.919598  3290 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:34.958776  1691 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 5.
I20260709 12:57:34.903119  3000 consensus_queue.cc:1059] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:57:34.903228  3255 consensus_queue.cc:1059] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:57:34.901129  3243 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:34.916555  3336 consensus_queue.cc:1059] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:57:34.911185  3215 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:34.948518  3341 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:34.979176  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:34.919041  3226 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:34.996083  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:34.997251  1617 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:57:34.998894  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:34.977914  3220 raft_consensus.cc:697] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:34.990657  3000 consensus_queue.cc:1243] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:57:34.996086  3336 consensus_queue.cc:1243] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:57:35.003528  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:35.050213  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:34.992431  3341 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:35.054752  1541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 1154) took 1873 ms (client timeout 1613 ms). Trace:
W20260709 12:57:35.055250  1541 rpcz_store.cc:269] 0709 12:57:33.181265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:33.190905 (+  9640us) service_pool.cc:224] Handling call
0709 12:57:35.054516 (+1863611us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400186fd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:35.054660 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3241869184}
I20260709 12:57:35.056088  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:35.057367  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:35.060979  1541 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:57:35.064625  3226 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:35.065354  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 44) took 1647 ms. Trace:
I20260709 12:57:35.064999  3220 consensus_queue.cc:237] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:35.065806  1536 rpcz_store.cc:276] 0709 12:57:33.418215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:33.418943 (+   728us) service_pool.cc:224] Handling call
0709 12:57:33.439586 (+ 20643us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:33.750077 (+310491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:33.750107 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:33.750144 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:33.750173 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:35.065121 (+1314948us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54003138d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:35.065170 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:35.065298 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":713695488}
I20260709 12:57:35.067526  3333 raft_consensus.cc:3055] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:35.067978  3333 raft_consensus.cc:740] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:35.068944  3333 consensus_queue.cc:260] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:35.070222  3333 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:35.073469  3243 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:35.074995  3215 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:35.076509  1539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 1144) took 1955 ms (client timeout 2420 ms). Trace:
I20260709 12:57:35.077262  3242 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:35.077821  1537 raft_consensus.cc:1240] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:57:35.077864  3242 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:35.080556  3242 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:35.080752  1611 raft_consensus.cc:2393] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 6: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:35.081290  3365 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:35.082427  1534 raft_consensus.cc:1240] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:35.077028  3341 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:35.083609  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:35.088590  1609 raft_consensus.cc:1240] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:35.073537  1608 raft_consensus.cc:2410] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:57:35.094398  1609 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:57:35.089834  3257 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:35.100450  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:35.076954  1539 rpcz_store.cc:269] 0709 12:57:33.120993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:33.122226 (+  1233us) service_pool.cc:224] Handling call
0709 12:57:35.076268 (+1954042us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540010c7d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:35.076419 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2315293440}
W20260709 12:57:35.103055  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:35.104329  2996 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:35.110167  2302 raft_consensus.cc:1240] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:57:35.111538  1617 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:35.112601  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:35.112733  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:35.113272  1690 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:35.113549  1688 raft_consensus.cc:2393] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 4: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:35.114212  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:35.114616  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:35.115800  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:35.116165  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:35.118192  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:35.118963  1536 raft_consensus.cc:2393] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 5: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:35.120007  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:35.120728  1688 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:35.114804  1690 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:35.125027  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:35.125779  1690 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:35.126729  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:35.123831  1654 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:35.129606  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 187103us
I20260709 12:57:35.133150  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:35.136569  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:35.137651  2298 raft_consensus.cc:2393] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 5: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:57:35.138979  3260 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:35.130927  3196 consensus_queue.cc:1059] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:57:35.142597  2996 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:35.144713  3350 raft_consensus.cc:3055] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:35.145201  3350 raft_consensus.cc:740] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:35.145362  3136 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:35.146178  3350 consensus_queue.cc:260] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:35.147265  3350 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:35.148826  1611 raft_consensus.cc:1240] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:35.157047  3196 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:57:35.158190  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:35.160403  2924 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:57:35.167395  1540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 685) took 1732 ms (client timeout 1904 ms). Trace:
W20260709 12:57:35.167917  1540 rpcz_store.cc:269] 0709 12:57:33.435075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:33.932118 (+497043us) service_pool.cc:224] Handling call
0709 12:57:35.167156 (+1235038us) spinlock_profiling.cc:243] Waited 47.2 ms on lock 0x7b54001874d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:35.167315 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108617984}
I20260709 12:57:35.172796  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 690) took 3254 ms. Trace:
I20260709 12:57:35.173239  1610 rpcz_store.cc:276] 0709 12:57:31.918097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:33.288738 (+1370641us) service_pool.cc:224] Handling call
0709 12:57:33.289054 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:34.243611 (+954557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:35.172551 (+928940us) spinlock_profiling.cc:243] Waited 923 ms on lock 0x7b54002ff154. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:35.172733 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2123164032}
I20260709 12:57:35.175988  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:35.176995  1534 raft_consensus.cc:1240] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 4. Current term is 5. Ops: []
W20260709 12:57:35.178479  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:35.189857  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 65940.2us
I20260709 12:57:35.174572  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:35.192129  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:35.193763  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:35.193660  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:35.195683  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:35.196692  1540 raft_consensus.cc:2410] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 7 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 12:57:35.197371  1534 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:35.197314  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:35.199018  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:35.199148  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:35.199656  1539 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:35.200780  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:35.201601  1610 raft_consensus.cc:2368] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4.
I20260709 12:57:35.191757  3174 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:35.202529  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:35.193645  1654 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:35.195106  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:35.206009  1610 raft_consensus.cc:2393] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 5: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:35.192233  1535 raft_consensus.cc:2955] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:35.203161  1581 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:35.224222  1617 raft_consensus.cc:2393] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 5: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:35.212354  1534 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
W20260709 12:57:35.220193  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 142806us
I20260709 12:57:35.229054  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:35.210747  1540 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:57:35.230831  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:35.230515  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:35.208376  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:35.234397  1508 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:35.237046  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:35.238080  1536 raft_consensus.cc:2393] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 6: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 12:57:35.203222  3388 log.cc:927] Time spent T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:57:35.230615  1534 raft_consensus.cc:1275] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:35.235976  1508 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:35.247429  3220 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:35.236912  3343 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:35.207226  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:35.266203  1688 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:57:35.231988  1617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:57:35.267827  1617 raft_consensus.cc:606] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:35.225159  3203 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:35.223340  3215 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:35.265671  3273 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:35.203070  3132 consensus_queue.cc:1059] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 12:57:35.202347  3174 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:35.272176  1610 raft_consensus.cc:2393] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 5: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:35.268224  1617 raft_consensus.cc:614] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:35.275066  1536 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:57:35.207161  1654 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:35.279886  1534 raft_consensus.cc:1275] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:35.268447  1539 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:35.283800  1540 raft_consensus.cc:1275] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:57:35.276492  1541 raft_consensus.cc:1275] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:57:35.289507  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 86446.8us
I20260709 12:57:35.271760  1508 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:35.285351  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:35.292162  1688 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:35.292460  1508 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:35.292330  1610 raft_consensus.cc:1240] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3. Ops: []
W20260709 12:57:35.295013  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:35.298374  1610 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:57:35.301097  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:35.301908  1581 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:35.302804  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:35.304525  3307 consensus_meta.cc:287] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.003s
I20260709 12:57:35.273167  3220 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:35.322229  3220 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:35.319653  3307 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:35.324762  1613 raft_consensus.cc:1240] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:35.309696  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:35.326485  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:35.312040  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 43) took 1894 ms. Trace:
I20260709 12:57:35.328188  3151 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:35.328943  3151 raft_consensus.cc:697] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:35.313175  3260 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:35.318235  3299 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:35.330021  3151 consensus_queue.cc:237] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:35.332547  1682 raft_consensus.cc:2410] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:57:35.333642  1581 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:35.334419  3299 raft_consensus.cc:2804] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:35.329244  3307 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:35.334830  3299 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:35.301311  3285 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:35.344198  1581 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:35.328007  1537 rpcz_store.cc:276] 0709 12:57:33.417885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:33.418551 (+   666us) service_pool.cc:224] Handling call
0709 12:57:35.077554 (+1659003us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:35.091041 (+ 13487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:35.311746 (+220705us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b540010c7d0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:35.311951 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3814915328}
W20260709 12:57:35.346896  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 54513.5us
W20260709 12:57:35.274188  3363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.005s	sys 0.021s
W20260709 12:57:35.279945  3209 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.972s	user 0.008s	sys 0.017s
I20260709 12:57:35.352945  1508 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:35.273576  2996 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:35.355726  1508 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:35.358719  1508 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:35.359670  1688 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:35.360455  1617 raft_consensus.cc:1240] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:57:35.356376  3363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.006s	sys 0.022s
I20260709 12:57:35.363286  1508 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:35.365236  1508 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:35.351261  3243 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:57:35.356889  3209 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.057s	user 0.008s	sys 0.017s
I20260709 12:57:35.352627  3377 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:35.365556  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 162538us
I20260709 12:57:35.362874  3285 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:35.282886  3203 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:35.372884  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 165836us
I20260709 12:57:35.353011  3299 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:35.356746  3345 raft_consensus.cc:3055] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:35.361192  3260 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:35.371191  1583 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:35.369158  2996 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:35.356551  3305 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:35.350747  3307 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:35.392042  1654 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:35.398854  1654 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:35.367677  3343 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:35.366043  3351 raft_consensus.cc:2764] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:57:35.369179  3136 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:35.383728  3363 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:35.418548  3333 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:35.389290  3345 raft_consensus.cc:740] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:35.419925  3377 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:35.420095  3345 consensus_queue.cc:260] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:35.421304  3345 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:35.403556  3343 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:35.422875  3343 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:35.430790  1609 raft_consensus.cc:1240] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: [4.2-4.2]
W20260709 12:57:35.431329  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:35.431768  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:35.432734  1654 leader_election.cc:400] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4.
I20260709 12:57:35.433089  1654 leader_election.cc:403] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:57:35.436578  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:35.437216  1617 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:35.421250  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:35.437794  1682 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:35.438467  1613 raft_consensus.cc:1240] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 5. Current term is 6. Ops: []
W20260709 12:57:35.438560  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:35.438349  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:35.439318  1654 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:35.441430  2826 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:35.438623  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:35.452630  1609 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:35.453776  3364 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:35.458160  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:35.458411  1505 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:35.458818  1683 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:35.459472  3257 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:35.461148  2996 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:35.461499  3270 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:35.461694  2996 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:35.463840  2996 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:35.455514  3363 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4.
I20260709 12:57:35.448939  3351 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:35.470983  3351 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:35.473349  3351 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:35.477383  1505 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:57:35.478662  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:35.485342  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 114219us
W20260709 12:57:35.484596  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 172486us
I20260709 12:57:35.439911  3397 consensus_queue.cc:1059] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:35.457957  3377 consensus_queue.cc:1059] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:35.489993  1508 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:35.449195  3307 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:35.491792  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:35.492880  1613 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:57:35.417755  2964 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 12:57:35.514096  1508 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:35.514528  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:35.515455  1508 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:35.516515  1508 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:35.484675  3351 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:35.518689  1655 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:35.519538  1617 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:57:35.490816  3305 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:57:35.528016  3393 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:57:35.513572  3285 consensus_queue.cc:1059] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:57:35.532053  3380 raft_consensus.cc:3055] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:35.532503  3380 raft_consensus.cc:740] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:35.532905  3307 raft_consensus.cc:697] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:35.533350  3380 consensus_queue.cc:260] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:35.533883  3307 consensus_queue.cc:237] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:35.534539  3380 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:35.510028  3225 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:57:35.536983  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:35.537125  3225 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:35.510774  3265 consensus_queue.cc:1048] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:57:35.539076  3362 raft_consensus.cc:1064] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
W20260709 12:57:35.539546  3362 raft_consensus.cc:1068] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d: Unable to promote non-voter 1d6516ff61104bdda54bde95e92fe579: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:57:35.526234  3174 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:35.526110  3364 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:35.502564  3363 consensus_queue.cc:1059] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:57:35.540213  3377 raft_consensus.cc:1064] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
W20260709 12:57:35.540704  3377 raft_consensus.cc:1068] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d: Unable to promote non-voter 1d6516ff61104bdda54bde95e92fe579: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:57:35.532096  3285 consensus_queue.cc:1243] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer c262eac7fc904ae9bb91e450f6532e3f log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:57:35.527364  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:35.543743  1683 raft_consensus.cc:2410] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:57:35.517808  3243 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:57:35.520769  3290 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:35.546559  3364 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:35.550871  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:35.528462  3132 consensus_queue.cc:1059] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:35.553215  3364 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:35.530260  3120 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:35.530668  3260 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:35.485679  3274 consensus_queue.cc:1059] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:57:35.480660  3270 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:35.527977  3220 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:35.519515  1508 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:35.507477  1682 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 7.
W20260709 12:57:35.558426  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:35.559588  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 23) took 2013 ms. Trace:
W20260709 12:57:35.559932  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 156314us
W20260709 12:57:35.561523  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 50710.9us
I20260709 12:57:35.544876  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:35.560854  3246 consensus_queue.cc:1059] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:35.523010  3320 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:35.521348  3351 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:35.521479  2996 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:57:35.565299  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:35.569247  1683 raft_consensus.cc:2393] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 5: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
W20260709 12:57:35.569093  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 49661.8us
I20260709 12:57:35.571444  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:35.562333  3120 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:35.573699  1581 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:35.580904  1538 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:35.568346  1614 rpcz_store.cc:276] 0709 12:57:33.546116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:33.912855 (+366739us) service_pool.cc:224] Handling call
0709 12:57:33.913167 (+   312us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:57:33.922064 (+  8897us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:33.922101 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:57:33.922659 (+   558us) log.cc:844] Serialized 52 byte log entry
0709 12:57:34.173830 (+251171us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:35.447584 (+1273754us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b180039a2a0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc85cbf94bc 00007fc859f4748b 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f61455 00007fc860a493c7 00007fc85d05b9a7 00007fc85d06b0bf
0709 12:57:35.447741 (+   157us) log.cc:844] Serialized 14 byte log entry
0709 12:57:35.559193 (+111452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:35.559267 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:35.559314 (+    47us) raft_consensus.cc:1685] finished
0709 12:57:35.559389 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:35.559523 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8721,"prepare.queue_time_us":131071,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":8439,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":7907,"spinlock_wait_cycles":5140864,"thread_start_us":307463,"threads_started":3,"wal-append.queue_time_us":235146,"wal-append.run_cpu_time_us":2311,"wal-append.run_wall_time_us":1050376}
I20260709 12:57:35.576880  1682 raft_consensus.cc:2410] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:57:35.584465  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:35.586061  3154 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:35.569056  3220 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:35.577047  1508 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:35.621706  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:35.572619  3210 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:57:35.633091  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 56126.5us
I20260709 12:57:35.649310  1508 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:35.575358  2996 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:35.635571  1539 raft_consensus.cc:1240] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:35.581434  3164 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:35.652396  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:35.575080  3351 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:35.572046  3320 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:35.649506  1535 raft_consensus.cc:1240] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:57:35.606849  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:35.651374  1614 raft_consensus.cc:1240] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:57:35.595208  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:35.587673  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:35.636564  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:35.637938  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 64308.7us
I20260709 12:57:35.660912  1541 raft_consensus.cc:2368] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4.
I20260709 12:57:35.661170  1581 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:35.661550  1540 raft_consensus.cc:2410] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:35.631448  3220 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:35.655472  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:35.664450  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:35.653457  1537 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:35.658473  1611 raft_consensus.cc:1240] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:35.658730  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:35.662618  1541 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:57:35.663367  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:35.664680  1682 raft_consensus.cc:2393] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 5: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:35.666127  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:35.569257  3276 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:35.666810  1537 raft_consensus.cc:2393] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 5: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:35.664546  3154 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:35.667413  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:35.659281  3164 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:35.644898  3136 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:35.645673  3285 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:35.650534  3402 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:35.669080  1541 raft_consensus.cc:1240] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:57:35.670382  1581 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:35.666070  3320 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:35.653275  2996 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:35.690366  1541 raft_consensus.cc:1240] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:57:35.675300  2925 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:35.692005  1508 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:35.693275  1508 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:35.695698  1508 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:35.674889  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:35.675441  3405 log.cc:927] Time spent T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:57:35.675930  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:35.676369  1614 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:57:35.677754  3225 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:35.679430  3367 consensus_queue.cc:260] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:35.679998  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:35.682309  3343 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:35.682936  1683 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:35.688628  1581 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:35.720002  1581 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:35.714373  1614 pending_rounds.cc:85] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f: Aborting all ops after (but not including) 3
I20260709 12:57:35.720899  1614 pending_rounds.cc:107] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:57:35.721213  1614 raft_consensus.cc:2889] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:35.722175  1581 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:35.581956  3120 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:35.676537  3136 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:35.588255  3246 consensus_queue.cc:1059] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.106s
I20260709 12:57:35.728829  3246 raft_consensus.cc:3055] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:35.729180  3246 raft_consensus.cc:740] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:35.730013  3246 consensus_queue.cc:260] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:35.731150  3246 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:57:35.732544  3285 consensus_queue.cc:1175] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4487a53c51be4634bf1ef29c5248353d" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 12:57:35.733848  1583 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:35.696848  3243 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:35.705456  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:35.697127  3242 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:35.694330  2925 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:35.709748  3257 raft_consensus.cc:3055] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:35.710578  3333 raft_consensus.cc:1064] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:57:35.711424  1687 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:35.713912  3401 raft_consensus.cc:3055] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:35.714561  1686 raft_consensus.cc:2410] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:57:35.716639  3290 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:35.724704  1581 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:35.766481  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1162) took 2281 ms. Trace:
I20260709 12:57:35.766862  1542 rpcz_store.cc:276] 0709 12:57:33.485495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:34.294282 (+808787us) service_pool.cc:224] Handling call
0709 12:57:35.168905 (+874623us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:35.169127 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:35.169158 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:35.169240 (+    82us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:35.169282 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:35.169348 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:35.766300 (+596952us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b54001874d0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:35.766422 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1982630656}
I20260709 12:57:35.726070  3367 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:35.727011  3260 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:35.674150  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:57:35.737793  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:35.683930  3299 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:35.818682  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:35.824100  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:35.824914  1609 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 5.
I20260709 12:57:35.855522  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:35.856446  1682 raft_consensus.cc:2410] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:35.750454  3154 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:35.745419  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:35.745235  2826 consensus_queue.cc:1059] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:35.746675  3136 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:35.747138  2925 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:35.748764  3376 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:35.751143  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:35.757722  3265 raft_consensus.cc:3055] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:35.901995  1688 raft_consensus.cc:2410] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:57:35.711478  3351 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:35.739763  3331 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:35.752853  3380 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:35.755182  3305 raft_consensus.cc:3055] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:57:35.756083  1538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 1171) took 1621 ms (client timeout 1875 ms). Trace:
W20260709 12:57:35.915648  1538 rpcz_store.cc:269] 0709 12:57:34.134707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:34.161266 (+ 26559us) service_pool.cc:224] Handling call
0709 12:57:35.755909 (+1594643us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b5400247554. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:35.756021 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3222454016}
W20260709 12:57:35.756664  3209 consensus_queue.cc:1175] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c262eac7fc904ae9bb91e450f6532e3f" responder_term: 3 status { last_received { term: 3 index: 2 } last_committed_idx: 1 last_received_current_leader { term: 3 index: 2 } }
I20260709 12:57:35.757652  2996 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:35.741689  3307 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:57:35.759541  1534 raft_consensus.cc:1217] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Deduplicated request from leader. Original: 1.1->[4.2-4.2]   Dedup: 4.2->[]
I20260709 12:57:35.816030  3397 consensus_queue.cc:1048] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.094s
I20260709 12:57:35.907229  3364 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:35.725006  3206 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:35.817886  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:35.740739  1614 raft_consensus.cc:1240] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:35.957816  1611 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:35.958690  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:35.959924  1581 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.875s (SENT) [suppressed 24 similar messages]
W20260709 12:57:35.872246  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:35.781061  1683 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
W20260709 12:57:35.894910  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:35.899775  1508 leader_election.cc:336] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 1.554s (SENT)
I20260709 12:57:35.899952  1542 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:35.902845  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:35.785928  3333 raft_consensus.cc:1068] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d: Unable to promote non-voter 1d6516ff61104bdda54bde95e92fe579: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:57:35.742960  3393 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.131s
I20260709 12:57:35.907552  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:35.965926  1505 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:35.903951  3225 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:35.751219  3345 consensus_queue.cc:1059] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.149s
I20260709 12:57:35.764925  3210 raft_consensus.cc:697] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:35.762311  3401 raft_consensus.cc:740] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:35.901100  3132 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:35.920740  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:57:36.012737  1609 raft_consensus.cc:606] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:35.783473  3174 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:35.921094  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:35.760326  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:35.903892  3347 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:35.922881  1534 raft_consensus.cc:1240] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:57:35.898763  3270 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:35.917392  3305 raft_consensus.cc:740] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:35.904114  3265 raft_consensus.cc:740] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:35.925493  2996 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:35.898090  2267 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:35.930316  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:36.033209  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:35.935824  1608 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:57:35.932941  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:35.943244  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:35.933151  2925 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:35.944171  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:35.932942  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:35.917129  3380 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:35.953034  3406 log.cc:927] Time spent T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 12:57:35.954288  3351 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:35.955852  3343 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:35.750734  3257 raft_consensus.cc:740] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:35.963358  1682 raft_consensus.cc:2410] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:57:35.784987  3404 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:35.959563  1614 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:36.061292  1614 raft_consensus.cc:1240] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 4. Current term is 5. Ops: []
W20260709 12:57:35.965251  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 65530.8us
I20260709 12:57:35.966064  1688 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:57:36.062501  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:36.063112  1508 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:35.977221  1611 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 7.
I20260709 12:57:35.966575  1655 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:35.968573  1617 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 4. Current term is 5. Ops: []
W20260709 12:57:35.981585  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 210580us
I20260709 12:57:36.063300  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:36.065775  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:36.017879  3132 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.015542  2989 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:57:36.015425  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 50817.5us
I20260709 12:57:36.019148  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:36.018694  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:35.967233  3377 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:35.977016  3333 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:57:36.028961  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 69071.4us
I20260709 12:57:36.042972  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:35.967473  3376 consensus_queue.cc:1059] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:57:35.964855  3364 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:36.044957  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 1186) took 1649 ms. Trace:
I20260709 12:57:36.051697  2925 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:36.037739  3402 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:36.063364  1682 raft_consensus.cc:2393] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 4: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:36.066856  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:36.015106  3345 consensus_queue.cc:1243] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer c262eac7fc904ae9bb91e450f6532e3f log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:57:36.054167  3393 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.030261  3347 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.014876  3225 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.073511  1539 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:36.084875  1686 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:36.073908  1508 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:36.102046  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:36.102854  1686 raft_consensus.cc:2410] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:36.073946  1505 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:36.087469  1687 rpcz_store.cc:276] 0709 12:57:34.395386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:34.406936 (+ 11550us) service_pool.cc:224] Handling call
0709 12:57:36.044755 (+1637819us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54003377d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:36.044887 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2997969664}
I20260709 12:57:36.094136  1688 raft_consensus.cc:2410] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:57:36.105652  2266 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:36.068665  3299 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:36.072788  2989 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:36.096873  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:36.115958  1682 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:36.106853  3425 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:36.088361  2996 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:36.112635  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:36.114428  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:36.121991  1609 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:36.119022  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 45224.7us
I20260709 12:57:36.124419  1508 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:36.127888  1508 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:36.136227  3417 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:36.138195  1682 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:57:36.139775  1609 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:36.138406  3417 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:36.141340  3417 raft_consensus.cc:697] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 7 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:57:36.142640  1682 raft_consensus.cc:1240] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 5. Current term is 7. Ops: []
I20260709 12:57:36.142603  3417 consensus_queue.cc:237] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:36.145486  1508 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:36.146742  1508 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:36.151382  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:36.162573  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:57:36.162644  1508 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:36.100905  3345 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:36.163440  1609 raft_consensus.cc:606] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:36.068882  3305 consensus_queue.cc:260] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.170336  1609 raft_consensus.cc:614] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:36.153851  1539 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 7.
I20260709 12:57:36.118759  2989 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:36.118407  2925 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:57:36.090652  3377 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.182672  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:36.093768  3120 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.094197  3333 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:36.180199  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:36.173228  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 67653.8us
I20260709 12:57:36.129079  2996 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:36.132747  3216 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:36.081521  3210 consensus_queue.cc:237] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.187260  1609 raft_consensus.cc:1240] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:36.167795  3303 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:36.169021  3351 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:36.128206  3343 consensus_queue.cc:1059] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:57:36.170629  3290 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:36.173554  3243 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:36.100550  3393 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.143774  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 956) took 1405 ms. Trace:
I20260709 12:57:36.200977  1682 rpcz_store.cc:276] 0709 12:57:34.738416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:36.141450 (+1403034us) service_pool.cc:224] Handling call
0709 12:57:36.142440 (+   990us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:36.143475 (+  1035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:36.143710 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:36.202455  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:36.203599  1682 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:36.188627  3305 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:36.190096  3247 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:36.133520  3425 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:36.190827  3303 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:36.191994  2925 raft_consensus.cc:697] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:36.188896  2996 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:36.193652  3429 consensus_queue.cc:1059] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:57:36.222219  3303 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:36.227416  2925 consensus_queue.cc:237] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:36.230576  3424 log.cc:927] Time spent T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:57:36.232846  3429 raft_consensus.cc:3055] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:36.233314  3429 raft_consensus.cc:740] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:57:36.234146  3120 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:36.236428  3312 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.236999  3312 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.234174  3429 consensus_queue.cc:260] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:36.238575  3429 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:36.198979  3243 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:36.220264  1608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:57:36.254050  1608 raft_consensus.cc:606] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
W20260709 12:57:36.194180  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 377648us
I20260709 12:57:36.256517  2267 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:36.257028  3154 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:36.239127  3312 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:36.239677  3196 raft_consensus.cc:3055] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:36.258226  3196 raft_consensus.cc:740] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:36.258818  3425 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:36.259852  3347 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:36.261196  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:36.259070  3196 consensus_queue.cc:260] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:36.240015  3320 consensus_meta.cc:287] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.000s
I20260709 12:57:36.240334  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:36.257895  3433 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:36.240618  2996 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.241681  3393 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:36.241906  3364 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:36.242094  3410 log.cc:927] Time spent T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
W20260709 12:57:36.242367  3415 log.cc:927] Time spent T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:57:36.245290  3333 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:36.219544  1682 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:57:36.290469  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:57:36.254758  3414 log.cc:927] Time spent T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.194s	user 0.002s	sys 0.000s
I20260709 12:57:36.256877  3243 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:36.288081  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:36.266075  3220 consensus_meta.cc:287] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.573s	user 0.010s	sys 0.000s
I20260709 12:57:36.298629  3377 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:36.298031  3220 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.300841  3432 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:36.292941  3203 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:36.301870  1688 raft_consensus.cc:2393] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 6: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:36.301506  3432 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:36.288661  3421 log.cc:927] Time spent T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
W20260709 12:57:36.306340  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:36.291528  3349 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:36.289992  3418 log.cc:927] Time spent T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.137s	user 0.001s	sys 0.001s
I20260709 12:57:36.283751  3120 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.303895  1682 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:57:36.304978  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 338484us
I20260709 12:57:36.307644  1686 raft_consensus.cc:1240] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:36.324365  1655 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:36.291893  1508 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:36.327222  1655 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:36.327566  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:36.312286  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:36.313091  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:36.329645  1688 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:36.289836  3132 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:36.322036  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:36.317119  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:36.328292  1508 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:36.334730  1683 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:36.331202  1655 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:36.285188  3320 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.333961  1682 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:57:36.340890  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:36.341917  3225 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:36.333314  3247 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:36.319216  3349 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.355194  1655 leader_election.cc:400] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4.
I20260709 12:57:36.354736  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1197) took 1839 ms. Trace:
I20260709 12:57:36.357470  1655 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:36.357071  1689 rpcz_store.cc:276] 0709 12:57:34.515137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:35.353713 (+838576us) service_pool.cc:224] Handling call
0709 12:57:35.354051 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:35.354386 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:35.354412 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:36.049530 (+695118us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b2c00128aa8. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85b94aa11 00007fc85b95a372 00007fc85d08ca01 00007fc85d05143a 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2
0709 12:57:36.056324 (+  6794us) log.cc:844] Serialized 26 byte log entry
0709 12:57:36.207514 (+151190us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:36.207644 (+   130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:36.208178 (+   534us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:36.354421 (+146243us) raft_consensus.cc:1685] finished
0709 12:57:36.354444 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:36.354670 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2118,"raft.queue_time_us":632,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":7140,"spinlock_wait_cycles":28606720,"thread_start_us":112262,"threads_started":1,"wal-append.queue_time_us":162258}
I20260709 12:57:36.330288  3393 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:36.366164  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:36.368320  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:36.367221  1655 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:36.329728  3270 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:36.369352  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:36.339143  3351 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:36.380434  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:36.330696  3120 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.336272  3274 consensus_queue.cc:1059] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:57:36.412060  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:36.377822  3132 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:36.339641  3430 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:36.352151  2996 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:36.419632  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:36.409205  1683 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:57:36.377180  1688 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
W20260709 12:57:36.411872  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 44761.4us
I20260709 12:57:36.420840  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:36.421341  1688 raft_consensus.cc:1240] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:57:36.413139  3438 log.cc:927] Time spent T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:57:36.413308  2924 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:36.413520  2269 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:36.429152  2989 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.429692  3433 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:36.411528  2925 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:36.429101  2924 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.366860  3349 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:36.430536  2925 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.353116  3311 raft_consensus.cc:3055] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:36.431572  3311 raft_consensus.cc:740] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:36.431679  1534 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:47506
I20260709 12:57:36.432016  2924 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:36.432881  2925 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:36.416088  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:36.434023  3412 log.cc:927] Time spent T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.673s	user 0.004s	sys 0.000s
I20260709 12:57:36.417064  3132 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:36.437069  3132 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:36.438663  3274 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:57:36.440412  3367 consensus_meta.cc:287] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.624s	user 0.007s	sys 0.004s
I20260709 12:57:36.441269  1691 raft_consensus.cc:2410] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:57:36.385115  3270 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.442919  1534 raft_consensus.cc:606] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:36.443826  3270 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:36.444154  1534 raft_consensus.cc:614] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:36.366096  3363 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:36.372465  3247 raft_consensus.cc:697] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:36.412880  3343 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.445200  3343 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.445506  3247 consensus_queue.cc:237] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.445225  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:36.422195  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 965) took 1663 ms. Trace:
I20260709 12:57:36.422372  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:36.447038  1655 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:36.436383  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:36.448123  1538 raft_consensus.cc:2368] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 6. Current term is 7.
I20260709 12:57:36.448282  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:36.449102  1537 raft_consensus.cc:2393] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 5: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:36.423143  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:36.425338  3120 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:36.455180  1537 raft_consensus.cc:1275] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:36.378197  3290 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:36.431074  3320 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:36.429955  3432 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:36.443681  3216 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.416141  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:36.484081  1609 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:36.418704  3230 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.420455  1539 raft_consensus.cc:2410] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:36.412295  3377 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:36.421289  1683 raft_consensus.cc:1275] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:57:36.450131  1655 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:36.448167  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:36.438580  3164 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:36.454428  3367 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:36.454825  1538 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:36.492645  3014 consensus_queue.cc:1048] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:36.483174  3397 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.494616  3397 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.456749  3343 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:36.426127  3276 consensus_meta.cc:287] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.754s	user 0.005s	sys 0.005s
I20260709 12:57:36.496551  3290 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.431360  2989 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:36.498488  1690 raft_consensus.cc:2410] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:57:36.498754  3290 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:36.467051  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:36.446542  3243 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.469638  3398 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.499809  3132 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.476615  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1196) took 1961 ms. Trace:
I20260709 12:57:36.487572  3296 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:57:36.510632  1684 rpcz_store.cc:276] 0709 12:57:34.514863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:35.327434 (+812571us) service_pool.cc:224] Handling call
0709 12:57:35.751841 (+424407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:35.753174 (+  1333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:35.753203 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:35.753679 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 12:57:36.018384 (+264705us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:36.018427 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:36.018502 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:36.027694 (+  9192us) raft_consensus.cc:1685] finished
0709 12:57:36.027716 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:36.476351 (+448635us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b5400158950. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:36.476555 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":890,"raft.queue_time_us":1896,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":975286144,"thread_start_us":264402,"threads_started":1,"wal-append.queue_time_us":272473}
I20260709 12:57:36.512779  1684 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:36.513321  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 972) took 1683 ms. Trace:
I20260709 12:57:36.513600  1684 rpcz_store.cc:276] 0709 12:57:34.829810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:36.512277 (+1682467us) service_pool.cc:224] Handling call
0709 12:57:36.512620 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:36.513104 (+   484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:36.513271 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:36.516752  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 975) took 1686 ms. Trace:
I20260709 12:57:36.517131  1687 rpcz_store.cc:276] 0709 12:57:34.830662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:36.515988 (+1685326us) service_pool.cc:224] Handling call
0709 12:57:36.516279 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:36.516431 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:36.516455 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:36.516528 (+    73us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:36.516557 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:36.516608 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:36.516702 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:36.518594  1687 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:57:36.519098  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 976) took 1688 ms. Trace:
W20260709 12:57:36.520720  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:36.525591  3215 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.526175  3132 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:36.519380  1687 rpcz_store.cc:276] 0709 12:57:34.830940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:36.518011 (+1687071us) service_pool.cc:224] Handling call
0709 12:57:36.518284 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:36.518877 (+   593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:36.519048 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:36.449498  1688 rpcz_store.cc:276] 0709 12:57:34.758672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:36.420792 (+1662120us) service_pool.cc:224] Handling call
0709 12:57:36.421136 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:36.421935 (+   799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:36.422144 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14208}
I20260709 12:57:36.479921  1537 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:57:36.490262  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 962) took 1750 ms. Trace:
I20260709 12:57:36.491221  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:36.490824  1655 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:36.491217  1440 catalog_manager.cc:5697] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:57:36.494938  1538 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:36.492341  3230 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.500684  3432 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:36.532015  1655 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:36.500576  3398 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.533147  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:36.474735  1581 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:36.462226  3351 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:36.487741  3331 consensus_queue.cc:1048] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:57:36.349668  3303 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.487861  3151 consensus_queue.cc:1048] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:57:36.475996  3311 consensus_queue.cc:260] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:36.503376  3243 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:36.492396  3216 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:36.505302  3154 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.505565  1615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:57:36.501705  3397 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:36.505865  3257 consensus_queue.cc:260] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.488515  3419 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:36.507230  1539 raft_consensus.cc:1275] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:36.499751  1610 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:57:36.509891  1583 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:36.530843  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:36.529760  1683 rpcz_store.cc:276] 0709 12:57:34.739894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:36.420754 (+1680860us) service_pool.cc:224] Handling call
0709 12:57:36.421002 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:36.489925 (+ 68923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:36.490194 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:57:36.534698  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 60047.1us
W20260709 12:57:36.535502  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:36.536835  1655 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:36.543998  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:36.545055  1615 raft_consensus.cc:606] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:36.537030  3367 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:36.547118  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 961) took 1807 ms. Trace:
I20260709 12:57:36.547894  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:36.558262  1609 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:36.549243  1536 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6. Ops: [2.2-5.3]
I20260709 12:57:36.550040  3154 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.559207  3432 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:36.558531  1655 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:36.553393  1687 raft_consensus.cc:2410] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:57:36.553350  1581 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:36.561866  1581 leader_election.cc:400] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 6. Current term is 7.
I20260709 12:57:36.526132  3215 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.562765  1581 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:36.554744  1688 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:36.564530  1689 rpcz_store.cc:276] 0709 12:57:34.739642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:36.416819 (+1677177us) service_pool.cc:224] Handling call
0709 12:57:36.417208 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:36.417414 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:57:36.482762 (+ 65348us) log.cc:844] Serialized 14 byte log entry
0709 12:57:36.546794 (+ 64032us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:36.546845 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:36.546885 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:36.546943 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:36.547066 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":65339,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":3443,"spinlock_wait_cycles":14720,"thread_start_us":86331,"threads_started":2}
I20260709 12:57:36.567368  1609 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
W20260709 12:57:36.569509  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:36.571274  1688 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:36.555619  1539 raft_consensus.cc:1240] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:36.573832  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:36.556329  1615 raft_consensus.cc:614] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:36.538136  3296 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:36.574615  1613 raft_consensus.cc:2393] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 7: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:57:36.574685  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:36.553779  1583 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:36.550551  1534 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:36.574345  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:36.573849  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:36.573199  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:36.576876  1539 raft_consensus.cc:2393] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 6: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:36.549978  1684 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:36.538177  3276 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:36.581591  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:36.575665  1608 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
W20260709 12:57:36.584266  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:36.585732  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:36.586439  1539 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:36.587661  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:36.588140  1655 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:36.594909  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:36.601034  1534 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:36.588366  1539 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:36.602581  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:36.603229  1539 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:36.604214  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:36.558158  2964 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:36.605074  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:36.605131  1539 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 5: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:36.606272  1655 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:36.607353  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:36.543043  3132 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:57:36.609043  1614 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:36.576056  3014 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:36.582652  3311 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:36.573949  3174 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:36.572649  3274 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.575927  3363 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:57:36.561422  3345 consensus_queue.cc:1175] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1d6516ff61104bdda54bde95e92fe579" responder_term: 6 status { last_received { term: 6 index: 5 } last_committed_idx: 3 last_received_current_leader { term: 6 index: 5 } }
I20260709 12:57:36.581218  3430 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.609356  1655 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:36.606835  3436 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:36.611146  3393 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:36.611987  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:36.583881  3031 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:36.594743  3296 raft_consensus.cc:697] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:36.607088  3349 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.629647  1614 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:36.630446  1535 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:36.641554  3031 raft_consensus.cc:697] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:36.642715  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:36.562426  3419 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.645744  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:36.646227  3419 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:36.633828  1610 raft_consensus.cc:1275] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:57:36.638113  3291 raft_consensus.cc:3055] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:36.630625  3154 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:36.544916  3401 consensus_queue.cc:260] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.643852  3349 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.629812  3436 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:36.631803  3393 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:36.632010  3276 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:36.659579  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:36.650621  3291 raft_consensus.cc:740] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:36.642602  3031 consensus_queue.cc:237] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.658718  3276 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:36.658802  3393 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:36.667382  3401 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:36.622537  3274 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:36.657675  3436 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:36.632184  3430 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.678084  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:36.685989  1536 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:36.690491  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:36.692019  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:36.676440  3276 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:36.692948  1536 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:36.698390  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:36.699090  1539 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:36.701723  3375 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:36.670243  3398 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:36.708884  1536 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:36.669330  3296 consensus_queue.cc:237] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:36.693665  3308 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:36.714614  1539 raft_consensus.cc:1240] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:36.722502  3349 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:36.728889  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:36.736032  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 979) took 1904 ms. Trace:
I20260709 12:57:36.736577  1690 rpcz_store.cc:276] 0709 12:57:34.831735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:35.126466 (+294731us) service_pool.cc:224] Handling call
0709 12:57:36.735780 (+1609314us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54000df554. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:36.735950 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3152978816}
I20260709 12:57:36.741245  1690 raft_consensus.cc:1275] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:36.741760  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 989) took 1780 ms. Trace:
I20260709 12:57:36.741988  1690 rpcz_store.cc:276] 0709 12:57:34.961458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:36.740743 (+1779285us) service_pool.cc:224] Handling call
0709 12:57:36.740997 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:36.741580 (+   583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:36.741717 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:36.743134  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 37) took 1760 ms. Trace:
I20260709 12:57:36.743395  1690 rpcz_store.cc:276] 0709 12:57:34.982380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:36.742539 (+1760159us) service_pool.cc:224] Handling call
0709 12:57:36.742762 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:36.742878 (+   116us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:36.742893 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:36.742927 (+    34us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:36.742954 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:36.743000 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:36.743094 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:36.744458  1690 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:36.720089  3308 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.745712  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 993) took 1742 ms. Trace:
I20260709 12:57:36.757998  1690 rpcz_store.cc:276] 0709 12:57:35.003162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:36.744135 (+1740973us) service_pool.cc:224] Handling call
0709 12:57:36.744334 (+   199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:36.745099 (+   765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:36.745655 (+   556us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:36.746830  3274 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:57:36.747795  3446 log.cc:927] Time spent T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:57:36.748384  3447 log.cc:927] Time spent T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:57:36.748705  3436 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.764772  3436 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:36.745656  3306 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 12:57:36.794889  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:36.797144  3448 log.cc:927] Time spent T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:57:36.797400  3436 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.798573  3436 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.803521  3436 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:36.807011  1690 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:57:36.807744  3220 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:36.809372  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1204) took 1614 ms. Trace:
I20260709 12:57:36.809746  1690 rpcz_store.cc:276] 0709 12:57:35.195267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:36.759718 (+1564451us) service_pool.cc:224] Handling call
0709 12:57:36.806784 (+ 47066us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:36.809114 (+  2330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:36.809317 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:36.813262  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1205) took 1617 ms. Trace:
I20260709 12:57:36.813668  1688 rpcz_store.cc:276] 0709 12:57:35.195536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:36.812491 (+1616955us) service_pool.cc:224] Handling call
0709 12:57:36.812781 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:36.812947 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:36.812983 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:36.813024 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:36.813052 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:36.813103 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:36.813208 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:57:36.816344  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 252537us
I20260709 12:57:36.817471  1581 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:36.804627  3420 log.cc:927] Time spent T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.605s	user 0.009s	sys 0.009s
I20260709 12:57:36.819569  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:36.823606  3368 consensus_queue.cc:1048] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:36.825433  3196 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:36.822808  1537 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:36.827900  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:36.828532  1537 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:36.832324  3430 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:36.764134  3393 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.836184  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:36.838078  1690 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:36.838793  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1206) took 1640 ms. Trace:
I20260709 12:57:36.840458  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:36.839197  1690 rpcz_store.cc:276] 0709 12:57:35.198374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:36.822195 (+1623821us) service_pool.cc:224] Handling call
0709 12:57:36.837897 (+ 15702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:36.838566 (+   669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:36.838742 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:36.825976  3265 consensus_queue.cc:260] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.844571  3265 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:57:36.844776  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:36.845534  3402 consensus_queue.cc:1059] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:36.847038  3402 raft_consensus.cc:3055] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:36.847421  3402 raft_consensus.cc:740] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:36.847805  3230 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:36.817534  3215 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:36.854362  1655 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:36.855576  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 973) took 2025 ms. Trace:
I20260709 12:57:36.857880  1684 rpcz_store.cc:276] 0709 12:57:34.830099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:36.514230 (+1684131us) service_pool.cc:224] Handling call
0709 12:57:36.514509 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:36.579285 (+ 64776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:36.855352 (+276067us) spinlock_profiling.cc:243] Waited 32.7 ms on lock 0x7b54002896d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:36.855523 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75209088}
I20260709 12:57:36.858397  1655 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:36.859565  1655 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:36.831102  3031 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:36.864758  1687 raft_consensus.cc:1240] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 4. Current term is 6. Ops: []
W20260709 12:57:36.865975  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:36.873718  1691 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 990) took 1892 ms (client timeout 1554 ms). Trace:
I20260709 12:57:36.875416  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:36.876689  1689 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:57:36.876811  1508 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:36.877987  1508 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:36.878834  1508 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:36.880798  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:36.885342  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 955) took 2147 ms. Trace:
I20260709 12:57:36.885396  1684 raft_consensus.cc:1275] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:36.862265  2826 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.886508  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1208) took 1687 ms. Trace:
I20260709 12:57:36.887035  1684 rpcz_store.cc:276] 0709 12:57:35.198828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:36.858960 (+1660132us) service_pool.cc:224] Handling call
0709 12:57:36.885058 (+ 26098us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:36.886256 (+  1198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:36.886456 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:36.887616  3151 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:36.888016  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:36.864179  3419 consensus_queue.cc:1059] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:57:36.866318  1655 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:36.874171  1691 rpcz_store.cc:269] 0709 12:57:34.981272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:34.985058 (+  3786us) service_pool.cc:224] Handling call
0709 12:57:36.873492 (+1888434us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b5400388e54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:36.873649 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3314377472}
I20260709 12:57:36.886533  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 987) took 1932 ms. Trace:
I20260709 12:57:36.895912  1687 rpcz_store.cc:276] 0709 12:57:34.953927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:36.594534 (+1640607us) service_pool.cc:224] Handling call
0709 12:57:36.612318 (+ 17784us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:36.865226 (+252908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:36.886353 (+ 21127us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b54000deb54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:36.886483 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":580161792}
I20260709 12:57:36.886677  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:36.897784  1540 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:36.898682  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:36.899402  1540 raft_consensus.cc:2393] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 4: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:36.885788  1686 rpcz_store.cc:276] 0709 12:57:34.738179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:36.118031 (+1379852us) service_pool.cc:224] Handling call
0709 12:57:36.307462 (+189431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:36.324190 (+ 16728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:36.885151 (+560961us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b5400392e50. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:36.885283 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":434963712}
I20260709 12:57:36.902549  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:36.903136  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:36.903980  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:36.821266  3306 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:36.904229  1540 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:36.909725  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:36.910400  1686 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:36.910772  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:36.911325  1540 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:36.912096  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:36.912988  1581 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:36.833235  3398 consensus_queue.cc:1059] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:57:36.913909  1581 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:36.915094   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 12:57:36.919541  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:36.946565  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:36.948784  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:36.956664  2302 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:36.866750  3366 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:36.904695  2826 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.941119  3155 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:36.865594  3345 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:36.958768  3155 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:36.958839  3345 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:36.959174  3155 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:36.959283  3345 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:36.940807  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:36.961974  3303 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:36.962119  1686 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:36.963035  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:36.963829  1686 raft_consensus.cc:2393] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 6: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:36.964588  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:36.965103  3380 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:36.965610  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:36.966296  1686 raft_consensus.cc:2393] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 7: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:57:36.967072  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:36.967700  1686 raft_consensus.cc:2393] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 3: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:36.968351  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:36.958153  3366 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:36.968906  3366 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:36.968959  1538 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:36.892206  3215 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:36.966194  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 715) took 1302 ms. Trace:
I20260709 12:57:36.972903  1533 rpcz_store.cc:276] 0709 12:57:35.664073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:35.664232 (+   159us) service_pool.cc:224] Handling call
0709 12:57:36.966011 (+1301779us) spinlock_profiling.cc:243] Waited 996 ms on lock 0x7b5400246154. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:36.966141 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2290483072}
I20260709 12:57:36.975868  1533 raft_consensus.cc:1240] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:57:36.968461  1541 raft_consensus.cc:1240] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:36.841260  3368 consensus_queue.cc:1059] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:57:36.969955  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1003) took 1037 ms. Trace:
I20260709 12:57:36.977702  1616 rpcz_store.cc:276] 0709 12:57:35.932492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:35.937409 (+  4917us) service_pool.cc:224] Handling call
0709 12:57:35.945522 (+  8113us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:57:35.945972 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:35.946003 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:57:35.946680 (+   677us) log.cc:844] Serialized 52 byte log entry
0709 12:57:36.053673 (+106993us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:36.053711 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:36.053777 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:36.707910 (+654133us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:57:36.914496 (+206586us) raft_consensus.cc:1685] finished
0709 12:57:36.914518 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:36.969878 (+ 55360us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2426,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":135,"spinlock_wait_cycles":7738624,"thread_start_us":106515,"threads_started":1,"wal-append.queue_time_us":144503}
I20260709 12:57:36.885732  3308 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:36.906060  3200 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:36.956761  1691 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:36.909849  2964 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:36.971266  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 57442us
I20260709 12:57:36.904183  1655 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:36.957370  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:36.848207  3402 consensus_queue.cc:260] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:36.983661  1537 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
W20260709 12:57:37.001492  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 97373.4us
I20260709 12:57:36.922405  1540 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:36.907414  3430 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:36.861681  3403 consensus_queue.cc:1048] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.093s
W20260709 12:57:36.968976  3449 log.cc:927] Time spent T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 12:57:36.953855  3247 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:57:36.992848  1505 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:36.994130  3164 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:36.867519  3174 consensus_queue.cc:1059] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.106s
I20260709 12:57:36.995558  1687 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 1.
I20260709 12:57:37.011741  3367 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:37.046594  3246 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:57:37.057991  3257 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:37.021767  3368 consensus_queue.cc:1059] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:57:37.022038  3164 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.066068  3296 raft_consensus.cc:3055] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:37.066642  3296 raft_consensus.cc:740] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:37.067596  3296 consensus_queue.cc:260] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.069938  3216 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:37.072938  3393 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:37.074894  3367 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:37.075417  3367 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:37.076269  3398 raft_consensus.cc:3055] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:37.076761  3398 raft_consensus.cc:740] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:37.077648  3398 consensus_queue.cc:260] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.079149  3398 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:36.902850  3243 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:36.972630  3215 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:37.004168  1535 raft_consensus.cc:1240] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:57:37.005821  1540 raft_consensus.cc:1240] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:37.007154  1691 raft_consensus.cc:2410] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:57:36.902875  3210 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:36.993305  3419 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:37.008186  3200 raft_consensus.cc:697] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 12:57:36.970763  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 64891us
I20260709 12:57:37.106813  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:37.015827  1581 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:37.107599  1687 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 5: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:36.972333  3230 consensus_queue.cc:1048] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:57:37.018630  1505 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:37.008190  3430 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:37.094794  1536 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:37.099671  1688 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:37.114790  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1210) took 1915 ms. Trace:
I20260709 12:57:37.105094  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:37.115048  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 99313us
I20260709 12:57:36.867362  3293 consensus_queue.cc:1059] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.106s
I20260709 12:57:37.018090  3402 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:37.066442  2826 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:37.116034  1688 rpcz_store.cc:276] 0709 12:57:35.199277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:37.098970 (+1899693us) service_pool.cc:224] Handling call
0709 12:57:37.099322 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:37.114460 (+ 15138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.114722 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:37.116703  1581 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:37.120066  1508 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:57:37.120137  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 101585us
I20260709 12:57:37.117585  3430 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:37.000973  2964 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:37.054566  3291 consensus_queue.cc:260] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.124929  3291 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:37.125619  2964 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:37.126359  3345 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.126855  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:37.127554  1687 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:37.103479  3154 raft_consensus.cc:3055] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:37.128211  3154 raft_consensus.cc:740] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:37.128603  3210 raft_consensus.cc:697] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:37.128973  1687 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:57:37.129087  3154 consensus_queue.cc:260] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.129670  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 994) took 1652 ms. Trace:
I20260709 12:57:37.129520  3210 consensus_queue.cc:237] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.130416  3154 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:37.130777  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:37.097244  3393 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.130038  1687 rpcz_store.cc:276] 0709 12:57:35.477482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:37.128281 (+1650799us) service_pool.cc:224] Handling call
0709 12:57:37.128664 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:37.129411 (+   747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.129614 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:57:37.132788  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:37.210707  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:37.105693  3419 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:37.103683  3215 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:57:37.211283  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:37.127585  1686 raft_consensus.cc:2393] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 6: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:37.103466  3132 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.108595  3243 raft_consensus.cc:697] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:37.118533  3225 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.238930  1687 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:37.126489  3320 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:37.233697  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:37.132534  3206 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:37.121981  2989 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:37.204326  3164 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:37.114452  3307 raft_consensus.cc:3055] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:37.240136  1612 raft_consensus.cc:2393] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 6: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:37.232764  3293 consensus_queue.cc:1243] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:57:37.241554  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1000) took 1762 ms. Trace:
I20260709 12:57:37.211578  2964 raft_consensus.cc:2804] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:37.118269  3296 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:37.251256  1610 raft_consensus.cc:1240] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:57:37.252276  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:37.257016  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:37.288127  1535 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:37.240963  3206 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:37.274647  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:37.291556  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:37.292416  1612 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 5: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 12:57:37.283361  3375 consensus_meta.cc:287] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.004s
I20260709 12:57:37.131515  3216 consensus_queue.cc:1059] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.098s
W20260709 12:57:37.286896  3451 log.cc:927] Time spent T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:57:37.282181  1691 raft_consensus.cc:1275] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:57:37.298071  1691 pending_rounds.cc:85] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 2
I20260709 12:57:37.298347  1691 pending_rounds.cc:107] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:57:37.298606  1691 raft_consensus.cc:2889] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:37.299263  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1006) took 1812 ms. Trace:
I20260709 12:57:37.299567  1691 rpcz_store.cc:276] 0709 12:57:35.486535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:37.235742 (+1749207us) service_pool.cc:224] Handling call
0709 12:57:37.281839 (+ 46097us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:37.299023 (+ 17184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.299208 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:37.236212  3419 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:57:37.266443  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 254816us
I20260709 12:57:37.302563  1683 raft_consensus.cc:2410] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:57:37.278091  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:37.231642  3273 consensus_queue.cc:1059] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:57:37.230343  3393 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.293597  2964 raft_consensus.cc:697] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:37.130333  3303 consensus_queue.cc:1048] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.109s
I20260709 12:57:37.246604  3225 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.278755  3307 raft_consensus.cc:740] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:37.281718  1687 rpcz_store.cc:276] 0709 12:57:35.478979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:37.210274 (+1731295us) service_pool.cc:224] Handling call
0709 12:57:37.235552 (+ 25278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:37.241253 (+  5701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.241486 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:37.285175  2826 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:37.240949  3132 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.330078  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 986) took 2376 ms. Trace:
I20260709 12:57:37.330596  1689 rpcz_store.cc:276] 0709 12:57:34.953623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:36.565950 (+1612327us) service_pool.cc:224] Handling call
0709 12:57:36.876334 (+310384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:36.877165 (+   831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.329839 (+452674us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b5400388e50. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:37.330007 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":610441984}
W20260709 12:57:37.306550  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:37.307047  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 183957us
I20260709 12:57:37.336930  1505 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:37.338094  1505 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:37.294090  3206 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:37.277451  3345 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:37.290400  3200 consensus_queue.cc:237] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.316807  1542 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:37.325230  1691 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:37.326622  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 738) took 1363 ms. Trace:
I20260709 12:57:37.339107  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:37.340044  1536 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:57:37.305984  3164 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.362674  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1212) took 1873 ms. Trace:
I20260709 12:57:37.360430  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1213) took 1870 ms. Trace:
I20260709 12:57:37.370090  1687 rpcz_store.cc:276] 0709 12:57:35.489574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:37.359590 (+1870016us) service_pool.cc:224] Handling call
0709 12:57:37.359915 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:37.360099 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:37.360125 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:37.360168 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:37.360198 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.360250 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:37.360369 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:37.370020  1691 rpcz_store.cc:276] 0709 12:57:35.489290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:37.300273 (+1810983us) service_pool.cc:224] Handling call
0709 12:57:37.325057 (+ 24784us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:37.362406 (+ 37349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.362614 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:37.360031  1611 rpcz_store.cc:276] 0709 12:57:35.963063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:36.063858 (+100795us) service_pool.cc:224] Handling call
0709 12:57:36.064147 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:36.068334 (+  4187us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:57:36.751807 (+683473us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b18002d6340. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f61455 00007fc860a493c7 00007fc85d05b9a7 00007fc85d06b0bf 00007fc85d06b038
0709 12:57:36.868459 (+116652us) log.cc:844] Serialized 14 byte log entry
0709 12:57:37.209783 (+341324us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:37.223876 (+ 14093us) log.cc:844] Serialized 26 byte log entry
0709 12:57:37.224025 (+   149us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:37.224055 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.224118 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:37.326296 (+102178us) raft_consensus.cc:1685] finished
0709 12:57:37.326396 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:37.326552 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12739,"prepare.queue_time_us":116332,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":6430,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":19797,"spinlock_wait_cycles":5220096,"thread_start_us":454842,"threads_started":2,"wal-append.queue_time_us":433114}
W20260709 12:57:37.336400  3276 consensus_meta.cc:287] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.632s	user 0.012s	sys 0.000s
W20260709 12:57:37.378602  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:37.379307  1685 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:37.380394  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:37.380774  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1215) took 1890 ms. Trace:
I20260709 12:57:37.381162  1611 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:37.381597  1687 rpcz_store.cc:276] 0709 12:57:35.490092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:37.371307 (+1881215us) service_pool.cc:224] Handling call
0709 12:57:37.380297 (+  8990us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:37.380453 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:37.380510 (+    57us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:37.380549 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:37.380576 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.380626 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:37.380722 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:37.386919  3460 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:37.387486  3460 raft_consensus.cc:697] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:37.393149  2964 consensus_queue.cc:237] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.406951  3413 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:37.413405  3429 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:57:37.334506  2826 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.308713  3243 consensus_queue.cc:237] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.483254  1538 raft_consensus.cc:1240] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:37.428153  1616 raft_consensus.cc:2410] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:57:37.438535  1583 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:37.458514  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:37.499506  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 378274us
I20260709 12:57:37.500259  1538 raft_consensus.cc:1240] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:57:37.422852  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:37.503311  3403 consensus_queue.cc:1059] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:37.434437  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1195) took 1014 ms. Trace:
I20260709 12:57:37.504643  1542 rpcz_store.cc:276] 0709 12:57:36.419592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:36.419704 (+   112us) service_pool.cc:224] Handling call
0709 12:57:36.419944 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:37.359551 (+939607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.434171 (+ 74620us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b5400186fd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:37.434369 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2061936000}
I20260709 12:57:37.505172  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:37.502041  1508 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:37.508575  1508 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:37.438822  3204 raft_consensus.cc:3055] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:37.511339  3343 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:37.441854  2826 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:37.511922  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:37.512322  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 73904.2us
I20260709 12:57:37.513022  3246 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:37.509878  1508 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:37.515916  1508 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:37.496654  3401 consensus_meta.cc:287] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.819s	user 0.010s	sys 0.005s
I20260709 12:57:37.501279  2302 raft_consensus.cc:2393] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 5: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:37.426757  3132 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:37.385064  3311 consensus_meta.cc:287] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.766s	user 0.011s	sys 0.003s
I20260709 12:57:37.523564  1691 raft_consensus.cc:1240] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:37.525653  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:37.526458  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1216) took 2036 ms. Trace:
I20260709 12:57:37.526871  1691 rpcz_store.cc:276] 0709 12:57:35.490354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:37.506576 (+2016222us) service_pool.cc:224] Handling call
0709 12:57:37.523358 (+ 16782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:37.526171 (+  2813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.526393 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:37.513094  3273 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:37.512039  3343 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:37.421270  3306 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:37.537253  1611 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:37.377736  3164 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:37.379933  3383 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.513690  3204 raft_consensus.cc:740] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:37.544034  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1219) took 2050 ms. Trace:
I20260709 12:57:37.385427  3276 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.545480  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:37.517899  1508 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:37.484431  3155 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.564822  1691 rpcz_store.cc:276] 0709 12:57:35.493325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:37.527573 (+2034248us) service_pool.cc:224] Handling call
0709 12:57:37.542005 (+ 14432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:37.542194 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:37.542217 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:37.542257 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:37.543748 (+  1491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.543831 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:37.543967 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:37.507756  3216 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:57:37.575675  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 1233) took 1051 ms. Trace:
I20260709 12:57:37.513655  3246 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.576112  1683 rpcz_store.cc:276] 0709 12:57:36.524203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:36.560909 (+ 36706us) service_pool.cc:224] Handling call
0709 12:57:37.575409 (+1014500us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b540022b0d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:37.575603 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1625608576}
I20260709 12:57:37.519804  3331 consensus_queue.cc:1059] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:57:37.598047  3155 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:37.388352  3460 consensus_queue.cc:237] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.598817  3206 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.602126  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:37.602607  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 84775.1us
I20260709 12:57:37.562502  3343 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:37.526512  3403 consensus_queue.cc:1048] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:57:37.538968  3031 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 12:57:37.607851  1691 raft_consensus.cc:1240] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: []
W20260709 12:57:37.594906  3257 consensus_meta.cc:287] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.000s
I20260709 12:57:37.580026  3425 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:37.582054  3398 consensus_meta.cc:287] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.002s
I20260709 12:57:37.607456  1682 raft_consensus.cc:1240] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:37.613265  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1220) took 2119 ms. Trace:
I20260709 12:57:37.617803  1691 rpcz_store.cc:276] 0709 12:57:35.493619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:37.573148 (+2079529us) service_pool.cc:224] Handling call
0709 12:57:37.607671 (+ 34523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:37.613017 (+  5346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.613212 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:37.609915  1686 raft_consensus.cc:1275] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:37.614737  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:37.619058  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1221) took 2079 ms. Trace:
I20260709 12:57:37.619434  1686 rpcz_store.cc:276] 0709 12:57:35.539686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:37.577150 (+2037464us) service_pool.cc:224] Handling call
0709 12:57:37.609557 (+ 32407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:37.618779 (+  9222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.619004 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:37.594110  3466 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:37.611642  3343 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:57:37.628154  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 290158us
I20260709 12:57:37.628413  1686 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:37.631044  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1226) took 1876 ms. Trace:
I20260709 12:57:37.570364  3383 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.631496  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:37.631402  1686 rpcz_store.cc:276] 0709 12:57:35.754452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:37.620160 (+1865708us) service_pool.cc:224] Handling call
0709 12:57:37.628216 (+  8056us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:37.630728 (+  2512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.630978 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:37.633716  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1225) took 1899 ms. Trace:
I20260709 12:57:37.633873  1505 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:37.634133  1691 rpcz_store.cc:276] 0709 12:57:35.733942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:37.618607 (+1884665us) service_pool.cc:224] Handling call
0709 12:57:37.633227 (+ 14620us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:37.633415 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:37.633442 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:37.633481 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:37.633509 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.633560 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:37.633662 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:37.635408  1505 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:37.636751  1612 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:37.625473  3466 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:57:37.651984  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 47793.5us
I20260709 12:57:37.651142  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:57:37.629868  3366 consensus_meta.cc:287] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.658s	user 0.005s	sys 0.008s
I20260709 12:57:37.655328  1612 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:37.658725  1686 raft_consensus.cc:1240] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:37.659484  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1227) took 1136 ms. Trace:
I20260709 12:57:37.635911  3343 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:37.659799  1686 rpcz_store.cc:276] 0709 12:57:36.522722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:37.642635 (+1119913us) service_pool.cc:224] Handling call
0709 12:57:37.658544 (+ 15909us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:37.659232 (+   688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.659427 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:37.664968  1691 raft_consensus.cc:1275] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:57:37.665393  1691 pending_rounds.cc:85] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 1
I20260709 12:57:37.665400  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1230) took 1142 ms. Trace:
I20260709 12:57:37.666842  1691 pending_rounds.cc:107] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:57:37.666049  1686 rpcz_store.cc:276] 0709 12:57:36.523449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:37.664673 (+1141224us) service_pool.cc:224] Handling call
0709 12:57:37.664933 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:37.665105 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:37.665131 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:37.665173 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:37.665201 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.665248 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:37.665348 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:37.667295  1691 raft_consensus.cc:2889] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:37.668087  1686 raft_consensus.cc:1275] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:37.668766  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1232) took 1144 ms. Trace:
I20260709 12:57:37.670902  1686 rpcz_store.cc:276] 0709 12:57:36.523941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:37.667502 (+1143561us) service_pool.cc:224] Handling call
0709 12:57:37.667787 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:37.668523 (+   736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.668713 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:37.671679  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:37.673322  1686 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:57:37.675163  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1228) took 1152 ms. Trace:
I20260709 12:57:37.675539  1691 rpcz_store.cc:276] 0709 12:57:36.522988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:37.642826 (+1119838us) service_pool.cc:224] Handling call
0709 12:57:37.664618 (+ 21792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:37.667735 (+  3117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.675111 (+  7376us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:37.646041  3393 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:37.676790  1536 raft_consensus.cc:1240] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:37.647096  3206 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:37.648844  3398 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:37.635632  3215 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.660081  3466 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:37.691464  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:37.692188  1608 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:37.693166  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:37.694242  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:57:37.670377  3454 log.cc:927] Time spent T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.678s	user 0.004s	sys 0.009s
I20260709 12:57:37.622023  3425 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:37.649334  3351 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:37.665781  3290 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:37.675372  1686 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:57:37.674122  3164 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:37.689499  3476 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:57:37.715552  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:37.712353  1608 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:37.666594  3366 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:37.695899  1613 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:57:37.622968  3204 consensus_queue.cc:260] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.676606  3413 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.701195  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:37.730646  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:37.657661  3216 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:57:37.744921  2298 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:37.746088  3465 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.746721  3465 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.680364  3246 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:37.712780  1690 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6. Ops: []
W20260709 12:57:37.710994  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 75660.5us
I20260709 12:57:37.694810  1609 raft_consensus.cc:1240] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:57:37.717108  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:37.732422  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:37.767099  1505 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
W20260709 12:57:37.767925  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:37.700769  3200 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:37.760008  2302 raft_consensus.cc:2410] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:57:37.766196  1612 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:37.719380  3476 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:37.711665  3351 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:37.766551  1684 raft_consensus.cc:2393] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 6: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:37.763850  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1223) took 2217 ms. Trace:
I20260709 12:57:37.718621  3206 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.773800  1683 rpcz_store.cc:276] 0709 12:57:35.546214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:37.595990 (+2049776us) service_pool.cc:224] Handling call
0709 12:57:37.616088 (+ 20098us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:37.616281 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:57:37.684339 (+ 68058us) log.cc:844] Serialized 14 byte log entry
0709 12:57:37.763568 (+ 79229us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:37.763615 (+    47us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:37.763647 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.763698 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:37.763797 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49942,"prepare.queue_time_us":69167,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":4192,"thread_start_us":125009,"threads_started":2}
I20260709 12:57:37.776655  1654 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:37.746347  3463 log.cc:927] Time spent T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:57:37.769177  1505 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:37.782501  1654 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:37.690888  3398 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.767340  3293 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:37.784526  3206 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.769877  3204 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:37.794836  3398 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:37.795430  3293 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.780085  3476 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:37.797353  3465 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:37.765528  3413 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.797533  3366 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:37.779724  2301 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 6 LEARNER]: Advancing to term 7
W20260709 12:57:37.812299  3419 consensus_meta.cc:287] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.503s	user 0.006s	sys 0.000s
I20260709 12:57:37.798174  3206 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:37.798364  2826 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:37.784005  3276 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:37.799274  3478 log.cc:927] Time spent T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:57:37.800812  3307 consensus_queue.cc:260] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:37.798076  3291 consensus_meta.cc:287] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.673s	user 0.010s	sys 0.001s
I20260709 12:57:37.805105  3225 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:37.806717  3120 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:37.810946  3460 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:57:37.816437  3471 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.126s	user 0.002s	sys 0.000s
W20260709 12:57:37.821058  3473 log.cc:927] Time spent T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 12:57:37.823714  3367 consensus_meta.cc:287] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.748s	user 0.008s	sys 0.003s
I20260709 12:57:37.866387  3367 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.861877  3460 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:37.868845  3460 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:37.869680  3293 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:37.861238  3320 consensus_meta.cc:287] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.614s	user 0.009s	sys 0.001s
I20260709 12:57:37.870536  3320 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:57:37.873310  3458 log.cc:927] Time spent T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.543s	user 0.003s	sys 0.000s
W20260709 12:57:37.875396  1685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 971) took 3045 ms (client timeout 1991 ms). Trace:
W20260709 12:57:37.876276  1685 rpcz_store.cc:269] 0709 12:57:34.829475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:35.057080 (+227605us) service_pool.cc:224] Handling call
0709 12:57:37.874948 (+2817868us) spinlock_profiling.cc:243] Waited 2.24 s on lock 0x7b540041cb54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:37.875180 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5148136704}
I20260709 12:57:37.877681  2301 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 7 LEARNER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:57:37.878443  2301 pending_rounds.cc:85] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579: Aborting all ops after (but not including) 4
I20260709 12:57:37.878782  2301 pending_rounds.cc:107] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:57:37.824764  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1209) took 2625 ms. Trace:
I20260709 12:57:37.879642  1682 rpcz_store.cc:276] 0709 12:57:35.199040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:36.869008 (+1669968us) service_pool.cc:224] Handling call
0709 12:57:36.869337 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:37.617561 (+748224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.824523 (+206962us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b5400033754. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:37.824702 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1697158400}
I20260709 12:57:37.824990  3215 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:37.827598  3403 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:37.738910  3164 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:57:37.882532  2989 raft_consensus.cc:3055] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:37.883496  2989 raft_consensus.cc:740] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:37.774338  3429 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:57:37.780035  3246 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:37.887297  3246 raft_consensus.cc:697] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:37.882742  3403 consensus_queue.cc:1243] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:57:37.888659  3246 consensus_queue.cc:237] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.889657  3481 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:37.779888  3331 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 12:57:37.832159  3430 consensus_meta.cc:287] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.710s	user 0.005s	sys 0.004s
I20260709 12:57:37.739132  3311 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:37.780128  3351 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:37.783329  3257 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:57:37.839591  3402 consensus_meta.cc:287] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.707s	user 0.009s	sys 0.001s
I20260709 12:57:37.804318  3247 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:57:37.861939  3307 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:37.879102  2301 raft_consensus.cc:2889] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 7 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:37.975553   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:57:37.841849  1533 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:37.830277  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:37.909224  2989 consensus_queue.cc:260] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.994028  1535 raft_consensus.cc:1275] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:57:37.995709  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:37.842206  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:38.058043  2989 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:38.058874  1540 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:37.997305  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:37.997737  1541 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:57:37.997301  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 744) took 1177 ms. Trace:
I20260709 12:57:38.061993  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:38.060875  1539 rpcz_store.cc:276] 0709 12:57:36.819831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:36.822263 (+  2432us) service_pool.cc:224] Handling call
0709 12:57:36.866092 (+ 43829us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:36.866506 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:36.866537 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:36.869497 (+  2960us) log.cc:844] Serialized 26 byte log entry
0709 12:57:37.223450 (+353953us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:37.223498 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.223580 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:37.872655 (+649075us) spinlock_profiling.cc:243] Waited 5.27 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:57:37.996657 (+124002us) raft_consensus.cc:1685] finished
0709 12:57:37.996710 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:37.997080 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":34985,"spinlock_wait_cycles":12112768,"thread_start_us":270643,"threads_started":1,"wal-append.queue_time_us":389714}
I20260709 12:57:38.062011  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:38.063258  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:37.998072  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:38.064289  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:38.064886  1542 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:57:38.008335  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 165928us
I20260709 12:57:38.013417  1437 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54606 (request call id 142) took 8606 ms. Trace:
I20260709 12:57:38.018563  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:38.020119  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:38.024746  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:38.069267  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:38.070251  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:38.070746  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:38.025740  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:38.073024  1609 raft_consensus.cc:2410] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:57:38.073926  3164 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:38.074226  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:38.074735  3164 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.832954  1654 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:38.075748  3014 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:38.076547  3151 raft_consensus.cc:3055] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:38.077170  3151 raft_consensus.cc:740] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:57:38.077801  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 269550us
I20260709 12:57:38.078904  3151 consensus_queue.cc:260] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.026155  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:38.080655  1654 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:38.081048  1610 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:38.082655  1610 raft_consensus.cc:3055] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:38.083060  1610 raft_consensus.cc:740] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:57:38.013231  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 498412us
I20260709 12:57:38.083374  1654 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:37.893296  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1207) took 2694 ms. Trace:
I20260709 12:57:38.084594  1690 rpcz_store.cc:276] 0709 12:57:35.198601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:36.841789 (+1643188us) service_pool.cc:224] Handling call
0709 12:57:36.885694 (+ 43905us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:37.766337 (+880643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:37.893019 (+126682us) spinlock_profiling.cc:243] Waited 827 ms on lock 0x7b540041da54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:37.893224 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1901887232}
I20260709 12:57:38.086124  1583 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:38.087440  1616 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:38.088186  3164 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:38.030009  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:38.090554  1654 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:38.091364  1613 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:38.068598  1535 pending_rounds.cc:85] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 1
I20260709 12:57:38.070026  2826 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:38.092070  3014 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:38.092886  1535 pending_rounds.cc:107] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:57:38.093482  1535 raft_consensus.cc:2889] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:38.093190  2826 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.055888  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:38.096030  1533 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:38.057403  1534 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 7.
W20260709 12:57:38.048059  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:38.075147  1609 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:38.099462  2964 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:38.100649  3132 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:38.101668  3132 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:38.102584  3132 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:38.063056  1538 raft_consensus.cc:2393] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 3: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:38.104964  1538 pending_rounds.cc:85] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 2
I20260709 12:57:38.105275  1538 pending_rounds.cc:107] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:57:38.105521  1538 raft_consensus.cc:2889] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:38.105652  2826 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:38.106249  1611 raft_consensus.cc:2393] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 5: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:38.106936  3174 consensus_queue.cc:1059] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:38.068640  1437 rpcz_store.cc:276] 0709 12:57:29.406489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:29.406671 (+   182us) service_pool.cc:224] Handling call
0709 12:57:38.013160 (+8606489us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:30.833737 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:30.871187 (+ 37450us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:30.871222 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:57:30.871240 (+    18us) tablet.cc:662] Decoding operations
0709 12:57:31.017951 (+146711us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:31.024124 (+  6173us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:31.068519 (+ 44395us) tablet.cc:685] Acquiring locks for 29 operations
0709 12:57:31.260783 (+192264us) tablet.cc:701] Row locks acquired
0709 12:57:31.265362 (+  4579us) write_op.cc:260] PREPARE: finished
0709 12:57:31.271876 (+  6514us) write_op.cc:270] Start()
0709 12:57:31.272000 (+   124us) write_op.cc:276] Timestamp: P: 1783601851271822 usec, L: 0
0709 12:57:31.272026 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:57:31.311284 (+ 39258us) log.cc:844] Serialized 11483 byte log entry
0709 12:57:31.907921 (+596637us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc859f470ac 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b
0709 12:57:33.729498 (+1821577us) op_driver.cc:464] REPLICATION: finished
0709 12:57:34.211452 (+481954us) write_op.cc:301] APPLY: starting
0709 12:57:34.216333 (+  4881us) tablet.cc:1367] starting BulkCheckPresence
0709 12:57:34.268874 (+ 52541us) tablet.cc:1370] finished BulkCheckPresence
0709 12:57:34.268901 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:57:34.471096 (+202195us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:57:34.471424 (+   328us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=29
0709 12:57:34.471468 (+    44us) write_op.cc:312] APPLY: finished
0709 12:57:34.471896 (+   428us) log.cc:844] Serialized 193 byte log entry
0709 12:57:34.715920 (+244024us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:34.732854 (+ 16934us) write_op.cc:454] Released schema lock
0709 12:57:34.743739 (+ 10885us) write_op.cc:341] FINISH: Updating metrics
0709 12:57:34.791988 (+ 48249us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:34.794199 (+  2211us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":56212,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":463565,"apply.run_cpu_time_us":44060,"apply.run_wall_time_us":565102,"num_ops":29,"prepare.queue_time_us":121273,"prepare.run_cpu_time_us":126950,"prepare.run_wall_time_us":2033943,"raft.queue_time_us":518586,"raft.run_cpu_time_us":22518,"raft.run_wall_time_us":473822,"replication_time_us":2424534,"spinlock_wait_cycles":34042752,"thread_start_us":2504115,"threads_started":5,"wal-append.queue_time_us":2033062,"wal-append.run_cpu_time_us":26538,"wal-append.run_wall_time_us":2331059}]]}
I20260709 12:57:38.109625  1610 consensus_queue.cc:260] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.111922  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:38.113377  3174 raft_consensus.cc:3055] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:38.116566  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:38.123106  1535 raft_consensus.cc:1240] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:57:38.073849  1655 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:38.117244  3151 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:38.118220  1610 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:38.095592  3014 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:38.121178  1609 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:57:38.125939  3014 consensus_queue.cc:1059] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:38.032958  1582 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:38.127060  3031 consensus_queue.cc:1048] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:57:38.124832  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 51419.7us
I20260709 12:57:38.130851  1655 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:38.131939  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:38.142218  1609 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 7.
I20260709 12:57:38.121044  3132 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:38.143719  3132 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:38.133396  1690 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:38.134788  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:38.133275  2826 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:38.144505  1540 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:38.145385  2826 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:38.146611  1691 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:38.147447  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:38.132550  3174 raft_consensus.cc:740] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:38.137185  1542 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:38.138178  3196 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:38.149693  3204 consensus_queue.cc:1059] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:38.150630  3204 consensus_queue.cc:1243] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:57:38.150385  3196 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.151330  3204 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:38.153630  3196 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:38.155009  3204 consensus_queue.cc:1048] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:38.160573  3204 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:38.144362  3132 raft_consensus.cc:697] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:38.160931  3174 consensus_queue.cc:260] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.162479  3132 consensus_queue.cc:237] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.132766  3014 consensus_queue.cc:1243] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:57:38.148659  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 116070us
W20260709 12:57:38.144639  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 52229.4us
I20260709 12:57:38.169359  3196 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:38.169911  3196 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.170243  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:38.170429  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:38.156981  1539 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:38.171279  2301 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:38.171456  1581 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:38.172735  1581 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:38.166030  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:38.174857  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:38.173339  3014 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:38.169174  2964 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:38.174031  3225 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:38.174240  3209 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:38.174921  3215 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:38.178371  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:38.179854  3196 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:38.172376  3031 raft_consensus.cc:3055] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:38.181432  1654 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:38.161119  3204 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:38.184935  3257 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:37.901684  3367 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:37.904342  3311 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.903295  3331 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:37.859910  3397 consensus_queue.cc:1175] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" responder_term: 7 status { last_received { term: 4 index: 3 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 6. Current term is 7. Ops: [6.4-6.4]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:57:37.923642  3413 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:38.319308  3331 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:37.850399  3419 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:37.856985  3425 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:37.903126  3430 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.325748  3430 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:37.944456  3460 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:38.319180  3311 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:38.329088  1688 raft_consensus.cc:2393] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 7: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:38.329566  1542 raft_consensus.cc:2393] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 6: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:37.936275  3466 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.332213  3466 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:37.946534  3476 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.333076  1614 raft_consensus.cc:2393] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 7: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:38.334978  3476 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:38.163341  3174 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:57:38.338965  3343 consensus_meta.cc:287] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.662s	user 0.006s	sys 0.007s
I20260709 12:57:38.339500  3343 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.197966  2826 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:38.220188  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:38.227415  3393 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:38.228540  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 387540us
W20260709 12:57:38.228996  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 102235us
I20260709 12:57:38.229827  3490 consensus_queue.cc:1048] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:38.231137  3468 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:38.160267  1505 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:38.233949  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:38.234233  1611 raft_consensus.cc:1275] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:57:38.234580  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:38.245054  1610 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:57:38.212664  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 356979us
I20260709 12:57:38.260854  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:38.263216  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:38.266623  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:38.295250  3215 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.295590  3225 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.295320  3366 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:38.253904  3031 raft_consensus.cc:740] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:38.263821  3204 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:57:38.289348  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 108056us
I20260709 12:57:38.262984  3257 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:38.304670  3209 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.306741  3383 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:38.310599  3351 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:38.312536  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 163922us
I20260709 12:57:38.316326  3196 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:57:38.343269  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 170724us
W20260709 12:57:38.345043  3368 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:57:38.353168  3366 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:38.357914  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:38.359211  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:38.346192  1537 raft_consensus.cc:1240] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:38.346670  2301 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:38.345149  2826 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:38.346351  1536 raft_consensus.cc:2393] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 6: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:38.328354  3460 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:38.323552  3419 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:38.358691  1682 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:38.347950  2267 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:38.363199  1687 raft_consensus.cc:1240] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:57:38.363399  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:38.364168  1690 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:57:38.363828  3031 consensus_queue.cc:260] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.365196  3225 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:38.348169  3393 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.358879  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:38.367969  3206 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:38.351024  3014 raft_consensus.cc:697] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:38.354590  3257 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:38.369369  3367 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:38.379032  1690 pending_rounds.cc:85] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 4
I20260709 12:57:38.390622  3014 consensus_queue.cc:237] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.391261  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:38.391999  1689 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:38.373790  2826 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.394307  3209 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:38.395010  3291 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:38.363194  3366 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:38.371001  1582 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:38.361475  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 1234) took 1261 ms. Trace:
I20260709 12:57:38.373167  1654 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:38.396296  1690 pending_rounds.cc:107] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:57:38.374195  1691 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:38.373796  3429 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:57:38.360077  3196 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:38.364209  3215 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:38.396217  1688 rpcz_store.cc:276] 0709 12:57:37.095053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:37.118170 (+ 23117us) service_pool.cc:224] Handling call
0709 12:57:38.349268 (+1231098us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54002891d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:38.356101 (+  6833us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2753746688}
I20260709 12:57:38.396862  1690 raft_consensus.cc:2889] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:38.384155  1686 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:38.386515  3031 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:38.390792  3367 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.395359  2826 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:38.391149  3136 raft_consensus.cc:2804] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:57:38.396811  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 236949us
I20260709 12:57:38.373682  3343 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:38.368364  1655 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:38.403977  1684 raft_consensus.cc:1275] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:38.404284  3398 raft_consensus.cc:2804] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:38.404400  3206 raft_consensus.cc:697] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:38.404654  1685 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:38.420516  1539 raft_consensus.cc:1240] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:38.404594  3151 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:38.423105  2964 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:38.423702  2964 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.424299  3154 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:38.424846  3154 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:38.425904  2964 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:38.428200  3397 consensus_queue.cc:1059] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:38.428959  2964 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:38.423148  3151 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.429606  3419 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:38.430073  3397 consensus_queue.cc:1243] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:57:38.416797  3367 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:38.415723  3136 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:38.427431  3490 consensus_queue.cc:1059] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:38.431015  3136 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:38.431515  3490 raft_consensus.cc:3055] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:38.431880  3490 raft_consensus.cc:740] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:38.432575  1615 raft_consensus.cc:1275] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:38.428269  3366 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:38.432997  3490 consensus_queue.cc:260] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.433960  3366 raft_consensus.cc:697] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:38.434587  3490 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:38.434954  3393 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:38.429463  3154 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:38.429117  3206 consensus_queue.cc:237] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:38.435992  3514 log.cc:927] Time spent T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:57:38.437597  3151 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:38.426470  3403 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:38.438941  3403 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:38.427265  3307 consensus_meta.cc:287] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.518s	user 0.004s	sys 0.004s
I20260709 12:57:38.441184  3403 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:38.441445  1617 raft_consensus.cc:2410] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:57:38.430243  3419 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.443397  3419 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:38.427867  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 54841.8us
I20260709 12:57:38.448702  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:38.449894  1691 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:38.400699  3196 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:38.443895  3215 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:38.419106  1581 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:38.440032  3136 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:38.465246  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:38.465571  1611 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:57:38.418716  3398 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:38.471786  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 71794.2us
I20260709 12:57:38.454771  3393 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:38.478454  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:38.478756  1542 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:38.443295  3257 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:38.482177  1536 raft_consensus.cc:1240] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 1. Current term is 2. Ops: []
W20260709 12:57:38.481390  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 113269us
I20260709 12:57:38.468768  3398 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:38.475955  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:38.484813  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:38.485716  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:38.486730  1686 raft_consensus.cc:2410] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:57:38.475947  3307 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:38.435081  3366 consensus_queue.cc:237] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.490739  1616 raft_consensus.cc:2393] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 6: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:38.452032  3204 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:57:38.509714  3513 log.cc:927] Time spent T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 12:57:38.514554  3393 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.585671  3393 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:38.491124  3307 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:38.586508  3307 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:38.489389  1654 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:38.590183  1542 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:38.593904  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:38.594197  3204 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:38.594791  1610 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:38.588070  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:38.597107  1691 raft_consensus.cc:1275] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:38.594750  1684 raft_consensus.cc:2393] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 7: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:38.599448  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:38.600368  1687 raft_consensus.cc:2410] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:57:38.601255  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 227865us
I20260709 12:57:38.602072  3331 raft_consensus.cc:3055] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:38.602475  3331 raft_consensus.cc:740] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:38.603369  3331 consensus_queue.cc:260] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.604386  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:38.605139  3215 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:38.605576  3215 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:38.605916  3215 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:57:38.602049  3296 consensus_meta.cc:287] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 1.310s	user 0.010s	sys 0.009s
I20260709 12:57:38.606912  3419 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:38.607439  3419 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.610447  3331 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:38.613606  1535 raft_consensus.cc:1275] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:38.614261  3490 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:38.614912  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:38.614861  3490 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.622416  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:38.605070  1540 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
W20260709 12:57:38.639516  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:38.643795  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 176378us
I20260709 12:57:38.647728  1610 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
W20260709 12:57:38.648723  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 158169us
W20260709 12:57:38.657982  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 75380.8us
I20260709 12:57:38.661563  3398 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:38.662158  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:38.666491  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:38.667243  1535 raft_consensus.cc:2393] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 7: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:38.669397  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:38.672005  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:38.663693  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:38.649765  3136 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:38.676556  3398 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:38.676761  3031 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:38.681318  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:57:38.664463  3490 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:38.683295  3296 consensus_queue.cc:1059] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:57:38.708956  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:57:38.687438  3031 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.709870  2302 raft_consensus.cc:2393] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 8: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:57:38.701682  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:38.688455  2298 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:38.693260  1654 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:38.709157  3296 raft_consensus.cc:3055] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:38.691709  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:38.701249  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:38.702056  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:38.715555  1691 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:38.702246  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:38.701462  3425 raft_consensus.cc:2955] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 7 LEADER]: Committing config change with OpId 5.5: config changed from index 2 to 5, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:38.688159  3307 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.704953  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:38.705763  1583 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:38.707376  1536 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:38.691536  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:38.675937  3351 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:38.711669  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:38.712567  3398 consensus_queue.cc:1059] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:38.734058  1685 raft_consensus.cc:2410] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:57:38.721251  1690 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:38.725586  1505 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:38.726186  1655 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:38.740113  1581 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:38.712730  3031 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:38.720593  3296 raft_consensus.cc:740] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:38.743824  1534 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:38.770732  1540 raft_consensus.cc:2410] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:57:38.772421  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 66736.6us
I20260709 12:57:38.737879  3393 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:38.743454  3515 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:38.778543  1505 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:38.781225  1690 raft_consensus.cc:2955] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 2 to 5, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:38.783169  3209 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:38.730230  3215 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.769670  3466 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:38.792640  1583 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:38.795465  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 51396.2us
I20260709 12:57:38.776609  3490 raft_consensus.cc:3055] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:38.803026  1691 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:38.790095  3031 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:38.787683  3206 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:38.777307  3204 consensus_queue.cc:1059] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:57:38.813383  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:38.815668  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:38.816274  1541 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:57:38.818841  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 84440.1us
W20260709 12:57:38.819595  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 132729us
I20260709 12:57:38.800184  3351 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:38.821264  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:38.821801  1540 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:38.803413  3490 raft_consensus.cc:740] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:38.823127  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:38.805675  3460 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:38.824960  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:38.795024  3331 consensus_queue.cc:1059] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:57:38.827594  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:38.829581  1655 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:38.831023  1505 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:38.824790  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:38.832376  3306 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:38.814324  3206 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:38.800345  3403 consensus_queue.cc:1048] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:57:38.836270  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:38.837016  1537 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:38.822046  3351 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:38.839465  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:38.827366  3468 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:38.821542  3393 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:38.839651  3174 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:38.857347  1655 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:38.858453  2826 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:38.836431  3206 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:38.838171  3366 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:57:38.863790  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 49644.6us
I20260709 12:57:38.865962  3306 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.869714  3307 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:38.861135  3460 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.872778  3366 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:38.873469  3366 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:38.873874  3460 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:38.809333  3296 consensus_queue.cc:260] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.810887  3515 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.846050  3351 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:38.878424  1535 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:38.861984  1505 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:38.885186  3515 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:38.886462  3419 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:38.888268  2298 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:38.855211  3468 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.890659  3257 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:38.891494  3468 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:38.892184  3468 raft_consensus.cc:3055] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:38.894073  3468 raft_consensus.cc:740] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:38.858845  3215 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:38.894291  3460 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:57:38.896744  1508 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:38.881491  3393 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:38.897747  3306 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:38.877260  3413 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:38.892506  3331 raft_consensus.cc:3055] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:38.861913  3031 raft_consensus.cc:697] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:38.907156  1537 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
W20260709 12:57:38.908954  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 65036.8us
I20260709 12:57:38.899425  3413 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:38.898605  3265 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:57:38.905422  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 12:57:38.910789  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 45932.9us
I20260709 12:57:38.912010  3291 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:38.913633  3291 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:38.913978  3291 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:38.914778  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:38.916210  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:38.857496  3174 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.901283  3460 consensus_queue.cc:1243] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:57:38.937686  1581 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:38.902192  3331 raft_consensus.cc:740] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:38.930980  1505 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:38.912287  3413 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:38.932051  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:38.907879  3215 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:38.938285  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:38.898320  3306 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:38.945845  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:38.899147  3393 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:38.932291  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:38.869211  3490 consensus_queue.cc:260] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.940338  1614 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:38.946799  1537 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:38.947309  1615 raft_consensus.cc:2393] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 6: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:38.947917  2826 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:38.954879  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:38.948043  3466 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:38.958951  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:38.948731  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:38.950459  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:38.960258  1610 raft_consensus.cc:2410] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:57:38.956034  1541 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:38.962395  1613 raft_consensus.cc:2393] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 8: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:38.941321  3296 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:38.963035  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:38.969185  1581 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:38.913437  3307 consensus_queue.cc:1048] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:57:38.948083  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:57:38.981248  2298 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:38.983146  3366 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.945506  3368 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:57:38.964941  3215 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.985441  1540 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:38.986562  3215 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:38.987079  3393 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:38.987507  3331 consensus_queue.cc:260] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.987758  3393 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.988955  3490 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:38.989908  3393 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:38.990785  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:38.991416  1688 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:38.992161  3174 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:38.959537  3419 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:38.992666  3419 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:38.993031  3419 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:38.964892  2826 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.943790  3468 consensus_queue.cc:260] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:38.986986  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:38.974586  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:38.968016  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:38.979099  3529 log.cc:927] Time spent T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:57:38.984589  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:38.970216  1581 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:57:39.002447  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:38.998003  1685 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:38.998613  1691 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:57:38.998967  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:38.997299  1689 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:39.007385  1688 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:39.002038  1610 raft_consensus.cc:2393] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 6: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:39.011291  1538 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:39.011662  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:39.012544  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:39.013295  1688 raft_consensus.cc:2368] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 5. Current term is 6.
I20260709 12:57:39.012790  3031 consensus_queue.cc:237] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:39.011296  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:57:39.014595  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 44443.2us
I20260709 12:57:39.014034  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:39.014948  1583 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:39.017309  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:39.017535  2266 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:39.017963  1611 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:39.016623  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:38.988884  3331 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:39.019109  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:39.021680  1581 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:39.024421  3494 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:57:39.024889  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:39.025607  1534 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:39.027350  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:39.028162  1611 raft_consensus.cc:2393] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 3: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:39.028962  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:39.029502  3196 consensus_meta.cc:287] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.548s	user 0.011s	sys 0.003s
I20260709 12:57:39.030112  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:39.030539  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:39.030943  1611 raft_consensus.cc:2410] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:57:39.031935  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:39.029934  3196 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:39.025738  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:38.996304  3351 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:39.033605  1682 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:39.034458  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:39.035058  3351 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:39.035588  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:39.035812  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:39.036258  1682 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:39.039031  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:39.039688  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:38.996454  3291 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:39.042196  3413 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:39.042618  3204 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:38.999068  2826 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:39.019584  3397 raft_consensus.cc:2804] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:57:39.047873  3204 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:39.048323  3204 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:39.050377  1508 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:39.034945  3196 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:39.032085  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:39.062106  1685 raft_consensus.cc:2393] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 6: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:39.065275  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:39.065989  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:39.066962  1617 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:39.069064  3413 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:39.069428  2964 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:39.050727  3366 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:39.082422  3517 log.cc:927] Time spent T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:57:39.072606  2989 consensus_queue.cc:1059] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:39.083040  3466 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:39.046936  3174 consensus_queue.cc:1048] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:57:39.048049  3397 raft_consensus.cc:697] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:39.072299  3351 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:57:39.086681  3397 consensus_queue.cc:237] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:39.078310  1537 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
W20260709 12:57:39.077605  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 53754.3us
I20260709 12:57:39.040184  2298 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:39.083360  2989 raft_consensus.cc:3055] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:39.090407  1583 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:39.096429  1583 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:39.102846  1583 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:39.074652  3525 log.cc:927] Time spent T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.283s	user 0.004s	sys 0.000s
I20260709 12:57:39.077500  3265 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:39.120162  1685 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:57:39.132682  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:39.177948  1685 raft_consensus.cc:1275] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:39.182190  1581 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:39.095209  2989 raft_consensus.cc:740] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:39.187058  1685 raft_consensus.cc:1275] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:57:39.122231  3403 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:39.192015  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:39.192819  1610 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:39.195205   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:39.134502  3366 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:39.183899  3291 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:39.219738  1685 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:57:39.220257  1685 pending_rounds.cc:85] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 2
I20260709 12:57:39.220531  1685 pending_rounds.cc:107] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:57:39.220779  1685 raft_consensus.cc:2889] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:39.189713  3265 raft_consensus.cc:697] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:39.192315  3403 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:39.226632  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 267326us
I20260709 12:57:39.224450  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:39.227771  1610 raft_consensus.cc:2393] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 6: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 12:57:39.232048  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 181826us
I20260709 12:57:39.202807  3393 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:39.237538  1508 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:39.238418  1685 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:57:39.232309  3403 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:57:39.248063  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 145319us
I20260709 12:57:39.253648  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:39.228945  3246 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:39.256423  3246 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:39.258985  3246 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:39.260449  1583 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:39.261791  1689 pending_rounds.cc:85] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 1
I20260709 12:57:39.262256  1689 pending_rounds.cc:107] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 12:57:39.262518  1689 raft_consensus.cc:2889] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:39.268805  3209 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:39.269488  3209 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:39.274767  3209 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:39.281890  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 99804.1us
I20260709 12:57:39.225103  3366 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:39.239494  3367 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:39.286541  1685 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:57:39.299480  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 62028.2us
I20260709 12:57:39.241523  3014 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:39.309058  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:39.309891  1610 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:39.304960  3419 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:39.321825  3549 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:39.322280  3549 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:39.322595  3549 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:39.322986  3419 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:39.323729  3419 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:39.285780  3291 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:39.327003  3351 consensus_queue.cc:1048] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:39.318686  3367 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:39.331198  3549 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:39.333468  3549 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:39.334033  3265 consensus_queue.cc:237] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:39.249608  3393 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:39.346197  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 43830.6us
I20260709 12:57:39.353225  1505 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:39.313742  3246 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:57:39.366657  3393 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:39.320318  3204 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:39.307123  3413 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:57:39.369944  1612 raft_consensus.cc:2410] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:57:39.370523  3366 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:39.371695  1508 leader_election.cc:400] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 5. Current term is 6.
W20260709 12:57:39.372562  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 65098.9us
I20260709 12:57:39.372969  2964 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:39.373504  1508 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:39.374145  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:39.374671  1614 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:39.376066  1610 raft_consensus.cc:1275] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:39.377063  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:39.382185  1505 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:39.333590  3367 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:39.386650  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:39.387346  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:39.389386  3204 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:39.373497  2964 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:39.392139  1614 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:39.394898  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:39.371739  3532 log.cc:927] Time spent T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.262s	user 0.000s	sys 0.002s
I20260709 12:57:39.403277  1610 raft_consensus.cc:2368] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6.
I20260709 12:57:39.341856  3343 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:57:39.394384  3246 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:39.416755  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:39.403687  3351 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:39.403450  3174 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:39.409510  3368 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:39.387924  3206 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:39.472010  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:39.475739  1655 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:39.489180  1655 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:39.493806  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 233450us
I20260709 12:57:39.494728  1583 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:39.440837  3466 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:39.506669  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:39.507579  1610 raft_consensus.cc:2393] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 7: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:39.510964  3403 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:39.513029  3204 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:39.491097  3367 raft_consensus.cc:2764] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:57:39.513230  3547 log.cc:927] Time spent T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:57:39.522218  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:39.522912  1688 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:39.523932  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:39.524603  1688 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:39.525496  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:39.525749  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:39.526284  1686 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:39.527186  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:39.527817  1685 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:39.530068  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:39.530726  1685 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:39.532786  1688 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:39.502373  3366 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:39.536903  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1056) took 1073 ms. Trace:
I20260709 12:57:39.540956  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:39.541654  1685 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:57:39.537439  1608 rpcz_store.cc:276] 0709 12:57:38.453353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:38.453488 (+   135us) service_pool.cc:224] Handling call
0709 12:57:38.485414 (+ 31926us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:38.603142 (+117728us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:38.603199 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:38.673634 (+ 70435us) log.cc:844] Serialized 26 byte log entry
0709 12:57:39.063270 (+389636us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:39.063331 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:39.063434 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:39.304663 (+241229us) spinlock_profiling.cc:243] Waited 9.94 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:57:39.518918 (+214255us) raft_consensus.cc:1685] finished
0709 12:57:39.518948 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:39.526256 (+  7308us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94070,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"spinlock_wait_cycles":22867712,"thread_start_us":348308,"threads_started":1,"wal-append.queue_time_us":423668}
I20260709 12:57:39.528890  3307 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:57:39.559834  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 277149us
I20260709 12:57:39.559334  1508 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:39.538326  3366 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:39.563035  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:39.561349  1581 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:39.563745  1616 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
W20260709 12:57:39.554282  3306 consensus_meta.cc:287] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.580s	user 0.012s	sys 0.003s
I20260709 12:57:39.566548  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:39.567111  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:39.568358  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:39.567353  1540 raft_consensus.cc:2393] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 6: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:39.566854  3306 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:39.548444  3204 raft_consensus.cc:697] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:39.609318  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:39.610173  1539 raft_consensus.cc:2393] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 6: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:39.611272  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:39.563102  3366 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:39.630245  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:39.631083  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:39.557873  3246 raft_consensus.cc:697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:39.632884  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:39.630388  3556 raft_consensus.cc:1064] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:57:39.634128  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:39.610451  3549 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:39.636502  3549 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:39.636850  3549 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:39.641590  3204 consensus_queue.cc:237] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:57:39.642395  3554 log.cc:927] Time spent T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:57:39.645354  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:39.646166  1682 raft_consensus.cc:2393] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 7: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:39.647498  1683 raft_consensus.cc:1275] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:57:39.651811  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 114200us
I20260709 12:57:39.652679  1508 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:39.653847  1508 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:39.655380  1686 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:39.656505  1534 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:39.658246  1688 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:57:39.660784  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:39.657276  1608 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:39.663105  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:39.664449  3460 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:39.669963  1583 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:39.648552  3246 consensus_queue.cc:237] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:39.673807  3397 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:39.673950  3460 consensus_queue.cc:1059] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:39.674403  3397 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:39.674875  3460 consensus_queue.cc:1048] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:39.664284  3154 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:39.677101  3154 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:39.678989  3306 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:39.679457  3154 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:39.680068  3154 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:39.681186  3296 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:39.681607  3296 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:39.681929  3296 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:39.686053  1534 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:39.610358  3343 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:39.724557  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:39.725041  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:39.727651  3397 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:39.680456  3306 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:57:39.727952  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:39.651734  3556 consensus_queue.cc:237] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:57:39.726395  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 56533.8us
I20260709 12:57:39.661610  3490 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:39.693161  3403 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:39.734180  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:39.703354  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 132399us
I20260709 12:57:39.737901  1685 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:39.741317  1539 raft_consensus.cc:2393] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 5: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:39.741016  1581 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:39.666880  3351 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:39.745452  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:39.746189  1539 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:39.676349  3460 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:57:39.693003  3257 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:39.733453  3367 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:39.754292  1654 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:39.759160  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:39.740044  3206 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:39.761718  1654 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:39.762959  1654 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:39.724368  3154 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:39.765561  2964 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:39.765825  3566 consensus_queue.cc:1048] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:57:39.774997  3393 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:39.776033  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:39.776707  3435 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:39.771878  3570 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:39.778414  3570 raft_consensus.cc:697] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:39.778976  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:39.768278  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:39.779241  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:39.780622  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:39.789501  1536 raft_consensus.cc:2393] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 5: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:39.789558  1540 raft_consensus.cc:2393] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 6: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:39.779294  3570 consensus_queue.cc:237] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:39.792613  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:39.793335  1535 raft_consensus.cc:2393] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 2: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:39.772926  2964 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:39.794937  3549 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:39.760138  3257 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:39.780452  3196 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:39.762725  3367 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:39.800505  3367 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:39.802106  1654 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:39.803184  3367 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:39.804392  1654 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:39.805117  3549 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:39.805202  3367 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:39.809098  1654 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:39.806605  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:39.753499  3490 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:39.816130  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 77916.4us
I20260709 12:57:39.818483  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:39.819360  1534 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:39.821179  1535 raft_consensus.cc:1275] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:39.820292  1654 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:39.807219  3257 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:39.823181  3566 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:39.823240  3196 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:39.820570  1583 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:57:39.842408  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:39.838075  3490 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:39.837911  3566 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:39.826929  1608 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:39.790544  3343 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:39.857057  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 183627us
I20260709 12:57:39.825424  1654 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:39.772207  2989 consensus_queue.cc:260] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:39.821367  3397 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:39.843405  3435 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:39.829178  3537 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:39.862629  1654 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:39.857864  3549 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:57:39.880880  1538 raft_consensus.cc:2393] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 5: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:39.860795  3209 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:39.865551  3154 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:39.888619  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:39.885435  1534 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:57:39.890938  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 45) took 1106 ms. Trace:
I20260709 12:57:39.890837  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:39.891686  1687 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:39.891613  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:39.892274  1690 rpcz_store.cc:276] 0709 12:57:38.780224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:38.780410 (+   186us) service_pool.cc:224] Handling call
0709 12:57:38.780824 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:38.781055 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:57:38.971608 (+190553us) log.cc:844] Serialized 14 byte log entry
0709 12:57:39.821981 (+850373us) spinlock_profiling.cc:243] Waited 3.13 ms on lock 0x7b18003b0d40. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f61455 00007fc860a493c7 00007fc85d05b9a7 00007fc85d06b0bf 00007fc85d06b038
0709 12:57:39.880322 (+ 58341us) log.cc:844] Serialized 14 byte log entry
0709 12:57:39.885939 (+  5617us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:39.885989 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:39.886028 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:39.886090 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:39.886203 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":113511,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":23,"raft.queue_time_us":1563,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":28852,"spinlock_wait_cycles":7191424,"thread_start_us":58184,"threads_started":1}
I20260709 12:57:39.894340  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:39.894996  1690 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:39.861111  3460 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:57:39.871186  3397 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:39.909600  3343 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:39.910362  3209 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:39.912619  3154 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:39.913156  3154 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:39.914410  3468 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:39.915309  3154 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:39.897702  2989 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:39.908310  1440 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38804 (request call id 31) took 10195 ms. Trace:
I20260709 12:57:39.923394  3566 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:39.925405  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:39.921942  1440 rpcz_store.cc:276] 0709 12:57:29.713171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:29.713936 (+   765us) service_pool.cc:224] Handling call
0709 12:57:39.908136 (+10194200us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:38.308813 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:38.309679 (+   866us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:38.309737 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:57:38.309758 (+    21us) tablet.cc:662] Decoding operations
0709 12:57:38.310233 (+   475us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:38.310334 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:38.310373 (+    39us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:57:38.310763 (+   390us) tablet.cc:701] Row locks acquired
0709 12:57:38.310804 (+    41us) write_op.cc:260] PREPARE: finished
0709 12:57:38.311023 (+   219us) write_op.cc:270] Start()
0709 12:57:38.311200 (+   177us) write_op.cc:276] Timestamp: P: 1783601858310947 usec, L: 0
0709 12:57:38.311240 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 12:57:38.321267 (+ 10027us) log.cc:844] Serialized 598 byte log entry
0709 12:57:38.851675 (+530408us) op_driver.cc:464] REPLICATION: finished
0709 12:57:39.312627 (+460952us) write_op.cc:301] APPLY: starting
0709 12:57:39.341349 (+ 28722us) tablet.cc:1367] starting BulkCheckPresence
0709 12:57:39.341508 (+   159us) tablet.cc:1370] finished BulkCheckPresence
0709 12:57:39.356965 (+ 15457us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:57:39.357272 (+   307us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:57:39.357539 (+   267us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:57:39.357597 (+    58us) write_op.cc:312] APPLY: finished
0709 12:57:39.357854 (+   257us) log.cc:844] Serialized 22 byte log entry
0709 12:57:39.358039 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:39.358124 (+    85us) write_op.cc:454] Released schema lock
0709 12:57:39.358185 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 12:57:39.358582 (+   397us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:39.358616 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1564340,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":380597,"apply.run_cpu_time_us":2551,"apply.run_wall_time_us":76802,"num_ops":1,"prepare.queue_time_us":296501,"prepare.run_cpu_time_us":11991,"prepare.run_wall_time_us":84702,"raft.queue_time_us":120158,"raft.run_cpu_time_us":14703,"raft.run_wall_time_us":298520,"replication_time_us":516012,"spinlock_wait_cycles":896,"thread_start_us":608117,"threads_started":4,"wal-append.queue_time_us":156558}]]}
I20260709 12:57:39.928790  3296 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:39.931895  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 69347.7us
I20260709 12:57:39.929373  1687 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:39.936110  1654 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:39.942502  1654 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:39.943372  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 63378.1us
I20260709 12:57:39.945289  1654 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:39.947454  3589 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:39.948103  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:39.948087  3589 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:39.950511  3589 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:39.951112  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:39.951686  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:39.943495  3556 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:39.952529  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:39.952716  3556 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:39.953351  1614 raft_consensus.cc:2393] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 6: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:39.954743  1609 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:39.955001  3556 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:39.955683  3296 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:39.959134  3397 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:39.960899  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:39.961524  1612 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:39.962497  1616 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:39.950554  1613 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:57:39.952054  1611 raft_consensus.cc:2410] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:57:39.971365  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:39.971983  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:39.902150  3575 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:39.972149  1609 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:39.977495  1505 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:39.979916  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:39.945937  3196 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:39.983155  1505 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:39.943971  3549 raft_consensus.cc:697] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:57:39.992157  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 46935.5us
I20260709 12:57:39.994051  1654 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:39.995694  1654 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:40.017110  1505 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:40.017376  3413 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:39.990578  3435 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:40.018025  3435 raft_consensus.cc:697] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:40.018705  1505 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:40.018923  3435 consensus_queue.cc:237] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.019765  3565 consensus_queue.cc:1059] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:40.020558  3565 consensus_queue.cc:1243] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer c262eac7fc904ae9bb91e450f6532e3f log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:57:40.021054  3565 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:39.981206  3366 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.023054  3537 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:40.025431  3343 raft_consensus.cc:3055] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:40.023314  3571 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:40.026163  3587 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:40.026376  3580 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:57:40.027390  3573 log.cc:927] Time spent T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:57:40.004341  3460 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:57:40.021695  3565 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:57:40.007997  3576 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:40.015938  3196 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:40.055580  2301 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 7 LEARNER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:57:40.059017  3196 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:40.064766  3196 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:40.068702  3549 consensus_queue.cc:237] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.030797  3343 raft_consensus.cc:740] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:39.985652  3575 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.059231  3576 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:40.092258  1612 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:40.096912  1617 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 6. Current term is 7. Ops: []
W20260709 12:57:40.099581  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 103887us
W20260709 12:57:40.100639  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 77077.8us
I20260709 12:57:40.101580  3196 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.102078  3343 consensus_queue.cc:260] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.103384  3343 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:40.103761  3196 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:40.035701  3571 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.094901  3576 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:40.055975  3587 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.132675  1505 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:40.111502  3196 consensus_queue.cc:1048] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 12:57:40.115310  3588 log.cc:927] Time spent T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:57:40.109731  3575 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:40.118414  3571 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:40.122804  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:40.139436  1690 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:40.110809  1654 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:40.134984  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:40.140383  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:40.137969  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:40.137023  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:40.141162  1534 raft_consensus.cc:2393] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 7: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:40.138610  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:40.141793  1535 raft_consensus.cc:1275] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:40.142427  1612 raft_consensus.cc:1240] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:40.143514  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:40.143051  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:40.147413  1536 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:40.148669  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:40.151304  3597 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:40.152103  3598 consensus_queue.cc:1059] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:57:40.138803  2989 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:40.166313  2989 raft_consensus.cc:697] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:40.167248  2989 consensus_queue.cc:237] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.136184  3196 consensus_queue.cc:1243] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer c262eac7fc904ae9bb91e450f6532e3f log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:57:40.168331  3413 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:40.166320  3598 raft_consensus.cc:3055] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:40.170046  3598 raft_consensus.cc:740] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:40.170898  3598 consensus_queue.cc:260] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.172113  3598 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:40.142333  3209 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:40.157790  3366 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:40.159524  3597 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.165452  3587 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:40.177469  1536 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:40.181579  1655 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:40.179037  1609 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:40.182183  1690 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:40.183377  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:40.183427  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:40.189903  1612 raft_consensus.cc:2393] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 3: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:40.195611  1655 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:40.199393  1533 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:57:40.205871  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:40.206526  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:40.209036  1541 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:57:40.180245  3515 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:57:40.229714  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:57:40.211412  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 100673us
W20260709 12:57:40.222720  3555 log.cc:927] Time spent T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.655s	user 0.000s	sys 0.006s
I20260709 12:57:40.212376  3460 consensus_queue.cc:1059] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:57:40.231166  1654 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:57:40.263773  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 68276.1us
I20260709 12:57:40.234225  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:40.265357  1655 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:40.234617  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:40.235145  1533 raft_consensus.cc:1240] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:40.235846  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:40.198998  3575 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:57:40.261649  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:40.204933  3366 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:40.198123  3413 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:40.231714  1505 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:40.275369  1654 leader_election.cc:400] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6.
I20260709 12:57:40.275734  1654 leader_election.cc:403] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:57:40.277829  1655 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:40.279007  1655 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:40.281426  3215 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6.
I20260709 12:57:40.281495  3575 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:40.276412  3366 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.286108  3597 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:40.286837  3567 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:40.287350  1690 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:40.276228  3460 raft_consensus.cc:3055] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:40.290688  3460 raft_consensus.cc:740] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:40.291611  3460 consensus_queue.cc:260] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.292960  3460 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:40.297331  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:40.298290  1538 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:40.299434  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:40.281200  3413 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.281057  3435 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:40.304885  3435 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.305438  3402 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:40.306041  1654 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:40.280853  3515 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:40.283390  3393 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:40.307559  3401 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:40.307986  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:40.308143  3401 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.308899  3393 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:40.309271  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:40.309829  3515 raft_consensus.cc:697] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:40.310334  3401 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:40.306912  1654 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:40.310597  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:40.311278  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:40.310925  3515 consensus_queue.cc:237] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:40.311887  1537 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:40.314146  3413 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:40.305959  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1060) took 1279 ms. Trace:
I20260709 12:57:40.269574  2826 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:40.317216  1691 rpcz_store.cc:276] 0709 12:57:39.026417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:39.255233 (+228816us) service_pool.cc:224] Handling call
0709 12:57:39.255644 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:39.256019 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:39.256047 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:39.256608 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 12:57:39.401705 (+145097us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:39.401993 (+   288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:39.402329 (+   336us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:40.221954 (+819625us) spinlock_profiling.cc:243] Waited 44.9 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:57:40.305659 (+ 83705us) raft_consensus.cc:1685] finished
0709 12:57:40.305681 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:40.305900 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3221,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":129,"spinlock_wait_cycles":103352704,"thread_start_us":143956,"threads_started":1,"wal-append.queue_time_us":278077}
I20260709 12:57:40.307436  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:40.321542  1536 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:40.322448  3594 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:40.324936  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:40.326399  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:40.326975  1611 pending_rounds.cc:85] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f: Aborting all ops after (but not including) 1
I20260709 12:57:40.327224  1610 raft_consensus.cc:2393] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 5: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:40.327304  1611 pending_rounds.cc:107] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:57:40.327243  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:40.328101  1611 raft_consensus.cc:2889] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:40.329770  1539 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:40.330854  1690 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:40.333653  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:40.335237  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:40.335692  1609 raft_consensus.cc:1275] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:40.336030  1614 raft_consensus.cc:2393] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 7: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:40.322877  3594 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:40.344849  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:40.345139  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:40.280599  3580 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:40.345100  3209 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:40.335291  3597 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:40.351217  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:40.352152  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:40.287086  3366 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:40.309346  3393 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:40.307449  3435 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:40.359738  1533 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:57:40.359128  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 80184.4us
I20260709 12:57:40.363042  1655 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:40.350432  3594 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:40.305982  3402 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.371485  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:40.372303  1617 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:40.370692  1655 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:40.375924  1655 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:40.358765  3567 raft_consensus.cc:697] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:40.377457  1536 raft_consensus.cc:1275] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:57:40.366132  3393 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:40.373713  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:40.382135  1614 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:57:40.344849  3576 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.382467  1655 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:40.386943  1536 raft_consensus.cc:1275] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:57:40.387810  1655 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:40.389374  1655 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:40.390460  3550 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:57:40.392009  1654 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:40.393006  3257 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:57:40.393662  1581 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:40.396029  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:40.396733  1542 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:40.398885  3397 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:57:40.402009  3402 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:40.402257  3576 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:40.404732  1581 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:40.363140  3209 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.407722  1654 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:40.374259  3580 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:40.377462  3435 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:40.409118  1581 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:40.378258  2989 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:40.364193  3597 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.383316  3366 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:40.400205  3397 consensus_queue.cc:1048] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:57:40.408097  2826 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:40.427060  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:40.411072  3257 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:40.427953  1581 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:40.413595  3576 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:40.432618  1581 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:40.433650  1581 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:40.420053  3215 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:40.412814  3154 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:57:40.411160  3570 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:57:40.428409  2826 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:40.436414  3296 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:40.436686  3031 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:40.429348  3575 consensus_queue.cc:1048] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:57:40.439658  3215 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:40.433861  3576 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:40.438365  3398 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:40.438581  3151 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:40.470160  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:40.470940  1616 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:40.476033  1540 raft_consensus.cc:2410] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:57:40.477034  1533 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:40.442656  3468 consensus_queue.cc:1048] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:57:40.428862  2989 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.444886  3567 consensus_queue.cc:237] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.452636  3576 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:40.452906  3590 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:40.455825  3215 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:40.446405  2826 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:40.450501  3296 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:40.463716  3209 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:40.450201  3031 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:40.467715  3393 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.446334  1581 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:40.486186  3398 raft_consensus.cc:697] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:40.495223  2989 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:40.516600  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 70343.6us
I20260709 12:57:40.511170  3296 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:57:40.516597  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 137731us
I20260709 12:57:40.528056  3585 consensus_queue.cc:1048] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.080s
W20260709 12:57:40.530049  3595 log.cc:927] Time spent T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.383s	user 0.002s	sys 0.000s
I20260709 12:57:40.517730  3031 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:40.523113  3397 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:40.515726  3590 raft_consensus.cc:697] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:40.541761  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:40.543284  1691 raft_consensus.cc:2393] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 5: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:40.544188  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:40.538652  3587 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:40.538504  3397 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:40.551329  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:40.552292  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:40.555369  1508 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:40.568617  3587 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.570955  3587 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:40.575107  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:40.575934  3619 log.cc:927] Time spent T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:57:40.540688  3614 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:57:40.576813  3151 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:40.577420  3151 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:40.577694  3612 log.cc:927] Time spent T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:57:40.575866  1612 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:57:40.580638  1685 raft_consensus.cc:2393] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 6: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 12:57:40.577117  3611 log.cc:927] Time spent T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:57:40.582844  3393 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:40.583221  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:40.583554  3553 log.cc:927] Time spent T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 1.012s	user 0.000s	sys 0.004s
I20260709 12:57:40.587121  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:40.587705  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:40.588366  1685 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:40.557384  3397 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:57:40.601316  3618 log.cc:927] Time spent T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:57:40.586165  3398 consensus_queue.cc:237] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.583951  3590 consensus_queue.cc:237] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.619863  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:40.619285  1583 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:40.627811  3154 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:40.630309  1583 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:40.598903  2989 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:40.631444  1583 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:40.638232  1611 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:57:40.639034  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:40.640249  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:40.641295  1691 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:40.644423  1685 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:40.636647  1583 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:40.646226  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:40.649678  1583 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:40.651338  1583 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:40.591388  3468 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:40.652868  3468 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.649719  3590 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:40.654424  3331 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:40.654798  3331 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:40.655139  3331 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:40.655270  3468 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:40.633585  3402 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:40.658336  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1269) took 1135 ms. Trace:
I20260709 12:57:40.658747  1682 rpcz_store.cc:276] 0709 12:57:39.523058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:39.646864 (+123806us) service_pool.cc:224] Handling call
0709 12:57:39.647213 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:39.664243 (+ 17030us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:57:39.731140 (+ 66897us) log.cc:844] Serialized 14 byte log entry
0709 12:57:39.870800 (+139660us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:39.871273 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 12:57:39.871400 (+   127us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:39.871600 (+   200us) log.cc:844] Serialized 14 byte log entry
0709 12:57:39.874212 (+  2612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:39.874294 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:40.320543 (+446249us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b18003d2d60. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f643f3 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd 000000000038f354 000000000038f199 00007fc859f4783a
0709 12:57:40.635713 (+315170us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b18003d2d60. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f643f3 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd 000000000038f354 000000000038f199 00007fc859f4783a
0709 12:57:40.658101 (+ 22388us) raft_consensus.cc:1685] finished
0709 12:57:40.658125 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:40.658269 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37725,"prepare.queue_time_us":67356,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":1353,"raft.queue_time_us":56520,"raft.run_cpu_time_us":365,"raft.run_wall_time_us":18859,"spinlock_wait_cycles":15236224,"thread_start_us":137661,"threads_started":1,"wal-append.queue_time_us":143139}
I20260709 12:57:40.660651  3585 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:40.660997  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:40.661726  1682 raft_consensus.cc:2393] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 6: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:40.664300  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:40.664754  1535 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:40.665096  1682 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:40.666072  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:40.666293  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:40.666534  1508 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:40.666836  1691 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:40.685053  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:40.687887  1533 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:40.672840  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:40.691330  1541 raft_consensus.cc:1275] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:57:40.691525  3546 raft_consensus.cc:3055] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:40.691949  3546 raft_consensus.cc:740] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:40.663118  3403 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:40.696815  1688 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
W20260709 12:57:40.668157  3548 log.cc:927] Time spent T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 1.112s	user 0.001s	sys 0.002s
I20260709 12:57:40.673470  3585 raft_consensus.cc:697] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:40.663017  3590 raft_consensus.cc:697] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:57:40.710179  3265 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.182s	user 0.005s	sys 0.022s
I20260709 12:57:40.692842  3546 consensus_queue.cc:260] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.689956  3565 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:57:40.712373  3620 log.cc:927] Time spent T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:57:40.688807  3246 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:40.700608  1583 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:40.733433  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 43585.2us
I20260709 12:57:40.668766  2826 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.723814  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:40.729386  3585 consensus_queue.cc:237] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.718318  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:40.740077  1688 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:40.669567  3215 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:40.727135  3265 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.212s	user 0.005s	sys 0.024s
I20260709 12:57:40.751156  3031 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:40.753438  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 345000us
I20260709 12:57:40.767784  1508 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:40.775493  1613 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:40.769126  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:40.779196  3594 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.742373  3246 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.780584  3151 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.781438  3594 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:40.782145  3246 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:40.775349  3546 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:40.783183  1655 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:40.783783  2826 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:40.784803  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:40.785524  3591 log.cc:927] Time spent T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.759s	user 0.003s	sys 0.000s
I20260709 12:57:40.783667  3515 consensus_queue.cc:1048] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:57:40.787050  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:40.785452  1688 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:40.787801  1685 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:40.778194  1691 raft_consensus.cc:2393] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 6: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:40.732554  3565 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:40.739292  3566 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:40.793615  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:40.784288  1655 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:40.785584  3209 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:40.784403  2826 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:40.791376  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:40.782789  3331 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:40.792943  3622 log.cc:927] Time spent T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:57:40.795975  1655 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:40.798871   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:40.805298  3594 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:40.777486  3587 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:40.806571  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:40.809921  1655 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:40.810736  1691 raft_consensus.cc:2393] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 7: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:40.794009  3565 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:40.813491  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:40.814432  1655 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:40.804804  1685 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:40.818181  1655 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:40.821467  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:40.799710  3209 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.808149  2826 raft_consensus.cc:697] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 7 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:40.808383  3151 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:40.826776  1691 raft_consensus.cc:2410] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:57:40.832644  3031 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:40.833650  2826 consensus_queue.cc:237] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:40.834554  3628 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:57:40.815912  3393 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:40.819275  3515 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:40.851529  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1042) took 1869 ms. Trace:
I20260709 12:57:40.793318  3590 consensus_queue.cc:237] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.880378  3031 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:40.881002  3031 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.883160  3031 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:40.883404  3136 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:40.818504  3367 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:57:40.857899  2298 raft_consensus.cc:1275] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:57:40.885456  3536 log.cc:927] Time spent T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 1.395s	user 0.004s	sys 0.000s
I20260709 12:57:40.886389  3296 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.887645  1687 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:57:40.864006  3331 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:40.827806  3576 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.874537  3215 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:40.827358  3575 consensus_queue.cc:1059] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:57:40.884003  3136 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:40.829263  3594 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:40.853305  1684 rpcz_store.cc:276] 0709 12:57:38.982576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:39.073943 (+ 91367us) service_pool.cc:224] Handling call
0709 12:57:39.074417 (+   474us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:39.074860 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:39.074890 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:39.075434 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 12:57:39.278852 (+203418us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:39.402366 (+123514us) log.cc:844] Serialized 14 byte log entry
0709 12:57:39.402833 (+   467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:39.402954 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:40.667510 (+1264556us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:57:40.846780 (+179270us) raft_consensus.cc:1685] finished
0709 12:57:40.851322 (+  4542us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:40.851471 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31174,"prepare.queue_time_us":124360,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":61,"raft.queue_time_us":5519,"raft.run_cpu_time_us":380,"raft.run_wall_time_us":10581,"spinlock_wait_cycles":23786880,"thread_start_us":203003,"threads_started":1,"wal-append.queue_time_us":430056}
I20260709 12:57:40.910187  1691 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:57:40.910740  1691 pending_rounds.cc:85] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 2
I20260709 12:57:40.910979  1691 pending_rounds.cc:107] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:57:40.911238  1691 raft_consensus.cc:2889] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:40.914049  1688 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:40.883507  3209 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:40.924364  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:40.927713  1508 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:40.928891  1684 raft_consensus.cc:1240] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:57:40.897071  3307 consensus_queue.cc:1048] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:57:40.929574  1654 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:40.932523  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:40.934767  3136 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:40.939862  3565 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.942322  3565 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:40.943646  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:40.951007  3576 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:40.952392  1583 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:40.952728  3571 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:40.958069  3546 consensus_queue.cc:1059] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:40.959481  3546 raft_consensus.cc:3055] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:40.959935  3546 raft_consensus.cc:740] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:40.961077  3546 consensus_queue.cc:260] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.963006  3546 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:40.954154  3331 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:40.953764  1583 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:40.972007  1583 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:40.973400  1583 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:57:40.978240  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 48763us
I20260709 12:57:40.980201  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1287) took 1093 ms. Trace:
I20260709 12:57:40.930001  3215 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:57:40.982537  3204 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:40.975745  3419 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:40.980659  1691 rpcz_store.cc:276] 0709 12:57:39.887137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:40.895312 (+1008175us) service_pool.cc:224] Handling call
0709 12:57:40.909776 (+ 14464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:40.979955 (+ 70179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:40.980146 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:40.931581  3296 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:40.973740  3307 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:40.971199  3594 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:40.983402  1654 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:40.972687  3331 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:40.986117  3204 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:40.977762  3397 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:40.992782  2826 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:41.023113  2826 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:41.023636  2826 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:40.989121  3419 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:40.985797  3215 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:40.995045  1616 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 2.
I20260709 12:57:41.080991  3367 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:41.081619  3367 raft_consensus.cc:697] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:41.081660  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:41.082922  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:41.082688  3367 consensus_queue.cc:237] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:41.083478  1691 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:41.084777  1615 raft_consensus.cc:1240] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8. Ops: []
W20260709 12:57:41.086704  3634 log.cc:927] Time spent T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.149s	user 0.004s	sys 0.000s
W20260709 12:57:41.088158  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:41.088593  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:41.092621  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:41.093492  1534 raft_consensus.cc:2410] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for term 7 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 12:57:41.094899  3635 log.cc:927] Time spent T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:57:41.095351  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:41.095973  1686 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:41.084297  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:40.995891  3331 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:41.038995  3204 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:41.101378  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:41.103153  1687 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:57:41.105441  1691 raft_consensus.cc:2393] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 6: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:41.058035  3419 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:41.110000  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 1284) took 1215 ms. Trace:
I20260709 12:57:41.107440  2826 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:41.110780  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:41.110435  1690 rpcz_store.cc:276] 0709 12:57:39.886678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:40.196936 (+310258us) service_pool.cc:224] Handling call
0709 12:57:41.102184 (+905248us) spinlock_profiling.cc:243] Waited 56.8 ms on lock 0x7b5400391f54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:41.102309 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130699520}
I20260709 12:57:41.112138  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:41.112790  1616 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:41.115674  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1272) took 1591 ms. Trace:
I20260709 12:57:41.117930  1686 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:41.119786  2826 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:41.129550  1686 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:41.132635  1505 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:41.061519  3594 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:41.142760  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 1291) took 1006 ms. Trace:
I20260709 12:57:41.143662  1691 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:57:41.144773  1505 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:41.145929  1505 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:41.116080  1683 rpcz_store.cc:276] 0709 12:57:39.523805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:39.649291 (+125486us) service_pool.cc:224] Handling call
0709 12:57:39.649608 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:39.872262 (+222654us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:39.872291 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:39.873433 (+  1142us) log.cc:844] Serialized 26 byte log entry
0709 12:57:41.106842 (+1233409us) spinlock_profiling.cc:243] Waited 8.66 ms on lock 0x7b54000ac6a0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfbb090 00007fc85cfc86b8 00007fc85d05192b 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c
0709 12:57:41.106902 (+    60us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:41.106943 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:41.107003 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:41.107042 (+    39us) raft_consensus.cc:1685] finished
0709 12:57:41.107053 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:41.115617 (+  8564us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50351,"raft.queue_time_us":87152,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":4750,"spinlock_wait_cycles":19917056,"thread_start_us":175415,"threads_started":2,"wal-append.queue_time_us":1514,"wal-append.run_cpu_time_us":1708,"wal-append.run_wall_time_us":1027249}
I20260709 12:57:41.143148  1540 rpcz_store.cc:276] 0709 12:57:40.136674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:40.136776 (+   102us) service_pool.cc:224] Handling call
0709 12:57:41.137407 (+1000631us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b5400312ed4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:41.142697 (+  5290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":768811904}
I20260709 12:57:41.128727  3351 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:41.157334  1690 raft_consensus.cc:1240] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:41.154695  1686 raft_consensus.cc:1240] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:41.160718  1691 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:57:41.155439  1683 raft_consensus.cc:1275] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:57:41.166930  1683 raft_consensus.cc:1275] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:57:41.137712  2989 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:41.142107  3246 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:41.172137  2989 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:41.153398  3537 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:41.191318  1690 raft_consensus.cc:1275] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:57:41.157014  3265 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:57:41.211961  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 228639us
I20260709 12:57:41.173307  3549 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:57:41.171584  3246 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:41.215408  1654 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:41.225906  2826 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:41.197559  3566 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:41.208155  2267 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:41.199095  3265 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:41.169535  3351 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:41.229516  1616 raft_consensus.cc:1240] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:41.229766  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:41.250195  1610 raft_consensus.cc:2368] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6.
I20260709 12:57:41.230885  1612 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:41.231047  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:41.231474  2989 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:41.231961  2826 raft_consensus.cc:697] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 2 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:41.232851  3397 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:41.234087  3246 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:57:41.235010  3640 log.cc:927] Time spent T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:57:41.236402  3637 log.cc:927] Time spent T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
W20260709 12:57:41.237130  3636 log.cc:927] Time spent T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 12:57:41.237275  1617 raft_consensus.cc:1275] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:57:41.240842  1683 raft_consensus.cc:1275] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:41.253145  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:41.254470  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:41.268724  1536 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:41.255187  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:57:41.257130  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 104897us
I20260709 12:57:41.263639  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:41.264138  1539 raft_consensus.cc:3055] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:57:41.270524  1539 raft_consensus.cc:740] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:41.271339  1539 consensus_queue.cc:260] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:41.272222  1539 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:41.274672  1537 raft_consensus.cc:1240] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:41.277004  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:41.278815  1540 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:41.248170  3265 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:41.280766  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:41.324811  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 44768.3us
I20260709 12:57:41.326908  1534 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:41.283146  1535 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:41.283680  3575 consensus_queue.cc:1059] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:57:41.328380  2826 consensus_queue.cc:237] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:41.336373  1505 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:41.339605  1536 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:41.340517  1537 raft_consensus.cc:1275] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:41.341141  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:41.341856  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:41.339587  1539 raft_consensus.cc:1275] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:57:41.347702  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:41.348449  1542 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
W20260709 12:57:41.349731  3642 log.cc:927] Time spent T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 12:57:41.351298  3641 log.cc:927] Time spent T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 12:57:41.351585  1540 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:41.274420  3569 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:41.354756  3306 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:41.355224  3306 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:41.355611  3306 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:57:41.266605  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 67732us
I20260709 12:57:41.356956  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:41.357800  1536 raft_consensus.cc:2393] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 7: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:41.360217  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:41.361479  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:41.363046  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:41.363819  1536 raft_consensus.cc:2393] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 5: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:41.364727  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:41.365494  1537 raft_consensus.cc:2393] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 6: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:41.366930  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:41.367590  1537 raft_consensus.cc:2368] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6.
I20260709 12:57:41.369374  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:41.332104  3401 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:41.372988  3401 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:41.374562  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:41.375329  1537 raft_consensus.cc:2393] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 2: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:41.239979  3549 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:41.371876  3246 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:41.377439  1533 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:41.377211  1616 raft_consensus.cc:2955] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 2 to 5, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:41.378870  3549 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:41.285710  3413 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.095s
I20260709 12:57:41.381845  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:41.382586  1537 raft_consensus.cc:2368] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6.
I20260709 12:57:41.383380  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:41.384114  1533 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:41.386435  1533 raft_consensus.cc:1275] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:57:41.333760  3587 consensus_meta.cc:287] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.521s	user 0.005s	sys 0.005s
I20260709 12:57:41.342520  1610 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 6.
I20260709 12:57:41.389918  1533 raft_consensus.cc:1240] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: []
W20260709 12:57:41.392185  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 61530.3us
I20260709 12:57:41.388487  1537 raft_consensus.cc:2393] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 5: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:41.407413  1581 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:41.395244  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1070) took 1030 ms. Trace:
I20260709 12:57:41.429539  3537 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:41.375242  3401 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:41.326578  3581 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:41.427122  1689 rpcz_store.cc:276] 0709 12:57:40.365126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:40.944967 (+579841us) service_pool.cc:224] Handling call
0709 12:57:40.945310 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:40.945668 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:40.945693 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:40.951883 (+  6190us) log.cc:844] Serialized 26 byte log entry
0709 12:57:41.172015 (+220132us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:41.172060 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:41.172651 (+   591us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:41.389789 (+217138us) raft_consensus.cc:1685] finished
0709 12:57:41.389812 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:41.395177 (+  5365us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3056,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":129,"thread_start_us":203777,"threads_started":1,"wal-append.queue_time_us":247496}
I20260709 12:57:41.389499  3587 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:57:41.533090  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:41.578933  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:41.425998  2301 raft_consensus.cc:1275] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:57:41.519868  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:41.534648  1542 raft_consensus.cc:1240] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:41.430179  3537 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:41.594390  3590 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:41.615357  2298 raft_consensus.cc:1275] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:57:41.615794  3590 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:41.617973  3590 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:41.629817  3594 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:41.518250  3397 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:57:41.648384  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 222461us
I20260709 12:57:41.647523  1534 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:41.388428  3204 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:41.643435  3616 log.cc:927] Time spent T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:57:41.437847  3398 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.207s
I20260709 12:57:41.730270  1609 raft_consensus.cc:2368] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6.
W20260709 12:57:41.730788  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 79607.8us
I20260709 12:57:41.735942  3397 raft_consensus.cc:697] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:41.730919  3587 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:41.724081  3419 consensus_meta.cc:287] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.595s	user 0.006s	sys 0.004s
I20260709 12:57:41.742964  3587 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:41.643131  3580 consensus_queue.cc:1048] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 12:57:41.743516  3215 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:41.743120  3397 consensus_queue.cc:237] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:41.814323  1654 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.127s	sys 0.246s
W20260709 12:57:41.818835  1654 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.127s	sys 0.247s
W20260709 12:57:41.821525  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 85682.1us
W20260709 12:57:41.819126  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 554981us
I20260709 12:57:41.788579  3246 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:41.792862  3565 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:41.838819  3647 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:41.845166  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 12:57:41.847177  3644 log.cc:927] Time spent T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.563s	user 0.004s	sys 0.004s
I20260709 12:57:41.853447  3565 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:41.835970  3654 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:57:41.794688  3351 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:41.854822  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1069) took 1497 ms. Trace:
I20260709 12:57:41.796830  3587 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:41.843165  3393 raft_consensus.cc:3055] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:41.854054  2301 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:57:41.775508  3419 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:41.849638  3306 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:41.855233  1684 rpcz_store.cc:276] 0709 12:57:40.357904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:40.929797 (+571893us) service_pool.cc:224] Handling call
0709 12:57:40.972272 (+ 42475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:40.972653 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:40.972680 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:40.973142 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 12:57:41.017330 (+ 44188us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:41.017376 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:41.017452 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:41.854598 (+837146us) raft_consensus.cc:1685] finished
0709 12:57:41.854617 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:41.854753 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6434,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":3250,"thread_start_us":33136,"threads_started":1,"wal-append.queue_time_us":240531}
I20260709 12:57:41.656553  3581 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:41.835949  3590 consensus_queue.cc:1059] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:57:41.867125  3654 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:41.873737  3581 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:41.856189  3546 consensus_meta.cc:287] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.883s	user 0.010s	sys 0.001s
I20260709 12:57:41.875008  1539 raft_consensus.cc:2410] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:57:41.863631  3646 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:41.875572  3646 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:41.877025  1684 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:57:41.877885  3646 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:41.879261  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:41.880021  1684 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
W20260709 12:57:41.874907  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:41.882002  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:41.883291  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:41.884531  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:41.875118  3599 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:41.885326  1689 raft_consensus.cc:2393] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 6: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:41.885689  3599 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:41.885826  3590 raft_consensus.cc:3055] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:41.886785  3590 raft_consensus.cc:740] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:41.889199  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:41.889782  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:41.890805  1533 raft_consensus.cc:2410] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:57:41.863462  3393 raft_consensus.cc:740] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:57:41.885080  3632 log.cc:927] Time spent T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.948s	user 0.003s	sys 0.010s
I20260709 12:57:41.895481  2989 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:41.896993  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:41.907421  1538 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:57:41.907284  2989 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:41.897387  1537 raft_consensus.cc:1275] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:57:41.897944  3351 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:41.889856  3215 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:41.893478  3652 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:41.900085  3246 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:41.893901  3580 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:41.901858  3393 consensus_queue.cc:260] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:41.903373  3655 log.cc:927] Time spent T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:57:41.853582  3647 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:41.910475  1581 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:41.923985  2989 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:41.935318  2989 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:41.888902  3419 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:41.887657  3590 consensus_queue.cc:260] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:41.723601  3566 raft_consensus.cc:2955] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index 2 to 6, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:41.944348  3656 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:41.945086  3656 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:41.946986  3331 consensus_meta.cc:287] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.829s	user 0.006s	sys 0.003s
I20260709 12:57:41.947556  3656 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:41.947501  3331 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:41.923695  3351 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:41.950421  3351 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:41.928004  3546 consensus_queue.cc:1059] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:57:41.939018  3590 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:41.952418  3393 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:41.944373  3306 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:41.927510  3215 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:41.933434  3580 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:41.933497  3246 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:41.978924  1655 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:41.956171  3550 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:41.981181  1581 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:41.981415  1655 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:41.982306  1581 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:41.983318  1581 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:41.984301  1655 leader_election.cc:400] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6.
I20260709 12:57:41.933248  3652 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:41.985852  1655 leader_election.cc:403] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:57:41.969223  3660 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:41.990561  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 101781us
I20260709 12:57:41.986649  1581 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:41.993582  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1323) took 1299 ms. Trace:
I20260709 12:57:41.988785  3397 consensus_queue.cc:1048] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:57:41.994046  1541 rpcz_store.cc:276] 0709 12:57:40.693740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:40.693844 (+   104us) service_pool.cc:224] Handling call
0709 12:57:40.717708 (+ 23864us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:57:40.742758 (+ 25050us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:40.742788 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:57:40.744442 (+  1654us) log.cc:844] Serialized 52 byte log entry
0709 12:57:40.896189 (+151747us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:40.896235 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:40.896317 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:41.884492 (+988175us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:57:41.989206 (+104714us) raft_consensus.cc:1685] finished
0709 12:57:41.989229 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:41.993499 (+  4270us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30716,"raft.queue_time_us":25230,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":2367,"spinlock_wait_cycles":36005120,"thread_start_us":149182,"threads_started":1,"wal-append.queue_time_us":189813}
I20260709 12:57:41.995644  3397 consensus_queue.cc:1243] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 12:57:42.000029  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 83982.4us
I20260709 12:57:42.000792  3656 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:42.007155  3656 raft_consensus.cc:697] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:41.998171  3206 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:42.008276  3206 raft_consensus.cc:697] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:42.008103  3656 consensus_queue.cc:237] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.009403  3206 consensus_queue.cc:237] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:41.998647  3550 raft_consensus.cc:697] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:42.013515  3550 consensus_queue.cc:237] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:41.980963  3646 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:41.986842  3367 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:41.989365  3031 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:42.020569  1655 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:41.989511  3661 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:41.979496  3401 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:57:42.018011  3546 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:42.041235  3546 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.043385  3647 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:42.043272  3658 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:42.044315  3658 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.045184  3397 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:42.046464  3658 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:42.018903  3666 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6.
I20260709 12:57:42.047405  3031 raft_consensus.cc:697] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:42.045189  1539 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:57:42.048425  3031 consensus_queue.cc:237] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:42.049700  3265 consensus_meta.cc:287] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.708s	user 0.008s	sys 0.004s
I20260709 12:57:42.020305  3660 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.050165  1539 raft_consensus.cc:2955] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 2 to 6, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:42.048727  3331 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:42.050161  3265 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.055466  1583 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:42.056066  1540 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:42.029759  3367 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:42.057801  3265 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:42.030157  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:42.025255  3661 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:42.030658  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:42.031586  1508 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:42.026569  3569 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:42.030831  3576 raft_consensus.cc:3055] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:42.032958  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:42.060563  1537 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:42.035054  3215 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:42.043416  3546 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:42.060151  3576 raft_consensus.cc:740] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:42.063572  3576 consensus_queue.cc:260] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.064661  3401 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:42.065301  3401 consensus_queue.cc:1243] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:57:42.034802  3291 raft_consensus.cc:3055] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:42.037451  3580 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:42.038940  3246 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:42.025198  3351 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:57:42.066056  3291 raft_consensus.cc:740] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:42.059340  3661 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:42.060577  3658 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:42.060099  3569 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:42.067042  3658 raft_consensus.cc:697] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:42.066460  3351 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:57:42.072224  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:42.072968  3351 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:42.061973  1581 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:42.073287  3291 consensus_queue.cc:260] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.073563  2826 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:42.074805  3291 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:42.074628  2826 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:57:42.073349  3660 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:42.075047  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:42.075548  3660 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:42.075947  3660 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:42.076313  3660 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:42.076805  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.077004  2826 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:42.071317  3658 consensus_queue.cc:237] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:42.078858  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 47383.6us
I20260709 12:57:42.079807  3546 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:42.080582  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1076) took 1697 ms. Trace:
I20260709 12:57:42.080430  3546 consensus_queue.cc:1048] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:42.080952  1685 rpcz_store.cc:276] 0709 12:57:40.383249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:41.119214 (+735965us) service_pool.cc:224] Handling call
0709 12:57:41.119460 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:41.167970 (+ 48510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:41.168002 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:41.168043 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:41.168072 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:42.080323 (+912251us) spinlock_profiling.cc:243] Waited 48.3 ms on lock 0x7b5400388954. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:42.080374 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:42.080527 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111098112}
I20260709 12:57:42.084652  3650 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:42.075093  3576 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:42.089421  3661 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.091161  3654 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:42.091804  3661 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:42.092779  3537 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:42.094566  3653 log.cc:927] Time spent T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.247s	user 0.001s	sys 0.001s
I20260709 12:57:42.095379  3331 consensus_queue.cc:1059] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:42.095906  3401 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:57:42.096299  3581 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:42.096534  3599 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:42.097683  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 77225.2us
I20260709 12:57:42.098280  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:42.099150  1655 leader_election.cc:400] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6.
I20260709 12:57:42.099470  1655 leader_election.cc:403] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:57:42.101029  1508 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:42.102774  3580 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:42.103474  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:42.104375  1655 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:42.100315  3367 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:42.113391  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:42.115687  1655 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:42.116290  1685 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:42.116705  2826 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:57:42.087284  3659 log.cc:927] Time spent T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.241s	user 0.000s	sys 0.002s
I20260709 12:57:42.120393  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:42.123294  2826 consensus_queue.cc:1048] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:42.141374  1685 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:42.073545  3569 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:42.100463  3393 consensus_queue.cc:1048] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:57:42.115099  3673 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:42.130765  3215 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:42.161556  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:42.162730  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:42.100111  3331 consensus_queue.cc:1048] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 12:57:42.168165  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:42.170224  3597 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:42.171838  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:42.173177  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:42.173527  1508 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:42.174367  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:42.175149  1682 raft_consensus.cc:2393] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 7: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:42.176033  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:42.177775  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:42.109769  3580 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.180387  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1065) took 1831 ms. Trace:
I20260709 12:57:42.181073  3580 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:42.107100  3590 consensus_queue.cc:1048] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:57:42.161285  3215 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.182060  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:42.180790  1687 rpcz_store.cc:276] 0709 12:57:40.348817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:40.888453 (+539636us) service_pool.cc:224] Handling call
0709 12:57:41.102934 (+214481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:41.108972 (+  6038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:42.180192 (+1071220us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b5400391f50. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:42.180326 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":492456832}
I20260709 12:57:42.184523  1682 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:42.185294  1508 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:42.178972  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:42.186233  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 89359.7us
I20260709 12:57:42.186689  1684 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:42.191022  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:42.191349  1583 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:42.196570  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:42.197526  1684 raft_consensus.cc:2393] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 7: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:42.198612  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:42.201246  1689 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:42.190727  3660 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.190177  3597 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:42.204141  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:42.204429  3661 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:42.192389  3667 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:42.206779  3660 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:42.203352  3669 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:42.217730  3669 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.220016  3669 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:42.213855  1687 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:42.222985  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:42.224370  1684 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:42.223788  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:42.226240  1683 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:42.228053  1508 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:42.231292  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:42.234997  1508 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:42.230897  3668 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:42.236017  3597 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:42.236451  3597 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:42.236835  3597 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:42.237495  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:42.238396  1683 raft_consensus.cc:2393] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 7: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:42.247391  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:42.248032  1683 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:42.236122  3668 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:42.236765  3215 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:42.247349  3599 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:42.257426  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:42.258450  1683 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:57:42.263096  1654 leader_election.cc:400] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6.
I20260709 12:57:42.270004  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:42.272971  3594 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:42.273586  1654 leader_election.cc:400] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6.
I20260709 12:57:42.273352  3580 consensus_queue.cc:1048] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:42.249723  3668 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:42.273895  1654 leader_election.cc:403] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:57:42.278625  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:42.279376  1691 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:57:42.271871  3367 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6.
I20260709 12:57:42.280375  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:42.282006  1691 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:57:42.271673  3031 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:42.289440  3031 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.294991  1684 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:57:42.284247  1691 raft_consensus.cc:1275] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:42.296173  3673 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:42.298172  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:42.298627  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.299358  1609 raft_consensus.cc:1275] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:57:42.300593  1684 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:57:42.301402  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.300901  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.305197  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.304250  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.275350  3667 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:42.308454  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:42.309299  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.312122  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.313889  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.314113  1610 raft_consensus.cc:2393] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 6: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:42.301429  3401 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:42.320279  3401 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.321031  1610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:57:42.321892  1610 raft_consensus.cc:606] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:42.322659  3401 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:42.331820  1682 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:42.303957  3677 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:42.304901  3206 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:42.305842  3031 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:42.337472  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 1071) took 1967 ms. Trace:
I20260709 12:57:42.339514  1688 rpcz_store.cc:276] 0709 12:57:40.369954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:40.806704 (+436750us) service_pool.cc:224] Handling call
0709 12:57:42.337261 (+1530557us) spinlock_profiling.cc:243] Waited 99.9 ms on lock 0x7b5400158954. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:42.337399 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229660416}
I20260709 12:57:42.341605  1582 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:42.341354  3677 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.345283  3652 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:42.312842  3667 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.348577  3401 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:42.324437  3597 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.350176  3565 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:42.350183  3677 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:42.354480  3565 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:42.355520  1612 raft_consensus.cc:1275] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:42.355872  3681 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:42.355029  3565 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.356950  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.355079  3597 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:42.358750  3565 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:42.366150  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:42.367899  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:42.377542  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:42.379149  1688 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:42.378320  1689 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:42.383915  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:42.385622  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:42.387243  1683 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 7.
I20260709 12:57:42.387929  1508 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:42.390887  3607 log.cc:927] Time spent T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.307s	user 0.001s	sys 0.001s
I20260709 12:57:42.393604  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 35) took 1063 ms. Trace:
I20260709 12:57:42.394093  1616 rpcz_store.cc:276] 0709 12:57:41.330371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:41.330538 (+   167us) service_pool.cc:224] Handling call
0709 12:57:41.330832 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:41.377070 (+ 46238us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:57:41.384964 (+  7894us) log.cc:844] Serialized 14 byte log entry
0709 12:57:41.724730 (+339766us) log.cc:844] Serialized 14 byte log entry
0709 12:57:41.744166 (+ 19436us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:41.744221 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:41.744264 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:42.393322 (+649058us) spinlock_profiling.cc:243] Waited 46 ms on lock 0x7b54001f77d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:42.393375 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:42.393533 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":143701,"prepare.queue_time_us":10579,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":5018,"raft.queue_time_us":150299,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":27331,"spinlock_wait_cycles":106919552,"thread_start_us":246750,"threads_started":1,"wal-append.queue_time_us":423562}
I20260709 12:57:42.354008  3206 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:42.406165  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.406569  1508 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:42.407994  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:42.412319  1688 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:57:42.414377  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.416157  1609 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:42.348582  3667 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:42.422343  1508 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:42.447075  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:42.448181  1508 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:42.452270  1508 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:42.453846  1508 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:42.455437  1688 raft_consensus.cc:1240] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:42.415275  3565 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:42.420974  3460 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:42.468441  1616 raft_consensus.cc:1240] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:42.459905  3650 raft_consensus.cc:2804] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:42.467054  3669 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:57:42.449817  3673 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6.
I20260709 12:57:42.449923  1687 raft_consensus.cc:2955] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 2 to 6, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:42.474511  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.459426  3291 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:42.458779  3597 raft_consensus.cc:2764] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:57:42.488549  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.490655  1610 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:57:42.491743  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.468969  3580 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:42.494396  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.470206  3460 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:42.469926  3565 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:42.502789  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.472426  3650 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:42.503485  3460 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:42.513885  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.514571  1613 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:57:42.503661  3565 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:42.516850  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:42.517417  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:42.517582  1534 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:42.517993  1538 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:42.518563  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:42.519090  1540 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:42.520102  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:42.520539  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:42.513937  3204 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:42.507776  3690 log.cc:927] Time spent T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:57:42.521961  1542 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:57:42.522792  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.522933  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.523993  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:42.524540  1537 raft_consensus.cc:1217] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-8.5]   Dedup: 4.3->[6.4-8.5]
I20260709 12:57:42.525053  1537 pending_rounds.cc:85] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 3
I20260709 12:57:42.525264  1537 pending_rounds.cc:107] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:57:42.525475  1537 raft_consensus.cc:2889] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:42.519107  1685 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:42.527644  2266 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:42.511972  3650 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:42.524715  1616 raft_consensus.cc:2368] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8.
I20260709 12:57:42.534498  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:42.534660  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:42.490514  3669 raft_consensus.cc:697] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:42.491585  3291 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:42.501099  3206 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:42.543756  1538 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:42.546653  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:42.548271  1539 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:42.549731  1616 raft_consensus.cc:1275] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:57:42.551148  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.541453  3648 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:42.551693  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:42.488169  3668 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.547719  1540 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:42.557480  1539 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:57:42.553858  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.563164  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:42.548882  3291 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:42.504082  3580 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.574185  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:42.576308  1539 raft_consensus.cc:2393] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 5: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:42.577528  1538 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
W20260709 12:57:42.578754  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:42.582296  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:42.591765  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.594062  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.594933  1505 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:57:42.589287  3691 log.cc:927] Time spent T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:57:42.594792  1617 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:42.592439  1609 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:57:42.605448  1505 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:42.550033  3565 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.606235  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.609223  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:42.612233  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:42.589994  3367 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:42.619421  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:42.620536  2826 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:42.621102  2826 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.551620  3669 consensus_queue.cc:237] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.606688  3667 consensus_queue.cc:1048] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:57:42.608884  3587 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:42.627089  2826 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:42.627385  3689 log.cc:927] Time spent T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:57:42.629427  3650 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.605810  3215 consensus_queue.cc:1059] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:57:42.613608  3537 consensus_queue.cc:1059] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:57:42.613641  3652 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:57:42.651518  2826 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:42.625404  3413 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:42.653393  1533 raft_consensus.cc:1275] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:57:42.653721  1534 raft_consensus.cc:1240] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:42.653021  2826 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.632895  3594 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 12:57:42.669373  3692 log.cc:927] Time spent T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 12:57:42.682255  2826 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:42.624039  3367 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.670605  3537 consensus_queue.cc:1243] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer c262eac7fc904ae9bb91e450f6532e3f log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:57:42.686887  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 81545.3us
I20260709 12:57:42.670239  3670 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 12:57:42.663503  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 118881us
I20260709 12:57:42.691164  1505 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:42.685319  3565 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:42.674863  3594 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.711097  3667 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:57:42.714187  3696 log.cc:927] Time spent T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:57:42.717392  3668 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:42.713305  1505 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:42.700234  3575 raft_consensus.cc:3055] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:42.727262  3673 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:42.729620  3673 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.731935  3673 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:42.732543  3537 consensus_queue.cc:1059] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:57:42.732797  3419 raft_consensus.cc:3055] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:42.733278  3419 raft_consensus.cc:740] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:42.718705  3413 consensus_queue.cc:1059] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:57:42.734203  3419 consensus_queue.cc:260] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.735400  3419 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:42.727293  3575 raft_consensus.cc:740] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:42.736250  3460 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.737371  1539 raft_consensus.cc:1240] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:42.738453  3460 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:42.742036  3413 raft_consensus.cc:3055] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:42.742424  3413 raft_consensus.cc:740] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:42.743244  3413 consensus_queue.cc:260] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.744568  3413 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:42.734607  3291 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.745527  1541 raft_consensus.cc:1240] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:42.746623  3291 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:42.735708  1436 catalog_manager.cc:5697] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 1 to 3, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 3 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:42.736871  3575 consensus_queue.cc:260] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.748699  3575 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:42.750344  3599 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:42.753007  3599 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:42.740118  3594 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:42.740655  3650 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:42.740877  3668 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:42.739923  1505 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:42.756386  3580 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:42.694008  3670 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:42.759379  3700 log.cc:927] Time spent T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:57:42.767109  3699 log.cc:927] Time spent T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.178s	user 0.002s	sys 0.000s
I20260709 12:57:42.760344  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1306) took 1815 ms. Trace:
I20260709 12:57:42.773460  1686 rpcz_store.cc:276] 0709 12:57:40.968692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:41.161284 (+192592us) service_pool.cc:224] Handling call
0709 12:57:41.161567 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:41.161789 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:57:41.394707 (+232918us) log.cc:844] Serialized 14 byte log entry
0709 12:57:41.395263 (+   556us) log.cc:844] Serialized 14 byte log entry
0709 12:57:42.169227 (+773964us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b1800374d40. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f643f3 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd 000000000038f354 000000000038f199 00007fc859f4783a
0709 12:57:42.759746 (+590519us) spinlock_profiling.cc:243] Waited 5.72 ms on lock 0x7b1800374d40. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859edec0a 00007fc86361e219 00007fc85cc07d70 00007fc85cbfb293 00007fc85cbf0cea 00007fc85cbf123a 00007fc85d05ba2a 00007fc85d06b0bf 00007fc85d06b038
0709 12:57:42.760007 (+   261us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:42.760056 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:42.760100 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:42.760177 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:42.760289 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29810,"prepare.queue_time_us":37738,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":95,"raft.queue_time_us":1293,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":7340,"spinlock_wait_cycles":40702720,"thread_start_us":203319,"threads_started":1}
I20260709 12:57:42.779505  1505 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:42.784049  1505 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:42.793426  1536 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: [5.3-7.4]
I20260709 12:57:42.761843  3367 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:42.797797  3670 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:42.785633  3668 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:42.798698  3668 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:42.799053  3668 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:42.804515  3704 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:42.808307  3599 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.810361  1505 leader_election.cc:400] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8.
I20260709 12:57:42.810729  1505 leader_election.cc:403] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:57:42.811713  1505 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:42.812402  3571 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:42.812810  1505 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:42.813144  3571 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8.
I20260709 12:57:42.813597  3704 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:57:42.814268  3704 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:42.814604  3704 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:42.814939  3704 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:57:42.821210  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:42.822570  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:42.824168  1682 raft_consensus.cc:1275] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:42.829635  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:42.779004  1436 catalog_manager.cc:5697] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 1 to 4, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 4 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:42.825805  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:42.831676  1690 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:42.837662  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:42.839251  1583 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:42.826632  1581 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:42.828925  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:42.843034  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:42.843564  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.844744  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:42.845423  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:42.849208  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:42.842903  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:42.850821  3296 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:42.851233  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:42.851899  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:42.852067  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.852327  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:42.852732  1541 raft_consensus.cc:2393] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 4: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:42.852552  3566 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:42.852988  3575 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:42.853561  3575 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.855374  1538 raft_consensus.cc:2393] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 8: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:42.855770  1581 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:42.856680  1654 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:42.866559  1684 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:42.867838  1542 raft_consensus.cc:2393] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 7: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:42.868185  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:42.870703  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:42.871404  1583 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:42.872181  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:42.873065  1534 raft_consensus.cc:2368] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 6. Current term is 7.
I20260709 12:57:42.876937  1654 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:42.877586  1581 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:42.881699  1654 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:42.850733  3397 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:57:42.867622  3307 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:42.883671  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:42.887337  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:42.869057  3367 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:42.889816  1538 raft_consensus.cc:1275] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:42.890571  1581 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:42.884555  3031 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:42.883924  1436 catalog_manager.cc:5697] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 2 to 5, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 5 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:42.892405  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:42.882705  3566 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:42.900260  2826 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:42.884790  3594 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:42.902112  2826 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.900995  1535 raft_consensus.cc:2410] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:57:42.886837  3490 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:42.904541  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:42.907579  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:42.905249  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:42.909297  1655 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:42.914956  1581 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:42.887425  3307 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:42.915020  1690 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:42.895888  3576 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:42.880404  3580 consensus_queue.cc:1048] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:57:42.917814  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:42.904626  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:42.926656  1689 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:42.926730  1682 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:57:42.916106  1655 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:42.854537  2298 raft_consensus.cc:2955] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 2 to 6, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:42.894619  3397 raft_consensus.cc:697] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:42.937237  3397 consensus_queue.cc:237] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.939409  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:42.939997  1608 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:42.882505  3296 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:57:42.940824  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:42.941718  3660 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:42.940277  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:42.920171  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:42.943462  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:42.943710  3402 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:42.944145  1581 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:42.944937  3658 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:42.929813  1436 catalog_manager.cc:5697] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 2 to 4, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 4 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:42.917253  3031 raft_consensus.cc:697] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:42.932148  3393 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:42.923556  3307 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:42.934077  3668 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.967939  1583 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:42.969820  3668 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:42.970518  3581 consensus_queue.cc:1048] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:42.971077  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.903216  3398 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:57:42.972203  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.972893  1616 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:42.972199  3581 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:42.973730  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.924994  3367 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:42.946488  1614 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:42.969874  1583 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:42.935789  3599 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:42.950016  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.926014  3654 raft_consensus.cc:3055] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:42.979434  3654 raft_consensus.cc:740] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:42.948395  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:42.980365  3654 consensus_queue.cc:260] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.981688  3654 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:42.982533  3031 consensus_queue.cc:237] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.945410  3658 raft_consensus.cc:697] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:42.985859  3660 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:42.985644  3658 consensus_queue.cc:237] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:42.968145  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:42.988139  1685 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:57:42.950287  1682 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:42.956629  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.899804  3652 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:57:42.976717  1541 raft_consensus.cc:1240] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:42.990393  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:42.985555  1581 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:42.953783  1690 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:42.996573  1682 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:57:43.008595  1682 raft_consensus.cc:1275] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:57:43.014868  1614 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:43.016126  1608 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
W20260709 12:57:43.016741  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 67074.5us
I20260709 12:57:43.021381  1685 raft_consensus.cc:1275] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:43.024665  1682 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:57:43.026602  1682 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: [5.3-7.4]
I20260709 12:57:42.967041  3669 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:43.033746  1581 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:42.987355  3581 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:43.019407  3550 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:57:43.040736  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 124717us
I20260709 12:57:43.048261  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:43.049366  1655 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:43.049782  1609 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:43.050037  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:43.050992  1655 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:43.047472  1505 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:43.067662  2826 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:43.073796  1505 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:43.076301  3668 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:43.052628  3419 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:57:43.081446  1655 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:43.083096  1654 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:43.083251  1655 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:43.086666  1609 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:43.083036  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:43.088243  1505 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:43.049126  3581 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:43.033329  3585 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:57:43.094437  1505 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:43.103394  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 69725.1us
I20260709 12:57:43.066505  3576 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:43.060945  3215 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:43.133128  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:43.135039  1505 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:43.110808  1581 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:43.115940  1617 raft_consensus.cc:1240] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:57:43.046720  3398 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:57:43.150990  1505 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:43.143167  3683 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:43.145977  3031 consensus_queue.cc:1059] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:43.047207  3331 consensus_queue.cc:1048] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:57:43.089250  3550 raft_consensus.cc:697] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:43.053730  3296 consensus_queue.cc:1048] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 12:57:43.039750  3669 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:43.090965  3549 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:43.096769  3668 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:57:43.108392  3650 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:43.133163  3587 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:43.131982  3413 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:43.165112  2989 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:43.105609  3722 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:43.093741  3490 consensus_queue.cc:1059] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
W20260709 12:57:43.161422  3699 log.cc:927] Time spent T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:57:43.154031  3670 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:57:43.199893  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 55783.4us
I20260709 12:57:43.153092  3597 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:57:43.177171  3721 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:57:43.292110  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 206319us
W20260709 12:57:43.277515  3715 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:57:43.270445  3670 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:57:43.305405  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 222233us
I20260709 12:57:43.309181  1655 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:43.203161  3587 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:43.324676  3307 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:43.326012  3587 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:43.299834  3575 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:43.328295  3720 log.cc:927] Time spent T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:57:43.317793  3730 consensus_queue.cc:1059] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:57:43.248515  3549 consensus_queue.cc:1059] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:57:43.321063  1655 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:43.366308  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 45370.7us
I20260709 12:57:43.367213  1655 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:43.370087  1655 leader_election.cc:400] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 6. Current term is 7.
I20260709 12:57:43.370404  1655 leader_election.cc:403] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:57:43.345933  1689 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:43.372246  1684 raft_consensus.cc:1240] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:57:43.304752  3670 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:43.409199  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 156380us
I20260709 12:57:43.370749  3576 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:43.370566  3367 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:43.374606  3652 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:43.381076  3730 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:43.380743  3549 raft_consensus.cc:3055] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:57:43.383889  3393 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 6. Current term is 7.
W20260709 12:57:43.423530  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 52199.9us
I20260709 12:57:43.425900  2989 raft_consensus.cc:697] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:43.414201  3733 raft_consensus.cc:3055] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:57:43.426538  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 245228us
I20260709 12:57:43.301404  3550 consensus_queue.cc:237] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:43.402904  3413 raft_consensus.cc:697] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:43.426925  2989 consensus_queue.cc:237] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:43.441983  1655 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:43.420661  3549 raft_consensus.cc:740] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:57:43.443693  3717 log.cc:927] Time spent T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.346s	user 0.001s	sys 0.000s
I20260709 12:57:43.428198  3733 raft_consensus.cc:740] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:43.460422  1536 raft_consensus.cc:1275] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:57:43.461269  1535 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:57:43.420027  1436 catalog_manager.cc:5697] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:43.481458  3413 consensus_queue.cc:237] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:43.482630  1436 catalog_manager.cc:5697] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:43.486042  1533 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:57:43.487181  3751 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:43.447690  3397 consensus_queue.cc:1059] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:57:43.488045  3397 consensus_queue.cc:1243] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:57:43.489014  3731 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:57:43.428960  3728 consensus_queue.cc:1059] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 12:57:43.492197  3728 raft_consensus.cc:3055] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:43.492594  3728 raft_consensus.cc:740] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:43.493441  3728 consensus_queue.cc:260] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:43.494825  3728 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:43.498107  1538 raft_consensus.cc:1275] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:43.445762  3650 raft_consensus.cc:697] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 12:57:43.535501  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 109036us
I20260709 12:57:43.538403  1655 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:43.542258  1686 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:57:43.543159  1655 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:43.544116  1655 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:43.551469  2826 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:43.558782  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:43.502152  3669 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:43.534927  3727 log.cc:927] Time spent T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 12:57:43.559080  3751 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:43.560371  3722 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:43.558314  3594 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:43.587687  3296 consensus_queue.cc:1048] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:43.532015  3658 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:57:43.623929  1508 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:43.626808  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:43.627485  1691 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:57:43.568441  3743 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 12:57:43.636515  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:43.572722  3549 consensus_queue.cc:260] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:43.589493  3402 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:57:43.597152  3590 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:57:43.621057  3734 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:43.580122  3733 consensus_queue.cc:260] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:43.631604  3587 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:43.633489  3594 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:43.596505  3722 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:43.664733  3594 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:43.666661  3722 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:43.667009  3594 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:43.669819  3721 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:57:43.673992  3704 consensus_meta.cc:287] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.859s	user 0.011s	sys 0.000s
I20260709 12:57:43.674508  3704 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:43.675652  1540 raft_consensus.cc:1240] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 7. Current term is 8. Ops: [5.3-7.4]
W20260709 12:57:43.650537  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:43.647784  3667 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:57:43.682235  3734 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:43.686806  3723 log.cc:927] Time spent T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.417s	user 0.001s	sys 0.000s
I20260709 12:57:43.688555  3587 raft_consensus.cc:697] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:43.655802  3206 raft_consensus.cc:993] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
W20260709 12:57:43.663775  3654 consensus_meta.cc:287] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.682s	user 0.009s	sys 0.000s
I20260709 12:57:43.612313  3650 consensus_queue.cc:237] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:43.696466  1616 raft_consensus.cc:1240] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:57:43.696753  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:43.699186  3398 raft_consensus.cc:3055] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:43.699642  3398 raft_consensus.cc:740] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:43.700088  1608 raft_consensus.cc:1240] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 6. Current term is 7. Ops: []
W20260709 12:57:43.702857  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 52967.2us
I20260709 12:57:43.703662  1508 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:43.691067  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 99234.5us
I20260709 12:57:43.709408  1539 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:57:43.722999  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:43.703346  3734 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:43.708228  3206 raft_consensus.cc:1081] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Signalling peer dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:57:43.710250  3537 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:57:43.787744  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 57482.7us
W20260709 12:57:43.787688  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 80855.1us
I20260709 12:57:43.689568  3587 consensus_queue.cc:237] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:43.733780  3413 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:57:43.781973  3581 consensus_meta.cc:287] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.650s	user 0.009s	sys 0.002s
I20260709 12:57:43.798763  1535 raft_consensus.cc:1275] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:57:43.783378  3537 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:43.779906  3658 consensus_queue.cc:1048] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:57:43.814755  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:43.828166  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:43.828984  1686 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:43.811329  3537 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:43.812541  3721 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:43.796731  3670 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:43.809620  3413 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:43.802104  3581 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:43.826313  3550 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:43.848155  1508 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:43.853705  2989 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:43.854089  2989 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:43.854404  2989 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:43.854290  1686 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:45440
I20260709 12:57:43.856716  1686 raft_consensus.cc:606] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:43.857178  1686 raft_consensus.cc:614] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:43.863338  3550 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:43.865556  3550 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:43.868664  3757 consensus_queue.cc:1048] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:57:43.873346  3670 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:43.873724  3581 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:43.875530  3413 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:43.830467  3751 consensus_queue.cc:1059] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:57:43.882961  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:43.885459  1541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:51500
W20260709 12:57:43.885876  3756 log.cc:927] Time spent T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:57:43.886322  1541 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:43.886699  1541 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:43.838548  3393 consensus_queue.cc:1059] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:57:43.889150  3393 raft_consensus.cc:3055] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:43.889504  3393 raft_consensus.cc:740] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:43.890278  3393 consensus_queue.cc:260] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:43.891414  3393 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:43.848430  3721 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:43.892855  3724 log.cc:927] Time spent T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.619s	user 0.000s	sys 0.001s
I20260709 12:57:43.894511  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:43.853618  3732 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:43.902774  1541 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:43.911813  1614 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:43.912843  1685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:45440
I20260709 12:57:43.913410  1685 raft_consensus.cc:606] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:43.913769  1685 raft_consensus.cc:614] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:43.914855  1541 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:43.911993  2989 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:43.916600  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:43.917212  1685 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:43.918666  3575 raft_consensus.cc:3055] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:43.920908  1534 raft_consensus.cc:1240] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:57:43.919046  3575 raft_consensus.cc:740] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:43.922581  2298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32788 (request call id 62) took 1088 ms. Trace:
I20260709 12:57:43.924338  2989 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:43.925408  3721 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:43.912730  3206 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:43.905017  3732 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:43.934841  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:43.934747  3206 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:43.936343  1613 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 6: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:43.934778  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:43.937037  1691 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:43.939157  3206 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:43.939719  3537 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:43.941645  3648 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:43.942487  1684 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:57:43.943070  1686 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:45440
I20260709 12:57:43.943332  3732 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:43.944780  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:43.951992  3537 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:43.952879  1536 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:43.929147  2298 rpcz_store.cc:276] 0709 12:57:42.834132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:42.853922 (+ 19790us) service_pool.cc:224] Handling call
0709 12:57:42.854206 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:42.854408 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:57:43.081807 (+227399us) log.cc:844] Serialized 14 byte log entry
0709 12:57:43.689398 (+607591us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b1800302e00. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f61455 00007fc85d049060 00007fc85d05b716 00007fc85d06c287 00007fc85d06c208
0709 12:57:43.908974 (+219576us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:43.913103 (+  4129us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:43.915543 (+  2440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:43.919351 (+  3808us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:43.922492 (+  3141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4238,"raft.run_cpu_time_us":3210,"raft.run_wall_time_us":45513,"spinlock_wait_cycles":26200448,"thread_start_us":574530,"threads_started":2,"wal-append.queue_time_us":538676}
I20260709 12:57:43.961896  3575 consensus_queue.cc:260] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:43.963358  3575 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:43.949728  3648 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:43.968153  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:43.964423  1686 raft_consensus.cc:606] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:43.968950  1686 raft_consensus.cc:614] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:43.969416  1683 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:43.966394  1685 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:43.972586  1508 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:43.976125  2989 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:43.976722  2989 raft_consensus.cc:697] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:43.971791  3732 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:43.977756  2989 consensus_queue.cc:237] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:43.982000  1691 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:57:43.982589  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:43.983625  1508 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:43.984030  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:43.988166  3733 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:43.988412  3667 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:57:43.991920  3667 raft_consensus.cc:697] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:43.992946  3667 consensus_queue.cc:237] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:43.984246  3648 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:43.996806  1686 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "1d6516ff61104bdda54bde95e92fe579"
 from {username='slave'} at 127.0.0.1:45440
I20260709 12:57:43.997700  1686 raft_consensus.cc:606] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Received request to transfer leadership to TS 1d6516ff61104bdda54bde95e92fe579
I20260709 12:57:43.983950  3732 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:44.001796  3732 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:44.002756  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:43.998219  1686 raft_consensus.cc:614] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:44.020282  2989 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:44.022562  1683 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:44.023521  1686 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:45440
I20260709 12:57:44.023785  1508 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:44.024132  1686 raft_consensus.cc:606] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:44.024569  1686 raft_consensus.cc:614] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:44.027668  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:44.028898  3537 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:44.029418  3537 raft_consensus.cc:697] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:44.027690  1687 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 6. Current term is 7. Ops: [5.4-6.5]
I20260709 12:57:44.027917  1690 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:57:44.037351  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:44.020800  2989 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:44.049110  1689 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:44.037838   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:57:44.052624   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:57:44.055794  1686 raft_consensus.cc:1240] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:44.064819  2989 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:44.065992  3656 consensus_queue.cc:1059] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:44.066439  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:44.067409  1688 raft_consensus.cc:2393] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 4: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:44.068426  3581 consensus_queue.cc:1059] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:44.069916  1654 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:44.070149  3537 consensus_queue.cc:237] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:44.072659  3751 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:44.073238  3757 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:44.073999  3757 consensus_queue.cc:1243] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:57:44.073199  3751 raft_consensus.cc:697] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 5 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:44.076900  3751 consensus_queue.cc:237] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:44.081336  1688 raft_consensus.cc:1275] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:57:44.066601  3307 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:44.089201  3581 raft_consensus.cc:3055] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:44.089674  3581 raft_consensus.cc:740] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:44.092504  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:44.092907  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:44.099292  3581 consensus_queue.cc:260] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:44.061425  2267 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:44.122516  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:44.124833  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 44224.5us
I20260709 12:57:44.126811  1687 raft_consensus.cc:1275] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:57:44.147806  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:44.127279  1682 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:44.128321  1690 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:57:44.130339  1683 pending_rounds.cc:85] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 2
I20260709 12:57:44.150336  1683 pending_rounds.cc:107] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:57:44.150700  1683 raft_consensus.cc:2889] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:44.130893  3331 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:44.135562  1583 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:44.122184  1688 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:44.127153  3204 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:44.158172  3566 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:44.156273  3648 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:44.157958  3581 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:44.172071  3566 raft_consensus.cc:697] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:57:44.161589  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 111559us
I20260709 12:57:44.157014  3331 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:44.160622  3206 consensus_queue.cc:1059] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:57:44.159493  3204 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:44.192082  3204 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:44.164518  3397 consensus_queue.cc:1048] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.019s
W20260709 12:57:44.199417  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:44.200642  1583 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:44.198524  3728 raft_consensus.cc:3055] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:44.207266  1583 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:44.197750  3735 consensus_queue.cc:1048] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:57:44.209774  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:44.212324  1687 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:57:44.213104  1688 raft_consensus.cc:2368] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8.
I20260709 12:57:44.209506  3757 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:44.214171  3590 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:44.214597  3590 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:44.205885  3206 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:57:44.215011  3590 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:44.221781  1583 leader_election.cc:400] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8.
I20260709 12:57:44.222224  1583 leader_election.cc:403] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:57:44.196261  3566 consensus_queue.cc:237] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:44.213785  3735 consensus_queue.cc:1243] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:57:44.206713  3728 raft_consensus.cc:740] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:57:44.265146  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 59102.6us
I20260709 12:57:44.291589  3331 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:44.296068  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 833) took 1449 ms. Trace:
I20260709 12:57:44.296551  1540 rpcz_store.cc:276] 0709 12:57:42.846838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:42.846957 (+   119us) service_pool.cc:224] Handling call
0709 12:57:42.847315 (+   358us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:57:43.676027 (+828712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:44.295792 (+619765us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b54003151d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:44.296006 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1904596864}
I20260709 12:57:44.298432  3590 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:44.285866  3648 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:44.312542  2989 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:44.314484  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:44.315893  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:44.316540  1539 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:44.316681  1534 raft_consensus.cc:2393] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 5: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:44.319113  1538 raft_consensus.cc:2393] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 7: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:44.320037  1541 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:57:44.322755  2989 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:44.324421  1541 raft_consensus.cc:1240] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:44.330513  3669 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:44.331292  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:44.337433  2989 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:44.341899  1538 raft_consensus.cc:1275] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:57:44.342952  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:44.343575  1686 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:44.344686  1508 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:44.331164  3669 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:44.330809  3306 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:44.351186  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:44.310549  3648 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:57:44.349926  3787 log.cc:927] Time spent T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:57:44.305938  3728 consensus_queue.cc:260] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:44.361093  1691 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:57:44.363059  1686 raft_consensus.cc:1275] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 12:57:44.363504  1686 pending_rounds.cc:85] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 2
I20260709 12:57:44.363754  1686 pending_rounds.cc:107] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 12:57:44.364013  1686 raft_consensus.cc:2889] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:44.354707  3748 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:44.357872  3590 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:44.352244  3306 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:44.397516  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:44.393296  3413 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:44.401243  3667 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
W20260709 12:57:44.406420  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 69647.6us
I20260709 12:57:44.417686  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:44.386354  3748 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:44.419827  3748 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:44.426090  3800 log.cc:927] Time spent T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 12:57:44.428040  3794 log.cc:927] Time spent T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:57:44.427754  3398 consensus_queue.cc:260] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:44.428515  3648 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:44.433861  3306 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:44.434547  3413 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:44.436812  3413 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:44.437165  3790 log.cc:927] Time spent T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:57:44.399402  3599 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:57:44.439009  3742 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:44.439612  3742 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:44.443943  3398 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:44.450637  3742 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:44.455020  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:44.455705  1684 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:44.401402  3728 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:44.477351  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:44.480548  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:44.481784  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:44.452883  1508 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:44.490216  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:44.495899  1542 raft_consensus.cc:2393] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 5: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:44.500375  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:44.501710  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 191355us
I20260709 12:57:44.504427  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:44.505334  1538 raft_consensus.cc:2393] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 5: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:44.494457  1536 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:57:44.416278  3669 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:44.507472  1689 raft_consensus.cc:1275] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:57:44.450717  3798 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:44.511938  1508 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:44.511479  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:44.514217  1542 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:44.515115  3798 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:44.503822  3587 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:44.517922  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:44.517374  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 116840us
I20260709 12:57:44.527572  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:44.530925  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:44.534950  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:44.536748  2989 consensus_queue.cc:1048] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:44.541659  1542 raft_consensus.cc:2410] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:57:44.526590  3742 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:44.527068  3587 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:44.555902  3742 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:44.569010  3742 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:44.546963  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:44.575237  3587 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:44.540779  3732 consensus_queue.cc:1059] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:57:44.893929  3648 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:44.897989  3648 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:44.831218  3791 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:57:44.833624  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 292937us
W20260709 12:57:45.049221  3812 log.cc:927] Time spent T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 12:57:45.028245  3791 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:45.056371  3398 consensus_meta.cc:287] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.612s	user 0.013s	sys 0.001s
W20260709 12:57:45.058185  3728 consensus_meta.cc:287] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.565s	user 0.010s	sys 0.001s
I20260709 12:57:45.242620  3798 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:45.350358  3648 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:45.592885  3549 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:57:45.609237  3742 consensus_meta.cc:287] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 1.040s	user 0.013s	sys 0.000s
W20260709 12:57:45.635896  3748 consensus_meta.cc:287] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 1.215s	user 0.015s	sys 0.000s
I20260709 12:57:45.620200  3742 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:45.686573  3748 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:45.707674  3742 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:45.705857  3748 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:45.717792  3587 consensus_meta.cc:287] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 1.057s	user 0.007s	sys 0.003s
I20260709 12:57:45.718161  3587 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:45.719708  3587 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:45.720742  3816 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:45.721387  3816 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:45.725276  3816 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:45.731979  3704 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:45.810578  3757 raft_consensus.cc:697] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:45.811755  3757 consensus_queue.cc:237] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:45.822317  3751 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.523s	user 0.000s	sys 0.023s
W20260709 12:57:45.822719  3751 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.524s	user 0.000s	sys 0.024s
I20260709 12:57:45.866923  3816 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:45.867496  3816 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:45.870134  3816 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:45.895133  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 1.34459e+06us
W20260709 12:57:45.895720  1655 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.374s	user 0.003s	sys 0.015s
W20260709 12:57:45.895977  1655 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.375s	user 0.003s	sys 0.015s
W20260709 12:57:45.896147  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 1.39288e+06us
I20260709 12:57:45.899219  1655 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:45.900642  1655 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:45.902293  1655 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:45.903729  1655 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:45.904676  3815 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:45.904837  1655 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:45.905193  3815 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:45.906889  3815 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:45.907239  3815 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:45.907545  3815 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:45.909041  3815 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:45.909682  3815 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:45.910105  3815 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:45.912287  3815 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:45.912804  3815 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:45.913264  3815 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:45.915496  3815 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:45.915568  3670 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:45.915933  3815 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:45.916085  3670 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:45.916321  3815 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:45.917331  3816 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:45.918093  3815 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:45.917870  3816 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:45.918157  3670 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:45.918604  3815 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:45.919050  3670 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:45.919447  3815 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:45.919536  3670 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:45.920192  3816 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:45.921505  3815 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:45.921922  3670 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:45.922055  3815 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:45.922412  3670 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:45.922804  3815 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:45.923236  3815 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:45.923509  3670 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:45.923600  3815 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:45.923960  3670 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:45.924369  3670 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:45.926155  3652 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:45.932008  3670 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:45.932345  3815 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:45.934492  3815 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:45.934536  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1414) took 1598 ms. Trace:
I20260709 12:57:45.934537  3670 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:45.936203  1541 rpcz_store.cc:276] 0709 12:57:44.336220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:44.338134 (+  1914us) service_pool.cc:224] Handling call
0709 12:57:44.338531 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:44.413250 (+ 74719us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:44.413278 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:44.413319 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:44.413345 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:45.934304 (+1520959us) spinlock_profiling.cc:243] Waited 67.7 ms on lock 0x7b54000735d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:45.934354 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:45.934470 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155795328}
I20260709 12:57:45.942869  3816 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:45.943723  3816 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:45.946462  3816 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:45.948644  3810 log.cc:927] Time spent T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 1.290s	user 0.003s	sys 0.009s
W20260709 12:57:45.958129  1686 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.411s	user 0.033s	sys 0.093s
W20260709 12:57:45.958518  1686 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.412s	user 0.034s	sys 0.093s
I20260709 12:57:45.959219  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1179) took 1415 ms. Trace:
I20260709 12:57:45.959560  1686 rpcz_store.cc:276] 0709 12:57:44.544018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:44.545266 (+  1248us) service_pool.cc:224] Handling call
0709 12:57:44.545554 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:44.545909 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:44.545939 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:44.546367 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 12:57:45.958856 (+1412489us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:45.958898 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:45.958967 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:45.959009 (+    42us) raft_consensus.cc:1685] finished
0709 12:57:45.959020 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:45.959161 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1308125,"raft.queue_time_us":487,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":1308270,"thread_start_us":1412113,"threads_started":1,"wal-append.queue_time_us":1145366}
I20260709 12:57:45.998844  3786 raft_consensus.cc:3055] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:57:46.004925  3786 raft_consensus.cc:740] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:46.009644  3393 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:46.009995  3789 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.010238  3215 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:46.010763  3215 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.012902  3215 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:46.013067  3652 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:46.013082  3393 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.013507  3215 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:46.013337  3789 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.014070  3215 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.015231  3393 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:46.015726  3789 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:46.016607  3789 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:46.015909  3652 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.013101  3786 consensus_queue.cc:260] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.017050  3393 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:46.018208  3786 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:46.021626  3393 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:57:46.022601  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 1.48495e+06us
I20260709 12:57:46.019495  3652 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:46.025215  3652 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:57:46.025754  3652 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:46.020416  3815 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.017122  3789 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.026522  3460 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.027033  3460 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.027926  3789 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:46.028584  3815 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.027846  3652 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:46.030596  3815 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:46.020100  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:46.030779  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:46.031430  1542 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 6.
I20260709 12:57:46.029052  3393 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:46.036242  3393 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.036594  3652 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:46.036958  3393 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.037185  3652 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.039337  3652 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:46.036145  3789 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.039271  3393 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:46.040427  3587 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:46.047190  3587 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.042397  3789 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.049751  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:46.063730  1537 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 7.
I20260709 12:57:46.066251  3789 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:46.051942  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:46.043195  3393 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:46.067005  3393 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.067560  3789 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:46.069166  3393 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:46.069168  3587 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:46.069713  3393 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:46.070729  3393 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.071503  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:46.072109  1540 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 8.
I20260709 12:57:46.072713  3393 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:46.073230  3393 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:46.073714  3393 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.069695  3460 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:46.075337  3215 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:46.075721  3393 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:46.075886  3215 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:46.076422  3789 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:46.076218  3393 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:46.084909  3393 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.086069  3789 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:46.090027  3215 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.092545  3215 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:46.068259  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1406) took 1753 ms. Trace:
I20260709 12:57:46.094244  1533 rpcz_store.cc:276] 0709 12:57:44.315269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:44.315402 (+   133us) service_pool.cc:224] Handling call
0709 12:57:44.329958 (+ 14556us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:44.330294 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:44.330321 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:44.442536 (+112215us) spinlock_profiling.cc:243] Waited 5.36 ms on lock 0x7b2c00000658. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85b94aa11 00007fc85b95a372 00007fc85d08ca01 00007fc85d05143a 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2
0709 12:57:44.442935 (+   399us) log.cc:844] Serialized 26 byte log entry
0709 12:57:44.518073 (+ 75138us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:44.518107 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:44.518276 (+   169us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:45.948142 (+1429866us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:57:46.068035 (+119893us) raft_consensus.cc:1685] finished
0709 12:57:46.068057 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:46.068203 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":370,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":18448896,"thread_start_us":74822,"threads_started":1,"wal-append.queue_time_us":103515}
I20260709 12:57:46.101397  2301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32802 (request call id 80) took 1812 ms. Trace:
I20260709 12:57:46.101866  2301 rpcz_store.cc:276] 0709 12:57:44.288719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:44.288866 (+   147us) service_pool.cc:224] Handling call
0709 12:57:44.289149 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:44.375985 (+ 86836us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:44.376021 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:44.376065 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:44.376097 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:46.100358 (+1724261us) spinlock_profiling.cc:243] Waited 86.6 ms on lock 0x7b54005d02d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:46.100417 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:46.101325 (+   908us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":199193856}
I20260709 12:57:46.045135  3652 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:46.060935  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:46.045449  3786 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:46.051193  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:46.062913  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:46.108461  2298 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:46.108331  3786 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:46.087095  3393 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:46.045308  3815 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 12:57:46.110143  1655 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.870s (SENT) [suppressed 2 similar messages]
I20260709 12:57:46.012844  3670 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:46.111198  3670 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.113602  3670 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:46.107836  1542 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 6.
I20260709 12:57:46.109711  3815 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.106730  3652 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:46.135281  2269 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.000s	sys 0.022s
W20260709 12:57:46.135751  2269 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.000s	sys 0.022s
W20260709 12:57:46.136046  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 635787us
W20260709 12:57:46.142208  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:46.152284  3811 log.cc:927] Time spent T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.775s	user 0.000s	sys 0.005s
I20260709 12:57:46.153507  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1170) took 1699 ms. Trace:
I20260709 12:57:46.153869  1683 rpcz_store.cc:276] 0709 12:57:44.454017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:44.454851 (+   834us) service_pool.cc:224] Handling call
0709 12:57:44.491284 (+ 36433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:44.491672 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:44.491704 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:44.503220 (+ 11516us) log.cc:844] Serialized 26 byte log entry
0709 12:57:44.845980 (+342760us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:57:44.846030 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:44.846113 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:46.151756 (+1305643us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:57:46.153221 (+  1465us) raft_consensus.cc:1685] finished
0709 12:57:46.153242 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:46.153450 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1319247,"raft.queue_time_us":37471,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":1321667,"spinlock_wait_cycles":399953280,"thread_start_us":342404,"threads_started":1,"wal-append.queue_time_us":528522}
I20260709 12:57:46.155467  3215 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:46.155665  1684 raft_consensus.cc:1275] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:46.156620  3393 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.157213  1686 raft_consensus.cc:1275] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:57:46.157135  3393 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.158288  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:46.158847  1689 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:46.159220  3393 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:46.159713  3393 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:46.160413  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:46.156051  3215 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.161008  1684 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:46.162454  3215 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:46.167867  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:46.168829  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:46.169286  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:46.169476  1685 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 7.
I20260709 12:57:46.169818  1686 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:46.158987  3792 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:57:46.170536  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:46.171159  1687 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 6.
I20260709 12:57:46.170920  3792 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:46.172124  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:46.174261  3792 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:46.160151  3393 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:46.177211  1688 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 1.
I20260709 12:57:46.180076  3393 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:57:46.180315  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:46.182439  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:46.183187  2300 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 1.
I20260709 12:57:46.183625  1686 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:46.184684  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:46.186586  1656 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 12:57:46.187811  3393 raft_consensus.cc:2804] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:46.188336  3393 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:46.188814  3393 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:46.194162  3652 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:46.195983  1684 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:46.187052  1689 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
W20260709 12:57:46.198637  1642 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:34735 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:34735 timed out after 15.000s (SENT)
W20260709 12:57:46.208622  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 98512.8us
W20260709 12:57:46.212600  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 1.9073e+06us
I20260709 12:57:46.215497  3745 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.219834  3745 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.222168  3745 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:46.232286  3791 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:46.237509  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:46.238353  2298 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:57:46.242645  1438 catalog_manager.cc:5697] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 3 to 4, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:46.245918  1438 catalog_manager.cc:5697] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 3 to 5, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 5 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:46.264518  3808 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.265182  3537 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.265044  3808 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.265794  3537 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.267211  3808 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:46.267781  3808 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.268074  3537 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:46.268628  3413 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:46.269145  3413 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.271224  3413 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:46.276747  3739 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:46.277345  3739 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.279371  3739 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:46.279886  3739 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:46.280766  2989 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.281215  2989 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.283115  2989 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:46.265064  1507 connection.cc:256] RPC call timeout handler was delayed by -1.0906829009999797s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:57:46.285341  1507 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:46.286875  3291 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.287110  3742 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:46.287385  3291 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.287634  3742 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.289434  3291 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:46.289773  3587 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:46.290022  3291 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:46.195837  3815 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:46.289474  3742 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:46.280310  3739 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:46.320355  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 2.10636e+06us
I20260709 12:57:46.323868  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:46.324790  1686 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:46.325654  1689 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:46.326172  1683 pending_rounds.cc:85] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 2
I20260709 12:57:46.326537  1683 pending_rounds.cc:107] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:57:46.326779  1683 raft_consensus.cc:2889] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:46.327349  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:57:46.329488  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 115944us
I20260709 12:57:46.333554  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:46.334272  1682 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:46.299430  3786 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:57:46.313071  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 234613us
I20260709 12:57:46.313207  3791 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.366439  2989 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:46.367141  2989 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:46.368613  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 131929us
I20260709 12:57:46.268191  3808 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:46.371631  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 54666.8us
I20260709 12:57:46.330794  3331 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:57:46.330922  3566 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:46.329242  3397 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.300109  3587 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.382257  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 856) took 1900 ms. Trace:
I20260709 12:57:46.383543  3031 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:46.384058  3683 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:57:46.365276  3413 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.365480  3204 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.368680  3291 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.354027  3654 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:46.316208  2269 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 12:57:46.368652  3419 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:46.368621  3623 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:46.371177  3757 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.393237  1535 rpcz_store.cc:276] 0709 12:57:44.481695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:44.481809 (+   114us) service_pool.cc:224] Handling call
0709 12:57:44.482125 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:44.482525 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:44.482553 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:46.222183 (+1739630us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b18003fa0c0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f322a6 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85b94aa11 00007fc85b95a372 00007fc85d08ca01 00007fc85d05143a
0709 12:57:46.223418 (+  1235us) spinlock_profiling.cc:243] Waited 8.09 ms on lock 0x7b2c00000658. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85b94aa11 00007fc85b95a372 00007fc85d08ca01 00007fc85d05143a 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2
0709 12:57:46.223921 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 12:57:46.366242 (+142321us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:57:46.366291 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:46.368366 (+  2075us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:46.381997 (+ 13631us) raft_consensus.cc:1685] finished
0709 12:57:46.382017 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:46.382193 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5737,"raft.queue_time_us":7642,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":10628,"spinlock_wait_cycles":25770112,"thread_start_us":141933,"threads_started":1,"wal-append.queue_time_us":155138}
W20260709 12:57:46.414920  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 115086us
I20260709 12:57:46.416455  3648 raft_consensus.cc:2804] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:46.417958  3648 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:46.403899  3550 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:46.393395  3031 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.372798  3791 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.385455  3733 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:46.394819  3577 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:46.407357  3413 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.391958  3397 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.420426  3748 consensus_queue.cc:1048] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:57:46.416776  3419 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.432881  3397 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:46.408068  3204 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.434504  3419 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:46.435755  3204 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:46.391511  3590 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:46.437820  1691 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:46.439317  3739 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:46.439759  3808 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:46.409412  3291 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.409147  3581 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:46.440850  3581 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.442958  3581 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:46.436228  2267 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:46.387143  3566 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:46.422747  3669 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:46.445814  3669 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.446727  3566 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:46.447822  3669 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:46.458088  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:46.458706  3490 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.459239  3490 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.461005  3331 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8.
I20260709 12:57:46.447674  3590 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.463716  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:46.463953  3590 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:46.426438  3031 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:46.421584  3550 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.464381  1617 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:46.465524  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:46.466221  3550 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:46.411514  3654 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.468304  3654 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:46.427366  3587 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:46.469056  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 94932.5us
I20260709 12:57:46.470376  1508 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:46.471288  1508 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:46.472085  1508 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:46.474149  3748 consensus_queue.cc:1048] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:46.475625  3748 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:46.475950  3809 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:46.476539  3809 raft_consensus.cc:697] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:46.476833  3669 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:46.477341  3669 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.477468  3809 consensus_queue.cc:237] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.479372  3669 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:46.479828  3669 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:46.480314  3669 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.481128  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:46.481752  1533 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:46.482335  3669 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:46.483089  3815 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:46.483640  3815 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.431613  2989 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:46.425303  3393 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:46.431113  3413 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:46.416698  3623 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.428457  3791 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:46.425595  3831 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:46.486951  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:46.486910  3831 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.487396  3393 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:46.450227  3291 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:46.429247  3830 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:46.488112  3623 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:46.488353  3830 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.488890  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:46.489169  3831 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:46.430383  3733 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.490674  3830 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:46.450814  3823 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:46.477499  3739 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:46.491384  3823 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:57:46.440390  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:46.492170  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:57:46.444943  2267 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:46.454715  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 86938.2us
I20260709 12:57:46.445225  3757 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.492664  3739 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:46.493120  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 48266.9us
I20260709 12:57:46.493845  2267 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:46.430430  3648 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:46.494640  3774 raft_consensus.cc:2804] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:57:46.495148  3774 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:46.495529  3774 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:46.497040  3683 consensus_queue.cc:1059] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:46.498392  3658 raft_consensus.cc:3055] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:46.498767  3658 raft_consensus.cc:740] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:46.499529  3658 consensus_queue.cc:260] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.449265  3751 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:46.428941  3577 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.484601  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:46.501042  1542 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 3.
I20260709 12:57:46.504418  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:46.505700  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:46.506875  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:46.508226  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:46.476130  3748 raft_consensus.cc:697] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:46.509473  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:46.537768  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:46.535450  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:46.559532  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:46.527922  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:46.617795  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 145774us
I20260709 12:57:46.494568  3739 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:46.679982  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 156876us
I20260709 12:57:46.677724  1583 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:46.651140  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:46.683689  3748 consensus_queue.cc:237] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:46.680634  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:46.683794  1533 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:57:46.735535  3398 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:46.692044  3658 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:46.683275  3815 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:46.735409  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 57796.8us
I20260709 12:57:46.684804  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:46.685676  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:46.708473  1691 raft_consensus.cc:1240] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:46.680261  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:46.681177  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:46.688036  1536 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:57:46.688128  1610 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:46.683539  3577 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:47.087868  3398 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:46.656970  3838 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:57:46.898371  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:47.089159  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:46.911791  3648 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:47.091921  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.092712  1610 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:47.093537  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:46.696883  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:46.873747  2324 debug-util.cc:398] Leaking SignalData structure 0x7b08002fb060 after lost signal to thread 434
I20260709 12:57:47.049358  1438 catalog_manager.cc:5697] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 3 to 4, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:46.494886  3816 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:47.094736  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:46.689121  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:47.097587  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.098261  1536 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:47.098783  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:46.684860  1614 raft_consensus.cc:2410] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:57:47.087563  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 353191us
I20260709 12:57:47.100037  1581 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:46.696976  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.100433  1689 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:47.100907  1690 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:47.095727  3816 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:47.099174  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:46.707284  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:46.686384  1609 raft_consensus.cc:2410] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:57:47.102579  3566 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:46.689695  3490 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:47.103739  3577 consensus_queue.cc:1048] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:46.681667  1616 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:47.110438  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.110980  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.104018  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:46.688598  1541 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:57:47.112172  1533 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:46.696388  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.100121  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:46.729318  3774 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:47.113224  1614 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:57:47.113639  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.114274  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.114756  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.105727  1539 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:47.105891  1537 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:47.108775  1536 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:47.107564  1542 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:46.695640  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.115792  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:46.685947  1617 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:57:46.490988  3733 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:47.093894  3648 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 2 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:47.114895  1614 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:57:46.658537  3550 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:47.089514  3393 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:47.137558  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.116801  1612 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
W20260709 12:57:46.952659  3738 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.010s	sys 0.016s
I20260709 12:57:47.093684  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:47.096187  2324 debug-util.cc:398] Leaking SignalData structure 0x7b08002fb740 after lost signal to thread 1474
I20260709 12:57:47.111668  1609 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:57:47.108588  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:47.100046  1582 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:49296 dropped due to backpressure: service queue is full with 50 items [suppressed 5 similar messages]
I20260709 12:57:46.619375   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:46.494510  3757 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:47.109259  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.102643  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:46.887559  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.118671  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.150570  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.096319  1438 catalog_manager.cc:5697] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 1 to 4, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:47.151451  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.117779  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.152110  1614 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:57:47.152621  1617 raft_consensus.cc:2410] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:57:47.025882  3809 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.005s	sys 0.008s
I20260709 12:57:47.114981  3774 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:47.059866  1436 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54590 (request call id 140) took 17553 ms (client timeout 15000 ms). Trace:
I20260709 12:57:47.125686  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.126855  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.159462  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.159852  1689 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:47.160063  1533 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:47.141402  1582 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:49296 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1164)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1176)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 929)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1169)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 915)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 924)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 912)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1158)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 908)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1175)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1177)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 907)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1168)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1167)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1160)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1157)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1155)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1174)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1180)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1162)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 928)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 925)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 930)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1163)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1166)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 923)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 910)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 911)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 913)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1152)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1154)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1156)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1159)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1165)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1170)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1171)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1172)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1173)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1178)
I20260709 12:57:47.159499  1682 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:57:47.161213  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.161605  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.161824  1535 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:57:47.162700  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:47.122255  3398 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:47.101750  3816 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:47.138468  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.095728  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.115497  1686 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:47.178831  1534 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:47.179595  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.179822  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.180198  1686 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:47.139026  1583 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:47.090308  1538 raft_consensus.cc:2410] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:57:46.628953  3728 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.535s
I20260709 12:57:47.122642  3550 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:47.111620  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:46.491825  3823 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:46.510076  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:47.141377  1611 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:47.149458  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.154484  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:46.658818  3581 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:57:47.121429  3751 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:47.155102  3809 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.006s	sys 0.009s
I20260709 12:57:47.158843  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.164420  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.211952  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.162698  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.156621  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.156711  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:47.213989  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.214540  1540 raft_consensus.cc:2393] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 7: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:47.215101  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.163511  1682 raft_consensus.cc:2393] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 2: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:47.134479  1542 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
W20260709 12:57:47.167657  2266 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.009s	sys 0.037s
I20260709 12:57:47.216073  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:47.216459  2266 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.010s	sys 0.037s
I20260709 12:57:47.216970  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:46.544488  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 50717.4us
I20260709 12:57:47.176244  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:47.142256  3838 raft_consensus.cc:697] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:47.180900  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:46.659478  3204 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.491s
I20260709 12:57:47.180998  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.178730  1690 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:47.185096  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.186266  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.149806  3490 consensus_queue.cc:1059] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:57:47.234108  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.186491  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.171031  2298 raft_consensus.cc:2393] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 2: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:57:47.199117  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.208112  1616 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:47.187528  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.136574  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.246133  1687 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:47.212845  1535 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 2.
I20260709 12:57:47.207383  3419 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:47.219587  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.220240  1541 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:57:47.248695  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.221074  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.251431  1536 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:47.222352  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.222357  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.149520  3393 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:47.252434  1685 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:47.253777  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.223623  1537 raft_consensus.cc:2393] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 8: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:47.220326  1615 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 6: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:47.224156  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.231135  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:47.231745  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 89617.6us
W20260709 12:57:47.158234  1436 rpcz_store.cc:269] 0709 12:57:29.506856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:29.518046 (+ 11190us) service_pool.cc:224] Handling call
0709 12:57:47.059756 (+17541710us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:43.876777 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:43.877370 (+   593us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:43.877406 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:57:43.877422 (+    16us) tablet.cc:662] Decoding operations
0709 12:57:43.878218 (+   796us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:43.878298 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:43.878321 (+    23us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:57:43.878795 (+   474us) tablet.cc:701] Row locks acquired
0709 12:57:43.878814 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:57:43.878949 (+   135us) write_op.cc:270] Start()
0709 12:57:43.879075 (+   126us) write_op.cc:276] Timestamp: P: 1783601863878903 usec, L: 0
0709 12:57:43.879099 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:57:43.914679 (+ 35580us) log.cc:844] Serialized 2481 byte log entry
0709 12:57:44.136731 (+222052us) op_driver.cc:464] REPLICATION: finished
0709 12:57:44.180793 (+ 44062us) write_op.cc:301] APPLY: starting
0709 12:57:44.180877 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 12:57:44.181037 (+   160us) tablet.cc:1370] finished BulkCheckPresence
0709 12:57:44.184834 (+  3797us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:57:44.188768 (+  3934us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:57:44.188965 (+   197us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:57:44.189009 (+    44us) write_op.cc:312] APPLY: finished
0709 12:57:44.189260 (+   251us) log.cc:844] Serialized 52 byte log entry
0709 12:57:44.189438 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:44.189543 (+   105us) write_op.cc:454] Released schema lock
0709 12:57:44.189588 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:57:44.189944 (+   356us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:44.189977 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":922,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":43797,"apply.run_cpu_time_us":3047,"apply.run_wall_time_us":9156,"num_ops":6,"prepare.queue_time_us":180833,"prepare.run_cpu_time_us":9568,"prepare.run_wall_time_us":94972,"raft.queue_time_us":104907,"raft.run_cpu_time_us":8124,"raft.run_wall_time_us":39770,"replication_time_us":257492,"thread_start_us":242968,"threads_started":4,"wal-append.queue_time_us":56799,"wal-append.run_cpu_time_us":9259,"wal-append.run_wall_time_us":1249977}]]}
I20260709 12:57:47.247848  1688 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:47.218832  1689 raft_consensus.cc:2393] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 8: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:47.247536  1613 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:47.245538  1533 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:47.247516  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.246364  1686 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:57:47.249231  1614 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:57:47.328116  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.329386  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.329939  1614 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:47.254925  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:47.254901  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.250674  1542 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:47.222502  3739 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:47.247022  1612 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:57:47.356076  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.356495  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:57:47.250743  2324 debug-util.cc:398] Leaking SignalData structure 0x7b080038e760 after lost signal to thread 1566
I20260709 12:57:47.318693  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.317826  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.323549  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.250414  3419 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:47.317239  1508 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:47.363262  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:47.363608  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 46480.4us
I20260709 12:57:47.363718  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.321424  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.322887  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.273617  3490 raft_consensus.cc:3055] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:57:47.253283  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:47.331058  1682 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:57:47.358943  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.355691  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.364284  1508 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:47.369026  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.223413  3581 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:47.370517  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.371708  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.372494  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.373287  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:47.373202  1534 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:57:47.374203  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.375619  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.375571  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.377943  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:47.378744  1615 raft_consensus.cc:2410] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:57:47.379456  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.376941  1614 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:47.381376  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.356120  1686 raft_consensus.cc:1275] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:57:47.367774  3419 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:47.383677  3830 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:57:47.362990  2324 debug-util.cc:398] Leaking SignalData structure 0x7b0800324240 after lost signal to thread 1567
I20260709 12:57:47.385851  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.374594  2300 raft_consensus.cc:1240] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9. Ops: []
I20260709 12:57:47.394237  1508 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:47.327117  3742 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.919s	user 0.034s	sys 0.055s
I20260709 12:57:47.426167  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.426918  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.426247  1614 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:57:47.378163  3809 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:47.427954  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.428107  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.428903  1610 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
W20260709 12:57:47.317515  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 49077.5us
I20260709 12:57:47.371428  3490 raft_consensus.cc:740] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:47.443446  1609 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:47.446305  1609 raft_consensus.cc:1275] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:57:47.448726  1609 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:57:47.449153  1609 pending_rounds.cc:85] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f: Aborting all ops after (but not including) 3
I20260709 12:57:47.449442  1609 pending_rounds.cc:107] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:57:47.449713  1609 raft_consensus.cc:2889] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:47.442974  1508 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:47.451123  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.362639  3739 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:47.458914  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 290189us
W20260709 12:57:47.438731  3742 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.035s	user 0.034s	sys 0.056s
I20260709 12:57:47.472213  1612 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:57:47.443567  3809 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:47.393546  3587 consensus_queue.cc:1059] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:57:47.482995  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:47.464063  1617 raft_consensus.cc:1275] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:57:47.452775  3738 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:57:47.498512  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.500085  1533 raft_consensus.cc:2393] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 7: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:47.500123  1538 raft_consensus.cc:2410] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:57:47.486274  1617 pending_rounds.cc:85] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f: Aborting all ops after (but not including) 3
I20260709 12:57:47.501693  1617 pending_rounds.cc:107] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:57:47.501987  1617 raft_consensus.cc:2889] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:47.498390  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.503780  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:47.504534  1533 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:47.504727  1536 raft_consensus.cc:2410] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:57:47.505517  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 323336us
W20260709 12:57:47.507014  2324 debug-util.cc:398] Leaking SignalData structure 0x7b080036f640 after lost signal to thread 1641
I20260709 12:57:47.482218  3809 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:47.512347  1583 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:47.517050  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.561764  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:47.563144  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 50899.1us
I20260709 12:57:47.557224  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.565961  1536 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:57:47.499275  3738 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:47.431491  3838 consensus_queue.cc:237] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:47.585312  1533 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 9.
I20260709 12:57:47.590966  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.594955  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:47.608916  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 150991us
W20260709 12:57:47.610081  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 183656us
I20260709 12:57:47.569861  3550 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:47.572041  3738 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:57:47.643239  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 183617us
I20260709 12:57:47.612128  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.645843  1536 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:57:47.646874  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.647555  1536 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:57:47.592675  3751 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:47.612679  3848 log.cc:927] Time spent T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.360s	user 0.001s	sys 0.000s
W20260709 12:57:47.609164  3841 log.cc:927] Time spent T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.362s	user 0.001s	sys 0.000s
W20260709 12:57:47.682071  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 118247us
W20260709 12:57:47.608143  3847 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.292s	user 0.000s	sys 0.002s
W20260709 12:57:47.650063  2324 debug-util.cc:398] Leaking SignalData structure 0x7b08003a5300 after lost signal to thread 1715
I20260709 12:57:47.557077  3490 consensus_queue.cc:260] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:47.693266  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.694550  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.692395  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.697525  1687 raft_consensus.cc:1240] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:47.642112  3393 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:47.695458  1682 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
W20260709 12:57:47.696085  3835 log.cc:927] Time spent T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.336s	user 0.001s	sys 0.000s
I20260709 12:57:47.728015  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.703097  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.740142  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.740536  1687 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:57:47.741394  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.741613  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.742169  1615 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:57:47.734524  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:57:47.656457  3842 log.cc:927] Time spent T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.330s	user 0.000s	sys 0.001s
I20260709 12:57:47.735952  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:47.700044  3846 log.cc:927] Time spent T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.332s	user 0.000s	sys 0.001s
I20260709 12:57:47.742867  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:47.691534  2324 debug-util.cc:398] Leaking SignalData structure 0x7b08003a5360 after lost signal to thread 1716
I20260709 12:57:47.601140  2267 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:47.759595  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.688282  3204 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:47.753262  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.750080  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.750190  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.749864  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.746954  3870 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 12:57:47.762517  3836 log.cc:927] Time spent T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
I20260709 12:57:47.762739  1609 raft_consensus.cc:1275] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:57:47.763749  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.764436  1612 raft_consensus.cc:1275] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:57:47.766721  3398 consensus_meta.cc:287] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.578s	user 0.007s	sys 0.000s
I20260709 12:57:47.766921  3419 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:47.777117  3566 consensus_queue.cc:1059] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:57:47.781071  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1397) took 1457 ms. Trace:
I20260709 12:57:47.781273  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.800999  1683 rpcz_store.cc:276] 0709 12:57:46.323712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:46.324579 (+   867us) service_pool.cc:224] Handling call
0709 12:57:46.325937 (+  1358us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:57:46.361881 (+ 35944us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:46.361917 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:57:46.362511 (+   594us) log.cc:844] Serialized 52 byte log entry
0709 12:57:46.768081 (+405570us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:47.087860 (+319779us) log.cc:844] Serialized 14 byte log entry
0709 12:57:47.088299 (+   439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:47.088372 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:47.780862 (+692490us) raft_consensus.cc:1685] finished
0709 12:57:47.780882 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:47.781016 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7199,"prepare.queue_time_us":319215,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":46,"raft.queue_time_us":7416,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":6097,"thread_start_us":373265,"threads_started":1,"wal-append.queue_time_us":785034}
I20260709 12:57:47.801256  1682 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:47.805742  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:47.791512  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:47.807149  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 422237us
W20260709 12:57:47.805423  3823 consensus_meta.cc:287] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.575s	user 0.008s	sys 0.002s
I20260709 12:57:47.818639  1608 raft_consensus.cc:2368] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 4. Current term is 5.
I20260709 12:57:47.800987  3849 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:57:47.813009  3850 log.cc:927] Time spent T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 12:57:47.800288  3739 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:47.812803  3460 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:47.831132  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:47.826326  2324 debug-util.cc:398] Leaking SignalData structure 0x7b08003bb240 after lost signal to thread 2327
W20260709 12:57:47.835530  1505 connection.cc:256] RPC call timeout handler was delayed by -1.4416848429999618s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.197s for a response
W20260709 12:57:47.815856  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 246730us
W20260709 12:57:47.839047  2324 debug-util.cc:398] Leaking SignalData structure 0x7b0800336960 after lost signal to thread 2328
I20260709 12:57:47.827699  3823 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:47.800657  3870 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:47.858913  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1395) took 1535 ms. Trace:
I20260709 12:57:47.835245  1687 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
W20260709 12:57:47.859359  3851 log.cc:927] Time spent T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 12:57:47.832203  3852 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:47.862159  1684 rpcz_store.cc:276] 0709 12:57:46.323160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:46.326486 (+  3326us) service_pool.cc:224] Handling call
0709 12:57:46.326800 (+   314us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:57:46.357503 (+ 30703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:46.357546 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:57:46.373157 (+ 15611us) log.cc:844] Serialized 52 byte log entry
0709 12:57:46.764893 (+391736us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:46.766827 (+  1934us) log.cc:844] Serialized 14 byte log entry
0709 12:57:46.767351 (+   524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:46.767476 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:47.858637 (+1091161us) raft_consensus.cc:1685] finished
0709 12:57:47.858669 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:47.858848 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1664,"prepare.queue_time_us":167,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":2042,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":11898,"thread_start_us":361637,"threads_started":1,"wal-append.queue_time_us":844644}
I20260709 12:57:47.800770  3398 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:47.860960  3419 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:47.878731  3852 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:47.877627  3658 consensus_meta.cc:287] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.768s	user 0.009s	sys 0.002s
I20260709 12:57:47.880968  3581 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:57:47.886365  3816 consensus_meta.cc:287] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.674s	user 0.008s	sys 0.001s
W20260709 12:57:47.876916  3869 log.cc:927] Time spent T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:57:47.896261  2267 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:47.897290  3648 raft_consensus.cc:2804] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:57:47.890033  3823 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:47.902110  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:47.902889  1684 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:47.893914  3398 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:47.894477  1614 raft_consensus.cc:1240] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:47.899503  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:47.917335  1688 raft_consensus.cc:1240] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:47.892215  1611 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:57:47.903384  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:47.904798  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:47.919188  1535 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:47.927341  1583 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:47.896819  3816 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:47.929905  3852 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:47.913512  3307 raft_consensus.cc:3055] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:57:47.932404  1684 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:47.915943  3585 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:47.941046  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 99458us
I20260709 12:57:47.945719  1535 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 8.
W20260709 12:57:47.949780  1505 connection.cc:256] RPC call timeout handler was delayed by -1.2265848430000119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
I20260709 12:57:47.935739  3307 raft_consensus.cc:740] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:47.954170  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.955231  3875 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:47.955876  3875 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:47.958045  3875 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:47.959339  1583 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:47.948757  3204 raft_consensus.cc:697] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:47.965471  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.952780  1505 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:47.937902  3419 consensus_queue.cc:1059] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:57:47.938129  3585 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:47.966730  3889 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:47.967259  1505 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:47.968142  3889 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:47.968573  3585 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:47.969596  1610 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 6.
I20260709 12:57:47.972446  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.976327  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.975994  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.979300  3307 consensus_queue.cc:260] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:47.980675  3307 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:47.981580  3884 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:47.982326  3884 consensus_queue.cc:1243] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer c262eac7fc904ae9bb91e450f6532e3f log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:57:47.984141  3882 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:57:47.947397  3809 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:47.988200  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.989113  1505 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:47.989872  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:47.990075  3884 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:57:47.991149  3843 log.cc:927] Time spent T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.681s	user 0.005s	sys 0.005s
I20260709 12:57:47.971029  3658 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:47.988724  1583 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:47.970695  3863 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:57:47.998497  1610 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 3.
I20260709 12:57:47.998600  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:47.999872  1612 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 6.
I20260709 12:57:48.000615  3863 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:48.004242  3863 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:48.004642  3896 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:48.005085  3896 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:48.005409  3896 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:47.992988  3838 consensus_queue.cc:1048] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:57:48.007570  3870 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:47.997233  3658 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:48.008972  3658 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:47.992319  3460 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:48.018677  3460 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:48.023967  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:48.025315  1583 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:48.026608  3874 raft_consensus.cc:2804] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:48.027015  3874 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:48.027349  3874 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:48.029654  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 896) took 1525 ms. Trace:
I20260709 12:57:48.030051  1613 rpcz_store.cc:276] 0709 12:57:46.504371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:46.505028 (+   657us) service_pool.cc:224] Handling call
0709 12:57:48.029474 (+1524446us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b540011dad4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:48.029572 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":318126336}
I20260709 12:57:48.023967  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:48.035555  1583 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:48.000705  3809 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:48.038069  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:48.038256  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:48.038911  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:48.040025  1687 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 7: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:48.040525  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:48.040680  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:48.041414  1684 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:48.042430  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:48.042187  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:48.043026  1534 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:48.044627  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:48.017812  3648 raft_consensus.cc:697] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 9 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:57:48.050258  1538 raft_consensus.cc:1240] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:48.045730  1583 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:48.047508  1534 raft_consensus.cc:1240] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9. Ops: []
I20260709 12:57:48.047569  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:48.048686  1539 raft_consensus.cc:1240] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:48.048962  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:48.049290  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:57:48.051911  2266 leader_election.cc:336] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 1.620s (SENT)
I20260709 12:57:48.052033  1542 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:57:48.046355  1535 raft_consensus.cc:1240] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:48.051553  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:48.050483  1687 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:57:48.052387  2266 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:48.053876  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:48.055827  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:48.056718  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:48.057449  2266 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:48.057561  1540 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:48.039685  3581 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:48.068810  1581 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:48.053876  3849 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:48.059165  3419 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:48.039515  3816 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:48.083437  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:48.037504  3566 consensus_queue.cc:1059] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:57:48.086198  3849 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:48.095537  1581 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:48.097460  1542 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:48.037822  3204 consensus_queue.cc:237] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.100417  1540 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:57:48.084096  3419 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:48.036832  3738 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.104387  3419 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:48.106170  3738 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:48.100227  2269 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:48.108155  3823 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:57:48.103008  3849 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:48.108955  3849 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:48.111409  3419 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.103448  3581 raft_consensus.cc:697] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:48.116001  3581 consensus_queue.cc:237] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.117750  3890 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:48.117985  3658 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.103641  3852 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:48.120594  3419 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:48.121261  3897 log.cc:927] Time spent T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:57:48.122982  1616 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 9.
I20260709 12:57:48.123319  2301 raft_consensus.cc:1240] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 2 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:48.122730  2298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32802 (request call id 88) took 1631 ms. Trace:
I20260709 12:57:48.122133  1581 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:48.126057  1581 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:48.120211  3658 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:48.124668  2298 rpcz_store.cc:276] 0709 12:57:46.491755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:46.491885 (+   130us) service_pool.cc:224] Handling call
0709 12:57:48.122500 (+1630615us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b54001617d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:48.122649 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1383616384}
I20260709 12:57:48.140801  3896 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.143236  3896 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:48.123708  3398 raft_consensus.cc:3055] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:48.144176  3398 raft_consensus.cc:740] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:48.147379  3398 consensus_queue.cc:260] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.152866  3398 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:48.156359  3849 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:48.114781  3874 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.161576  3852 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:48.182742  3852 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:48.209600  3852 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:48.213318  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:48.213989  1540 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:48.222771  1540 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 7.
I20260709 12:57:48.226166  3874 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:48.229708  3849 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:48.163815  3863 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.145536  3648 consensus_queue.cc:237] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:48.099632  3460 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:48.176574  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 50583.3us
I20260709 12:57:48.230000  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:48.233374  1581 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:48.234650  1581 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:48.233132  3460 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:48.240706  3757 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:48.241910  1581 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:48.242849  3757 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:48.244298  1581 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:48.240392  3874 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:48.248762  3757 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:48.253008  3757 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:48.255429  1581 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:48.182790  3419 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:48.284184  3419 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:57:48.283632  3860 log.cc:927] Time spent T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.631s	user 0.003s	sys 0.010s
I20260709 12:57:48.277009  3742 raft_consensus.cc:3055] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:48.287248  3742 raft_consensus.cc:740] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:48.282770  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 924) took 1374 ms. Trace:
I20260709 12:57:48.288429  1611 rpcz_store.cc:276] 0709 12:57:46.908165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:47.220761 (+312596us) service_pool.cc:224] Handling call
0709 12:57:48.282617 (+1061856us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b54001f68d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:48.282718 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1473121024}
I20260709 12:57:48.276887  3830 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:48.265246  3863 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:48.281911  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1154) took 1326 ms. Trace:
I20260709 12:57:48.289851  1614 rpcz_store.cc:276] 0709 12:57:46.955153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:47.435653 (+480500us) service_pool.cc:224] Handling call
0709 12:57:47.435974 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:47.915722 (+479748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:48.281650 (+365928us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b540032b254. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:48.281849 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1054119808}
I20260709 12:57:48.290822  3490 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:48.291095  3830 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:48.294165  3742 consensus_queue.cc:260] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:48.295323  3742 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:48.252322  3852 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.299289  3852 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:48.305029  3853 consensus_queue.cc:1059] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:48.306264  3490 raft_consensus.cc:3055] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:48.306392  1581 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:48.306740  3490 raft_consensus.cc:740] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:48.308336  3748 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:48.356412  3852 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:48.309413  3885 consensus_queue.cc:1048] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:48.356721  3490 consensus_queue.cc:260] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:48.357607  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 51302.3us
I20260709 12:57:48.310079  3738 consensus_queue.cc:1059] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:48.310670  3883 raft_consensus.cc:3055] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:48.312893  2299 raft_consensus.cc:1240] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:48.358978  3738 raft_consensus.cc:3055] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:48.313285  2298 raft_consensus.cc:1240] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:48.313939  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:48.359316  3738 raft_consensus.cc:740] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 12:57:48.315991  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 671653us
I20260709 12:57:48.360812  1654 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:48.360240  3738 consensus_queue.cc:260] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.361963  3738 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:48.362713  1654 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:48.363582  1654 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:48.364022  3815 raft_consensus.cc:2764] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:57:48.317762  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1217) took 1214 ms. Trace:
I20260709 12:57:48.321978  2301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32794 (request call id 141) took 1087 ms. Trace:
I20260709 12:57:48.326287  3577 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:48.365120  3393 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:48.365453  3751 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:48.364871  1685 rpcz_store.cc:276] 0709 12:57:47.103075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:47.271938 (+168863us) service_pool.cc:224] Handling call
0709 12:57:47.272182 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:47.272369 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:57:47.574984 (+302615us) log.cc:844] Serialized 14 byte log entry
0709 12:57:48.317420 (+742436us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:48.317475 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:48.317517 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:48.317580 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:48.317706 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":585643,"prepare.queue_time_us":113069,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":2806,"raft.queue_time_us":586501,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":374035,"threads_started":2,"wal-append.queue_time_us":314986}
I20260709 12:57:48.335695  1616 raft_consensus.cc:1275] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:57:48.336971  1615 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:57:48.367157  2301 rpcz_store.cc:276] 0709 12:57:47.234682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:47.252433 (+ 17751us) service_pool.cc:224] Handling call
0709 12:57:48.005325 (+752892us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b5800003c98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc86202afc0 00007fc862015929 00007fc8620153d2 00007fc85b58cbd4
0709 12:57:48.123115 (+117790us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:48.123899 (+   784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:48.321749 (+197850us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54001617d0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:48.321910 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275858688}
I20260709 12:57:48.367705  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1220) took 1263 ms. Trace:
I20260709 12:57:48.368183  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:48.368793  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1204) took 1481 ms. Trace:
I20260709 12:57:48.358315  1581 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:48.369334  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:48.369577  1654 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:48.341010  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:48.341377  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:48.370296  3577 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:48.341708  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:48.342525  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:48.371119  3577 consensus_queue.cc:1059] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:57:48.371974  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:48.329922  3858 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:48.372325  3830 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.344933  1684 raft_consensus.cc:1240] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:48.347560  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:48.348737  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:48.348934  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:48.350562  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:48.351722  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:48.352058  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:48.373234  3854 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:48.374040  3854 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:48.344626  1688 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:57:48.374523  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:48.375399  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:48.375639  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:48.371201  3393 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:48.354024  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:48.376595  3393 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:48.377244  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:48.378338  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:48.378872  1609 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:57:48.372617  3852 raft_consensus.cc:3055] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:57:48.373121  1614 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:57:48.379601  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:48.355094  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:48.380388  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:48.372723  1615 raft_consensus.cc:2376] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4. Re-sending same reply.
I20260709 12:57:48.372723  1654 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:48.372980  3858 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.381870  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:48.382002  3815 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:48.373754  1683 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:48.382579  3815 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:48.383162  3815 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:48.373713  1612 raft_consensus.cc:2393] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 3: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:48.338409  1611 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:48.366477  3751 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:48.380736  1688 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:48.370823  3883 raft_consensus.cc:740] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:48.370385  1537 raft_consensus.cc:2376] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8. Re-sending same reply.
I20260709 12:57:48.381290  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:48.374385  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:48.367237  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:48.385628  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:48.385995  1685 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:48.370503  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:48.387108  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:48.387290  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:48.385166  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:48.382043  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:48.388607  3751 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:48.389210  1611 raft_consensus.cc:2410] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:57:48.389755  1617 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:48.390384  1611 raft_consensus.cc:1217] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-8.4]   Dedup: 3.2->[6.3-8.4]
I20260709 12:57:48.390842  1611 pending_rounds.cc:85] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f: Aborting all ops after (but not including) 2
I20260709 12:57:48.385234  1610 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:48.391053  1611 pending_rounds.cc:107] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:57:48.391325  1611 raft_consensus.cc:2889] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:48.383304  3858 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:48.392846  3883 consensus_queue.cc:260] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.393401  1614 raft_consensus.cc:2376] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8. Re-sending same reply.
I20260709 12:57:48.393857  3883 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:48.394691  1614 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:57:48.386184  1612 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:48.352720  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:48.397308  1682 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:48.399076  1654 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:48.358043  3490 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:48.401957  1654 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:48.402784  3852 raft_consensus.cc:740] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:48.404050  3852 consensus_queue.cc:260] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:48.382515  1615 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:48.374410  3854 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:48.405218  3751 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:48.408357  1687 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:57:48.407395  3751 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:48.410027  3751 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:48.368139  1689 rpcz_store.cc:276] 0709 12:57:47.103868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:47.360935 (+257067us) service_pool.cc:224] Handling call
0709 12:57:47.361298 (+   363us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:57:47.361650 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:47.361679 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:57:47.397829 (+ 36150us) log.cc:844] Serialized 52 byte log entry
0709 12:57:47.569909 (+172080us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:47.610435 (+ 40526us) log.cc:844] Serialized 14 byte log entry
0709 12:57:48.309230 (+698795us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b1800148f00. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859edec0a 00007fc86361e219 00007fc859f66a40 00007fc859f614e4 00007fc859f61455 00007fc85d049060 00007fc85d05b716 00007fc85d06c287 00007fc85d06c208
0709 12:57:48.311770 (+  2540us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b1800148f00. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f643f3 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd 000000000038f354 000000000038f199 00007fc859f4783a
0709 12:57:48.367386 (+ 55616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:48.367462 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:48.367505 (+    43us) raft_consensus.cc:1685] finished
0709 12:57:48.367518 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:48.367647 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":676021,"prepare.queue_time_us":79458,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":914439,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":28777,"spinlock_wait_cycles":13788160,"thread_start_us":157074,"threads_started":2,"wal-append.queue_time_us":248617}
I20260709 12:57:48.403155  1654 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:48.369782  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1205) took 1444 ms. Trace:
I20260709 12:57:48.419482  1654 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:48.369138  1690 rpcz_store.cc:276] 0709 12:57:46.887749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:47.232905 (+345156us) service_pool.cc:224] Handling call
0709 12:57:47.245134 (+ 12229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:47.245406 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:57:47.245704 (+   298us) log.cc:844] Serialized 14 byte log entry
0709 12:57:48.368369 (+1122665us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:48.368429 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:48.368493 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:48.368558 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:48.368729 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":753915,"prepare.queue_time_us":2655,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":40,"raft.queue_time_us":690981,"raft.run_cpu_time_us":53,"raft.run_wall_time_us":53,"thread_start_us":431643,"threads_started":2,"wal-append.queue_time_us":686054}
I20260709 12:57:48.419251  1691 rpcz_store.cc:276] 0709 12:57:46.925196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:47.246880 (+321684us) service_pool.cc:224] Handling call
0709 12:57:47.273443 (+ 26563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:47.273627 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:57:47.482543 (+208916us) log.cc:844] Serialized 14 byte log entry
0709 12:57:48.369479 (+886936us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:48.369527 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:48.369565 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:48.369626 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:48.369720 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":780485,"prepare.queue_time_us":179648,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":8000,"raft.queue_time_us":700958,"raft.run_cpu_time_us":53,"raft.run_wall_time_us":52,"thread_start_us":299613,"threads_started":3,"wal-append.queue_time_us":297503}
I20260709 12:57:48.351971  1655 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:48.412721  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:48.422257  3886 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:57:48.422644  3886 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:48.422999  3886 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:48.412460  1685 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:57:48.418856  3867 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:48.423610  1617 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:57:48.423568  3867 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:48.424166  3867 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:48.424969  1683 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:57:48.415457  3852 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:48.430330  1654 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:48.428617  1682 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:57:48.428656  3910 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:48.412667  3815 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.431478  1654 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:48.435971  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:48.441293  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:48.465628  1615 raft_consensus.cc:2376] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8. Re-sending same reply.
I20260709 12:57:48.435194  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:48.433236  3815 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:48.446422  3910 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:48.435700  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:48.470851  1617 raft_consensus.cc:2393] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 9: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:48.471249  3854 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.428162  1688 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:48.436925  1616 raft_consensus.cc:2410] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:57:48.452232  1654 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:48.477615  1654 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:48.478300  3854 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:48.478911  1654 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:48.445948  3912 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:57:48.480654  3912 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 12:57:48.424223  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 72349us
I20260709 12:57:48.417354  3751 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:48.481478  3751 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:48.430351  3830 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:48.452919  3867 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.481698  1655 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:48.481086  3912 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:48.483460  3867 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:48.484050  3867 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:48.453730  3858 raft_consensus.cc:2764] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:57:48.486286  3858 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:48.452802  3911 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:48.487191  3911 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:48.487592  3911 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:48.488688  3815 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:48.489192  3751 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.490131  1654 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:48.490973  1654 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:48.481156  3920 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:48.491649  3920 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:48.491974  3920 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:48.462811  3886 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.484400  3867 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:48.468019  3393 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.473169  3738 consensus_queue.cc:1048] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:48.493777  3867 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:48.496601  3912 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.503589  3858 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:48.503860  3886 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:48.504133  3858 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:48.504724  3858 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:48.505208  3912 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:48.496923  3911 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.507210  3911 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:48.499310  3751 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:48.501329  3393 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:48.502389  3867 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.508344  3815 raft_consensus.cc:2764] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:57:48.473822  3910 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:48.510005  3867 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:48.511520  3920 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.513011  3858 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.513873  3920 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:48.515216  3858 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:48.478911  3854 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:48.516691  3854 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:48.517278  3854 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:48.520972  3910 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.463636  1505 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:48.559017  1440 catalog_manager.cc:5697] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
W20260709 12:57:48.562255  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 98599.4us
I20260709 12:57:48.563580  1440 catalog_manager.cc:5697] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 2 to 5, term changed from 5 to 7, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:48.567476  1505 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:48.573530  1505 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
W20260709 12:57:48.434607  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:48.577437  1508 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:48.414208  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 44143us
I20260709 12:57:48.579999  1609 raft_consensus.cc:2393] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 8: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:48.470033  1583 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:48.458398  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:48.448282  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:48.635365  1610 raft_consensus.cc:2368] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8.
I20260709 12:57:48.459813  1612 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:57:48.462459  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:57:48.595714  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 113929us
W20260709 12:57:48.644851  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 67741us
I20260709 12:57:48.646737  1655 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:48.592600  3809 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:48.589133  1581 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:48.649775  3870 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:48.653339  3870 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:48.653787  3870 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:48.654246  3910 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:48.652657  3830 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:48.657852  3885 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:48.665808  3885 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:48.666356  3885 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:48.652545  1508 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:48.680922  3910 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:48.689064  3830 raft_consensus.cc:2804] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:48.689806  3854 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.694072  3830 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:48.683007  3658 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:48.693014  3852 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:57:48.685238  3738 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:57:48.689074  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 218994us
I20260709 12:57:48.696179  3830 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:48.700765  1542 raft_consensus.cc:1275] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:57:48.702031  1508 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:48.703310  3849 consensus_queue.cc:1048] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:57:48.697248  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 123999us
I20260709 12:57:48.699774  1583 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:48.713014  3854 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:48.705559  3852 raft_consensus.cc:697] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:48.714969  3852 consensus_queue.cc:237] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.715642  3748 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:48.721136  3658 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:57:48.723212  3658 raft_consensus.cc:697] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:48.724371  3658 consensus_queue.cc:237] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.722136  3854 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:48.728904  1505 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:48.729825  3854 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.733309  3748 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:48.733848  3748 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:48.734609  3854 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:48.721637  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 75212us
I20260709 12:57:48.732052  1505 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:57:48.737373  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 148916us
I20260709 12:57:48.739109  2301 raft_consensus.cc:1240] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:48.716925  3910 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:48.742475  3742 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:48.743050  1688 raft_consensus.cc:1240] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:48.745105  3858 consensus_queue.cc:1059] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:57:48.746902  3858 raft_consensus.cc:3055] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:48.747268  3858 raft_consensus.cc:740] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:48.748667  1655 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:48.750743  1655 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:48.754415  3921 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:48.757066  1686 raft_consensus.cc:1240] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:48.754911  1583 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:48.761976  3854 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:48.763787  3854 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:48.759116  3921 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:48.754451  3738 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:57:48.766378  3742 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:48.765479  3854 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:48.767513  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:48.773726  3920 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:48.774400  3920 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.776686  3920 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:48.782052  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 45167.7us
I20260709 12:57:48.782868  1655 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:48.783397  3880 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:57:48.784086  3880 raft_consensus.cc:697] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:48.786376  1688 raft_consensus.cc:1240] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:57:48.751791  3858 consensus_queue.cc:260] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:48.788988  3858 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:48.791139  3920 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:48.790794  3880 consensus_queue.cc:237] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.791635  3920 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:48.792200  3920 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:48.768535  3910 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.783401  1583 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:48.778232  3921 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:48.801474  3910 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:48.802796  3853 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:57:48.805285  1581 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:48.817286  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 85328.4us
I20260709 12:57:48.831239  1685 raft_consensus.cc:1240] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:57:48.832239  3853 raft_consensus.cc:697] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:57:48.833113  1438 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54582 (request call id 149) took 17352 ms (client timeout 15000 ms). Trace:
I20260709 12:57:48.833525  3853 consensus_queue.cc:237] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.836869  1505 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:48.840704  3738 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:48.826086  3854 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.842865  3854 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:48.817903  3885 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.848618  1655 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:48.850682  1655 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:48.851665  3910 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:48.852743  3910 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:57:48.852962  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 91615.7us
I20260709 12:57:48.853351  3910 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:48.853865  3910 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:48.856841  3878 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:48.860507  3748 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.862959  3748 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:48.865027  1508 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:48.866637  3910 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.840145  1505 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:48.852303  1655 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:48.869799  3742 consensus_queue.cc:1059] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:48.822678  3658 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:57:48.854111  1438 rpcz_store.cc:269] 0709 12:57:31.480436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:31.480660 (+   224us) service_pool.cc:224] Handling call
0709 12:57:33.679770 (+2199110us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54001b99d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfbb090 00007fc85d059f3a 00007fc862e101cc 00007fc862f0e37e 00007fc8613cf2a4 00007fc8613cf232 00007fc8613cf161 00007fc8613cf0dc 00007fc8613ce392 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:48.832828 (+15153058us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:47.882109 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:47.882729 (+   620us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:47.882760 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:57:47.882776 (+    16us) tablet.cc:662] Decoding operations
0709 12:57:47.883393 (+   617us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:47.883448 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:47.883482 (+    34us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:57:47.883863 (+   381us) tablet.cc:701] Row locks acquired
0709 12:57:47.883877 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:57:47.884032 (+   155us) write_op.cc:270] Start()
0709 12:57:47.884140 (+   108us) write_op.cc:276] Timestamp: P: 1783601867883983 usec, L: 0
0709 12:57:47.884158 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:57:47.935060 (+ 50902us) log.cc:844] Serialized 1705 byte log entry
0709 12:57:48.181594 (+246534us) op_driver.cc:464] REPLICATION: finished
0709 12:57:48.231952 (+ 50358us) write_op.cc:301] APPLY: starting
0709 12:57:48.232029 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 12:57:48.232190 (+   161us) tablet.cc:1370] finished BulkCheckPresence
0709 12:57:48.232327 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:57:48.232947 (+   620us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:57:48.233149 (+   202us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:57:48.233215 (+    66us) write_op.cc:312] APPLY: finished
0709 12:57:48.236450 (+  3235us) log.cc:844] Serialized 40 byte log entry
0709 12:57:48.236691 (+   241us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:48.236802 (+   111us) write_op.cc:454] Released schema lock
0709 12:57:48.236859 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:57:48.237229 (+   370us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:48.237265 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":690339,"reported_tablets":36,"spinlock_wait_cycles":2934853888,"child_traces":[["op",{"apply.queue_time_us":50128,"apply.run_cpu_time_us":2491,"apply.run_wall_time_us":5249,"num_ops":4,"prepare.queue_time_us":508083,"prepare.run_cpu_time_us":14995,"prepare.run_wall_time_us":93647,"raft.queue_time_us":57790,"raft.run_cpu_time_us":2944,"raft.run_wall_time_us":21386,"replication_time_us":297256,"thread_start_us":523678,"threads_started":5,"wal-append.queue_time_us":51215}]]}
I20260709 12:57:48.853909  3885 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:48.883031  3830 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.894764  3920 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.899600  1583 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:57:48.924419  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 99008.7us
I20260709 12:57:48.901225  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:48.901935  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:48.902542  1686 raft_consensus.cc:1240] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:48.903220  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:48.903662  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:48.904263  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:48.904680  1683 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:57:48.906329  1682 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:57:48.906188  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:48.907107  1689 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:57:48.910084  3870 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.911690  3738 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:57:48.914247  2266 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:48.917201  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:48.918141  3921 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.942080  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:48.942427  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:48.943684  3460 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:57:48.944954  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 104935us
I20260709 12:57:48.945662  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:48.946380  1505 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:48.948686  3878 raft_consensus.cc:2804] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:48.945659  1684 raft_consensus.cc:2393] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 9: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:48.954046  1535 raft_consensus.cc:2393] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 5: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 12:57:48.971354  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 119173us
I20260709 12:57:48.978969  1539 raft_consensus.cc:2393] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 8: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:48.976027  3858 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:48.983428  3858 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:48.983814  3858 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:48.986129  1534 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:57:48.959702  3748 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:48.994833  3748 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:48.995335  3748 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:48.996345  3883 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:48.997171  3883 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:48.998392  3870 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:48.945700  3490 consensus_queue.cc:1059] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:57:48.999576  3883 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:49.000151  3490 raft_consensus.cc:3055] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:57:49.000423  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:48.959995  3849 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:57:49.001744  3910 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:48.987738  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:49.003127  3830 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:49.004366  1682 raft_consensus.cc:1240] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:48.994040  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:49.005153  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 91168us
I20260709 12:57:49.006664  3920 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:48.986465  3460 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:49.010126  3490 raft_consensus.cc:740] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:49.013046  1505 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:49.020515  1655 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:49.011667  3490 consensus_queue.cc:260] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:49.023425  3858 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:49.041299  1688 raft_consensus.cc:2393] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 6: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:49.042420  3858 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:49.039247  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:49.061836  1533 raft_consensus.cc:1240] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 4. Current term is 5. Ops: []
W20260709 12:57:49.069775  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:49.074820  1539 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 6. Current term is 7. Ops: []
W20260709 12:57:49.086337  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 97761.5us
W20260709 12:57:49.071349  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 78678us
I20260709 12:57:49.063052  3878 raft_consensus.cc:697] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:49.099046  1505 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:49.104804  3921 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:49.104871  3858 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:49.108915  3924 log.cc:927] Time spent T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:57:49.100112  3934 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:49.058445  3920 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:57:49.110987  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 246170us
I20260709 12:57:49.109851  3934 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:49.116212  1535 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 3.
I20260709 12:57:49.089210  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:49.059693  3460 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:49.116725  3934 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:49.127681  1540 raft_consensus.cc:2393] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 9: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:49.061555  3742 consensus_queue.cc:1243] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer c262eac7fc904ae9bb91e450f6532e3f log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:57:49.139971  1535 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:49.099820  3878 consensus_queue.cc:237] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:49.112171  3920 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:49.109221  3858 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:49.155369  3920 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:49.139878  3830 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:57:49.194563  3858 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:49.194298  3748 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:49.191290  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 64948.9us
W20260709 12:57:49.191993  3930 log.cc:927] Time spent T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:57:49.209529  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:49.212949  1505 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:49.214567  1505 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:49.157513  3870 consensus_queue.cc:1059] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:57:49.213461  1655 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:49.224730  3748 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:49.226578  3577 consensus_queue.cc:1059] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:57:49.227918  3929 log.cc:927] Time spent T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:57:49.228451  3934 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:49.229259  3937 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:49.229856  3937 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:49.230638  3934 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:49.243326  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:49.246753  1684 raft_consensus.cc:1240] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:49.256565  1686 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:49.268550  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:49.276196  1683 raft_consensus.cc:1240] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:49.244035  3738 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:49.244412  3858 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:49.286096  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:49.255009  3742 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:49.233525  3920 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:49.297034  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:49.286500  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:49.305614  1612 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:49.295156  3742 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:49.318293  1541 raft_consensus.cc:1240] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:49.318849  3938 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:49.319392  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:49.320174  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:49.320132  1539 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:49.322516  3885 raft_consensus.cc:3055] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:57:49.323480  3885 raft_consensus.cc:740] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:49.324019  1682 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:49.317971  3852 consensus_queue.cc:1059] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:49.327960  1535 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:49.334455  1685 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:57:49.336397  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 124693us
I20260709 12:57:49.325856  3742 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:57:49.338793  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 88781.9us
I20260709 12:57:49.319579  3938 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:49.343600  1687 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:49.351622  1609 raft_consensus.cc:1240] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:49.324501  3885 consensus_queue.cc:260] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:49.356707  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:49.356989  1537 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:57:49.338593  3937 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:49.363956  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:57:49.364499  3932 log.cc:927] Time spent T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.263s	user 0.001s	sys 0.002s
I20260709 12:57:49.365252  3878 consensus_queue.cc:1059] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.004s
W20260709 12:57:49.372000  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 157570us
I20260709 12:57:49.376281  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:49.380407  1655 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:49.349279  3880 consensus_queue.cc:1059] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:57:49.365262  3935 raft_consensus.cc:3055] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:49.389932  1685 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:49.378873  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:49.356256  3852 consensus_queue.cc:1059] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:57:49.415321  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:49.416703  1608 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:49.420830  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:57:49.421198  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 57344.7us
I20260709 12:57:49.371454  3577 consensus_queue.cc:1059] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:57:49.375599  3883 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:57:49.389318  3935 raft_consensus.cc:740] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:49.415237  3854 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:49.418758  3885 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:49.432911  1689 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:57:49.432572  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:49.438597  1616 raft_consensus.cc:1275] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:57:49.427433  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:49.443352  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:49.446401  3878 raft_consensus.cc:3055] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:49.446897  3878 raft_consensus.cc:740] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:49.424422   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:57:49.453069  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 85764.9us
I20260709 12:57:49.455914  1608 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:57:49.456825  1536 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:57:49.462492  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:49.463174  1608 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:49.464906  3577 raft_consensus.cc:3055] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:57:49.465366  3577 raft_consensus.cc:740] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:49.466336  3577 consensus_queue.cc:260] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:49.467628  3577 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:49.431071  3460 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:57:49.475636  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:49.447917  3878 consensus_queue.cc:260] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:49.450814  3920 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:49.481607  3947 consensus_queue.cc:1059] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
W20260709 12:57:49.483265  3943 log.cc:927] Time spent T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:57:49.484812  3935 consensus_queue.cc:260] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:49.486131  3935 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:49.486622  1608 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:49.488586  3951 raft_consensus.cc:3055] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:57:49.489043  3951 raft_consensus.cc:740] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:49.489564  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:49.489982  3951 consensus_queue.cc:260] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:49.490506  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:49.491392  3951 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:49.492771  3938 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:49.493431  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:49.494962  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:49.495486  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:49.495837  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:49.496321  1610 raft_consensus.cc:2393] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 5: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:49.495862  1508 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:49.485487  1682 raft_consensus.cc:1275] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:57:49.499511  1612 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 7.
I20260709 12:57:49.501226  1687 raft_consensus.cc:1275] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:57:49.502221  1615 raft_consensus.cc:1240] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 6. Current term is 7. Ops: []
W20260709 12:57:49.502264  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 74744us
I20260709 12:57:49.478685  3933 raft_consensus.cc:3055] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:49.507247  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:49.508059  1685 raft_consensus.cc:2393] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 5: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:49.505646  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:49.514570  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:49.517154  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:49.518985  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:57:49.519701  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:49.520298  1581 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:49.525100  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:49.529312  3460 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:49.529178  3921 consensus_queue.cc:1059] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:49.530278  3921 raft_consensus.cc:3055] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:49.530663  3921 raft_consensus.cc:740] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:49.531666  3921 consensus_queue.cc:260] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:49.533371  1654 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:49.534446  3920 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:57:49.534992  3920 raft_consensus.cc:697] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 8 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:49.535899  3920 consensus_queue.cc:237] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:49.537973  1655 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:57:49.538867  3858 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:49.539294  3858 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:57:49.539669  3858 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:49.540443  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:49.541486  1614 raft_consensus.cc:2410] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:57:49.546149  1654 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:49.546531  3490 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:49.539623  1655 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:49.513314  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:49.507298  3933 raft_consensus.cc:740] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:49.556941  3854 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:49.557324  3933 consensus_queue.cc:260] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:49.558629  3933 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:49.559181  1655 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:49.559697  3934 raft_consensus.cc:3055] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:57:49.560091  3854 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:49.560554  3854 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:49.560925  3854 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:49.563077  3460 consensus_queue.cc:1059] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:57:49.563561  1583 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:49.567232  3733 consensus_queue.cc:1059] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:49.568648  1611 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:49.536902  3945 consensus_queue.cc:1059] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 12:57:49.569278  3938 consensus_queue.cc:1048] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:49.570255  3945 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:49.570787  3938 consensus_queue.cc:1048] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:57:49.571628  3945 raft_consensus.cc:3055] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:57:49.572058  3945 raft_consensus.cc:740] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 12:57:49.572965  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:49.574231  3742 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:49.568666  3883 consensus_queue.cc:1059] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:57:49.575548  3883 raft_consensus.cc:3055] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:49.575923  3883 raft_consensus.cc:740] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:49.576843  3883 consensus_queue.cc:260] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:49.578076  3883 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:57:49.579409  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 101327us
I20260709 12:57:49.580673  3658 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:49.581197  3658 raft_consensus.cc:697] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:49.582116  3658 consensus_queue.cc:237] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:49.582679  3858 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:49.585114  3931 raft_consensus.cc:3055] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:49.585558  3931 raft_consensus.cc:740] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:49.586488  3931 consensus_queue.cc:260] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:49.572883  1655 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:49.588104  3931 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:49.552918  3950 consensus_queue.cc:1059] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:49.554598  3852 raft_consensus.cc:3055] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:49.556207  1440 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38804 (request call id 32) took 9173 ms. Trace:
I20260709 12:57:49.585153  1581 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:49.559106  1508 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:49.596191  1608 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:57:49.568344  3733 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:57:49.645880  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:49.572259  3938 raft_consensus.cc:3055] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:49.564177  3460 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:57:49.585572  3921 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:49.593739  3946 raft_consensus.cc:3055] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:49.595427  3878 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:57:49.663174  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 104174us
I20260709 12:57:49.576380  3742 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:49.560117  3934 raft_consensus.cc:740] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:49.602134  3852 raft_consensus.cc:740] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:49.647552  3733 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:49.647859  3809 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:49.602267  1440 rpcz_store.cc:276] 0709 12:57:40.390342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:40.390674 (+   332us) service_pool.cc:224] Handling call
0709 12:57:49.556125 (+9165451us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:48.719392 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:48.783687 (+ 64295us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:48.783735 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:57:48.783766 (+    31us) tablet.cc:662] Decoding operations
0709 12:57:48.784447 (+   681us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:48.784553 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:48.784582 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:57:48.785054 (+   472us) tablet.cc:701] Row locks acquired
0709 12:57:48.785114 (+    60us) write_op.cc:260] PREPARE: finished
0709 12:57:48.785305 (+   191us) write_op.cc:270] Start()
0709 12:57:48.785500 (+   195us) write_op.cc:276] Timestamp: P: 1783601868785246 usec, L: 0
0709 12:57:48.785540 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 12:57:48.786325 (+   785us) log.cc:844] Serialized 1044 byte log entry
0709 12:57:49.023358 (+237033us) op_driver.cc:464] REPLICATION: finished
0709 12:57:49.253408 (+230050us) write_op.cc:301] APPLY: starting
0709 12:57:49.253543 (+   135us) tablet.cc:1367] starting BulkCheckPresence
0709 12:57:49.255811 (+  2268us) tablet.cc:1370] finished BulkCheckPresence
0709 12:57:49.255977 (+   166us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:57:49.256523 (+   546us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:57:49.256843 (+   320us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:57:49.256904 (+    61us) write_op.cc:312] APPLY: finished
0709 12:57:49.257189 (+   285us) log.cc:844] Serialized 28 byte log entry
0709 12:57:49.258114 (+   925us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:49.258220 (+   106us) write_op.cc:454] Released schema lock
0709 12:57:49.258285 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 12:57:49.258725 (+   440us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:49.258766 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":23020,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":206880,"apply.run_cpu_time_us":2530,"apply.run_wall_time_us":8335,"num_ops":2,"prepare.queue_time_us":66279,"prepare.run_cpu_time_us":4125,"prepare.run_wall_time_us":78967,"replication_time_us":205357,"thread_start_us":96733,"threads_started":2}]]}
I20260709 12:57:49.594978  3854 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:49.649935  3938 raft_consensus.cc:740] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:57:49.754257  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:49.659492  3946 raft_consensus.cc:740] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:49.715556  3733 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:49.655285  3937 consensus_queue.cc:1059] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.109s
I20260709 12:57:49.761983  1437 catalog_manager.cc:5697] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 2 to 6, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 6 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
W20260709 12:57:49.790828  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 129075us
I20260709 12:57:49.795437  1437 catalog_manager.cc:5697] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 3 to 4, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:49.787899  3858 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:49.807734  1437 catalog_manager.cc:5697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } }
W20260709 12:57:49.813633  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 240821us
I20260709 12:57:49.804915  3920 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:57:49.849201  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 55608.1us
I20260709 12:57:49.763255  3945 consensus_queue.cc:260] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:49.850835  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:57:49.851227  1655 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:49.855053  1437 catalog_manager.cc:5697] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 3 to 5, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:49.817811  3937 raft_consensus.cc:3055] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:49.862589  1616 raft_consensus.cc:2410] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:57:49.850417  3658 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:57:49.865747  1655 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:49.808938  3957 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:49.794279  3934 consensus_queue.cc:260] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:49.871070  1437 catalog_manager.cc:5697] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 4 to 6, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 6 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
W20260709 12:57:49.885262  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 170931us
I20260709 12:57:49.887058  1505 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:57:49.890209  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 130666us
I20260709 12:57:49.892673  3748 consensus_queue.cc:1059] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:49.894038  3748 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:49.895740  3748 raft_consensus.cc:3055] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:49.896166  3748 raft_consensus.cc:740] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:49.909057  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:49.909817  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:49.806735  3852 consensus_queue.cc:260] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:49.871917  3937 raft_consensus.cc:740] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:49.854357  3955 consensus_queue.cc:1059] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.147s
I20260709 12:57:49.915323  1437 catalog_manager.cc:5697] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 4 to 5, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 5 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:49.810313  3938 consensus_queue.cc:260] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:49.808692  3946 consensus_queue.cc:260] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:49.878346  3957 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 12:57:49.922657  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 376623us
W20260709 12:57:49.923730  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 58059.4us
I20260709 12:57:49.924242  1542 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:57:49.929234  1534 raft_consensus.cc:1275] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:57:49.925765  1437 catalog_manager.cc:5697] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index 2 to 6, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:49.943323  1437 catalog_manager.cc:5697] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 6 to 8, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:49.921511  3934 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:49.920907  3742 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:49.951254  1437 catalog_manager.cc:5697] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 4 to 5, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 5 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
W20260709 12:57:49.952245  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:49.953145  3490 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:49.952976  3965 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:49.952951  1437 catalog_manager.cc:5697] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 1 to 7, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 7 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:49.954125  3945 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:57:49.954684  3961 log.cc:927] Time spent T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:57:49.954983  1437 catalog_manager.cc:5697] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
W20260709 12:57:49.956625  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:49.956616  1437 catalog_manager.cc:5697] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 3 to 5, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
W20260709 12:57:49.957619  3962 log.cc:927] Time spent T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:57:49.957000  3960 log.cc:927] Time spent T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:57:49.958048  1437 catalog_manager.cc:5697] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 4 to 6, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 6 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:49.959983  1437 catalog_manager.cc:5697] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 3 to 5, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:49.953722  3490 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:49.965165  1437 catalog_manager.cc:5697] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 2 to 6, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 6 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:49.966420  3490 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:49.961236  3967 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:57:49.963677  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 76767.2us
I20260709 12:57:49.966784  1437 catalog_manager.cc:5697] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:49.969107  1505 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:49.956645  3748 consensus_queue.cc:260] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:49.970539  3748 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:49.968518  1437 catalog_manager.cc:5697] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 1 to 3, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 3 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:49.972941  3958 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:57:49.974608  3964 log.cc:927] Time spent T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:57:49.973858  1437 catalog_manager.cc:5697] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 2 to 3, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 3 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:49.975780  1505 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:49.978724  1437 catalog_manager.cc:5697] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 4 to 6, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:49.983646  1505 leader_election.cc:400] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8.
I20260709 12:57:49.983525  1437 catalog_manager.cc:5697] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 4 to 6, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 6 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:49.929066  3957 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:49.985318  1437 catalog_manager.cc:5697] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 4 to 5, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:49.985970  3963 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:49.986320  3460 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:49.953042  3966 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:49.988555  1437 catalog_manager.cc:5697] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 4 to 6, leader changed from <none> to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 6 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:57:49.991394  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:49.991822  1508 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:49.996785  1437 catalog_manager.cc:5697] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 1 to 6, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 6 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:49.999817  1437 catalog_manager.cc:5697] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 3 to 6, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 6 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:57:50.006735  1505 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:49.960551  3972 raft_consensus.cc:3055] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:57:50.021078  1437 catalog_manager.cc:5697] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
W20260709 12:57:50.022511  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 409833us
I20260709 12:57:50.017583  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:50.023967  1533 raft_consensus.cc:1275] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:57:50.025077  1437 catalog_manager.cc:5697] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 2 to 4, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 4 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
W20260709 12:57:50.028154  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:50.014523  3742 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:50.031234  1508 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:50.015831  3972 raft_consensus.cc:740] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:50.034178  3977 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:50.062286  3977 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:50.062909  1536 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
W20260709 12:57:50.028815  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 80976.6us
W20260709 12:57:50.037112  3951 consensus_meta.cc:287] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.545s	user 0.011s	sys 0.000s
I20260709 12:57:50.069326  1685 raft_consensus.cc:1275] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:57:50.039113  3648 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:50.070207  3648 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:50.058373  3945 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:57:50.021998  1655 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:50.042933  1612 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:57:50.049141  3460 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:50.072589  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 76508.9us
I20260709 12:57:50.013166  3937 consensus_queue.cc:260] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:50.075815  3937 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:50.076200  1655 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:50.057771  3933 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:50.077001  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:50.077071  3933 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:50.077814  1534 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 6.
I20260709 12:57:50.079788  3742 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:57:50.072669  3972 consensus_queue.cc:260] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:50.080886  3972 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:50.064903  1508 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:50.073499  3460 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:50.087216  3460 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:50.088014  3920 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:50.088867  1655 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:57:50.090026  3970 log.cc:927] Time spent T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.121s	user 0.003s	sys 0.000s
I20260709 12:57:50.034228  3733 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:50.077420  3967 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:50.084668  1508 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:50.101867  1617 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:57:50.052044  1437 catalog_manager.cc:5697] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 1 to 4, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:50.104935  3648 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:50.105109  3973 log.cc:927] Time spent T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:57:50.111922  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:57:50.112296  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 202418us
I20260709 12:57:50.111573  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:50.117641  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:50.079247  3933 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:50.121259  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:50.122498  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:50.121971  1682 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:50.087304  3738 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:50.102478  3920 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:57:50.130775  1616 raft_consensus.cc:1240] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:57:50.130908  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:50.073679  3977 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:50.125017  1437 catalog_manager.cc:5697] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 1 to 3, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 3 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:50.132294  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:50.136032  1615 raft_consensus.cc:2410] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:57:50.139325  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:50.139892  3577 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:50.140451  3577 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:50.127964  3945 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:50.143296  3945 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:50.123862  3648 consensus_queue.cc:1048] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
W20260709 12:57:50.149471  3975 log.cc:927] Time spent T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.196s	user 0.000s	sys 0.004s
I20260709 12:57:50.149796  3733 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:50.137811  1437 catalog_manager.cc:5697] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 1 to 2, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 2 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
W20260709 12:57:50.151175  3935 consensus_meta.cc:287] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.665s	user 0.008s	sys 0.005s
I20260709 12:57:50.153725  3920 raft_consensus.cc:697] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 8 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:50.154774  3920 consensus_queue.cc:237] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:50.157079  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 72506.7us
I20260709 12:57:50.158414  3852 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:50.134919  3963 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:50.164744  3958 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:50.165410  3958 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:50.167917  3854 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:50.139456  3986 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:50.127022  3658 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:50.170087  3658 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:50.169516  1534 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 2.
I20260709 12:57:50.172361  3658 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:50.137563  2266 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:50.197875  2267 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:50.198324  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 74146.6us
I20260709 12:57:50.173384  1689 raft_consensus.cc:1240] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:50.137786  3965 raft_consensus.cc:697] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 5 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:57:50.184800  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:50.196967  3460 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:50.200290  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:50.169319  3986 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:50.200790  3460 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:50.201406  3956 raft_consensus.cc:2804] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:50.201858  3956 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:50.202184  3956 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:50.202749  3986 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:50.181587  3938 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:50.172276  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:50.179086  3946 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:50.208928  3460 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:50.209719  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:50.210450  2301 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:57:50.200589  3977 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:50.211158  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:50.211738  3977 raft_consensus.cc:697] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 7 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:57:50.212033  1536 raft_consensus.cc:2393] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 5: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:50.212219  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:50.200662  3849 consensus_queue.cc:1059] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:57:50.213713  3849 raft_consensus.cc:3055] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:57:50.214092  3849 raft_consensus.cc:740] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:57:50.214218  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:50.215070  3849 consensus_queue.cc:260] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:50.216012  3945 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:50.216372  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:50.210640  3958 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:57:50.216907  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 77878.4us
I20260709 12:57:50.217777  3977 consensus_queue.cc:237] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:50.218535  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:50.219390  1542 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:57:50.219734  3658 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:50.220675  3853 consensus_queue.cc:1048] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:50.211685  3965 consensus_queue.cc:237] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:50.222906  3853 consensus_queue.cc:1048] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:50.223636  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:50.221298  1617 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:57:50.220860  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:50.223819  1581 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:50.220243  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:50.220672  3658 consensus_queue.cc:1243] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:57:50.225843  3577 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:50.226317  1690 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 2.
I20260709 12:57:50.216917  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:50.231158  1613 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:50.231747  1534 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:50.234349  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:57:50.239588  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:50.235147  3986 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:50.235893  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:50.236892  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:50.237821  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:50.240592  1654 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:50.249116  1541 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:50.243485  1608 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:50.253850  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:50.259078  2300 raft_consensus.cc:2393] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 8: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:57:50.255101  1654 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:50.265940  3921 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:50.266752  3921 raft_consensus.cc:697] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 7 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:50.270233  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:50.268069  3921 consensus_queue.cc:237] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:50.274787  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:50.276412  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:50.277529  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:50.278205  1682 raft_consensus.cc:2393] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 7: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:50.278316  1683 raft_consensus.cc:2393] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 5: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:50.278987  1684 raft_consensus.cc:1240] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:50.279309  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:50.280604  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:50.276523  1687 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:57:50.281860  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:50.282357  1508 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:50.282513  1683 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 2.
I20260709 12:57:50.277354  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:50.283628  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:45440
I20260709 12:57:50.284385  1683 raft_consensus.cc:606] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:50.284650  3945 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:50.277372  1686 raft_consensus.cc:1240] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:50.286809  3945 consensus_queue.cc:1059] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:50.288053  3963 raft_consensus.cc:3055] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:50.288532  3963 raft_consensus.cc:740] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:50.288381  3945 consensus_queue.cc:1059] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:50.289601  3738 raft_consensus.cc:3055] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:57:50.289425  3963 consensus_queue.cc:260] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:50.290015  3738 raft_consensus.cc:740] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:50.290880  3738 consensus_queue.cc:260] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:50.290705  3963 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:50.282305  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:50.293196  1687 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:57:50.294492  1687 raft_consensus.cc:1240] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 8 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:50.276835  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:50.299253  1685 raft_consensus.cc:2393] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 8: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:50.300920  1508 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:50.301019  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:50.303179  3460 raft_consensus.cc:2804] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:57:50.303656  3460 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:50.303661  1508 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:50.304534  3460 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:50.307843  3809 consensus_queue.cc:1059] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:50.309029  3809 raft_consensus.cc:3055] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:50.309410  3809 raft_consensus.cc:740] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:50.308132  3742 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:57:50.310011  3742 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:50.310545  3742 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:50.310256  3809 consensus_queue.cc:260] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:50.311736  3809 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:50.300350  1685 raft_consensus.cc:1240] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:50.280941  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:50.324061  1684 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:50.324285  3809 consensus_queue.cc:1059] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:50.291865  3738 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:50.325497  3963 raft_consensus.cc:3055] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:57:50.325911  3963 raft_consensus.cc:740] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:50.326860  3963 consensus_queue.cc:260] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:50.327821  3963 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:50.273559  1690 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8. Ops: [5.3-7.4]
W20260709 12:57:50.345854  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:50.360580  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:50.362671  3733 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:50.363256  1583 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:50.363432  3853 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:50.364092  3853 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:50.366142  3853 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:50.366284  1539 raft_consensus.cc:1275] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:57:50.363227  3733 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:50.367343  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:50.367888  1539 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:50.368680  3733 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:50.369853  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:50.370494  1533 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:50.371325  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:50.371850  1533 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:50.373087  1541 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:50.374687  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:50.374933  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:50.375309  1611 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:50.379813  1539 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:57:50.380221  1538 raft_consensus.cc:1275] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:57:50.380643  1538 pending_rounds.cc:85] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 3
I20260709 12:57:50.284768  1683 raft_consensus.cc:614] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:50.254841  3854 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:57:50.392904  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:50.380910  1538 pending_rounds.cc:107] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:57:50.400708  1538 raft_consensus.cc:2889] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:50.190296  3957 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:50.356154  3460 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:50.372987  3849 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:50.399569  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:50.392936  1654 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:50.403097  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:50.400730  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:50.408711  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:50.420624  1610 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:50.427433  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:50.428956  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:50.428155  1611 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 7.
I20260709 12:57:50.387236  3878 raft_consensus.cc:2764] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:57:50.436730  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 43902.1us
I20260709 12:57:50.437772  1654 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:50.357482  3738 consensus_queue.cc:1059] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 12:57:50.394207  3852 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:50.404973  3854 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:57:50.443881  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:50.441396  1614 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:57:50.262271  3986 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:50.455798  1654 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:50.464527  1539 raft_consensus.cc:1240] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:57:50.466535  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 88997.8us
I20260709 12:57:50.442022  1533 raft_consensus.cc:1240] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 2. Current term is 3. Ops: []
I20260709 12:57:50.448652  3738 consensus_queue.cc:1243] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:57:50.460096  3854 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:50.405694  3742 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:50.463034  3733 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:50.455303  3987 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:57:50.491927  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 63195.6us
I20260709 12:57:50.474866  3920 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:50.444820  3953 consensus_queue.cc:1048] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:57:50.504830  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:50.507717  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:50.519090  1687 raft_consensus.cc:1275] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 12:57:50.519632  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 89819.6us
I20260709 12:57:50.520720  1685 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:57:50.488586  3981 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:50.510995  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:50.544982  1689 raft_consensus.cc:2393] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 5: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:50.546900  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:50.540666  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:50.548946  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:50.479800  3852 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:50.540149  3658 consensus_queue.cc:1048] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:57:50.554473  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:50.555258  1689 raft_consensus.cc:2393] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 6: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:50.555817  3742 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:50.556380  1691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:45440
I20260709 12:57:50.556579  3986 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:50.556843  3983 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:50.558929  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:50.576632  1690 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:50.565812  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:50.568558  1536 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:50.568804  1691 raft_consensus.cc:606] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:50.577081  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 67088.8us
I20260709 12:57:50.577517  1691 raft_consensus.cc:614] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:50.525463  3987 raft_consensus.cc:697] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 7 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:50.578224  1684 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:50.566887  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:50.581527  1689 raft_consensus.cc:1275] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:50.505849  3733 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:50.545979  3920 raft_consensus.cc:697] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:50.593993  1685 raft_consensus.cc:2393] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 5: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:50.602758  1583 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:50.609386  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:50.610066  1684 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:50.606145  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:50.618057  1687 raft_consensus.cc:2393] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 7: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 12:57:50.604027  3937 consensus_meta.cc:287] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.528s	user 0.006s	sys 0.004s
W20260709 12:57:50.632948  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 107033us
I20260709 12:57:50.634104  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:50.634300  1581 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:50.604365  3983 raft_consensus.cc:697] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 7 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:50.630569  3853 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:50.606372  3951 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:57:50.674105  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:50.675545  1581 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:50.676690  3982 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:57:50.677047  3995 log.cc:927] Time spent T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 12:57:50.677170  3982 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:50.677655  3982 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:50.612257  3986 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:57:50.695323  1581 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:50.697690  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:57:50.699083  3999 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260709 12:57:50.701094  3991 log.cc:927] Time spent T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:57:50.702464  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:50.703127  3733 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:50.704136  3920 consensus_queue.cc:237] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:50.691982  3460 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:50.707502  1540 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:57:50.710711  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:50.651969  3966 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:50.726617  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:50.727972  1539 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:57:50.658821  3853 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:50.728366  1684 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
W20260709 12:57:50.693596  4004 log.cc:927] Time spent T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:57:50.732920  1537 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:50.734133  3953 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:57:50.740931  3963 raft_consensus.cc:3055] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:57:50.740450  1538 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:50.747200  3953 raft_consensus.cc:697] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:50.748205  3953 consensus_queue.cc:237] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:50.748359  3987 consensus_queue.cc:237] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:50.727486  3956 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:50.680416  3957 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:50.755699  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 73918.7us
I20260709 12:57:50.765228  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:57:50.743029  4000 log.cc:927] Time spent T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:57:50.731732  3853 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:50.768908  3984 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:50.775754  1684 raft_consensus.cc:1275] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:57:50.776258  2301 raft_consensus.cc:2393] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 3: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:57:50.745667  3963 raft_consensus.cc:740] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:50.777544  3937 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:50.788515  1537 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:57:50.793442  1542 raft_consensus.cc:1217] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 4.3->[5.4-8.6]   Dedup: 5.4->[6.5-8.6]
I20260709 12:57:50.793437  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:50.734272  3966 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:50.819149  1542 pending_rounds.cc:85] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 4
I20260709 12:57:50.809502  3947 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:50.795581  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:50.802672  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:50.789108  3937 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:50.837268  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:50.856817  3945 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:50.859673  3963 consensus_queue.cc:260] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:50.860222  3945 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:50.809716  3852 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:50.793031  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:50.838706  1542 pending_rounds.cc:107] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:57:50.809796  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:50.841506  3947 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:50.842471  3972 consensus_meta.cc:287] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.761s	user 0.011s	sys 0.000s
I20260709 12:57:50.843384  3978 consensus_queue.cc:1048] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 12:57:50.844465  4010 log.cc:927] Time spent T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:57:50.841544  3966 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:50.849997  3957 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:50.850239  1581 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:50.822758  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:50.870474  1540 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:50.794065  1533 raft_consensus.cc:1275] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:50.870756  1538 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:50.794474  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:50.862691  1537 raft_consensus.cc:2393] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 5: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:50.862613  1534 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:50.833590  3870 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:50.868252  3957 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:50.872958  3870 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:50.873296  3854 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:50.875138  3870 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:50.875566  3854 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:50.865216  1505 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:50.867651  3945 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:50.854718  1690 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:57:50.862077  1542 raft_consensus.cc:2889] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:50.891896  1505 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:50.893224  1505 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:50.876240  1686 raft_consensus.cc:1240] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:57:50.876464  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:50.895437  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:50.896260  1537 raft_consensus.cc:2393] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 8: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:50.878762  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:50.881765  2266 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:50.896845  1538 raft_consensus.cc:2368] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 8. Current term is 9.
I20260709 12:57:50.897636  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:50.898141  1538 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:50.898754  3985 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:50.899194  3985 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:50.864840  1655 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:50.899528  3985 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:50.900704  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:57:50.888331  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:50.902712  1581 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:50.904999  1655 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:50.906303  3935 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:50.906859  3935 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:50.907294  3935 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:50.908571  1655 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:50.908703  3920 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:50.909478  3921 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:50.904078  3966 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:50.909998  3921 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:50.910418  3921 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:50.902637  1534 raft_consensus.cc:2393] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 7: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:50.911744  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:50.911912  1538 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:50.906590  3933 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:50.913183  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:50.913793  1538 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:50.899466  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:57:50.914678  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:50.914884  2300 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:50.916116  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:50.916740  1538 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:50.917341  1655 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:50.921279  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:50.922302  1534 raft_consensus.cc:2393] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 6: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:50.883710  1540 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:50.904219  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:50.923328  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:50.925282  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:50.925643  1534 raft_consensus.cc:2393] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 7: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:50.925891  1541 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:50.778230  3983 consensus_queue.cc:237] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:50.924368  3809 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:57:50.877458  3852 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:50.935324  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:50.936088  1540 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:50.936334  1539 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:50.931644  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:50.933048  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:50.941386  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:50.933650  1655 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:50.927929  3738 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:50.944056  1538 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:50.945680  1533 raft_consensus.cc:1240] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:50.928005  3920 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:50.949932  1534 raft_consensus.cc:1240] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:50.927641  3945 consensus_queue.cc:1059] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:57:50.946244  1540 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:57:50.924562  3972 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:57:50.954506  1538 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 8. Current term is 9. Ops: []
I20260709 12:57:50.952999  3809 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:50.953550  1533 raft_consensus.cc:1240] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:50.962091  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:50.966351  1537 raft_consensus.cc:2393] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 3: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 12:57:50.983847  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 50302.1us
I20260709 12:57:50.964000  3966 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:50.996057  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:50.998648  1690 raft_consensus.cc:2393] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 3: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:50.996335  1655 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:51.003742  2300 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
W20260709 12:57:51.009569  4017 log.cc:927] Time spent T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:57:51.015434  3987 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:51.018605  1655 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:51.019608  3987 consensus_queue.cc:1059] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:50.981531  3968 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:51.023744  3920 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:57:51.025902  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 132766us
I20260709 12:57:51.029928  1505 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:50.976425  3956 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 3 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:51.024271  3968 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.033135  3935 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.037352  1655 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:51.040756  1505 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:57:51.025125  4013 log.cc:927] Time spent T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.267s	user 0.004s	sys 0.000s
I20260709 12:57:51.054469  1581 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:51.065729  3853 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.057298  3966 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:51.077215  3921 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:51.082679  3733 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:51.083319  3733 raft_consensus.cc:697] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:51.084359  3733 consensus_queue.cc:237] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.087589  1608 raft_consensus.cc:1275] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:57:51.056555  3958 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:51.091120  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:51.097379  1534 raft_consensus.cc:2393] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 9: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:51.098318  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:51.091426  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:51.099200  1537 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:51.099738  3947 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:51.090126  1616 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:57:51.092834  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:51.106402  1536 raft_consensus.cc:2393] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 9: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:51.093116  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:51.107563  1538 raft_consensus.cc:2393] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 6: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:51.093636  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:51.025053  3981 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:51.094388  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:57:51.094237  3956 consensus_queue.cc:1048] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:57:51.092859  3921 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:51.108770  1535 raft_consensus.cc:2393] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 8: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:51.048030  3742 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:57:51.098850  1534 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:51.112190  3937 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:51.098829  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 46627.2us
I20260709 12:57:51.132223  1655 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:51.137467  1534 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:51.137962  1691 raft_consensus.cc:1240] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 5. Current term is 6. Ops: []
W20260709 12:57:51.121932  4020 log.cc:927] Time spent T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:57:51.139711  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:51.122601  1537 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:51.115063  1541 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:57:51.141008  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:51.147779  1687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "920d24d01316479692fb62f167beb41e"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:45440
I20260709 12:57:51.148533  1687 raft_consensus.cc:606] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:51.148876  1687 raft_consensus.cc:614] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:51.114421  3981 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:51.162928  1688 raft_consensus.cc:2393] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 4: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:51.149714  4026 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:51.156709  3982 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.163972  3971 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:57:51.077986  3985 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:51.128326  3957 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:51.180446  1581 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:51.183823  2301 raft_consensus.cc:2368] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 7. Current term is 8.
I20260709 12:57:51.187016  1581 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:51.190974  1505 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:51.191004  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:57:51.192370  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 60249.2us
I20260709 12:57:51.192617  1505 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:57:51.193198  1655 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:51.194591  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:51.195231  1610 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:51.196704  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:51.182324  3971 raft_consensus.cc:697] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 8 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:51.216958  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:51.217159  3971 consensus_queue.cc:237] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.225657  3982 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:51.225893  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:51.193813  4029 raft_consensus.cc:2764] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:57:51.227275  1613 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 8. Current term is 9. Ops: []
I20260709 12:57:51.228536  1689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:45440
I20260709 12:57:51.229355  1689 raft_consensus.cc:606] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:51.229725  1689 raft_consensus.cc:614] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:51.232929  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:51.233111  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:51.233660  1617 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:57:51.233752  1690 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:51.234126  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:51.234826  1542 raft_consensus.cc:2393] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 5: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:51.204432  3852 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:51.193508  3954 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:51.168651  4026 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.194885  3937 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:51.206295  3985 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:51.263306  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 70192.5us
I20260709 12:57:51.264025  1655 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:51.194427  3742 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:57:51.213184  4023 log.cc:927] Time spent T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.232s	user 0.002s	sys 0.001s
I20260709 12:57:51.213554  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:51.214130  3987 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:57:51.241802  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 44469.1us
I20260709 12:57:51.262686  1609 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:57:51.266331  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:51.272876  1690 raft_consensus.cc:2393] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 6: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:51.268524  1687 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:51.271242  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:51.271911  1505 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
W20260709 12:57:51.276528  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:51.277236  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:51.261708  3878 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:51.279163  1655 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:51.286478  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:51.276465  3979 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:51.287905  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:51.288079  3979 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.290748  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:51.291417  1613 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:51.292335  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:51.292925  1613 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:51.293982  1613 raft_consensus.cc:1240] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:51.294847  1582 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:51.297032  1654 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:51.297104  3965 consensus_queue.cc:1059] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:57:51.265692  3742 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:51.304836  1615 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:57:51.307209  1690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:45440
I20260709 12:57:51.307883  1690 raft_consensus.cc:606] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:51.308256  1690 raft_consensus.cc:614] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:51.271030  3854 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:51.273018  3950 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:51.314822  1505 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:51.319213  1583 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:51.322494  1655 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:51.331429  1655 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:51.331213  4049 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:57:51.308913  3987 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:57:51.310846  3742 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:51.298422  3937 raft_consensus.cc:697] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:51.312709  3983 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:51.351555  1611 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:57:51.345366  4027 raft_consensus.cc:2764] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:57:51.349001  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 54232.6us
I20260709 12:57:51.343436  1614 raft_consensus.cc:1240] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:51.353772  1505 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:51.312297  3954 raft_consensus.cc:697] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:51.357625  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:51.363354  1690 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:51.306838  3878 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:51.396134  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 76981.5us
I20260709 12:57:51.397161  1583 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:51.401681  4027 consensus_queue.cc:1059] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:51.403406  4027 raft_consensus.cc:3055] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:51.403800  4027 raft_consensus.cc:740] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:51.404898  4027 consensus_queue.cc:260] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.406230  4027 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:51.411041  4029 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:51.411646  4029 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.412621  4037 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:51.413324  4037 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.413921  4029 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:51.415738  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:51.416613  1612 raft_consensus.cc:2393] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 7: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:51.420588  4028 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:51.421305  4028 raft_consensus.cc:697] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:51.422256  4028 consensus_queue.cc:237] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:51.425010  3989 log.cc:927] Time spent T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.986s	user 0.004s	sys 0.000s
I20260709 12:57:51.426498  4011 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:57:51.428115  4011 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:57:51.440361  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:51.444859  3980 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:51.445248  3733 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:51.339944  3951 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 12:57:51.444900  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 47833.1us
I20260709 12:57:51.316202  3854 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.463133  1583 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:51.433249  3937 consensus_queue.cc:237] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.455991  1687 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 8.
I20260709 12:57:51.365911  3966 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:51.393447  3490 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:57:51.481133  1610 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:57:51.316771  3950 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.396349  3945 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:51.493021  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:51.488026  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:51.496091  1687 raft_consensus.cc:2393] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 6: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:51.497394  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:51.500286  3972 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:51.502808  4025 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:57:51.506850  4041 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:57:51.508344  3854 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:51.512054  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:51.513077  3954 consensus_queue.cc:237] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.513737  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:51.487227  3981 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.357627  3953 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:51.517381  3878 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:51.512130  4037 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:51.517385  4047 log.cc:927] Time spent T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.197s	user 0.003s	sys 0.000s
I20260709 12:57:51.518757  1508 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:57:51.521891  1583 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:51.523522  1690 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:51.524534  1687 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:57:51.554235  4052 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:51.557344  4056 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:57:51.568950  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 270771us
I20260709 12:57:51.352027  3983 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:51.491813  3945 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:51.475881  3951 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.362416  3987 raft_consensus.cc:697] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:51.475361  3733 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:51.654305  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 132518us
W20260709 12:57:51.657116  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 138451us
I20260709 12:57:51.640765  1611 raft_consensus.cc:1240] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8. Ops: []
W20260709 12:57:51.576256  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 244927us
I20260709 12:57:51.575795  3965 consensus_queue.cc:1243] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer c262eac7fc904ae9bb91e450f6532e3f log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:57:51.659334  1655 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:51.654780  3945 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:51.639910  3983 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:51.658857  3947 raft_consensus.cc:2804] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:51.563702  3972 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.667106  1689 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:51.669787  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:51.671605  4060 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:51.671962  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:51.676685  3951 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:51.679822  3738 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:57:51.661621  4037 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:51.690945  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:51.656674  3966 raft_consensus.cc:697] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 5 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:51.685983  1655 leader_election.cc:400] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 8. Current term is 9.
I20260709 12:57:51.697700  1655 leader_election.cc:403] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:57:51.689895  1687 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:51.657769  3953 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.719616  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1262) took 1414 ms. Trace:
I20260709 12:57:51.721356  1686 rpcz_store.cc:276] 0709 12:57:50.278590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:50.286237 (+  7647us) service_pool.cc:224] Handling call
0709 12:57:50.286556 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:50.894143 (+607587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:51.682711 (+788568us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b5400299fd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:51.693119 (+ 10408us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1355659136}
I20260709 12:57:51.726348  4056 raft_consensus.cc:697] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:57:51.726811  4039 log.cc:927] Time spent T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:57:51.727010  3853 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:51.727383  4056 consensus_queue.cc:237] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.730561  3980 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:51.689971  3947 raft_consensus.cc:697] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:51.753281  3947 consensus_queue.cc:237] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:51.758734  3963 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:51.680430  3738 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:51.763109  3738 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:51.762693  3742 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:51.748358  4011 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:51.764807  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:51.765949  3849 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:51.766500  3849 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:51.767149  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:51.768834  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:51.769554  1610 raft_consensus.cc:2393] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 8: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:51.739814  3935 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:51.770684  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:51.776754  3945 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.749472  3950 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:51.750531  3981 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:51.789261  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:51.790115  1614 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 8.
I20260709 12:57:51.692680  4060 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.778209  4025 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:51.779898  3953 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:51.742942  4026 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:51.804674  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:57:51.805487  1614 raft_consensus.cc:606] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:51.805907  1614 raft_consensus.cc:614] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:51.791870  3738 consensus_queue.cc:1059] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:57:51.807672  3870 raft_consensus.cc:3055] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:57:51.782907  3849 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:51.783187  3733 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:51.808095  3870 raft_consensus.cc:740] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:51.809079  3870 consensus_queue.cc:260] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.810302  3870 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:51.752161  3920 raft_consensus.cc:3055] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:51.812775  3920 raft_consensus.cc:740] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:51.813710  3920 consensus_queue.cc:260] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.817701  3742 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:51.821902  3983 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.823189  1686 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:57:51.825008  4060 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:51.830195  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 160988us
I20260709 12:57:51.789219  3935 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:51.834622  1508 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:51.840370  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:51.841997  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:51.844077   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:57:51.857019  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:51.858232  4052 raft_consensus.cc:697] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 5 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:51.860682  1689 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:57:51.842782  3742 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:51.844252  4025 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:51.842182  3935 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.793891  3987 consensus_queue.cc:237] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.884907  3983 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:51.885411  3968 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:51.867458  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:51.868994  3945 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:51.885874  4037 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:51.877593  3935 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:51.878931  1616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1250) took 1743 ms (client timeout 2016 ms). Trace:
W20260709 12:57:51.919832  1616 rpcz_store.cc:269] 0709 12:57:50.135021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:50.137026 (+  2005us) service_pool.cc:224] Handling call
0709 12:57:51.878702 (+1741676us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b5400447ad4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:51.878831 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1426649984}
W20260709 12:57:51.924724  4038 log.cc:927] Time spent T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.604s	user 0.006s	sys 0.000s
I20260709 12:57:51.886300  4025 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:51.926292  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:51.928016  1689 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:51.856087  3966 consensus_queue.cc:237] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.937976  1683 raft_consensus.cc:3055] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:57:51.938501  1683 raft_consensus.cc:740] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:51.859264  4052 consensus_queue.cc:237] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.942375  1689 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:57:51.939306  1683 consensus_queue.cc:260] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.945945  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:51.946108  1683 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:51.946738  1689 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:51.941155  3935 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:51.951679  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:51.952854  1689 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:51.953807  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:51.958166  3972 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:51.951851  3935 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.963106  3935 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:51.970870  3748 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:57:51.971524  3748 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:51.973795  3748 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:51.978960  1507 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:51.983603  1583 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:51.984582  1583 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:51.985409  1583 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:51.986646  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:51.987349  2300 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:57:51.987536  4030 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:57:51.988189  4030 raft_consensus.cc:697] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:51.989323  3809 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:57:51.989151  4030 consensus_queue.cc:237] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.989874  3809 raft_consensus.cc:697] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 12:57:51.990902  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 320947us
I20260709 12:57:51.991782  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:57:51.995416  1687 raft_consensus.cc:1240] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:51.995515  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:51.994850  1508 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:51.997221  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:51.997861  1687 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:51.999914  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:52.001495  4064 consensus_queue.cc:1059] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:57:52.001957  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 316154us
I20260709 12:57:52.002401  4064 consensus_queue.cc:1243] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer c262eac7fc904ae9bb91e450f6532e3f log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:57:52.002758  1655 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:52.003376  4064 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 8. Current term is 9.
I20260709 12:57:52.004073  4064 raft_consensus.cc:3055] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:52.004675  3854 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:57:51.987476  3972 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:57:52.005653  3972 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:52.006078  3972 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:52.006740  3965 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 12:57:52.005878  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:52.004834  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:52.008124  1656 leader_election.cc:400] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Vote denied by peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437) with higher term. Message: Invalid argument: T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 7. Current term is 8.
I20260709 12:57:51.987768  4057 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:51.988396  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:52.008226  1686 raft_consensus.cc:2393] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 8: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:52.009014  3965 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:52.010748  4068 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:52.011346  3965 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:52.012892  1655 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:52.008459  1656 leader_election.cc:403] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:57:52.014353  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:51.998608  1583 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:52.022151  1533 raft_consensus.cc:1240] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:52.024786  1683 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 12:57:52.025241  1683 pending_rounds.cc:85] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 6
I20260709 12:57:52.025566  1683 pending_rounds.cc:107] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:57:52.025939  1683 raft_consensus.cc:2889] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:52.028826  1508 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:52.026036  3968 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:52.032131  3968 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:52.032521  3968 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:52.037671  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:52.037829  3971 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:52.038393  1686 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
W20260709 12:57:52.040086  4048 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:57:52.043542  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:52.044075  1583 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:52.045737  3963 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:57:52.048182  4034 log.cc:927] Time spent T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.787s	user 0.003s	sys 0.000s
I20260709 12:57:52.050148  4057 raft_consensus.cc:697] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:52.051091  4057 consensus_queue.cc:237] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:51.990870  3809 consensus_queue.cc:237] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:57:52.052682  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 44709.5us
I20260709 12:57:52.004391  4064 raft_consensus.cc:740] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:52.054548  3920 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:52.057077  3854 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437) with higher term. Message: Invalid argument: T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 7. Current term is 8.
I20260709 12:57:52.026258  3742 consensus_queue.cc:1059] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:57:52.059204  3742 raft_consensus.cc:3055] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:52.059554  3742 raft_consensus.cc:740] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:52.019552  3935 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:57:52.055478  4043 log.cc:927] Time spent T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.721s	user 0.003s	sys 0.000s
I20260709 12:57:52.011410  4068 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:52.019640  3748 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:52.064805  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:52.066546  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:52.066682  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 53887.9us
I20260709 12:57:52.067919  1508 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:52.061947  1583 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:52.066006  3935 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:52.065404  3742 consensus_queue.cc:260] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:52.086476  1686 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 8.
I20260709 12:57:52.087524  1687 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:57:52.083724  1655 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:52.090545  1540 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:57:52.056944  3946 consensus_queue.cc:1059] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:57:52.069622  3984 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:57:52.094007  1687 raft_consensus.cc:1240] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:57:52.094251  1655 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:52.087128  1505 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 2.016s (SENT) [suppressed 36 similar messages]
I20260709 12:57:52.095763  1655 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:52.097517  1583 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:52.098670  1583 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:52.099917  1655 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:52.069504  3854 raft_consensus.cc:2764] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:57:52.106609  1540 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 8.
I20260709 12:57:52.086149  3935 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:52.038417  3971 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:52.112859  1655 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:52.089977  4027 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:52.115168  1655 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:52.116251  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:52.119474  1542 raft_consensus.cc:2393] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 8: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:52.116902  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:52.120507  1533 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:52.121678  1542 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:57:52.122869  4059 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:57:52.125535  4063 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:52.125952  1655 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:52.112329  3953 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:52.126951  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:52.127592  1686 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:52.097369  3984 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:52.131393  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:52.104626  4030 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:57:52.132647  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 45544.8us
I20260709 12:57:52.133803  1538 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:57:52.134313  1539 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:57:52.135614  1583 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:52.107331  4048 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:52.110663  3742 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:52.107522  3965 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:52.110283  4031 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:52.110488  4049 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:57:52.142562  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:52.113618  3979 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:52.131170  3987 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:52.110111  3950 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:57:52.119963  3966 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:52.126318  4063 consensus_queue.cc:1059] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:57:52.112743  3738 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.133316  4026 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:52.140831  3984 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:52.157160  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:52.165050  1537 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:57:52.130868  3968 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:52.133563  4056 consensus_queue.cc:1059] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:57:52.153185  4031 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:52.170054  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:52.171118  1655 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:52.153014  3981 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:52.152835  3921 consensus_queue.cc:1059] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:57:52.182444  3921 raft_consensus.cc:3055] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:52.182862  3921 raft_consensus.cc:740] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:52.183660  3921 consensus_queue.cc:260] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:52.169996  3738 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:52.186806  3738 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:52.187331  3748 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:52.131533  2269 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:57:52.188827  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 76462.5us
I20260709 12:57:52.189316  3968 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:52.187253  1538 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:57:52.174080  3981 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:52.195385  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:52.195847  3981 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:52.195446  1541 raft_consensus.cc:1275] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:57:52.197369  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:52.190152  3956 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:57:52.198151  3956 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:52.198520  3956 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:52.198889  1541 raft_consensus.cc:1275] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:57:52.199230  3972 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:52.200165  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:52.202965  2267 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:52.205535  3971 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:52.206853  1691 raft_consensus.cc:1275] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:52.207971  4068 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:52.210305  1536 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:57:52.217653  1541 raft_consensus.cc:1275] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:57:52.218572  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:52.219604  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:52.220395  2299 raft_consensus.cc:2368] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8.
I20260709 12:57:52.222131  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:52.222885  1536 raft_consensus.cc:2393] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 8: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:52.223656  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:52.208689  3648 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:57:52.224444  1536 raft_consensus.cc:2410] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:57:52.225258  1507 leader_election.cc:400] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437) with higher term. Message: Invalid argument: T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8.
I20260709 12:57:52.225574  1507 leader_election.cc:403] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:57:52.225948  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:52.226101  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:52.226554  1536 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:52.227327  1533 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:52.225042  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:52.229131  1541 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:52.169658  3987 raft_consensus.cc:697] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:52.233636  3987 consensus_queue.cc:237] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:52.197716  4025 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:52.238498  4025 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.238981  4025 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:52.239580  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:52.167482  4026 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:52.242269  4026 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:52.190161  4063 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:52.245213  1615 raft_consensus.cc:1275] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:57:52.245640  4063 raft_consensus.cc:697] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 7 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:52.246579  4063 consensus_queue.cc:237] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:52.249416  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:52.175419  4031 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:52.252589  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:52.252913  1581 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:52.256577  1612 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:52.257064  1617 raft_consensus.cc:1240] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:52.262485  1608 raft_consensus.cc:1275] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:57:52.264099  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:52.261050  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:52.267701  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:52.268261  1609 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:52.224247  4030 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:52.277117  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:52.282370  1539 raft_consensus.cc:1275] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:57:52.283897  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:52.290023  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:52.291357  1536 raft_consensus.cc:2393] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 8: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:52.244277  3968 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.331027  1612 raft_consensus.cc:1275] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:57:52.349984  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 69065.1us
I20260709 12:57:52.353195  3980 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:52.270874  3979 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:52.376652  4025 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:52.379283  3953 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:52.380209  3968 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:52.382722  3968 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:52.385042  3972 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:52.275425  3880 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 12:57:52.389216  3981 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:52.391705  3981 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:52.392810  3978 consensus_queue.cc:1059] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:57:52.286998  3921 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:52.396703  4027 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:52.397816  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:52.404909  1538 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 8.
W20260709 12:57:52.405155  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 53682.2us
I20260709 12:57:52.406047  1581 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:52.407475  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:52.410153  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:52.410775  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:52.411240  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:52.411378  1687 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:52.413663  1655 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:52.421027  1655 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:52.482723  1537 raft_consensus.cc:1240] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:57:52.493433  1538 raft_consensus.cc:1240] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:52.448062  4072 consensus_queue.cc:1048] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:57:52.496645  3950 consensus_queue.cc:1048] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:52.498006  1581 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:52.425393  3880 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:57:52.423561  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:52.496531  4081 log.cc:927] Time spent T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:57:52.372272  3984 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:52.424247  3965 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:57:52.504885  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:52.508044  1616 raft_consensus.cc:2368] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 8. Current term is 9.
I20260709 12:57:52.446115  4056 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:57:52.424983  3920 consensus_queue.cc:1048] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 12:57:52.404984  3935 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:52.523828  1687 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:57:52.499408  4076 consensus_queue.cc:1048] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:57:52.424053  3971 consensus_queue.cc:1048] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 12:57:52.455369  4075 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:52.499249  4031 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:52.493666  3966 consensus_queue.cc:1059] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:57:52.519228  3979 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:52.535334  1611 raft_consensus.cc:2393] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 7: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 12:57:52.533250  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 183866us
I20260709 12:57:52.532264  3984 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:52.527768  3648 consensus_queue.cc:1059] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:57:52.588752  3965 raft_consensus.cc:3055] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:57:52.620308  1617 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:57:52.619061  3965 raft_consensus.cc:740] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:52.626848  3980 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:52.642975  4031 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:52.644411  3956 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:52.656754  1583 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:52.645198  3935 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:52.651947  1690 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:57:52.652863  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:57:52.636536  4007 log.cc:927] Time spent T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.999s	user 0.004s	sys 0.005s
I20260709 12:57:52.661711  1684 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:52.649654  4063 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:52.663374  3880 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:57:52.674355  1684 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:57:52.670852  4063 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:52.675485  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:52.676066  1684 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:52.678198  4063 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:52.682088  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:52.686049  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:52.686695  1687 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:57:52.695398  1684 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:57:52.699141  4037 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:52.699821  4037 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:52.702083  4037 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:52.702527  3935 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:52.703070  3935 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:52.705521  3935 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:52.711364  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:52.712123  1690 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:52.713886  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:52.714524  4064 consensus_queue.cc:260] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:52.715588  4064 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:52.717821  3870 raft_consensus.cc:3055] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:52.718292  3870 raft_consensus.cc:740] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:52.719123  3870 consensus_queue.cc:260] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:52.717756  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:52.720865  1690 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:52.721993  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:52.722498  1612 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:57:52.729254  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:52.728317  1612 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 9.
I20260709 12:57:52.731545  1687 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:52.680397  3880 raft_consensus.cc:697] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:52.733408  3956 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:52.760731  4078 log.cc:927] Time spent T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.528s	user 0.000s	sys 0.005s
I20260709 12:57:52.743899  3880 consensus_queue.cc:237] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:52.795622  1690 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 9.
I20260709 12:57:52.811651  2269 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:52.812767  4087 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:57:52.814184  4087 raft_consensus.cc:697] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 9 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:57:52.815299  4087 consensus_queue.cc:237] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:57:52.818846  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:52.795347  3957 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.005s	sys 0.022s
W20260709 12:57:52.825838  3957 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.006s	sys 0.022s
I20260709 12:57:52.821885  1654 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:52.831086  3920 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:52.831928  3920 consensus_queue.cc:1048] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:52.833601  3920 consensus_queue.cc:1048] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:52.835706  1437 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54606 (request call id 143) took 8544 ms. Trace:
I20260709 12:57:52.849236  3965 consensus_queue.cc:260] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:52.847332  1437 rpcz_store.cc:276] 0709 12:57:44.291486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:44.291653 (+   167us) service_pool.cc:224] Handling call
0709 12:57:52.835628 (+8543975us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:50.560701 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:50.561254 (+   553us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:50.561286 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:57:50.561302 (+    16us) tablet.cc:662] Decoding operations
0709 12:57:50.706440 (+145138us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:50.706535 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:50.706563 (+    28us) tablet.cc:685] Acquiring locks for 29 operations
0709 12:57:50.708903 (+  2340us) tablet.cc:701] Row locks acquired
0709 12:57:50.708919 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:57:50.709074 (+   155us) write_op.cc:270] Start()
0709 12:57:50.709205 (+   131us) write_op.cc:276] Timestamp: P: 1783601870709022 usec, L: 0
0709 12:57:50.709231 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:57:50.710008 (+   777us) log.cc:844] Serialized 11571 byte log entry
0709 12:57:50.858307 (+148299us) op_driver.cc:464] REPLICATION: finished
0709 12:57:50.939173 (+ 80866us) write_op.cc:301] APPLY: starting
0709 12:57:50.943208 (+  4035us) tablet.cc:1367] starting BulkCheckPresence
0709 12:57:50.992857 (+ 49649us) tablet.cc:1370] finished BulkCheckPresence
0709 12:57:51.005254 (+ 12397us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:57:51.029964 (+ 24710us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:57:51.068809 (+ 38845us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=29
0709 12:57:51.068869 (+    60us) write_op.cc:312] APPLY: finished
0709 12:57:51.069443 (+   574us) log.cc:844] Serialized 193 byte log entry
0709 12:57:51.069643 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:51.069898 (+   255us) write_op.cc:454] Released schema lock
0709 12:57:51.069988 (+    90us) write_op.cc:341] FINISH: Updating metrics
0709 12:57:51.070454 (+   466us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:51.070485 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1939470,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":69133,"apply.run_cpu_time_us":7325,"apply.run_wall_time_us":135093,"num_ops":29,"prepare.queue_time_us":375994,"prepare.run_cpu_time_us":28466,"prepare.run_wall_time_us":220739,"raft.queue_time_us":12672,"raft.run_cpu_time_us":45501,"raft.run_wall_time_us":69404,"replication_time_us":148919,"thread_start_us":427396,"threads_started":4,"wal-append.queue_time_us":109928,"wal-append.run_cpu_time_us":5842,"wal-append.run_wall_time_us":1265026}]]}
I20260709 12:57:52.850383  3965 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:52.851882  1689 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:57:52.836163   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 12:57:52.858137  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:52.861174  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:52.862175  1690 raft_consensus.cc:2368] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8.
I20260709 12:57:52.863169  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:52.869652  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:52.870477  1691 raft_consensus.cc:2393] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 7: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:52.837141  1440 catalog_manager.cc:5697] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 5 to 9, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:57:52.875085  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 1529) took 1551 ms. Trace:
I20260709 12:57:52.843132  1583 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:52.844586  4025 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:52.875536  1688 rpcz_store.cc:276] 0709 12:57:51.314789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:51.513475 (+198686us) service_pool.cc:224] Handling call
0709 12:57:52.865536 (+1352061us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b5400388954. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:52.865707 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1334065024}
W20260709 12:57:52.887302  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 44278.8us
W20260709 12:57:52.888078  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 662973us
I20260709 12:57:52.889704  1583 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:52.904301  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:52.905907  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:52.906659  1541 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:52.868652  3933 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:52.919647  3958 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.908646  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:52.925494  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:52.923856  1536 raft_consensus.cc:1275] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:57:52.925177  2267 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:52.931003  1541 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:57:52.931771  4087 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:57:52.890470  4028 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437) with higher term. Message: Invalid argument: T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8.
I20260709 12:57:52.932588  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:52.890199  3935 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:57:52.934219  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:52.935463  1540 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:52.935741  1541 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:52.936739  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:52.937443  1540 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:52.938300  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:52.938427  1583 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:52.938848  1540 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:52.935413  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:52.939976  1538 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:52.924008  4011 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:57:52.946812  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:52.947795  1536 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:52.944324  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:52.948602  1535 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:52.949823  1583 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:52.950883  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:57:52.952291  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:52.945748  1541 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:57:52.957901  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:52.934978  3945 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:52.959779  1540 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:52.961024  1533 raft_consensus.cc:2393] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 6: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:52.936410  4026 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:52.945748  4087 raft_consensus.cc:697] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 8 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:57:52.967875  1535 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:57:52.925969  3933 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:52.968374  3935 raft_consensus.cc:697] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:52.973898  3935 consensus_queue.cc:237] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:52.957664  4031 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:52.976739  4031 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:52.977012  1581 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:52.971637  3979 consensus_queue.cc:1048] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:57:52.934453  3958 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:52.970342  4011 raft_consensus.cc:697] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:52.971541  3953 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:52.980751  1615 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:52.959158  3978 raft_consensus.cc:3055] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:57:52.992170  1505 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:52.973822  3933 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:52.996189  1683 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:57:52.996528  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:52.977149  4031 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:53.000192  1542 raft_consensus.cc:2393] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 8: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:52.999374  1535 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:52.990495  3460 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.016724  3460 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.019040  3460 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:52.990324  3742 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.020457  1689 raft_consensus.cc:1275] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:53.023813  1654 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:52.998205  3946 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.027079  1654 leader_election.cc:400] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 8. Current term is 9.
I20260709 12:57:53.027453  1654 leader_election.cc:403] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:57:52.967031  3945 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.028451  1535 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 9.
I20260709 12:57:52.968612  4026 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:52.997179  3978 raft_consensus.cc:740] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:57:53.034991  1583 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:52.994695  4028 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.994656  3738 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.022957  3852 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.032644  2301 raft_consensus.cc:1275] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:57:53.020689  4059 raft_consensus.cc:3055] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:53.029933  4100 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:57:53.026060  3880 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:57:53.039106  1581 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:53.041766  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:53.031622  4063 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 8. Current term is 9.
I20260709 12:57:53.033324  3953 raft_consensus.cc:697] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:53.047576  1683 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:57:53.032096  4052 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:53.035880  4068 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.045753  1536 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:53.051364  1535 raft_consensus.cc:1240] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:57:53.028012  4076 consensus_queue.cc:1048] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:57:53.055863  2301 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:57:53.038767  4059 raft_consensus.cc:740] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:57:53.053805  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 60277.8us
I20260709 12:57:53.049619  3733 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:53.029219  3742 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.029752  3946 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.055073  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:53.071978  3946 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:53.068898  1505 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:53.055440  3880 raft_consensus.cc:697] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:53.038476  3738 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.042943  3852 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.052949  4030 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:57:53.042560  4028 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.031424  4087 consensus_queue.cc:237] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:53.052901  3460 consensus_queue.cc:1048] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
W20260709 12:57:53.114684  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 45898.4us
W20260709 12:57:53.114858  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 75840.9us
I20260709 12:57:53.115480  1581 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:53.064749  4068 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.125020  1505 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
W20260709 12:57:53.126586  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:53.114027  4105 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:57:53.049324  4011 consensus_queue.cc:237] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.152801  3955 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:53.153299  3955 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:53.153662  3955 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:53.154861  4105 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.155812  1508 leader_election.cc:400] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8.
I20260709 12:57:53.158685  1581 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:53.122789  3981 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:53.118352  3946 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:57:53.118669  3972 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.118531  3748 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:53.163239  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:53.149153  4103 log.cc:927] Time spent T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:57:53.122673  4076 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:53.142356  3809 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:57:53.151268  3733 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:53.162879  3981 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:53.176856  1508 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:53.116812  3953 consensus_queue.cc:237] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.169623  4100 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.185065  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:53.169910  3958 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:53.172070  3742 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:53.155396  4105 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.111714  3978 consensus_queue.cc:260] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:53.160403  4059 consensus_queue.cc:260] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.211560  4059 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:53.186360  3945 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:53.201463  4100 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.215307  4100 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:53.188690  4113 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.182940  3981 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:53.216347  4113 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.217471  3852 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:53.218842  4113 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:53.173488  4076 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.220700  4027 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:53.222358  4076 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:53.223034  4109 log.cc:927] Time spent T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:57:53.193794  1533 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:57:53.170598  3748 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.173744  4110 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 12:57:53.211153  3965 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.235370  3748 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:53.235702  3957 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:53.236301  3957 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.237102  3870 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:53.237833  3981 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.238642  3957 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:53.235409  3965 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.239952  3981 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:53.207330  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:53.181613  3809 raft_consensus.cc:697] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 12:57:53.197096  4096 log.cc:927] Time spent T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:57:53.186000  3980 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:53.209411  3738 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:53.210403  4105 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:53.170006  3880 consensus_queue.cc:237] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:53.191145  4095 log.cc:927] Time spent T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.259s	user 0.002s	sys 0.000s
I20260709 12:57:53.223471  4031 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.171162  3972 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:53.191255  4028 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:53.285173  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:53.253388  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:53.286834  1541 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:53.179497  3733 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.201898  4026 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:53.291096  4111 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.293272  4068 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:53.295001  4105 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:53.296043  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:53.286046  1539 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:53.252046  3980 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:53.303129  3972 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:53.304913  3809 consensus_queue.cc:237] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.315101  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:53.329772  1542 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:57:53.334570  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:53.340838  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:53.326529  3921 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:53.358191  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 181420us
I20260709 12:57:53.327291  3980 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:57:53.325444  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 125912us
I20260709 12:57:53.361096  1533 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:57:53.371219  1608 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:57:53.324908  4076 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.325331  4111 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:53.403662  1615 raft_consensus.cc:1240] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:53.402374  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:53.406472  1616 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:57:53.407698  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1543) took 1280 ms. Trace:
I20260709 12:57:53.327677  4105 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.409695  1609 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:57:53.408360  1614 raft_consensus.cc:1275] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:57:53.412849  1608 raft_consensus.cc:1275] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:57:53.408164  1534 rpcz_store.cc:276] 0709 12:57:52.115045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:52.117423 (+  2378us) service_pool.cc:224] Handling call
0709 12:57:52.117706 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:52.117907 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:57:52.118159 (+   252us) log.cc:844] Serialized 14 byte log entry
0709 12:57:52.855388 (+737229us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b1800371560. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859edec0a 00007fc86361e219 00007fc859f66a40 00007fc859f614e4 00007fc859f61455 00007fc85d049060 00007fc85d05b716 00007fc85d06c287 00007fc85d06c208
0709 12:57:53.313425 (+458037us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b1800371560. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc85cbf94bc 00007fc859f4748b 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f61455 00007fc860a493c7 00007fc85d05b9a7 00007fc85d06b0bf
0709 12:57:53.333563 (+ 20138us) log.cc:844] Serialized 14 byte log entry
0709 12:57:53.395371 (+ 61808us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:53.395417 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:53.395456 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:53.395517 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:53.395607 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19228,"prepare.queue_time_us":114133,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":77,"raft.queue_time_us":741348,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":12189,"spinlock_wait_cycles":18635264,"thread_start_us":91757,"threads_started":2}
W20260709 12:57:53.435214  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:53.324348  1541 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:53.553105  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:53.415319  1611 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:57:53.464104  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 49138.1us
W20260709 12:57:53.420706  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 268750us
I20260709 12:57:53.570489  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:53.575840  1610 raft_consensus.cc:2393] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 8: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:53.572873  1538 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:53.557626  1542 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:57:53.551671  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:53.581974  1542 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:57:53.583858  1539 raft_consensus.cc:2393] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 6: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 12:57:53.461625  4115 log.cc:927] Time spent T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:57:53.587909  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:53.588723  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:53.588613  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:53.389731  3921 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:53.407596  4026 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.349s
I20260709 12:57:53.441437  3870 consensus_queue.cc:1048] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.337s
I20260709 12:57:53.516968  4118 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.899979  1582 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:53.722611  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:53.648013  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:53.934834  1533 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:53.900066  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:53.935801  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:53.936592  1617 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:57:53.750480  1539 raft_consensus.cc:1240] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:57:53.774212  1610 raft_consensus.cc:1240] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:53.772889  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:53.941617  1608 raft_consensus.cc:2376] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8. Re-sending same reply.
I20260709 12:57:53.942133  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:53.591753  1538 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:57:53.916132   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:53.484844  4059 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:53.810091  4083 log.cc:927] Time spent T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 12:57:53.454548  3965 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:53.938838  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:53.581780  4068 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.942729  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:53.944325  1538 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:57:53.954584  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:53.900126  3972 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.945436  1614 raft_consensus.cc:2393] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 7: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 12:57:53.906391  3880 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.037s	sys 0.026s
I20260709 12:57:53.415302  4076 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:53.923198  3953 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.024s	sys 0.044s
I20260709 12:57:53.580590  3733 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:53.487973  3955 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.942790  1610 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:53.587298  4028 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.755308  4120 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.859279  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:53.703995  4064 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.951105  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:53.807549  4105 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:53.984333  4120 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.985073  1610 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:57:53.986495  1612 raft_consensus.cc:1240] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:53.987718  3955 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:53.958559  3921 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:53.988847  3921 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:53.989094  4120 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:53.976346  3953 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.025s	sys 0.045s
I20260709 12:57:53.955996  1538 raft_consensus.cc:1275] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:57:53.898459  4087 consensus_queue.cc:1059] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
W20260709 12:57:53.969791  3880 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.037s	sys 0.027s
I20260709 12:57:53.990314  1536 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:57:53.957571  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:53.956993  3965 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:53.787581  3980 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.954500  4059 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.944900  4118 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.957386  4068 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.975610  3972 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.996502  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:57:53.998351  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 423118us
W20260709 12:57:54.409854  1541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.011s	sys 0.023s
W20260709 12:57:54.430709  1541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.011s	sys 0.025s
I20260709 12:57:54.046002  1616 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:54.431216  4143 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:54.432081  4143 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:54.430161  1538 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:54.432593  4146 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:54.180186  4076 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:54.433441  4076 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:54.433985  4076 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:54.433354  4146 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:54.434664  4143 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:54.435338  4143 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:54.435827  4143 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:54.453622  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:54.436188  4076 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:54.436976  1542 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 12:57:54.341414  1534 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.003s	sys 0.007s
W20260709 12:57:54.438340  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 538471us
I20260709 12:57:54.458017  1533 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:57:54.439198  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:54.460132  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:54.441663  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 333950us
I20260709 12:57:54.442741  1536 raft_consensus.cc:1240] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:53.988433  3955 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:57:54.279626  4107 log.cc:927] Time spent T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 1.044s	user 0.005s	sys 0.007s
I20260709 12:57:54.490782  1613 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:57:54.466503  1538 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
W20260709 12:57:54.495916  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:54.490849  1534 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.005s	sys 0.013s
I20260709 12:57:53.990190  4028 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:54.513069  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:54.513761  1690 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:54.515480  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:54.516114  1690 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:57:54.496248  1538 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:54.222922  4136 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:54.460949  3742 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:54.501606  4146 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:54.445916  3947 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:54.517604  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:57:54.518208  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:54.631099  1533 raft_consensus.cc:1275] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:57:53.991900  4064 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:54.520910   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:54.522698  1538 raft_consensus.cc:3055] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:57:54.636056  1538 raft_consensus.cc:740] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:54.530011  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:54.491626  4104 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:53.993762  3921 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:53.993963  4126 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.496s
I20260709 12:57:54.029273  3965 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:54.642261  1540 raft_consensus.cc:1240] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:54.636873  1538 consensus_queue.cc:260] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:54.519025  4076 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:54.651206  1538 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:54.532588  4105 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:54.661828  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:54.662145  1533 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:57:54.662751  1687 raft_consensus.cc:2393] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 6: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 12:57:54.660589  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 222537us
I20260709 12:57:54.633091  3981 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:54.629146  3880 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:54.670305  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:54.625841  4120 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:57:54.660494  4148 log.cc:927] Time spent T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.229s	user 0.002s	sys 0.000s
I20260709 12:57:54.635527  4146 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:54.699736  1682 raft_consensus.cc:2393] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 9: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 12:57:54.680789  4123 log.cc:927] Time spent T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 12:57:54.716259  1538 raft_consensus.cc:1275] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:57:54.653544  3953 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:54.629971  3742 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:54.744233  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:57:54.717411  4011 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.480s	user 0.023s	sys 0.049s
I20260709 12:57:54.751174  1690 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:57:54.680830  4143 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:54.634250  4136 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:54.640681  3947 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:54.670955  4076 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:54.751994  4011 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.515s	user 0.023s	sys 0.049s
I20260709 12:57:54.740322  4137 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:54.701066  3981 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:54.681608  4105 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:54.729460  3956 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:57:54.655239  4104 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:54.740733  4120 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:54.816363  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:54.718267  3880 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:54.817382  1614 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:54.815438  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:54.820322  1690 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:54.743242  3953 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:54.741824  4146 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:54.784096  4156 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:54.833159  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:54.784793  3984 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 12:57:54.814296  4139 log.cc:927] Time spent T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.487s	user 0.001s	sys 0.000s
W20260709 12:57:54.821903  2267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:54.820992  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 189806us
I20260709 12:57:54.828437  1690 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:57:54.910360  3984 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:54.829147  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:54.830560  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:54.912794  1617 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:57:54.887075  4154 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:54.830093  4059 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:54.811237  4153 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:57:54.810495  4143 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:54.890576  1608 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:54.887279  3965 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:54.890803  1654 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:54.891240  3953 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:54.891848  3980 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:54.896340  3972 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:54.899757  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:54.886952  4156 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:54.821205  3971 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:54.914893  4118 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:54.915520  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:54.916527  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:54.916453  4121 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:57:54.888463  4064 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:54.915068  3984 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:54.931236  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:57:54.938855  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 48144.3us
I20260709 12:57:54.902266  4159 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:54.813485  4137 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:54.977415  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:54.981444  1610 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:57:54.937763  4076 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:54.994298  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 73024us
I20260709 12:57:54.825227  4161 consensus_queue.cc:1059] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.122s
I20260709 12:57:54.933804  4154 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:55.009341  4142 log.cc:927] Time spent T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 12:57:54.989809  3971 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.009994  3921 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:55.010666  4144 log.cc:927] Time spent T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 12:57:55.012466  3980 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 12:57:55.013055  4145 log.cc:927] Time spent T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.229s	user 0.000s	sys 0.000s
I20260709 12:57:55.013288  4156 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:54.937638  4153 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:55.014070  4118 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:57:55.052994  4118 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:55.053967  4154 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:55.017844  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1000) took 1635 ms. Trace:
I20260709 12:57:55.055009  4104 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:54.939494  4059 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 12:57:55.055438  1615 rpcz_store.cc:276] 0709 12:57:53.382546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:53.415754 (+ 33208us) service_pool.cc:224] Handling call
0709 12:57:53.643387 (+227633us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:53.757947 (+114560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:53.757983 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:53.788201 (+ 30218us) log.cc:844] Serialized 26 byte log entry
0709 12:57:53.972387 (+184186us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:53.972427 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:53.972511 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:55.017594 (+1045083us) raft_consensus.cc:1685] finished
0709 12:57:55.017614 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:55.017752 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":114105,"raft.queue_time_us":152140,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":12472,"thread_start_us":145978,"threads_started":1,"wal-append.queue_time_us":374139}
I20260709 12:57:55.056926  4137 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:55.018131  4169 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:55.052340  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 975) took 1470 ms. Trace:
I20260709 12:57:55.058194  4169 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:54.942780  4143 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.018328  4064 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:54.939254  3963 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:55.061151  4136 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:54.935720  4165 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 12:57:54.940857  4134 log.cc:927] Time spent T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.422s	user 0.000s	sys 0.001s
W20260709 12:57:54.997385  4149 log.cc:927] Time spent T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.355s	user 0.000s	sys 0.001s
I20260709 12:57:55.038133  4076 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:55.019408  4163 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:57:55.030774  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 98273.9us
I20260709 12:57:55.035883  1608 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:57:55.006884  3953 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:55.009414  4157 log.cc:927] Time spent T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:57:55.039618  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:55.040542  1617 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:55.050413  4174 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:55.019044  4159 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.026027  4160 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:57:55.058467  1534 rpcz_store.cc:276] 0709 12:57:53.582292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:53.586167 (+  3875us) service_pool.cc:224] Handling call
0709 12:57:53.586591 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:53.589762 (+  3171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:53.589801 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:53.705276 (+115475us) log.cc:844] Serialized 26 byte log entry
0709 12:57:54.520205 (+814929us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:54.520453 (+   248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:54.520715 (+   262us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:55.052127 (+531412us) raft_consensus.cc:1685] finished
0709 12:57:55.052149 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:55.052281 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15754,"raft.queue_time_us":118271,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":33373,"thread_start_us":691731,"threads_started":1,"wal-append.queue_time_us":909830}
I20260709 12:57:55.057859  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:55.054952  2299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32794 (request call id 154) took 1856 ms. Trace:
I20260709 12:57:55.059772  4118 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:55.061985  4178 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:57:55.063180  3981 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:55.063594  3809 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:55.063896  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 977) took 1481 ms. Trace:
I20260709 12:57:55.064087  4168 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:55.064431  3980 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:55.065021  4169 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:55.065333  4156 consensus_queue.cc:1048] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:55.066591  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:55.066901  4146 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:55.302541  1682 consensus_meta.cc:287] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.000s
W20260709 12:57:55.303848  1689 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.025s	sys 0.061s
I20260709 12:57:55.061334  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1002) took 1660 ms. Trace:
I20260709 12:57:55.054927  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:55.094709  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:55.129544  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:55.059643  4170 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:55.323065  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:57:55.323398  1689 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.026s	sys 0.066s
I20260709 12:57:55.301311  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:55.236267  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:55.243669  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:55.325150  1534 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:57:55.326679  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:55.323729  1610 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:57:55.323400  1616 rpcz_store.cc:276] 0709 12:57:53.401300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:53.407277 (+  5977us) service_pool.cc:224] Handling call
0709 12:57:53.435730 (+ 28453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:54.431911 (+996181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:55.061077 (+629166us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b5400032ad4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:55.061244 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1403067648}
I20260709 12:57:55.327831  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:55.328341  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:55.329952  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:55.330941  1690 raft_consensus.cc:2393] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 8: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:55.301985  1533 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:55.331454  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:55.066601  4177 raft_consensus.cc:3055] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:55.055565  4104 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:55.238890  3947 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:55.267565  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 248027us
I20260709 12:57:55.081935  3971 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:55.345433  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 44223.4us
I20260709 12:57:55.240676  4176 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.240334  4143 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:55.346431  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:55.268164  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:55.304435  1682 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:55.332039  1684 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:55.168223  4154 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.300823  1541 rpcz_store.cc:276] 0709 12:57:53.582935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:53.590316 (+  7381us) service_pool.cc:224] Handling call
0709 12:57:53.590722 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:53.754772 (+164050us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:53.754817 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:53.789436 (+ 34619us) log.cc:844] Serialized 26 byte log entry
0709 12:57:54.431159 (+641723us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:54.431202 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:54.431268 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:55.063654 (+632386us) raft_consensus.cc:1685] finished
0709 12:57:55.063675 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:55.063834 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":169224,"raft.queue_time_us":180491,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":8366,"thread_start_us":600948,"threads_started":1,"wal-append.queue_time_us":914173}
I20260709 12:57:55.334052  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:55.358536  1691 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
W20260709 12:57:55.241505  4158 log.cc:927] Time spent T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
I20260709 12:57:55.358950  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:55.359601  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 978) took 1776 ms. Trace:
I20260709 12:57:55.340905  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:55.360503  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:55.333985  1685 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:55.083487  3965 consensus_queue.cc:1059] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.248s
I20260709 12:57:55.323555  4156 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.343041  4169 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.238193  4135 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:55.324671  4136 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.322817  3809 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.323804  4170 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:55.390012  4170 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:55.398090  3809 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:55.374679  4169 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.374455  4156 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.401383  3971 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.402047  3971 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:55.407977  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:55.408344  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:55.410665  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:55.411510  4028 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:55.412464  3880 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:55.416357  1687 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:57:55.242271  4031 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:55.418812  1541 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:57:55.348021  1533 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:55.118882  4059 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.226s
I20260709 12:57:55.323276  3921 consensus_queue.cc:1048] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:57:55.333535  4120 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:55.053998  4153 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:55.363327  4187 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.361213  1690 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:55.118965  3963 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.361940  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:55.362596  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 980) took 1778 ms. Trace:
I20260709 12:57:55.359997  1535 rpcz_store.cc:276] 0709 12:57:53.583221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:53.584222 (+  1001us) service_pool.cc:224] Handling call
0709 12:57:53.584589 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:53.584966 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:53.584995 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:53.756933 (+171938us) log.cc:844] Serialized 26 byte log entry
0709 12:57:53.991997 (+235064us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:53.992041 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:53.992114 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:55.359402 (+1367288us) raft_consensus.cc:1685] finished
0709 12:57:55.359424 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:55.359548 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19366,"raft.queue_time_us":3137,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":65587,"thread_start_us":182939,"threads_started":1,"wal-append.queue_time_us":440005}
I20260709 12:57:55.436877  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:55.437523  1535 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:57:55.438401  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:55.338019  4177 raft_consensus.cc:740] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:55.324276  4174 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.363683  1683 raft_consensus.cc:3055] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:57:55.366513  1581 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:55.324530  3953 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:55.371799  1505 leader_election.cc:336] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 2.016s (SENT)
I20260709 12:57:55.322795  4168 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.367712  1654 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:55.350167  3981 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.349855  4110 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:55.363673  1583 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:55.303591  2299 rpcz_store.cc:276] 0709 12:57:53.198759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:53.201697 (+  2938us) service_pool.cc:224] Handling call
0709 12:57:53.211098 (+  9401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:53.357506 (+146408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:53.359035 (+  1529us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:53.829150 (+470115us) log.cc:844] Serialized 26 byte log entry
0709 12:57:54.230360 (+401210us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:54.249820 (+ 19460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:54.333113 (+ 83293us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:55.054708 (+721595us) raft_consensus.cc:1685] finished
0709 12:57:55.054736 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:55.054873 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":69389,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":112,"thread_start_us":410520,"threads_started":2,"wal-append.queue_time_us":810218}
I20260709 12:57:55.378772  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1001) took 1985 ms. Trace:
I20260709 12:57:55.379850  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 984) took 1520 ms. Trace:
I20260709 12:57:55.366688  4154 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.383126  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 990) took 1486 ms. Trace:
I20260709 12:57:55.384712  4167 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:55.385460  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:55.386152  4164 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:55.389417  3742 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:55.398216  3978 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:55.063550  4161 consensus_queue.cc:1048] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.277s
I20260709 12:57:55.421831  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 996) took 2040 ms. Trace:
I20260709 12:57:55.333477  4076 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.325227  4163 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.422971  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1004) took 1843 ms. Trace:
I20260709 12:57:55.345942  4104 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.341741  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:55.463480  3880 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:57:55.439436  1610 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:57:55.434912  1539 rpcz_store.cc:276] 0709 12:57:53.583768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:53.940155 (+356387us) service_pool.cc:224] Handling call
0709 12:57:53.940541 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:53.945948 (+  5407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:53.945980 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:53.951330 (+  5350us) log.cc:844] Serialized 26 byte log entry
0709 12:57:54.323429 (+372099us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:54.323472 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:54.323548 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:55.362381 (+1038833us) raft_consensus.cc:1685] finished
0709 12:57:55.362401 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:55.362536 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4896,"raft.queue_time_us":5034,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":3666,"thread_start_us":361818,"threads_started":1,"wal-append.queue_time_us":537743}
I20260709 12:57:55.421525  4146 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.425211  4064 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.450373  1683 raft_consensus.cc:740] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:55.168536  4165 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:55.451107  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 84676.1us
I20260709 12:57:55.467396  4169 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:55.454815  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 87184.2us
I20260709 12:57:55.427503  4068 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:55.488631  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:55.489106  1581 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:55.457083  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 93483.2us
I20260709 12:57:55.457394  1684 raft_consensus.cc:1275] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:57:55.463220  4153 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:57:55.459900  1613 rpcz_store.cc:276] 0709 12:57:53.393317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:53.415683 (+ 22366us) service_pool.cc:224] Handling call
0709 12:57:53.452760 (+ 37077us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:54.497583 (+1044823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:55.378436 (+880853us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54000663d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:55.378690 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2320099584}
I20260709 12:57:55.460701  1542 rpcz_store.cc:276] 0709 12:57:53.859469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:53.956590 (+ 97121us) service_pool.cc:224] Handling call
0709 12:57:53.961176 (+  4586us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:54.462130 (+500954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:55.379564 (+917434us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b54002193d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:55.379784 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1093758848}
I20260709 12:57:55.493786  1581 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:55.464198  1615 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:55.464748  1536 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:55.454599  4120 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.497893  4120 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:55.462236  1540 rpcz_store.cc:276] 0709 12:57:53.896860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:54.505749 (+608889us) service_pool.cc:224] Handling call
0709 12:57:54.506121 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:54.649758 (+143637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:55.382845 (+733087us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b540045cc54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:55.383050 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":312684928}
I20260709 12:57:55.466562  1534 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:57:55.455037  4031 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:55.374744  4143 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 12:57:55.457651  4178 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:55.415109  4135 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:55.469080  4164 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.353487  4176 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:55.443662  4187 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:55.477360  3880 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:55.462961  4110 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.470865  1612 rpcz_store.cc:276] 0709 12:57:53.381428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:53.381589 (+   161us) service_pool.cc:224] Handling call
0709 12:57:53.381933 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:53.986900 (+604967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:55.421586 (+1434686us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b5400122ad4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:55.421769 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1390053248}
I20260709 12:57:55.433115  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:55.462656  4160 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:55.472851  1611 rpcz_store.cc:276] 0709 12:57:53.579642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:53.581356 (+  1714us) service_pool.cc:224] Handling call
0709 12:57:53.772550 (+191194us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:54.037784 (+265234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:54.037820 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:54.430090 (+392270us) log.cc:844] Serialized 26 byte log entry
0709 12:57:54.649300 (+219210us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:54.649341 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:54.649419 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:55.422774 (+773355us) raft_consensus.cc:1685] finished
0709 12:57:55.422795 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:55.422919 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15701,"raft.queue_time_us":64440,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":17052,"thread_start_us":408147,"threads_started":2,"wal-append.queue_time_us":347474}
I20260709 12:57:55.478428  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:55.514092  1535 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:57:55.501201  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:55.526209  1540 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:57:55.527266  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:55.482602  1655 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:55.453037  1505 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:55.461086  3981 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.510769  4176 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:55.532037  3981 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:55.518386  1533 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:57:55.462270  4087 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:57:55.533093  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:55.533725  1533 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:57:55.534222  4030 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:55.534646  4030 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:55.535149  4030 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:55.418645  4136 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.536900  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:55.537981  4076 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:55.530138  4068 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:57:55.490084  1583 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:55.490983  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:55.479621  4059 consensus_queue.cc:1048] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:57:55.492149  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:55.539486  4154 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:55.540236  1608 raft_consensus.cc:2410] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:57:55.495138  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:55.487722  1654 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:55.541556  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 53934.1us
I20260709 12:57:55.541467  4104 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:55.542595  1654 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:55.543300  3953 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:55.470652  4167 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.544147  3921 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:57:55.544348  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 172585us
I20260709 12:57:55.506280  4135 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:55.545714  1505 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:55.529703  1611 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:55.538173  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:55.529925  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:55.547322  1505 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:55.538033  4136 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:55.534576  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:55.463038  4179 consensus_queue.cc:1059] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:57:55.543787  1654 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:55.538358  1682 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:57:55.511229  4187 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:57:55.550024  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 67517.3us
W20260709 12:57:55.552737  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 59033.7us
I20260709 12:57:55.570431  1611 raft_consensus.cc:1275] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:57:55.527951  1540 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:55.559104  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:55.491426  3980 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:55.559939  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:55.573870  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:55.577580  1505 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:55.577943  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:55.577016  1542 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:57:55.580827  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:55.581584  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:55.511492  3880 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:55.584487  4135 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:57:55.569641  4160 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.581583  4028 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:55.592218  4028 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:55.592625  4028 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:55.593504  4160 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:55.584914  3947 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:55.600136  3947 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:55.600582  3947 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:55.601187  4136 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:55.601698  4136 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:55.602052  4136 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:55.472160  4186 consensus_queue.cc:1059] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 12:57:55.590222  3955 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:55.604665  3955 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:55.605022  1609 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:55.585397  4195 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:55.606178  4195 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:55.606581  4195 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:55.605077  3955 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:55.608834  3921 consensus_queue.cc:1059] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:55.609354  1655 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:55.586514  3954 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:57:55.610615  1655 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:55.473353  4177 consensus_queue.cc:260] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.513886  4110 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:55.502372  4111 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:55.487583  4064 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.589457  4104 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:57:55.591349  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:55.590168  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 100191us
I20260709 12:57:55.585304  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:55.614295  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:55.500424  4120 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:55.487126  4146 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:55.545634  4167 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:55.506505  4164 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:55.583338  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:55.644521  1542 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:57:55.568630  4118 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:55.492421  3852 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 12:57:55.572800  4068 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:57:55.569283  4143 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:55.622517  4177 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:55.625869  4153 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:55.556819  4159 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:55.508342  4105 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:55.627897  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:55.627627  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:55.650936  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 74155.3us
I20260709 12:57:55.621434  1533 raft_consensus.cc:1240] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:57:55.660344  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:55.621978  4076 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:57:55.663800  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 53265.6us
I20260709 12:57:55.665758  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:55.689013  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:55.698758  1690 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:55.698853  1686 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:57:55.692981  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:55.707134  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:55.707837  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:55.709751  4179 raft_consensus.cc:3055] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:55.710285  4179 raft_consensus.cc:740] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:55.711227  4179 consensus_queue.cc:260] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.711732  3971 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:55.648101  4026 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:57:55.716064  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 48637.7us
I20260709 12:57:55.658102  4187 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.724635  1581 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:55.726207  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:55.663249  4068 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:55.728726  4068 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:57:55.733044  1583 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:55.733584  3852 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:57:55.735193  4118 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:55.735636  4118 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:55.735986  4118 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:55.726231  4026 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.740964  4146 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:55.741762  4172 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:57:55.742177  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:55.744696  4187 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:55.746290  4165 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:55.751971  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:55.752702  1533 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:57:55.663800  4169 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:55.758186  1583 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:55.734287  1542 raft_consensus.cc:1240] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:57:55.762549  1581 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:55.763895  1583 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:55.675683  4153 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:55.673622  4184 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.769165  1583 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:55.769304  1581 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:55.771034  4114 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:55.771476  4114 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:55.771819  4114 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:55.772379  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:55.773437  1688 raft_consensus.cc:2410] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:57:55.779758  1583 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:55.762879  4165 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:55.706724  4170 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.772642  4111 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:55.773089  3963 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:55.820019  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 121076us
I20260709 12:57:55.854176  1655 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:55.773696  4153 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:55.858491  1533 raft_consensus.cc:1275] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:57:55.775889  4179 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:55.778403  4167 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:55.860011  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:55.842617  3956 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:57:55.862736  4111 raft_consensus.cc:697] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:57:55.863961  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 45111.5us
I20260709 12:57:55.867090  3955 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.790858  3972 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:55.869787  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:55.871327  4178 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:55.768090  3852 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:57:55.787760  3742 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:57:55.876896  4076 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:55.877161  4064 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:55.880354  4180 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:55.790132  3953 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:57:55.883926  4126 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.885264  3947 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.779666  4184 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.766794  4169 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.844623  4138 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
W20260709 12:57:55.900345  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 45120.1us
I20260709 12:57:55.787618  4110 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:55.923208  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:57:55.918439  3880 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.973726  1609 raft_consensus.cc:606] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:55.923931  1533 raft_consensus.cc:2393] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 8: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 12:57:55.918747  4197 log.cc:927] Time spent T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.140s	user 0.000s	sys 0.005s
I20260709 12:57:55.987272  1683 consensus_queue.cc:260] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.950608  3742 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:55.899375  4028 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.990828  4028 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:55.915112  4167 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:55.913798  4104 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:55.931648  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:55.886039  4153 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.859203  4165 raft_consensus.cc:697] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:55.957067  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:55.926837  3972 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:55.789319  4030 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.886875  4195 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.968145  1655 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:55.984114  4169 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:55.976797  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:56.003144  1533 raft_consensus.cc:2393] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 4: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:55.979223  4187 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:55.980449  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:55.982323  3947 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:55.983067  4170 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:55.982815  4111 consensus_queue.cc:237] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.985131  4110 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 12:57:55.985332  4196 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.294s	user 0.000s	sys 0.001s
I20260709 12:57:56.004638  4104 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.984361  4114 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:56.015337  4104 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:56.004896  3972 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:56.017447  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1311) took 1188 ms. Trace:
I20260709 12:57:56.017830  1612 rpcz_store.cc:276] 0709 12:57:54.829401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:55.517485 (+688084us) service_pool.cc:224] Handling call
0709 12:57:55.517766 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:55.546081 (+ 28315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:55.546112 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:55.546169 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:55.546204 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:56.017234 (+471030us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b540032b754. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:56.017279 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:56.017396 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64638208}
I20260709 12:57:55.999779  4167 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:55.991361  1683 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:56.000406  1542 raft_consensus.cc:2393] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 6: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:56.000411  1611 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 3.
I20260709 12:57:55.930600  4076 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.003302  1655 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:56.003801  4206 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:57:56.004037  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:55.978725  4068 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:55.968662  3953 raft_consensus.cc:697] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:56.026317  1655 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:56.031834  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:56.032644  1536 raft_consensus.cc:2376] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9. Re-sending same reply.
I20260709 12:57:56.032920  1505 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:56.036164  1683 raft_consensus.cc:1275] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:57:56.036836  1683 pending_rounds.cc:85] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 4
I20260709 12:57:56.037168  1683 pending_rounds.cc:107] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:57:55.966058  4126 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:56.039872  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:56.012920  4110 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:56.040627  1655 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:56.037539  1683 raft_consensus.cc:2889] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:56.042063  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:56.045048  1655 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:56.045392  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.046130  1655 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:56.046518  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:56.048103  1655 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:56.048630  1536 raft_consensus.cc:2376] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5. Re-sending same reply.
I20260709 12:57:56.022716  4206 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:56.022750  4076 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:56.087955  1683 raft_consensus.cc:2410] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:57:56.103739  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.105713  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:56.049912  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:56.113791  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:56.049701  4203 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:56.100976  4206 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:57:56.039733  4184 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:56.040125  4064 consensus_queue.cc:1059] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 12:57:56.117496  4064 raft_consensus.cc:3055] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:57:56.117882  4064 raft_consensus.cc:740] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:56.118762  4064 consensus_queue.cc:260] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:56.119167  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.117796  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.113816  1542 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:56.114698  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.091219  1655 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:56.047267  4178 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:57:56.124143  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:56.124109  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 56637.3us
I20260709 12:57:56.120462  1610 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:57:56.132165  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.129599  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.022888  4136 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:56.041740  4143 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:57:55.958639  4180 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:56.133160  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.132566  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:56.043634  4187 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:56.132511  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.134747  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.133867  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.150748  1536 raft_consensus.cc:2393] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 7: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:56.151396  1683 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:56.035096  3921 consensus_queue.cc:1059] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 12:57:56.134492  1655 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:56.152890  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.153069  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:56.049906  4059 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:57:56.153169  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.154345  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:56.090247  4186 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:57:56.042709  2300 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:57:56.157332  1533 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:57:56.157900  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.157969  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.038303  3953 consensus_queue.cc:237] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:56.159271  4059 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:56.154809  4143 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:56.162748  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.163554  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.142947  4064 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:56.164740  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.166195  4136 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:56.166556  4209 log.cc:927] Time spent T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:57:56.166409  4206 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:56.168396  4180 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:56.169215  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.225180  1609 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:57:56.170989  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 997) took 1020 ms. Trace:
I20260709 12:57:56.226012  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:56.226092  1534 rpcz_store.cc:276] 0709 12:57:55.150145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:55.330373 (+180228us) service_pool.cc:224] Handling call
0709 12:57:56.170816 (+840443us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b5400314cd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:56.170927 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":307079424}
I20260709 12:57:56.174564  1440 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38804 (request call id 33) took 6190 ms. Trace:
I20260709 12:57:56.174281  4076 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:56.103084  4165 consensus_queue.cc:237] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:56.124208  4118 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
W20260709 12:57:56.177541  4133 log.cc:927] Time spent T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 1.746s	user 0.000s	sys 0.005s
I20260709 12:57:56.178401  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1299) took 1358 ms. Trace:
I20260709 12:57:56.248137  1613 rpcz_store.cc:276] 0709 12:57:54.823018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:55.493553 (+670535us) service_pool.cc:224] Handling call
0709 12:57:55.493885 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:55.560904 (+ 67019us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:55.560937 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:55.560984 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:55.561014 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:56.178141 (+617127us) spinlock_profiling.cc:243] Waited 66.8 ms on lock 0x7b5400031bd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:56.178213 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:56.178346 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153621376}
I20260709 12:57:56.181488  4156 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:56.186579  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:56.189109  4177 consensus_meta.cc:287] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.511s	user 0.008s	sys 0.001s
I20260709 12:57:56.276937  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.182578  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1292) took 2345 ms. Trace:
I20260709 12:57:56.197359  4153 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:56.198383  4030 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:56.206359  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:56.207167  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 75377.1us
I20260709 12:57:56.127401  4203 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:56.090421  4202 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:56.218403  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.219820  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.227447  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:56.293421  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:56.294159  1536 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:57:56.295241  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:56.221114  4189 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:56.245141  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:56.297241  1542 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:56.211408  3880 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:56.227272  1440 rpcz_store.cc:276] 0709 12:57:49.983829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:49.984019 (+   190us) service_pool.cc:224] Handling call
0709 12:57:56.174478 (+6190459us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:57:53.031776 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:57:53.201727 (+169951us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:57:53.205883 (+  4156us) write_op.cc:435] Acquired schema lock
0709 12:57:53.224519 (+ 18636us) tablet.cc:662] Decoding operations
0709 12:57:53.299374 (+ 74855us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:57:53.299452 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:57:53.299484 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:57:53.299687 (+   203us) tablet.cc:701] Row locks acquired
0709 12:57:53.299700 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:57:53.299853 (+   153us) write_op.cc:270] Start()
0709 12:57:53.299978 (+   125us) write_op.cc:276] Timestamp: P: 1783601873299802 usec, L: 0
0709 12:57:53.299998 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:57:53.300719 (+   721us) log.cc:844] Serialized 535 byte log entry
0709 12:57:54.813348 (+1512629us) op_driver.cc:464] REPLICATION: finished
0709 12:57:55.333479 (+520131us) write_op.cc:301] APPLY: starting
0709 12:57:55.339646 (+  6167us) tablet.cc:1367] starting BulkCheckPresence
0709 12:57:55.348177 (+  8531us) tablet.cc:1370] finished BulkCheckPresence
0709 12:57:55.365985 (+ 17808us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:57:55.403286 (+ 37301us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:57:55.403475 (+   189us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:57:55.403547 (+    72us) write_op.cc:312] APPLY: finished
0709 12:57:55.403779 (+   232us) log.cc:844] Serialized 22 byte log entry
0709 12:57:55.483787 (+ 80008us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:55.488079 (+  4292us) write_op.cc:454] Released schema lock
0709 12:57:55.491751 (+  3672us) write_op.cc:341] FINISH: Updating metrics
0709 12:57:55.578307 (+ 86556us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:57:55.583644 (+  5337us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":189,"mutex_wait_us":870134,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":462836,"apply.run_cpu_time_us":15996,"apply.run_wall_time_us":236261,"num_ops":1,"prepare.queue_time_us":116742,"prepare.run_cpu_time_us":19677,"prepare.run_wall_time_us":494379,"raft.queue_time_us":749525,"raft.run_cpu_time_us":14859,"raft.run_wall_time_us":324329,"replication_time_us":1447237,"thread_start_us":909947,"threads_started":5,"wal-append.queue_time_us":698911,"wal-append.run_cpu_time_us":14477,"wal-append.run_wall_time_us":1477156}]]}
I20260709 12:57:56.246572  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:56.217551  4059 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:56.217744  4143 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:56.247434  4136 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:57:56.287931  4201 log.cc:927] Time spent T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.323s	user 0.000s	sys 0.003s
I20260709 12:57:56.289408  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.278533  1614 rpcz_store.cc:276] 0709 12:57:53.837132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:53.960011 (+122879us) service_pool.cc:224] Handling call
0709 12:57:53.960277 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:54.823291 (+863014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:56.182233 (+1358942us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b54002a62d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:56.182462 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1970874240}
I20260709 12:57:56.279320  1615 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:57:56.290850  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.307437  1613 raft_consensus.cc:2410] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:57:56.307582  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.308992  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:56.309791  1615 raft_consensus.cc:2393] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 8: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:56.204066  4186 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:56.297561  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:56.296375  1536 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:57:56.300429  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:56.250373  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.222383  4110 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:56.304697  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:56.306367  1609 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:56.311510  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:56.314777  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:56.315346  1536 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:57:56.316370  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:56.316833  4160 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:56.317324  1536 raft_consensus.cc:2410] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:57:56.317386  4160 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:56.318382  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:56.318977  1536 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:56.323750  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:56.324394  1534 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:57:56.327615  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1576) took 3421 ms. Trace:
I20260709 12:57:56.327947  4205 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:56.328536  4205 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:56.327762  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:56.296136  4202 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:56.314077  4136 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:56.296998  4189 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:56.369527  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 1614) took 1241 ms. Trace:
I20260709 12:57:56.379273  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.333802  3965 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:56.377216  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1620) took 1104 ms. Trace:
I20260709 12:57:56.351256  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.381650  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:56.371534  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.344170  1542 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:57:56.438349  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:56.438869  1542 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:57:56.414638  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 121) took 1019 ms. Trace:
I20260709 12:57:56.310901  3742 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:56.334352  1537 rpcz_store.cc:276] 0709 12:57:52.906271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:52.966714 (+ 60443us) service_pool.cc:224] Handling call
0709 12:57:52.995079 (+ 28365us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:57:53.454538 (+459459us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b1800371620. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc85cbf94bc 00007fc859f4748b 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f61455 00007fc85d049060 00007fc85d049bfb 00007fc85d05464b
0709 12:57:53.454712 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:53.454738 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:57:53.578718 (+123980us) log.cc:844] Serialized 52 byte log entry
0709 12:57:54.193056 (+614338us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:54.443795 (+250739us) log.cc:844] Serialized 14 byte log entry
0709 12:57:54.490744 (+ 46949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:54.490830 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:55.889626 (+1398796us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b1800371620. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f322a6 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f322a6 00007fc859f32240
0709 12:57:55.890524 (+   898us) spinlock_profiling.cc:243] Waited 4.34 ms on lock 0x7b1800371620. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f322a6 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db
0709 12:57:56.177013 (+286489us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:57:56.327349 (+150336us) raft_consensus.cc:1685] finished
0709 12:57:56.327370 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:56.327519 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49115,"prepare.queue_time_us":250673,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":81139,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":16437,"spinlock_wait_cycles":79768448,"thread_start_us":656825,"threads_started":3,"wal-append.queue_time_us":644405}
W20260709 12:57:56.352669  4210 log.cc:927] Time spent T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:57:56.425354  1536 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:57:56.417094  4202 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:56.448601  1534 raft_consensus.cc:2393] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 4: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:56.312922  4186 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:56.406747  4189 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:56.374586  4118 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:56.431491  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.339946  1615 raft_consensus.cc:1275] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:57:56.377015  4110 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:56.347786  4076 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:56.520139  4143 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:56.538754  4076 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:56.539265  4076 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:56.375948  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:56.541141  1535 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:57:56.439566  1539 rpcz_store.cc:276] 0709 12:57:55.395569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:55.547548 (+151979us) service_pool.cc:224] Handling call
0709 12:57:55.548154 (+   606us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:55.572562 (+ 24408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:55.572596 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:55.573036 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 12:57:55.786601 (+213565us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:55.786644 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:55.787040 (+   396us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:56.287263 (+500223us) spinlock_profiling.cc:243] Waited 7.69 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:57:56.380101 (+ 92838us) raft_consensus.cc:1685] finished
0709 12:57:56.380122 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:56.414564 (+ 34442us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9406,"raft.queue_time_us":29421,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":9976,"spinlock_wait_cycles":17688960,"thread_start_us":196849,"threads_started":1,"wal-append.queue_time_us":372501}
I20260709 12:57:56.434561  1685 rpcz_store.cc:276] 0709 12:57:55.128582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:55.243371 (+114789us) service_pool.cc:224] Handling call
0709 12:57:56.369286 (+1125915us) spinlock_profiling.cc:243] Waited 7.13 ms on lock 0x7b54002887d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:56.369442 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16399104}
I20260709 12:57:56.436014  1682 rpcz_store.cc:276] 0709 12:57:55.272631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:55.364206 (+ 91575us) service_pool.cc:224] Handling call
0709 12:57:55.415912 (+ 51706us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:55.557846 (+141934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:56.376974 (+819128us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b540022a1d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:56.377158 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":280865536}
I20260709 12:57:56.440968  4215 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:56.443717  4136 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:56.446977  4168 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:56.449034  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.449052  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:56.591079  1691 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:56.442960  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.450582  4174 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:56.453369  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:56.459025  1617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1309) took 1630 ms (client timeout 1643 ms). Trace:
I20260709 12:57:56.343518  4167 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:56.523295  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.527575  1686 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:56.529716  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.601964  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.530901  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 996) took 1381 ms. Trace:
I20260709 12:57:56.531631  1581 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:56.542290  4189 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:56.572980  1535 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:57:56.602758  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:56.603400  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 71902.3us
I20260709 12:57:56.604629  4143 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:56.582237  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.605767  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.605990  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.587179  3947 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.607044  4189 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:56.607115  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.608059  4195 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:56.608354  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.609442  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.609587  4110 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:57:56.610915  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.611696  1613 raft_consensus.cc:2393] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 8: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:56.612072  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.612511  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.613152  1613 raft_consensus.cc:2368] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8.
I20260709 12:57:56.613971  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.609452  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.615458  1610 raft_consensus.cc:2393] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 7: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:56.615993  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.616416  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1308) took 1045 ms. Trace:
I20260709 12:57:56.616746  1683 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:57:56.617602  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.617748  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.618532  1683 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:56.619000  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.619437  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:56.602722  1541 rpcz_store.cc:276] 0709 12:57:55.149908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:55.360209 (+210301us) service_pool.cc:224] Handling call
0709 12:57:56.530687 (+1170478us) spinlock_profiling.cc:243] Waited 57.4 ms on lock 0x7b5400073fd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:56.530810 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132041088}
I20260709 12:57:56.620890  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:56.621537  1541 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:56.591995  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:56.622310  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.590427  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:56.623164  1542 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:56.592090  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:56.596998  1617 rpcz_store.cc:269] 0709 12:57:54.828204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:54.913587 (+ 85383us) service_pool.cc:224] Handling call
0709 12:57:56.458839 (+1545252us) spinlock_profiling.cc:243] Waited 63.4 ms on lock 0x7b5400444654. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:56.458959 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":145860864}
I20260709 12:57:56.599224  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:56.625100  1539 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:56.594103  1583 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:56.600066  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.602185  1690 raft_consensus.cc:2393] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 5: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:56.626639  1683 raft_consensus.cc:2393] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 8: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:56.523370  4104 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.631764  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.632421  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:56.613188  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.430835  4172 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:57:56.532042  4163 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:56.606817  3947 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:56.628319  1688 raft_consensus.cc:2393] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 9: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:56.628834  1689 raft_consensus.cc:2410] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:57:56.586306  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.635919  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.632731  1683 raft_consensus.cc:2393] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 7: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:56.622499  1536 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:56.636534  1691 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:57:56.636534  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.633774  1686 rpcz_store.cc:276] 0709 12:57:55.571279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.527016 (+955737us) service_pool.cc:224] Handling call
0709 12:57:56.527362 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:56.616160 (+ 88798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:56.616354 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:56.637353  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.637714  1615 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:57:56.588167  4161 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:56.455780  3972 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:56.640429  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.642585  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.643365  1686 raft_consensus.cc:2410] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:57:56.643208  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.613909  4167 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:56.640103  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.644270  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.644850  1611 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:57:56.641044  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.456104  3965 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:56.644634  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.649107  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.649721  1688 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:57:56.650539  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.651079  1688 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:57:56.652047  1691 raft_consensus.cc:2410] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:57:56.652956  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.653298  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.648036  1508 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:56.634630  3954 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:56.657173  1508 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:56.657949  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.665241  1686 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:56.666136  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.651906  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.666389  1583 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:56.666941  1686 raft_consensus.cc:2410] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260709 12:57:56.661046  1536 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:57:56.668257  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:56.663276  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.663667  1541 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:57:56.663975  1614 raft_consensus.cc:2393] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 7: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:56.670480  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.669421  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.677644  1539 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:56.679766  1690 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:57:56.598702  4215 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:56.635222  4176 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
W20260709 12:57:56.705721  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:56.627323  4059 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:56.661934  1542 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:57:56.663604  4174 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:56.640089  4104 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:56.664449  3954 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:56.730530  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:56.727511  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:56.671940  4187 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:56.735359  1684 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:57:56.689499  4167 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:56.757085  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.758683  1611 raft_consensus.cc:1240] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:56.643875  4161 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:56.759451  3954 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:56.768005  1533 pending_rounds.cc:85] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 4
I20260709 12:57:56.784253  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1011) took 1189 ms. Trace:
I20260709 12:57:56.731340  4174 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:56.934218  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:56.755169  4195 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:56.938508  1541 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 12:57:56.882130  4143 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.823760  4187 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:56.924604  4136 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.890458  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.955278  1688 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:56.788142  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:56.945528  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 103913us
I20260709 12:57:56.942202  1540 rpcz_store.cc:276] 0709 12:57:55.594427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:55.620697 (+ 26270us) service_pool.cc:224] Handling call
0709 12:57:56.373057 (+752360us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b5800002798. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ceee 0000000000375939 00007fc861fa01e0 00007fc8620690c4 00007fc862069131 00007fc86202afc0 00007fc862015929 00007fc8620153d2 00007fc85b58cbd4
0709 12:57:56.373261 (+   204us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:56.373664 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:56.373694 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:56.374219 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 12:57:56.461634 (+ 87415us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:56.461675 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:56.461747 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:56.762569 (+300822us) raft_consensus.cc:1685] finished
0709 12:57:56.762590 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:56.784177 (+ 21587us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7920,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":25776,"spinlock_wait_cycles":4559872,"thread_start_us":86994,"threads_started":1,"wal-append.queue_time_us":297876}
I20260709 12:57:56.784543  1533 pending_rounds.cc:107] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:57:56.957625  1615 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:57:56.958421  1533 raft_consensus.cc:2889] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:56.936431  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.963644  1613 raft_consensus.cc:2410] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:57:56.756735  4114 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:56.828712  4120 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:56.937593  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:56.961356  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.891058  4186 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:56.937224  4174 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:56.756449  4076 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:56.823598  2300 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32788 (request call id 74) took 1757 ms (client timeout 1646 ms). Trace:
I20260709 12:57:56.942571  1542 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9. Ops: []
I20260709 12:57:57.009111  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.966361  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.762151  4167 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:56.971071  1683 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:57.017616  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 1330) took 1155 ms. Trace:
I20260709 12:57:56.972251  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.938340  4195 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:57.018040  1683 rpcz_store.cc:276] 0709 12:57:55.862087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.689222 (+827135us) service_pool.cc:224] Handling call
0709 12:57:57.017541 (+328319us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:56.973626  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:56.978749  4219 log.cc:927] Time spent T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.217s	user 0.000s	sys 0.000s
I20260709 12:57:56.980202  3965 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:56.967319  4163 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:56.959807  4187 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:56.962810  4136 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:56.957506  4143 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:56.990818  3972 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:57.018447  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:56.995263  3947 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:57.022928  1688 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:57:57.041999  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:57.056306  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 99179.7us
I20260709 12:57:57.039624  1654 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:57.057608  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:57.058256  1683 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:57:57.060161  1654 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:57.044797  1505 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:57.061014  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:57.061569  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:57.020530  4167 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:57.056883  1616 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:57.079334  1654 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:57.080335  1505 leader_election.cc:400] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8.
W20260709 12:57:57.080508  4225 log.cc:927] Time spent T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 12:57:57.080765  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:57.081687  1688 raft_consensus.cc:2410] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:57:57.082113  3870 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:57.082645  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:57.082795  3870 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:57.083299  1688 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:57:57.083513  3921 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:57.081526  1505 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:57.086218  1505 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:57.096102  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:57.096869  1683 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:57:57.098527  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:57.084312  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:57.100729  1688 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 3.
I20260709 12:57:57.019766  4120 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:57.094048  3947 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:57:57.103655  3947 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:57.104080  3947 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:57.102372  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:57.105811  1542 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:57.106839  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:57.107823  1654 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:57.086140  4076 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:57:57.110756  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1020) took 1004 ms. Trace:
I20260709 12:57:57.111224  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:57.107918  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:57.115470  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:57.104595  3947 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:57:57.016427  2300 rpcz_store.cc:269] 0709 12:57:55.065809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:55.066283 (+   474us) service_pool.cc:224] Handling call
0709 12:57:56.823229 (+1756946us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b5400700654. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:56.823486 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1695815552}
I20260709 12:57:57.105751  4104 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:57.101701  4228 log.cc:927] Time spent T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:57:57.094187  3921 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:57.124212  3947 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:57.124857  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:57:57.125288  1655 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.039s (SENT) [suppressed 29 similar messages]
I20260709 12:57:57.125813  1683 raft_consensus.cc:2410] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:57:57.126669  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "920d24d01316479692fb62f167beb41e"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:45440
I20260709 12:57:57.126452  3954 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:57.126921  3947 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:57.127255  1683 raft_consensus.cc:606] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:57.127665  1683 raft_consensus.cc:614] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:57.128135  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45440 (request call id 10) took 1134 ms. Trace:
W20260709 12:57:57.105294  4202 consensus_meta.cc:287] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.568s	user 0.009s	sys 0.000s
I20260709 12:57:57.087154  4161 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:57.041153  4163 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:57.138600  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:57.143953  1611 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:57.139343  2266 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:57.141160  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:57.114395  1608 rpcz_store.cc:276] 0709 12:57:56.107429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.211493 (+104064us) service_pool.cc:224] Handling call
0709 12:57:56.217578 (+  6085us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:56.217917 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:56.217958 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:56.223441 (+  5483us) log.cc:844] Serialized 26 byte log entry
0709 12:57:56.456286 (+232845us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:56.456324 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:56.456387 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:57.110548 (+654161us) raft_consensus.cc:1685] finished
0709 12:57:57.110567 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:57.110694 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1472,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":3143,"thread_start_us":178060,"threads_started":1,"wal-append.queue_time_us":500946}
I20260709 12:57:57.116147  1542 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
W20260709 12:57:57.104208  4224 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:57:57.149591  3956 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:57.128451  1683 rpcz_store.cc:276] 0709 12:57:55.993895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.126505 (+1132610us) service_pool.cc:224] Handling call
0709 12:57:57.128075 (+  1570us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:57.140537  1654 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:57.171934  1611 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
W20260709 12:57:57.137089  4226 log.cc:927] Time spent T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 12:57:57.179358  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 93204.2us
W20260709 12:57:57.151122  4227 log.cc:927] Time spent T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:57:57.138343  4076 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:57.182096  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:57.133893  4178 raft_consensus.cc:3055] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:57:57.184691  3742 consensus_queue.cc:1059] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:57.181988  1505 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:57.140203  4216 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:57:57.173451  4229 log.cc:927] Time spent T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 12:57:57.155218  3956 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:57.173637  4161 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:57.194154  1505 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:57.128964  4202 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:57.200740  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:57.207553  1683 raft_consensus.cc:1240] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:57.188099  4076 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:57.208400  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1320) took 1436 ms. Trace:
I20260709 12:57:57.188721  4178 raft_consensus.cc:740] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:57:57.190266  4231 log.cc:927] Time spent T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:57:57.212108  1683 rpcz_store.cc:276] 0709 12:57:55.771745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.176432 (+1404687us) service_pool.cc:224] Handling call
0709 12:57:57.205443 (+ 29011us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:57.208139 (+  2696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:57.208344 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:57.192757  4161 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:57.195561  3956 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:57.218389  1685 raft_consensus.cc:2393] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 8: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:57.196766  3954 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:57.218765  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:57.223047  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1321) took 1451 ms. Trace:
I20260709 12:57:57.223724  1683 rpcz_store.cc:276] 0709 12:57:55.771996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.213056 (+1441060us) service_pool.cc:224] Handling call
0709 12:57:57.222560 (+  9504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:57.222733 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:57.222758 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:57.222799 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:57.222837 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:57.222887 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:57.222994 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:57:57.216938  4223 log.cc:927] Time spent T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:57:57.213894  3947 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:57.242806  4205 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:57.210233  4235 raft_consensus.cc:2764] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:57:57.215837  4186 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:57.222885  4161 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:57.232790  4126 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:57.265764  4234 log.cc:927] Time spent T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:57:57.251330  4178 consensus_queue.cc:260] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:57.270546  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:57.271585  1688 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 8.
I20260709 12:57:57.272042  4143 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:57.272233  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1026) took 1141 ms. Trace:
I20260709 12:57:57.273811  4202 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:57.272701  1612 rpcz_store.cc:276] 0709 12:57:56.130903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.326894 (+195991us) service_pool.cc:224] Handling call
0709 12:57:56.327254 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:56.341037 (+ 13783us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:56.341074 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:56.341548 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 12:57:56.536534 (+194986us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b180031a020. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f643f3 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd 000000000038f354 000000000038f199 00007fc859f4783a
0709 12:57:56.686867 (+150333us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:56.686918 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:56.686986 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:57.271886 (+584900us) raft_consensus.cc:1685] finished
0709 12:57:57.271909 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:57.272158 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8537,"raft.queue_time_us":16270,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":93,"spinlock_wait_cycles":48772480,"thread_start_us":306390,"threads_started":1,"wal-append.queue_time_us":752942}
I20260709 12:57:57.274871  4120 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:57.260977  4187 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:57.271013  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1644) took 1237 ms. Trace:
W20260709 12:57:57.282002  1685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 1339) took 1417 ms (client timeout 1865 ms). Trace:
W20260709 12:57:57.282538  1685 rpcz_store.cc:269] 0709 12:57:55.864398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.593173 (+728775us) service_pool.cc:224] Handling call
0709 12:57:57.281741 (+688568us) spinlock_profiling.cc:243] Waited 614 ms on lock 0x7b540041da54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:57.281928 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1412630400}
I20260709 12:57:57.281662  1541 rpcz_store.cc:276] 0709 12:57:56.035683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.939452 (+903769us) service_pool.cc:224] Handling call
0709 12:57:56.939766 (+   314us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:57:56.940174 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:57:56.940531 (+   357us) log.cc:844] Serialized 14 byte log entry
0709 12:57:56.999608 (+ 59077us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:57:57.005473 (+  5865us) log.cc:844] Serialized 52 byte log entry
0709 12:57:57.005670 (+   197us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:57.005916 (+   246us) log.cc:844] Serialized 14 byte log entry
0709 12:57:57.006224 (+   308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:57.006318 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:57.270580 (+264262us) raft_consensus.cc:1685] finished
0709 12:57:57.270611 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:57.270835 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":305,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":1247,"raft.queue_time_us":789,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":1103,"thread_start_us":58708,"threads_started":1,"wal-append.queue_time_us":101938}
I20260709 12:57:57.286237  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:57.297173  3955 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:57.283769  4195 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:57.331291  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:57.333484  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 98) took 1029 ms. Trace:
I20260709 12:57:57.333866  1685 rpcz_store.cc:276] 0709 12:57:56.304990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.318930 (+1013940us) service_pool.cc:224] Handling call
0709 12:57:57.333044 (+ 14114us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:57.333232 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:57:57.333248 (+    16us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:57.333278 (+    30us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:57.333305 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:57.333346 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:57.333427 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:57.335160  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 97) took 1347 ms. Trace:
I20260709 12:57:57.335510  1688 rpcz_store.cc:276] 0709 12:57:55.987603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.308255 (+1320652us) service_pool.cc:224] Handling call
0709 12:57:57.334759 (+ 26504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:57.334922 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:57.334945 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:57.334976 (+    31us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:57.334995 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:57.335032 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:57.335112 (+    80us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:57.284089  4136 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:57.347395  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:45440
I20260709 12:57:57.348161  1682 raft_consensus.cc:606] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:57.348793  1682 raft_consensus.cc:614] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:57.352900  1685 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 12:57:57.353705  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:57.354485  1686 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:57:57.355837  1684 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 1348) took 1473 ms (client timeout 1862 ms). Trace:
W20260709 12:57:57.358886  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:57.363662  1508 leader_election.cc:336] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 1.729s (SENT)
I20260709 12:57:57.367045  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:57.369875  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:57.370568  1538 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 8.
I20260709 12:57:57.371889  1538 raft_consensus.cc:1240] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6. Ops: [5.5-5.5]
W20260709 12:57:57.373054  1508 leader_election.cc:336] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 1.757s (SENT)
I20260709 12:57:57.374110  1508 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:57.375043  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1019) took 1089 ms. Trace:
W20260709 12:57:57.356349  1684 rpcz_store.cc:269] 0709 12:57:55.883264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.605727 (+722463us) service_pool.cc:224] Handling call
0709 12:57:57.355615 (+749888us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b540041bc54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:57.355765 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296022912}
I20260709 12:57:57.360457  1507 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:57.375655  1538 rpcz_store.cc:276] 0709 12:57:56.285606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.371260 (+1085654us) service_pool.cc:224] Handling call
0709 12:57:57.371640 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:57.372268 (+   628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:57.374973 (+  2705us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:57:57.388914  1508 leader_election.cc:336] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 1.786s (SENT)
I20260709 12:57:57.388629  2267 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:57.389513  1508 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:57.390887  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:57.385138  4120 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:57.393244  4235 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:57.390674  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:57.395164  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:57.396883  1508 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:57.402616  4161 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:57.404309  4167 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:57.406839  4064 consensus_meta.cc:287] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 1.183s	user 0.010s	sys 0.002s
I20260709 12:57:57.350391  4163 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:57.396288  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:57.338888  4076 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:57.420670  1683 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:57:57.337234  4174 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:57.422799  4174 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:57.384871  4136 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:57.423552  4136 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:57.425665  4136 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:57.426826  4076 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:57.415642  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1636) took 1605 ms. Trace:
I20260709 12:57:57.416802  1538 raft_consensus.cc:1240] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:57:57.429185  1682 raft_consensus.cc:2410] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:57:57.429703  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1024) took 1142 ms. Trace:
I20260709 12:57:57.430162  1538 rpcz_store.cc:276] 0709 12:57:56.286860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.385636 (+1098776us) service_pool.cc:224] Handling call
0709 12:57:57.416573 (+ 30937us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:57.429347 (+ 12774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:57.429648 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:57.428817  1539 rpcz_store.cc:276] 0709 12:57:55.810154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.678508 (+868354us) service_pool.cc:224] Handling call
0709 12:57:56.678832 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:56.679060 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:57:56.705888 (+ 26828us) log.cc:844] Serialized 14 byte log entry
0709 12:57:57.369408 (+663520us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b18003b3080. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf123a 00007fc85d05ba2a
0709 12:57:57.415293 (+ 45885us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:57.415343 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:57.415403 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:57.415474 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:57.415595 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26587,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":20441,"raft.queue_time_us":3657,"spinlock_wait_cycles":47143296,"thread_start_us":45460,"threads_started":1}
I20260709 12:57:57.408946  3978 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:57:57.437001  3978 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:57.437415  3978 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:57.440994  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1017) took 1155 ms. Trace:
I20260709 12:57:57.441412  1542 rpcz_store.cc:276] 0709 12:57:56.285103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.148790 (+863687us) service_pool.cc:224] Handling call
0709 12:57:57.152507 (+  3717us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:57.152990 (+   483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:57.153019 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:57.182661 (+ 29642us) log.cc:844] Serialized 26 byte log entry
0709 12:57:57.316225 (+133564us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:57.316264 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:57.316330 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:57.440766 (+124436us) raft_consensus.cc:1685] finished
0709 12:57:57.440785 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:57.440924 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":124,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":18748,"thread_start_us":107340,"threads_started":1,"wal-append.queue_time_us":236586}
I20260709 12:57:57.432909  2301 consensus_queue.cc:237] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:57.411569  3809 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:57.452023  4026 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:57.452371  4206 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:57.456038  4167 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:57.443454  4195 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:57.457432  4195 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:57.449003  3809 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:57.459283  3809 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:57.460847  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:57.461597  1689 raft_consensus.cc:2368] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 4. Current term is 5.
I20260709 12:57:57.462431  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:57.463467  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:57.464114  1684 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:57:57.465066  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:57.465222  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1651) took 1122 ms. Trace:
I20260709 12:57:57.465782  1684 raft_consensus.cc:2393] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 8: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:57.466696  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:57.467221  4215 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:57.471830  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 1016) took 1366 ms. Trace:
I20260709 12:57:57.472261  1610 rpcz_store.cc:276] 0709 12:57:56.105042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.163298 (+ 58256us) service_pool.cc:224] Handling call
0709 12:57:57.471613 (+1308315us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b540008cfd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:57.471764 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":917271296}
W20260709 12:57:57.474261  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 870015us
I20260709 12:57:57.465639  1536 rpcz_store.cc:276] 0709 12:57:56.342766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.464444 (+1121678us) service_pool.cc:224] Handling call
0709 12:57:57.464752 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:57.464921 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:57.464955 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:57.464995 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:57.465028 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:57.465076 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:57.465169 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:57.475215  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:57.475983  1537 raft_consensus.cc:2393] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 8: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:57.476118  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1652) took 1101 ms. Trace:
I20260709 12:57:57.476380  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 1653) took 1099 ms. Trace:
I20260709 12:57:57.476464  1536 rpcz_store.cc:276] 0709 12:57:56.374597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.475298 (+1100701us) service_pool.cc:224] Handling call
0709 12:57:57.475625 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:57.475791 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:57.475818 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:57.475859 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:57.475889 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:57.475949 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:57.476066 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:57:57.477667  1690 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 1328) took 1616 ms (client timeout 2108 ms). Trace:
W20260709 12:57:57.478053  1690 rpcz_store.cc:269] 0709 12:57:55.861562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.631421 (+769859us) service_pool.cc:224] Handling call
0709 12:57:57.477518 (+846097us) spinlock_profiling.cc:243] Waited 32 ms on lock 0x7b5400159354. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:57.477615 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73531776}
I20260709 12:57:57.467384  1684 raft_consensus.cc:2393] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 8: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:57.463016  1689 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:57:57.483538  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:57.484319  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:57.485481  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:57.486052  1615 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:57.487548  3956 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:57.491325  1581 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:57.492544  1581 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:57.483801  1610 raft_consensus.cc:1240] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:57.495513  1612 raft_consensus.cc:1240] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:57:57.495890  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:57.497009  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:57.497756  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:57.498765  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:57.499214  1537 rpcz_store.cc:276] 0709 12:57:56.377028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.442171 (+ 65143us) service_pool.cc:224] Handling call
0709 12:57:57.475071 (+1032900us) spinlock_profiling.cc:243] Waited 8.28 ms on lock 0x7b5800002798. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc8620170a0 00007fc862016984 00007fc85b5916d4 00007fc85b591662
0709 12:57:57.476331 (+  1260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19054336}
I20260709 12:57:57.509511  1615 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:57:57.509914  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:57.510463  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:57.511588  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:57.511904  1581 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:57.514192  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:57.515295  1581 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:57.494406  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:57.517832  1539 raft_consensus.cc:1240] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:57:57.517887  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:57.515329  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:57.513504  1654 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:57.519626  1613 raft_consensus.cc:2410] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:57:57.510500  1612 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:57.522266  1581 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:57.526912  1581 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:57.523262  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:57.522513  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:57.537820  1581 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:57.520397  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1029) took 1232 ms. Trace:
I20260709 12:57:57.527869  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:57.528640  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:57.529695  1616 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:57:57.541543  1539 rpcz_store.cc:276] 0709 12:57:56.288179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.449303 (+1161124us) service_pool.cc:224] Handling call
0709 12:57:57.517632 (+ 68329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:57.520151 (+  2519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:57.520345 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:57.547055  1612 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:57:57.522995  4206 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:57.513473  3955 raft_consensus.cc:2764] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:57:57.517040  4167 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:57:57.530397  4037 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:57.557086  1583 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:57.551095  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:57.568862  1537 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:57:57.565248  1505 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:57.570879  1505 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:57.572645  1505 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:57.524080  4176 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:57.574121  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:57.577639  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:57.578300  1539 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:57.579149  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:57.580026  4187 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:57.580690  4187 raft_consensus.cc:697] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:57.581733  4187 consensus_queue.cc:237] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:57.582052  3809 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:57.584169  3809 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:57.538930  4076 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:57.516798  3954 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:57:57.594749  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:57.595535  1539 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:57:57.549085  4150 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:57.551133  3972 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:57:57.544808  4165 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:57.596624  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:57:57.598294  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 201490us
I20260709 12:57:57.602823  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:57.627360  1508 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:57.627610  1539 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:57:57.628688  1508 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:57.562273  4167 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:57.591411  4105 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:57.633069  1508 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:57.674517  1508 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:57.675823  1508 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:57.550885  4136 consensus_queue.cc:1059] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 12:57:57.681905  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:57.683791  1537 raft_consensus.cc:2410] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:57:57.684185  1508 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:57.686681  1508 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:57.688211  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1635) took 1254 ms. Trace:
I20260709 12:57:57.693514  1508 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:57.695395  1508 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:57.688608  1689 rpcz_store.cc:276] 0709 12:57:56.433300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.481969 (+1048669us) service_pool.cc:224] Handling call
0709 12:57:57.482240 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:57.482418 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:57:57.509011 (+ 26593us) log.cc:844] Serialized 14 byte log entry
0709 12:57:57.687866 (+178855us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:57.687925 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:57.687969 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:57.688034 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:57.688159 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":935,"prepare.queue_time_us":654,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"thread_start_us":177524,"threads_started":1}
I20260709 12:57:57.671955  3809 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:57.676990  4167 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:57:57.672358  4165 raft_consensus.cc:697] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:57.600862  4076 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:57.711862  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1634) took 1278 ms. Trace:
I20260709 12:57:57.672962  4105 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:57.716017  1686 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:57:57.682687  4120 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:57.676689  4026 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:57:57.718144  1684 rpcz_store.cc:276] 0709 12:57:56.433078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.479947 (+1046869us) service_pool.cc:224] Handling call
0709 12:57:57.480229 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:57.480433 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:57:57.480745 (+   312us) log.cc:844] Serialized 14 byte log entry
0709 12:57:57.709503 (+228758us) log.cc:844] Serialized 14 byte log entry
0709 12:57:57.711517 (+  2014us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:57.711565 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:57.711608 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:57.711671 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:57.711794 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14921,"prepare.queue_time_us":3398,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":2689,"thread_start_us":190239,"threads_started":1}
I20260709 12:57:57.685599  4168 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:57.682089  4059 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:57.686800  3972 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:57.708099  3809 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:57.723354  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:57.702425  4202 raft_consensus.cc:3055] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:57.690063  3947 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:57:57.725809  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:57.726963  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:57.746548  1655 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:57:57.727056  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 170055us
I20260709 12:57:57.687902  4163 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:57.720666  4245 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:57.747042  1689 raft_consensus.cc:2393] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 7: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:57.702469  4174 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:57.747848  1583 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:57.725584  4105 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:57.752522  1583 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:57.750211  1655 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:57.751811  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:57.754655  1583 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:57.760251  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:57.742077  4068 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:57.765964  1539 raft_consensus.cc:2393] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 8: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:57.743191  3809 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:57.742604  4202 raft_consensus.cc:740] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:57.749452  3947 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:57.782963  1655 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:57.793027  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:57.828362  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1027) took 1540 ms. Trace:
I20260709 12:57:57.772099  3954 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:57.830149  1689 raft_consensus.cc:2368] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8.
I20260709 12:57:57.832054  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1635) took 2022 ms. Trace:
W20260709 12:57:57.832860  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 49996.6us
I20260709 12:57:57.834776  1655 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:57.819341  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1026) took 1531 ms. Trace:
W20260709 12:57:57.837039  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 48507.8us
I20260709 12:57:57.833014  1535 rpcz_store.cc:276] 0709 12:57:55.809924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.603275 (+793351us) service_pool.cc:224] Handling call
0709 12:57:56.603610 (+   335us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:57:56.653106 (+ 49496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:56.653133 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:57:56.662985 (+  9852us) log.cc:844] Serialized 52 byte log entry
0709 12:57:56.801700 (+138715us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:56.801746 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:57.791346 (+989600us) spinlock_profiling.cc:243] Waited 49.1 ms on lock 0x7b540010c2d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:57.791393 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:57.791449 (+    56us) raft_consensus.cc:1685] finished
0709 12:57:57.791463 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:57.831988 (+ 40525us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2870,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":9576,"spinlock_wait_cycles":112961792,"thread_start_us":114843,"threads_started":1,"wal-append.queue_time_us":308035}
I20260709 12:57:57.838441  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:57.839592  1688 raft_consensus.cc:2393] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 6: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 12:57:57.840696  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 74332.8us
I20260709 12:57:57.905493  1508 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:57:57.847138  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:57.778486  3972 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:57:57.881415  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:57.912782  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 78148.7us
I20260709 12:57:57.914124  1583 leader_election.cc:400] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 4. Current term is 5.
I20260709 12:57:57.786629  4174 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:57.916059  1583 leader_election.cc:403] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:57:57.786927  4205 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:57:57.964515  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 59098.6us
I20260709 12:57:57.965412  1508 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:57.818825  4251 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:57.831449  4187 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:57:57.792863  3947 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:57:57.967871  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 55726.7us
W20260709 12:57:57.958314  2269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:57.841656  4153 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:57.918041  1655 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:57.917877  4156 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:57:57.915041  3972 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:57.965533  4174 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:57.996781  1508 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:57.778832  4165 consensus_queue.cc:237] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.000116  4161 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:58.001737  4248 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 12:57:58.003265  3956 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 4 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:58.004309  2300 raft_consensus.cc:1240] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:57.999516  4257 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:57:58.010401  4257 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:58.010839  4257 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:57:57.998162  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 82401.3us
I20260709 12:57:58.014618  1655 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:58.015803  1655 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:58.016047  4243 log.cc:927] Time spent T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
I20260709 12:57:58.017326  4174 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:57.962960  3954 consensus_queue.cc:1059] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:57:58.020985  4156 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:57:58.021431  4156 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:57.975265  4259 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:58.021922  4156 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:57.986738  4205 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 12:57:58.022872  3978 consensus_meta.cc:287] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.585s	user 0.001s	sys 0.009s
I20260709 12:57:58.025003  1655 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:57.989868  3972 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:58.023356  3978 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:58.050356  1655 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:58.021332  3954 raft_consensus.cc:3055] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:57:58.047673  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 50979.8us
I20260709 12:57:57.996671  4160 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:58.008999  4153 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:57:58.107645  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 60607.3us
W20260709 12:57:58.026381  4247 log.cc:927] Time spent T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
W20260709 12:57:58.026609  4246 log.cc:927] Time spent T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:57:58.008016  4251 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 4. Current term is 5.
I20260709 12:57:57.968010  4202 consensus_queue.cc:260] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.046981  4143 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:57:58.118595  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 68348.1us
W20260709 12:57:58.112983  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 140426us
I20260709 12:57:58.051052  3870 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:58.112161  1508 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:58.104367  4161 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:58.023031  4205 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:58.124507  1655 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:58.117476  4037 consensus_meta.cc:287] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.000s
I20260709 12:57:58.123380  1583 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:57:58.135540  1691 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.035s	sys 0.044s
W20260709 12:57:58.135918  1691 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.035s	sys 0.044s
I20260709 12:57:58.112622  4076 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:58.133546  1508 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:57:58.131628  1581 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.001s	sys 0.009s
I20260709 12:57:58.113755  4215 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:58.113911  3965 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:58.138783  1581 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.001s	sys 0.009s
W20260709 12:57:58.162005  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 618827us
I20260709 12:57:58.052299  3809 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.162724  1581 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:58.162541  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1018) took 1877 ms. Trace:
I20260709 12:57:58.117307  4153 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:58.139474  1508 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:58.163760  1541 rpcz_store.cc:276] 0709 12:57:56.285363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.287617 (+1002254us) service_pool.cc:224] Handling call
0709 12:57:57.288000 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:57.288241 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:57:57.315630 (+ 27389us) log.cc:844] Serialized 14 byte log entry
0709 12:57:57.790678 (+475048us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b1800389e60. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf123a 00007fc85d05ba2a
0709 12:57:58.162174 (+371496us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:58.162225 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:58.162272 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:58.162353 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:58.162483 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21232,"prepare.queue_time_us":27137,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":22462,"spinlock_wait_cycles":7795456,"thread_start_us":349979,"threads_started":1}
I20260709 12:57:58.128794  4160 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:57:58.114142  3954 raft_consensus.cc:740] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:57:58.186239  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 46832.4us
I20260709 12:57:58.114315  4203 consensus_queue.cc:1059] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:57:58.187705  1508 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:58.135433  4184 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:58.192327  1508 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:58.162128  4251 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:57:58.184211  4247 log.cc:927] Time spent T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:57:58.162268  4037 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:58.165388  4104 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:58.183393  4076 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:57:58.163273  4235 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:58.227392  1508 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:58.185482  4168 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:57:58.198249  4206 consensus_meta.cc:287] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.637s	user 0.010s	sys 0.000s
W20260709 12:57:58.243170  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 80534.3us
I20260709 12:57:58.232950  4271 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:58.232512  3954 consensus_queue.cc:260] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.228693  4143 raft_consensus.cc:697] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 7 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:57:58.233723  4262 log.cc:927] Time spent T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
W20260709 12:57:58.194617  4260 log.cc:927] Time spent T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:57:58.192231  4160 raft_consensus.cc:697] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:58.197192  4068 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:57:58.191552  4153 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:57:58.246589  1508 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:58.166018  4215 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.231177  4259 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:58.182963  3965 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:57:58.251579  4255 log.cc:927] Time spent T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 12:57:58.241631  4251 raft_consensus.cc:697] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:58.249586  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1625) took 1818 ms. Trace:
I20260709 12:57:58.256945  1508 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:58.269413  3870 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:57:58.250871  4068 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:58.278290  4205 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:57:58.253751  4267 log.cc:927] Time spent T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:57:58.261458  4259 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:58.246480  4271 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:58.251233  4076 raft_consensus.cc:697] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:58.285422  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:58.281530  1581 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:58.252861  4059 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:57:58.248179  4206 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:58.275909  4143 consensus_queue.cc:237] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.288580  1508 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:58.289635  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:58.250975  4184 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:57:58.294087  4171 raft_consensus.cc:3055] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:57:58.279681  3954 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:57:58.289842  3870 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:58.327178  3870 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:58.278311  3965 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:58.304832  4271 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:58.346699  4156 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:58.302704  4233 log.cc:927] Time spent T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 1.124s	user 0.000s	sys 0.004s
I20260709 12:57:58.303877  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:58.292367  4068 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:57:58.380865  1541 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:58.381240  4059 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:58.381707  4059 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:58.293778  4146 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:58.383033  4146 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.384881  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1640) took 2375 ms. Trace:
I20260709 12:57:58.385286  4146 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:58.307355  1508 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:57:58.386258  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 79003.1us
I20260709 12:57:58.386407  4026 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:58.386809  4026 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:58.387137  4026 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:58.387244  1508 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:58.389061  4187 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:57:58.389451  4187 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:58.389791  4187 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:58.307993  4171 raft_consensus.cc:740] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:58.391752  4171 consensus_queue.cc:260] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.393030  4171 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:57:58.306558  4184 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:58.395196  4184 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:57:58.385285  1533 rpcz_store.cc:276] 0709 12:57:56.009831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.767347 (+757516us) service_pool.cc:224] Handling call
0709 12:57:56.767768 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:56.965945 (+198177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:56.965979 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:56.968242 (+  2263us) log.cc:844] Serialized 26 byte log entry
0709 12:57:57.065086 (+ 96844us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:57.065126 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:57.065193 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:58.302056 (+1236863us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:57:58.384551 (+ 82495us) raft_consensus.cc:1685] finished
0709 12:57:58.384574 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:58.384813 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6404352,"thread_start_us":96519,"threads_started":1,"wal-append.queue_time_us":144544}
I20260709 12:57:58.397855  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1322) took 2608 ms. Trace:
I20260709 12:57:58.313184  4076 consensus_queue.cc:237] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.314299  4251 consensus_queue.cc:237] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.289898  4168 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:58.316344  4215 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:58.305460  4259 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:58.347762  1686 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:57:58.349524  3978 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:58.301685  4105 consensus_meta.cc:287] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.530s	user 0.007s	sys 0.001s
I20260709 12:57:58.357524  3809 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:58.308171  4245 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:57:58.446487  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 322089us
I20260709 12:57:58.436784  4156 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:57:58.360759  4167 consensus_meta.cc:287] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.639s	user 0.010s	sys 0.000s
I20260709 12:57:58.361533  3870 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:58.362637  1614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 1039) took 2063 ms (client timeout 2505 ms). Trace:
I20260709 12:57:58.362950  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 96) took 2758 ms. Trace:
I20260709 12:57:58.365588  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1646) took 2153 ms. Trace:
I20260709 12:57:58.365917  4266 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:57:58.366562  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 85120.3us
I20260709 12:57:57.831732  1542 rpcz_store.cc:276] 0709 12:57:56.287679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.442587 (+1154908us) service_pool.cc:224] Handling call
0709 12:57:57.442819 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:57.442984 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:57:57.707330 (+264346us) log.cc:844] Serialized 14 byte log entry
0709 12:57:57.827968 (+120638us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:57.828024 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:57.828078 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:57.828144 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:57.828290 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69564,"prepare.queue_time_us":182530,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":6586,"raft.queue_time_us":1133,"thread_start_us":297307,"threads_started":2}
I20260709 12:57:58.369870  4271 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:58.376610  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.376751  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:58.450021  1687 rpcz_store.cc:276] 0709 12:57:55.604393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.377670 (+773277us) service_pool.cc:224] Handling call
0709 12:57:56.378065 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:57.280952 (+902887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:57.280985 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:57.281565 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 12:57:57.432681 (+151116us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:57.432720 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:58.362562 (+929842us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b54000df054. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:58.362604 (+    42us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:58.362652 (+    48us) raft_consensus.cc:1685] finished
0709 12:57:58.362667 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:58.362893 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":902,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":125,"spinlock_wait_cycles":2075575040,"thread_start_us":104659,"threads_started":1,"wal-append.queue_time_us":222398}
I20260709 12:57:58.378949  3947 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.310053  4160 consensus_queue.cc:237] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.402760  1541 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 9.
I20260709 12:57:58.402953  4068 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.403716  1508 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:58.335987  4257 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:58.380287  1582 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.842s	user 0.002s	sys 0.009s
W20260709 12:57:58.459609  1582 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.921s	user 0.003s	sys 0.009s
W20260709 12:57:58.460042  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 955690us
W20260709 12:57:58.460785  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.463508  1582 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:58.415556  2269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.425668  3954 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.431169  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 1365) took 1066 ms. Trace:
I20260709 12:57:58.427575  4187 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.432685  4184 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.286363  1691 rpcz_store.cc:276] 0709 12:57:56.430853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.310673 (+879820us) service_pool.cc:224] Handling call
0709 12:57:57.310971 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:57.311141 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:57:57.407734 (+ 96593us) log.cc:844] Serialized 14 byte log entry
0709 12:57:58.226853 (+819119us) log.cc:844] Serialized 14 byte log entry
0709 12:57:58.249213 (+ 22360us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:58.249265 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:58.249321 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:58.249404 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:58.249527 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26544,"prepare.queue_time_us":137174,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":3451,"raft.queue_time_us":72520,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":9573,"spinlock_wait_cycles":8930048,"thread_start_us":905738,"threads_started":3,"wal-append.queue_time_us":784645}
W20260709 12:57:58.412197  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.407444  1683 rpcz_store.cc:276] 0709 12:57:55.789998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.224677 (+1434679us) service_pool.cc:224] Handling call
0709 12:57:57.253374 (+ 28697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:57.421046 (+167672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:58.397595 (+976549us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b5400337cd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:58.397790 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":384352512}
I20260709 12:57:58.428879  4026 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.486898  4026 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:58.469398  4276 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:57:58.490370  4068 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:57:58.492812  4258 log.cc:927] Time spent T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.372s	user 0.004s	sys 0.000s
W20260709 12:57:58.494351  4263 log.cc:927] Time spent T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.467s	user 0.001s	sys 0.000s
I20260709 12:57:58.435772  4153 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.331924  3972 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.447459  1655 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:57:58.504081  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 56729.3us
W20260709 12:57:58.449927  1614 rpcz_store.cc:269] 0709 12:57:56.298906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.307041 (+  8135us) service_pool.cc:224] Handling call
0709 12:57:58.362422 (+2055381us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b54001f63d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:58.362575 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":755232000}
I20260709 12:57:58.450543  1540 rpcz_store.cc:276] 0709 12:57:56.211953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.959311 (+747358us) service_pool.cc:224] Handling call
0709 12:57:56.959576 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:57.087899 (+128323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:57.087919 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:57.087949 (+    30us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:57.087972 (+    23us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:58.365331 (+1277359us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54002e7a54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:58.365387 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:58.365526 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":294599936}
I20260709 12:57:58.456714  4156 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:58.446101  4245 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:57:58.465360  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 76991.2us
I20260709 12:57:58.469980  3809 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:58.472594  1682 rpcz_store.cc:276] 0709 12:57:57.364901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.382661 (+ 17760us) service_pool.cc:224] Handling call
0709 12:57:58.405161 (+1022500us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b540041c654. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:58.431107 (+ 25946us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85910400}
I20260709 12:57:58.480322  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:58.472554  4215 consensus_queue.cc:1059] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:57:58.483868  1617 raft_consensus.cc:1240] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:58.484436  4187 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:58.484715  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:58.497831  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:58.498749  1615 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:57:58.471942  3954 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.524129  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:58.524089  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:58.525381  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:58.525569  3954 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:58.446749  4059 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.525895  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:58.526432  1617 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:58.527228  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1638) took 2078 ms. Trace:
I20260709 12:57:58.527552  4059 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:58.271641  4120 consensus_queue.cc:1059] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:57:58.505558  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:58.529501  2301 raft_consensus.cc:2368] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9.
I20260709 12:57:58.530056  4153 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:58.447404  4105 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.531903  4105 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:58.451983  1581 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:58.507114  1691 raft_consensus.cc:1240] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:57:58.532889  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 81036.1us
I20260709 12:57:58.533419  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1636) took 2096 ms. Trace:
I20260709 12:57:58.467859  1654 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:58.535197  4266 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:57:58.536247  4268 log.cc:927] Time spent T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
I20260709 12:57:58.513522  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:58.449153  4167 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.537914  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:58.538950  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:58.539093  4120 raft_consensus.cc:3055] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:57:58.539649  4167 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:58.473039  4171 raft_consensus.cc:2804] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:57:58.482937  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:58.533919  1617 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:58.542131  3972 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:58.543591  3870 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:58.517446  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:58.518754  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:58.519994  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:58.521669  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:58.526450  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:58.540894  1687 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:58.524037  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:58.546695  1609 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:58.547557  1612 raft_consensus.cc:2393] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 7: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:58.545454  1610 raft_consensus.cc:2376] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7. Re-sending same reply.
I20260709 12:57:58.552695  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:58.566408  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:58.567492  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:58.533749  1691 rpcz_store.cc:276] 0709 12:57:56.437298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.501323 (+2064025us) service_pool.cc:224] Handling call
0709 12:57:58.501697 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:58.533173 (+ 31476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:58.533368 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:57:58.518234  4264 log.cc:927] Time spent T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.412s	user 0.004s	sys 0.000s
I20260709 12:57:58.571964  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1637) took 2130 ms. Trace:
I20260709 12:57:58.572490  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:58.572373  1683 rpcz_store.cc:276] 0709 12:57:56.442060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.514251 (+2072191us) service_pool.cc:224] Handling call
0709 12:57:58.571482 (+ 57231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:58.571658 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:58.571682 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:58.571720 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:57:58.571749 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:58.571797 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:58.571909 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:57:58.574440  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 106701us
I20260709 12:57:58.576022  1582 leader_election.cc:400] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Vote denied by peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437) with higher term. Message: Invalid argument: T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9.
I20260709 12:57:58.573720  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:58.547158  1613 raft_consensus.cc:2393] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 8: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:58.540199  1611 raft_consensus.cc:1240] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:58.579089  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:58.527601  1682 rpcz_store.cc:276] 0709 12:57:56.448616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.514783 (+2066167us) service_pool.cc:224] Handling call
0709 12:57:58.526771 (+ 11988us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:58.526946 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:58.526970 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:58.527008 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:57:58.527036 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:58.527084 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:58.527175 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:58.583587  1687 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 9.
I20260709 12:57:58.515959  4143 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:57:58.515134  4245 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:58.588387  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1641) took 1270 ms. Trace:
I20260709 12:57:58.588963  1505 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:58.588783  1691 rpcz_store.cc:276] 0709 12:57:57.317821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.587667 (+1269846us) service_pool.cc:224] Handling call
0709 12:57:58.587935 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:58.588099 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:58.588122 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:58.588157 (+    35us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:58.588191 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:58.588238 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:58.588338 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:58.577772  1654 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:58.590422  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1640) took 1277 ms. Trace:
I20260709 12:57:58.590633  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1642) took 1262 ms. Trace:
I20260709 12:57:58.540274  4171 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:57:58.591599  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 51637.7us
I20260709 12:57:58.603981  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:58.528820  3947 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:58.596843  4105 consensus_queue.cc:1059] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:58.597113  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:58.539659  4120 raft_consensus.cc:740] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:58.610674  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:58.611101  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:58.611253  1508 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:58.596843  1614 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10. Ops: []
I20260709 12:57:58.597514  4167 consensus_queue.cc:1059] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:57:58.598019  4187 consensus_queue.cc:1059] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:58.594866  1505 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:58.601037  4153 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:57:58.604982  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:58.591012  1691 rpcz_store.cc:276] 0709 12:57:57.328450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.589921 (+1261471us) service_pool.cc:224] Handling call
0709 12:57:58.590182 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:58.590354 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:58.590378 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:58.590415 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:58.590445 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:58.590496 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:58.590588 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:58.616983  1617 raft_consensus.cc:2393] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 5: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:58.590873  1687 rpcz_store.cc:276] 0709 12:57:57.312899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.585270 (+1272371us) service_pool.cc:224] Handling call
0709 12:57:58.585561 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:58.585800 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:58.585827 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:58.585866 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:58.585896 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:58.585947 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:58.590370 (+  4423us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:58.608248  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:58.518688  4156 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.613215  1505 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:58.587069  4059 raft_consensus.cc:3055] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:58.628106  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:58.628821  1691 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:58.609475  1609 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:57:58.619829  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:58.620159  4105 raft_consensus.cc:3055] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:58.620533  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:58.623525  4167 raft_consensus.cc:3055] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:57:58.624815  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:58.625114  1581 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:58.520869  3809 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.597374  4026 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:58.587456  4275 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:57:58.608738  4171 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:58.630677  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:58.608985  4143 raft_consensus.cc:697] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 8 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:58.640439  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:58.641117  1541 raft_consensus.cc:1240] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:58.641343  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:58.642036  1542 raft_consensus.cc:1240] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:58.643968  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:58.614085  3460 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:58.618346  3870 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:58.702054  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:58.645416  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:58.649333  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:58.703387  1687 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:58.650148  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:58.706476  1537 raft_consensus.cc:2393] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 7: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:58.653158  3809 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:58.638705  4104 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:57:58.698935  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:58.722214  1541 raft_consensus.cc:2368] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8.
I20260709 12:57:58.699326  1533 raft_consensus.cc:2393] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 7: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:58.627928  4059 raft_consensus.cc:740] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:58.630824  4167 raft_consensus.cc:740] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:58.632006  4105 raft_consensus.cc:740] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:58.732093  1611 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:57:58.732895  1611 raft_consensus.cc:606] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:58.733256  1611 raft_consensus.cc:614] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:58.628396  4271 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:58.714026  1687 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:58.738315  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:58.739022  1687 raft_consensus.cc:2393] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 9: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:58.642597  4116 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:57:58.640002  4153 raft_consensus.cc:697] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:58.634856  4068 consensus_queue.cc:1059] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 12:57:58.736884  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:58.701267  4275 raft_consensus.cc:697] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 5 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:58.646667  4187 consensus_queue.cc:1059] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 12:57:58.741859  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:58.745738  1611 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 8.
I20260709 12:57:58.746794  1611 raft_consensus.cc:1240] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:58.702634  3954 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:58.740430  1654 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:58.743575  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:58.721989  3460 raft_consensus.cc:697] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:58.751922  1687 raft_consensus.cc:2393] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 8: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:58.734011  4146 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:58.761950  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:58.763305  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:58.764230  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:58.765859  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:58.766396  1683 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:58.747140  4068 consensus_queue.cc:1243] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:57:58.769086  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:58.770270  1687 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:58.773314  3460 consensus_queue.cc:237] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.751364  3965 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:57:58.717264  4120 consensus_queue.cc:260] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.750687  4257 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:58.743628  4170 consensus_queue.cc:1059] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:57:58.754269  4189 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.789073  4170 raft_consensus.cc:3055] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:57:58.789601  4170 raft_consensus.cc:740] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:58.789834  4275 consensus_queue.cc:237] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.790716  4178 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:58.768990  4167 consensus_queue.cc:260] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.794288  4120 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:58.794741  4167 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:58.797629  4277 raft_consensus.cc:3055] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:58.798084  4277 raft_consensus.cc:740] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:58.798686  4171 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.798878  4277 consensus_queue.cc:260] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:58.757001  3954 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.793272  4153 consensus_queue.cc:237] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.802026  3954 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:58.767338  4146 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.791153  4184 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:58.772315  4105 consensus_queue.cc:260] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.767269  4059 consensus_queue.cc:260] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.790521  4170 consensus_queue.cc:260] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.814978  4146 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:58.815651  4170 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:57:58.792604  4189 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.818476  4189 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:58.819746  4168 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:58.821550  3947 raft_consensus.cc:3055] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:57:58.822005  3947 raft_consensus.cc:740] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:58.822160  4156 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:58.822834  3947 consensus_queue.cc:260] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.782073  4143 consensus_queue.cc:237] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.824067  3947 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:57:58.825953  4254 log.cc:927] Time spent T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.776s	user 0.001s	sys 0.004s
I20260709 12:57:58.830791  4245 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.831245  4202 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:58.815510  4059 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:58.834617  4171 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:58.835857  4105 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:58.837173  4259 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.839339  4259 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:58.822857  4195 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:58.814549  4277 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:58.850109  4245 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:58.854367  4215 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:58.854944  4215 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:58.711920  1508 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:57:58.897866  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 268293us
I20260709 12:57:58.898991  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1634) took 3089 ms. Trace:
W20260709 12:57:58.899194  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.698182  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:57:58.900890  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 188943us
W20260709 12:57:58.932142  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.922514  1685 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
W20260709 12:57:58.921856  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.910955  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1632) took 2478 ms. Trace:
I20260709 12:57:58.910691  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1362) took 2082 ms. Trace:
I20260709 12:57:58.924156  1581 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:58.962332  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.972715  4215 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:58.904466  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:57:58.972731  2269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:58.968642  4153 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:57:58.980590  4245 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:57:58.981393  4153 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:58.988653  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:58.989681  1615 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:58.948088  4275 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:57:58.991497  4275 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:58.902783  1505 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
W20260709 12:57:59.011292  1686 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 1659) took 1521 ms (client timeout 1810 ms). Trace:
W20260709 12:57:59.012038  1686 rpcz_store.cc:269] 0709 12:57:57.489852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.723054 (+233202us) service_pool.cc:224] Handling call
0709 12:57:59.010707 (+1287653us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b540008e8d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:59.011012 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1319908736}
I20260709 12:57:59.019363  1537 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:57:58.962169  4251 consensus_queue.cc:1059] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
W20260709 12:57:59.023890  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:59.024665  4275 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:57.836650  1538 rpcz_store.cc:276] 0709 12:57:56.287385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.431198 (+1143813us) service_pool.cc:224] Handling call
0709 12:57:57.434280 (+  3082us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:57.434598 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:57:57.512774 (+ 78176us) log.cc:844] Serialized 14 byte log entry
0709 12:57:57.818531 (+305757us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:57.818663 (+   132us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:57.818778 (+   115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:57.818919 (+   141us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:57.819200 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":103092,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":232,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":15998,"thread_start_us":304881,"threads_started":1}
I20260709 12:57:59.027776  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:59.028127  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:57:59.028740  1617 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:59.029065  1538 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:59.029587  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:59.024991  4076 consensus_queue.cc:1059] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:57:59.034657  4076 raft_consensus.cc:3055] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:59.035188  4076 raft_consensus.cc:740] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:59.027576  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:59.038928  1542 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:57:59.041283  1542 raft_consensus.cc:1275] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:57:59.043089  1542 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:57:58.951756  1690 rpcz_store.cc:276] 0709 12:57:56.432559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.478840 (+1046281us) service_pool.cc:224] Handling call
0709 12:57:57.479151 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:57.479540 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:57.479566 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:57.480015 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 12:57:57.711612 (+231597us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:57.711646 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:57.711703 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:58.829274 (+1117571us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b240024d0b8. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859dea9c4 00007fc859de8acb 00007fc859fa3dc9 00007fc859fa3a55 00007fc859fa2fb0 00007fc85cc19488 00007fc85cc19be8 00007fc85cbf1398 00007fc85cbec76a 00007fc85cbebbb6
0709 12:57:58.910067 (+ 80793us) raft_consensus.cc:1685] finished
0709 12:57:58.910115 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:58.910661 (+   546us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":194,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":83,"spinlock_wait_cycles":4208512,"thread_start_us":231286,"threads_started":1,"wal-append.queue_time_us":434251}
I20260709 12:57:59.046271  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:59.046634  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:58.954484  1682 rpcz_store.cc:276] 0709 12:57:56.828169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:58.591777 (+1763608us) service_pool.cc:224] Handling call
0709 12:57:58.615910 (+ 24133us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:58.616196 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:58.616214 (+    18us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:58.626709 (+ 10495us) log.cc:844] Serialized 26 byte log entry
0709 12:57:58.742321 (+115612us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:58.742361 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:58.742427 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:58.910014 (+167587us) raft_consensus.cc:1685] finished
0709 12:57:58.910056 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:58.910411 (+   355us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2133,"raft.queue_time_us":1711,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":5300,"thread_start_us":40257,"threads_started":1,"wal-append.queue_time_us":125704}
I20260709 12:57:59.052738  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:59.053404  3809 raft_consensus.cc:3055] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:57:59.053905  3809 raft_consensus.cc:740] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:59.055245  1533 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 9. Current term is 10. Ops: []
I20260709 12:57:59.056850  4153 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:59.048815  1539 raft_consensus.cc:1240] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:59.039204  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:57:59.053599  1688 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:58.899786  1534 rpcz_store.cc:276] 0709 12:57:55.809704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.467407 (+657703us) service_pool.cc:224] Handling call
0709 12:57:57.536240 (+1068833us) spinlock_profiling.cc:243] Waited 995 us on lock 0x7b5800002798. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc86202afc0 00007fc862015929 00007fc8620153d2 00007fc85b58cbd4
0709 12:57:57.536432 (+   192us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:57.536785 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:57.536810 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:57.537239 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 12:57:57.718641 (+181402us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:57.718891 (+   250us) log.cc:844] Serialized 14 byte log entry
0709 12:57:57.787195 (+ 68304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:57.787284 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:58.825415 (+1038131us) spinlock_profiling.cc:243] Waited 52.4 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:57:58.898007 (+ 72592us) raft_consensus.cc:1685] finished
0709 12:57:58.898104 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:58.898649 (+   545us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20972,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":15770,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":19938,"spinlock_wait_cycles":122724608,"thread_start_us":249074,"threads_started":2,"wal-append.queue_time_us":477442}
I20260709 12:57:59.071280  1616 raft_consensus.cc:1240] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:59.076365  1537 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
W20260709 12:57:59.063958  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 161507us
I20260709 12:57:59.078109  1617 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 9.
I20260709 12:57:59.080034  1508 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:59.081212  4245 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:57:59.065691  3460 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:57:59.083144  3460 raft_consensus.cc:697] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:59.063144  4176 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:57:59.067499  1689 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:59.062781  1615 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 4.
I20260709 12:57:59.084929  3460 consensus_queue.cc:237] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.069355  4251 raft_consensus.cc:3055] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:59.136698  4251 raft_consensus.cc:740] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:59.137948  4251 consensus_queue.cc:260] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.139675  4251 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:57:59.096462  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "1d6516ff61104bdda54bde95e92fe579"
 from {username='slave'} at 127.0.0.1:45440
I20260709 12:57:59.141109  1682 raft_consensus.cc:606] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Received request to transfer leadership to TS 1d6516ff61104bdda54bde95e92fe579
I20260709 12:57:59.141208  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:59.141618  1682 raft_consensus.cc:614] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:57:59.142453  1614 raft_consensus.cc:2393] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 8: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:57:59.143792  1682 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9. Ops: []
I20260709 12:57:59.064798  2269 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:59.145110  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:59.109323  1583 leader_election.cc:400] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8.
I20260709 12:57:59.113294  3742 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:57:59.146042  1508 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:59.147537  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:59.148352  4245 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:59.118623  1685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 1369) took 1752 ms (client timeout 2065 ms). Trace:
I20260709 12:57:59.148269  4187 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:59.149478  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:59.149662  4187 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.149874  4245 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.108222  1683 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:57:59.150848  1608 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
W20260709 12:57:59.145397  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 80812.1us
I20260709 12:57:59.148835  4259 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:57:59.123526  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 199853us
I20260709 12:57:59.128197  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:59.152398  4259 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.155952  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1644) took 1817 ms. Trace:
I20260709 12:57:59.158429  1581 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:59.160567  4266 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:57:59.163575  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1643) took 1831 ms. Trace:
I20260709 12:57:59.163954  4245 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:59.164327  1682 rpcz_store.cc:276] 0709 12:57:57.332558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.142911 (+1810353us) service_pool.cc:224] Handling call
0709 12:57:59.143451 (+   540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:59.144326 (+   875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:59.163428 (+ 19102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:59.167083  1682 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9. Ops: []
W20260709 12:57:59.099924  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:59.134259  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:59.169945  1686 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:59.134768  1533 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:57:59.102424  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 595562us
I20260709 12:57:59.145376   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:57:59.145954  1583 leader_election.cc:403] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:57:59.067719  3809 consensus_queue.cc:260] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.171983  1655 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:59.173017  4176 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8.
I20260709 12:57:59.173960  1655 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:57:59.171945  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 63032.1us
I20260709 12:57:59.174268  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:59.174889  4160 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:57:59.175542   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:57:59.175776  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:59.177661  3954 consensus_queue.cc:1059] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:57:59.181555  3954 raft_consensus.cc:3055] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:57:59.181929  1688 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:57:59.183472  1688 raft_consensus.cc:1240] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9. Ops: []
I20260709 12:57:59.146086  4238 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:57:59.108047  4076 consensus_queue.cc:260] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.184062  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1650) took 1794 ms. Trace:
I20260709 12:57:59.159787  1684 rpcz_store.cc:276] 0709 12:57:57.338640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.154314 (+1815674us) service_pool.cc:224] Handling call
0709 12:57:59.154913 (+   599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:59.155422 (+   509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:59.155459 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:59.155549 (+    90us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:59.155600 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:59.155705 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:59.155845 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:59.200094  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:57:59.168684  4245 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:57:59.131098  1687 raft_consensus.cc:2410] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:57:59.167963  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 69568us
I20260709 12:57:59.184856  4076 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:57:59.149147  1685 rpcz_store.cc:269] 0709 12:57:57.365963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.396051 (+ 30088us) service_pool.cc:224] Handling call
0709 12:57:59.118370 (+1722319us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b5400158954. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:59.118533 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3456031104}
W20260709 12:57:59.169116  1691 consensus_meta.cc:287] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.540s	user 0.001s	sys 0.018s
I20260709 12:57:59.188230  2266 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:57:59.170976  4259 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:59.181977  3954 raft_consensus.cc:740] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:59.194271  4238 raft_consensus.cc:697] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 9 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:57:59.192307  3809 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:59.168291  4187 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:59.196900  1534 raft_consensus.cc:1240] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 9. Current term is 10. Ops: []
I20260709 12:57:59.198014  1583 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:59.131953  1689 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:57:59.211984  1683 raft_consensus.cc:1240] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:59.119459  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 125) took 2413 ms. Trace:
I20260709 12:57:59.212373  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:59.205062  1581 leader_election.cc:400] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8.
I20260709 12:57:59.193349  1538 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:57:59.207109  1690 raft_consensus.cc:2393] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 9: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:57:59.207695  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1648) took 1817 ms. Trace:
I20260709 12:57:59.213773  1682 rpcz_store.cc:276] 0709 12:57:57.385039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.166249 (+1781210us) service_pool.cc:224] Handling call
0709 12:57:59.166839 (+   590us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:59.201789 (+ 34950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:59.201989 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:59.190429  1537 raft_consensus.cc:1240] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:59.215155  1690 raft_consensus.cc:1240] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 4. Current term is 5. Ops: []
I20260709 12:57:59.200891  1688 rpcz_store.cc:276] 0709 12:57:57.389805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.182839 (+1793034us) service_pool.cc:224] Handling call
0709 12:57:59.183162 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:59.183842 (+   680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:59.184008 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:59.217725  1691 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:57:59.220433  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:59.221308  4160 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:57:59.222159  4160 raft_consensus.cc:697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 8 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:59.222806  4277 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:59.223485  4160 consensus_queue.cc:237] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:57:59.224601  4087 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:59.231710  4087 raft_consensus.cc:697] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 4 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:57:59.225963  4238 consensus_queue.cc:237] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:59.228075  1685 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:59.223632  4277 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.140358  1438 catalog_manager.cc:5697] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:59.215850  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:57:59.235320  1682 raft_consensus.cc:1240] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:59.230705  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1655) took 1800 ms. Trace:
I20260709 12:57:59.240667  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1645) took 1886 ms. Trace:
I20260709 12:57:59.247011  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1652) took 1834 ms. Trace:
I20260709 12:57:59.236742  1686 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:57:59.247433  1685 rpcz_store.cc:276] 0709 12:57:57.412127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.211071 (+1798944us) service_pool.cc:224] Handling call
0709 12:57:59.227731 (+ 16660us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:59.244510 (+ 16779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:59.246949 (+  2439us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:59.248413  1690 rpcz_store.cc:276] 0709 12:57:57.430056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.214048 (+1783992us) service_pool.cc:224] Handling call
0709 12:57:59.214754 (+   706us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:59.230402 (+ 15648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:59.230628 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:59.249751  1508 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:59.212754  1536 rpcz_store.cc:276] 0709 12:57:56.705536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.477477 (+771941us) service_pool.cc:224] Handling call
0709 12:57:57.477762 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:57.477995 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:57:58.967278 (+1489283us) spinlock_profiling.cc:243] Waited 3.6 ms on lock 0x7b1800403480. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc85cbf94bc 00007fc859f4748b 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f61455 00007fc860a493c7 00007fc85d05b9a7 00007fc85d06b0bf
0709 12:57:58.967543 (+   265us) log.cc:844] Serialized 14 byte log entry
0709 12:57:59.097386 (+129843us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:59.112623 (+ 15237us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:57:59.112767 (+   144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:59.119088 (+  6321us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:59.119262 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85704,"prepare.queue_time_us":212726,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":61,"raft.queue_time_us":28737,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":154,"spinlock_wait_cycles":8268544,"thread_start_us":226874,"threads_started":2}
I20260709 12:57:59.248847  1683 rpcz_store.cc:276] 0709 12:57:57.346072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.157870 (+1811798us) service_pool.cc:224] Handling call
0709 12:57:59.211800 (+ 53930us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:59.212418 (+   618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:59.229867 (+ 17449us) spinlock_profiling.cc:243] Waited 53.4 ms on lock 0x7b54003377d0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:59.232299 (+  2432us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122755328}
W20260709 12:57:59.259191  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 61368.4us
I20260709 12:57:59.259616  1687 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:57:59.262516  1691 raft_consensus.cc:1275] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 12:57:59.263000  1691 pending_rounds.cc:85] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 2
I20260709 12:57:59.263266  1691 pending_rounds.cc:107] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 12:57:59.263532  1691 raft_consensus.cc:2889] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:57:59.258113  1684 raft_consensus.cc:1240] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9. Ops: []
I20260709 12:57:59.260324  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1661) took 1769 ms. Trace:
I20260709 12:57:59.264456  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1664) took 1740 ms. Trace:
I20260709 12:57:59.265398  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1651) took 1857 ms. Trace:
I20260709 12:57:59.279851  1684 rpcz_store.cc:276] 0709 12:57:57.408378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.211607 (+1803229us) service_pool.cc:224] Handling call
0709 12:57:59.253725 (+ 42118us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:59.265109 (+ 11384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:59.265340 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:57:59.269188  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 50694.9us
I20260709 12:57:59.275508  1541 raft_consensus.cc:1240] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9. Ops: []
W20260709 12:57:59.268663  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 80556.1us
I20260709 12:57:59.278934  1691 rpcz_store.cc:276] 0709 12:57:57.523575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.261618 (+1738043us) service_pool.cc:224] Handling call
0709 12:57:59.262006 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:59.264147 (+  2141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:59.264368 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:57:59.269447  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 95759.5us
I20260709 12:57:59.271450  1534 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:57:59.284548  1533 raft_consensus.cc:2393] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 10: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:57:59.266165  4037 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:59.287034  4037 raft_consensus.cc:697] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:59.287207  1691 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:57:59.272293  4276 consensus_queue.cc:1059] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:57:59.288658  4165 raft_consensus.cc:3055] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:57:59.289103  4165 raft_consensus.cc:740] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:59.277426  4087 consensus_queue.cc:237] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:59.289950  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1653) took 1875 ms. Trace:
I20260709 12:57:59.270705  3954 consensus_queue.cc:260] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.290336  1689 rpcz_store.cc:276] 0709 12:57:57.414272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.213166 (+1798894us) service_pool.cc:224] Handling call
0709 12:57:59.251590 (+ 38424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:59.289610 (+ 38020us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:59.289639 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:59.289709 (+    70us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:59.289744 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:59.289797 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:59.289898 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:59.289402  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1658) took 1799 ms. Trace:
I20260709 12:57:59.268992  1687 rpcz_store.cc:276] 0709 12:57:57.490372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.252670 (+1762298us) service_pool.cc:224] Handling call
0709 12:57:59.259384 (+  6714us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:59.260039 (+   655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:59.260248 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:59.288200  4037 consensus_queue.cc:237] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.294019  1688 rpcz_store.cc:276] 0709 12:57:57.489528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.217084 (+1727556us) service_pool.cc:224] Handling call
0709 12:57:59.253250 (+ 36166us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:59.289068 (+ 35818us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:59.289093 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:59.289140 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:57:59.289179 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:59.289237 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:59.289343 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:59.290517  1537 raft_consensus.cc:1240] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: []
I20260709 12:57:59.297812  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 102) took 1283 ms. Trace:
I20260709 12:57:59.298254  1691 rpcz_store.cc:276] 0709 12:57:58.010156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.286473 (+1276317us) service_pool.cc:224] Handling call
0709 12:57:59.286862 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:59.290660 (+  3798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:59.293473 (+  2813us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:59.298527  1655 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:59.275013  4153 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:57:59.265391  1438 catalog_manager.cc:5697] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 6 to 7, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:59.310947  1538 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9. Ops: []
I20260709 12:57:59.311334  1654 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:57:59.318301  4165 consensus_queue.cc:260] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.321116  3954 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:59.327199  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:59.274302  4271 consensus_queue.cc:1059] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:57:59.329200  1691 raft_consensus.cc:1240] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:59.338665  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:59.339380  1617 raft_consensus.cc:1275] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:57:59.340379  1610 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:57:59.341106  4153 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:59.342603  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:59.343658  4153 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:57:59.344910  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:59.345515  1690 raft_consensus.cc:1240] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 8 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: []
I20260709 12:57:59.346391  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1665) took 1810 ms. Trace:
I20260709 12:57:59.346725  1690 rpcz_store.cc:276] 0709 12:57:57.535675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.280060 (+1744385us) service_pool.cc:224] Handling call
0709 12:57:59.305670 (+ 25610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:59.346167 (+ 40497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:59.346340 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:59.348286  1689 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:57:59.349042  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1668) took 1057 ms. Trace:
I20260709 12:57:59.349365  1689 rpcz_store.cc:276] 0709 12:57:58.291653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.297624 (+1005971us) service_pool.cc:224] Handling call
0709 12:57:59.301547 (+  3923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:59.348772 (+ 47225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:59.348984 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:57:59.272990  4176 consensus_queue.cc:1059] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:57:59.339373  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:59.344954  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:59.355094  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:59.360677  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:59.361034  1690 raft_consensus.cc:1275] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:57:59.361488  1690 pending_rounds.cc:85] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 4
I20260709 12:57:59.365540  1690 pending_rounds.cc:107] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:57:59.365811  1690 raft_consensus.cc:2889] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:57:59.372100  4301 log.cc:927] Time spent T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:57:59.372562  4171 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:57:59.374922  1691 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:57:59.355559  4165 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:59.362443  1438 catalog_manager.cc:5697] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 5 to 8, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
W20260709 12:57:59.377061  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 155566us
I20260709 12:57:59.379714  1691 pending_rounds.cc:85] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 3
I20260709 12:57:59.385108  1691 pending_rounds.cc:107] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:57:59.385427  1691 raft_consensus.cc:2889] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:57:59.376585  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 65326us
W20260709 12:57:59.390164  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 93522us
I20260709 12:57:59.392594  1508 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:59.357757  4309 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:57:59.396660  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:59.413154  3460 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:59.414083  3460 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.415292  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:57:59.416834  1438 catalog_manager.cc:5697] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 4 to 7, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 7 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:59.418182  4277 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:59.418641  4076 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:57:59.424894  4059 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:57:59.425431  1536 raft_consensus.cc:1240] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:59.425426  4059 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:59.427294  4059 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:59.431228  4176 consensus_queue.cc:1059] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:57:59.432127  1508 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:57:59.433640  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 273210us
I20260709 12:57:59.434026  1508 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:59.434818  4187 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:57:59.434612  4271 consensus_queue.cc:1059] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:59.438344  4266 consensus_queue.cc:1059] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:57:59.401664  4259 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:59.425576  1656 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:59.390347  3809 consensus_queue.cc:1048] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:57:59.453950  1541 raft_consensus.cc:1240] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:59.454686  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 100) took 1625 ms. Trace:
I20260709 12:57:59.455041  1684 rpcz_store.cc:276] 0709 12:57:57.829557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.296680 (+1467123us) service_pool.cc:224] Handling call
0709 12:57:59.309939 (+ 13259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:59.355091 (+ 45152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:59.355125 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:59.358973 (+  3848us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:59.359015 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:59.454444 (+ 95429us) spinlock_profiling.cc:243] Waited 36.1 ms on lock 0x7b54002882d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:57:59.454487 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:59.454595 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83068160}
I20260709 12:57:59.456785  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1657) took 2007 ms. Trace:
I20260709 12:57:59.457152  1682 rpcz_store.cc:276] 0709 12:57:57.449627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.214565 (+1764938us) service_pool.cc:224] Handling call
0709 12:57:59.218379 (+  3814us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:59.247087 (+ 28708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:59.456585 (+209498us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b5400389350. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:57:59.456727 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7848704}
I20260709 12:57:59.458647  1691 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 9. Current term is 10. Ops: []
I20260709 12:57:59.460322  1683 raft_consensus.cc:1240] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6. Ops: []
I20260709 12:57:59.464777  4153 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:57:59.466952  4167 raft_consensus.cc:3055] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:57:59.467433  4167 raft_consensus.cc:740] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:59.469043  4276 raft_consensus.cc:3055] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:57:59.469485  4276 raft_consensus.cc:740] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:57:59.469738  2269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:59.470515  4276 consensus_queue.cc:260] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.471897  4276 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:59.473477  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:57:59.474241  1609 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:57:59.475764  1615 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:57:59.418355  1438 catalog_manager.cc:5697] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 6 to 7, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:59.480684  1438 catalog_manager.cc:5697] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 4 to 5, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:59.488914  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:57:59.464704  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 67636.5us
I20260709 12:57:59.494318  1656 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:59.496884  4187 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:57:59.500911  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 202475us
I20260709 12:57:59.502326  1655 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:59.503250  4153 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:59.503757  4153 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:59.496202  1438 catalog_manager.cc:5697] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 4 to 7, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
W20260709 12:57:59.504032  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:59.504138  4153 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:59.503895  1655 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:59.508446  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:59.508998  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:59.509253  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:59.514631  1613 raft_consensus.cc:2410] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:57:59.529907  4275 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:57:59.515101  3460 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:59.530095  1686 raft_consensus.cc:1240] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9. Ops: []
I20260709 12:57:59.538506  1541 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: []
W20260709 12:57:59.573343  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:59.576403  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 142541us
I20260709 12:57:59.576979  1654 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:57:59.581805  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 78043.5us
I20260709 12:57:59.582820  1655 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:59.583043  4277 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:57:59.583571  4277 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:59.583972  4277 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:57:59.584977  1611 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:57:59.588276  1505 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:59.589339  3460 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:57:59.589810  3460 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:59.590222  3460 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:59.583777  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1662) took 2093 ms. Trace:
I20260709 12:57:59.592840  1685 rpcz_store.cc:276] 0709 12:57:57.490615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.254146 (+1763531us) service_pool.cc:224] Handling call
0709 12:57:59.303318 (+ 49172us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:57:59.319446 (+ 16128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:57:59.319484 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:57:59.320179 (+   695us) log.cc:844] Serialized 26 byte log entry
0709 12:57:59.390390 (+ 70211us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:57:59.390436 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:59.390510 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:57:59.583546 (+193036us) raft_consensus.cc:1685] finished
0709 12:57:59.583565 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:59.583723 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6280,"raft.queue_time_us":6617,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":147,"thread_start_us":69797,"threads_started":1,"wal-append.queue_time_us":256234}
I20260709 12:57:59.588328  1508 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:59.597098  4187 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:57:59.597417  1508 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:59.598295  4187 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:57:59.599198  1508 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:57:59.601236  4311 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:57:59.601852  4171 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:57:59.602455  1508 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:59.603349  4187 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:57:59.604004  4187 raft_consensus.cc:697] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:59.584302  1655 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:59.468374  4167 consensus_queue.cc:260] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.607985  1508 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:59.607352  3460 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.639730  3460 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:59.602543  4171 raft_consensus.cc:697] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:59.632867  4167 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:57:59.636901  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 52766.5us
I20260709 12:57:59.604926  4187 consensus_queue.cc:237] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:59.652676  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:57:59.658767  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 50865.8us
I20260709 12:57:59.650691  1438 catalog_manager.cc:5697] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 4 to 7, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 7 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:59.657820  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:57:59.629421  4245 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:59.655767  3742 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:57:59.665990  3742 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:59.666401  3742 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:57:59.667557  4276 raft_consensus.cc:3055] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:57:59.668044  4276 raft_consensus.cc:740] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:59.668650  1508 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:59.670725  1508 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:59.671638  4105 raft_consensus.cc:2804] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:59.671945  1508 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:59.672693  3460 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:59.673272  1438 catalog_manager.cc:5697] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 1 to 7. New cstate: current_term: 7 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:59.674863  1611 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:57:59.675549  1438 catalog_manager.cc:5697] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:59.673175  1613 raft_consensus.cc:1275] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:57:59.666024  4251 consensus_meta.cc:287] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.526s	user 0.012s	sys 0.003s
I20260709 12:57:59.681087  1508 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:57:59.679376  1655 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:59.679776  1505 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:57:59.681728  3460 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:57:59.682682  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 251923us
I20260709 12:57:59.648705  4059 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.692104  1438 catalog_manager.cc:5697] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:59.703299  3460 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:59.706498  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 272104us
I20260709 12:57:59.711323  3460 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:59.712019  3460 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:57:59.712443  3460 raft_consensus.cc:697] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:59.700913  3809 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:57:59.714561  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1371) took 1118 ms. Trace:
I20260709 12:57:59.705380  4160 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:59.718158  1688 rpcz_store.cc:276] 0709 12:57:58.596445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.297844 (+701399us) service_pool.cc:224] Handling call
0709 12:57:59.320638 (+ 22794us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:59.320913 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:57:59.386987 (+ 66074us) log.cc:844] Serialized 14 byte log entry
0709 12:57:59.714068 (+327081us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:59.714131 (+    63us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:57:59.714183 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:59.714363 (+   180us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:59.714491 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1018,"prepare.queue_time_us":256963,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":42,"thread_start_us":362229,"threads_started":2}
I20260709 12:57:59.717495  1438 catalog_manager.cc:5697] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 4 to 7, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:59.698444  4251 consensus_queue.cc:1059] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:57:59.700595  4245 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:59.726455  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 149591us
I20260709 12:57:59.722059  4271 consensus_queue.cc:1048] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:57:59.722896  4275 raft_consensus.cc:2764] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:57:59.738734  3460 consensus_queue.cc:237] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:59.741699  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:59.739908  3954 raft_consensus.cc:3055] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:59.740897  4160 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:57:59.751636  1611 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:57:59.757845  1581 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:59.760939  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 55221.2us
I20260709 12:57:59.764952  4275 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:57:59.767196  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:59.771436  4245 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:59.773335  4059 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:59.777395  4259 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:57:59.778337  4259 consensus_queue.cc:1048] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:59.778712  3947 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:57:59.779309  3947 raft_consensus.cc:697] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:59.780225  3947 consensus_queue.cc:237] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.780581  4176 consensus_queue.cc:1059] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:59.716605  4171 consensus_queue.cc:237] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.782203  4277 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.727988  4276 consensus_queue.cc:260] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.785275  4276 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:59.756942  3954 raft_consensus.cc:740] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:59.794348  4323 raft_consensus.cc:3055] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:57:59.794867  4323 raft_consensus.cc:740] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:59.796773  4251 consensus_queue.cc:1059] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:57:59.798035  4251 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:59.798652  1438 catalog_manager.cc:5697] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:59.799490  4251 raft_consensus.cc:3055] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:57:59.799940  4251 raft_consensus.cc:740] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:59.800304  4324 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:59.795840  4323 consensus_queue.cc:260] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.801545  1581 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:59.808138  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 104) took 1263 ms. Trace:
I20260709 12:57:59.812423  4076 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:59.803211  4320 consensus_queue.cc:1059] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:57:59.796679  4266 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:57:59.801898  4321 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:57:59.814957  4105 raft_consensus.cc:697] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:59.815271  4037 consensus_queue.cc:1059] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:59.816052  4322 consensus_queue.cc:1059] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:57:59.816773  1581 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:57:59.807116  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:59.800442  1438 catalog_manager.cc:5697] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:59.811264  1687 rpcz_store.cc:276] 0709 12:57:58.544782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:59.302240 (+757458us) service_pool.cc:224] Handling call
0709 12:57:59.351085 (+ 48845us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:57:59.356765 (+  5680us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:57:59.689305 (+332540us) log.cc:844] Serialized 14 byte log entry
0709 12:57:59.807646 (+118341us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:57:59.807702 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:57:59.807746 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:57:59.807950 (+   204us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:57:59.808076 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":228221,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"thread_start_us":393959,"threads_started":2}
I20260709 12:57:59.820515  1438 catalog_manager.cc:5697] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
W20260709 12:57:59.841821  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 162152us
I20260709 12:57:59.842952  4330 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:57:59.803990  4323 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:57:59.845693  1438 catalog_manager.cc:5697] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 4 to 5, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 5 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:57:59.823293  4277 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:59.804747  4167 consensus_queue.cc:1059] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:57:59.842147  3809 raft_consensus.cc:697] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:57:59.853420  4266 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:57:59.816908  4105 consensus_queue.cc:237] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.882112  3809 consensus_queue.cc:237] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.879474  1438 catalog_manager.cc:5697] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 3 to 4, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:59.845852  4153 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.871106  4037 consensus_queue.cc:1243] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:57:59.800896  4324 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.885082  4326 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:59.910275  1542 raft_consensus.cc:1275] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:57:59.914345  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 251517us
I20260709 12:57:59.920984  1686 raft_consensus.cc:1240] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 6. Current term is 7. Ops: []
I20260709 12:57:59.874063  3742 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:59.931614  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:59.876039  4330 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:57:59.936405  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 119727us
I20260709 12:57:59.924378  4187 consensus_queue.cc:1048] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:57:59.879449  4251 consensus_queue.cc:260] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.937162  4328 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:59.939502  4171 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:59.919852  4259 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:57:59.926440  4326 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.953862  4332 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:57:59.969245  1688 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:57:59.933648  4309 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:57:59.954150  4330 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:59.971011  1655 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:57:59.976663  4259 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.978540  4076 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:57:59.978830  4309 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:57:59.979369  4076 consensus_queue.cc:1059] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:57:59.979655  4259 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:59.980189  4076 consensus_queue.cc:1059] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:57:59.981243  4277 raft_consensus.cc:3055] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:57:59.981283  4271 raft_consensus.cc:3055] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:57:59.982071  4059 raft_consensus.cc:3055] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:57:59.984751  4059 raft_consensus.cc:740] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:59.982545  4328 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.987723  4328 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:57:59.968802  4339 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:57:59.981899  4271 raft_consensus.cc:740] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:57:59.985834  4059 consensus_queue.cc:260] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.990931  4271 consensus_queue.cc:260] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:57:59.996779  4271 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:57:59.981657  4277 raft_consensus.cc:740] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:57:59.993119  4266 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:59.999521  4319 raft_consensus.cc:3055] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:00.001314  4324 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:57:59.968461  4171 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
W20260709 12:58:00.021232  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:00.063773  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:57:59.981843  4309 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:00.006444  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 43638.7us
I20260709 12:58:00.010558  4319 raft_consensus.cc:740] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:00.072909  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:00.082880  1608 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:58:00.018175  4187 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.063479  3460 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.055656  4251 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:00.083910  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 203983us
I20260709 12:58:00.089363  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:00.108541  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 169665us
I20260709 12:58:00.112932  1615 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:00.086203  3460 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:00.067631  4324 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.088904  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:00.117280  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:00.068953  4328 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 12:58:00.125305  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.116825  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:00.129035  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:00.129809  1615 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:00.132995  3460 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:00.019897  4266 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:00.093789  4165 raft_consensus.cc:3055] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:00.139329  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:00.142310  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:00.144030  1613 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:00.124110  4330 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:00.153059  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 175006us
I20260709 12:58:00.156286  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:00.137032  4153 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:00.121544  4187 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:00.122040  4324 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:00.162128  4322 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.143136  4165 raft_consensus.cc:740] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:00.159785  1608 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:58:00.160373  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:00.179836  1682 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
W20260709 12:58:00.172557  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.176292  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:00.181854  1615 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:58:00.183109  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:00.179260  1608 pending_rounds.cc:85] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f: Aborting all ops after (but not including) 4
I20260709 12:58:00.186589  1608 pending_rounds.cc:107] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:58:00.186906  1608 raft_consensus.cc:2889] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:00.187269  1608 pending_rounds.cc:107] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:58:00.187492  1608 raft_consensus.cc:2889] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:00.141608  4328 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:00.185655  1610 raft_consensus.cc:1275] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:00.208739  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:00.134469  4277 consensus_queue.cc:260] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:00.187757  4332 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:00.195456  4333 log.cc:927] Time spent T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
W20260709 12:58:00.213570  4335 log.cc:927] Time spent T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:58:00.214279   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:00.214666  4187 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:00.217281  1690 raft_consensus.cc:1275] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:00.224356  1689 raft_consensus.cc:1275] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:58:00.165375  4330 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:00.231186  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:58:00.233101  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:00.233529  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.234159  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:00.240732  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:00.241027  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:00.243814  1688 raft_consensus.cc:2393] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 9: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:00.208578  4153 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:00.250232  1615 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:58:00.251271  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:00.254419  1610 raft_consensus.cc:2368] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 8. Current term is 9.
I20260709 12:58:00.158058  4319 consensus_queue.cc:260] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:00.208956  4337 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 12:58:00.230079  4332 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:00.270925  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 81367.6us
I20260709 12:58:00.228950  4326 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:00.260677  4346 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:00.285065  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:00.288190  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.209167  4322 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:00.289443  4347 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:00.289646  4334 log.cc:927] Time spent T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:58:00.291414  4322 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:00.293136  1683 raft_consensus.cc:1275] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:00.294975  4322 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:00.295655  4322 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:00.296770  1655 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:00.312855  1655 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:00.313638  4330 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:00.315657  4325 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:58:00.317894  4341 log.cc:927] Time spent T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 12:58:00.322191  3742 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:00.323359  4320 raft_consensus.cc:3055] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:00.323796  4320 raft_consensus.cc:740] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:00.324875  4344 consensus_queue.cc:1048] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:58:00.325534  4320 consensus_queue.cc:260] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:00.301614  4275 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.326829  4320 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:00.281811  4176 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:00.335455  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.348565  1613 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:58:00.272765  4153 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:00.316303  4325 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:00.301460  4326 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.353135  4176 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:00.366351  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:00.308584  4277 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:00.326874  4275 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:00.380641  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:00.374862  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:00.366159  4330 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:00.383632  4330 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:00.384241  4332 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:00.388057  4176 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:00.352571  4322 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:00.369908  4325 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:00.371440  4266 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:00.424597  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:00.370677  4344 consensus_queue.cc:1048] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:58:00.305981  4347 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:00.437032  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 124375us
W20260709 12:58:00.426903  4167 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.025s	sys 0.025s
I20260709 12:58:00.404834  4319 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:00.441517  1581 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:00.394381  4326 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:00.430151  4324 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:00.455946  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:00.456931  1685 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
W20260709 12:58:00.439683  4167 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.026s	sys 0.026s
I20260709 12:58:00.459985  4322 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:00.460376  4342 raft_consensus.cc:2955] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 5 to 8, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:58:00.354580  4346 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:00.424297  4355 consensus_queue.cc:1059] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:58:00.402782  3954 consensus_queue.cc:260] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:00.507828  1655 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:00.589402  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.461633  4326 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:00.462620  4328 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:00.424273  4345 consensus_queue.cc:1048] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.186s
I20260709 12:58:00.619596  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:00.644601  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:00.462738  4352 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.256s
I20260709 12:58:00.507045  4167 consensus_queue.cc:1243] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:58:00.450309  4087 consensus_queue.cc:1048] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.170s
I20260709 12:58:00.618561  4351 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:58:00.652894  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.656407  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:00.657269  1684 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:58:00.669116  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:00.670017  1683 raft_consensus.cc:2368] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 8. Current term is 9.
I20260709 12:58:00.673237  4275 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:00.674515  1690 raft_consensus.cc:2410] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:58:00.644495  4076 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:00.675383  4076 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:00.675796  4076 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:00.652858  3954 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:00.678246  4347 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:00.688021  4153 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:00.651888  4337 consensus_queue.cc:1059] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
W20260709 12:58:00.690479  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 221401us
I20260709 12:58:00.656391  4338 consensus_queue.cc:1059] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:58:00.547799  4176 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.105s
W20260709 12:58:00.699075  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.652233  4322 raft_consensus.cc:697] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:58:00.710249  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:00.710706  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.654558  4167 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:00.694762  4105 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:00.712646  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:00.714453  1613 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:58:00.714246  4105 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:00.716459  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 62005.8us
I20260709 12:58:00.717263  1684 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:00.717881  1581 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:00.718824  1684 raft_consensus.cc:1275] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:00.719609  1613 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:00.720237  4105 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:00.720567  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:00.720870  1655 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:00.722380  1655 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:00.723186  4352 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:00.723889  4346 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:00.723846  4352 raft_consensus.cc:697] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:00.724751  4153 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:00.725114  4352 consensus_queue.cc:237] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:00.725548  4153 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:00.726166  4153 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:00.705708  4365 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:00.726569  4153 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:00.726419  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:00.726770  4365 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:00.728444  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:00.730561  4330 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:00.730566  4365 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:00.724256  1655 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:00.732414  4351 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:00.732890  4351 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:00.733237  4351 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:00.734479  4320 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:00.735095  4322 consensus_queue.cc:237] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:00.737138  1608 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:00.714025  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:00.738958  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:00.734453  1581 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:00.741504   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:00.750628  1612 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:58:00.753289  4153 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:00.714112  4167 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:00.761310  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:00.762301  1683 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:00.756196  4153 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:00.767323  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:00.768863  1609 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
W20260709 12:58:00.770043  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 45859.6us
I20260709 12:58:00.770782  4167 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:00.771268  1655 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:00.778435  1683 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:58:00.773422  4271 consensus_meta.cc:287] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.767s	user 0.010s	sys 0.001s
I20260709 12:58:00.761368  4037 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:00.777133  4251 consensus_meta.cc:287] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.666s	user 0.009s	sys 0.003s
I20260709 12:58:00.765812  4332 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:00.787817  4277 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:00.788867  1683 raft_consensus.cc:1275] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:00.763674  4176 consensus_queue.cc:1059] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:58:00.796797  1686 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:58:00.792696  4342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:38910 (request call id 0) took 3376 ms. Trace:
W20260709 12:58:00.792054  4323 consensus_meta.cc:287] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.927s	user 0.013s	sys 0.001s
W20260709 12:58:00.804243  4360 log.cc:927] Time spent T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.438s	user 0.000s	sys 0.002s
I20260709 12:58:00.813760  2267 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:00.814040  4325 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:00.814778  4087 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:00.815436  4059 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:00.816215  4325 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:00.809615  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:00.784180  4167 consensus_queue.cc:1059] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:58:00.821153  4167 raft_consensus.cc:3055] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:00.807682  4342 rpcz_store.cc:276] 0709 12:57:57.412502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:57.412646 (+   144us) service_pool.cc:224] Handling call
0709 12:57:57.514157 (+101511us) log.cc:844] Serialized 501 byte log entry
0709 12:58:00.784224 (+3270067us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":143,"mutex_wait_us":3562,"raft.queue_time_us":5167,"raft.run_cpu_time_us":2397,"raft.run_wall_time_us":241469,"thread_start_us":455631,"threads_started":2,"wal-append.queue_time_us":315871,"wal-append.run_cpu_time_us":3430,"wal-append.run_wall_time_us":1358082}
I20260709 12:58:00.821549  4167 raft_consensus.cc:740] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:00.788205  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:00.817706  1536 raft_consensus.cc:1240] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:00.818964  1613 raft_consensus.cc:1275] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:58:00.825873  1613 pending_rounds.cc:85] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f: Aborting all ops after (but not including) 4
I20260709 12:58:00.826134  1613 pending_rounds.cc:107] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:58:00.826372  1613 raft_consensus.cc:2889] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:00.827320  4365 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.827872  4365 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:00.816975  4171 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:00.830093  4365 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:00.832671  1614 raft_consensus.cc:3055] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:00.833120  1614 raft_consensus.cc:740] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:00.833886  1614 consensus_queue.cc:260] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:00.835655  4105 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.836272  4105 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:00.836660  4330 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.837195  4330 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:00.822440  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 51332.4us
I20260709 12:58:00.791622  4332 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:00.841747  4361 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.842310  4361 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:00.843798  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:00.844360  4327 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.816776  1686 raft_consensus.cc:2955] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 5 to 8, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:58:00.823144  4167 consensus_queue.cc:260] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:00.844931  4327 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:00.850689  4167 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:00.852283  4330 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:00.837097  4326 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:00.852804  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:00.853435  1536 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:00.854384  4105 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:00.855163  4367 log.cc:927] Time spent T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 12:58:00.855211  1537 raft_consensus.cc:1275] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:00.844394  4361 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:00.861101  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:00.860921  4326 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:00.861735  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:00.862421  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:00.853298  4339 raft_consensus.cc:3055] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:00.863217  4340 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:00.879148  1616 raft_consensus.cc:1275] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:58:00.863507  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:00.867030  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:00.880402  1538 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:58:00.866935  1533 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:58:00.869072  1539 raft_consensus.cc:2410] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:58:00.872211  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:00.873909  1426 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 07ac6d2e7442458585e7eca31089d547 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:00.883189  1655 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:00.859179  4327 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:00.852283  4176 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:00.995476  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 113548us
W20260709 12:58:00.997238  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 132381us
I20260709 12:58:00.924696  1609 raft_consensus.cc:1275] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:00.997684  1581 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:00.910499  1505 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:00.961907  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:01.003358  1686 raft_consensus.cc:2368] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 6. Current term is 7.
I20260709 12:58:00.995191  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:01.004419  1683 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:58:00.869065  4339 raft_consensus.cc:740] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:00.879355  4322 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 12:58:01.015601  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 105190us
I20260709 12:58:01.016542  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:00.920964  1540 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:01.025146  1690 raft_consensus.cc:2393] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 9: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:00.949504  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 12:58:00.948767  1426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 75035us
I20260709 12:58:00.943106  4365 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.031980  1505 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:00.908715  4171 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:00.943317  4327 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:01.043208  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:01.044895  3460 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:01.016052  4323 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:01.053076  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:58:01.053958  1609 raft_consensus.cc:606] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:01.054380  1609 raft_consensus.cc:614] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:01.045822  3460 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:01.055738  3460 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:01.053552  1540 raft_consensus.cc:1240] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:01.058300  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:01.024438  4105 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:00.906567  4176 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:01.022214  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 145423us
I20260709 12:58:01.081635  1505 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:01.059562  4350 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.084568  4350 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:01.087007  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:01.087908  4372 log.cc:927] Time spent T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.224s	user 0.000s	sys 0.000s
I20260709 12:58:01.089148  4350 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.092134  1505 leader_election.cc:400] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 8. Current term is 9.
I20260709 12:58:01.096001  1505 leader_election.cc:403] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:58:01.093793  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:01.096719  4379 consensus_queue.cc:1048] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:58:01.097826  4326 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.042768  4322 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:01.099136  1505 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:01.099920  4245 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:01.061758  4171 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.102253  3809 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:01.102541  4171 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.103197  4171 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:01.104228  1505 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:01.105350  1505 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:01.105512  4330 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:01.106027  4330 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:01.100893  4326 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:01.106441  4330 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:01.106726  4326 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:01.107161  4326 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:01.108561  1683 raft_consensus.cc:1275] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:01.111670  1686 raft_consensus.cc:1275] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:01.111902  1508 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:01.112447  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:01.112804  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:01.113505  1690 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:58:01.112505  4271 raft_consensus.cc:3055] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:01.116874  4271 raft_consensus.cc:740] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:58:01.090477  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 72649us
I20260709 12:58:01.058789  4323 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:01.113205  1682 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:01.080603  4105 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:01.079515  4037 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:01.079440  4319 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.092440  4361 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:01.081543  3954 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.100297  4322 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:01.134583  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:01.111930  4359 log.cc:927] Time spent T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.747s	user 0.002s	sys 0.001s
I20260709 12:58:01.133934  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:01.137061  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:01.150826  1613 raft_consensus.cc:2393] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 7: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:01.151693  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:01.137997  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:01.151505  1608 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:58:01.053591  4365 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.159178  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:01.126259  3809 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:58:01.161425  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:01.126250  4323 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:01.078506  4351 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.174193  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:01.132275  4105 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:01.132910  4320 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.177901  1613 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:01.150059  4361 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:01.144137  4350 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.188300  1691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:45440
I20260709 12:58:01.186859  1654 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:01.193152  1691 raft_consensus.cc:606] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:01.193569  1691 raft_consensus.cc:614] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:01.125720  4328 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:58:01.117808  4271 consensus_queue.cc:260] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.162225  4171 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:58:01.208246  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 89929.6us
W20260709 12:58:01.201128  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 89304.2us
I20260709 12:58:01.131836  4379 consensus_queue.cc:1048] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:58:01.160001  4338 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 12:58:01.197559  4076 consensus_meta.cc:287] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.001s
I20260709 12:58:01.207185  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:01.162743  3809 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:01.208932  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:01.156972  3954 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.211238  1508 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:01.199214  3460 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.192380  4361 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:01.206511  1654 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:01.225950  1508 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:01.228379  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:01.172415  4319 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:01.232591  1508 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:01.213013  4277 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:58:01.211737  4347 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.212512  4325 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:01.185698  4326 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.235526  3460 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.222893  3809 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:01.197322  4320 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.246883  4346 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:01.234380  4171 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:01.251452  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:01.252079  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:01.203954  4350 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.235678  4153 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:01.257721  1508 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:01.258734  4356 log.cc:927] Time spent T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.891s	user 0.000s	sys 0.002s
I20260709 12:58:01.213182  4160 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:58:01.270239  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:01.270473  1609 raft_consensus.cc:1275] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:01.232781  4076 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.276124  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:01.278023  4350 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:01.278891  4376 log.cc:927] Time spent T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:58:01.278708  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:01.288825  1613 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:01.266305  4171 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:01.280408  4326 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.289729  4171 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:01.289770  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:01.290904  1613 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:01.291887  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:01.292550  1613 raft_consensus.cc:2368] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 6. Current term is 7.
I20260709 12:58:01.280793  4354 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.281831  1611 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:58:01.282258  4386 log.cc:927] Time spent T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:58:01.284401  1608 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:01.254186  4387 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:01.255725  4325 raft_consensus.cc:697] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:01.231997  4338 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:58:01.276307  4377 log.cc:927] Time spent T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:58:01.306145  4365 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.306649  4176 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:01.307237  4348 log.cc:927] Time spent T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 1.096s	user 0.000s	sys 0.005s
I20260709 12:58:01.250351  4347 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.315888  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:01.273059  4153 raft_consensus.cc:697] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 7 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:58:01.317477  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 59861.1us
I20260709 12:58:01.326241  1508 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:01.292799  4321 raft_consensus.cc:3055] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:01.317737  3460 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:01.327267  3460 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.324024  4160 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.336970  1508 leader_election.cc:400] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 8. Current term is 9.
I20260709 12:58:01.338762  1608 raft_consensus.cc:1275] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:01.318537  4350 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:01.345302  3460 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.325590  4326 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:01.346046  1508 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:01.346573  3460 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:01.350618  1508 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:01.307240  4105 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.359361  4394 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.360011  4394 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.349295  4160 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.361481  4105 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.357316  4346 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:01.362864  4160 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:01.365710  4245 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 8. Current term is 9.
I20260709 12:58:01.365974  4338 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:01.368322  4350 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.369556  4165 consensus_queue.cc:260] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.356952  3954 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.370620  4350 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.371095  1608 raft_consensus.cc:1275] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:01.371558  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:01.375322  3460 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:58:01.375444  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 147900us
I20260709 12:58:01.354797  4347 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.355635  4153 consensus_queue.cc:237] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.330310  4321 raft_consensus.cc:740] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:01.317241  4393 consensus_queue.cc:1048] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:58:01.357257  4319 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.358415  4076 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:01.357170  4351 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:01.334381  4387 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:01.313957  4354 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:01.384963  1654 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:01.394656  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:01.401923  4396 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:01.402392  4396 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:01.402748  4396 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:01.402804  4277 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:58:01.396019  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 43743.9us
I20260709 12:58:01.358201  4388 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:58:01.398721  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 151580us
I20260709 12:58:01.398970  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1398) took 1319 ms. Trace:
I20260709 12:58:01.417814  1508 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:01.419093  1508 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:01.370697  4165 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:01.349499  4328 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:58:01.362177  4105 consensus_queue.cc:1048] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 12:58:01.392733  4167 consensus_meta.cc:287] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.542s	user 0.007s	sys 0.004s
I20260709 12:58:01.416227  1617 rpcz_store.cc:276] 0709 12:58:00.072468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:00.073246 (+   778us) service_pool.cc:224] Handling call
0709 12:58:00.109989 (+ 36743us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:00.110731 (+   742us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:00.110763 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:00.126729 (+ 15966us) log.cc:844] Serialized 26 byte log entry
0709 12:58:00.202701 (+ 75972us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:00.202742 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:00.202819 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:01.257883 (+1055064us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:58:01.372603 (+114720us) raft_consensus.cc:1685] finished
0709 12:58:01.372624 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:01.392229 (+ 19605us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19738,"raft.queue_time_us":101214,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":13307,"spinlock_wait_cycles":72702720,"thread_start_us":55716,"threads_started":1,"wal-append.queue_time_us":140658}
I20260709 12:58:01.362247  4394 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.427294  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:01.431953  1689 raft_consensus.cc:2393] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 8: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:01.428017  1508 leader_election.cc:400] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 6. Current term is 7.
I20260709 12:58:01.429924  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:01.430647  1615 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:58:01.433245  1508 leader_election.cc:403] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:01.436247  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:01.437412  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:01.438156  1691 raft_consensus.cc:2393] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 5: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:01.438603  1687 raft_consensus.cc:1240] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:01.436374  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:01.445411  4387 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:58:01.446564  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:01.447249  1686 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:58:01.448184  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:01.450249  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:01.457669  1690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:45440
I20260709 12:58:01.458273  1690 raft_consensus.cc:606] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:01.457003  1683 raft_consensus.cc:1240] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:01.458729  1684 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 4.
I20260709 12:58:01.465214  1683 raft_consensus.cc:1275] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:01.463171  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:01.463816  1508 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:01.430872  4346 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:01.477679  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:01.481791  1685 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:58:01.481134  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:01.482059  1686 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:01.483764  1612 raft_consensus.cc:2955] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 5 to 8, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:58:01.489852  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:01.450099  4076 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.382023  4325 consensus_queue.cc:237] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.490617  1691 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:01.427894  4326 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:58:01.494279  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:01.496203  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:01.496995  1687 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:01.456630  4354 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:01.491003  4346 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:01.503110  4328 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:01.505683  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:01.505906  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:58:01.511386  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:01.511994  1691 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:01.510015  4266 raft_consensus.cc:3055] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:01.491470  4405 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:01.516331  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:01.515270  4266 raft_consensus.cc:740] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:01.495738  4076 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.547034  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:01.547806  4076 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:01.513419  4346 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:01.499842  4393 consensus_queue.cc:1048] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:58:01.559415  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:01.560456  1683 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:58:01.560923  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:01.598506  1691 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:58:01.561889  1686 raft_consensus.cc:1240] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:01.602072  4361 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.562206  4400 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.615710  4400 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.618022  4400 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.618505  4320 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.619340  4361 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.562944  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:01.620026  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:01.568813  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:01.569268  4266 consensus_queue.cc:260] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.621560  4266 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:01.600301  4396 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.623340  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:01.624368  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1399) took 1359 ms. Trace:
I20260709 12:58:01.570257  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:01.573318  3809 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.625615  4396 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:01.624771  1688 rpcz_store.cc:276] 0709 12:58:00.265114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:00.289218 (+ 24104us) service_pool.cc:224] Handling call
0709 12:58:00.311399 (+ 22181us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:00.433300 (+121901us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:00.433331 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:00.433828 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 12:58:00.701397 (+267569us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:00.701446 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:01.624011 (+922565us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b54003c0854. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:01.624055 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:01.624099 (+    44us) raft_consensus.cc:1685] finished
0709 12:58:01.624113 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:01.624310 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":49331,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":110,"spinlock_wait_cycles":40110976,"thread_start_us":340221,"threads_started":2,"wal-append.queue_time_us":261553}
I20260709 12:58:01.626380  3809 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.628439  1539 raft_consensus.cc:2368] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6.
I20260709 12:58:01.628371  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:01.631986  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:01.574806  4323 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.582566  4330 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.513185  4328 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:01.588701  1611 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:58:01.504536  4321 consensus_queue.cc:260] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.620388  1535 raft_consensus.cc:2393] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 6: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:01.634160  1581 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:01.638845  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:01.639067  4328 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:01.640187  1539 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:58:01.641916  3809 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.580222  4387 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 6. Current term is 7.
I20260709 12:58:01.643239  1656 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:01.643918  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 180200us
I20260709 12:58:01.645201  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:01.645955  1691 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:58:01.650274  1581 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:01.657092  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:01.638780  4393 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.661011  1583 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:01.657271  1508 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:01.663683  1581 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:01.664644  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:01.667563  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:01.660097  4401 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:01.680125  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:01.665795  4388 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:01.667937  4350 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:01.683233  1583 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:01.684947  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:01.670374  4400 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.676680  4361 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.676951  4387 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.661209  3809 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.689509  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:01.668536  4393 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.699427  4176 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.700004  4176 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.679502  4401 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:01.702991  4401 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:01.704511  4337 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:01.685765  4350 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:01.706118  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:01.706524  4350 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:01.706785  1583 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:01.707908  4332 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:01.680857  4338 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:01.708781  4338 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:01.709213  4338 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:01.710810  4391 consensus_queue.cc:1059] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:01.694525  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:01.712801  1539 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:58:01.681911  4403 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:01.701100  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:01.721374  1533 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:01.702468  4393 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.684518  4388 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:01.715240  1583 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:01.722926  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:01.724349  1583 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:01.725358  1583 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:01.729286  4391 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:01.729763  4391 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:01.730105  4391 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:01.730819  4176 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.731415  4176 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:01.731753  4176 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:01.732086  4176 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:01.733227  4167 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:01.732924  4411 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:58:01.708798  4165 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:01.734011  3809 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.687464  4171 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.692904  4320 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:58:01.724771  4388 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:01.754515  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:01.757253  4346 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.694098  4400 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.727504  4361 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.740260  4167 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:01.701782  4387 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.762749  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:01.772101  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:01.788102  1540 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:58:01.779842  1533 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:01.787102  1610 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:58:01.805763  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:01.811709  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:01.768936  4323 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.814846  1536 raft_consensus.cc:1240] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:01.774487  4330 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.819603  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:01.820595  1537 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:58:01.822104  1542 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:01.823115  4339 consensus_queue.cc:260] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.793669  4167 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:01.830147  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:01.760166  4401 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.833176  4339 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:01.787356  4337 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:58:01.834820  4401 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.819564  1539 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
W20260709 12:58:01.847649  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 168446us
I20260709 12:58:01.848939  1610 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:58:01.854452  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:01.854475  1542 raft_consensus.cc:1275] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:01.856190  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:01.857048  1542 raft_consensus.cc:2393] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 7: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:01.857937  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:01.859522  1542 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:01.862828  1533 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:58:01.759665  4391 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.839996  4415 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.865473  1581 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:01.840538  4401 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:01.873250  4401 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.877804  4387 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.882692  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:01.820254  4338 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:01.896713  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 171429us
I20260709 12:58:01.922417  1583 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:01.923625  1583 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:01.883517  1533 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 9: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:01.921757  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:01.877694  4424 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:01.927042  1583 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:01.928325  1583 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:01.925839  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:01.929976  1533 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
W20260709 12:58:01.928984  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 59339.3us
I20260709 12:58:01.929039  1537 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:58:01.862560  4328 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.938618  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:01.894115  4414 log.cc:927] Time spent T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:58:01.933638  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:01.933091  1537 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:01.939628  1533 raft_consensus.cc:2368] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 7. Current term is 8.
I20260709 12:58:01.875523  4076 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:01.942205  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:01.941562  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:01.943452  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:01.944072  1533 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:01.947427  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:01.950680  1542 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:58:01.948207  4355 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:01.951710  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:01.947458  4338 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.949702  4428 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:01.879627  4415 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.952732  4428 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.931715  4165 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:58:01.954785  4428 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.955601  4415 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.956763  1542 raft_consensus.cc:2393] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 10: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:01.956755  4328 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.894688  4391 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.958576  4424 consensus_queue.cc:1059] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:01.958892  1542 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:58:01.959448  4424 raft_consensus.cc:3055] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:01.959770  4167 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:01.960461  1542 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:01.962409  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:01.925910  4361 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.929692  4404 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:01.955384  4176 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:01.971067  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:01.932160  4403 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:01.976603  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:01.977726  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:01.940331  4400 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.982923  1542 raft_consensus.cc:2393] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 6: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:01.985150  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:01.985286  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:01.986258  1542 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:58:01.988997  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:01.959784  4424 raft_consensus.cc:740] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:01.969455  4167 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:02.005225  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:02.006058  1537 raft_consensus.cc:2393] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 8: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:02.006910  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:02.007628  1537 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 9: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:02.008607  4420 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:02.009141  4420 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:02.009287  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:02.009562  4420 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:02.010459  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:02.010579  4424 consensus_queue.cc:260] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.011830  4424 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:02.013665  4176 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:02.014178  4401 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:01.980808  4403 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 12:58:02.017680  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 89432.2us
I20260709 12:58:02.008392  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:02.011765  1542 raft_consensus.cc:1240] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:02.022063  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:02.018362  1583 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:02.025403  1533 raft_consensus.cc:1240] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:02.026746  1533 raft_consensus.cc:1275] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:02.030081  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:02.030364  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:02.031102  1542 raft_consensus.cc:2393] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 6: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:02.031059  1617 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:02.031373  1505 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:02.036044  1505 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:02.037322  4328 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:02.038757  1505 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:02.032963  1655 leader_election.cc:400] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6.
I20260709 12:58:02.040297  1538 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:02.048336  1617 raft_consensus.cc:2410] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:58:02.045734  1655 leader_election.cc:403] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:02.045998  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:02.041802  1505 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:02.049690  1537 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:02.029572  4339 raft_consensus.cc:2804] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:02.019064  4403 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:02.053351  1505 leader_election.cc:400] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 6. Current term is 7.
I20260709 12:58:02.032909  4400 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.055027  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:02.070660  1617 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:02.039839  4361 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:02.076414  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:02.077277  1542 raft_consensus.cc:2393] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 10: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:02.047829  4167 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.079619  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:02.080564  1617 raft_consensus.cc:2410] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:58:02.054327  4332 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:58:02.093379  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:02.052173  4328 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:02.103410  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:02.104435  1533 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:02.097806  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:58:02.094020  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 69121.7us
I20260709 12:58:02.108548  1655 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:02.053464  4339 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:02.110579  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:02.113183  1505 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:02.118072  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:02.118674  1538 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:02.116998  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:02.069419  4165 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.120278  1617 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:02.078991  4400 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.102582  4328 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:02.054479  4388 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.134634  1537 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:02.135511  3460 consensus_queue.cc:1048] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:02.138453  3809 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:58:02.145437  1617 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:02.146589  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:02.147773  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:02.148128  1616 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:02.138926  1538 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:02.148998  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:02.117144  4339 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:02.155280  1614 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:02.126307  4165 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.160046  4339 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.161912  4165 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:02.162447  4339 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:02.123202  4393 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:02.123519  4366 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:02.165014  1617 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:58:02.166698  1614 raft_consensus.cc:1275] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:02.167536  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1094) took 2085 ms. Trace:
I20260709 12:58:02.167893  1614 rpcz_store.cc:276] 0709 12:58:00.082185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:00.082335 (+   150us) service_pool.cc:224] Handling call
0709 12:58:00.116639 (+ 34304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:00.832545 (+715906us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b540043d120. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85cfc8dc0 00007fc85d0531c0 00007fc85d054231 00007fc85d050d8f 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c
0709 12:58:02.154815 (+1322270us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b58006614d0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85cfad0aa 00007fc85d02f447 00007fc85d047fe7 00007fc85d0497de 00007fc85d053b49 00007fc85d054416 00007fc85d050d8f 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4
0709 12:58:02.167273 (+ 12458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:02.167488 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3985881088}
I20260709 12:58:02.097141  4167 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.173185  1505 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:02.181777  1535 raft_consensus.cc:2368] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10.
I20260709 12:58:02.138610  4328 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:02.183290  1505 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:02.183780  1533 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:02.186605  4330 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:58:02.188866  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 50465.8us
I20260709 12:58:02.189935  4388 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:02.175159  4276 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:58:02.138199  4405 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:58:02.223695  4330 raft_consensus.cc:697] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:02.193606  4350 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.225013  1610 raft_consensus.cc:1240] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:58:02.224749  4330 consensus_queue.cc:237] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.226111  4350 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:02.173830  4393 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:02.226903  4393 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:02.195395  4400 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:02.200732  1541 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:58:02.229517  1655 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:02.201920  4167 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:02.209990  1508 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:02.238915  4332 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6.
I20260709 12:58:02.239180  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:02.239719  4351 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:02.240168  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:02.221223  4327 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:02.241158  4327 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.242874  4388 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.243346  4327 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:02.185058  4411 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:02.243507  4388 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.244114  4411 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:02.244544  4411 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:02.246110  4388 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:02.213447  4366 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.248983  4366 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.211956  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:02.217255  4325 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.250339  4325 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.250952  4366 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:02.220110  4363 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:02.235858  1686 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:45440
I20260709 12:58:02.252815  1686 raft_consensus.cc:606] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:02.253181  1686 raft_consensus.cc:614] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:02.254345  1614 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:02.254772  4403 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.255625  1505 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:02.256884  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:02.256712  4363 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.258131  4415 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:02.257512  4400 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:02.263885  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:02.264708  1686 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:02.266738  4171 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:02.273542  4332 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.220151  4420 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.274111  4332 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.276780  4420 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:02.277834  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1410) took 1050 ms. Trace:
I20260709 12:58:02.278276  1609 rpcz_store.cc:276] 0709 12:58:01.227010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:01.227142 (+   132us) service_pool.cc:224] Handling call
0709 12:58:01.243772 (+ 16630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:01.270940 (+ 27168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:02.277579 (+1006639us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b540011dad4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:02.277770 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60673920}
I20260709 12:58:02.276247  4332 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:02.281890  4425 log.cc:927] Time spent T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.426s	user 0.003s	sys 0.004s
I20260709 12:58:02.284865  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:02.286350  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:02.287467  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1697) took 1440 ms. Trace:
I20260709 12:58:02.215093  4361 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:02.268218  4411 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.290699  4411 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:02.291314  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:02.260120  4400 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:02.293069  4400 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:02.297464  4363 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:02.252351  4325 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:02.287909  1534 rpcz_store.cc:276] 0709 12:58:00.847358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:00.847465 (+   107us) service_pool.cc:224] Handling call
0709 12:58:00.863077 (+ 15612us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:00.863467 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:58:01.032773 (+169306us) log.cc:844] Serialized 14 byte log entry
0709 12:58:01.604276 (+571503us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b1800126dc0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859edec0a 00007fc86361e219 00007fc860f2558f 00007fc859f64571 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd
0709 12:58:02.257124 (+652848us) spinlock_profiling.cc:243] Waited 8.03 ms on lock 0x7b1800126dc0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc85cbf94bc 00007fc859f4748b 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f61455 00007fc85d049060 00007fc85d05b716 00007fc85d06c287
0709 12:58:02.257302 (+   178us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:02.257761 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 12:58:02.257928 (+   167us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:02.257965 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:02.258048 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:02.287221 (+ 29173us) raft_consensus.cc:1685] finished
0709 12:58:02.287245 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:02.287403 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31061,"prepare.queue_time_us":229813,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":81163,"raft.run_cpu_time_us":380,"raft.run_wall_time_us":28146,"spinlock_wait_cycles":28503168,"thread_start_us":226105,"threads_started":3,"wal-append.queue_time_us":66955}
I20260709 12:58:02.292064  1609 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:02.282991  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:02.307934  1614 raft_consensus.cc:2393] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 6: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:02.281948  1690 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:58:02.304196  1617 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:02.317327  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:02.319070  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:02.251875  4328 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.257963  4403 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:02.326201  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:02.330039  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:02.331010  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:02.319038  4363 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.350090  1689 raft_consensus.cc:2410] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:58:02.350167  1614 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 9: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:02.332248  1617 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:02.360772  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:02.365137  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:02.365947  1687 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 9: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:02.367125  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:02.368512  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:02.369108  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:02.369426  1617 raft_consensus.cc:2393] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 10: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:02.370473  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:02.371120  1614 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:02.369768  1687 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:58:02.373174  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:02.378811  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:02.380112  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:02.380736  1686 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:58:02.381546  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:02.381901  4328 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:02.382066  1686 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:02.324293  4393 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:02.382961  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:02.383750  1686 raft_consensus.cc:2410] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:58:02.384068  4393 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:02.384931  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:02.386197  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:02.387434  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:02.389838  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:02.401765  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:02.416742  1610 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:58:02.417711  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:02.416340  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:02.418555  1610 raft_consensus.cc:2410] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:58:02.394826  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:02.373785  1687 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:02.395213  1614 raft_consensus.cc:2410] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:58:02.390141  1617 raft_consensus.cc:2393] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 9: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:02.413725  1689 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:58:02.423446  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:02.424140  1682 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:02.427343  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 213448us
W20260709 12:58:02.402724  4421 log.cc:927] Time spent T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.545s	user 0.006s	sys 0.014s
I20260709 12:58:02.434111  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:02.435925  1610 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:58:02.402616  4321 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:02.364323  4363 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.420138  4388 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:02.442449  1655 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:02.460851  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1425) took 1063 ms. Trace:
I20260709 12:58:02.465868  1689 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:02.467043  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:02.461333  1611 rpcz_store.cc:276] 0709 12:58:01.390396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:01.394370 (+  3974us) service_pool.cc:224] Handling call
0709 12:58:02.453352 (+1058982us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54002a6cd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:02.453477 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430309120}
W20260709 12:58:02.468940  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:02.469905  1655 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:02.471504  1654 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:58:02.479521  1581 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:02.482219  1654 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:02.489347  1610 raft_consensus.cc:1240] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:58:02.493332  1655 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:02.492300  1581 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:02.469451  4325 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:02.496531  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1427) took 1038 ms. Trace:
I20260709 12:58:02.500802  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:02.474892  4442 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:02.499743  1612 rpcz_store.cc:276] 0709 12:58:01.457937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:01.624565 (+166628us) service_pool.cc:224] Handling call
0709 12:58:01.624908 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:01.649739 (+ 24831us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:01.649769 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:01.656793 (+  7024us) log.cc:844] Serialized 26 byte log entry
0709 12:58:01.787366 (+130573us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:01.787410 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:01.787487 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:02.386542 (+599055us) spinlock_profiling.cc:243] Waited 7.17 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:58:02.485164 (+ 98622us) raft_consensus.cc:1685] finished
0709 12:58:02.485184 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:02.496440 (+ 11256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33877,"raft.queue_time_us":24548,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":6893,"spinlock_wait_cycles":16487680,"thread_start_us":104506,"threads_started":1,"wal-append.queue_time_us":186739}
I20260709 12:58:02.502296  1581 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:02.486461  4160 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:02.483848  4332 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:02.490305  4420 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:02.505668  1610 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:02.486038  4366 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:02.513988  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:02.501616  4325 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:02.517112  4441 log.cc:927] Time spent T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:58:02.518105  4325 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:02.518692  4325 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:02.519515  4325 consensus_queue.cc:1048] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:02.499524  4327 consensus_queue.cc:1059] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:58:02.521003  4327 raft_consensus.cc:3055] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:02.521365  4327 raft_consensus.cc:740] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:02.522217  4327 consensus_queue.cc:260] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.523458  4327 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:02.526257  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:02.527439  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:02.505614  4266 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:02.528398  4266 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:02.528774  4266 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:02.531118  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:02.531834  1690 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:58:02.512040  1581 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:02.534016  1581 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:02.536581  1689 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:58:02.506358  4160 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:02.496591  4167 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:58:02.554270  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:02.556636  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:02.557408  1538 raft_consensus.cc:2393] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 6: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:02.557597  4160 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:02.558235  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:02.559494  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:02.560246  1537 raft_consensus.cc:2393] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 10: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:02.499392  4350 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:58:02.512074  4420 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:02.562963  1610 raft_consensus.cc:1275] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:02.563344  1538 raft_consensus.cc:1240] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:02.597947  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:02.544783  3954 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:02.601418  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:02.548193  4347 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:02.543246  4355 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:02.598289  1534 raft_consensus.cc:1240] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:58:02.574894  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:02.598963  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:02.614940  1533 raft_consensus.cc:2393] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 6: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 12:58:02.577651  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 82979.4us
I20260709 12:58:02.505260  4339 consensus_queue.cc:1059] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:58:02.552093  1617 raft_consensus.cc:1240] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:02.545235  4366 raft_consensus.cc:697] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 8 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:02.621011  1508 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:02.625358  1610 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260709 12:58:02.634897  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:02.663945  1617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db702b262c1644109366a56f6f0d805a"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:58:02.664700  1617 raft_consensus.cc:606] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:02.665084  1617 raft_consensus.cc:614] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:58:02.671460  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 50566.5us
I20260709 12:58:02.598120  4420 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:02.672250  1508 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:02.683838  1508 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:02.551369  4400 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.688426  1508 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:02.695781  1508 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:02.698663  4347 raft_consensus.cc:697] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:02.698467  4355 raft_consensus.cc:697] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:02.703639   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:58:02.692049  4387 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:02.674654  4345 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:02.705219  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:02.674374  3954 raft_consensus.cc:697] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:02.674185  3809 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:58:02.756675  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 60963.8us
I20260709 12:58:02.759150  1690 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:58:02.690519  4330 raft_consensus.cc:2764] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 12:58:02.699455  4446 log.cc:927] Time spent T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 12:58:02.765123  4345 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.767439  4160 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:02.767724  4366 consensus_queue.cc:237] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.768868  4355 consensus_queue.cc:237] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.770876  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:02.771128  4440 log.cc:927] Time spent T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.197s	user 0.000s	sys 0.006s
W20260709 12:58:02.771966  4448 log.cc:927] Time spent T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.080s	user 0.004s	sys 0.001s
W20260709 12:58:02.772294  4443 log.cc:927] Time spent T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.262s	user 0.000s	sys 0.006s
W20260709 12:58:02.772891  4449 log.cc:927] Time spent T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.159s	user 0.002s	sys 0.004s
W20260709 12:58:02.773509  4454 log.cc:927] Time spent T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.083s	user 0.000s	sys 0.006s
I20260709 12:58:02.773960  4350 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:02.762202  1508 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:02.692579  4433 raft_consensus.cc:3055] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:02.697726  4352 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 12:58:02.786970  4447 log.cc:927] Time spent T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.286s	user 0.000s	sys 0.001s
I20260709 12:58:02.794415  4160 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:02.800154  3954 consensus_queue.cc:237] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.811617  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:02.813329  1535 raft_consensus.cc:2393] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 9: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:02.756196  4393 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:02.816883  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:02.760334  4405 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:02.831691  4405 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:02.832111  4405 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:02.827625  4350 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.833249  4271 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:02.834702  4350 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:02.830209  4352 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.822155  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:02.838115  4352 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:02.822639  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:02.825733  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:02.839417  1687 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:02.812709  4388 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:58:02.826682  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 265098us
W20260709 12:58:02.826825  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 64698.4us
I20260709 12:58:02.845907  1508 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:02.826298  4433 raft_consensus.cc:740] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:58:02.829854  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 336603us
I20260709 12:58:02.830575  1686 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:58:02.843129  1682 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:02.839280  1690 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:02.847568  1655 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:02.848659  4160 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:02.851240  1508 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:02.826006  4363 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:02.854214  1687 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:02.855119  1508 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:02.839272  4330 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:02.861053  1655 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:02.865465  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:02.854387  4393 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:02.857112  3947 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:02.876995  1690 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:02.873437  4160 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:02.878670  4160 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:02.879067  4160 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:02.880362  4423 log.cc:927] Time spent T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 1.022s	user 0.009s	sys 0.014s
I20260709 12:58:02.882444  1684 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:58:02.882920  4346 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:02.885273  4266 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.861865  4330 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:02.888952  4330 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:02.861225  4438 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:02.888268  4266 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:02.829936  4347 consensus_queue.cc:237] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.896006  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:02.897083  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:02.897590  1682 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:58:02.898389  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:02.898936  1682 raft_consensus.cc:2393] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 10: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:02.899502  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:02.873623  4393 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:02.900767  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 43704.8us
W20260709 12:58:02.901901  4453 log.cc:927] Time spent T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.085s	user 0.000s	sys 0.006s
I20260709 12:58:02.902755  1655 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:02.903381  4461 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:58:02.901262  1683 raft_consensus.cc:2410] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:02.908924  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:02.909482  1688 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:02.910606  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:02.911872  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:02.914602  1691 raft_consensus.cc:2393] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 6: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:02.916430  1655 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:02.917809  4464 raft_consensus.cc:2764] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:58:02.919168  1655 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:02.922997  1615 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:58:02.923920  4076 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:02.923758  4405 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.915406  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:02.904019  4393 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:02.929049  1616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 1112) took 1755 ms (client timeout 1818 ms). Trace:
I20260709 12:58:02.932585  1655 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:02.936017  1616 rpcz_store.cc:269] 0709 12:58:01.173748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:01.173919 (+   171us) service_pool.cc:224] Handling call
0709 12:58:02.928856 (+1754937us) spinlock_profiling.cc:243] Waited 836 ms on lock 0x7b5400446bd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:02.928983 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1922967424}
I20260709 12:58:02.913394  4327 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:58:02.938424  1654 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 1.818s (SENT) [suppressed 1 similar messages]
I20260709 12:58:02.944533  1655 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:02.945118  4351 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:02.925100  4400 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:02.938335  4332 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:02.933722  3947 raft_consensus.cc:697] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:02.890223  4433 consensus_queue.cc:260] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.962800  1508 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:02.965240  1688 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:02.971024  3947 consensus_queue.cc:237] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.953846  4345 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:02.936779  4464 consensus_queue.cc:1059] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:58:02.985517  4433 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:02.941047  4458 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:58:02.993748  4458 consensus_queue.cc:1243] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:58:02.994920  4458 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:02.995443  4458 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.996578  4420 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:02.961727  4332 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:02.997758  1612 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 8. Current term is 9. Ops: []
W20260709 12:58:03.002049  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 63673.4us
I20260709 12:58:02.966867  4327 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:58:03.003877  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 88962.7us
I20260709 12:58:03.003371  4076 raft_consensus.cc:3055] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:03.004444  4464 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:03.013257  4076 raft_consensus.cc:740] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:03.014381  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
W20260709 12:58:03.011086  4321 consensus_meta.cc:287] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.568s	user 0.010s	sys 0.002s
I20260709 12:58:03.012921  1508 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:03.025447  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1709) took 1393 ms. Trace:
I20260709 12:58:03.025923  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:03.027042  1685 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:03.026341  1536 rpcz_store.cc:276] 0709 12:58:01.631832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:01.642886 (+ 11054us) service_pool.cc:224] Handling call
0709 12:58:01.650821 (+  7935us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:01.820395 (+169574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:03.025210 (+1204815us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b540010c2d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:03.025385 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":372429696}
I20260709 12:58:03.023073  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:03.012706  4415 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:58:03.031705  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 87329.4us
I20260709 12:58:03.039335  1655 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:03.040230  4327 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:03.040700  4327 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:03.041045  1655 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:03.042270  1655 leader_election.cc:400] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 7. Current term is 8.
I20260709 12:58:03.042579  1655 leader_election.cc:403] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:03.042832  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1067) took 1320 ms. Trace:
I20260709 12:58:03.043519  4327 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:03.043267  1539 rpcz_store.cc:276] 0709 12:58:01.722463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:01.722629 (+   166us) service_pool.cc:224] Handling call
0709 12:58:03.042644 (+1320015us) spinlock_profiling.cc:243] Waited 95.3 ms on lock 0x7b540045d654. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:03.042750 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219164416}
I20260709 12:58:03.042358  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 88) took 1770 ms. Trace:
I20260709 12:58:03.046133  1608 rpcz_store.cc:276] 0709 12:58:01.271822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:01.371872 (+100050us) service_pool.cc:224] Handling call
0709 12:58:01.714786 (+342914us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:01.715097 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:01.715128 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:01.715603 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 12:58:01.830261 (+114658us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b480024e7d8. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc861f7aaa1 00007fc861f71b37 00007fc861f719ca 00007fc86206926f 00007fc862068f37 00007fc86207d55c 00007fc86207d508 00007fc86207d488 00007fc86207d443 00007fc86207c6ec 00007fc860fa6a96
0709 12:58:01.863615 (+ 33354us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:01.863661 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:01.863731 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:02.012117 (+148386us) raft_consensus.cc:1685] finished
0709 12:58:02.012136 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:03.042177 (+1030041us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b5400444b50. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:03.042292 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1754,"raft.run_cpu_time_us":2301,"raft.run_wall_time_us":108744,"spinlock_wait_cycles":792323072,"thread_start_us":109908,"threads_started":1,"wal-append.queue_time_us":231488,"wal-append.run_cpu_time_us":1710,"wal-append.run_wall_time_us":1034157}
I20260709 12:58:03.053377  1690 raft_consensus.cc:1240] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: []
W20260709 12:58:03.059448  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:03.059980  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:03.059527  1541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1069) took 1297 ms (client timeout 1713 ms). Trace:
W20260709 12:58:03.060722  1541 rpcz_store.cc:269] 0709 12:58:01.761921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:01.783563 (+ 21642us) service_pool.cc:224] Handling call
0709 12:58:03.059364 (+1275801us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b5400246654. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:03.059469 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":892838784}
I20260709 12:58:03.069808  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:03.070631  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:03.071935  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:03.074015  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:03.084895  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:03.085811  1609 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:58:03.085001  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:03.086907  1614 raft_consensus.cc:2410] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:58:03.088414  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:03.090232  1610 raft_consensus.cc:1275] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:03.091195  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:03.092036  1542 raft_consensus.cc:2410] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:03.094635  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:03.062273  4387 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:03.062224  4271 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.097792  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:03.102787  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:03.098939  1581 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:03.103565  1608 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:03.103291  1536 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:58:03.019217  4464 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:03.037178  4321 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:03.108767  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:03.085547  4405 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:03.106150  1689 raft_consensus.cc:1240] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 8 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:03.038003  4366 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:58:03.081523  4345 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.106902  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:03.114959  1540 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:03.110862  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:03.109663  1581 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:03.147562  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:03.150163  1688 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:03.106849  4350 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:03.105329  4332 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:03.102685  4387 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:03.152279  1535 raft_consensus.cc:2393] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 9: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:03.109742  4458 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:03.101330  4420 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:03.103446  3954 consensus_queue.cc:1059] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:58:03.150086  4433 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:03.108295  4352 consensus_queue.cc:1059] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 12:58:03.203174  1688 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:03.164958  4325 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 7. Current term is 8.
I20260709 12:58:03.107975  4271 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:03.161212  4473 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:03.218684  3954 raft_consensus.cc:3055] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:03.219120  3954 raft_consensus.cc:740] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:03.215898  4433 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:03.219795  4433 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:03.220024  3954 consensus_queue.cc:260] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:03.221299  3954 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:03.221905  4355 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.222435  4355 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:03.224418   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:03.225077  4352 raft_consensus.cc:3055] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:03.225498  4352 raft_consensus.cc:740] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:03.226389  4352 consensus_queue.cc:260] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:03.227650  4352 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:03.229638  1617 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:03.178020  4387 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:03.112141  4321 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:03.238692  1540 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
W20260709 12:58:03.236572  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 198848us
I20260709 12:58:03.247103  4433 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:03.249176  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 194119us
I20260709 12:58:03.240092  1581 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:58:03.253233  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 211103us
I20260709 12:58:03.254268  1583 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:03.261163  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:03.149659  4345 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:03.262296  1583 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:03.277894  1583 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:03.263074  1655 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:03.264907  1654 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:03.282646  1613 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:58:03.286921  3460 consensus_queue.cc:1048] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:03.289592  1505 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:03.291581  1505 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:03.293887  1505 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:03.295846  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:03.302392  1505 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:03.305167  1505 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:03.250689  4420 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.310323  1505 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:03.260046  4350 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:03.297986  4468 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:58:03.312937  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 49949.5us
I20260709 12:58:03.330358  4325 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:03.359274  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:03.361756  1614 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:03.319096  1685 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:03.362849  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:03.363456  1685 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:03.335376  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:03.297715  3809 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:03.248888  4327 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:03.297654  4176 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:03.325913  4405 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:03.293736  4415 raft_consensus.cc:697] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:03.298220  4347 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:03.278306  4363 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:03.310806  1608 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:03.351774  4482 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:03.293638  4458 consensus_queue.cc:1059] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 12:58:03.313964  1654 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:03.367831  1690 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:58:03.345340  4388 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:03.358477  4479 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:03.372965  4176 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:03.377447  1614 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:03.330606  4473 consensus_queue.cc:1059] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:58:03.378433  3809 raft_consensus.cc:697] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:03.333277  4420 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:03.361225  4271 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:03.366026  4325 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:03.350618  4350 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:03.380932  4405 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:03.379652  1685 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:58:03.431998  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:03.409938  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 132138us
I20260709 12:58:03.381400  4483 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:03.420603  1690 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:03.435748  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:03.248741  4330 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:03.399230  4363 raft_consensus.cc:697] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:03.441340  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1450) took 1254 ms. Trace:
I20260709 12:58:03.407032  4176 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:03.383631  4160 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:03.413409  4347 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:03.441839  1611 rpcz_store.cc:276] 0709 12:58:02.187253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:02.472306 (+285053us) service_pool.cc:224] Handling call
0709 12:58:02.485410 (+ 13104us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:02.501734 (+ 16324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:02.501768 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:03.051560 (+549792us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b2c00125b38. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85b94aa11 00007fc85b95a372 00007fc85d08ca01 00007fc85d05143a 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2
0709 12:58:03.078041 (+ 26481us) log.cc:844] Serialized 26 byte log entry
0709 12:58:03.260562 (+182521us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:03.260604 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:03.260677 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:03.438949 (+178272us) raft_consensus.cc:1685] finished
0709 12:58:03.438977 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:03.441253 (+  2276us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5452,"raft.queue_time_us":5675,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":5096,"spinlock_wait_cycles":2613120,"thread_start_us":151085,"threads_started":1,"wal-append.queue_time_us":335356}
I20260709 12:58:03.433880  1583 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:03.408409  4464 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:03.438617  4330 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:03.373569  4477 consensus_queue.cc:1048] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:58:03.455832  1583 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:03.457391  4433 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:03.457127  3809 consensus_queue.cc:237] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:03.458330  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:03.492645  1583 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:03.469168  4475 log.cc:927] Time spent T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:58:03.471369  4327 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:03.473191  4420 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:03.473850  4363 consensus_queue.cc:237] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:03.453929  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 121365us
I20260709 12:58:03.434512  4405 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:03.433472  4325 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:03.441167  4321 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:03.489483  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 175601us
I20260709 12:58:03.485922  4266 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:03.412974  4482 consensus_queue.cc:1059] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 12:58:03.498207  1689 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:03.499280  1583 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:03.500145  1505 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:03.543331  4482 raft_consensus.cc:3055] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:03.543725  4482 raft_consensus.cc:740] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:58:03.544000  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 44830.7us
W20260709 12:58:03.544176  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 44129.1us
I20260709 12:58:03.544840  4266 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:03.545275  4330 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:03.405616  4415 consensus_queue.cc:237] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:03.545710  4330 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:03.506508  1654 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:03.546182  4330 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:03.545351  4266 raft_consensus.cc:697] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:03.546509  3947 consensus_queue.cc:1059] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:03.547425  4266 consensus_queue.cc:237] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:03.548784  4479 consensus_queue.cc:1059] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:03.491035  4464 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:58:03.492552  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 135424us
I20260709 12:58:03.506786  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:03.550781  1690 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:03.498864  4347 raft_consensus.cc:2764] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:58:03.551182  1655 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:03.533182  4477 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:03.555197  1655 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:03.497193  4271 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:03.497691  4483 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:03.541725  4160 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:03.546013  1583 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:03.575845  1583 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:03.551342  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1735) took 1084 ms. Trace:
I20260709 12:58:03.576624  1690 rpcz_store.cc:276] 0709 12:58:02.466609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:03.550316 (+1083707us) service_pool.cc:224] Handling call
0709 12:58:03.550604 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:03.551122 (+   518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:03.551288 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:03.552772  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 46381.7us
I20260709 12:58:03.534595  4350 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:03.557267  1655 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:03.545651  4393 consensus_meta.cc:287] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.605s	user 0.009s	sys 0.002s
I20260709 12:58:03.516010  4387 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:03.589715  1583 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:03.620265  1583 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:03.624527  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 67333.9us
I20260709 12:58:03.559135  4464 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:03.632120  1538 raft_consensus.cc:1240] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:58:03.634719  1583 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:03.615046  4491 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:03.627238  4350 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:03.636137  4346 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:03.627612  4160 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:03.628961  4420 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:03.617063  4352 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:58:03.692353  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 146319us
I20260709 12:58:03.572979  4477 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:03.617785  4433 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:03.724187  1505 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:03.556633  4482 consensus_queue.cc:260] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:03.629135  4464 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:03.730017  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 94875.9us
I20260709 12:58:03.631533  4347 consensus_queue.cc:1059] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 12:58:03.580637  4483 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:03.734444  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 115345us
I20260709 12:58:03.625710  4492 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:03.740559  1505 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:03.741729  1655 leader_election.cc:400] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10.
I20260709 12:58:03.742163  1655 leader_election.cc:403] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:58:03.618060  4393 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:03.691962  4420 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:03.746948  1505 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:03.689254  4493 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:03.721429  4458 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:03.732241  4350 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:03.738812  4464 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:03.755918  4494 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:03.761013  4176 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:03.761675  4387 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:03.750141  4415 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:58:03.763123  4483 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:03.763988  4477 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:03.755321  4482 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:03.767593  4325 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:03.769518  4330 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:03.731029  4327 consensus_queue.cc:1048] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:58:03.711113  4346 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:03.677253  4495 consensus_queue.cc:1059] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.112s
I20260709 12:58:03.775431  4468 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:03.776454  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1725) took 1312 ms. Trace:
I20260709 12:58:03.777767  4480 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:58:03.778116  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:03.780134  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 12:58:03.781419  4489 log.cc:927] Time spent T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.277s	user 0.000s	sys 0.000s
I20260709 12:58:03.780380  4076 consensus_queue.cc:260] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:03.676838  4491 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:03.734107  4352 raft_consensus.cc:697] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:58:03.784027  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 149372us
I20260709 12:58:03.823211  4442 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:58:03.816166  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 58350.2us
I20260709 12:58:03.751772  4420 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:03.829509  1613 raft_consensus.cc:2393] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 9: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:03.795215  4415 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:03.834916  1686 rpcz_store.cc:276] 0709 12:58:02.464181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:03.057096 (+592915us) service_pool.cc:224] Handling call
0709 12:58:03.057469 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:03.250989 (+193520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:03.251035 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:03.251585 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 12:58:03.454236 (+202651us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:03.454273 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:03.454338 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:03.776228 (+321890us) raft_consensus.cc:1685] finished
0709 12:58:03.776250 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:03.776384 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":119194,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":8839,"thread_start_us":302215,"threads_started":2,"wal-append.queue_time_us":358874}
I20260709 12:58:03.783458  4458 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:03.841162  1508 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:03.875344  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:03.875536  1508 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:03.841418  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:03.876049  1615 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:58:03.842164  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:03.843817  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:03.877709  1617 raft_consensus.cc:2376] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10. Re-sending same reply.
I20260709 12:58:03.845679  1610 raft_consensus.cc:1240] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:58:03.848141  1583 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:03.795605  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 161360us
I20260709 12:58:03.842998  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:03.794713  4492 consensus_queue.cc:1048] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:58:03.828982  4366 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10.
I20260709 12:58:03.885807  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:58:03.872017  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 136797us
I20260709 12:58:03.872947  1505 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:03.873787  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:03.886816  1655 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:03.887216  1611 raft_consensus.cc:2368] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 11.
I20260709 12:58:03.884796  1583 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:03.889860  1583 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:03.885793  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:03.888451  4245 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:03.896008  1654 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:03.951081  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 61285.5us
I20260709 12:58:03.864334  4477 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 12:58:03.958658  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 71930.2us
I20260709 12:58:03.875454  4415 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:58:03.963171  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 67272.3us
I20260709 12:58:03.970643  1687 raft_consensus.cc:1240] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:58:03.885161  4437 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:03.969691  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:03.972437  1654 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:03.889772  4510 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:03.902769  4245 raft_consensus.cc:697] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 12:58:03.971177  4511 log.cc:927] Time spent T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:58:04.010509  1654 leader_election.cc:400] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 11.
I20260709 12:58:04.017225  1654 leader_election.cc:403] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:03.902921  4468 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:03.953193  4271 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:03.951509  4350 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:03.969026  4495 raft_consensus.cc:2764] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:58:04.034308  4327 raft_consensus.cc:2764] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:58:04.035115  4327 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:58:03.981483  4347 consensus_queue.cc:1059] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:58:04.037148  4347 raft_consensus.cc:3055] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:04.037508  4347 raft_consensus.cc:740] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:04.038287  4347 consensus_queue.cc:260] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.039402  4347 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:04.045485  4176 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:04.046833  4176 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:04.047365  4176 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:04.050537  4176 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:03.875272  4442 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.020085  1654 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:04.022119  4514 log.cc:927] Time spent T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:58:04.055667  4492 consensus_queue.cc:1059] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:04.055922  4468 raft_consensus.cc:697] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:03.981498  4494 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:04.028532  4458 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:04.029094  4330 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:03.983780  4477 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:03.746243  4160 consensus_queue.cc:1175] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" responder_term: 8 status { last_received { term: 5 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:58:04.029583  4510 raft_consensus.cc:697] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:04.031733  4245 consensus_queue.cc:237] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.013976  4352 consensus_queue.cc:237] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.039996  4478 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:04.040723  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:04.004106  4437 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.019387  4513 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.050782  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:04.075629  4176 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.057837  1684 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:04.023630  4491 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:04.055133  4516 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:04.025327  4346 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:03.958544  4325 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:04.063701  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:04.064929  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:04.065166  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:04.066761  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:04.112888  1540 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:58:04.068185  1542 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 12:58:04.068400  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:04.113605  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:04.113996  1537 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:58:04.114395  1533 raft_consensus.cc:2393] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 8: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:04.114516  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:04.114948  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:04.116106  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:03.901144  4509 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:04.056600  4492 raft_consensus.cc:3055] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:04.075141  1536 raft_consensus.cc:1275] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:04.091326  4478 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:04.083745  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:04.083878  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:04.124956  1535 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:04.055184  4442 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:04.079069  4505 log.cc:927] Time spent T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:58:04.091748  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:04.051025  4484 log.cc:927] Time spent T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.647s	user 0.002s	sys 0.000s
I20260709 12:58:04.111017  4176 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.134647  4176 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:04.135162  4345 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:04.140745  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:04.141464  1610 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:58:04.142516  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:04.143179  4506 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:04.143374  4510 consensus_queue.cc:237] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.100366  4393 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:04.144723  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:04.145709  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 124) took 1101 ms. Trace:
W20260709 12:58:04.106292  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:04.115031  1542 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:04.117304  1533 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:58:04.012976  4366 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:04.117404  1537 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:58:04.073526  1505 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:04.097376  4405 consensus_meta.cc:287] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.002s
I20260709 12:58:04.123664  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:04.118698  4492 raft_consensus.cc:740] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:04.126920  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:04.128404  4415 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.143621  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:04.148984  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 246795us
I20260709 12:58:04.109616  1684 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:04.162506  1615 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
W20260709 12:58:04.162599  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 89180.1us
I20260709 12:58:04.160167  1690 rpcz_store.cc:276] 0709 12:58:03.044297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:03.889186 (+844889us) service_pool.cc:224] Handling call
0709 12:58:03.889469 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:03.889671 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:58:03.984127 (+ 94456us) log.cc:844] Serialized 14 byte log entry
0709 12:58:04.142093 (+157966us) log.cc:844] Serialized 14 byte log entry
0709 12:58:04.142965 (+   872us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:04.143011 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:04.143061 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:04.145478 (+  2417us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:04.145643 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48939,"prepare.queue_time_us":112172,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":68,"raft.queue_time_us":29549,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":7584,"thread_start_us":135768,"threads_started":1}
I20260709 12:58:04.174602  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:04.174610  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:04.159991  1540 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:58:04.176396  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:04.078379  4494 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.187168  4473 raft_consensus.cc:3055] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:04.187647  4473 raft_consensus.cc:740] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:04.188349  4494 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:04.189546  4437 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:04.183236  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:04.148998  1654 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:04.197903  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1123) took 2002 ms. Trace:
I20260709 12:58:04.198300  1612 rpcz_store.cc:276] 0709 12:58:02.195169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:02.504267 (+309098us) service_pool.cc:224] Handling call
0709 12:58:02.533209 (+ 28942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:02.998205 (+464996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:04.197670 (+1199465us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b540011d5d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:04.197835 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1068050304}
I20260709 12:58:04.178810  1690 raft_consensus.cc:2393] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 5: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:04.200573  1541 raft_consensus.cc:1275] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:04.201550  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1135) took 1126 ms. Trace:
I20260709 12:58:04.201910  1583 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:04.201864  1616 rpcz_store.cc:276] 0709 12:58:03.075169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:03.075305 (+   136us) service_pool.cc:224] Handling call
0709 12:58:03.075630 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:03.078853 (+  3223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:03.078887 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:03.079458 (+   571us) log.cc:844] Serialized 26 byte log entry
0709 12:58:03.299009 (+219551us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:03.299048 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:03.299112 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:04.050435 (+751323us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:58:04.193319 (+142884us) raft_consensus.cc:1685] finished
0709 12:58:04.193341 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:04.201492 (+  8151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2746,"raft.queue_time_us":2915,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":5042,"spinlock_wait_cycles":8352640,"thread_start_us":193064,"threads_started":1,"wal-append.queue_time_us":296142}
I20260709 12:58:04.180120  1655 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:04.212019  4442 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:04.146770  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:04.143777  4506 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:04.150874  4516 raft_consensus.cc:697] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:04.183650  1534 raft_consensus.cc:2368] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5.
I20260709 12:58:04.165303  4405 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.165351  4393 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:04.184168  4492 consensus_queue.cc:260] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.183136  4415 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:04.148201  4478 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:04.181201  1535 raft_consensus.cc:1240] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:58:04.197795  4473 consensus_queue.cc:260] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.166489  4327 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 11.
I20260709 12:58:04.206028  4271 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:04.207072  4493 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:58:04.206578  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 57674.5us
I20260709 12:58:04.203879  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:04.215401  1686 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:58:04.233894  1654 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:04.233821  1690 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:04.235069  1536 raft_consensus.cc:1240] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:04.224844  4442 consensus_queue.cc:1059] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:58:04.234856  1583 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:04.217813  1655 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:04.165676  4366 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.235541  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:04.240998  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:04.249200  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1732) took 1783 ms. Trace:
I20260709 12:58:04.228148  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:04.323017  1615 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:58:04.230585  1542 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:58:04.104734  4513 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.200984  4363 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.332870  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:04.333138  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 115438us
I20260709 12:58:04.334275  1655 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:04.322762  1689 rpcz_store.cc:276] 0709 12:58:02.465903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:03.212398 (+746495us) service_pool.cc:224] Handling call
0709 12:58:03.212688 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:03.543222 (+330534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:04.248930 (+705708us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b5400391f54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:04.249133 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":656221952}
I20260709 12:58:04.245937  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:04.345328  1617 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:04.221726  1611 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:58:04.322690  1690 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:58:04.251320  1654 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:04.320456  4332 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.334983  4405 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:04.167045  4468 consensus_queue.cc:237] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.338297  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:04.339519  4366 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:04.334345  4442 consensus_queue.cc:1243] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:58:04.253284  4355 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:04.317011  4458 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:04.367640  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 1469) took 1361 ms. Trace:
I20260709 12:58:04.347625  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:04.347886  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:04.368043  1688 rpcz_store.cc:276] 0709 12:58:03.006053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:03.020405 (+ 14352us) service_pool.cc:224] Handling call
0709 12:58:04.367446 (+1347041us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b540022a6d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:04.367579 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":277434112}
I20260709 12:58:04.368782  1690 raft_consensus.cc:2393] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 7: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:04.369160  1687 raft_consensus.cc:1240] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: []
W20260709 12:58:04.351058  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 99824.8us
I20260709 12:58:04.369760  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:04.259300  4492 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:04.350762  4522 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:04.349252  4363 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.239933  4516 consensus_queue.cc:237] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.233369  4493 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:04.362926  4332 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.380125  4493 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:04.357522  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:04.344696  4506 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:04.253444  4420 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.249769  4479 raft_consensus.cc:3055] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:04.244810  4473 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:04.251631  4482 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:04.362881  1615 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:04.376732  4522 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:04.322070  4076 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:04.262550  4464 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.343550  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1451) took 2010 ms. Trace:
I20260709 12:58:04.332705  4401 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:58:04.321976  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 87214.9us
I20260709 12:58:04.434553  1691 rpcz_store.cc:276] 0709 12:58:02.333248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:02.930890 (+597642us) service_pool.cc:224] Handling call
0709 12:58:03.052580 (+121690us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:03.052806 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:03.052834 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:03.052880 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:03.052916 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:03.052976 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:04.343363 (+1290387us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b540029a9d0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:04.343490 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279152512}
I20260709 12:58:04.436513  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:04.370831  1689 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:58:04.251829  4327 consensus_queue.cc:1059] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.113s
I20260709 12:58:04.438154  1583 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:04.377395  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1464) took 1095 ms. Trace:
I20260709 12:58:04.421492  4479 raft_consensus.cc:740] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:04.379439  1617 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:04.455494  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:04.455261  4479 consensus_queue.cc:260] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.365912  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:04.356729  4499 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:04.456736  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:04.374598  4478 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.431941  4522 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:04.457891  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:04.458635  1617 raft_consensus.cc:2393] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 10: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:04.459394  4478 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:04.460033  1654 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:04.362213  4512 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:04.383158  1611 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:04.461256  1654 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:04.461423  4512 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:04.462050  4499 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:04.462181  4355 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.462944  4512 raft_consensus.cc:697] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:04.462809  4355 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.382652  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:04.389407  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:04.463949  4512 consensus_queue.cc:237] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.439838  4405 raft_consensus.cc:3055] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:04.382071  4363 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:04.465065  4405 raft_consensus.cc:740] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:04.465895  4405 consensus_queue.cc:260] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.466706  4355 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:04.466856  4405 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:04.421728  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 71994us
I20260709 12:58:04.378548  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:04.459452  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:04.440665  1613 rpcz_store.cc:276] 0709 12:58:03.281717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:03.295572 (+ 13855us) service_pool.cc:224] Handling call
0709 12:58:04.377210 (+1081638us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b5400031bd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:04.377337 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1220325632}
I20260709 12:58:04.469228  4271 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:04.443789  4433 consensus_queue.cc:1059] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:04.445744  4327 raft_consensus.cc:3055] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:04.373718  4458 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.443850  4347 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:04.470695  4347 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:04.471143  4347 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:04.435557  4401 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:04.381870  4332 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:04.464633  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:04.438619  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:04.440932  1583 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:04.470075  4327 raft_consensus.cc:740] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:04.464579  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:04.482014  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:04.472551  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:04.484709  1617 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:04.453814  4420 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:04.469841  1655 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:04.475181  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:04.477679  1611 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:58:04.488014  1682 raft_consensus.cc:2393] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 11: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:04.479275  1688 raft_consensus.cc:2393] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 9: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 12:58:04.488497  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 47658.7us
I20260709 12:58:04.489555  1583 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:04.490322  1655 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:04.479661  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:04.479174  1689 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:58:04.491133  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:04.472221  4458 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:04.500346  1617 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:04.502085  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:04.502748  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:04.491995  1686 raft_consensus.cc:2368] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 5. Current term is 6.
I20260709 12:58:04.491909  1611 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:58:04.503530  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:04.503568  1617 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:04.493992  1505 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:04.507030  3460 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.507961  3460 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.494058  1583 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:04.505241  1654 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:04.509651  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:04.509764  1505 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:04.511289  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:04.514539  1617 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:04.515651  1615 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:04.480990  4401 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:04.517477  1505 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:04.518571  1655 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:04.520392  3460 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:04.521509  3460 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:58:04.521692  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:04.491935  4332 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:04.522377  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1748) took 1431 ms. Trace:
I20260709 12:58:04.523244  3460 raft_consensus.cc:697] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:04.524521  1538 rpcz_store.cc:276] 0709 12:58:03.091422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:03.091845 (+   423us) service_pool.cc:224] Handling call
0709 12:58:03.092139 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:03.632620 (+540481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:04.517348 (+884728us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b54002e8e54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:04.522314 (+  4966us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1241399168}
I20260709 12:58:04.522342  1505 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:04.528146  1655 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:04.528095  1505 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:04.501487  4499 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:04.507419  4355 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:04.506201  4482 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:04.472154  4493 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.491423  4478 consensus_queue.cc:1048] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:58:04.529510  1615 raft_consensus.cc:1240] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:58:04.519536  4420 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:04.535818  1505 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:04.506450  4363 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:04.519815  4415 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:04.540943  3460 consensus_queue.cc:237] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.544513  1505 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:04.551717  1691 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:04.522188  4526 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:04.533165  4355 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:04.536546  4468 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:04.551990  1505 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:04.534639  4321 raft_consensus.cc:3055] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:04.542106  4503 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:04.541321  4420 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:04.546355  4442 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:04.546991  4524 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:04.546175  4363 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:04.561089  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1474) took 1298 ms. Trace:
I20260709 12:58:04.564041  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:04.564678  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:04.568616  1542 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:04.565078  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:04.551985  4495 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:04.555264  4526 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:04.554983  4513 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:04.534322  4332 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:04.569074  4420 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:04.570990  4363 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:04.569415  4506 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:04.564862  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:04.549412  4415 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:04.560202  4499 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.558921  4321 raft_consensus.cc:740] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:04.555611  4437 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:04.557364  4355 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:04.538574  4327 consensus_queue.cc:260] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:04.569928  1535 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:04.226363   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:04.572799  4510 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:04.700325  4510 raft_consensus.cc:697] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:04.701294  4510 consensus_queue.cc:237] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.575758  1683 raft_consensus.cc:2410] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:58:04.576287  4468 raft_consensus.cc:697] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:04.583696  4523 raft_consensus.cc:3055] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:04.706084  4523 raft_consensus.cc:740] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:04.582137  1685 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:58:04.584808  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1459) took 1508 ms. Trace:
I20260709 12:58:04.706347  4468 consensus_queue.cc:237] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.706955  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1478) took 1443 ms. Trace:
I20260709 12:58:04.707374  1685 rpcz_store.cc:276] 0709 12:58:03.263695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:04.581443 (+1317748us) service_pool.cc:224] Handling call
0709 12:58:04.581789 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:04.706681 (+124892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:04.706899 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:04.708556  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:04.590294  4493 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:04.593020  4401 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.710807  1685 raft_consensus.cc:1240] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:04.589808  4464 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:04.593433  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:04.589109  4522 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.580977  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:04.600890  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:04.612121  4473 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.717283  4473 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.717720  4523 consensus_queue.cc:260] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.718467  1685 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:58:04.719457  4473 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:04.720183  4522 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:04.612738  4499 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.721480  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:04.718689  4523 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:04.722108  4499 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:04.605792  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:04.723438  1685 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 12:58:04.607177  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:04.611522  4524 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:04.724390  4524 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.726548  4524 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:04.608960  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:04.727523  1533 raft_consensus.cc:2393] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 10: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:04.723829  1685 pending_rounds.cc:85] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 4
I20260709 12:58:04.728403  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:58:04.615296  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:04.729545  1685 pending_rounds.cc:107] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 12:58:04.729872  1685 raft_consensus.cc:2889] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:58:04.730216  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:04.617060  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:04.731734  1537 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:04.613193  4321 consensus_queue.cc:260] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.733803  4321 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:04.732915  4355 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.630336  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:04.640028  1686 raft_consensus.cc:1275] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:04.755849  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:04.767402  1686 raft_consensus.cc:1240] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:04.769151  4355 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:04.638150  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1743) took 1404 ms. Trace:
I20260709 12:58:04.763414  4433 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:58:04.770117  1687 rpcz_store.cc:276] 0709 12:58:03.233867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:03.971505 (+737638us) service_pool.cc:224] Handling call
0709 12:58:04.368970 (+397465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:04.369485 (+   515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:04.637939 (+268454us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b540022a6d0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:04.638084 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":913495424}
W20260709 12:58:04.629349  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 63172.8us
W20260709 12:58:04.648152  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:04.648319  1691 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 12:58:04.772084  1655 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:04.773849  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:04.774500  1687 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:04.778420  1537 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:58:04.779440  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:04.781018  1655 leader_election.cc:400] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5.
I20260709 12:58:04.681756  1688 raft_consensus.cc:1240] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:04.748982  1685 raft_consensus.cc:1240] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:04.681377  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:04.781998  1684 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
W20260709 12:58:04.782604  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:04.614347  4271 raft_consensus.cc:3055] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:04.690265  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:04.655748  4515 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:04.670400  4479 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:04.622228  4458 consensus_queue.cc:1059] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.139s
I20260709 12:58:04.695461  4516 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:04.695528  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1477) took 1432 ms. Trace:
I20260709 12:58:04.689574  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:04.757083  4165 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
W20260709 12:58:04.861429  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 81988us
I20260709 12:58:04.622012  4477 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:04.659051  1440 catalog_manager.cc:5697] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 7 to 9, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:58:04.858589  1536 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:04.661957  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:04.761776  4309 consensus_queue.cc:1059] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:04.655850  4405 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.693100  4352 consensus_queue.cc:1059] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:58:04.615927  4437 raft_consensus.cc:697] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:04.685179  4363 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.723711  1534 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:58:04.878069  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:04.879393  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:04.656597  4420 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.711951  4401 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:04.596832  4332 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:04.882213  4420 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:04.881860  4437 consensus_queue.cc:237] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.756060  4499 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:04.882954  4499 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.885179  4499 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:04.646981  4347 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.885886  4363 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:04.886905  1612 raft_consensus.cc:1240] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:58:04.887099  4347 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:04.780944  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:04.887593  1615 raft_consensus.cc:2393] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 10: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:04.889107  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:04.889725  1615 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:04.890540  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:04.890923  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:04.891518  1537 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:04.891587  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:04.699570  1611 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:58:04.629443  4328 consensus_queue.cc:1059] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.244s
I20260709 12:58:04.623136  4415 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:04.576399  4503 raft_consensus.cc:697] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:04.585655  4495 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:04.713698  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:04.696249  1689 rpcz_store.cc:276] 0709 12:58:03.262809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:04.491464 (+1228655us) service_pool.cc:224] Handling call
0709 12:58:04.491764 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:04.491976 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:58:04.522597 (+ 30621us) log.cc:844] Serialized 14 byte log entry
0709 12:58:04.560124 (+ 37527us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:04.560177 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:04.560231 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:04.560904 (+   673us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:04.561030 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18017,"prepare.queue_time_us":41224,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":7866,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":24085,"thread_start_us":36156,"threads_started":1,"wal-append.queue_time_us":87313}
I20260709 12:58:04.603367  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:04.793910  1581 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:04.791296  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1476) took 1528 ms. Trace:
I20260709 12:58:04.714373  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:04.602598  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:04.786199  1685 raft_consensus.cc:1275] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:58:04.792790  1614 raft_consensus.cc:2368] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5.
I20260709 12:58:04.789680  1691 raft_consensus.cc:1275] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:04.571297  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1473) took 1308 ms. Trace:
I20260709 12:58:04.633656  1610 raft_consensus.cc:1240] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:58:04.627971  1538 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:04.856158  1682 rpcz_store.cc:276] 0709 12:58:03.263486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:04.505547 (+1242061us) service_pool.cc:224] Handling call
0709 12:58:04.510215 (+  4668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:04.510419 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:04.685146 (+174727us) log.cc:844] Serialized 14 byte log entry
0709 12:58:04.695154 (+ 10008us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:04.695212 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:04.695262 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:04.695356 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:04.695464 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14504,"prepare.queue_time_us":40238,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":1730,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":132,"thread_start_us":160274,"threads_started":2,"wal-append.queue_time_us":15489}
I20260709 12:58:04.692413  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:04.863049  4515 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:04.861465  1687 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:04.862843  1613 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:04.707149  1609 rpcz_store.cc:276] 0709 12:58:03.147725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:03.147875 (+   150us) service_pool.cc:224] Handling call
0709 12:58:03.180293 (+ 32418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:03.256867 (+ 76574us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:03.298151 (+ 41284us) log.cc:844] Serialized 14 byte log entry
0709 12:58:04.056559 (+758408us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b1800038140. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf123a 00007fc85d05ba2a
0709 12:58:04.218185 (+161626us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:04.218239 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:04.218284 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:04.584568 (+366284us) spinlock_profiling.cc:243] Waited 76.3 ms on lock 0x7b54002fe754. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:04.584615 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:04.584750 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":40596,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":325,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":3561,"spinlock_wait_cycles":200036992,"thread_start_us":161386,"threads_started":1,"wal-append.queue_time_us":1041871}
I20260709 12:58:04.636777  4506 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 12:58:04.873179  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:04.872525  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:04.602738  4513 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:04.873239  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:04.600518  4442 raft_consensus.cc:697] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 8 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:04.593807  4526 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:04.876259  4460 raft_consensus.cc:3055] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:04.791896  4271 raft_consensus.cc:740] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:04.667829  1535 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:04.663079  1508 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:04.879943  1440 catalog_manager.cc:5697] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:04.892390  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:05.342191  1537 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:04.892771  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:04.941848  1615 raft_consensus.cc:1240] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:05.344751  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1478) took 1219 ms. Trace:
W20260709 12:58:05.193128  1438 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54582 (request call id 150) took 14380 ms (client timeout 15000 ms). Trace:
W20260709 12:58:05.139842  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:05.347370  1688 rpcz_store.cc:276] 0709 12:58:03.263263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:04.492513 (+1229250us) service_pool.cc:224] Handling call
0709 12:58:04.502751 (+ 10238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:04.781564 (+278813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:04.791060 (+  9496us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54003b6ad4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:04.791234 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":411236224}
W20260709 12:58:05.348299  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:05.125330  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:04.874487  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 87337.3us
W20260709 12:58:05.047861  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:05.027473  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:04.789913  4522 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:05.343184  1534 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
W20260709 12:58:05.348903  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:04.915091  1611 raft_consensus.cc:1275] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:05.368064  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:05.358731  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1146) took 1463 ms. Trace:
W20260709 12:58:05.343364  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 680393us
I20260709 12:58:05.370286  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1477) took 1249 ms. Trace:
I20260709 12:58:05.371091  1608 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:05.370441  1617 rpcz_store.cc:276] 0709 12:58:03.895015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:04.515198 (+620183us) service_pool.cc:224] Handling call
0709 12:58:04.515492 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:04.515659 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:04.533295 (+ 17636us) log.cc:844] Serialized 14 byte log entry
0709 12:58:04.908617 (+375322us) log.cc:844] Serialized 14 byte log entry
0709 12:58:05.358306 (+449689us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:05.358369 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:05.358422 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:05.358514 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:05.358660 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":448992,"prepare.queue_time_us":23925,"prepare.run_cpu_time_us":159,"prepare.run_wall_time_us":10303,"raft.queue_time_us":84672,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":75,"thread_start_us":373921,"threads_started":2,"wal-append.queue_time_us":148541}
I20260709 12:58:05.371335  1611 rpcz_store.cc:276] 0709 12:58:04.120779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:04.914347 (+793568us) service_pool.cc:224] Handling call
0709 12:58:04.914706 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:05.369512 (+454806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:05.369715 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:05.369071  1683 raft_consensus.cc:2410] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 12:58:05.361452  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 567634us
I20260709 12:58:05.346778  1687 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:05.375648  1581 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:05.367555  1440 catalog_manager.cc:5697] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:58:05.353417  1615 rpcz_store.cc:276] 0709 12:58:04.125628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:04.914349 (+788721us) service_pool.cc:224] Handling call
0709 12:58:04.941638 (+ 27289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:05.344468 (+402830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:05.344694 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:05.360853  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:05.380570  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1149) took 1311 ms. Trace:
I20260709 12:58:05.381789  1537 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:05.382057  1535 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:05.341683  1690 rpcz_store.cc:276] 0709 12:58:03.262560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:04.482909 (+1220349us) service_pool.cc:224] Handling call
0709 12:58:04.483183 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:04.483403 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:04.507698 (+ 24295us) log.cc:844] Serialized 14 byte log entry
0709 12:58:04.570966 (+ 63268us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:04.571015 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:04.571058 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:04.571121 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:04.571244 (+   123us) inbound_call.cc:177] Queueing success response
0709 12:58:04.595817 (+ 24573us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b48001c0158. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc861f7aaa1 00007fc861f71b37 00007fc861f719ca 00007fc86206926f 00007fc862068f37 00007fc86207d55c 00007fc86207d508 00007fc86207d488 00007fc86207d443 00007fc86207c6ec 00007fc860fa6a96
Metrics: {"mutex_wait_us":10224,"prepare.queue_time_us":39440,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":10329,"raft.run_cpu_time_us":2030,"raft.run_wall_time_us":20079,"spinlock_wait_cycles":41820032,"thread_start_us":52585,"threads_started":1,"wal-append.queue_time_us":155831}
I20260709 12:58:05.383188  1539 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:58:05.385495  1682 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:58:05.387390  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:05.381021  1610 rpcz_store.cc:276] 0709 12:58:04.068770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:04.633125 (+564355us) service_pool.cc:224] Handling call
0709 12:58:04.633438 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:05.380236 (+746798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:05.380503 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:05.425510  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 49980.7us
I20260709 12:58:05.428071  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:05.431473  1581 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:05.431667  1685 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:05.426900  1654 leader_election.cc:400] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5.
I20260709 12:58:05.432799  1654 leader_election.cc:403] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:58:05.390199  1613 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:05.367451  4522 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:04.905345  3947 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:05.437364  3947 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:05.436105  4401 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.441306  4401 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:05.441819  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:05.442734  1688 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:05.435945  4522 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:05.432942  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:05.436620  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:04.973889  4477 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.438215  1538 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:58:05.365046  4468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.039s	sys 0.024s
I20260709 12:58:05.234127  4510 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.340986  4460 raft_consensus.cc:740] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:58:05.373162  4492 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:05.455461  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1152) took 1080 ms. Trace:
I20260709 12:58:05.413215  4433 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:05.455742  4468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.040s	sys 0.024s
I20260709 12:58:04.893337  4321 consensus_queue.cc:1059] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.572s
I20260709 12:58:05.445878  4332 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:05.390708  1440 catalog_manager.cc:5697] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 6 to 8, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 8 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:05.465907  1608 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:58:04.804042  4473 consensus_queue.cc:1059] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.642s
I20260709 12:58:05.367580  4347 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:05.381127  4506 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:05.373365  4464 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:05.030119  4245 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.376886  4363 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.435257  1613 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:05.377005  4387 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:05.472405  1610 rpcz_store.cc:276] 0709 12:58:04.375295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:05.453956 (+1078661us) service_pool.cc:224] Handling call
0709 12:58:05.454529 (+   573us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:05.454864 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:05.454919 (+    55us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:05.454990 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:05.455054 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:05.455139 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:05.455374 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:05.382989  4328 raft_consensus.cc:3055] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:05.475744  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:04.874924  4405 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:05.478515  1686 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.034s	sys 0.049s
I20260709 12:58:05.378566  4513 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:05.483248  1685 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:05.495070  1608 raft_consensus.cc:1240] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:58:05.537168  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1154) took 1161 ms. Trace:
I20260709 12:58:05.484849  4401 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:05.499056  1537 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10. Ops: [7.4-9.5]
W20260709 12:58:05.351572  1438 rpcz_store.cc:269] 0709 12:57:50.790711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:50.790865 (+   154us) service_pool.cc:224] Handling call
0709 12:58:05.170826 (+14379961us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:00.774963 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:00.820972 (+ 46009us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:00.821024 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:58:00.821055 (+    31us) tablet.cc:662] Decoding operations
0709 12:58:00.823342 (+  2287us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:00.823436 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:00.823463 (+    27us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:58:00.840580 (+ 17117us) tablet.cc:701] Row locks acquired
0709 12:58:00.840625 (+    45us) write_op.cc:260] PREPARE: finished
0709 12:58:00.840830 (+   205us) write_op.cc:270] Start()
0709 12:58:00.840975 (+   145us) write_op.cc:276] Timestamp: P: 1783601880840764 usec, L: 0
0709 12:58:00.840996 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:58:00.841768 (+   772us) log.cc:844] Serialized 6749 byte log entry
0709 12:58:01.509847 (+668079us) op_driver.cc:464] REPLICATION: finished
0709 12:58:01.691779 (+181932us) write_op.cc:301] APPLY: starting
0709 12:58:01.691870 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:01.692199 (+   329us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:01.692345 (+   146us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:01.703675 (+ 11330us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:01.704011 (+   336us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 12:58:01.704054 (+    43us) write_op.cc:312] APPLY: finished
0709 12:58:01.711174 (+  7120us) log.cc:844] Serialized 118 byte log entry
0709 12:58:01.711410 (+   236us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:01.711583 (+   173us) write_op.cc:454] Released schema lock
0709 12:58:01.711651 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:01.714252 (+  2601us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:01.714435 (+   183us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12449,"reported_tablets":57,"child_traces":[["op",{"apply.queue_time_us":181666,"apply.run_cpu_time_us":5115,"apply.run_wall_time_us":21060,"num_ops":17,"prepare.queue_time_us":395313,"prepare.run_cpu_time_us":18598,"prepare.run_wall_time_us":197764,"raft.queue_time_us":221319,"raft.run_cpu_time_us":64809,"raft.run_wall_time_us":139907,"replication_time_us":668686,"thread_start_us":379762,"threads_started":4,"wal-append.queue_time_us":239250,"wal-append.run_cpu_time_us":25934,"wal-append.run_wall_time_us":1682387}]]}
W20260709 12:58:05.480244  4437 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.001s	sys 0.015s
W20260709 12:58:05.483659  4352 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.021s	sys 0.037s
I20260709 12:58:05.530565  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1480) took 1337 ms. Trace:
I20260709 12:58:05.544307  1613 rpcz_store.cc:276] 0709 12:58:04.193503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:05.434389 (+1240886us) service_pool.cc:224] Handling call
0709 12:58:05.434816 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:05.530260 (+ 95444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:05.530503 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:05.479437  4523 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:05.533716  1686 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.034s	sys 0.050s
I20260709 12:58:05.533488  1689 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:05.537871  1608 rpcz_store.cc:276] 0709 12:58:04.375937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:05.494529 (+1118592us) service_pool.cc:224] Handling call
0709 12:58:05.494895 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:05.536890 (+ 41995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:05.537110 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:05.495491  1688 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:58:05.466312  4477 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:05.467866  4510 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:05.549938  1608 raft_consensus.cc:1240] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:05.479400  4492 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:05.549650  1541 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:05.533285  4328 raft_consensus.cc:740] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:05.500563  4332 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:05.535988  4363 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:05.539076  4557 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:05.527356  4347 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:05.481163  4271 consensus_queue.cc:260] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:05.533672  4245 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:05.608683  4405 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:05.530817  4464 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:05.537393  4473 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 4. Current term is 5.
I20260709 12:58:05.563215  1613 raft_consensus.cc:1240] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:05.540975  4387 raft_consensus.cc:697] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 12:58:05.546226  4352 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.021s	sys 0.038s
I20260709 12:58:05.609591  1539 raft_consensus.cc:1240] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: []
W20260709 12:58:05.543561  4437 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.010s	sys 0.015s
I20260709 12:58:05.623546  1608 raft_consensus.cc:1275] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:58:05.623929  1608 pending_rounds.cc:85] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f: Aborting all ops after (but not including) 3
I20260709 12:58:05.624171  1608 pending_rounds.cc:107] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:58:05.624392  1608 raft_consensus.cc:2889] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:05.549880  4401 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:05.550734  4558 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:05.622483  1613 raft_consensus.cc:1240] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:05.530747  4442 consensus_queue.cc:237] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:05.530534  4503 consensus_queue.cc:237] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:05.554466  4523 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:05.648005  1689 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:05.613395  3947 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:05.656126   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:05.540361  4460 consensus_queue.cc:260] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:05.653813  4515 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:05.652084  4352 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:05.664722  4558 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.610989  4557 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:05.664176  4245 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:05.671705  4460 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:05.655470  4401 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:05.694200  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1770) took 1053 ms. Trace:
I20260709 12:58:05.673667  4352 raft_consensus.cc:697] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:58:05.688994  4555 log.cc:927] Time spent T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:58:05.734882  1539 rpcz_store.cc:276] 0709 12:58:04.641260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:05.440665 (+799405us) service_pool.cc:224] Handling call
0709 12:58:05.441136 (+   471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:05.617713 (+176577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:05.693947 (+ 76234us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b540045db54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:05.694134 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":386911104}
I20260709 12:58:05.745048  1611 raft_consensus.cc:1240] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 12:58:05.745672  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:05.746358  1611 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:05.747668  1611 raft_consensus.cc:1275] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:58:05.746304  1617 raft_consensus.cc:1275] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:05.754941  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1489) took 1191 ms. Trace:
I20260709 12:58:05.755414  1608 rpcz_store.cc:276] 0709 12:58:04.563257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:05.551839 (+988582us) service_pool.cc:224] Handling call
0709 12:58:05.552045 (+   206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:05.646390 (+ 94345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:05.754647 (+108257us) spinlock_profiling.cc:243] Waited 69.7 ms on lock 0x7b540008cfd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:05.754874 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":160371456}
I20260709 12:58:05.758038  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 99) took 1064 ms. Trace:
I20260709 12:58:05.758524  1613 rpcz_store.cc:276] 0709 12:58:04.694043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:05.651366 (+957323us) service_pool.cc:224] Handling call
0709 12:58:05.651585 (+   219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:05.701274 (+ 49689us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:05.701304 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:05.701349 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:05.701381 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:05.757746 (+ 56365us) spinlock_profiling.cc:243] Waited 49.5 ms on lock 0x7b5400445554. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:05.757793 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:05.757954 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113828736}
I20260709 12:58:05.761379  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1773) took 1119 ms. Trace:
I20260709 12:58:05.761799  1535 rpcz_store.cc:276] 0709 12:58:04.642052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:05.447965 (+805913us) service_pool.cc:224] Handling call
0709 12:58:05.448309 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:05.555110 (+106801us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:05.555142 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:05.555182 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:05.555213 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:05.761140 (+205927us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b540010b8d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:05.761182 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:05.761322 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245209856}
I20260709 12:58:05.680748  4558 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:05.811911  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 12:58:05.771886  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 401069us
I20260709 12:58:05.684300  4387 consensus_queue.cc:237] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:05.816309  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1762) took 1213 ms. Trace:
I20260709 12:58:05.816747  1534 rpcz_store.cc:276] 0709 12:58:04.603047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:05.377365 (+774318us) service_pool.cc:224] Handling call
0709 12:58:05.377615 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:05.408876 (+ 31261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:05.408913 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:05.408960 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:05.408993 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:05.816065 (+407072us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b5400186fd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:05.816119 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:05.816251 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71164288}
W20260709 12:58:05.843892  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:05.769306  4562 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.770529  4495 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:05.770110  4477 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:05.768222  4513 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:05.806671  4332 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:05.798341  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 371630us
I20260709 12:58:05.876423  1508 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:05.877512  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1489) took 1507 ms. Trace:
I20260709 12:58:05.771838  4492 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:05.815313  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 1774) took 1173 ms. Trace:
I20260709 12:58:05.813102  4363 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:05.813957  4347 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:05.891759  1541 rpcz_store.cc:276] 0709 12:58:04.642296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:04.713416 (+ 71120us) service_pool.cc:224] Handling call
0709 12:58:05.815122 (+1101706us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b540010ccd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:05.815249 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468137216}
I20260709 12:58:05.892596  1684 rpcz_store.cc:276] 0709 12:58:04.369894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:04.783586 (+413692us) service_pool.cc:224] Handling call
0709 12:58:04.783860 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:05.433384 (+649524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:05.433418 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:05.433461 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:05.433500 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:05.877053 (+443553us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b540041c154. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:05.877102 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:05.877444 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1493350656}
I20260709 12:58:05.815347  4516 raft_consensus.cc:3055] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:58:05.916500  1505 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.028s	sys 0.040s
W20260709 12:58:05.916936  1505 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.028s	sys 0.040s
I20260709 12:58:05.876116  4510 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:05.879074  4464 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:05.919044  1508 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:05.924610  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:05.927802  1684 raft_consensus.cc:1240] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 4. Current term is 5. Ops: []
I20260709 12:58:05.892966  4327 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:05.894498  4477 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:05.917157  4492 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:05.911520  4332 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.936776  1508 leader_election.cc:400] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 5. Current term is 6.
I20260709 12:58:05.878010  4562 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:05.920789  4516 raft_consensus.cc:740] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:58:05.941722  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 510398us
W20260709 12:58:05.938364  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:05.942775  1505 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:05.924786  4513 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:05.922763  4347 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.933441  4464 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.928885  4523 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:05.935030  4561 log.cc:927] Time spent T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 12:58:05.934708  4571 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.878619  4352 consensus_queue.cc:237] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:05.938971  4495 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.952382  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1471) took 1987 ms. Trace:
I20260709 12:58:05.952512  1508 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:05.955344  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:05.972287  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:05.956331  4557 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:05.973063  1613 raft_consensus.cc:1813] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Handling vote request from an unknown peer dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:05.933997  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 12:58:05.946012  4559 log.cc:927] Time spent T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 12:58:05.958081  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1130) took 1182 ms. Trace:
I20260709 12:58:06.013911  1538 rpcz_store.cc:276] 0709 12:58:04.775616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:05.464396 (+688780us) service_pool.cc:224] Handling call
0709 12:58:05.464710 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:05.464895 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:05.648960 (+184065us) log.cc:844] Serialized 14 byte log entry
0709 12:58:05.957732 (+308772us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:05.957790 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:05.957836 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:05.957899 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:05.958018 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14262,"prepare.queue_time_us":289988,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":1450,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":6064,"thread_start_us":477200,"threads_started":2}
I20260709 12:58:05.964731  1655 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:06.016742  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 52102us
W20260709 12:58:05.969678  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:05.953325  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 203948us
I20260709 12:58:05.972944  1612 rpcz_store.cc:276] 0709 12:58:03.965287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:04.631239 (+665952us) service_pool.cc:224] Handling call
0709 12:58:04.631607 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:05.341295 (+709688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:05.952093 (+610798us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b54002571d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:05.952311 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":586631936}
I20260709 12:58:05.979353  1614 raft_consensus.cc:1275] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:58:05.939965  4477 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:05.957042  4573 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.967703  4572 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.981190  1613 raft_consensus.cc:2410] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:58:05.970629  4574 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.982573  1583 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:05.983574  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:05.956949  4437 consensus_queue.cc:1048] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:58:06.059760  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:06.064656  1613 raft_consensus.cc:2410] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:58:05.945909  4332 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:05.988168  4524 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.990447  4510 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.991122  4585 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.991827  4568 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:05.992462  4558 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:05.993156  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:06.078441  1611 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:06.078819  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:06.079417  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:05.959285  4567 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:05.951469  4515 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:58:05.969226  1581 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:06.019037  2267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:05.966264  4347 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.019732  1655 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:06.073683  4522 consensus_meta.cc:287] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.606s	user 0.005s	sys 0.005s
I20260709 12:58:05.940637  4492 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:05.980660  4523 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:06.068439  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:05.974035  4401 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:58:06.044903  1536 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.014s	sys 0.022s
W20260709 12:58:06.123371  1536 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.016s	sys 0.024s
I20260709 12:58:06.077001  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:06.026033  4321 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.971583  4464 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.013904  4557 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 12:58:06.103006  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 133861us
I20260709 12:58:05.980525  4516 consensus_queue.cc:260] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.101846  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:06.024036  1654 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:06.075762  4506 consensus_meta.cc:287] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.542s	user 0.007s	sys 0.003s
I20260709 12:58:06.108659  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:05.985193  4495 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:06.127447  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1155) took 1751 ms. Trace:
I20260709 12:58:06.083086  4568 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:06.130272  1581 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:06.140002  1581 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:06.131645  1612 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:06.138154  1610 rpcz_store.cc:276] 0709 12:58:04.376244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:05.531012 (+1154768us) service_pool.cc:224] Handling call
0709 12:58:05.531311 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:05.531519 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:05.945750 (+414231us) log.cc:844] Serialized 14 byte log entry
0709 12:58:06.127014 (+181264us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:06.127079 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:06.127132 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:06.127218 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:06.127371 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":459033,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"thread_start_us":579251,"threads_started":2}
I20260709 12:58:06.191974  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:06.194078  1608 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:05.979250  4571 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.104691  4590 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:06.130782  4560 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:06.144979  1611 raft_consensus.cc:2393] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 8: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:06.078457  4524 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.082212  4510 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.058833  4573 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:06.066622  4572 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:06.210805  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 220832us
W20260709 12:58:06.129382  4526 consensus_meta.cc:287] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.753s	user 0.012s	sys 0.000s
I20260709 12:58:06.136799  4401 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:06.210217  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 244602us
I20260709 12:58:06.119110  4513 consensus_queue.cc:1048] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.100s
I20260709 12:58:06.118687  4522 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.191529  4557 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:06.100718  4585 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.143870  4506 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.145380  4568 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:06.071312  4574 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.130935  4523 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.129012  4582 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:06.202126  4584 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:06.143865  4321 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.219157  4473 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:06.237165  4526 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.241361  4401 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.217074  4560 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.257952  4573 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:06.338994  4573 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:06.339730  4347 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:06.340029  1542 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:58:06.259835  4572 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:06.261498  4510 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:06.320402  4582 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.344770  4582 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:06.345389  4582 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:06.345860  4585 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:06.261909  4557 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:58:06.262903  4577 log.cc:927] Time spent T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:58:06.266080  4574 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:06.267798  4327 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:06.244325  4562 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:06.269032  4415 consensus_meta.cc:287] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.892s	user 0.012s	sys 0.000s
I20260709 12:58:06.270054  4332 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:06.258002  4600 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:06.268921  1617 raft_consensus.cc:1275] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:58:06.271083  4506 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:06.271782  4495 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:06.272701  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1767) took 1668 ms. Trace:
W20260709 12:58:06.275365  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 171397us
I20260709 12:58:06.277078  3460 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:06.278025  1691 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 11. Current term is 12. Ops: [11.5-11.5]
W20260709 12:58:06.325290  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 94819.9us
W20260709 12:58:06.326033  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 94949.4us
I20260709 12:58:06.214025  4590 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.325292  4584 raft_consensus.cc:697] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:06.328299  4522 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:06.329026  4401 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:06.330927  4526 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:06.331324  4601 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:58:06.333043  4580 log.cc:927] Time spent T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 12:58:06.268007  4523 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:06.336212  4464 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:06.259920  4492 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:06.337803  4571 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:06.349437  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:06.352336  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:06.345911  4582 raft_consensus.cc:697] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:06.358003  4477 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:06.358574  1540 rpcz_store.cc:276] 0709 12:58:04.604287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:05.378572 (+774285us) service_pool.cc:224] Handling call
0709 12:58:05.378840 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:05.379042 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:05.831144 (+452102us) log.cc:844] Serialized 14 byte log entry
0709 12:58:06.064950 (+233806us) log.cc:844] Serialized 14 byte log entry
0709 12:58:06.260145 (+195195us) spinlock_profiling.cc:243] Waited 5.22 ms on lock 0x7b180039bf80. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859edec0a 00007fc86361e219 00007fc859f66a40 00007fc859f614e4 00007fc859f61455 00007fc85d049060 00007fc85d05b716 00007fc85d06c287 00007fc85d06c208
0709 12:58:06.260302 (+   157us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:06.260352 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:06.260403 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:06.272506 (+ 12103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:06.272641 (+   135us) inbound_call.cc:177] Queueing success response
0709 12:58:06.333813 (+ 61172us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b180039bf80. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f643f3 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd 000000000038f354 000000000038f199 00007fc859f4783a
Metrics: {"mutex_wait_us":3509,"prepare.queue_time_us":313665,"prepare.run_cpu_time_us":128,"prepare.run_wall_time_us":1314,"raft.queue_time_us":208869,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":232,"spinlock_wait_cycles":20318464,"thread_start_us":625446,"threads_started":2,"wal-append.queue_time_us":369873}
I20260709 12:58:06.410929  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 12:58:06.419454  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 59825.8us
I20260709 12:58:06.420253  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:06.420837  1508 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:06.421404  4597 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:06.421701  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:06.422519  4492 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:06.423069  4492 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:06.424208  4562 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:58:06.425962  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 65958.5us
I20260709 12:58:06.426577  4584 consensus_queue.cc:237] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.428735  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1761) took 2316 ms. Trace:
I20260709 12:58:06.429483  4585 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:06.430768  4405 consensus_queue.cc:1059] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:06.431069  4492 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:06.359381  3460 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.434841  3460 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:06.408640  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 12:58:06.437575  1542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 1756) took 1836 ms (client timeout 2108 ms). Trace:
I20260709 12:58:06.379073  4332 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:06.429147  1686 rpcz_store.cc:276] 0709 12:58:04.112519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:04.768318 (+655799us) service_pool.cc:224] Handling call
0709 12:58:04.768630 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:04.888155 (+119525us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:04.888465 (+   310us) log.cc:844] Serialized 14 byte log entry
0709 12:58:05.831908 (+943443us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:05.831965 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:05.832014 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:06.428515 (+596501us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54002896d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:06.428561 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:06.428677 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2887,"prepare.queue_time_us":279,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":340745,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":8632,"spinlock_wait_cycles":274402688,"thread_start_us":941645,"threads_started":2,"wal-append.queue_time_us":779589}
I20260709 12:58:06.245230  4581 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:06.429731  4165 raft_consensus.cc:3055] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:06.431813  4405 raft_consensus.cc:3055] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:06.432858  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 12:58:06.438014  1542 rpcz_store.cc:269] 0709 12:58:04.601530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:04.606876 (+  5346us) service_pool.cc:224] Handling call
0709 12:58:06.437400 (+1830524us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b540021a2d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:06.437515 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3641966848}
I20260709 12:58:06.453012  4405 raft_consensus.cc:740] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:06.452811  4165 raft_consensus.cc:740] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:06.453907  4590 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:06.454263  4405 consensus_queue.cc:260] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.454775  4165 consensus_queue.cc:260] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.455610  4405 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:06.455818  4165 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:06.373667  4600 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.453253  4328 consensus_queue.cc:260] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.462918  4600 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:06.463511  4328 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:06.465996  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1479) took 2297 ms. Trace:
I20260709 12:58:06.466404  1609 rpcz_store.cc:276] 0709 12:58:04.169039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:05.431744 (+1262705us) service_pool.cc:224] Handling call
0709 12:58:05.465398 (+ 33654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:05.646390 (+180992us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:05.957162 (+310772us) log.cc:844] Serialized 14 byte log entry
0709 12:58:06.195237 (+238075us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:06.195302 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:06.195356 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:06.465764 (+270408us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b5400032ad4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:06.465811 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:06.465940 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9393,"prepare.queue_time_us":344461,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":178040,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":13583,"spinlock_wait_cycles":367679232,"thread_start_us":522796,"threads_started":3,"wal-append.queue_time_us":284707}
I20260709 12:58:06.469847  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1777) took 1043 ms. Trace:
I20260709 12:58:06.470270  1687 rpcz_store.cc:276] 0709 12:58:05.426630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:05.426824 (+   194us) service_pool.cc:224] Handling call
0709 12:58:05.427283 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:05.451074 (+ 23791us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:05.658355 (+207281us) log.cc:844] Serialized 14 byte log entry
0709 12:58:06.116919 (+458564us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:06.179112 (+ 62193us) log.cc:844] Serialized 26 byte log entry
0709 12:58:06.179298 (+   186us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:06.179341 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:06.179426 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:06.469636 (+290210us) raft_consensus.cc:1685] finished
0709 12:58:06.469657 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:06.469791 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18096,"prepare.queue_time_us":285834,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":4173,"raft.queue_time_us":285496,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":34750,"thread_start_us":623402,"threads_started":3,"wal-append.queue_time_us":404000}
I20260709 12:58:06.406427  4245 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:06.472679  4245 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.474756  4560 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:06.475452  4245 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:06.476447  4363 raft_consensus.cc:3055] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:06.476960  4363 raft_consensus.cc:740] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:06.477854  4363 consensus_queue.cc:260] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.479178  4363 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:06.479537  4568 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.356063  4596 consensus_queue.cc:1059] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:58:06.358301  4415 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.483232  1537 raft_consensus.cc:1240] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:06.484321  4415 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:06.484844  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1137) took 1705 ms. Trace:
I20260709 12:58:06.484995  4332 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.485275  1537 rpcz_store.cc:276] 0709 12:58:04.779233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:05.541563 (+762330us) service_pool.cc:224] Handling call
0709 12:58:05.556337 (+ 14774us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:06.483666 (+927329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:06.484608 (+   942us) spinlock_profiling.cc:243] Waited 927 ms on lock 0x7b54003f98d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:06.484783 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2131416832}
I20260709 12:58:06.486367  4516 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:06.270661  4583 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:06.280723  4479 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:06.479604  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1776) took 1706 ms. Trace:
I20260709 12:58:06.497990  1691 rpcz_store.cc:276] 0709 12:58:04.772767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:05.351546 (+578779us) service_pool.cc:224] Handling call
0709 12:58:05.351832 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:06.359443 (+1007611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:06.479338 (+119895us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b5400189a54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:06.479541 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2129515776}
W20260709 12:58:06.499204  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 523927us
W20260709 12:58:06.488708  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:06.423944  4597 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:06.497560  4405 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:06.523000  4405 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:06.511097  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:06.511744  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:06.518095  4596 consensus_queue.cc:1243] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:58:06.518474  4524 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:06.518919  3460 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:06.497013  4401 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:06.540992  3460 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:06.501821  4460 consensus_meta.cc:287] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.795s	user 0.004s	sys 0.007s
I20260709 12:58:06.551332  4405 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:06.462952  4581 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.462107  4582 consensus_queue.cc:237] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.558230  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1164) took 1860 ms. Trace:
W20260709 12:58:06.649936  1533 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 1776) took 2007 ms (client timeout 1906 ms). Trace:
I20260709 12:58:06.652840  4321 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:06.714224  4332 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:06.558746  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 539122us
I20260709 12:58:06.729830  1655 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:06.547246  4433 consensus_meta.cc:287] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 1.066s	user 0.011s	sys 0.001s
I20260709 12:58:06.731593  4433 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:58:06.720140  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 220306us
I20260709 12:58:06.625005  2303 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:58:06.734004  1583 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:06.734285  4583 consensus_queue.cc:1048] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:06.723297  4581 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:06.644385  4567 raft_consensus.cc:3055] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:06.734990  1583 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:06.735371  4567 raft_consensus.cc:740] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:06.552366  4401 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.735987  1583 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:06.736224  4601 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:06.736756  4602 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:06.761698  4583 consensus_queue.cc:1243] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:58:06.762487  4602 raft_consensus.cc:697] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:06.734617  1656 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
W20260709 12:58:06.702144  1581 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.004s	sys 0.012s
W20260709 12:58:06.763346  1581 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.007s	sys 0.012s
I20260709 12:58:06.754680  4615 consensus_queue.cc:1059] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:58:06.747330  4613 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:58:06.752080  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:06.717255  1615 rpcz_store.cc:276] 0709 12:58:04.697897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:05.742521 (+1044624us) service_pool.cc:224] Handling call
0709 12:58:05.753403 (+ 10882us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:05.753656 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:05.962632 (+208976us) log.cc:844] Serialized 14 byte log entry
0709 12:58:06.557870 (+595238us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:06.557930 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:06.557980 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:06.558048 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:06.558167 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":237416,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":204183,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":23470,"thread_start_us":799080,"threads_started":3,"wal-append.queue_time_us":378662}
W20260709 12:58:06.740895  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:06.765810  1684 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:06.554804  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1132) took 1778 ms. Trace:
I20260709 12:58:06.758948  4585 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:06.767343  1536 rpcz_store.cc:276] 0709 12:58:04.776088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:05.473485 (+697397us) service_pool.cc:224] Handling call
0709 12:58:05.495790 (+ 22305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:06.123770 (+627980us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:06.123800 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:06.191574 (+ 67774us) log.cc:844] Serialized 26 byte log entry
0709 12:58:06.405835 (+214261us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:06.405875 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:06.405950 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:06.554564 (+148614us) raft_consensus.cc:1685] finished
0709 12:58:06.554588 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:06.554739 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":75119,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":14320,"thread_start_us":834781,"threads_started":2,"wal-append.queue_time_us":354535}
W20260709 12:58:06.764267  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 624353us
W20260709 12:58:06.718644  1533 rpcz_store.cc:269] 0709 12:58:04.642800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:04.755561 (+112761us) service_pool.cc:224] Handling call
0709 12:58:06.649718 (+1894157us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b54000735d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:06.649856 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3988610816}
I20260709 12:58:06.771395  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:06.773257  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:06.774001  1684 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
W20260709 12:58:06.714558  2267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:06.575747  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 551809us
W20260709 12:58:06.658536  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 231474us
I20260709 12:58:06.778831  1654 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:06.769877  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:06.787222  3460 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:06.654585  4479 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:06.546929  3947 consensus_queue.cc:1059] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.246s
I20260709 12:58:06.738763  4165 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:06.714183  4271 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:06.861836  1654 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:06.822129  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:06.738298  4401 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:06.815387  4602 consensus_queue.cc:237] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.853029  4468 consensus_queue.cc:1048] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:58:06.870791  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:06.856380  1505 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:06.887024  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:06.870990  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:06.556521  4568 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:06.884097  4596 consensus_queue.cc:1059] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:58:06.738449  4601 raft_consensus.cc:697] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:06.892745  4612 consensus_queue.cc:1048] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:58:06.901381  4601 consensus_queue.cc:237] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.815999  4584 raft_consensus.cc:3055] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:06.902824  4567 consensus_queue.cc:260] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.903582  4584 raft_consensus.cc:740] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:06.904054  4567 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:06.878248  4524 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:58:06.904614  4584 consensus_queue.cc:260] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.812250  4332 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:06.890446  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:06.906587  1690 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:58:06.894104  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:06.907517  1685 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:58:06.891548  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:06.901286  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:06.892910  1505 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:06.889592  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:06.892947  1654 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:06.908418  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:06.908665  1689 raft_consensus.cc:2410] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:58:06.891683  1684 raft_consensus.cc:2410] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:06.909360  1683 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:06.895035  1687 raft_consensus.cc:2410] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:58:06.836463  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 106756us
I20260709 12:58:06.788865  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:06.803339  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 68814.7us
I20260709 12:58:06.905817  4584 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:06.884732  4479 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:06.916328  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:06.830852  4516 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:06.929374  4332 raft_consensus.cc:697] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:06.929539  4492 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:06.930042  4492 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.930366  4332 consensus_queue.cc:237] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.931077  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:06.931746  1615 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:58:06.892225  4405 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:06.916877  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:06.892376  4571 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:06.917146  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:06.915515  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:06.917544  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:06.916816  1691 raft_consensus.cc:2410] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:58:06.916039  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:06.910207  1690 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:06.916678  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:06.958324  1610 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:58:06.916270  1655 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:06.927234  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:06.959277  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:06.959277  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:06.900134  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 129731us
I20260709 12:58:06.927910  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:06.960139  1610 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:58:06.810516  4614 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:06.961426  4401 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:06.960767  4165 raft_consensus.cc:697] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:06.963362  4401 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.964187  4615 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:06.964403  4165 consensus_queue.cc:237] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.963295  4614 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.965353  1689 raft_consensus.cc:1275] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:58:06.964028  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:06.945839  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:06.932721  4590 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:06.934859  1684 raft_consensus.cc:1275] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:06.932670  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:06.970427  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 54210.5us
I20260709 12:58:06.970769  1615 raft_consensus.cc:2393] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 7: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:06.970592  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:06.966421  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:06.937952  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:06.943392  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:06.963267  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:06.945741  1583 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:06.951342  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:06.972357  1682 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:06.972378  1683 raft_consensus.cc:2393] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 11: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:06.820690  4581 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:06.954830  1686 raft_consensus.cc:1275] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:06.971604  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:06.971457  1655 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:06.957979  1616 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:58:06.960686  1609 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:58:06.962033  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:06.975765  1610 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:06.932294  4492 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:06.960314  1617 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:06.922627  4582 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:06.967518  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:06.948778  1612 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:58:06.886439  4503 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:58:06.968952  1614 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:06.969411  1608 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:58:06.967170  4590 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.976969  1684 raft_consensus.cc:2410] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:06.892663  4610 consensus_queue.cc:1059] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 12:58:06.977443  1583 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:06.785647  4585 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.962090  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:06.968076  4615 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:06.954437  4516 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:06.971411  1689 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:06.991447  1683 pending_rounds.cc:85] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 2
I20260709 12:58:07.012795  1683 pending_rounds.cc:107] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:58:07.013118  1683 raft_consensus.cc:2889] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:58:06.991412  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 98567.9us
I20260709 12:58:06.996289  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:07.015961  1614 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:58:06.998001  1583 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:06.984886  4600 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:06.984663  4599 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:06.981948  4603 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:07.006843  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:07.015453  1505 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:06.985695  4612 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:06.997830  4524 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:07.017961  1583 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
W20260709 12:58:07.018692  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.013221  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:07.016188  1684 raft_consensus.cc:2368] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8.
I20260709 12:58:06.999631  1691 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:07.016870  4600 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:07.005905  4355 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:06.991189  4591 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:06.993134  4571 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:07.047698  1537 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:07.024117  4599 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:07.033061  1581 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:06.987303  4582 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:06.985360  4266 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:58:07.042305  1689 raft_consensus.cc:2410] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:58:07.032559  4603 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:06.990338  4601 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:58:07.018105  4516 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:07.045634  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.046100  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.056972  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.096778  1539 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:58:07.097851  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.098430  1539 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:07.099253  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.099790  1539 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:58:07.057317  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.031534  1682 raft_consensus.cc:1240] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:58:07.101310  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:07.045243  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:07.101725  1688 raft_consensus.cc:1240] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:07.058564  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.045327  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.042929  4600 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:07.046591  1583 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:07.103727  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 57219.7us
I20260709 12:58:07.074086  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.074975  1581 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:07.104951  1541 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:58:06.991554  4492 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:07.068092  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.109268  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.109916  1537 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:58:07.110845  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.111454  1537 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:07.086248  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:07.064771  4165 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:07.040409  4524 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:07.096015  1538 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:07.047149  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.132990  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.065349  4468 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:07.065263  4583 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:07.114007  1684 raft_consensus.cc:2393] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 7: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:07.114295  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:07.104404  1583 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:07.113653  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.112270  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.088749  4355 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:07.119078  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.066753  4596 consensus_queue.cc:1048] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:58:07.093279  4603 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:07.119997  1614 raft_consensus.cc:1240] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:07.149722  1608 raft_consensus.cc:1240] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:07.149868  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:07.150851  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:07.151448  1614 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:07.121392  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:07.123181  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:07.075665  4582 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:07.131848  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.153790  1539 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:07.113684  4321 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:07.134828  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.082764  4599 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:07.039047  4612 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.137915  1533 raft_consensus.cc:2393] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 7: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:07.140443  1537 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:58:07.163551  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:07.163997  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.164497  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:07.165390  1608 raft_consensus.cc:2410] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:58:07.131131  4332 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:07.141974  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:07.170019  1617 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:07.108003  4602 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:07.169487  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.174523  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.139129  4613 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 12:58:07.175374  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.143854  4355 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:07.210110  4596 consensus_queue.cc:1048] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:07.210531  4355 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:07.119781  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:07.211901  1542 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:07.146507  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:07.213603  4568 raft_consensus.cc:3055] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:07.213990  4568 raft_consensus.cc:740] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:07.117916  4609 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:07.154803  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.134105  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.147435  4583 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.135990  4492 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.162356  4165 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:07.160041  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:07.137751  4524 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:07.160818  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:07.119478  4614 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:07.076992  4571 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.158814  1541 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:58:07.166496  1682 raft_consensus.cc:1240] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:07.135859  4468 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:07.071703  4591 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:07.119234  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.175787  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.144764  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:07.176985  4610 consensus_queue.cc:1059] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:07.182003  4612 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:07.182597  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:07.184958  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:07.185518  4332 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.190910  1508 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:07.197652  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:07.199574  4576 raft_consensus.cc:3055] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:07.174373  4602 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:07.201184  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.152433  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:07.225248  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.229053  1617 raft_consensus.cc:2410] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:58:07.230576  1608 raft_consensus.cc:1240] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:07.233351  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:07.267467  1684 raft_consensus.cc:2410] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:58:07.234282  1688 raft_consensus.cc:2393] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 10: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:07.203187  1685 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
W20260709 12:58:07.202418  4622 log.cc:927] Time spent T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.105s	user 0.002s	sys 0.000s
I20260709 12:58:07.237838  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.279893  1535 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:58:07.226997  1537 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:58:07.281356  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.282612  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:07.226153  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:07.285501  1682 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:58:07.252732  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.288070  1533 raft_consensus.cc:2410] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:58:07.222343  1610 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:58:07.289739  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:07.290946  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:07.291580  1610 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:58:07.227396  1540 raft_consensus.cc:2393] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 10: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 12:58:07.259894  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 69057.6us
I20260709 12:58:07.216048  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:58:07.297248  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.298797  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.262655  1614 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:07.297330  1538 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:07.301967  1686 raft_consensus.cc:1275] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:58:07.302695  1505 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:07.302894  3460 consensus_queue.cc:1059] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:07.302599  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.305346  1540 raft_consensus.cc:2410] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:58:07.299540  1533 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:07.306648  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.310333  1508 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:07.310555  1684 raft_consensus.cc:1275] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:07.308811  1608 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:58:07.221042  4621 log.cc:927] Time spent T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:58:07.237083  4503 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:07.277753  4321 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:07.320664  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.321363  4591 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:07.321964  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.322134  4591 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:07.322575  1541 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:58:07.220872  4165 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:07.325224  1686 raft_consensus.cc:1217] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Deduplicated request from leader. Original: 8.5->[9.6-9.6]   Dedup: 9.6->[]
I20260709 12:58:07.330152  1686 raft_consensus.cc:1240] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:58:07.327426  1538 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:58:07.327790  1505 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:07.228394  4612 raft_consensus.cc:3055] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:07.215054  4609 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:07.226619  4401 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:07.245819  4585 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:07.216878  4615 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:07.248920  4590 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:07.234455  4576 raft_consensus.cc:740] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:58:07.331784  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 227486us
I20260709 12:58:07.226377  4468 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:07.333443  4165 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:07.353745  1533 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:58:07.302820  3947 consensus_queue.cc:1059] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:58:07.331398  4387 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:07.332242  1508 leader_election.cc:400] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8.
I20260709 12:58:07.335486  1505 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:07.336241  3460 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:07.356598  3460 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:07.356940  3460 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:07.356956  1535 raft_consensus.cc:1275] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:58:07.357548  3460 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:07.359499  1505 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:07.360561  4437 consensus_queue.cc:1059] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:07.337397  1542 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:07.303558  4626 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:07.361907  4626 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.362545  1542 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:07.364212  4626 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:07.217545  4513 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.115s
I20260709 12:58:07.365666  4513 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:07.366031  4513 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:07.366371  4513 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:07.355309  1583 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:07.310333  4571 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:07.249012  4613 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.367267  4582 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.368858  1682 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:58:07.370710  1682 pending_rounds.cc:85] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 4
I20260709 12:58:07.370924  1682 pending_rounds.cc:107] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:58:07.371049  4613 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:07.330543  4597 raft_consensus.cc:3055] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:07.356011  1508 leader_election.cc:403] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:58:07.371788  4597 raft_consensus.cc:740] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:07.372792  4597 consensus_queue.cc:260] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.374300  1690 raft_consensus.cc:2393] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 11: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:07.236879  4602 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:07.376029  4582 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:07.325721  4503 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:07.371142  1682 raft_consensus.cc:2889] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:07.376849  4503 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:07.377655  3460 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:07.372965  1508 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:07.380123  3460 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:07.221031  4405 consensus_queue.cc:1048] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.112s
I20260709 12:58:07.321233  4321 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.382500  4321 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:07.369272  4600 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.377524  4513 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.386147  4600 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:07.386482  4513 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:07.387123  4513 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8.
I20260709 12:58:07.387807  4513 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:07.374264  4597 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:07.390158  4602 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.391587  1614 raft_consensus.cc:1240] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:58:07.393822  4602 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:07.397192  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.399088  1583 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:07.400039  4321 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:07.400462  4321 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:07.400977  4321 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:07.401664  4503 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.403846  4503 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:07.406452  4613 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:07.407119  4613 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:07.407506  4613 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:07.406585  4401 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:07.415573  4401 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:07.418803  4401 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:58:07.429451  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.336024  4614 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:07.335402  4609 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:07.433656  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.435012  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.431623  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:07.437917  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:07.439004  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:07.442206  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.436280  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:07.445789  1540 raft_consensus.cc:1275] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:58:07.322690  4591 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:07.422186  1581 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:07.425318  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:07.423686  4420 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:07.335275  4332 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:07.214737  4568 consensus_queue.cc:260] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.473106  1533 raft_consensus.cc:1240] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:58:07.425457  1685 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:07.475860  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:07.431620  1608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:58:07.476876  1608 raft_consensus.cc:606] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:07.334968  4612 raft_consensus.cc:740] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:07.477219  1608 raft_consensus.cc:614] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:07.476111  1686 raft_consensus.cc:2393] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 7: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:07.479609  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:07.447636  1684 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
W20260709 12:58:07.450729  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 320172us
I20260709 12:58:07.476464  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:07.480528  1608 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:58:07.489879  1655 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:07.492679  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:07.432912  4387 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:07.492141  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:07.500222  1655 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:07.501150  1655 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:07.501956  1655 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:07.450559  4614 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:07.468228  4583 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:07.508797  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:07.478781  4581 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:07.546195  1614 raft_consensus.cc:1275] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:07.489187  4420 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.550151  4420 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:07.504050  4387 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:07.563422  4609 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.564697  1615 raft_consensus.cc:1240] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:58:07.513875  4568 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:07.507771  4614 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:07.530586  4332 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:58:07.587307  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.544931  4266 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:07.510548  4629 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:07.557278  4590 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:58:07.597570  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 118034us
I20260709 12:58:07.591123  1654 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:07.539446  4581 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:07.601966  1583 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:07.583819  4582 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:58:07.595443  4271 consensus_meta.cc:287] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.686s	user 0.010s	sys 0.000s
I20260709 12:58:07.588722  4332 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:07.618330  1616 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:58:07.595777  4629 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:07.534240  4613 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:07.614609  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 112700us
I20260709 12:58:07.623735  1655 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:07.606479  4602 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:58:07.604101  4590 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:07.604866  4567 consensus_meta.cc:287] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.695s	user 0.009s	sys 0.000s
I20260709 12:58:07.621822  1686 raft_consensus.cc:1275] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
W20260709 12:58:07.615866  4584 consensus_meta.cc:287] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.685s	user 0.008s	sys 0.002s
I20260709 12:58:07.629294  1655 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:07.629855  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 256987us
I20260709 12:58:07.655066  1508 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:07.632951  4609 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:07.604123  1654 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:07.724040  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 120009us
I20260709 12:58:07.608948  4266 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:07.648025  1686 pending_rounds.cc:85] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 4
I20260709 12:58:07.730342  1686 pending_rounds.cc:107] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:58:07.730756  1686 raft_consensus.cc:2889] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:07.711305  4582 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:07.739831  4582 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:07.740326  4582 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:07.741874  4613 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:07.717027  4630 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:07.743839  4630 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.746368  4630 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:07.653425  1536 raft_consensus.cc:1275] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:58:07.640905  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 281479us
I20260709 12:58:07.661202  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:07.620724  4560 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:07.619660  4332 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:07.763410  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:07.768006  4524 consensus_meta.cc:287] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.545s	user 0.010s	sys 0.000s
I20260709 12:58:07.769192  4363 consensus_queue.cc:1048] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:07.771167  1537 raft_consensus.cc:2410] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:58:07.660187  1613 raft_consensus.cc:2410] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:07.617594  4492 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:07.624173  4571 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:07.774377  4571 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:07.774844  4571 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:07.781327  1682 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:58:07.670660  4612 consensus_queue.cc:260] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:07.674751  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.748787  1505 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:07.678659  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:07.786504  1505 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:07.685992  4405 raft_consensus.cc:3055] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:07.687207  4591 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:07.624616  4629 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:07.646721  4590 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:07.690721  4321 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.693332  3460 raft_consensus.cc:3055] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:58:07.702535  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 73275.4us
I20260709 12:58:07.805356  3460 raft_consensus.cc:740] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:07.662647  4600 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:58:07.672289  4479 consensus_meta.cc:287] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.719s	user 0.005s	sys 0.005s
I20260709 12:58:07.626513  4355 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:07.724632  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 302514us
I20260709 12:58:07.798636  4405 raft_consensus.cc:740] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:07.806763  4581 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.785537  4524 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.756155  4468 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.813282  3460 consensus_queue.cc:260] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:07.798386  4516 consensus_meta.cc:287] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.672s	user 0.005s	sys 0.006s
I20260709 12:58:07.833199  4516 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:07.838881  4405 consensus_queue.cc:260] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.839974  4405 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:07.844753  1534 raft_consensus.cc:2368] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 11.
I20260709 12:58:07.788712  4492 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:07.845585  4492 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.844061  4571 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.507988  4576 consensus_queue.cc:260] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:07.707564  4603 consensus_meta.cc:287] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.000s
I20260709 12:58:07.854676  4603 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.663043  4437 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:07.732123  4636 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:58:07.739282  4599 consensus_meta.cc:287] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.565s	user 0.009s	sys 0.000s
I20260709 12:58:07.656232  1508 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:07.757287  1440 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38804 (request call id 34) took 11243 ms. Trace:
I20260709 12:58:07.757778  4560 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.761521  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:07.806137  1655 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:07.885489  1691 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:07.846941  1581 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:07.847576  4492 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:07.848045  3460 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:07.849535  1614 raft_consensus.cc:1240] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:58:07.850345  1687 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:07.849959  4165 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.809147  4643 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:07.729243  1654 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:07.864403  1685 raft_consensus.cc:1240] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:07.863651  1436 catalog_manager.cc:5697] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 3 to 7, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 7 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:07.844873  4479 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.812858  4503 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:58:07.864156  4626 consensus_queue.cc:1175] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" responder_term: 11 status { last_received { term: 11 index: 8 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:58:07.875556  1440 rpcz_store.cc:276] 0709 12:57:56.513634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:56.513778 (+   144us) service_pool.cc:224] Handling call
0709 12:57:57.405908 (+892130us) spinlock_profiling.cc:243] Waited 31.9 ms on lock 0x7b5400210610. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2d0b2 00007fc862ea6a89 00007fc862e3eda6 00007fc862e10088 00007fc862f0e37e 00007fc8613cf2a4 00007fc8613cf232 00007fc8613cf161 00007fc8613cf0dc
0709 12:58:07.757223 (+10351315us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:06.145541 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:06.365854 (+220313us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:06.373915 (+  8061us) write_op.cc:435] Acquired schema lock
0709 12:58:06.378806 (+  4891us) tablet.cc:662] Decoding operations
0709 12:58:06.476411 (+ 97605us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:06.487409 (+ 10998us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:06.497269 (+  9860us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:58:06.519160 (+ 21891us) tablet.cc:701] Row locks acquired
0709 12:58:06.519177 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:58:06.519326 (+   149us) write_op.cc:270] Start()
0709 12:58:06.519449 (+   123us) write_op.cc:276] Timestamp: P: 1783601886519273 usec, L: 0
0709 12:58:06.519467 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:58:06.520147 (+   680us) log.cc:844] Serialized 1874 byte log entry
0709 12:58:06.925515 (+405368us) op_driver.cc:464] REPLICATION: finished
0709 12:58:07.156614 (+231099us) write_op.cc:301] APPLY: starting
0709 12:58:07.166997 (+ 10383us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:07.225595 (+ 58598us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:07.225747 (+   152us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:07.226251 (+   504us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:07.226447 (+   196us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:58:07.226497 (+    50us) write_op.cc:312] APPLY: finished
0709 12:58:07.243783 (+ 17286us) log.cc:844] Serialized 40 byte log entry
0709 12:58:07.243975 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:07.244092 (+   117us) write_op.cc:454] Released schema lock
0709 12:58:07.244134 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:07.296784 (+ 52650us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:07.303696 (+  6912us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":61280,"reported_tablets":6,"spinlock_wait_cycles":73322880,"child_traces":[["op",{"apply.queue_time_us":209867,"apply.run_cpu_time_us":2447,"apply.run_wall_time_us":100962,"num_ops":4,"prepare.queue_time_us":495954,"prepare.run_cpu_time_us":20861,"prepare.run_wall_time_us":607649,"raft.queue_time_us":157584,"raft.run_cpu_time_us":20019,"raft.run_wall_time_us":104143,"replication_time_us":366710,"thread_start_us":726749,"threads_started":4,"wal-append.queue_time_us":204078}]]}
I20260709 12:58:07.896812  4654 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:07.806187  4609 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 12:58:07.914553  4654 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:07.915004  4654 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:07.889376  4642 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:07.865770  4332 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.916767  4355 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:07.866652  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.918282  4437 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:07.875335  4636 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:07.919610  4636 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:07.867700  4524 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:07.920516  4615 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:07.921119  4615 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.922194  4613 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:07.922729  4613 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.895642  4599 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.924007  4584 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:07.916874  4642 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.924614  4584 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.925328  4599 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:07.867995  4630 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:07.863814  4576 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:07.852630  4568 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:58:07.928092  4581 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:07.868808  4321 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:07.869910  4603 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:07.867604  4612 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:07.870379  4582 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.870500  4614 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.931958  4582 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:07.931598  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 84756.7us
I20260709 12:58:07.933708  4614 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:07.862396  4468 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:07.934968  1684 raft_consensus.cc:1240] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:07.937114  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:07.937781  1687 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:07.939311  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 283161us
W20260709 12:58:07.940049  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.905376  1691 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:07.939335  1683 raft_consensus.cc:2410] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:58:07.941376  1508 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:07.942080  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 142367us
W20260709 12:58:07.943490  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 137494us
W20260709 12:58:07.944558  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:07.907913  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 178751us
I20260709 12:58:07.888710  3947 consensus_queue.cc:1059] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:58:07.912695  1609 raft_consensus.cc:1240] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:07.896634  4648 raft_consensus.cc:2804] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:07.947173  1654 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:07.951920  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:07.939285  1581 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:07.954952  1654 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:07.948956  1655 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:07.871922  4516 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:58:07.951467  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:07.962067  1539 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:07.964284  1654 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:07.960839  1655 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:07.965617  1581 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:07.926802  4584 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:07.964666  4609 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:07.926859  4599 consensus_queue.cc:1059] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:58:07.982692  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:07.958583  4585 consensus_queue.cc:1048] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:58:07.964934  4581 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:07.905889  4643 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:07.950165  4492 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:07.961283  4603 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:07.952991  4630 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:07.935914  4503 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:07.969889  4642 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:07.971395  4479 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:07.946604  4468 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:07.973001  4626 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:07.973584  4597 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:07.976065  4596 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:07.979390  1654 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:07.986650  4582 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:07.978111  4513 consensus_queue.cc:1059] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:58:07.980458  4332 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:07.990731  4643 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:07.981012  4355 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:07.976985  1436 catalog_manager.cc:5697] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:07.958074  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:58:07.983996  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:07.984762  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:08.030848  1683 raft_consensus.cc:2393] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 11: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:07.985707  1581 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:08.002753  4626 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:07.961491  4387 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:08.032949  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 47294.2us
I20260709 12:58:08.004375  4582 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:07.992051  1684 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:58:07.993585  1687 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:07.980885  4165 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:07.986824  4516 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:08.002498  1654 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:07.954123  4614 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:08.009765  4613 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:07.994613  4492 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:07.979707  1655 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:07.994912  4599 raft_consensus.cc:3055] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:07.980533  4560 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:08.006263  4581 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:07.997263  4503 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:07.958385  4648 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:08.040006  2299 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:08.034325  1581 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:07.985489  1583 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:08.055621  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 75990.3us
I20260709 12:58:08.053222  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:58:08.057231  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.034083  4626 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:08.061450  1684 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:08.007210  4468 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:08.007755  4597 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:08.041379  4582 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:08.055270  4600 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:58:08.032322  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 57843.8us
I20260709 12:58:08.039631  4609 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:08.052608  4590 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:08.071532  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 86130.7us
I20260709 12:58:08.013268  4596 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:08.048237  4516 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:08.057767  4599 raft_consensus.cc:740] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:08.058158  4492 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:08.075671  1581 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:08.064991  4615 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:08.056583  4591 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:08.076918  1583 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:08.053536  4332 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:58:08.083022  1581 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:08.090700  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:08.071321  4609 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:08.071476  4600 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:08.069962  4603 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:08.067878  1655 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:08.079113  4516 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:08.091995  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:08.066980  4648 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:08.076747  4613 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:58:08.093204  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.071296  4581 raft_consensus.cc:697] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 7 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:08.094141  1581 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:08.079303  4647 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:08.073524  4571 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:08.115949  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:08.116681  1508 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 1.635s (SENT)
I20260709 12:58:08.116590  1655 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:08.088361  4321 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:08.096895  4420 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:08.078151  4165 consensus_queue.cc:1059] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:58:08.096463  4609 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:08.093531  4615 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:08.098879  4600 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:08.080785  4560 consensus_queue.cc:1059] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:58:08.098222  4603 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:08.088181  4584 consensus_queue.cc:1048] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:58:08.130505  4599 consensus_queue.cc:260] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:08.088213  3947 consensus_queue.cc:1059] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:58:08.149586  4599 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:08.149919  3947 raft_consensus.cc:3055] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:08.150332  3947 raft_consensus.cc:740] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:08.151144  3947 consensus_queue.cc:260] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:08.121788  4610 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:08.155405  4610 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:08.156086  4610 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:08.129561  4613 raft_consensus.cc:697] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:08.142710  4468 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:08.143254  4387 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:08.132458  4321 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:08.091922  4629 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:08.244416  1690 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:08.245584  4629 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:08.174782  4630 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:08.189823  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:08.152307  3947 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:08.222419  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 105765us
I20260709 12:58:08.226469  1436 catalog_manager.cc:5697] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:08.227145  2299 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:58:08.220634  4615 raft_consensus.cc:697] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:08.229900  4613 consensus_queue.cc:237] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:08.104964  4661 consensus_queue.cc:1059] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:58:08.219455  4355 raft_consensus.cc:3055] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:58:08.241029  4663 log.cc:927] Time spent T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 12:58:08.130607  4363 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:08.141575  4571 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:08.264195  4571 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:08.264802  4571 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:08.264959  4615 consensus_queue.cc:237] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:08.219667  4321 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:08.266856  4600 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:08.239840  4603 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:08.276587  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 182527us
I20260709 12:58:08.261570  4332 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:58:08.262053  4656 log.cc:927] Time spent T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 12:58:08.272816  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:08.275360  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:08.285046  1535 raft_consensus.cc:2393] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 9: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:08.281263  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:08.286396  1541 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:58:08.275491  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:08.277505  1581 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:08.276611  1688 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:58:08.281347  1436 catalog_manager.cc:5697] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 4 to 7, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 7 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:08.287866  1686 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:08.282588  1508 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:08.288105  1688 pending_rounds.cc:85] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 7
I20260709 12:58:08.289034  1688 pending_rounds.cc:107] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:58:08.289288  1688 raft_consensus.cc:2889] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:08.290956  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:08.290629  1656 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 12:58:08.296896  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:08.297636  1539 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:58:08.303221  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:08.304134  1538 raft_consensus.cc:2368] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 11.
I20260709 12:58:08.256690  4629 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.299727  1583 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:08.309654  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.311415  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:08.313275  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:08.259081  4355 raft_consensus.cc:740] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:08.309685  1581 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:08.315948  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:08.316721  1536 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:08.316990  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:08.320710  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:08.321355  1610 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:08.322230  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:08.322808  4433 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:08.323140  1617 raft_consensus.cc:1240] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:08.322237  4599 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:08.345979  4266 consensus_queue.cc:1059] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:08.345981  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:08.347023  4266 raft_consensus.cc:3055] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:08.347420  4266 raft_consensus.cc:740] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:08.347710  4433 raft_consensus.cc:697] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:08.285389  4581 consensus_queue.cc:237] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:08.352095  1583 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:08.297482  4662 raft_consensus.cc:3055] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:58:08.327912  4659 log.cc:927] Time spent T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
I20260709 12:58:08.314159  4612 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:08.333736  1436 catalog_manager.cc:5697] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:08.371299  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:58:08.335479  4655 log.cc:927] Time spent T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.269s	user 0.003s	sys 0.000s
I20260709 12:58:08.338577  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1539) took 1156 ms. Trace:
I20260709 12:58:08.339761  4582 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:08.385444  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:08.341312  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:08.341612  4600 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:08.343601  4603 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:08.344233  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:58:08.392107  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.351209  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:08.351858  1614 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:58:08.394007  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:08.395197  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:08.325107  4585 raft_consensus.cc:3055] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:58:08.356127  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 46528.8us
I20260709 12:58:08.398924  1581 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:08.396533  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:08.365000  1610 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:08.401222  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:08.402019  1610 raft_consensus.cc:2410] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:58:08.368674  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:08.402913  1535 raft_consensus.cc:2393] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 10: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:08.336246  4591 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:08.312633  4437 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:08.377193  1688 rpcz_store.cc:276] 0709 12:58:07.182266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:07.323984 (+141718us) service_pool.cc:224] Handling call
0709 12:58:07.324268 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:08.289737 (+965469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:08.338318 (+ 48581us) spinlock_profiling.cc:243] Waited 952 ms on lock 0x7b54003381d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:08.338511 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2189500800}
I20260709 12:58:08.375094  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:08.369717  4560 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:08.406817  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:08.314994  4629 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:08.348294  4266 consensus_queue.cc:260] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:08.409679  1617 raft_consensus.cc:2393] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 8: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:08.396658  4585 raft_consensus.cc:740] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:08.410874  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:08.411899  1539 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:08.415793  1612 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:08.445089  1610 raft_consensus.cc:2393] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 11: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:08.370688  4662 raft_consensus.cc:740] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:08.413411  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:08.390326  4590 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:08.447335  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:08.374054  4647 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:08.396296  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:08.410214  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1195) took 1109 ms. Trace:
I20260709 12:58:08.418298  1436 catalog_manager.cc:5697] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 6 to 7, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 7 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:08.448977  1611 rpcz_store.cc:276] 0709 12:58:07.300584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:07.672075 (+371491us) service_pool.cc:224] Handling call
0709 12:58:07.672458 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:07.675489 (+  3031us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:07.675526 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:07.675992 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 12:58:07.941563 (+265571us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:07.941601 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:07.941664 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:08.261430 (+319766us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:58:08.401666 (+140236us) raft_consensus.cc:1685] finished
0709 12:58:08.401691 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:08.410130 (+  8439us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2350,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":103,"spinlock_wait_cycles":4431488,"thread_start_us":265294,"threads_started":1,"wal-append.queue_time_us":326227}
I20260709 12:58:08.417936  1683 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:58:08.427424  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:08.426425  1538 raft_consensus.cc:1240] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:08.434055  1691 raft_consensus.cc:2393] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 9: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:08.452916  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:08.454017  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:08.454579  1538 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:08.428825  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:08.428696  1542 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:58:08.416438  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:08.451303  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:08.456576  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:08.430722  1540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:47506
W20260709 12:58:08.435232  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.457334  1540 raft_consensus.cc:606] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Received request to transfer leadership to TS c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:08.457672  1540 raft_consensus.cc:614] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:08.409741  4603 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.465700  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:08.457813  1535 raft_consensus.cc:2393] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 9: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:08.424708  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:08.467756  1542 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:08.468438  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1530) took 1192 ms. Trace:
I20260709 12:58:08.468918  1616 rpcz_store.cc:276] 0709 12:58:07.275959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:07.667627 (+391668us) service_pool.cc:224] Handling call
0709 12:58:07.667978 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:07.668205 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:07.668229 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:07.668732 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 12:58:07.941861 (+273129us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:07.941898 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:07.941973 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:08.257746 (+315773us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:58:08.459502 (+201756us) raft_consensus.cc:1685] finished
0709 12:58:08.459522 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:08.468377 (+  8855us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6189440,"thread_start_us":272756,"threads_started":1,"wal-append.queue_time_us":343737}
I20260709 12:58:08.470288  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:08.470966  1537 raft_consensus.cc:2393] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 11: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:08.372296  4571 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:08.458245  1533 raft_consensus.cc:2410] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:58:08.459118  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:08.464253  1436 catalog_manager.cc:5697] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:08.412073  4631 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:08.493112  1612 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:08.495211  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:08.477226  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:08.478298  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:08.478586  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:58:08.473276  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 190776us
I20260709 12:58:08.415596  4596 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:08.481237  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:08.504384  1540 raft_consensus.cc:2410] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:58:08.481251  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:08.422816  4658 log.cc:927] Time spent T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.382s	user 0.000s	sys 0.002s
I20260709 12:58:08.417470  4524 raft_consensus.cc:3055] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:08.430146  4584 raft_consensus.cc:3055] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:08.405910  4654 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:08.498597  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:58:08.442823  4420 consensus_queue.cc:1175] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" responder_term: 9 status { last_received { term: 9 index: 5 } last_committed_idx: 4 last_received_current_leader { term: 9 index: 5 } }
I20260709 12:58:08.496593  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:08.433954  4266 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:08.502290  1538 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:08.405551  4516 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:08.499945  1505 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:08.553821  4684 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.554533  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:08.519918  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:08.555307  1617 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:08.550407  4612 raft_consensus.cc:697] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:08.557391  4612 consensus_queue.cc:237] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:08.411960  4355 consensus_queue.cc:260] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:08.559374  4355 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:08.451275  4647 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:08.520758  1508 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:08.551903  1533 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:58:08.562017  1533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:47506
I20260709 12:58:08.562583  1533 raft_consensus.cc:606] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:08.562916  1533 raft_consensus.cc:614] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:08.560403  1583 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:08.504246  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:08.403200  4433 consensus_queue.cc:237] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:08.523160  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:08.524312  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:08.566385  1614 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:08.567386  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:08.414974  4626 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:08.527019  1688 raft_consensus.cc:1240] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:08.534900  1612 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:08.513443  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:08.554394  4684 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:08.432289  4629 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:08.576613  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 76735.2us
I20260709 12:58:08.576844  4387 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:08.577378  4387 raft_consensus.cc:697] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:08.578662  1613 raft_consensus.cc:2393] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 8: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 12:58:08.578965  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 58299.9us
I20260709 12:58:08.579857  1613 raft_consensus.cc:1240] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:58:08.571983  1617 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:58:08.574590  1533 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:08.583711  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:08.584132  1533 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 12:58:08.584558  1533 pending_rounds.cc:85] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 3
I20260709 12:58:08.584308  1683 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:08.585163  1538 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:58:08.582036  1613 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:58:08.584805  1533 pending_rounds.cc:107] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 12:58:08.586938  1533 raft_consensus.cc:2889] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:08.588872  1613 raft_consensus.cc:1240] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:08.585752  1583 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:08.524859  4524 raft_consensus.cc:740] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:08.483714  4603 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:08.590018  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:08.601399  1682 raft_consensus.cc:2393] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 7: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:08.590629  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:08.602182  1683 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:08.532999  4584 raft_consensus.cc:740] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:08.593118  1614 raft_consensus.cc:1240] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:58:08.588979  1505 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:08.568773  1535 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:58:08.608274  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:08.608589  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:08.611637  1685 raft_consensus.cc:2393] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 7: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:08.563967  4647 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:08.610792  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:08.613094  1682 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:08.610788  1683 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:08.624989  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.583297  4420 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:08.578351  4684 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:08.638975  1687 raft_consensus.cc:1240] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:58:08.639458  1683 raft_consensus.cc:2410] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:08.641160  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:58:08.560854  4165 consensus_queue.cc:1175] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" responder_term: 6 status { last_received { term: 4 index: 4 } last_committed_idx: 4 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:58:08.598948  4629 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:08.604830  4661 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:08.605018  4673 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.649269  1687 raft_consensus.cc:2393] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 9: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:08.524705  4585 consensus_queue.cc:260] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:08.578260  4387 consensus_queue.cc:237] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:08.694451  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:08.647611  4503 consensus_meta.cc:287] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.575s	user 0.008s	sys 0.002s
I20260709 12:58:08.696009  4503 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:08.698385  4503 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:08.662030  4405 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.700338  4405 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:08.702577  4405 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:08.643913  4643 consensus_meta.cc:287] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.610s	user 0.006s	sys 0.003s
I20260709 12:58:08.703258  4643 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:08.635648  4420 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:08.704667  4420 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:08.666813  1539 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:58:08.670208  1505 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:08.644856  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:08.594498  4321 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:08.672458  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:08.707407  1690 raft_consensus.cc:2368] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12.
I20260709 12:58:08.693784  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:08.709359  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:08.560974  4662 consensus_queue.cc:260] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:08.649024  4615 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:08.706154  1505 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:08.721293  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:08.722071  1683 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:08.687690  4673 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:08.712913  4649 log.cc:927] Time spent T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:58:08.642778  4642 consensus_queue.cc:1048] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:58:08.635632  4479 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 12:58:08.667090  4596 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:08.763484  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:08.782795  1690 raft_consensus.cc:2368] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12.
I20260709 12:58:08.643147  4641 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:58:08.772009  1536 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
W20260709 12:58:08.806394  3947 consensus_meta.cc:287] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.548s	user 0.007s	sys 0.002s
I20260709 12:58:08.808662  1537 raft_consensus.cc:2410] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:58:08.686354  1682 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
W20260709 12:58:08.763022  4638 log.cc:927] Time spent T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:58:08.726943  4677 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.738279  4405 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:58:08.785653  4679 log.cc:927] Time spent T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:58:08.786557  4692 consensus_queue.cc:1059] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:08.787343  4673 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:08.788101  4603 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:08.711395  4513 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:08.788673  4571 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:08.790372  4492 consensus_meta.cc:287] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.697s	user 0.003s	sys 0.004s
I20260709 12:58:08.869478  4492 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:08.871959  4492 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:08.727136  4660 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
W20260709 12:58:08.795187  4636 consensus_meta.cc:287] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.875s	user 0.010s	sys 0.000s
W20260709 12:58:08.800830  4609 consensus_meta.cc:287] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.644s	user 0.009s	sys 0.000s
I20260709 12:58:08.801827  4643 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:08.773183  4363 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:08.780391  1683 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
W20260709 12:58:08.712064  4669 log.cc:927] Time spent T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:58:08.674779  4629 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:58:08.853163  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 228227us
I20260709 12:58:08.987362  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:08.988224  1616 raft_consensus.cc:2393] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 7: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:08.859131  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:08.989092  1690 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
W20260709 12:58:08.861699  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 140912us
I20260709 12:58:08.728258  4582 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:08.865540  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:08.995419  1682 raft_consensus.cc:2393] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 11: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:08.866765  4596 raft_consensus.cc:697] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:08.867272  4642 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.771486  4615 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:08.671386  4524 consensus_queue.cc:260] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:08.913965  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 51692.8us
I20260709 12:58:08.856859  4405 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:08.926927  4672 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:08.919008  4513 raft_consensus.cc:697] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:08.928133  4597 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:08.930897  4321 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:08.931537  4626 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:08.915562  4609 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
W20260709 12:58:08.944281  4648 consensus_meta.cc:287] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.816s	user 0.007s	sys 0.002s
I20260709 12:58:08.862744  4677 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:08.949718  4585 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:08.954341  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:08.958211  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:08.961050  4516 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:08.962299  1655 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.032s	sys 0.021s
I20260709 12:58:08.694011  4584 consensus_queue.cc:260] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:08.981371  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:09.044044  1683 raft_consensus.cc:2393] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 7: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:09.017366  4524 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:08.979681  4654 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:09.013615  3460 consensus_queue.cc:1175] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c262eac7fc904ae9bb91e450f6532e3f" responder_term: 9 status { last_received { term: 5 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 8. Current term is 9. Ops: [8.4-8.4]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:58:08.915401  4636 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.017498  1615 raft_consensus.cc:2410] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:58:09.052495  1654 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:09.020027  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:08.999480  4568 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:09.023442  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:09.021564  4355 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.028378  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:09.005645  4615 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:58:09.040431  1655 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.032s	sys 0.021s
I20260709 12:58:09.014370  4405 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:09.001130  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:09.045959  1508 leader_election.cc:400] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12.
W20260709 12:58:09.018685  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:09.005194  4479 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.059617  1609 raft_consensus.cc:2393] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 10: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:09.007609  4642 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:09.065076  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 841097us
W20260709 12:58:09.072876  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:08.999210  4363 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:09.065863  1689 raft_consensus.cc:2393] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 7: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:09.069341  1616 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 6.
I20260709 12:58:09.069780  1508 leader_election.cc:403] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:58:09.071031  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:09.089823  1505 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:09.085187  1655 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:09.087312  1688 raft_consensus.cc:1240] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:09.041296  4701 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:09.038134  4597 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:58:09.021359  4672 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.093957  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:09.094332  1684 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:58:09.041816  4321 consensus_queue.cc:1059] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
W20260709 12:58:09.054062  4610 consensus_meta.cc:287] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.879s	user 0.012s	sys 0.000s
I20260709 12:58:09.102982  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:09.064073  4582 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:09.063180  4693 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:09.167258  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 82145.3us
I20260709 12:58:09.169001  1690 raft_consensus.cc:1240] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:09.043439  4648 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.188239  1655 leader_election.cc:400] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 11.
I20260709 12:58:09.090085  4690 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:09.189359  1655 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:09.106454  4643 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:09.068744  4603 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 12:58:09.071636  4355 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.069672  4568 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:09.173854  4647 consensus_meta.cc:287] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.000s
I20260709 12:58:09.158380  3947 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:09.187351  4492 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:09.175804  4591 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:09.158983  4654 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:09.091522  4479 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.176131  4433 raft_consensus.cc:3055] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:09.085527  4420 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.187716  4582 raft_consensus.cc:697] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 12 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:09.248101  4648 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:09.242547  4697 log.cc:927] Time spent T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:58:09.248430  4582 consensus_queue.cc:237] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.090471  4596 consensus_queue.cc:237] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.249928  4672 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:09.097616  4513 consensus_queue.cc:237] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.253321  4677 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:09.254312  4609 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:09.172310  4610 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.238965  4433 raft_consensus.cc:740] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:09.256188  4433 consensus_queue.cc:260] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.257737  4433 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:09.124927  4701 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.195444  4571 consensus_queue.cc:1048] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:58:09.190724  4693 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.196589  4690 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:09.234663  4647 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.287221  4701 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:09.292904  4693 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:09.294780  4690 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:58:09.296150  4700 log.cc:927] Time spent T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.003s
W20260709 12:58:09.298933  4712 log.cc:927] Time spent T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:58:09.299607  4707 log.cc:927] Time spent T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 12:58:09.301473  4685 log.cc:927] Time spent T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.356s	user 0.000s	sys 0.002s
W20260709 12:58:09.330185  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 171976us
W20260709 12:58:09.333146  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:09.333614  1581 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:09.103734  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:09.337836  1535 raft_consensus.cc:2393] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 7: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:09.339941  1581 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:09.104044  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:09.342346  1538 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:09.103739  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:09.345387  1539 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:09.347963  1533 raft_consensus.cc:1275] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:58:09.348592  1533 pending_rounds.cc:85] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 6
I20260709 12:58:09.348893  1533 pending_rounds.cc:107] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:58:09.349326  1533 raft_consensus.cc:2889] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:09.193823  1690 raft_consensus.cc:1240] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:09.352828  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:09.355264  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:09.356102  1611 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:09.357997  1690 raft_consensus.cc:1275] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:58:09.359045  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:58:09.359206  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 169825us
I20260709 12:58:09.359963  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1532) took 1049 ms. Trace:
I20260709 12:58:09.360514  1690 raft_consensus.cc:1240] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: [9.4-9.4]
W20260709 12:58:09.362275  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:09.232826  3947 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:09.364652  3947 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:09.366685  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:09.367754  1682 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:09.369179  1684 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:09.373000  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:09.352169  1617 raft_consensus.cc:1240] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:09.377122  4321 consensus_queue.cc:1059] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:09.379007  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:09.379602  4321 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:09.364193  1616 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:09.193368  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 134216us
I20260709 12:58:09.245887  4420 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:09.239952  4492 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.380445  1617 raft_consensus.cc:2393] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 9: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:09.403834  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:09.456566  1538 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:09.396278  3460 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.404814  4492 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:09.467698  4689 log.cc:927] Time spent T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.540s	user 0.003s	sys 0.000s
I20260709 12:58:09.403980  4332 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:09.472893  4332 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:09.473345  4332 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:09.473793  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1538) took 1157 ms. Trace:
I20260709 12:58:09.474208  1608 rpcz_store.cc:276] 0709 12:58:08.316540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.316668 (+   128us) service_pool.cc:224] Handling call
0709 12:58:09.473333 (+1156665us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b5400447ad4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:09.473578 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1772884224}
I20260709 12:58:09.475800  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:09.273149  4654 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:09.482111  4654 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:09.283439  4629 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:09.487251  4591 raft_consensus.cc:697] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 12 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:09.406550  1609 rpcz_store.cc:276] 0709 12:58:08.310611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.320170 (+  9559us) service_pool.cc:224] Handling call
0709 12:58:09.359455 (+1039285us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b540011d5d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:09.359750 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1580854016}
I20260709 12:58:09.389561  4355 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:09.489073  4591 consensus_queue.cc:237] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.398005  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:09.490123  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:09.491604  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:09.277482  4642 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:09.495654  4613 raft_consensus.cc:3055] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:09.496222  4613 raft_consensus.cc:740] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:09.382890  4321 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:09.497438  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:58:09.501611  4266 consensus_meta.cc:287] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.937s	user 0.011s	sys 0.007s
I20260709 12:58:09.502631  1611 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:09.504676  1655 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:09.506134  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 98903.2us
I20260709 12:58:09.507261  1655 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:09.509195  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:09.510619  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:09.511655  1609 raft_consensus.cc:2393] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 7: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 12:58:09.518044  4702 log.cc:927] Time spent T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.275s	user 0.003s	sys 0.000s
I20260709 12:58:09.519649  4610 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:09.525996  4647 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:09.526436  4479 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:09.500047  4332 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.530128  4332 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:09.534083  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 444231us
I20260709 12:58:09.539134  1616 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:09.387452  4363 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:09.526113  1613 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:09.541109  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:09.504364  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:09.518541  3947 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.398113  4165 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:09.541621  1617 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:58:09.561945  1612 raft_consensus.cc:2393] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 7: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:09.574582  1608 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:58:09.588589  1581 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:09.401371  4420 consensus_queue.cc:1059] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.160s
I20260709 12:58:09.589790  1608 raft_consensus.cc:1240] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:09.590740  1684 raft_consensus.cc:1240] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:09.590965  1617 raft_consensus.cc:1275] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:09.589752  4603 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:09.592826  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:09.594623  4662 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:09.597848  4492 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:09.598354  4492 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:09.598874  4492 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:09.599499  1611 raft_consensus.cc:2393] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 9: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:09.497515  4613 consensus_queue.cc:260] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.588855  3460 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.472446  4636 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:09.631816  1682 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:58:09.659886  4675 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.660696  4675 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.662995  4675 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:09.664296  4661 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.671482  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:09.666903  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:09.677675  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:09.678027  1686 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:09.679322  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:09.680346  1689 raft_consensus.cc:2410] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:09.680579  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:09.681157  4613 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:09.681716  1508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.004s	sys 0.011s
W20260709 12:58:09.682168  1508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.004s	sys 0.011s
W20260709 12:58:09.682622  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 636814us
W20260709 12:58:09.683279  4615 consensus_meta.cc:287] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.598s	user 0.008s	sys 0.004s
I20260709 12:58:09.574528  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db011c2c8016405d968fe57a093fc111"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:58:09.664840  4661 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:09.684931  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 177913us
I20260709 12:58:09.685982  1655 leader_election.cc:400] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 11.
I20260709 12:58:09.686275  1655 leader_election.cc:403] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:58:09.686578  4661 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:09.683787  1508 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:09.691414  4717 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:09.692121  4717 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:09.681195  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 219604us
I20260709 12:58:09.693610  1581 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:09.693958  4513 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:09.694895  4717 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:09.695433  4568 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:09.676242  4363 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:09.686923  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:09.699019  4420 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:09.699417  4165 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:09.699883  1581 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:09.700767  4420 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:58:09.701529  4641 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.006s	sys 0.013s
W20260709 12:58:09.701930  4641 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.006s	sys 0.013s
W20260709 12:58:09.702082  4405 consensus_meta.cc:287] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.615s	user 0.007s	sys 0.006s
I20260709 12:58:09.702661  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1544) took 1349 ms. Trace:
I20260709 12:58:09.703212  1610 rpcz_store.cc:276] 0709 12:58:08.353142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.449018 (+ 95876us) service_pool.cc:224] Handling call
0709 12:58:08.449307 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:08.449516 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:58:08.484210 (+ 34694us) log.cc:844] Serialized 14 byte log entry
0709 12:58:09.070730 (+586520us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b1800436d20. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f64522 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd 000000000038f354 000000000038f199 00007fc859f4783a
0709 12:58:09.405395 (+334665us) spinlock_profiling.cc:243] Waited 9.7 ms on lock 0x7b1800436d20. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f61455 00007fc85d049060 00007fc85d05b716 00007fc85d06c287 00007fc85d06c208
0709 12:58:09.698652 (+293257us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:09.698753 (+   101us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:09.702207 (+  3454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:09.702312 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:09.702466 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":33091,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":14995,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":19961,"spinlock_wait_cycles":77104128,"thread_start_us":266591,"threads_started":1}
I20260709 12:58:09.704133  1581 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:09.702682  4405 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:09.695205  4718 log.cc:927] Time spent T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.448s	user 0.002s	sys 0.000s
I20260709 12:58:09.677747  4709 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.683889  4615 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.713078  4709 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.718001  1684 raft_consensus.cc:2393] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 11: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:09.720247  4709 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:09.719053  4420 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:09.731501  4405 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:09.716276  4636 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 11.
W20260709 12:58:09.738562  4585 consensus_meta.cc:287] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.696s	user 0.012s	sys 0.000s
I20260709 12:58:09.738386  4165 consensus_queue.cc:1059] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:09.740424  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:09.742303  1583 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:09.743690  4355 consensus_queue.cc:1048] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:09.732550  4584 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:09.745055  4433 consensus_queue.cc:1059] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:09.748687  1534 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:58:09.751386  4631 consensus_queue.cc:1059] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:58:09.749250  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 45387us
I20260709 12:58:09.752321  4165 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.752441  4630 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:09.752951  4165 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.753404  4363 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.754015  4363 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.755368  4165 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:09.756608  4631 raft_consensus.cc:3055] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:58:09.757109  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 71451.8us
I20260709 12:58:09.757385  4420 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:09.757915  4420 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:09.740325  4696 raft_consensus.cc:3055] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:09.758512  4696 raft_consensus.cc:740] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:09.753093  1581 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:09.759130  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:09.760027  1613 raft_consensus.cc:2393] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 7: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:09.760694  1581 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:09.760895  4647 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:09.762427  4647 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:09.762451  4433 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:09.764727  4433 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:09.764966  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 1210) took 1299 ms. Trace:
I20260709 12:58:09.765141  4433 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:09.766031  1614 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:09.757885  4630 raft_consensus.cc:697] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:09.767098  4630 consensus_queue.cc:237] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.767616  3460 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:09.770658  4643 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12.
I20260709 12:58:09.752444  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1180) took 1284 ms. Trace:
I20260709 12:58:09.772089  1534 rpcz_store.cc:276] 0709 12:58:08.468010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.470028 (+  2018us) service_pool.cc:224] Handling call
0709 12:58:09.752210 (+1282182us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54003142d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:09.752373 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2917098752}
I20260709 12:58:09.773551  1581 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:09.774504  4321 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:09.776541  4647 consensus_queue.cc:1048] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:09.777388  1655 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:09.778345  4673 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:09.780596  1655 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:09.757099  4631 raft_consensus.cc:740] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:58:09.781677  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 58577.6us
I20260709 12:58:09.781946  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:09.785145  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:09.765578  1615 rpcz_store.cc:276] 0709 12:58:08.465468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.466252 (+   784us) service_pool.cc:224] Handling call
0709 12:58:09.764550 (+1298298us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b54002567d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:09.764779 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1105776384}
I20260709 12:58:09.781119  1581 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:09.785758  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:09.785936  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:09.789980  4615 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:09.773380  4492 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.785429  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:09.791534  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 49472.3us
I20260709 12:58:09.756209  4363 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:09.801067  1617 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:58:09.776412  4696 consensus_queue.cc:260] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.755992  4165 raft_consensus.cc:3055] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:09.802170  1609 raft_consensus.cc:606] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:09.802372  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:09.804857  1609 raft_consensus.cc:614] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:09.806432  1508 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:09.790980  3947 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:09.815948  1613 raft_consensus.cc:2410] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:58:09.828639  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:09.804569  4165 raft_consensus.cc:740] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:09.816372  4709 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:58:09.835860  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 55478.9us
I20260709 12:58:09.836330  1613 raft_consensus.cc:1275] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:09.838078  1617 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:09.811852  4363 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:58:09.844460  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:09.817605  4433 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.858253  1534 raft_consensus.cc:2393] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 10: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:09.859421  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:09.859735  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:09.860224  1537 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:09.861130  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:09.861862  1682 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
W20260709 12:58:09.865183  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 140569us
I20260709 12:58:09.855811  4673 consensus_queue.cc:1059] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:58:09.867254  4673 raft_consensus.cc:3055] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:09.867619  4673 raft_consensus.cc:740] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:09.845556  4654 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:09.868733  1537 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:58:09.862035  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:09.861294  1540 raft_consensus.cc:1275] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:09.866185  1508 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:09.857448  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:09.869818  3460 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:09.879169  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:09.881721  4724 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:09.882691  1505 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:09.883410  1508 leader_election.cc:400] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12.
I20260709 12:58:09.883729  1508 leader_election.cc:403] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:58:09.884099  1505 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:09.884683  4675 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:09.885213  4585 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:09.906764  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:09.885744  4437 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12.
I20260709 12:58:09.886735  4713 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.858742  4709 raft_consensus.cc:697] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:09.908665  4709 consensus_queue.cc:237] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.909849  4585 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:09.888724  1508 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:09.910547  4585 raft_consensus.cc:697] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:09.911130  3460 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:09.911630  4585 consensus_queue.cc:237] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.888401  4165 consensus_queue.cc:260] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.913050  1655 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:09.913645  4165 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:09.914439  1655 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:09.915758  1655 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:09.893016  1542 raft_consensus.cc:2410] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:58:09.893365  4492 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:09.878161  4696 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:09.902293  1685 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:09.900781  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:09.905270  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:09.905826  1539 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:09.907430  1540 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:09.842758  4631 consensus_queue.cc:260] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.911657  3460 raft_consensus.cc:697] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:09.880961  1583 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:09.923240  1538 raft_consensus.cc:2393] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 9: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 12:58:09.924628  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 45016.2us
I20260709 12:58:09.925877  4567 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:09.924922  4591 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:09.936826  4626 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:09.937170  4631 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:09.944537  4567 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.937906  1654 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:09.927922  4724 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:09.928224  4363 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:09.936342  1583 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:09.936800  4687 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.014s	sys 0.018s
I20260709 12:58:09.879320  4673 consensus_queue.cc:260] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.949012  3460 consensus_queue.cc:237] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.923313  4713 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:09.947402  4363 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:09.954247  4363 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:09.957051  1654 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:09.958164  1654 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:09.959473  4626 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:09.959983  4492 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:09.960628  4492 raft_consensus.cc:697] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 8 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:09.960719  4725 consensus_queue.cc:1059] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:09.961738  4492 consensus_queue.cc:237] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.960374  4666 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:09.962225  4581 raft_consensus.cc:3055] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:58:09.949606  4687 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.015s	sys 0.019s
I20260709 12:58:09.960399  1654 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:09.966024  4731 log.cc:927] Time spent T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.073s	user 0.002s	sys 0.000s
W20260709 12:58:09.967052  4730 log.cc:927] Time spent T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.080s	user 0.002s	sys 0.000s
I20260709 12:58:09.971374  4433 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:09.968070  4666 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:09.972400  4581 raft_consensus.cc:740] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:09.978837  4666 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:09.976909  4615 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:09.968905  4654 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:09.981106  4654 raft_consensus.cc:697] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:09.981400  4615 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.979475  4581 consensus_queue.cc:260] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.983065  4581 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:09.984033  4615 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:09.985492  4724 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:09.986143  4724 raft_consensus.cc:697] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:58:09.987345  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:09.987076  4724 consensus_queue.cc:237] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.961544  4582 consensus_queue.cc:1048] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:58:09.982056  4654 consensus_queue.cc:237] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.960049  4626 raft_consensus.cc:697] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:09.994503  4626 consensus_queue.cc:237] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:09.998839  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:09.999074  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:09.999571  4584 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.000063  1688 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:10.000260  4584 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:10.001555  1691 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:58:10.002852  4584 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:10.003449  1691 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:10.004944  4673 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:09.989861  4420 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:10.007016  4420 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:10.007712  1655 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:10.039690  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 71126.8us
I20260709 12:58:10.041646  1655 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:10.042582  4582 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:10.043349  4582 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:10.044795  1582 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:10.046162  1582 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:10.046948  4584 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:10.047645  4584 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:58:10.008080  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:10.009871  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:10.010845  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 1822) took 1532 ms. Trace:
I20260709 12:58:10.012827  1615 raft_consensus.cc:1275] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:58:10.013473  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:10.013667  1614 raft_consensus.cc:1275] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:58:10.014212  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:10.015074  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:10.051187  1617 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:58:10.010735  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:10.015779  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:10.018926  4713 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:10.019588  1508 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:09.989908  4732 log.cc:927] Time spent T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:58:10.020234  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:10.022766  4567 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:10.032823  4675 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.023903  1581 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:10.072280  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:10.038348  1688 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:10.048573  1582 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:10.052281  1613 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:10.048970  1542 rpcz_store.cc:276] 0709 12:58:08.477961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:08.478075 (+   114us) service_pool.cc:224] Handling call
0709 12:58:10.010624 (+1532549us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b540010c2d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:10.010791 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3202497920}
I20260709 12:58:10.068439  1616 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:10.069051  1609 raft_consensus.cc:2393] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 12: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:10.075064  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:10.075862  1538 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:58:10.077692  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:10.080495  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:10.089401  1533 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:10.063845  4165 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:58:10.069460  4696 consensus_queue.cc:1059] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:58:10.093263  4709 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:10.104161  1539 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:58:10.091789  4584 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:58:10.112594  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 71091.8us
W20260709 12:58:10.116264  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 92440.8us
I20260709 12:58:10.083587  4675 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:10.123301  1616 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:10.100225  4662 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:10.106956  4643 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:10.100056  4567 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:10.132272  1581 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:10.129016  1505 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:10.130930  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:10.139328  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:10.137712  4615 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.142264  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:10.142426  4615 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:10.142876  1538 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:10.148072  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:10.154135  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:10.155463  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:10.164188  1613 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
W20260709 12:58:10.166769  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 158299us
I20260709 12:58:10.152220  4631 raft_consensus.cc:2764] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:58:10.156728  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:10.165076  1655 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:10.171130  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:10.171341  1615 raft_consensus.cc:1275] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:58:10.177621  1534 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:10.182174  1505 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:10.183851  4716 consensus_queue.cc:1048] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:10.186257  1534 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:10.192399  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:10.194228  1617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:58:10.159364  4405 raft_consensus.cc:2804] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:10.195533  1617 raft_consensus.cc:606] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:10.202490  1617 raft_consensus.cc:614] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:10.196396  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:10.199887  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:10.184325  4479 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:10.212162  1609 raft_consensus.cc:2368] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 8. Current term is 9.
I20260709 12:58:10.153182  4662 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:10.140838  4643 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:10.154978  4332 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
W20260709 12:58:10.241492  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 100707us
I20260709 12:58:10.243355  1616 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 6.
I20260709 12:58:10.202382  4405 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:10.256450  1538 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:10.205797  4636 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:10.263015  1609 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:58:10.265983  1610 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:10.209765  4479 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:10.268430  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 64379.3us
I20260709 12:58:10.269166  1615 raft_consensus.cc:1240] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:58:10.269582  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 77138.5us
I20260709 12:58:10.274174  1655 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:10.274614  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:10.275453  1608 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:10.283888  1611 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:58:10.286559  1505 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:10.262961  4405 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:10.295866  1505 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:10.296804  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:10.303695  1538 raft_consensus.cc:2410] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:58:10.308857  1505 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:10.277208  4479 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:10.299319  4437 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:10.328320  1685 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:58:10.334810  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:10.327489  4610 consensus_queue.cc:1048] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:58:10.314792  4513 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:10.299533  4717 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:58:10.291736  4641 consensus_queue.cc:1048] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:58:10.316242  4492 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:10.381871  4492 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:58:10.383358  4739 log.cc:927] Time spent T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:58:10.361894  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 87808.5us
I20260709 12:58:10.385624  1655 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:10.386025  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:10.388499  1581 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:10.389652  2266 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:10.390086  1581 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:10.388770  4332 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:10.391628  4332 raft_consensus.cc:697] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 7 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:10.392671  4332 consensus_queue.cc:237] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:10.362730  1536 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:10.319118  4363 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:10.396078  4363 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:10.393258  4715 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:10.407028  4513 raft_consensus.cc:697] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:10.323983  4661 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:10.400977  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:10.408074  4661 raft_consensus.cc:697] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:10.409188  4661 consensus_queue.cc:237] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:10.402627  1583 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:10.399739  4492 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:10.330667  4725 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:58:10.405637  4738 log.cc:927] Time spent T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:58:10.406100  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 115081us
I20260709 12:58:10.388738   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:58:10.404376  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:58:10.359239  4737 log.cc:927] Time spent T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 12:58:10.324782  4437 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:10.380431  4643 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:10.415047  1581 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:10.323519  4636 raft_consensus.cc:697] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 7 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:58:10.405804  4741 log.cc:927] Time spent T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.069s	user 0.002s	sys 0.000s
I20260709 12:58:10.422888  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:10.407272  4715 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:10.442528  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:10.469695  1538 raft_consensus.cc:2393] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 7: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:10.444036  1505 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:10.437963  1537 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:58:10.437330  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:10.470690  1617 raft_consensus.cc:2393] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 8: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:10.444837  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:10.446213  4615 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:10.424785  4709 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.439885  4437 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:10.440280  4654 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:10.445245  4631 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:10.436800  4725 raft_consensus.cc:697] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:10.444309  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:10.438650  4513 consensus_queue.cc:237] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:10.460966  1612 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:10.449602  4666 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:10.411089  4662 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:10.458117   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 12:58:10.472993  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 58047.6us
I20260709 12:58:10.473011  1508 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:10.475083  3460 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:10.479739  3460 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:10.480144  3460 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:10.482621  1581 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:10.483938  1581 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:10.486171  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:10.486929  1534 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:10.461942  4420 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:10.497848  1535 raft_consensus.cc:1240] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:10.500602  1536 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:10.473695  4715 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:10.478644  4631 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:10.507795  4631 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:10.508167  4433 raft_consensus.cc:3055] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:10.508642  4433 raft_consensus.cc:740] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:10.509521  4433 consensus_queue.cc:260] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:10.510690  4433 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:10.513157  1609 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:10.517949  4643 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:10.519309  4725 consensus_queue.cc:237] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:10.472555  4675 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:10.498085  4615 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:58:10.521994  4654 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:10.522961  4420 raft_consensus.cc:697] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:10.478345  4709 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:10.523994  4420 consensus_queue.cc:237] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:10.525207  4709 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:10.526165  1611 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:10.526949  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:58:10.527227  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 54324.6us
I20260709 12:58:10.527561  4636 consensus_queue.cc:237] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:10.533102  4747 log.cc:927] Time spent T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 12:58:10.526837  4748 log.cc:927] Time spent T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:58:10.504855  1581 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:10.544442  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:10.575251  1534 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
W20260709 12:58:10.577133  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 72361.1us
W20260709 12:58:10.544234  4750 log.cc:927] Time spent T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.106s	user 0.002s	sys 0.000s
I20260709 12:58:10.580260  1617 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:10.522943  4654 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:10.588218  1581 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:10.569355  4613 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:10.590483  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:10.594349  1539 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:10.613977  1505 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:58:10.621690  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 318678us
I20260709 12:58:10.629199  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:58:10.632294  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 63352.6us
I20260709 12:58:10.584195  4584 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:10.623029  3460 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:10.640075  1534 raft_consensus.cc:2368] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10.
I20260709 12:58:10.641175  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:10.644806  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:10.578473  4675 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:58:10.646840  1537 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:58:10.643690  4743 log.cc:927] Time spent T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:58:10.641116  1654 leader_election.cc:400] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 8. Current term is 9.
I20260709 12:58:10.632431  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:10.651283  1535 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:10.643519  4716 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:10.657127  4675 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:10.657677  4675 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:10.659665  4675 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:10.660015  1535 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:58:10.660426  1654 leader_election.cc:403] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:58:10.661686  4582 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 8. Current term is 9.
I20260709 12:58:10.667182  1536 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:10.671178  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:10.671797  1609 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:10.578078  4405 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:10.593782  4654 raft_consensus.cc:697] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:10.685441  3460 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:10.631048  4567 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:10.687443  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:10.633061  4696 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:10.694851  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:10.696216  1508 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:10.694242  1610 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:10.641624  4666 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:10.694465  1654 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:10.705075  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:10.712829  4654 consensus_queue.cc:237] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:10.683207  4492 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:58:10.693926  4581 consensus_queue.cc:1059] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:58:10.723325  1609 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:10.724453  1541 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:10.726080  1654 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:10.728421  3460 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:10.691751  4567 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:10.748085  1505 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:10.683605  4724 consensus_queue.cc:1059] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:58:10.761225  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:10.761332  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:10.763744  1536 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:10.764328  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:10.749092  4582 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:10.749315  4696 raft_consensus.cc:697] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:58:10.794351  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 99919.3us
I20260709 12:58:10.757064  4567 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:10.787844  1542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.032s	sys 0.023s
W20260709 12:58:10.807586  1542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.032s	sys 0.023s
I20260709 12:58:10.760114  4673 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:10.760874  4675 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:58:10.793421  4626 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.007s	sys 0.017s
I20260709 12:58:10.854805  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:58:10.853008  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 423899us
I20260709 12:58:10.758661  4479 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:10.816324  4626 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.008s	sys 0.017s
I20260709 12:58:10.853778  4582 raft_consensus.cc:697] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:58:10.908664  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 46166.4us
I20260709 12:58:10.903780  1536 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:10.859236  4675 raft_consensus.cc:697] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:10.856935  4673 raft_consensus.cc:697] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:10.921887  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:10.926245  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:10.931434  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:10.938675  1540 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:10.940068  1608 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.031s	sys 0.029s
W20260709 12:58:10.940548  1608 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.032s	sys 0.029s
I20260709 12:58:10.944427  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:10.937860  1686 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:10.978618  1684 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
W20260709 12:58:10.987839  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:10.981150  4405 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:10.937903  4696 consensus_queue.cc:237] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:11.007170  4332 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.026s	sys 0.025s
W20260709 12:58:11.009214  4332 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.026s	sys 0.025s
I20260709 12:58:11.012223  1536 raft_consensus.cc:1275] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:11.060535  1541 raft_consensus.cc:1275] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:11.011875  1581 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:58:11.060917  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 56287.6us
I20260709 12:58:10.988384  4662 consensus_queue.cc:1059] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
W20260709 12:58:11.077463  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 65679.2us
I20260709 12:58:11.076849  1654 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:11.105290  1613 raft_consensus.cc:1240] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 7. Current term is 8. Ops: []
W20260709 12:58:11.068156  4631 consensus_meta.cc:287] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.555s	user 0.015s	sys 0.002s
I20260709 12:58:11.109462  4332 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:58:11.110456  4760 log.cc:927] Time spent T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 12:58:11.119361  1539 consensus_meta.cc:287] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.007s
I20260709 12:58:11.123580  1539 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:58:10.992731  4675 consensus_queue.cc:237] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.008956  4751 consensus_queue.cc:1059] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.205s
I20260709 12:58:11.000849  4673 consensus_queue.cc:237] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.099973  4724 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:11.129907  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 47437.8us
I20260709 12:58:11.131218  4751 raft_consensus.cc:3055] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:11.131685  4513 raft_consensus.cc:3055] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:11.107550  4479 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:11.132108  4513 raft_consensus.cc:740] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:11.133203  4513 consensus_queue.cc:260] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.134017  1613 raft_consensus.cc:1275] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:58:11.134840  4513 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:11.136776  4752 log.cc:927] Time spent T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
I20260709 12:58:11.143232  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:11.143833  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:11.149366  1613 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:11.149680  1608 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:11.150696  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1238) took 1017 ms. Trace:
W20260709 12:58:11.144223  4437 consensus_meta.cc:287] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.649s	user 0.007s	sys 0.000s
I20260709 12:58:11.104018  4492 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:11.004184  4582 consensus_queue.cc:237] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.151181  1614 rpcz_store.cc:276] 0709 12:58:10.132804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.132922 (+   118us) service_pool.cc:224] Handling call
0709 12:58:10.152659 (+ 19737us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:10.161564 (+  8905us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:10.161594 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:10.211749 (+ 50155us) log.cc:844] Serialized 26 byte log entry
0709 12:58:10.540834 (+329085us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:10.540876 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:10.540958 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:11.150238 (+609280us) raft_consensus.cc:1685] finished
0709 12:58:11.150259 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:11.150402 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":9552,"thread_start_us":252562,"threads_started":1,"wal-append.queue_time_us":501314}
W20260709 12:58:11.147970  4715 consensus_meta.cc:287] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.642s	user 0.007s	sys 0.000s
I20260709 12:58:11.211853  1683 raft_consensus.cc:1275] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:11.213459  1505 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:11.131641  4751 raft_consensus.cc:740] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:11.194825  4492 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.178198  4437 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:11.286624  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:11.161330  4613 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:11.124631  4631 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.297564  1613 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:11.290520  4613 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:11.301256  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 87906.4us
W20260709 12:58:11.302444  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 217284us
W20260709 12:58:11.276170  4753 log.cc:927] Time spent T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.312s	user 0.004s	sys 0.003s
I20260709 12:58:11.308207  1537 raft_consensus.cc:1240] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:11.177850  4724 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.274370  4768 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:11.291489  4581 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.315877  1609 raft_consensus.cc:1240] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:58:11.318452  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1852) took 1229 ms. Trace:
W20260709 12:58:11.299110  4661 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.004s	sys 0.007s
I20260709 12:58:11.231666  4715 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:11.305572  4662 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:11.291808  4363 consensus_queue.cc:1048] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:58:11.238584  4763 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.105s
I20260709 12:58:11.310047  4754 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 12:58:11.346612  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:11.333266  4661 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.004s	sys 0.007s
I20260709 12:58:11.322753  1542 rpcz_store.cc:276] 0709 12:58:10.080251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.080381 (+   130us) service_pool.cc:224] Handling call
0709 12:58:10.104522 (+ 24141us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:10.110549 (+  6027us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:10.110582 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:10.118389 (+  7807us) log.cc:844] Serialized 26 byte log entry
0709 12:58:10.808186 (+689797us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:11.292884 (+484698us) log.cc:844] Serialized 14 byte log entry
0709 12:58:11.309684 (+ 16800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.309752 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:11.309793 (+    41us) raft_consensus.cc:1685] finished
0709 12:58:11.309803 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:11.309932 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21976,"prepare.queue_time_us":468324,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":30417,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":2695,"thread_start_us":1083044,"threads_started":2,"wal-append.queue_time_us":850476}
I20260709 12:58:11.322016  4636 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:11.369076  1538 raft_consensus.cc:1240] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:11.326035  4756 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:11.347249  4662 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:11.347280  4626 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:11.375978  4788 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:11.378252  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 409914us
W20260709 12:58:11.381589  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 284282us
W20260709 12:58:11.383522  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 66507.3us
W20260709 12:58:11.387188  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 84331.2us
I20260709 12:58:11.384336  1583 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:11.346904  4581 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.380234  4662 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:11.427675  1540 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
W20260709 12:58:11.446940  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 62698.9us
I20260709 12:58:11.381904  4437 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:11.450193  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 108563us
I20260709 12:58:11.327608  4751 consensus_queue.cc:260] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.451251  1583 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:11.448360  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 137194us
I20260709 12:58:11.398095  4761 consensus_queue.cc:1048] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:58:11.465299  4771 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:11.465926  4666 raft_consensus.cc:3055] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:11.466255  4581 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:11.372707  4754 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.373725  4636 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:11.474946  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 86426.7us
W20260709 12:58:11.468652  4759 log.cc:927] Time spent T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
I20260709 12:58:11.465886  4771 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:11.396234  4756 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.468770  4666 raft_consensus.cc:740] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:11.507611  4666 consensus_queue.cc:260] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.485838  4790 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:11.508740  4666 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:11.512606  4363 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 12:58:11.512943  4767 log.cc:927] Time spent T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 12:58:11.502794  1686 raft_consensus.cc:3055] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:11.502483  4795 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 12:58:11.506582  4774 log.cc:927] Time spent T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:58:11.414494  4626 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.523628  1686 raft_consensus.cc:740] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:11.539860  4754 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:11.504778  4771 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:11.490322  4768 raft_consensus.cc:697] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:58:11.557770  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 81347.4us
I20260709 12:58:11.547336  1686 consensus_queue.cc:260] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.561815  1686 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:11.395550  4788 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.567380  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:11.568167  1540 raft_consensus.cc:2368] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 7. Current term is 8.
I20260709 12:58:11.508733  4790 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:11.572847  1608 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:11.580410  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:11.581897  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:11.537067  4363 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.562767  4762 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:11.574750  4790 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:11.551432  4789 consensus_queue.cc:1048] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:58:11.596371  4762 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.587597  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:11.603945  1540 raft_consensus.cc:2393] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 9: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:11.591478  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:11.592383  4768 consensus_queue.cc:237] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.552577  4795 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:11.617309  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 1873) took 1214 ms. Trace:
I20260709 12:58:11.618654  1542 raft_consensus.cc:1240] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:11.594623  4724 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:11.593829  4788 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:11.593773  4626 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:11.617744  1685 rpcz_store.cc:276] 0709 12:58:10.402764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.404107 (+  1343us) service_pool.cc:224] Handling call
0709 12:58:11.617049 (+1212942us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b5400388954. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:11.617194 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1346167168}
I20260709 12:58:11.629617  1542 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:58:11.629966  1535 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:11.622393  4796 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.638885  4795 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:11.639791  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:11.647547  4771 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.650460  4771 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:11.651710  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:58:11.654989  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 97915.3us
I20260709 12:58:11.657243  4796 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.659174  4363 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:11.659567  4756 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:11.660240  4636 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:11.664594  4782 log.cc:927] Time spent T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.267s	user 0.000s	sys 0.002s
I20260709 12:58:11.667035  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:11.667676  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:11.668440  1682 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:11.673455  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:11.677431  1535 raft_consensus.cc:2368] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 8. Current term is 9.
I20260709 12:58:11.676769  1540 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:11.677045  1687 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:58:11.680585  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:11.682363  1536 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:11.683689  4662 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:11.695644  4567 consensus_meta.cc:287] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.843s	user 0.012s	sys 0.000s
I20260709 12:58:11.696161  4567 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.697263  1533 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:11.699131  4584 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.699756  4584 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.702154  4584 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:11.708778  1682 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:11.707088  1583 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:11.711971  1682 raft_consensus.cc:1275] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:11.712898  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1590) took 1290 ms. Trace:
I20260709 12:58:11.714877  4794 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:11.715557  4794 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:11.713311  1616 rpcz_store.cc:276] 0709 12:58:10.422761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.422979 (+   218us) service_pool.cc:224] Handling call
0709 12:58:10.469659 (+ 46680us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:10.712390 (+242731us) spinlock_profiling.cc:243] Waited 32.5 ms on lock 0x7b480024e7d8. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc861f7aaa1 00007fc861f71b37 00007fc861f719ca 00007fc86206926f 00007fc862068f37 00007fc86207d55c 00007fc86207d508 00007fc86207d488 00007fc86207d443 00007fc86207c6ec 00007fc860fa6a96
0709 12:58:10.923672 (+211282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:10.923712 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:10.938510 (+ 14798us) log.cc:844] Serialized 26 byte log entry
0709 12:58:11.304972 (+366462us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:11.305009 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.305079 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:11.706337 (+401258us) raft_consensus.cc:1685] finished
0709 12:58:11.706357 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:11.712830 (+  6473us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21970,"raft.queue_time_us":34256,"raft.run_cpu_time_us":2646,"raft.run_wall_time_us":177444,"spinlock_wait_cycles":74832256,"thread_start_us":769476,"threads_started":2,"wal-append.queue_time_us":369498}
I20260709 12:58:11.719621  1536 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:58:11.721761  4584 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:11.723946  1583 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:11.740877  4768 consensus_queue.cc:1048] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:11.742169  4790 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.748540  4363 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:11.749310  1536 raft_consensus.cc:1275] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:11.749163  4363 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.809693  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:11.819696  1539 raft_consensus.cc:1275] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:11.805903  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1187) took 1293 ms. Trace:
I20260709 12:58:11.771801  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:11.822319  1686 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:58:11.823035  1539 raft_consensus.cc:1275] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:11.824963  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:58:11.824833  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 373829us
I20260709 12:58:11.821931  1538 rpcz_store.cc:276] 0709 12:58:10.512611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.512736 (+   125us) service_pool.cc:224] Handling call
0709 12:58:10.513018 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:11.369524 (+856506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.805607 (+436083us) spinlock_profiling.cc:243] Waited 856 ms on lock 0x7b540007dd54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:11.805829 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1968520960}
I20260709 12:58:11.826807  1540 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:11.829444  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:11.830993  1536 raft_consensus.cc:1240] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:11.739478  4584 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:11.771066  4771 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:11.829093  4615 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.839638  1608 raft_consensus.cc:1275] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:11.787883  4715 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 7 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:11.502583   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:11.812752  4662 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:11.828109  4790 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:11.807247  4613 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.846381  1612 raft_consensus.cc:1240] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:58:11.848750  3460 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.858793  4808 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:11.831840  4806 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:11.859819  1505 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:11.861219  3460 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.837291  4584 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:11.862816  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:11.858688  4796 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:11.865891  4808 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.869832  4405 raft_consensus.cc:2804] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:11.870271  1614 raft_consensus.cc:2393] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 8: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:11.870687  4806 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:11.845724  4615 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.872710  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1195) took 1102 ms. Trace:
I20260709 12:58:11.873054  4806 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:11.874518  4591 raft_consensus.cc:3055] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:11.870476  4405 raft_consensus.cc:697] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 12:58:11.875411  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 46247.9us
I20260709 12:58:11.876012  4405 consensus_queue.cc:237] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.836464  4768 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:58:11.876680  4724 consensus_queue.cc:1059] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:11.877015  4768 consensus_queue.cc:1243] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 12.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:58:11.877396  4724 consensus_queue.cc:1243] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer c262eac7fc904ae9bb91e450f6532e3f log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:58:11.871982  4794 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:11.879002  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:11.879804  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:11.880579  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:11.879614  4332 consensus_queue.cc:1059] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:11.884231  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:11.874917  4591 raft_consensus.cc:740] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:11.885016  1537 rpcz_store.cc:276] 0709 12:58:10.770314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.796985 (+ 26671us) service_pool.cc:224] Handling call
0709 12:58:10.797332 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:11.308773 (+511441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.872408 (+563635us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b54000744d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:11.872646 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1174548352}
I20260709 12:58:11.888815  1505 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:11.895524  1685 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:11.896720  3460 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:11.897049  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:11.847604  4771 raft_consensus.cc:697] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:11.897759  1610 raft_consensus.cc:1813] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Handling vote request from an unknown peer dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:11.898464  1689 raft_consensus.cc:1240] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:11.900082  4725 raft_consensus.cc:3055] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:11.900532  4725 raft_consensus.cc:740] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:11.901137  4615 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:11.900238  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:11.898231  4796 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:11.902813  4796 raft_consensus.cc:697] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:11.903709  4796 consensus_queue.cc:237] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.889856  4754 raft_consensus.cc:3055] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:11.904686  4754 raft_consensus.cc:740] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:11.905192  4591 consensus_queue.cc:260] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.905485  4754 consensus_queue.cc:260] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.906138  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:11.906603  4754 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:11.907321  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:11.906230  4591 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:11.908113  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:11.908674  1687 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:58:11.898792  1690 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:58:11.913084  1610 raft_consensus.cc:2410] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:58:11.901530  1614 raft_consensus.cc:1275] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:11.877856  4613 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:11.930256  1687 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:11.877903  4724 consensus_queue.cc:1048] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:58:11.885039  4808 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:11.937899  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:11.901394  4725 consensus_queue.cc:260] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:11.939666  4725 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:11.932183  1537 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:58:11.932327  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:11.941365  1690 raft_consensus.cc:2410] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:58:11.944825  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:11.946048  1535 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:11.946341  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:11.947376  1687 raft_consensus.cc:1275] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:58:12.035847  1690 raft_consensus.cc:1275] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:58:12.313141  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:58:12.521499  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:11.948107  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:11.976492  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:12.311136  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:12.524052  1535 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:12.495275  1540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.013s	sys 0.017s
I20260709 12:58:12.524418  1611 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
W20260709 12:58:12.524803  1540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.014s	sys 0.018s
I20260709 12:58:12.524509  1685 raft_consensus.cc:2410] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:58:11.955965  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:12.320236  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:12.527089  1541 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:12.312125  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:12.314064  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:12.534488  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:12.535175  1537 raft_consensus.cc:2393] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 8: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:12.408948  2266 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:12.310009  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:12.519658  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:58:12.054385  1533 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 1863) took 1462 ms (client timeout 1785 ms). Trace:
W20260709 12:58:12.593029  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 583905us
I20260709 12:58:12.596501  1615 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:12.540830  1610 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:58:12.537990  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 129155us
W20260709 12:58:12.042425  4775 log.cc:927] Time spent T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.666s	user 0.002s	sys 0.002s
W20260709 12:58:12.043190  4810 log.cc:927] Time spent T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
W20260709 12:58:12.592649  1533 rpcz_store.cc:269] 0709 12:58:10.591860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:10.644504 (+ 52644us) service_pool.cc:224] Handling call
0709 12:58:12.053971 (+1409467us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540021a7d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:12.054250 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2419052800}
W20260709 12:58:12.277534  4817 log.cc:927] Time spent T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
W20260709 12:58:12.043848  4811 log.cc:927] Time spent T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
W20260709 12:58:12.672130  1536 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.000s	sys 0.033s
I20260709 12:58:12.107683  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:12.714772  1614 raft_consensus.cc:1240] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:12.714648  3947 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.716007  3947 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:12.717347  4791 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:12.717988  4791 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:12.718501  3947 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:12.048236  4781 log.cc:927] Time spent T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.666s	user 0.000s	sys 0.002s
W20260709 12:58:12.275492  4802 log.cc:927] Time spent T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.644s	user 0.003s	sys 0.000s
I20260709 12:58:12.005986  4790 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:12.719333  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 185094us
I20260709 12:58:12.719486  4790 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:12.425295  4654 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:12.720453  4582 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:12.136840  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 12:58:12.689790  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 536941us
W20260709 12:58:12.734580  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:12.404552  4762 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:12.385221  4613 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:11.998611  4761 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.046766  4567 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:11.976064  4800 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 12:58:12.698319  1536 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.000s	sys 0.034s
W20260709 12:58:12.671739  1689 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.004s	sys 0.029s
W20260709 12:58:12.761783  1689 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.005s	sys 0.029s
I20260709 12:58:12.701964  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:12.245126  4584 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:12.763881  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:11.975795  4806 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.007002  4662 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.712428  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:12.116711  4771 consensus_queue.cc:237] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:12.718562  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:12.768833  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:12.719012  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:12.769569  1684 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:12.437127  4793 log.cc:927] Time spent T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.877s	user 0.002s	sys 0.003s
I20260709 12:58:12.593078  4778 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:12.720078  1655 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:12.731751  1609 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.010s	sys 0.014s
W20260709 12:58:12.778399  1609 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.010s	sys 0.015s
I20260709 12:58:12.523658  4751 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:12.737437  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:12.439924  4797 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:12.388808  1440 catalog_manager.cc:5697] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 6 to 9, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:12.739476  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:12.435947  4363 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:12.492096  4615 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:12.738695  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:12.676156  4794 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:12.765218  1533 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:12.765570  1541 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:12.775954  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:12.783747  1535 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:12.774433  4613 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:12.828704  4631 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:12.830379  4613 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:12.832796  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:12.833566  1690 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:12.836292  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:12.837634  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:12.838768  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:12.839516  1685 raft_consensus.cc:2368] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12.
I20260709 12:58:12.677044  4804 consensus_queue.cc:1048] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 12:58:12.849972  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:12.733315  4433 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.796783  1540 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:12.840266  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:12.720968  4654 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:12.818372  4615 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:12.819084  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:12.821427  1538 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:58:12.822013  4794 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:12.824576  4808 consensus_queue.cc:1048] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:12.827121  4492 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:12.828307  1687 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:12.853998  1608 raft_consensus.cc:1240] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:12.854748  4724 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:58:12.787496  1505 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:12.857673  1690 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:12.757043  4762 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.859902  1541 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:12.817795  4363 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:12.886148  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:12.889564  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:12.891898  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 104508us
I20260709 12:58:12.790488  4479 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.893601  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:12.865186  4824 log.cc:927] Time spent T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.671s	user 0.002s	sys 0.000s
I20260709 12:58:12.903527  1616 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:12.896854  1687 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:12.905249  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:12.899048  4794 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:12.854166  4584 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:12.776343  4662 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:12.858131  4797 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:12.775347  4800 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:12.948441  1581 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.021s	sys 0.040s
W20260709 12:58:12.949328  1581 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.021s	sys 0.040s
I20260709 12:58:12.934221  4790 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:12.776126  4806 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:12.914710  4615 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:12.912732  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:12.965546  1581 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:58:12.966789  1691 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.019s	sys 0.040s
W20260709 12:58:12.967144  1691 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.019s	sys 0.040s
I20260709 12:58:12.932061  1687 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:12.925462  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:12.771781  4761 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:12.938588  1690 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
W20260709 12:58:12.902745  4817 log.cc:927] Time spent T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:58:12.902881  4641 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:12.920957  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:12.882382  4433 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:12.948097  4772 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.023s	sys 0.034s
I20260709 12:58:12.907940  4812 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:13.010746  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:13.015342  1690 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:13.016300  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:13.013666  1505 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:58:13.069355  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 55699.4us
I20260709 12:58:12.906865  4363 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:12.901585  4762 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:13.014199  4613 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:12.908341  4479 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:13.025238  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:12.961697  4790 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 12:58:13.057271  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 83251.6us
I20260709 12:58:13.070622  1582 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:13.078603  1687 raft_consensus.cc:1275] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:13.014199  4492 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:13.072503  1689 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:12.966943  4584 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 12:58:13.010527  4615 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
W20260709 12:58:13.077842  4754 consensus_meta.cc:287] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 1.168s	user 0.012s	sys 0.000s
I20260709 12:58:13.069986  4776 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 12:58:13.129398  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 58865.4us
I20260709 12:58:13.106141  4772 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:13.122539  1687 raft_consensus.cc:1275] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:58:13.108817  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1206) took 1475 ms. Trace:
I20260709 12:58:13.106382  4804 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:13.085878  4613 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:13.025686  4641 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:13.139721  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:13.140904  1542 rpcz_store.cc:276] 0709 12:58:11.633625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:11.633771 (+   146us) service_pool.cc:224] Handling call
0709 12:58:11.661916 (+ 28145us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:11.673177 (+ 11261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:11.673208 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:11.678552 (+  5344us) log.cc:844] Serialized 26 byte log entry
0709 12:58:11.831474 (+152922us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:11.840907 (+  9433us) log.cc:844] Serialized 14 byte log entry
0709 12:58:11.841490 (+   583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:11.841571 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:12.403386 (+561815us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b18003e3560. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f64522 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd 000000000038f354 000000000038f199 00007fc859f4783a
0709 12:58:13.077823 (+674437us) raft_consensus.cc:1685] finished
0709 12:58:13.088681 (+ 10858us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:13.108740 (+ 20059us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":138527,"prepare.queue_time_us":9218,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":7461,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":13844,"spinlock_wait_cycles":8723200,"thread_start_us":90057,"threads_started":1,"wal-append.queue_time_us":181644}
I20260709 12:58:13.106393  1581 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:13.140763  1687 pending_rounds.cc:85] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 3
I20260709 12:58:13.108862  4808 consensus_queue.cc:1059] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 12:58:13.108213  4790 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:13.175098  4808 raft_consensus.cc:3055] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:13.159258  1687 pending_rounds.cc:107] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:58:13.185396  4808 raft_consensus.cc:740] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:13.186589  4808 consensus_queue.cc:260] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:13.174666  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:13.188019  4808 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:13.188270  1689 raft_consensus.cc:2368] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12.
I20260709 12:58:13.152958  4804 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.188797  4804 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:13.189282  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:13.189880  1689 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:58:13.156795  4776 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:58:13.191072  4831 log.cc:927] Time spent T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:58:13.192466  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1872) took 1264 ms. Trace:
I20260709 12:58:13.111043  4492 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:13.193677  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1619) took 1251 ms. Trace:
I20260709 12:58:13.192866  1536 rpcz_store.cc:276] 0709 12:58:11.927903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:11.928049 (+   146us) service_pool.cc:224] Handling call
0709 12:58:11.928416 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:11.940649 (+ 12233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:11.940679 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:11.975170 (+ 34491us) log.cc:844] Serialized 26 byte log entry
0709 12:58:12.761327 (+786157us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:12.761369 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:12.761440 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:13.192220 (+430780us) raft_consensus.cc:1685] finished
0709 12:58:13.192242 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:13.192398 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21944,"raft.queue_time_us":12330,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":5888,"thread_start_us":785743,"threads_started":1,"wal-append.queue_time_us":985694}
I20260709 12:58:13.194067  1616 rpcz_store.cc:276] 0709 12:58:11.942601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:11.943083 (+   482us) service_pool.cc:224] Handling call
0709 12:58:13.193519 (+1250436us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b54000663d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:13.193621 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":863089024}
I20260709 12:58:13.196918  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1616) took 1334 ms. Trace:
I20260709 12:58:13.197085  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1624) took 1223 ms. Trace:
W20260709 12:58:13.179342  1615 consensus_meta.cc:287] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.532s	user 0.005s	sys 0.002s
I20260709 12:58:13.196964  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:13.185519  1687 raft_consensus.cc:2889] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:13.197399  1608 rpcz_store.cc:276] 0709 12:58:11.862293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:11.862430 (+   137us) service_pool.cc:224] Handling call
0709 12:58:11.862833 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:12.882654 (+1019821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:13.196660 (+314006us) spinlock_profiling.cc:243] Waited 991 ms on lock 0x7b54002a5dd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:13.196860 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2279188224}
I20260709 12:58:13.199242  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:13.200286  1614 raft_consensus.cc:2393] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 12: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:13.200953  1615 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:13.201551  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1625) took 1227 ms. Trace:
I20260709 12:58:13.202229  1615 rpcz_store.cc:276] 0709 12:58:11.974456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:12.309683 (+335227us) service_pool.cc:224] Handling call
0709 12:58:13.201494 (+891811us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:13.200448  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:13.203023  1687 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:13.205813  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:13.197449  1612 rpcz_store.cc:276] 0709 12:58:11.974084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:12.539207 (+565123us) service_pool.cc:224] Handling call
0709 12:58:12.672340 (+133133us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:12.963264 (+290924us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:12.963296 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:12.963341 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:12.963374 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:13.196874 (+233500us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54002a53d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:13.196919 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:13.197030 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":666794240}
I20260709 12:58:13.106215  4795 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:58:13.207993  1687 pending_rounds.cc:85] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 4
I20260709 12:58:13.210333  1687 pending_rounds.cc:107] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 12.5
I20260709 12:58:13.210686  1687 raft_consensus.cc:2889] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:13.158640  4613 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:13.210194  1505 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:13.212643  1505 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:58:13.164660  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 75881.3us
I20260709 12:58:13.201469  4794 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:13.230724  3460 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:13.231321  3460 raft_consensus.cc:697] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 12:58:13.212572  4822 log.cc:927] Time spent T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.311s	user 0.001s	sys 0.001s
I20260709 12:58:13.219280  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1620) took 1271 ms. Trace:
I20260709 12:58:13.231127  1581 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:58:13.229770  1683 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.011s	sys 0.020s
I20260709 12:58:13.168845  4772 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:13.362785  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 479548us
W20260709 12:58:13.377323  1684 consensus_meta.cc:287] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.600s	user 0.008s	sys 0.001s
I20260709 12:58:13.445243  1684 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:13.337364  1612 raft_consensus.cc:1275] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:58:13.325443  1580 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.022s	sys 0.049s
W20260709 12:58:13.445115  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 725130us
W20260709 12:58:13.448110  1580 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.024s	sys 0.050s
I20260709 12:58:13.448494  1655 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:13.443986  1689 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
W20260709 12:58:13.447245  1684 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 1890) took 1288 ms (client timeout 1564 ms). Trace:
W20260709 12:58:13.449129  1533 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.017s	sys 0.014s
W20260709 12:58:13.450248  1537 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.005s	sys 0.025s
W20260709 12:58:13.450548  1533 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.017s	sys 0.014s
W20260709 12:58:13.450073  1683 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.016s	sys 0.029s
W20260709 12:58:13.450587  1537 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.005s	sys 0.025s
I20260709 12:58:13.463178  1613 rpcz_store.cc:276] 0709 12:58:11.947951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:12.323396 (+375445us) service_pool.cc:224] Handling call
0709 12:58:12.323719 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:12.323938 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:12.324279 (+   341us) log.cc:844] Serialized 14 byte log entry
0709 12:58:13.218919 (+894640us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:13.218977 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:13.219020 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:13.219086 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:13.219210 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":494,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":76441,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":891364,"threads_started":2,"wal-append.queue_time_us":639657}
W20260709 12:58:13.465632  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 234585us
I20260709 12:58:13.175138  4800 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:13.210793  4791 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:13.450105  1684 rpcz_store.cc:269] 0709 12:58:12.158516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:12.718720 (+560204us) service_pool.cc:224] Handling call
0709 12:58:13.447171 (+728451us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:13.362188  3460 consensus_queue.cc:237] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:13.287096  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1256) took 1454 ms. Trace:
W20260709 12:58:13.314491  1534 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.004s	sys 0.012s
W20260709 12:58:13.351895  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:13.313651  1615 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:58:13.346410  1610 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.005s	sys 0.011s
I20260709 12:58:13.466498  1581 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:58:13.488972  1610 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.007s	sys 0.012s
I20260709 12:58:13.494673  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:13.495409  1536 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:13.215962  4567 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:58:13.231910  4796 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.001s	sys 0.014s
I20260709 12:58:13.189993  4641 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:13.470945  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1878) took 1529 ms. Trace:
W20260709 12:58:13.487039  1534 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.008s	sys 0.012s
I20260709 12:58:13.218180  4809 consensus_queue.cc:1059] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.276s
I20260709 12:58:13.316712  4654 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:13.213136  4835 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:13.496632  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:13.873378  4835 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:13.874256  4835 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:13.572845  1541 raft_consensus.cc:1275] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:58:13.469548  4825 log.cc:927] Time spent T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.459s	user 0.000s	sys 0.001s
I20260709 12:58:13.487422  1609 rpcz_store.cc:276] 0709 12:58:11.832315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:11.832422 (+   107us) service_pool.cc:224] Handling call
0709 12:58:11.832768 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:11.833149 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:11.927421 (+ 94272us) log.cc:844] Serialized 14 byte log entry
0709 12:58:12.778849 (+851428us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:12.827843 (+ 48994us) log.cc:844] Serialized 26 byte log entry
0709 12:58:12.827989 (+   146us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:12.828027 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:12.828096 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:13.286835 (+458739us) raft_consensus.cc:1685] finished
0709 12:58:13.286855 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:13.287018 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":165016,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":39147,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":134,"spinlock_wait_cycles":19712,"thread_start_us":880425,"threads_started":2,"wal-append.queue_time_us":1071483}
W20260709 12:58:13.469923  4828 log.cc:927] Time spent T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.460s	user 0.001s	sys 0.000s
I20260709 12:58:13.612350  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:13.632663  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:13.633080  1689 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:58:13.658100  1656 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.038s	sys 0.062s
I20260709 12:58:13.875520  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:13.919234  1656 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.084s	user 0.042s	sys 0.077s
I20260709 12:58:13.919440  1540 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:13.920315  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:13.920709  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:13.497074  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:13.658448  1508 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.061s	sys 0.065s
W20260709 12:58:13.876828  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 428448us
I20260709 12:58:13.876369  1537 rpcz_store.cc:276] 0709 12:58:11.941186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:12.809319 (+868133us) service_pool.cc:224] Handling call
0709 12:58:12.809683 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:12.809890 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:12.886403 (+ 76513us) log.cc:844] Serialized 14 byte log entry
0709 12:58:13.470617 (+584214us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:13.470670 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:13.470711 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:13.470773 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:13.470895 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17053,"prepare.queue_time_us":89228,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":45,"raft.queue_time_us":30745,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":19342,"thread_start_us":566803,"threads_started":1}
W20260709 12:58:13.921324  1508 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.012s	user 0.062s	sys 0.083s
W20260709 12:58:13.921501  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:13.921671  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 1.02938e+06us
W20260709 12:58:13.887295  1539 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.001s	user 0.003s	sys 0.030s
W20260709 12:58:13.922320  1539 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.036s	user 0.003s	sys 0.030s
I20260709 12:58:13.923365  1542 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
W20260709 12:58:13.890600  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:13.898252  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:13.925285  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:13.447960  4806 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:13.909005  1688 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.002s	sys 0.025s
I20260709 12:58:13.465229  4797 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:13.576122  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:13.481407  4837 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:13.934197  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:13.935094  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:13.975219  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:13.872752  4836 log.cc:927] Time spent T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.510s	user 0.001s	sys 0.000s
W20260709 12:58:13.936659  1505 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.000s	sys 0.044s
W20260709 12:58:13.940768  1688 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.002s	sys 0.026s
I20260709 12:58:13.642218  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:13.877889  4796 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.160s	user 0.006s	sys 0.023s
W20260709 12:58:13.637095  4832 log.cc:927] Time spent T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.552s	user 0.000s	sys 0.001s
W20260709 12:58:14.085899  1690 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.966s	user 0.017s	sys 0.023s
W20260709 12:58:13.922277  1508 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 1.548s (SENT) [suppressed 1 similar messages]
I20260709 12:58:14.086107  1533 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 10: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 12:58:14.086740  1690 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.017s	sys 0.023s
W20260709 12:58:14.087111  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 164869us
I20260709 12:58:13.963543  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:13.577195  4584 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:58:13.926563  4833 log.cc:927] Time spent T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.837s	user 0.000s	sys 0.001s
I20260709 12:58:13.876893  4567 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:13.608556  4754 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:13.977249  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:13.977833  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:13.974710  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:13.881819  4363 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:13.887440  4778 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:13.927058  4791 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:13.932535  4615 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.006613  4847 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.007804  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:14.009263  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1569) took 2132 ms. Trace:
I20260709 12:58:13.506217  4800 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.469s
W20260709 12:58:14.060889  4808 consensus_meta.cc:287] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.851s	user 0.009s	sys 0.000s
I20260709 12:58:14.032416  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1889) took 2206 ms. Trace:
I20260709 12:58:14.008208  1689 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:58:14.031122  4841 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:13.575001  4812 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:14.028515  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:14.124402  4584 raft_consensus.cc:697] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:14.045305  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:14.020256  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 86612.8us
I20260709 12:58:13.996757  4837 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:14.152539  1683 rpcz_store.cc:276] 0709 12:58:11.877342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:11.878216 (+   874us) service_pool.cc:224] Handling call
0709 12:58:11.878561 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:11.878968 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:11.878994 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:11.879471 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 12:58:13.452242 (+1572771us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:13.613618 (+161376us) log.cc:844] Serialized 14 byte log entry
0709 12:58:13.613814 (+   196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:13.613901 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:14.009042 (+395141us) raft_consensus.cc:1685] finished
0709 12:58:14.009061 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:14.009184 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69349,"prepare.queue_time_us":189499,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":83150,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":87559,"thread_start_us":932208,"threads_started":1,"wal-append.queue_time_us":2110632}
W20260709 12:58:14.082856  1505 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.000s	sys 0.049s
W20260709 12:58:14.015625  1687 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.014s	sys 0.033s
W20260709 12:58:14.169719  1687 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.020s	sys 0.034s
W20260709 12:58:14.084899  1617 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.018s	sys 0.032s
W20260709 12:58:14.170086  1617 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.018s	sys 0.032s
I20260709 12:58:13.486609  4662 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:14.125532  1540 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:58:14.127328  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:14.092449  4772 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:14.118765  1508 connection.cc:256] RPC call timeout handler was delayed by -1.1857236789999774s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
I20260709 12:58:14.121106  4567 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:14.152088  1541 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
W20260709 12:58:14.157184  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:14.186163  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:14.158191  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1608) took 1085 ms. Trace:
I20260709 12:58:14.022096  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:14.156869  1686 rpcz_store.cc:276] 0709 12:58:11.825724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:11.826187 (+   463us) service_pool.cc:224] Handling call
0709 12:58:11.830546 (+  4359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:11.895650 (+ 65104us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:11.895679 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:11.901864 (+  6185us) log.cc:844] Serialized 26 byte log entry
0709 12:58:12.114182 (+212318us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:12.114222 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:12.114288 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:14.032148 (+1917860us) raft_consensus.cc:1685] finished
0709 12:58:14.032171 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:14.032346 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":122936,"raft.queue_time_us":101469,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":6737,"thread_start_us":211931,"threads_started":1,"wal-append.queue_time_us":993448}
I20260709 12:58:14.129253  4848 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:14.163031  1538 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:14.166713  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:14.192194  1613 raft_consensus.cc:2368] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10.
I20260709 12:58:14.165032  1614 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
W20260709 12:58:14.125061  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 231363us
I20260709 12:58:14.186988  1689 rpcz_store.cc:276] 0709 12:58:13.072694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:14.007368 (+934674us) service_pool.cc:224] Handling call
0709 12:58:14.007816 (+   448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:14.157827 (+150011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:14.158103 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:14.171387  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1595) took 1341 ms. Trace:
I20260709 12:58:14.176515  1615 raft_consensus.cc:2410] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:58:14.148159  4791 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.196830  4791 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:14.197394  4791 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:14.197916  4791 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.200088  4791 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:14.201210  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1878) took 3071 ms. Trace:
I20260709 12:58:14.181653  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1606) took 1232 ms. Trace:
W20260709 12:58:14.203022  1508 connection.cc:256] RPC call timeout handler was delayed by -1.1758236789999614s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20379999999999998s for a response
W20260709 12:58:14.218096  1508 connection.cc:256] RPC call timeout handler was delayed by -1.1722236789999556s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
W20260709 12:58:14.218695  1508 connection.cc:256] RPC call timeout handler was delayed by -1.1335236789999499s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20850000000000002s for a response
I20260709 12:58:14.217850  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1596) took 1395 ms. Trace:
I20260709 12:58:14.220932  1655 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:14.222150  1685 rpcz_store.cc:276] 0709 12:58:12.949033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:13.212065 (+263032us) service_pool.cc:224] Handling call
0709 12:58:13.221355 (+  9290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:13.415148 (+193793us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:13.497852 (+ 82704us) log.cc:844] Serialized 14 byte log entry
0709 12:58:14.180909 (+683057us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:14.180970 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:14.181021 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:14.181090 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:14.181274 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34098,"prepare.queue_time_us":83969,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":6435,"thread_start_us":512920,"threads_started":2,"wal-append.queue_time_us":599800}
I20260709 12:58:14.222083  1688 rpcz_store.cc:276] 0709 12:58:12.821940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:13.018657 (+196717us) service_pool.cc:224] Handling call
0709 12:58:13.018991 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:13.058215 (+ 39224us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:13.107876 (+ 49661us) log.cc:844] Serialized 14 byte log entry
0709 12:58:14.162708 (+1054832us) log.cc:844] Serialized 14 byte log entry
0709 12:58:14.162858 (+   150us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:14.162901 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:14.162946 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:14.163008 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:14.163135 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":50138,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":81,"raft.queue_time_us":134997,"thread_start_us":1000880,"threads_started":2,"wal-append.queue_time_us":945247}
I20260709 12:58:14.219951  1690 rpcz_store.cc:276] 0709 12:58:12.822199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:13.072879 (+250680us) service_pool.cc:224] Handling call
0709 12:58:13.106135 (+ 33256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:13.111382 (+  5247us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:14.087461 (+976079us) log.cc:844] Serialized 14 byte log entry
0709 12:58:14.217404 (+129943us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:14.217463 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:14.217513 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:14.217591 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:14.217766 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13515,"prepare.queue_time_us":8150,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"thread_start_us":1047426,"threads_started":2}
I20260709 12:58:14.201630  1691 rpcz_store.cc:276] 0709 12:58:11.130042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:11.169601 (+ 39559us) service_pool.cc:224] Handling call
0709 12:58:11.277273 (+107672us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:11.277746 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:11.277785 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:11.869623 (+591838us) spinlock_profiling.cc:243] Waited 4.47 ms on lock 0x7b48001c0158. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc861f7aaa1 00007fc861f71b37 00007fc861f719ca 00007fc86206926f 00007fc862068f37 00007fc86207d55c 00007fc86207d508 00007fc86207d488 00007fc86207d443 00007fc86207c6ec 00007fc860fa6a96
0709 12:58:12.325244 (+455621us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b2c00128aa8. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85b94aa11 00007fc85b95a372 00007fc85d08ca01 00007fc85d05143a 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2
0709 12:58:12.325879 (+   635us) log.cc:844] Serialized 26 byte log entry
0709 12:58:13.013659 (+687780us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:13.013710 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:13.013791 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:14.200962 (+1187171us) raft_consensus.cc:1685] finished
0709 12:58:14.200984 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:14.201141 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62952,"raft.queue_time_us":4744,"raft.run_cpu_time_us":4876,"raft.run_wall_time_us":587337,"spinlock_wait_cycles":53004416,"thread_start_us":641219,"threads_started":1,"wal-append.queue_time_us":683947}
I20260709 12:58:14.172415  4837 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:14.150472  4615 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.235212  1689 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:14.216584  4839 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 12:58:14.253436  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:14.256413  1613 raft_consensus.cc:2410] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
W20260709 12:58:14.235829  4845 log.cc:927] Time spent T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 12:58:14.216954  4809 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:14.261605  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 58829.4us
I20260709 12:58:14.262014  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:13.306475  4804 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.325981  4567 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.327436  1535 raft_consensus.cc:2393] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 10: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:14.317888  4615 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:14.317886  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1634) took 1187 ms. Trace:
I20260709 12:58:14.339066  1608 rpcz_store.cc:276] 0709 12:58:13.130954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:13.199456 (+ 68502us) service_pool.cc:224] Handling call
0709 12:58:13.199737 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:13.506066 (+306329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:13.506105 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:13.506150 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:13.506181 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:14.317636 (+811455us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b5400032ad4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:14.317686 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:14.317821 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":704078080}
W20260709 12:58:14.337532  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 118367us
W20260709 12:58:14.340703  1508 connection.cc:256] RPC call timeout handler was delayed by -1.0975236789999485s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21250000000000002s for a response
W20260709 12:58:14.341068  1508 connection.cc:256] RPC call timeout handler was delayed by -1.0885236789999908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2135s for a response
W20260709 12:58:14.341346  1508 connection.cc:256] RPC call timeout handler was delayed by -1.084923678999985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21389999999999998s for a response
I20260709 12:58:14.319082  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1629) took 2343 ms. Trace:
I20260709 12:58:14.342123  1689 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:58:14.343688  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1613) took 1149 ms. Trace:
I20260709 12:58:14.345507  1689 rpcz_store.cc:276] 0709 12:58:13.194266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:14.219578 (+1025312us) service_pool.cc:224] Handling call
0709 12:58:14.235030 (+ 15452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:14.343387 (+108357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:14.343625 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:14.271806  4809 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.169106  4812 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.163599  4847 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.173166  4841 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:14.148547  4778 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:58:14.276139  4751 consensus_meta.cc:287] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 1.467s	user 0.004s	sys 0.005s
I20260709 12:58:14.382165  1440 catalog_manager.cc:5697] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 5 to 8, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New cstate: current_term: 9 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:58:14.327592  4863 log.cc:927] Time spent T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:58:14.317692  4798 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.298169  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1626) took 2323 ms. Trace:
I20260709 12:58:14.303879  4843 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.303915  4479 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:14.285457  4433 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:14.277495  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1874) took 2349 ms. Trace:
W20260709 12:58:14.300781  4725 consensus_meta.cc:287] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 2.361s	user 0.017s	sys 0.000s
I20260709 12:58:14.303236  4870 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:14.282917  4754 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:14.267001  4584 consensus_queue.cc:237] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.278352  2299 raft_consensus.cc:1240] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:14.295753  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:14.301033  4800 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:14.412729  4800 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.268198  4801 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:58:14.402953  4798 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:14.346897  1508 connection.cc:256] RPC call timeout handler was delayed by -1.0534236789999909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2174s for a response
I20260709 12:58:14.271129  1655 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:14.357625  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:14.194144  4846 log.cc:927] Time spent T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
W20260709 12:58:14.389861  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 243211us
W20260709 12:58:14.391197  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:14.420678  1682 raft_consensus.cc:2410] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:14.393141  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:14.312189  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1640) took 1179 ms. Trace:
I20260709 12:58:14.341912  1611 rpcz_store.cc:276] 0709 12:58:11.975563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:12.542297 (+566734us) service_pool.cc:224] Handling call
0709 12:58:12.677428 (+135131us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:12.899886 (+222458us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:12.900122 (+   236us) log.cc:844] Serialized 14 byte log entry
0709 12:58:13.392706 (+492584us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:13.392760 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:13.392811 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:14.318847 (+926036us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b54001f72d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:14.318890 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:14.319017 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35339,"prepare.queue_time_us":572,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":46875,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":95,"spinlock_wait_cycles":770720896,"thread_start_us":492167,"threads_started":1,"wal-append.queue_time_us":1162148}
I20260709 12:58:14.297004  4762 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:14.280036  4866 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.402817  1534 rpcz_store.cc:276] 0709 12:58:11.928538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:11.928647 (+   109us) service_pool.cc:224] Handling call
0709 12:58:11.947309 (+ 18662us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:12.592279 (+644970us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:12.592311 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:12.673541 (+ 81230us) log.cc:844] Serialized 26 byte log entry
0709 12:58:13.876159 (+1202618us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:13.876200 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:13.876267 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:14.277228 (+400961us) raft_consensus.cc:1685] finished
0709 12:58:14.277252 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:14.277403 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":127660,"raft.queue_time_us":565808,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":141573,"thread_start_us":1129837,"threads_started":1,"wal-append.queue_time_us":1339662}
I20260709 12:58:14.397514  1617 rpcz_store.cc:276] 0709 12:58:11.974722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:12.539665 (+564943us) service_pool.cc:224] Handling call
0709 12:58:12.684021 (+144356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:12.901198 (+217177us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:13.278652 (+377454us) log.cc:844] Serialized 14 byte log entry
0709 12:58:14.170478 (+891826us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:14.170527 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:14.170569 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:14.297920 (+127351us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b540032b254. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:14.297972 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:14.298110 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2115,"prepare.queue_time_us":55993,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":2354,"raft.run_wall_time_us":8052,"spinlock_wait_cycles":525366912,"thread_start_us":1162598,"threads_started":2,"wal-append.queue_time_us":912348}
I20260709 12:58:14.293531  4868 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:14.302480  4791 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:14.219080  4848 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.410863  4870 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:14.265400  4859 consensus_queue.cc:1048] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.072s
W20260709 12:58:14.416859  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:14.436693  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:14.403254  4717 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.423203  1613 raft_consensus.cc:2393] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 8: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:14.421783  1616 rpcz_store.cc:276] 0709 12:58:13.132388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:13.343685 (+211297us) service_pool.cc:224] Handling call
0709 12:58:13.439638 (+ 95953us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:13.440057 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:13.440085 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:13.468800 (+ 28715us) log.cc:844] Serialized 52 byte log entry
0709 12:58:14.111970 (+643170us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:14.112015 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:14.112091 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:14.311950 (+199859us) raft_consensus.cc:1685] finished
0709 12:58:14.311970 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:14.312123 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4890,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":33653,"thread_start_us":452521,"threads_started":1,"wal-append.queue_time_us":703333}
I20260709 12:58:14.403306  3947 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:14.405382  4808 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:14.412374  4812 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:14.407323  4751 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:14.380395  4835 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.439946  1611 raft_consensus.cc:1275] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:58:14.446597  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:14.425513  4405 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.425329  4796 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:14.455020  1616 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:14.406529  4843 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.458528  1611 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:58:14.460075  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 195438us
I20260709 12:58:14.460996  1655 leader_election.cc:400] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10.
I20260709 12:58:14.461310  1655 leader_election.cc:403] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:58:14.437034  4754 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:14.431836  4795 consensus_queue.cc:1059] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
W20260709 12:58:14.457468  4613 consensus_meta.cc:287] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 1.228s	user 0.012s	sys 0.000s
I20260709 12:58:14.443653  4726 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:14.449296  4874 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.453397  3947 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:14.443482  4717 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.480693  4847 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:14.483042  4848 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:14.452652  4725 consensus_queue.cc:1059] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:58:14.448108  4866 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.486163  4835 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:14.435546  4791 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:14.454875  4405 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.487876  4870 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:14.488183  4800 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:14.490217  4778 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:14.448698  4808 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:14.508708  4876 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:58:14.491744  4853 log.cc:927] Time spent T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.376s	user 0.000s	sys 0.007s
W20260709 12:58:14.493535  4844 log.cc:927] Time spent T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.458s	user 0.002s	sys 0.009s
I20260709 12:58:14.494097  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1641) took 1329 ms. Trace:
I20260709 12:58:14.533041  1612 rpcz_store.cc:276] 0709 12:58:13.165103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:13.483955 (+318852us) service_pool.cc:224] Handling call
0709 12:58:13.498704 (+ 14749us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:14.059104 (+560400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:14.059135 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:14.061440 (+  2305us) log.cc:844] Serialized 26 byte log entry
0709 12:58:14.391603 (+330163us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:14.391645 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:14.396303 (+  4658us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:14.493832 (+ 97529us) raft_consensus.cc:1685] finished
0709 12:58:14.493857 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:14.494033 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100935,"raft.queue_time_us":433785,"raft.run_cpu_time_us":6030,"raft.run_wall_time_us":26986,"thread_start_us":710551,"threads_started":2,"wal-append.queue_time_us":341638}
I20260709 12:58:14.495461  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:14.535562  1609 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:14.537853  4843 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:14.496462  1611 raft_consensus.cc:1275] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:58:14.541409  4761 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:14.469172  4796 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.541821  4332 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10.
I20260709 12:58:14.497077  4871 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:14.544791  4871 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:14.547641  4871 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:14.497447  3460 raft_consensus.cc:3055] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:14.548739  3460 raft_consensus.cc:740] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:14.548903  4798 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:14.451035  4751 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:14.551544  4751 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:14.553488  4790 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:14.554618  4791 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:14.556512  4866 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:14.557540  4855 log.cc:927] Time spent T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.401s	user 0.004s	sys 0.004s
I20260709 12:58:14.558846  4870 raft_consensus.cc:3055] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:14.559340  4870 raft_consensus.cc:740] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:14.559783  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1873) took 2631 ms. Trace:
I20260709 12:58:14.508101  4726 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:14.506302  4613 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.508114  4874 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.561897  4567 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:14.563344  4874 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:14.518049  4837 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:14.564512  4857 log.cc:927] Time spent T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.426s	user 0.002s	sys 0.003s
I20260709 12:58:14.565557  4796 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:14.566009  4837 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:14.566722  1615 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 11. Current term is 12. Ops: []
W20260709 12:58:14.511535  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 87690.3us
I20260709 12:58:14.569837  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:14.570483  1508 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:14.570926  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:14.571151  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:14.571848  1541 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:14.573876  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:14.576236  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 1.26205e+06us
I20260709 12:58:14.560467  4876 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.578881  4876 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:14.579457  4492 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:14.559928  1505 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:14.526645  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:14.560178  4870 consensus_queue.cc:260] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:14.528851  3947 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:14.529835  4405 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:14.591861  1613 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:14.571727  1508 leader_election.cc:400] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12.
I20260709 12:58:14.581544  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:14.585391  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:14.560150  1539 rpcz_store.cc:276] 0709 12:58:11.928222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:11.928741 (+   519us) service_pool.cc:224] Handling call
0709 12:58:11.929079 (+   338us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:11.948588 (+ 19509us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:12.391613 (+443025us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b1800316600. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f61455 00007fc860a493c7 00007fc85d05b9a7 00007fc85d06b0bf 00007fc85d06b038
0709 12:58:12.433778 (+ 42165us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b1800316600. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f643f3 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd 000000000038f354 000000000038f199 00007fc859f4783a
0709 12:58:12.864158 (+430380us) log.cc:844] Serialized 14 byte log entry
0709 12:58:13.979721 (+1115563us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:14.299426 (+319705us) spinlock_profiling.cc:243] Waited 7.16 ms on lock 0x7b1800316600. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f322a6 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85b94aa11 00007fc85b95a372 00007fc85d08ca01 00007fc85d05143a
0709 12:58:14.299864 (+   438us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b2c00000658. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85b94aa11 00007fc85b95a372 00007fc85d08ca01 00007fc85d05143a 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2
0709 12:58:14.356877 (+ 57013us) log.cc:844] Serialized 52 byte log entry
0709 12:58:14.357072 (+   195us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:14.462309 (+105237us) log.cc:844] Serialized 14 byte log entry
0709 12:58:14.463488 (+  1179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:14.463552 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:14.556915 (+ 93363us) spinlock_profiling.cc:243] Waited 63.9 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:58:14.559498 (+  2583us) raft_consensus.cc:1685] finished
0709 12:58:14.559520 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:14.559694 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":607314,"prepare.queue_time_us":163597,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":81,"raft.queue_time_us":66164,"raft.run_cpu_time_us":431,"raft.run_wall_time_us":51552,"spinlock_wait_cycles":207052416,"thread_start_us":1618038,"threads_started":3,"wal-append.queue_time_us":1187393}
I20260709 12:58:14.581835  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 1895) took 1088 ms. Trace:
I20260709 12:58:14.566650  4809 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:14.530781  4808 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:14.433727  4868 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:14.499359  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:14.594473  1535 rpcz_store.cc:276] 0709 12:58:13.492978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:13.496847 (+  3869us) service_pool.cc:224] Handling call
0709 12:58:14.581639 (+1084792us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b5400246654. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:14.581776 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":933839232}
I20260709 12:58:14.584198  4726 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:14.596417  4868 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:14.597034  1682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 1582) took 2690 ms (client timeout 1548 ms). Trace:
W20260709 12:58:14.597390  1682 rpcz_store.cc:269] 0709 12:58:11.906724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:11.907103 (+   379us) service_pool.cc:224] Handling call
0709 12:58:14.596811 (+2689708us) spinlock_profiling.cc:243] Waited 2.51 s on lock 0x7b5400389354. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:14.596940 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5778603392}
I20260709 12:58:14.589218  4812 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:14.598970  4812 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:14.599232  4840 log.cc:927] Time spent T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.512s	user 0.000s	sys 0.006s
I20260709 12:58:14.599352  4812 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:14.530359  4804 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:14.600099  4804 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:14.600586  4804 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:14.586644  4801 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:14.602182  4717 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:14.584832  4776 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:14.600708  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:14.591682  4613 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:14.588529  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:14.604621  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:14.591563  1542 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:14.598749  4641 raft_consensus.cc:3055] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:14.605748  4641 raft_consensus.cc:740] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:14.580439  4662 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:58:14.606527  4641 consensus_queue.cc:260] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.607751  4641 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:14.608901  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:14.602646  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:14.608907  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:14.610903  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:14.589901  4870 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:14.615626  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 12:58:14.594515  4858 log.cc:927] Time spent T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.420s	user 0.003s	sys 0.004s
I20260709 12:58:14.610630  2267 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:14.617811  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1897) took 1706 ms. Trace:
I20260709 12:58:14.618114  4867 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:14.618254  2267 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:14.618163  1687 rpcz_store.cc:276] 0709 12:58:12.911030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:13.207456 (+296426us) service_pool.cc:224] Handling call
0709 12:58:13.207792 (+   336us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:13.213314 (+  5522us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:13.213360 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:13.213915 (+   555us) log.cc:844] Serialized 52 byte log entry
0709 12:58:14.170116 (+956201us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:14.170163 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:14.170231 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:14.593958 (+423727us) spinlock_profiling.cc:243] Waited 45.7 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:58:14.617543 (+ 23585us) raft_consensus.cc:1685] finished
0709 12:58:14.617563 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:14.617747 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46782,"raft.queue_time_us":4600,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":11137,"spinlock_wait_cycles":105154944,"thread_start_us":955862,"threads_started":1,"wal-append.queue_time_us":913021}
I20260709 12:58:14.621335  4631 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:14.621878  4631 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:14.593565  1508 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:14.623987  4567 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:14.620157  4726 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:14.585409  3460 consensus_queue.cc:260] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.625902  3460 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:14.632980  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:14.634312  4751 consensus_queue.cc:1175] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c262eac7fc904ae9bb91e450f6532e3f" responder_term: 7 status { last_received { term: 7 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 7 index: 5 } }
I20260709 12:58:14.603250  4804 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:14.643592  1615 raft_consensus.cc:1240] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:14.469133   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:14.644966  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:14.645566  1613 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:14.648459  4841 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:14.652977  1581 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:14.653640  4790 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:14.654289  4790 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.631322  4812 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:14.657181  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 80197.2us
I20260709 12:58:14.659466  1583 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:14.660671  4800 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:14.662266  4843 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:14.662678  4843 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:14.663012  4843 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:14.666167  1583 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:14.656332  4790 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:14.674515  4847 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.675027  4847 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.675403  4631 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:14.501909  1654 leader_election.cc:400] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10.
I20260709 12:58:14.675957  1654 leader_election.cc:403] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:58:14.676405  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 174799us
I20260709 12:58:14.678184  4883 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10.
I20260709 12:58:14.678678  4868 consensus_queue.cc:1048] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:14.679096  4883 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:14.680330  4868 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:58:14.674425  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 53963.2us
I20260709 12:58:14.686503  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:14.687501  1611 raft_consensus.cc:2410] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:58:14.688880  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:14.689051  4847 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:14.690827  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:14.691468  1611 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 12:58:14.697177  1581 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:14.698455  1583 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:14.700361  4861 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:14.699160  4837 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:14.696992  4613 consensus_queue.cc:1048] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.003s
W20260709 12:58:14.644579  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 51098.1us
I20260709 12:58:14.703632  1583 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:14.705152  4613 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:14.705760  4613 raft_consensus.cc:697] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:14.706676  4613 consensus_queue.cc:237] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.708577  4797 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:14.709556  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1905) took 1069 ms. Trace:
I20260709 12:58:14.709921  1533 rpcz_store.cc:276] 0709 12:58:13.640036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:14.216459 (+576423us) service_pool.cc:224] Handling call
0709 12:58:14.239169 (+ 22710us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:14.253190 (+ 14021us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:14.253231 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:14.265693 (+ 12462us) log.cc:844] Serialized 26 byte log entry
0709 12:58:14.574480 (+308787us) spinlock_profiling.cc:243] Waited 59.4 ms on lock 0x7b18003b8180. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf10d1 00007fc85d00ca0f
0709 12:58:14.709148 (+134668us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:14.709184 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:14.709247 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:14.709299 (+    52us) raft_consensus.cc:1685] finished
0709 12:58:14.709310 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:14.709500 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13543,"raft.queue_time_us":14365,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":7500,"spinlock_wait_cycles":136681344,"thread_start_us":134481,"threads_started":1,"wal-append.queue_time_us":430152}
I20260709 12:58:14.701077  4631 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:14.715651  4631 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:14.716081  4631 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:14.656366  4812 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:14.724990  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1904) took 1568 ms. Trace:
I20260709 12:58:14.728329  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:14.728607  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:14.729135  1608 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:14.731091  1581 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:14.744547  1581 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:14.755079  4837 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:14.735176  1508 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:14.737303  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:14.738381  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:14.739615  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:14.741189  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:14.758999  1611 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:14.743119  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:14.733445  4751 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:14.745240  4841 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:58:14.748561  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 287728us
I20260709 12:58:14.766911  1655 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:14.768318  1655 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:14.749686  1542 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:14.750341  4871 consensus_queue.cc:1059] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:58:14.750988  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 68598.4us
W20260709 12:58:14.764304  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 50424.5us
I20260709 12:58:14.780781  1687 raft_consensus.cc:1275] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:58:14.783074  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:14.785622  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:14.786378  1682 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:14.788522  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:14.792533  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:14.774068  1581 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:14.793845  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:14.794445  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:14.727851  1683 rpcz_store.cc:276] 0709 12:58:13.156538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:14.218276 (+1061738us) service_pool.cc:224] Handling call
0709 12:58:14.218615 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:14.218866 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:14.236268 (+ 17402us) log.cc:844] Serialized 14 byte log entry
0709 12:58:14.724608 (+488340us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:14.724659 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:14.724717 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:14.724801 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:14.724929 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5049,"prepare.queue_time_us":17199,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":108,"raft.queue_time_us":46687,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":2817,"thread_start_us":487862,"threads_started":2,"wal-append.queue_time_us":225744}
I20260709 12:58:14.797777  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:14.798454  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:14.800374  1685 raft_consensus.cc:2410] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:14.800673  3460 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:58:14.801805  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 66706.7us
I20260709 12:58:14.802695  1581 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:14.805820  1581 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:14.806238  1508 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:14.804692  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:14.809209  1689 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:14.773139  1613 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:14.813925  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:14.815802  1691 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:58:14.815744  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:14.798503  1683 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:14.814677  1685 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:14.822806  1689 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:58:14.825711  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:14.826687  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:14.828111  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:14.829421  1508 leader_election.cc:400] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12.
I20260709 12:58:14.829819  1508 leader_election.cc:403] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:58:14.799773  4885 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:14.833966  3460 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12.
I20260709 12:58:14.834980  1690 raft_consensus.cc:2393] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 8: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 12:58:14.834898  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 66675.3us
I20260709 12:58:14.837433  1655 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:14.837694  1581 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:14.828890  4433 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:14.839514  4433 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:14.839877  4433 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:14.815667  4615 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:14.840832  4615 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:14.841185  4615 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:14.825450  4812 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:58:14.724344  4631 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.844697  4790 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:14.827768  4800 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:14.765709  4841 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:14.827991  3947 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:14.845588  4841 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:14.846153  4726 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.846650  4726 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:14.847561  4433 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.848680  4800 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:14.804350  4902 log.cc:927] Time spent T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.052s	user 0.003s	sys 0.000s
I20260709 12:58:14.849074  4800 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:14.849509  4871 raft_consensus.cc:3055] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:14.849900  4871 raft_consensus.cc:740] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:14.850729  4871 consensus_queue.cc:260] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.851883  4871 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:14.834585  4843 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.844969  4884 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:14.852805  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:14.853641  2299 raft_consensus.cc:2393] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 7: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:58:14.854393  4843 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:14.845204  4790 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:14.855510  4790 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:14.816939  4870 consensus_queue.cc:1059] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.049s
W20260709 12:58:14.852651  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 73992.9us
I20260709 12:58:14.834260  4804 consensus_queue.cc:1048] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:58:14.861783  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:14.858407  1581 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:14.858461  1505 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:14.875600  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:14.876401  1685 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:14.875803  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:14.856405  4870 raft_consensus.cc:3055] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:14.879422  4870 raft_consensus.cc:740] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:14.880578  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:14.880306  4870 consensus_queue.cc:260] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.881212  4726 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:14.881794  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:14.883030  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:14.883599  1690 raft_consensus.cc:1275] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:14.879594  4641 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.884940  4870 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:14.886101  4433 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:14.886984  4641 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:14.888981  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:14.889876  1690 raft_consensus.cc:2410] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:58:14.889746  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:14.891238  1615 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10. Ops: []
W20260709 12:58:14.893023  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:14.902064  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:14.902493  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:14.894163  4405 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:14.894353  1505 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:14.884663  4847 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:14.878756  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:14.914065  1685 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:14.897809  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 60443.6us
I20260709 12:58:14.898367  4884 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:58:14.925570  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 67242.7us
I20260709 12:58:14.925721  1508 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:14.915061  1505 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:14.904753  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:14.926003  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:14.927472  1505 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:14.927665  1610 raft_consensus.cc:1240] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:14.929157  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:14.906281  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:14.914908  3460 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:14.918407  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:14.930966  1686 raft_consensus.cc:2410] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:58:14.919586  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:14.932155  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:14.920868  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:14.933923  1689 raft_consensus.cc:2410] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:58:14.934484  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:14.935992  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:14.932843  1691 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:58:14.939369  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:14.922044  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:14.942533  1682 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:14.929896  1537 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:14.940303  1690 raft_consensus.cc:2393] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 10: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:14.947065  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:14.947984  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:14.948040  1505 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:14.948691  1688 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:14.949182  1505 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:58:14.952749  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:14.950310  1505 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:14.954475  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:14.956612  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:14.956748  1655 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:14.958431  1683 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 10: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:14.886385  4631 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:14.909793  4405 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:14.983628  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 44796us
I20260709 12:58:14.977557  1689 raft_consensus.cc:2410] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:58:14.974632  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:14.973827  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:14.984790  1533 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:14.984925  1541 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:14.959478  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:14.986410  1617 raft_consensus.cc:2410] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:58:14.959223  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:14.992836  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:14.991822  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:14.934744  4771 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.104s	user 0.025s	sys 0.059s
W20260709 12:58:15.014281  4771 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.196s	user 0.026s	sys 0.059s
I20260709 12:58:14.946399  4567 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:15.018643  1537 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:14.950400  4868 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.022305  1581 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:14.934325  4871 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:15.018697  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:14.938174  4751 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:15.025498  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:14.954797  4479 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:14.958750  4861 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:58:15.031632  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:14.958585  4796 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:14.959394  4809 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:15.037654  1685 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:14.973383  4874 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.041455  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:15.021185  4567 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:15.082785  1683 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
W20260709 12:58:15.037902  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 78492.5us
I20260709 12:58:14.946724  4801 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 12:58:15.050863  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:14.982470  4795 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:58:15.052881  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 96251.9us
I20260709 12:58:14.993495  4405 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:14.950062  4717 consensus_queue.cc:1048] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.080s
I20260709 12:58:15.057514  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:15.117339  1542 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:15.117365  1583 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:14.989115  4754 raft_consensus.cc:697] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 12 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:14.938953  4847 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:15.061506  1654 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:15.072962  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 50743.7us
I20260709 12:58:15.060720  1508 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:15.129774  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 69169.2us
I20260709 12:58:14.954897  4876 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:15.105417  4567 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:14.973229  4790 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:15.106637  1541 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:15.163718  4790 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:15.161403  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:15.166100  1541 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:15.099807  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:15.052111  4868 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:15.169520  1613 raft_consensus.cc:2410] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:58:15.112228  1655 leader_election.cc:400] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 7. Current term is 8.
I20260709 12:58:15.102567  4874 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:15.170892  1655 leader_election.cc:403] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:58:15.172166  4887 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 7. Current term is 8.
I20260709 12:58:15.112215  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:15.080336  4796 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:15.072841  4843 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:15.174219  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:15.174553  4843 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:15.174232  4796 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:15.082520  4845 log.cc:927] Time spent T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:58:15.099368  4825 log.cc:927] Time spent T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:58:15.104193  4861 raft_consensus.cc:697] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:58:15.108804  4873 log.cc:927] Time spent T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:58:15.099689  4591 raft_consensus.cc:2764] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 12:58:15.103928  4761 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:15.133925  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:15.178937  4861 consensus_queue.cc:237] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:15.180181  4837 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:15.180714  4876 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:15.182556  1689 raft_consensus.cc:2410] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:58:15.110679  4798 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:58:15.183281  4837 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:15.183758  4837 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:15.070721  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:15.082443  4776 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:15.185281  4776 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:58:15.134830  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 73395.3us
I20260709 12:58:15.185040  1682 raft_consensus.cc:2410] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:58:15.187031  1654 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:15.187516  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:15.139149  4754 consensus_queue.cc:237] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:15.188503  1690 raft_consensus.cc:2410] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:15.180105  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:15.189489  1688 raft_consensus.cc:2376] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9. Re-sending same reply.
I20260709 12:58:15.194170  1685 raft_consensus.cc:2376] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10. Re-sending same reply.
I20260709 12:58:15.140144  4847 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:15.142401  4479 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:15.033052  4871 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:15.216861  4887 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:15.149899  4641 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:15.153069  1608 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:58:15.128373  4795 raft_consensus.cc:697] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:15.219947  4795 consensus_queue.cc:237] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:15.222229  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:15.148590  4492 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:15.177668  4903 consensus_queue.cc:1048] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:58:15.208662  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 96600.1us
I20260709 12:58:15.265478  1655 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:15.209278  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 92015.5us
I20260709 12:58:15.266705  1583 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:15.103482  4841 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:15.268278  1654 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:15.215134  1687 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:15.215632  1533 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:15.167898  4615 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:15.234717  1541 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:15.310916  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1265) took 1318 ms. Trace:
I20260709 12:58:15.267063  4903 consensus_queue.cc:1243] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:58:15.324287  4835 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:15.335482  1542 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:15.340552  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:15.329175  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 62564.8us
I20260709 12:58:15.344189  1614 raft_consensus.cc:2393] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 10: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:15.345553  1583 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:15.339757  1610 rpcz_store.cc:276] 0709 12:58:13.992450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:14.314331 (+321881us) service_pool.cc:224] Handling call
0709 12:58:14.314700 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:14.938347 (+623647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:15.310639 (+372292us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b54000023d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:15.310847 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1409340288}
I20260709 12:58:15.285984  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:15.347219  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 81887.9us
I20260709 12:58:15.347702  1583 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:15.342386  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:15.348798  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:15.342615  1682 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:15.352507  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:15.352978  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:15.353168  1617 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:58:15.351575  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:15.354249  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:15.354687  1682 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
W20260709 12:58:15.349437  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:15.342283  4905 log.cc:927] Time spent T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
W20260709 12:58:15.356698  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:15.307567  4870 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:15.357661  4433 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:15.358342  4843 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:15.307361  4887 consensus_queue.cc:1059] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:58:15.308017  4847 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:15.359004  4912 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:15.359750  4776 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:15.361639  4911 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:58:15.362563  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:15.363658  1583 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:15.364372  4405 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:15.366400  4800 consensus_meta.cc:287] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.000s
I20260709 12:58:15.391764  4800 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:15.394162  4800 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:15.395135  1611 raft_consensus.cc:1240] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:58:15.394835  4796 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:15.397254  1583 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:15.398581  4841 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:15.399013  4433 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:15.399289  4841 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:15.399752  4841 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:15.400144  4841 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:15.398531  1583 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:15.369375  2266 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:15.369798  1655 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:15.371070  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:15.371564  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:15.357184  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:15.402869  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:15.379019  1508 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:15.361953  4567 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:15.407757  1508 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:15.340166  4871 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:15.388185  4874 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:15.390498  4405 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:15.391053  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:15.414090  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:15.420292  1583 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:15.423245  1583 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:15.401577  4433 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:15.418434  1691 raft_consensus.cc:2376] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10. Re-sending same reply.
I20260709 12:58:15.430950  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:15.431953  1583 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:58:15.405004  4778 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:15.407063  4887 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:15.408888  4641 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:15.432194  4433 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:15.440017  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:15.440446  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 70703.5us
I20260709 12:58:15.443404  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:15.444886  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:15.429700  4912 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:15.429173  4903 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:15.442065  4911 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:15.467969  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:15.441016  4868 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:15.434741  4800 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:15.480254  4912 raft_consensus.cc:697] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:15.434536  4776 consensus_queue.cc:1048] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:58:15.481972  4796 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:15.482509  4615 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:15.489866  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 82207.1us
I20260709 12:58:15.462219  1685 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:15.500591  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:15.501617  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 85926.3us
W20260709 12:58:15.502146  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 57029us
I20260709 12:58:15.492687  4800 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:15.502683  1655 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:15.490491  4662 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:58:15.529448  4889 log.cc:927] Time spent T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
I20260709 12:58:15.529608  4837 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:15.531795  4837 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:15.487673  4567 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:15.534273  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:15.535429  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:15.520594  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:15.537148  1691 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:58:15.535878  4433 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:15.540129  4433 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:15.542845  4876 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:15.509871  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:15.502765  1508 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:15.526821  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:15.490836  4911 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:15.545048  4912 consensus_queue.cc:237] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:15.545990  4911 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:15.545708  1685 raft_consensus.cc:2410] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:58:15.555594  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 61576.3us
I20260709 12:58:15.556954  1655 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:15.557859  4887 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:15.558230  4641 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:15.558748  4874 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:15.524636  1686 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:15.551824  4841 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:15.544875  4492 raft_consensus.cc:3055] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:15.558284  1655 leader_election.cc:400] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 8. Current term is 9.
W20260709 12:58:15.563330  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 60659.9us
I20260709 12:58:15.566062  1508 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:15.569639  3460 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:15.527169  4800 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:15.571702  1508 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:15.558382  4887 raft_consensus.cc:697] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:15.577378  1655 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:15.579136  3460 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:15.563640  4492 raft_consensus.cc:740] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:15.581178  1508 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:15.583328  1508 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:15.595845  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:15.600812  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:15.601660  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:15.603438  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:15.580530  4847 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:15.605816  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:15.595314  1583 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:15.608085  1539 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:15.608654  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:15.609865  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:15.610216  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:15.610508  1541 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:58:15.611304  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:15.585651  4641 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:15.596434  4754 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:15.613287  4754 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:15.614008  4776 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:15.614440  4776 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:15.614799  4776 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:15.592242  4567 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:15.613336  1534 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 11. Ops: []
W20260709 12:58:15.619872  4900 log.cc:927] Time spent T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6: Append to log took a long time: real 0.463s	user 0.000s	sys 0.004s
I20260709 12:58:15.620702  4841 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:15.583789  4868 consensus_queue.cc:1048] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:58:15.622566  4641 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:15.623054  4641 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:15.578133  4876 consensus_queue.cc:1048] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:58:15.629870  4887 consensus_queue.cc:237] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:15.580775  4874 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:58:15.632789  4874 consensus_queue.cc:1243] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:58:15.634611  1539 raft_consensus.cc:1240] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 11. Current term is 12. Ops: [9.6-11.7]
W20260709 12:58:15.635298  4892 log.cc:927] Time spent T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.494s	user 0.002s	sys 0.000s
I20260709 12:58:15.622924  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:15.638350  1687 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:15.639673  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:15.641181  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:15.641942  1655 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:15.643016  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 47786.8us
I20260709 12:58:15.643450  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:15.643982  1654 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:15.645597  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:15.645795  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:15.646101  1583 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:15.645007  1655 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:15.647162  1533 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:15.648797  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:15.649425  1684 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:58:15.649993  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 56549.4us
I20260709 12:58:15.658396  1655 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:15.659030  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:15.660319  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:15.660319  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:15.670954  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:15.648635  4847 consensus_queue.cc:1059] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:58:15.680413  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:15.682305  1684 raft_consensus.cc:2410] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:58:15.681568  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:15.683521  1610 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:58:15.654036  4884 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:15.699694  4871 raft_consensus.cc:2764] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:58:15.690630  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:15.699159  1615 raft_consensus.cc:1240] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:15.690949  1687 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:15.669087  4662 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:15.672206  4874 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:15.706403  1583 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:15.681667  4843 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:15.718585  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:15.721494  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:15.723744  1610 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:15.724852  1612 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:15.654557  4866 consensus_queue.cc:1059] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:58:15.669423  4911 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:15.716266  4615 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:15.730129  1612 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:15.734575  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:15.739045  1615 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:15.742828  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:15.751972  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:15.760004  4911 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:15.761526  4903 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:15.764945  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:58:15.768839  4866 consensus_queue.cc:1243] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer c262eac7fc904ae9bb91e450f6532e3f log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:58:15.770278  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:15.799060  2299 raft_consensus.cc:2393] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 7: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:58:15.799525  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:15.770046  4641 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:15.771054  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:15.771559  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:15.804987  1540 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:58:15.771762  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:15.772428  1609 raft_consensus.cc:1240] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:15.772784  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:15.773455  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:15.774147  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:15.806586  1610 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:15.774806  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:15.784896  4800 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:15.708590  4776 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:15.722275  4662 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:15.792069  1615 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
W20260709 12:58:15.795414  4928 log.cc:927] Time spent T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.182s	user 0.000s	sys 0.002s
I20260709 12:58:15.802260  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:15.803807  1655 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:15.854614  1534 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
W20260709 12:58:15.854988  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 51263.5us
I20260709 12:58:15.757157  4615 raft_consensus.cc:697] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:15.828277  1535 raft_consensus.cc:2393] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 8: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:15.829860  1541 pending_rounds.cc:85] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 3
I20260709 12:58:15.835052  1533 raft_consensus.cc:1240] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:58:15.857666  1541 pending_rounds.cc:107] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 12:58:15.857999  1541 raft_consensus.cc:2889] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:15.858465  1539 raft_consensus.cc:1240] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 11. Ops: []
W20260709 12:58:15.853161  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 105939us
I20260709 12:58:15.669318  4876 consensus_queue.cc:1059] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 12:58:15.855747  1655 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:15.860407  1508 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:15.866215  1616 raft_consensus.cc:1240] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:15.868886  1542 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:58:15.869314  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:15.870421  1611 raft_consensus.cc:2393] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 11: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:15.872116  1654 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:15.872459  1508 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:15.878132  1508 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:15.859462  4943 raft_consensus.cc:2764] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:58:15.868816  4859 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.007s	sys 0.027s
I20260709 12:58:15.882959  3460 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:15.883704  1505 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:15.875977  4907 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:15.886531  1508 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:15.890156  1505 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:58:15.884027  4859 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.007s	sys 0.028s
I20260709 12:58:15.914709  4641 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:15.878629  4801 consensus_queue.cc:1059] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:58:15.915503  4882 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:15.915921  4615 consensus_queue.cc:237] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:15.918017  4776 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:15.886122  4940 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:15.881057  4812 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:15.892290  4876 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:15.932356  4800 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:15.884809  4909 consensus_queue.cc:1059] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:58:15.889376  4887 consensus_queue.cc:1059] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
W20260709 12:58:15.971889  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 81803.1us
W20260709 12:58:15.985112  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 69723.9us
I20260709 12:58:16.014029  1508 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:15.985746  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 58628us
W20260709 12:58:15.997066  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 125001us
I20260709 12:58:15.976882  4910 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:58:15.999547  4936 log.cc:927] Time spent T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 12:58:16.018910  1610 raft_consensus.cc:1240] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 10. Current term is 11. Ops: []
W20260709 12:58:16.016242  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 145373us
I20260709 12:58:16.020370  1611 raft_consensus.cc:1275] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:58:15.999449  4717 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:58:16.011534  4876 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:16.011252  4882 raft_consensus.cc:697] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:16.027383  1655 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:16.027311  1508 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:16.026283  3460 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:16.029325  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:16.031424  4950 consensus_queue.cc:1059] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:16.029978  4870 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:16.036197  4662 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:16.039286  4882 consensus_queue.cc:237] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:16.027240  4887 consensus_queue.cc:1059] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:58:16.042971  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:16.043292  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:16.044044  1687 raft_consensus.cc:2368] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 10. Current term is 11.
I20260709 12:58:16.044386  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:16.050097  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:16.051292  1687 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:16.056066  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:16.057538  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:16.064349  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:16.064764  1690 pending_rounds.cc:85] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 5
I20260709 12:58:16.065171  1690 pending_rounds.cc:107] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:58:16.026001  4876 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:16.065464  1690 raft_consensus.cc:2889] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:16.065436  1615 raft_consensus.cc:1217] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Deduplicated request from leader. Original: 9.6->[11.7-11.7]   Dedup: 11.7->[]
I20260709 12:58:16.066800  1615 raft_consensus.cc:1240] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:58:16.067299  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:16.027592  4910 raft_consensus.cc:697] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:16.071677  1508 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:16.050136  4919 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:16.118312  1682 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:58:16.079496  1583 leader_election.cc:400] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 10. Current term is 11.
I20260709 12:58:16.125778  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:16.071861  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:16.126642  1689 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:16.120189  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 92881.7us
I20260709 12:58:16.126082  1583 leader_election.cc:403] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 12:58:16.123924  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 52334.5us
I20260709 12:58:16.117456  4950 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:16.120025  4405 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:58:16.128261  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 58495.1us
I20260709 12:58:16.122303  4919 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:16.128918  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1668) took 1348 ms. Trace:
I20260709 12:58:16.126864  4882 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:16.129347  1687 raft_consensus.cc:2410] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:16.127015  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:16.153142  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:16.153707  1682 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:16.128789  1655 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:16.147766  1614 rpcz_store.cc:276] 0709 12:58:14.780309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:14.780773 (+   464us) service_pool.cc:224] Handling call
0709 12:58:16.128695 (+1347922us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b54002a62d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:16.128860 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1187465600}
I20260709 12:58:16.129127  1613 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:58:16.131738  4762 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 10. Current term is 11.
I20260709 12:58:16.156368  1655 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:16.159380  1689 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:16.161212  1689 raft_consensus.cc:1275] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:58:16.150697  4919 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:16.164426  1655 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:16.174089  1682 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:16.175915  1682 raft_consensus.cc:1275] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:16.180647  1583 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:58:16.157169  4943 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:16.172524  4847 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:16.193994  1583 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:16.185127  4843 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:58:16.185796  4954 log.cc:927] Time spent T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:58:16.198546  4615 consensus_queue.cc:1048] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:58:16.198530  4762 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:16.207159  4762 raft_consensus.cc:697] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:16.207687  1612 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:16.208086  4762 consensus_queue.cc:237] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:16.189026  4887 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:58:16.221809  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 57456.7us
I20260709 12:58:16.193025  4911 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:58:16.224928  1612 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:16.227788  1583 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:16.233700  1655 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:16.232724  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1642) took 1174 ms. Trace:
I20260709 12:58:16.157229  4910 consensus_queue.cc:237] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:16.241349  4887 consensus_queue.cc:1059] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:16.243070  4887 raft_consensus.cc:3055] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:16.243517  4887 raft_consensus.cc:740] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:16.246348  1655 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:16.249765  1655 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:16.251166  1655 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:16.237396  1691 rpcz_store.cc:276] 0709 12:58:15.058537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:15.540699 (+482162us) service_pool.cc:224] Handling call
0709 12:58:15.541053 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:15.578663 (+ 37610us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:15.578697 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:15.583284 (+  4587us) log.cc:844] Serialized 26 byte log entry
0709 12:58:15.831396 (+248112us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:16.229924 (+398528us) log.cc:844] Serialized 14 byte log entry
0709 12:58:16.232267 (+  2343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:16.232354 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:16.232394 (+    40us) raft_consensus.cc:1685] finished
0709 12:58:16.232407 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:16.232650 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37144,"prepare.queue_time_us":198679,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":37318,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":2794,"thread_start_us":588371,"threads_started":2,"wal-append.queue_time_us":234685}
I20260709 12:58:16.263055  1655 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:16.248118  4847 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:16.313664  4847 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:16.316268  1505 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:16.281021  4959 log.cc:927] Time spent T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:58:16.281523  4940 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:16.238478  4843 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:16.238979  4800 consensus_queue.cc:1048] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:58:16.289763  4943 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:16.253298  4953 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:58:16.290555  4915 log.cc:927] Time spent T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:58:16.290812  4958 log.cc:927] Time spent T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.117s	user 0.002s	sys 0.000s
I20260709 12:58:16.232969  4911 raft_consensus.cc:697] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:16.294806  1686 raft_consensus.cc:1240] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 10. Current term is 11. Ops: [8.6-10.7]
I20260709 12:58:16.295712  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1926) took 1350 ms. Trace:
I20260709 12:58:16.297039  4631 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:16.301112  4492 consensus_queue.cc:260] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:16.244374  4887 consensus_queue.cc:260] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:16.309715  4859 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.310241  4909 consensus_queue.cc:1059] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:16.277483  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1280) took 1401 ms. Trace:
W20260709 12:58:16.313743  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 50768.8us
W20260709 12:58:16.322830  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 156823us
I20260709 12:58:16.321807  4479 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:16.328153  1538 rpcz_store.cc:276] 0709 12:58:14.945696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:15.164942 (+219246us) service_pool.cc:224] Handling call
0709 12:58:15.165277 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:15.223277 (+ 58000us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:15.566861 (+343584us) log.cc:844] Serialized 14 byte log entry
0709 12:58:15.567082 (+   221us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:15.567125 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:15.567168 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:16.295454 (+728286us) spinlock_profiling.cc:243] Waited 57.7 ms on lock 0x7b54002e8e54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:16.295511 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:16.295653 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":253234,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":87,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":76,"spinlock_wait_cycles":133114368,"thread_start_us":343253,"threads_started":1,"wal-append.queue_time_us":10149}
I20260709 12:58:16.342968  1609 rpcz_store.cc:276] 0709 12:58:14.875804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:14.994502 (+118698us) service_pool.cc:224] Handling call
0709 12:58:15.643525 (+649023us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b5800091e98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc86202afc0 00007fc862015929 00007fc8620153d2 00007fc85b58cbd4
0709 12:58:15.643732 (+   207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:15.805920 (+162188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:16.277198 (+471278us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400444b54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:16.277398 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":333995776}
I20260709 12:58:16.308284  4919 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:16.343451  1655 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:16.292393  4876 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:16.322983  3947 consensus_queue.cc:1048] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:58:16.337982  4843 raft_consensus.cc:697] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:16.360656  1655 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:16.363057  1655 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:16.366797  4940 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:16.356402  4492 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:16.342386  4631 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:16.375016  4631 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:16.375283  4957 log.cc:927] Time spent T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 12:58:16.382241  1655 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:16.383762  1655 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:16.384639  4940 raft_consensus.cc:2764] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:58:16.384891  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:16.386799  4950 consensus_queue.cc:1059] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:16.387837  4847 raft_consensus.cc:3055] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:16.388226  4847 raft_consensus.cc:740] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:16.389098  4911 consensus_queue.cc:237] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:16.389139  4847 consensus_queue.cc:260] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:16.390766  4847 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:16.391427  1688 raft_consensus.cc:3055] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:16.391819  1688 raft_consensus.cc:740] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:16.393221  1688 consensus_queue.cc:260] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:16.394956  1688 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:16.396733  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:16.399223  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:16.358698  4887 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:16.400945  4884 raft_consensus.cc:3055] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:16.401094  1611 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:16.401434  4884 raft_consensus.cc:740] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:16.402371  4884 consensus_queue.cc:260] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:16.403751  4884 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:16.406754  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:16.408687  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:16.414156  1539 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:58:16.394047  1655 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:16.417160  4492 consensus_queue.cc:1059] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:16.418608  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:16.419910  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:16.420745  4843 consensus_queue.cc:237] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:16.425241  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:16.426074  1536 raft_consensus.cc:2393] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 10: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:16.426849  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:16.427695  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:16.428261  1534 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:16.415809  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:16.430303  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:16.431643  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:16.431798  1609 raft_consensus.cc:1240] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:58:16.433935  4591 consensus_queue.cc:1059] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:16.393090  4943 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:16.427736  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:16.441098  4943 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.349167  4859 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:16.441627  4943 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:16.442735  1541 raft_consensus.cc:1240] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:16.443836  4859 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:16.429189  1611 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:16.445642  4919 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:16.445492  1534 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:16.431367  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:16.436246  1542 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:16.364948  4885 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:16.457597  1688 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:58:16.458925  1508 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:16.459908  1688 raft_consensus.cc:1240] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:16.459736  3947 consensus_queue.cc:1059] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:16.461666  1541 raft_consensus.cc:1240] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:16.463315  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:16.463789  1533 raft_consensus.cc:1275] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:16.463941  1611 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:16.467186  1535 raft_consensus.cc:1240] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 12:58:16.467530  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:16.462822  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:16.471181  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:16.471791  1611 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:16.471638  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:16.472729  1609 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:16.471626  1508 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:16.476248  1654 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:16.474951  1505 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:16.492651  1542 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:16.494304  1536 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:16.458343  4876 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:16.506378  1611 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:58:16.511058  4567 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:16.511554  4567 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:16.511896  4567 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:16.515606  4751 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:16.516860  3947 consensus_queue.cc:1059] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:16.527990  3947 raft_consensus.cc:3055] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:16.528663  3947 raft_consensus.cc:740] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:16.530273  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:16.530957  1685 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:16.532114  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:16.498457  4885 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:16.495672  4812 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:16.490590  4965 consensus_queue.cc:1059] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:58:16.534030  4938 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:16.537089  1617 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:58:16.551622  3460 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:16.531790  3947 consensus_queue.cc:260] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:16.507087  4662 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:58:16.555527  4812 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:16.536168  4885 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:16.557173  4885 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:16.537631  4859 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:16.558907  4859 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:16.563467  4859 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:16.554992  3947 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:16.571250  4812 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:16.572175  4948 raft_consensus.cc:3055] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:16.572819  4948 raft_consensus.cc:740] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:16.573840  4948 consensus_queue.cc:260] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:16.585227  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:16.582805  1609 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:16.587924  1540 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:16.588893  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:16.594568  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:16.595990  1581 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:16.596702  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:16.575423  4948 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:16.606084  1538 raft_consensus.cc:1275] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:58:16.586877  4925 log.cc:927] Time spent T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.974s	user 0.004s	sys 0.002s
I20260709 12:58:16.612000  4939 consensus_queue.cc:1059] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:58:16.614679  4965 consensus_queue.cc:1243] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer c262eac7fc904ae9bb91e450f6532e3f log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:58:16.616045  1581 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:16.619778  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:16.626189  1581 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:16.623780  1540 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:58:16.620069  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:16.633881  1542 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:16.635579  1536 raft_consensus.cc:1275] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:58:16.637610  1581 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:16.631417  1655 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:16.644867  4965 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:16.645463  4965 raft_consensus.cc:697] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:16.646349  4965 consensus_queue.cc:237] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:16.615607  4939 raft_consensus.cc:3055] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:16.616201  4903 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:16.600037  4812 consensus_queue.cc:1059] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:58:16.666848  1581 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:16.666123  4776 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:16.666788  4939 raft_consensus.cc:740] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:16.686213  4939 consensus_queue.cc:260] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:16.687580  4939 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:16.689657  4754 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:16.656594  4615 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:16.699693  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:16.679772  4567 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:16.702044  1508 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:16.703835  1609 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:16.700910  4800 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:16.720078  4910 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:16.721760  4843 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:16.721591  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:16.724447  1691 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:58:16.725432  1691 pending_rounds.cc:85] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 3
I20260709 12:58:16.725658  1691 pending_rounds.cc:107] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:58:16.725870  1691 raft_consensus.cc:2889] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:16.727419  1691 raft_consensus.cc:1275] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:58:16.624333  4870 consensus_queue.cc:1059] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:58:16.710127  1654 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:16.663375  4797 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:16.740700  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:16.746696  1508 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:16.750823  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:16.754635  4987 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:16.781783  1508 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:16.727350  4809 raft_consensus.cc:3055] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:16.783298  3460 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:16.784154  3947 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:58:16.799989  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:16.736110  4615 raft_consensus.cc:697] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:16.808912  1684 raft_consensus.cc:1275] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:58:16.785346  4809 raft_consensus.cc:740] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:16.802141  4908 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:16.743022  4910 consensus_queue.cc:1059] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 12:58:16.748453  4843 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:16.802263  4917 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:58:16.827986  4874 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 12:58:16.803604  4859 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
W20260709 12:58:16.858655  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 126225us
I20260709 12:58:16.830708  4797 raft_consensus.cc:697] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:16.850761  4776 raft_consensus.cc:697] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:16.883278  4615 consensus_queue.cc:237] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:16.844187  4917 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:16.908834  4800 raft_consensus.cc:697] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:16.922412  4797 consensus_queue.cc:237] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:16.923645  4917 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:16.927244  4567 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:16.885416  4809 consensus_queue.cc:260] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:16.938326  4891 log.cc:927] Time spent T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 1.777s	user 0.004s	sys 0.008s
I20260709 12:58:16.938802  4776 consensus_queue.cc:237] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:16.940873  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1671) took 1284 ms. Trace:
I20260709 12:58:16.945338  1608 rpcz_store.cc:276] 0709 12:58:15.656844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:15.660413 (+  3569us) service_pool.cc:224] Handling call
0709 12:58:15.660792 (+   379us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:15.671050 (+ 10258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:15.671083 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:15.696758 (+ 25675us) log.cc:844] Serialized 52 byte log entry
0709 12:58:16.686284 (+989526us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b18002f3560. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf10d1 00007fc85d00ca0f
0709 12:58:16.837729 (+151445us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:16.837768 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:16.838782 (+  1014us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:16.940227 (+101445us) raft_consensus.cc:1685] finished
0709 12:58:16.940247 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:16.940801 (+   554us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13412,"raft.queue_time_us":18875,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":13736,"spinlock_wait_cycles":8530688,"thread_start_us":151253,"threads_started":1,"wal-append.queue_time_us":1201114}
I20260709 12:58:16.955423  4800 consensus_queue.cc:237] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:16.933200  4843 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:16.961211  4938 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:16.961774  4938 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:16.952098  4994 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:58:16.976287  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:16.948210  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 12:58:17.004877  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 261388us
I20260709 12:58:17.006215  1581 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:16.986012  4809 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:17.010788  1581 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:17.012080  1581 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:17.019096  1583 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
W20260709 12:58:17.029386  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:17.010097  4982 log.cc:927] Time spent T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
W20260709 12:58:17.141974  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 129977us
I20260709 12:58:17.152355  1581 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:17.000867  4866 raft_consensus.cc:3055] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:58:17.199965  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 181147us
W20260709 12:58:17.206523  4979 log.cc:927] Time spent T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.346s	user 0.001s	sys 0.000s
W20260709 12:58:17.221165  1436 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54590 (request call id 141) took 28380 ms (client timeout 15000 ms). Trace:
I20260709 12:58:17.212442  4843 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:17.195060  4804 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:17.197904  4866 raft_consensus.cc:740] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:16.999080  4996 consensus_queue.cc:1048] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.216s
W20260709 12:58:17.231660  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:17.232121  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 221) took 1671 ms. Trace:
I20260709 12:58:17.232550  1537 rpcz_store.cc:276] 0709 12:58:15.560516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:15.560943 (+   427us) service_pool.cc:224] Handling call
0709 12:58:15.561288 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:16.245139 (+683851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:16.245171 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:16.245221 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:16.245249 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:17.231897 (+986648us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b540010c7d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:17.231942 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:17.232067 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1572282240}
I20260709 12:58:17.204507  4999 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:17.212913  5000 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:58:17.234396  4988 log.cc:927] Time spent T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.321s	user 0.000s	sys 0.001s
W20260709 12:58:17.249046  4997 log.cc:927] Time spent T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
W20260709 12:58:17.254359  4998 log.cc:927] Time spent T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 12:58:17.255560  5001 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:17.257740  4990 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:17.262063  1691 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:58:17.264894  4986 log.cc:927] Time spent T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.325s	user 0.001s	sys 0.000s
I20260709 12:58:17.236696  4965 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:17.285753  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1672) took 1628 ms. Trace:
I20260709 12:58:17.286194  1616 rpcz_store.cc:276] 0709 12:58:15.657126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:15.661156 (+  4030us) service_pool.cc:224] Handling call
0709 12:58:15.661463 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:15.866699 (+205236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:17.285519 (+1418820us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54004470d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:17.285695 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470506368}
I20260709 12:58:17.243355  4948 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 12:58:17.277752  4885 consensus_meta.cc:287] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.720s	user 0.010s	sys 0.003s
I20260709 12:58:17.292977  4965 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:17.301456  4798 raft_consensus.cc:3055] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:17.302167  4798 raft_consensus.cc:740] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:17.239589  4804 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:17.290299  4859 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.301465  4965 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:58:17.224399  1436 rpcz_store.cc:269] 0709 12:57:48.840494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:57:48.840819 (+   325us) service_pool.cc:224] Handling call
0709 12:58:17.220892 (+28380073us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:08.802598 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:08.803132 (+   534us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:08.803163 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:58:08.803179 (+    16us) tablet.cc:662] Decoding operations
0709 12:58:08.804044 (+   865us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:08.804101 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:08.804127 (+    26us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:58:08.804755 (+   628us) tablet.cc:701] Row locks acquired
0709 12:58:08.804775 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:58:08.804956 (+   181us) write_op.cc:270] Start()
0709 12:58:08.853649 (+ 48693us) write_op.cc:276] Timestamp: P: 1783601888804894 usec, L: 0
0709 12:58:08.860242 (+  6593us) op_driver.cc:348] REPLICATION: starting
0709 12:58:09.031043 (+170801us) log.cc:844] Serialized 2869 byte log entry
0709 12:58:09.739297 (+708254us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc859f470ac 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b
0709 12:58:10.703588 (+964291us) op_driver.cc:464] REPLICATION: finished
0709 12:58:11.146808 (+443220us) write_op.cc:301] APPLY: starting
0709 12:58:11.146927 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:11.147226 (+   299us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:11.147265 (+    39us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:11.245861 (+ 98596us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:11.274317 (+ 28456us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:58:11.274381 (+    64us) write_op.cc:312] APPLY: finished
0709 12:58:11.274862 (+   481us) log.cc:844] Serialized 58 byte log entry
0709 12:58:11.275914 (+  1052us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:11.276108 (+   194us) write_op.cc:454] Released schema lock
0709 12:58:11.276186 (+    78us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:11.276735 (+   549us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:11.276765 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1594023,"reported_tablets":57,"child_traces":[["op",{"apply.queue_time_us":442917,"apply.run_cpu_time_us":11667,"apply.run_wall_time_us":129900,"num_ops":7,"prepare.queue_time_us":214065,"prepare.run_cpu_time_us":40687,"prepare.run_wall_time_us":1231275,"raft.queue_time_us":561453,"raft.run_cpu_time_us":8298,"raft.run_wall_time_us":298651,"replication_time_us":1843159,"spinlock_wait_cycles":26422016,"thread_start_us":1567375,"threads_started":4,"wal-append.queue_time_us":897613,"wal-append.run_cpu_time_us":106593,"wal-append.run_wall_time_us":2339439}]]}
I20260709 12:58:17.326133  4919 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.330977  4919 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:17.333123  4919 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:17.290977  4866 consensus_queue.cc:260] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:17.334316  4804 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:17.334776  4866 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:17.335238  4991 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:17.335793  4991 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:17.337873  4991 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:17.347553  4939 consensus_meta.cc:287] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.660s	user 0.012s	sys 0.000s
I20260709 12:58:17.350566  4991 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:17.327795  4798 consensus_queue.cc:260] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:17.358057  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1968) took 1128 ms. Trace:
I20260709 12:58:17.305809  4885 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:17.386829  1686 rpcz_store.cc:276] 0709 12:58:16.230116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:16.338629 (+108513us) service_pool.cc:224] Handling call
0709 12:58:16.338990 (+   361us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:16.345900 (+  6910us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:58:16.362114 (+ 16214us) log.cc:844] Serialized 14 byte log entry
0709 12:58:16.671552 (+309438us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:16.702102 (+ 30550us) log.cc:844] Serialized 52 byte log entry
0709 12:58:16.707404 (+  5302us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:16.707440 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:16.707513 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:17.357826 (+650313us) raft_consensus.cc:1685] finished
0709 12:58:17.357847 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:17.357992 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29186,"prepare.queue_time_us":18288,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":17354,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":22108,"thread_start_us":224228,"threads_started":1,"wal-append.queue_time_us":387215}
I20260709 12:58:17.306845  4948 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:58:17.400542  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 248257us
I20260709 12:58:17.402036  1581 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:17.405023  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:17.405205  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:17.405975  4999 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:17.411916  4999 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:17.416203  1581 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:17.417133  4999 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:17.418818  4999 consensus_queue.cc:1059] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:17.419724  4762 raft_consensus.cc:3055] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:17.420301  1581 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:17.326357  4859 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:17.421818  1581 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
W20260709 12:58:17.432322  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:17.449393  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1695) took 1131 ms. Trace:
I20260709 12:58:17.452509  1615 rpcz_store.cc:276] 0709 12:58:16.317865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:16.318675 (+   810us) service_pool.cc:224] Handling call
0709 12:58:16.326549 (+  7874us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:16.373544 (+ 46995us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:16.373572 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:16.373613 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:16.373652 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:17.449096 (+1075444us) spinlock_profiling.cc:243] Waited 46.8 ms on lock 0x7b54002a6cd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:17.449153 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:17.449319 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107572096}
W20260709 12:58:17.456171  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 214529us
I20260709 12:58:17.459174  3460 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.459684  3460 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:17.393218  4991 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:17.420300  4762 raft_consensus.cc:740] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:17.423894  4796 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:58:17.478320  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:17.421491  4798 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:17.484930  5005 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 12:58:17.456843  4797 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.015s	sys 0.030s
I20260709 12:58:17.449640  4999 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:58:17.460718  4631 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:17.488435  4796 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:17.488565  5005 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:17.489360  4762 consensus_queue.cc:260] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:17.493175  4797 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.015s	sys 0.030s
I20260709 12:58:17.494426  4999 consensus_queue.cc:1059] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:17.497521  3460 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:17.485167  4903 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.011s	sys 0.023s
W20260709 12:58:17.505100  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 46862.7us
W20260709 12:58:17.499468  4903 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.012s	sys 0.023s
I20260709 12:58:17.495555  4999 consensus_queue.cc:1048] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.004s
W20260709 12:58:17.507079  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 47528.7us
I20260709 12:58:17.495390  5005 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:58:17.502096  4938 consensus_meta.cc:287] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.000s
I20260709 12:58:17.515672  1617 raft_consensus.cc:1240] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:58:17.520625  5011 raft_consensus.cc:3055] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:17.521212  5011 raft_consensus.cc:740] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:17.522240  5011 consensus_queue.cc:260] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:17.523928  5011 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:58:17.524991  1612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1686) took 1778 ms (client timeout 1862 ms). Trace:
I20260709 12:58:17.525143  1614 raft_consensus.cc:1240] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:17.521090  1581 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:17.526973  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1967) took 1365 ms. Trace:
I20260709 12:58:17.527344  1689 rpcz_store.cc:276] 0709 12:58:16.162011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:16.303583 (+141572us) service_pool.cc:224] Handling call
0709 12:58:16.303818 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:17.525740 (+1221922us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:17.525769 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:17.525809 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:17.525836 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:17.526745 (+   909us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b540041d054. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:17.526787 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:17.526917 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2809984896}
I20260709 12:58:17.528884  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1291) took 2586 ms. Trace:
I20260709 12:58:17.529299  1613 rpcz_store.cc:276] 0709 12:58:14.942281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:15.170343 (+228062us) service_pool.cc:224] Handling call
0709 12:58:16.128877 (+958534us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:16.155813 (+ 26936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:17.528684 (+1372871us) spinlock_profiling.cc:243] Waited 958 ms on lock 0x7b54002a62d0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:17.528802 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2203753856}
I20260709 12:58:17.529784  4903 consensus_queue.cc:1048] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:17.531913  4903 consensus_queue.cc:1048] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:17.529430  5000 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:17.536382  4907 raft_consensus.cc:3055] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:17.536861  4907 raft_consensus.cc:740] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:17.537657  4907 consensus_queue.cc:260] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:17.538712  4907 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:17.541787  4943 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:17.544020  4909 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:17.550284  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:17.556314  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 1962) took 1501 ms. Trace:
I20260709 12:58:17.556852  1682 rpcz_store.cc:276] 0709 12:58:16.054627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:16.176904 (+122277us) service_pool.cc:224] Handling call
0709 12:58:16.177498 (+   594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:16.204241 (+ 26743us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:16.225446 (+ 21205us) log.cc:844] Serialized 14 byte log entry
0709 12:58:16.225696 (+   250us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:16.225752 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:16.225805 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:17.547067 (+1321262us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b18004068a0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f643f3 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd 000000000038f354 000000000038f199 00007fc859f4783a
0709 12:58:17.556062 (+  8995us) spinlock_profiling.cc:243] Waited 26.5 ms on lock 0x7b5400299fd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:17.556114 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:17.556246 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6838,"prepare.queue_time_us":29605,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":694,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":2692,"spinlock_wait_cycles":64770176}
I20260709 12:58:17.561378  1533 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:58:17.590691  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:17.591876  4796 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:17.520856  4591 raft_consensus.cc:3055] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:17.592553  4591 raft_consensus.cc:740] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:17.593449  4591 consensus_queue.cc:260] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:17.594656  4591 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:17.600044  4909 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:17.602327  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1304) took 1203 ms. Trace:
I20260709 12:58:17.602818  1614 rpcz_store.cc:276] 0709 12:58:16.398678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:16.398794 (+   116us) service_pool.cc:224] Handling call
0709 12:58:17.524967 (+1126173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:17.530305 (+  5338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:17.602141 (+ 71836us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54002ff150. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:17.602266 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2589384960}
I20260709 12:58:17.603736  1613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:58:17.604377  1613 raft_consensus.cc:606] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:17.604897  1613 raft_consensus.cc:614] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:17.611174  1542 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:58:17.612581  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:17.616401  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:17.622743  1617 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:17.622558  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:17.623353  4951 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.623765  1611 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:17.618836  2303 raft_consensus.cc:1275] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:58:17.618983  4870 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.627311  4870 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:17.629819  4870 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:17.632154  1617 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:17.619328  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:17.525461  1612 rpcz_store.cc:269] 0709 12:58:15.746674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:15.751731 (+  5057us) service_pool.cc:224] Handling call
0709 12:58:17.524816 (+1773085us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b54002ff154. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:17.524933 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1046412160}
I20260709 12:58:17.619889  4871 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:17.634807  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:17.636891  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:17.637209  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:17.640064  4762 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:17.641976  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:17.620558  4943 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:17.646637  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:17.647208  4951 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:17.618549  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:17.644423  1617 raft_consensus.cc:1275] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:58:17.650455  4951 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:17.635119  4871 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:17.646526  4943 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:17.603304  4909 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:17.620234  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:17.656399  2301 consensus_queue.cc:237] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:17.665943  1613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:58:17.681325  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:17.670210  4797 consensus_queue.cc:1048] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:58:17.680940  4987 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 12:58:17.703377  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:17.707279  4887 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:17.737097  4887 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:17.739698  4887 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:17.708638  1685 raft_consensus.cc:1275] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:58:17.709695  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:17.735392  4987 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:17.745198  4987 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:17.704995  4870 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.681814  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:17.676911  1525 tablet_service.cc:1558] Processing DeleteTablet for tablet 07ac6d2e7442458585e7eca31089d547 with delete_type TABLET_DATA_TOMBSTONED (TS dbe6a89d0e1c4137b3a1b17bf4b520d8 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:51498
I20260709 12:58:17.746511  3947 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:17.711882  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:17.747144  3947 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:17.699527  4943 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:17.732674  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:17.747648  1684 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:17.747604  4870 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:17.756421  1684 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:17.749394  3947 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:17.752094  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:17.733961  1613 raft_consensus.cc:606] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:17.768790  1613 raft_consensus.cc:614] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:17.733047  1440 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38804 (request call id 35) took 8234 ms. Trace:
I20260709 12:58:17.792660  1613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:58:17.709879  1614 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:17.803303  1540 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:58:17.796429  1611 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:17.515547  4938 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:17.827169  4991 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:17.828408  4859 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:17.831316  4809 consensus_meta.cc:287] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.814s	user 0.008s	sys 0.002s
I20260709 12:58:17.832350  1534 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:58:17.832804  4885 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:17.840572  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 381697us
I20260709 12:58:17.704173  4871 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:17.866559  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:17.816784  4631 raft_consensus.cc:697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:58:17.893585  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 47039.7us
I20260709 12:58:17.887600  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:17.890328  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:17.894584  1686 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:17.893613  1688 raft_consensus.cc:2410] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:58:17.750111  4870 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:17.867673  1613 raft_consensus.cc:606] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:17.899186  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:17.782248  1440 rpcz_store.cc:276] 0709 12:58:09.498823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.500411 (+  1588us) service_pool.cc:224] Handling call
0709 12:58:10.032305 (+531894us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b54001b99d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfbb090 00007fc85d059f3a 00007fc862e101cc 00007fc862f0e37e 00007fc8613cf2a4 00007fc8613cf232 00007fc8613cf161 00007fc8613cf0dc 00007fc8613ce392 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:17.732955 (+7700650us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:14.712373 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:14.713016 (+   643us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:14.713068 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:58:14.713098 (+    30us) tablet.cc:662] Decoding operations
0709 12:58:14.713571 (+   473us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:14.713657 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:14.713689 (+    32us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:58:14.714115 (+   426us) tablet.cc:701] Row locks acquired
0709 12:58:14.714164 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:58:14.714322 (+   158us) write_op.cc:270] Start()
0709 12:58:14.714478 (+   156us) write_op.cc:276] Timestamp: P: 1783601894714251 usec, L: 0
0709 12:58:14.714498 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:58:14.715187 (+   689us) log.cc:844] Serialized 981 byte log entry
0709 12:58:15.612666 (+897479us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:58:15.796570 (+183904us) op_driver.cc:464] REPLICATION: finished
0709 12:58:15.918497 (+121927us) write_op.cc:301] APPLY: starting
0709 12:58:15.918644 (+   147us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:15.918781 (+   137us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:15.918803 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:15.919260 (+   457us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:15.919456 (+   196us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:58:15.919504 (+    48us) write_op.cc:312] APPLY: finished
0709 12:58:15.919732 (+   228us) log.cc:844] Serialized 28 byte log entry
0709 12:58:15.919932 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:15.920042 (+   110us) write_op.cc:454] Released schema lock
0709 12:58:15.920087 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:15.920564 (+   477us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:15.920606 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2556172,"reported_tablets":5,"spinlock_wait_cycles":1215321472,"child_traces":[["op",{"apply.queue_time_us":88021,"apply.run_cpu_time_us":2037,"apply.run_wall_time_us":28709,"num_ops":2,"prepare.queue_time_us":98536,"prepare.run_cpu_time_us":31093,"prepare.run_wall_time_us":314484,"raft.queue_time_us":175245,"raft.run_cpu_time_us":18039,"raft.run_wall_time_us":63617,"replication_time_us":1081895,"spinlock_wait_cycles":26515712,"thread_start_us":556351,"threads_started":4,"wal-append.queue_time_us":433244,"wal-append.run_cpu_time_us":24437,"wal-append.run_wall_time_us":1780319}]]}
I20260709 12:58:17.917178  1613 raft_consensus.cc:614] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:17.905512  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:17.919508  4662 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.921101  5015 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:17.921694  5015 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:17.927050  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:17.901655  5012 log.cc:927] Time spent T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:58:17.854017  4885 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.903259  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:17.970136  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:17.850296  4991 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 12:58:17.997993  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:17.920156  4662 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:18.001295  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:17.971474  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:17.905356  4797 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:17.995437  1581 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:17.922523  4993 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
W20260709 12:58:18.016081  1505 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.001s	sys 0.009s
W20260709 12:58:18.016636  1505 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.001s	sys 0.009s
I20260709 12:58:17.958280  4870 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:17.997287  5001 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:18.019480  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:18.003983  4948 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:58:18.029878  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:18.030247  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:18.030612  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:18.030865  1534 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:58:18.032399  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:18.032776  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:18.033030  1534 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:18.034937  1533 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:18.036273  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:18.022377  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1651) took 2649 ms. Trace:
I20260709 12:58:17.972649  4591 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:18.027799  1612 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 12:58:17.958052  4809 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:18.040156  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:18.039439  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:18.045049  1615 raft_consensus.cc:2393] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 10: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:18.042320  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:18.040551  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:18.047173  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:18.040295  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:18.043990  1508 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:18.051970  1534 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:58:18.053260  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:18.053740  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:18.022691  4940 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:58:18.061372  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:18.061681  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:18.008963  4885 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:18.029811  5000 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:18.038457  1683 rpcz_store.cc:276] 0709 12:58:15.372927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:15.562281 (+189354us) service_pool.cc:224] Handling call
0709 12:58:16.296901 (+734620us) spinlock_profiling.cc:243] Waited 2.76 ms on lock 0x7b5800190898. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc86202afc0 00007fc862015929 00007fc8620153d2 00007fc85b58cbd4
0709 12:58:16.297112 (+   211us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:16.297507 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:16.297534 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:16.298102 (+   568us) log.cc:844] Serialized 52 byte log entry
0709 12:58:16.455229 (+157127us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:16.496433 (+ 41204us) log.cc:844] Serialized 14 byte log entry
0709 12:58:16.496822 (+   389us) log.cc:844] Serialized 14 byte log entry
0709 12:58:17.532599 (+1035777us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b18002e4740. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f643f3 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd 000000000038f354 000000000038f199 00007fc859f4783a
0709 12:58:17.534036 (+  1437us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b18002e4740. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f643f3 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd 000000000038f354 000000000038f199 00007fc859f4783a
0709 12:58:17.548766 (+ 14730us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b18002e4740. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f61455 00007fc85d049060 00007fc85d05b716 00007fc85d06c287 00007fc85d06c208
0709 12:58:18.021967 (+473201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:18.022129 (+   162us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:18.022170 (+    41us) raft_consensus.cc:1685] finished
0709 12:58:18.022182 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:18.022316 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":78665,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":2697,"raft.queue_time_us":73749,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":275,"spinlock_wait_cycles":22111744,"thread_start_us":629776,"threads_started":2,"wal-append.queue_time_us":238664,"wal-append.run_cpu_time_us":2329,"wal-append.run_wall_time_us":1002356}
I20260709 12:58:18.075017  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:18.063745  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:18.083482  1534 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:58:18.019942  4843 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:58:18.086994  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:18.015297  4797 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:18.105930  3947 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:18.061112  4567 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:18.106676  1687 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:18.112053  1687 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:18.108675  3947 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:18.046541  4948 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:18.069788  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:18.112123  1689 raft_consensus.cc:2410] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:58:18.116514  1538 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:18.089264  1539 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:58:18.027053  4870 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:18.116787  1687 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:58:18.058152  5016 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:18.129689  5016 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:18.133549  5016 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:18.121902  1687 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:58:18.127327  4870 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:18.135428  4885 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:18.028789  4631 consensus_queue.cc:237] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:18.046725  4591 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:18.128944  5015 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:18.128655  4948 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:18.136103  1687 raft_consensus.cc:1275] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:58:18.143117  3947 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:18.133982  4797 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:18.079345  4903 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 12:58:18.083017  4837 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:58:18.062611  4798 consensus_queue.cc:1048] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 12:58:18.152346  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:18.142311  4567 raft_consensus.cc:697] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:18.057262  4809 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:18.083297  5001 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:18.180784  1542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.005s	sys 0.032s
I20260709 12:58:18.223838  1685 raft_consensus.cc:2410] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:58:18.241981  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 120574us
I20260709 12:58:18.310298  1691 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:58:18.329234  1684 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:58:18.221144  1683 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:18.329739  1691 pending_rounds.cc:85] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 5
I20260709 12:58:18.330322  1684 pending_rounds.cc:85] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 5
I20260709 12:58:18.330494  1691 pending_rounds.cc:107] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:58:18.330811  1684 pending_rounds.cc:107] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 12:58:18.331610  1684 raft_consensus.cc:2889] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:18.331868  1691 raft_consensus.cc:2889] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:18.332716  1654 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:18.326700  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:18.336704  1534 raft_consensus.cc:2393] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 8: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 12:58:18.302665  5025 log.cc:927] Time spent T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 12:58:18.294492  4907 consensus_meta.cc:287] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.755s	user 0.010s	sys 0.000s
I20260709 12:58:18.217067  5026 tablet_replica.cc:333] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 12:58:18.313863  4938 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:18.244794  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 72152us
I20260709 12:58:18.154567  4919 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:18.342730  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:18.381064  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:18.328464  1542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.005s	sys 0.050s
I20260709 12:58:18.345567  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:18.346056  4909 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 12:58:18.291541  4866 consensus_meta.cc:287] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.956s	user 0.008s	sys 0.001s
I20260709 12:58:18.238390  4933 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:18.330467  4662 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:18.330575  4940 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:18.292641  4591 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:18.320731  5027 log.cc:927] Time spent T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.105s	user 0.000s	sys 0.004s
I20260709 12:58:18.361078  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:18.361680  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:18.370927  1583 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:18.337019  4885 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:18.349159  4870 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:58:18.378252  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:18.383399  1614 raft_consensus.cc:2410] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:18.335237  4994 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:58:18.384874  1508 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:18.392330  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:18.412292  1615 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:58:18.413492  5005 consensus_queue.cc:1059] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:18.414031  4990 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:18.414237  5008 consensus_queue.cc:1059] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:18.414973  4903 consensus_queue.cc:1048] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:18.394131  4909 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:18.417490  4909 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:18.395239  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:18.383330  4843 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:18.418792  4843 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:18.414268  4999 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:58:18.417493  4859 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:18.420222  4859 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:18.420658  4859 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:18.420956  4843 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:18.172219  4405 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:18.405262  4948 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:18.475073  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 61267.2us
I20260709 12:58:18.476125  5005 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:18.376932  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:18.405388  4940 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:18.472512  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 52774.9us
I20260709 12:58:18.404415  4933 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:18.491334  4933 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:18.491645  4994 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:58:18.497442  4809 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:18.400441  4567 consensus_queue.cc:237] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:18.501858  4940 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:18.503176  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:18.491521  5008 consensus_queue.cc:1243] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:58:18.386425  4919 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:18.509713  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:58:18.510356  1616 raft_consensus.cc:606] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:18.516317  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 12:58:18.523964  1535 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.001s	sys 0.025s
W20260709 12:58:18.524428  1535 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.001s	sys 0.025s
I20260709 12:58:18.526679  5001 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:18.412961  1508 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:18.484179  4405 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:18.530066  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 117017us
W20260709 12:58:18.533043  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:18.534433  5005 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:18.532902  4809 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:18.544993  5005 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:18.557163  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:18.562314  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:18.553115  4919 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:18.566614  1542 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:58:18.567929  4999 raft_consensus.cc:3055] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:58:18.622682  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:18.637033  3460 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:18.637634  3460 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:18.639788  3460 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:18.568398  4999 raft_consensus.cc:740] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:58:18.659413  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 415267us
I20260709 12:58:18.664460  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:18.660082  5033 log.cc:927] Time spent T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:58:18.645557  4907 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:18.660722  4994 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:18.671639  1690 raft_consensus.cc:1275] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:58:18.660295  4843 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:18.683801  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:18.686062  1505 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:18.667198  2299 consensus_queue.cc:237] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:18.691121  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:18.682274  5016 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:18.674439  4907 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:18.696213  1505 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:18.679041  4919 consensus_queue.cc:1059] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:58:18.675169  4994 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:18.679344  4843 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:18.708444  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1962) took 1026 ms. Trace:
I20260709 12:58:18.708940  1535 rpcz_store.cc:276] 0709 12:58:17.681938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.682100 (+   162us) service_pool.cc:224] Handling call
0709 12:58:17.682441 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:17.682869 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:17.682899 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:17.903740 (+220841us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b2c00000658. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85b94aa11 00007fc85b95a372 00007fc85d08ca01 00007fc85d05143a 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2
0709 12:58:17.904138 (+   398us) log.cc:844] Serialized 26 byte log entry
0709 12:58:18.525224 (+621086us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:18.525264 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:18.525330 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:18.708085 (+182755us) raft_consensus.cc:1685] finished
0709 12:58:18.708108 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:18.708373 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":437,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":89,"spinlock_wait_cycles":284951296,"thread_start_us":620344,"threads_started":1,"wal-append.queue_time_us":765589}
I20260709 12:58:18.711802  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 1963) took 1028 ms. Trace:
I20260709 12:58:18.712949  1684 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:58:18.713364  1684 pending_rounds.cc:85] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 5
I20260709 12:58:18.713609  1684 pending_rounds.cc:107] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:58:18.713860  1684 raft_consensus.cc:2889] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:18.716678  4907 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:18.717547  5000 raft_consensus.cc:3055] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:58:18.717957  5000 raft_consensus.cc:740] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:18.718793  5000 consensus_queue.cc:260] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:18.720027  5000 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:18.721850  5015 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:18.675994  4999 consensus_queue.cc:260] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:18.722711  4405 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:18.727109  1537 consensus_queue.cc:237] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:18.734043  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:18.712304  1541 rpcz_store.cc:276] 0709 12:58:17.683891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.684052 (+   161us) service_pool.cc:224] Handling call
0709 12:58:17.684382 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:17.684801 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:17.684832 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:18.320958 (+636126us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b2c00000658. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85b94aa11 00007fc85b95a372 00007fc85d08ca01 00007fc85d05143a 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2
0709 12:58:18.321456 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 12:58:18.598535 (+277079us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:18.645831 (+ 47296us) log.cc:844] Serialized 14 byte log entry
0709 12:58:18.646042 (+   211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:18.646115 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:18.711505 (+ 65390us) raft_consensus.cc:1685] finished
0709 12:58:18.711617 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:18.711734 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":47158,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":1250,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":171,"spinlock_wait_cycles":280984320,"thread_start_us":276105,"threads_started":1,"wal-append.queue_time_us":388222}
I20260709 12:58:18.697466  5005 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:18.690299  4867 consensus_queue.cc:1048] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
W20260709 12:58:18.739076  5034 log.cc:927] Time spent T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:58:18.745270  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:18.746505  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1689) took 1032 ms. Trace:
I20260709 12:58:18.750880  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:18.751322  1682 rpcz_store.cc:276] 0709 12:58:17.713836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.713993 (+   157us) service_pool.cc:224] Handling call
0709 12:58:17.714324 (+   331us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:17.715206 (+   882us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:17.715240 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:17.715989 (+   749us) log.cc:844] Serialized 52 byte log entry
0709 12:58:18.018363 (+302374us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:18.302063 (+283700us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:58:18.505804 (+203741us) log.cc:844] Serialized 14 byte log entry
0709 12:58:18.742128 (+236324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:18.742210 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:18.742251 (+    41us) raft_consensus.cc:1685] finished
0709 12:58:18.746303 (+  4052us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:18.746451 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":245832,"prepare.queue_time_us":64671,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":315,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":72,"spinlock_wait_cycles":50128128,"thread_start_us":743633,"threads_started":2,"wal-append.queue_time_us":502254}
I20260709 12:58:18.743670  4938 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:18.756309  4938 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:18.758294  4994 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:18.759974  4843 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:18.760684  4943 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:18.762109  5020 log.cc:927] Time spent T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.543s	user 0.003s	sys 0.000s
I20260709 12:58:18.765522  4987 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:18.766125  4987 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:18.766790  4859 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:18.734952  4751 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:58:18.807933  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:18.808820  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:18.810778  4591 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:18.811437  4591 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:18.813709  4591 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:18.814906  5039 log.cc:927] Time spent T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:58:18.816844  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:18.818190  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:18.819398  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:18.819995  1690 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:18.761255  4943 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:18.821907  1688 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:18.823022  4943 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:18.817291  4859 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:18.830370  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:18.831583  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:18.853447  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:18.856612  5023 log.cc:927] Time spent T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.640s	user 0.004s	sys 0.006s
I20260709 12:58:18.861085  4919 raft_consensus.cc:3055] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:18.861537  4919 raft_consensus.cc:740] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:18.862346  4919 consensus_queue.cc:260] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:18.863658  4999 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:58:18.863930  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 162444us
I20260709 12:58:18.758548  4938 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:18.873409  1690 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:18.768342  4987 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:18.877458  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:18.879020  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:18.891839  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:18.863629  4919 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:18.893672  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1317) took 1211 ms. Trace:
I20260709 12:58:18.894091  1612 rpcz_store.cc:276] 0709 12:58:17.682752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.683070 (+   318us) service_pool.cc:224] Handling call
0709 12:58:17.683395 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:18.038571 (+355176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:18.893399 (+854828us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b5400447ad4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:18.893617 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":791532288}
I20260709 12:58:18.894567  1654 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:18.893697  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:18.874138  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:18.899555  1686 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
W20260709 12:58:18.901969  1538 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.011s	sys 0.030s
W20260709 12:58:18.902432  1538 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.011s	sys 0.030s
I20260709 12:58:18.903029  3460 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:18.898455  4943 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:18.904381  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:18.904687  4943 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:18.905166  1690 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 12:58:18.890852  4717 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:18.906170  4717 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:18.906844  4943 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:18.910770  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 43789.4us
I20260709 12:58:18.911664  1505 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:18.898622  4591 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:18.911378  4987 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:18.908349  4717 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:18.937619  1508 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:18.939038  1505 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:18.914731  4943 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:18.914702  4917 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:18.944437  1508 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:18.947240  1655 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:18.932968  4809 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:18.937151  4987 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:18.943588  4804 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:18.984571  4987 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:18.993834  4809 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:18.948719  4859 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:18.954357  5018 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:18.958112  4567 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:19.036629  4938 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:19.037658  4809 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:18.936892  4591 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:18.955050  4943 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:19.053206  1655 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:19.046257  4940 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:58:19.054282  4591 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:18.953953  4917 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:58:19.055635  5053 log.cc:927] Time spent T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:58:19.057339  4917 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:19.057956  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:19.060699  4943 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:19.062177  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:19.063321  1655 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:19.064842  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:19.065207  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:19.065797  1542 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:19.066697  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:19.066769  1655 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:19.066721  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:19.067842  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:19.068507  1539 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:19.068176  1537 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:58:19.070583  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:19.072695  4943 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:58:19.071789  1655 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:19.074312  1655 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:19.074848  4943 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:19.075778  4591 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:19.080900  4943 raft_consensus.cc:697] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:19.081900  4943 consensus_queue.cc:237] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.086530  1655 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:19.090469  4866 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:19.092190  1655 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:19.094655  4591 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:19.096653  4866 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:19.098196  1655 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:19.103624  1655 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:19.105047  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:19.113175  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:19.043709  4567 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:19.107707  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 1998) took 1086 ms. Trace:
I20260709 12:58:19.127287  1683 rpcz_store.cc:276] 0709 12:58:18.021459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:18.084160 (+ 62701us) service_pool.cc:224] Handling call
0709 12:58:19.107517 (+1023357us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b5400287dd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:19.107635 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264388352}
I20260709 12:58:19.106642  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 12:58:19.133211  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 188797us
I20260709 12:58:19.141049  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 1700) took 1249 ms. Trace:
I20260709 12:58:19.144692  1685 rpcz_store.cc:276] 0709 12:58:17.891445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.958750 (+ 67305us) service_pool.cc:224] Handling call
0709 12:58:19.127047 (+1168297us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b5400260054. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:19.140964 (+ 13917us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":449472896}
I20260709 12:58:19.135910  4567 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:19.139117  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:19.138268  5026 raft_consensus.cc:2243] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:19.070446  4940 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:19.149573  1691 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:58:19.106273  2299 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:58:19.145112  1508 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:19.146607  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:19.150691  1655 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:19.146741  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:19.147097  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:19.151512  1539 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:58:19.149499  1540 raft_consensus.cc:2393] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 11: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:19.152311  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:19.104295  4591 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:19.153028  1538 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:19.150439  4871 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.154891  4943 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:19.156656  4871 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:19.159114  4871 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:19.145120  4948 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:19.161861  1440 catalog_manager.cc:5697] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 3 to 7, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 7 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:58:19.131445  5018 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:19.164101  5018 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:19.165832  2267 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:19.166654  4913 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:19.168975  1655 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:19.174044  1655 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:19.180094  1508 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:19.132421  4987 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.202265  4987 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:19.166635  5018 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:19.177122  1655 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:19.175997  4940 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:19.194146  4948 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:19.178522  4631 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:58:19.206704  1508 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:19.155887  4591 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:19.225884  1583 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:19.222977  1655 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:19.231094  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:19.240178  4938 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:19.240829  4938 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:19.231792  1533 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:19.251806  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:19.223471  4717 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.252447  1540 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:19.257668  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 100184us
I20260709 12:58:19.211987  4987 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:19.216841  4809 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:19.226828  4871 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:19.220820  4948 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:19.219197  4866 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:19.258445  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:19.228109  4591 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:19.219049  5062 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:19.264392  1655 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:19.270780  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:19.274971  1538 raft_consensus.cc:1275] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:58:19.253530  5026 raft_consensus.cc:2272] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:58:19.285014  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 59216.3us
I20260709 12:58:19.316393  1540 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:58:19.273293  1691 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:19.262141  4876 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:19.257812  5009 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:19.316344  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 46863.1us
I20260709 12:58:19.252700  4990 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.263942  5019 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:19.264910  4812 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:19.275067  5062 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:19.265373  4809 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:19.271131  4948 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:19.283587  5001 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.263543  4999 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:19.310387  4866 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:19.262974  4717 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.329665  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:19.329929  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:19.330474  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:19.349064  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:19.349684  1616 raft_consensus.cc:2393] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 9: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:19.331055  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:19.331794  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:19.332310  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:19.321599  4876 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:19.285550  4991 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:19.270218  4837 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:19.285907  4911 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:19.285735  5037 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:19.398571  5037 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.400838  5037 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:19.401541  4911 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.402668  1612 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:19.403751  4911 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:19.369621  4876 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:19.410445  4837 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.412653  4837 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:19.298729  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:19.270406  5015 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:19.328188  1583 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:19.344805  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:19.264379  4919 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:58:19.284040  4940 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:19.352016  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:19.268235  4987 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.356619  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:19.426499  1609 raft_consensus.cc:2376] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11. Re-sending same reply.
I20260709 12:58:19.359285  4717 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:19.327072  4812 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:19.301144  4567 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.263834  4871 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:19.432086  4871 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:19.354820  1655 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:19.339493  4809 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:19.350878  4913 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:58:19.340333  5062 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:19.384260  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 158532us
I20260709 12:58:19.391135  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:19.443090  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:19.414649  4938 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.355296  4866 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:19.326848  4990 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.414748  4591 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.427018  5073 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:58:19.422092  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 94010.8us
I20260709 12:58:19.327889  5009 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.425529  4940 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:19.468508  4940 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:19.469872  5009 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:19.340139  5019 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.472906  1614 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
I20260709 12:58:19.474095  5019 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:19.474646  5019 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:19.475131  5019 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.346208  5001 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.478022  5001 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:19.474098  4938 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:19.430248  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:19.424450  5015 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.479386  1610 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:19.355193  4999 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:19.482023  4999 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:58:19.434636  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 79927.2us
I20260709 12:58:19.444137  1616 raft_consensus.cc:2410] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 12:58:19.445115  1615 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:58:19.423965  4943 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:19.484687  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:19.485059  4943 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.445729  5043 raft_consensus.cc:2955] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 4 to 9, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:58:19.486806  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:19.487277  4943 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:19.487821  4943 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:19.487957  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:19.489636  4948 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.490186  5015 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:19.491750  5062 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.391409  1508 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:19.451148  1683 raft_consensus.cc:2955] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 4 to 9, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:58:19.454828  5026 ts_tablet_manager.cc:1916] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:19.440989  4870 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:19.454865  4990 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:19.457952  4567 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:19.434005  4812 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:19.432355  4987 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:19.467501  4919 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:58:19.504666  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 113365us
W20260709 12:58:19.421113  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:19.531572  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:19.525450  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:19.548365  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:19.539489  4866 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.554149  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:19.555116  1689 raft_consensus.cc:2410] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 12:58:19.567281  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:19.549250  1691 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:19.555742  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:19.559808  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:19.513273  5015 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:19.512441  4917 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:19.573223  1688 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:19.571380  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:19.507243  4938 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:19.488309  4943 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.544507  4987 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:19.579692  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:19.594309  1613 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
W20260709 12:58:19.583302  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 49932us
I20260709 12:58:19.588668  1684 raft_consensus.cc:1275] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:19.595813  1583 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:19.589182  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:19.543576  4631 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.598035  3947 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:19.598660  3947 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.499634  4809 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.545260  4870 raft_consensus.cc:697] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:58:19.605629  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 52668.2us
I20260709 12:58:19.611074  3947 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:19.609704  1508 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:19.525694  4876 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.614904  3947 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:19.618975  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:19.618999  3947 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:19.619716  3947 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:19.615810  1508 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:19.621363  1508 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:19.543963  4919 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.623879  1612 raft_consensus.cc:1275] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:19.630713  4717 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:19.636778  4876 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:19.638113  4943 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:19.639796  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:19.640974  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:19.597440  5017 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:19.595777  5015 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.602722  4938 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.603310  4987 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.614696  4796 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.643204  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:19.642851  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:19.894692  1616 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
W20260709 12:58:19.796443  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 200763us
I20260709 12:58:19.907789  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:19.856815  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:19.909190  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:19.725844  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 113427us
I20260709 12:58:19.911430  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:19.912071  1537 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:19.618999  5074 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:19.889585  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 287157us
I20260709 12:58:19.821094  3947 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.851456  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:19.921000  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:19.839214  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:19.888500  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:19.714013  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 92714us
I20260709 12:58:19.912642  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:19.914052  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:19.907893  1583 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:19.843142  5076 log.cc:927] Time spent T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 12:58:19.921260  1610 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:19.857764  5062 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:19.935638  1538 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:19.828429  4990 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:19.726658  4567 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:19.865103  4909 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:19.928896  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:19.611738  4631 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.641326  4948 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:19.642200  4591 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:19.638160  4866 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:19.962420  4940 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:19.962924  5078 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:58:19.963431  5075 log.cc:927] Time spent T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:58:19.963599  5078 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:19.968779  5080 log.cc:927] Time spent T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 12:58:19.864869  5018 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:19.915230  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:19.725817  5019 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:19.946041  3947 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:19.959383  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:19.807435  4871 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.936159  4993 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:19.971390  1691 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:20.004256  4871 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:19.916878  5017 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.922087  4796 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.969449  4938 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:19.934433  5074 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:20.012744  4631 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:19.960291  4909 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:19.997987  5018 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:20.014469  5077 log.cc:927] Time spent T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:58:19.642599  4870 consensus_queue.cc:237] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:20.010546  4940 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:20.030001  5015 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:20.038596  5017 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:20.021561  4919 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:20.080849  5082 log.cc:927] Time spent T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:58:20.088892  5074 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:20.131397  1533 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:19.923062  1508 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:20.134176  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:20.135116  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 212030us
I20260709 12:58:19.930286  1537 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:58:20.146793  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:20.148581  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:20.142130  1538 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:58:20.149998  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:20.149223  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:19.939325  1583 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:20.155275  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 215952us
I20260709 12:58:20.161823  1583 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:20.167273  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:20.169162  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:20.170679  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:20.171643  1609 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:20.172957  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:20.174479  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:20.175462  1611 raft_consensus.cc:2393] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 12: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:20.176314  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:20.177696  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:20.189769  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:20.191156  1534 raft_consensus.cc:2393] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 11: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:20.191416  1613 raft_consensus.cc:2393] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 9: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:20.191623  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:20.191861  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:20.192528  1616 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:20.208878  1505 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:20.210333  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 291137us
I20260709 12:58:20.219071  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:20.221042  4641 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:20.221120  4631 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:20.222345  4641 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:20.223946  4567 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:20.226899  1609 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:20.240720  4867 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:20.242436  4796 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:20.243423  4797 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:20.244921  4804 consensus_queue.cc:1048] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:20.248736  4641 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:20.250715  5073 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:20.241914  4867 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:20.228689  4567 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:20.254547  4567 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:58:20.050479  5043 consensus_meta.cc:287] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.564s	user 0.009s	sys 0.003s
I20260709 12:58:20.252352  5073 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 12:58:20.311779  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 116933us
I20260709 12:58:20.311879  5073 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:20.323087  5093 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:20.324209  5093 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:20.325778  4867 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:20.327380  5093 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:20.329448  5018 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:20.329545  4809 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:20.325829  4991 consensus_meta.cc:287] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.928s	user 0.007s	sys 0.004s
I20260709 12:58:20.330744  4991 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:20.327942  4867 raft_consensus.cc:2955] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index 4 to 7, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 12:58:20.334314  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 80745.2us
I20260709 12:58:20.336917  1614 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:20.321779  4796 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:58:20.321818  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 84440.7us
I20260709 12:58:20.348527  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:20.348970  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:20.340742  4800 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.349642  1609 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:20.350124  4800 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:20.351867  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:20.352862  4909 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:20.354947  5011 raft_consensus.cc:993] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:58:20.355854  4837 raft_consensus.cc:1081] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
W20260709 12:58:20.339241  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 91196.2us
I20260709 12:58:20.348694  5009 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.360805  4987 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:20.369959  1583 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:20.373919  3947 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.374817  3947 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:20.377152  5009 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:20.381695  5009 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:20.389377  4993 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:20.392737  4993 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:20.393260  4993 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:20.402582  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:20.402812  2302 raft_consensus.cc:2955] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 6 to 8, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:58:20.401263  4800 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:20.417629  1541 raft_consensus.cc:2955] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 4 to 7, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:58:20.425069  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:20.425423  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:20.426043  1542 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:20.433422  1609 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:20.435976  1614 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:58:20.445478  5081 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:20.446365  5081 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:20.448873  4591 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:20.449738  4591 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:20.450250  1690 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:20.439808  3947 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:20.452319  4591 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:20.477473  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:20.478251  1609 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:20.495877  1609 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:20.497545  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:20.497864  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:20.498922  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:20.499219  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:20.499861  1612 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:58:20.500010  1689 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:20.500694  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:20.501286  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:20.501565  1690 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:20.502385  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 199) took 1032 ms. Trace:
W20260709 12:58:20.497803  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 337998us
I20260709 12:58:20.515304  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:20.502780  1683 rpcz_store.cc:276] 0709 12:58:19.449083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:19.450562 (+  1479us) service_pool.cc:224] Handling call
0709 12:58:19.450859 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:19.451038 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:58:19.955337 (+504299us) log.cc:844] Serialized 14 byte log entry
0709 12:58:20.389014 (+433677us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:20.400010 (+ 10996us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:20.423138 (+ 23128us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b48001c0158. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc861f7aaa1 00007fc861f71b37 00007fc861f719ca 00007fc86206926f 00007fc862068f37 00007fc86207d55c 00007fc86207d508 00007fc86207d488 00007fc86207d443 00007fc86207c6ec 00007fc860fa6a96
0709 12:58:20.430623 (+  7485us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:20.438996 (+  8373us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:20.480920 (+ 41924us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13360,"raft.queue_time_us":39592,"raft.run_cpu_time_us":3064,"raft.run_wall_time_us":425431,"spinlock_wait_cycles":8988416,"thread_start_us":362702,"threads_started":1}
I20260709 12:58:20.516760  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:20.517724  1685 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:20.518402  1690 raft_consensus.cc:1240] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:20.505928  4591 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:20.530732  4876 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:20.531083  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:20.506153  4987 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:20.516793  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:20.533569  4876 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:20.541275  5093 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:20.544412  5093 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:20.545409  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:20.546217  1687 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:58:20.546552  5043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:38910 (request call id 2) took 2957 ms. Trace:
I20260709 12:58:20.547452  4938 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:20.548098  4938 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:20.549088  1656 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.937s	user 0.006s	sys 0.011s
I20260709 12:58:20.549110  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:20.519759  4993 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:20.521514  5081 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:20.550405  4938 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:20.557591  4943 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:20.558284  5086 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:20.546792  5093 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:20.590572  5086 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:20.565657  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 51633.3us
I20260709 12:58:20.592190  1505 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:20.566620  1654 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:20.567068  1656 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.960s	user 0.007s	sys 0.011s
I20260709 12:58:20.568014  5026 ts_tablet_manager.cc:1929] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.7
I20260709 12:58:20.570173  4876 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:20.571569  5097 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:20.575047  5073 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:20.558040  5078 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:20.578828  4591 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:58:20.580647  4812 consensus_meta.cc:287] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 1.037s	user 0.010s	sys 0.009s
W20260709 12:58:20.582412  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:20.590325  4943 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:20.594353  1689 raft_consensus.cc:2410] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:58:20.554431  5015 raft_consensus.cc:2955] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 6 to 8, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:58:20.576768  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:20.604755  4405 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:20.610725  5097 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:20.614719  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:20.615439  1682 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 7.
I20260709 12:58:20.615573  5097 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:20.610798  4876 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:20.616811  4876 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:20.617493  4943 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:58:20.618619  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 74974.1us
I20260709 12:58:20.619081  4876 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:20.602757  4987 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:20.619766  4876 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:20.621724  4987 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:20.620393  1654 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:20.609458  4812 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:20.610734  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:20.605620  1505 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:20.604769  5026 log.cc:1199] T 07ac6d2e7442458585e7eca31089d547 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-0-root/wals/07ac6d2e7442458585e7eca31089d547
I20260709 12:58:20.624450  5073 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:20.633752  1537 raft_consensus.cc:2393] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 14: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:20.635639  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:20.628364  4938 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:20.634346  5086 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:20.639369  4938 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:20.644410  4917 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.645256  1683 raft_consensus.cc:1240] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:20.645926  2269 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 12:58:20.646399  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:20.647114  1684 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:20.647269  1690 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:20.646294  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:20.632273  5073 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:20.632404  4943 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:20.649612  4913 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:20.645203  4917 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:20.658136  4913 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:20.658602  4913 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:20.659941  4917 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:20.655344  4405 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:20.662899  1689 raft_consensus.cc:2393] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 11: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:20.640133  5026 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51498 (request call id 69) took 2964 ms. Trace:
I20260709 12:58:20.649998  4987 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:20.666551  4631 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:20.667959  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 62604us
I20260709 12:58:20.668180  4631 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:20.669024  1505 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:20.669904  5100 log.cc:927] Time spent T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.366s	user 0.004s	sys 0.000s
I20260709 12:58:20.671074  4631 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:20.661257  4867 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:38910 (request call id 1) took 3444 ms. Trace:
I20260709 12:58:20.666569  4804 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:20.678215  4804 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:20.678682  5073 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:20.677358  4993 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:20.682277  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:20.671849  4943 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:20.685551  3947 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:20.688462  3947 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:20.690583  3947 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:20.686968  5005 consensus_queue.cc:1059] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:58:20.680774  4804 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:20.694972  1583 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:20.695680  5005 consensus_queue.cc:1243] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:58:20.684762  4917 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:20.696237  4631 raft_consensus.cc:3055] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:20.696758  4631 raft_consensus.cc:740] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:20.697376  4812 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:20.697844  4631 consensus_queue.cc:260] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:20.699330  4631 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:20.701116  4938 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:20.701617  1583 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:20.702140  1690 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:58:20.702806  1583 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:20.703737  4994 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:20.704247  4994 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:20.704648  4994 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:20.706910  4800 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:20.707466  4800 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:20.707876  4800 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:20.701169  1686 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:20.716168  1654 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:20.696332  5009 raft_consensus.cc:2764] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:58:20.718014  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:20.708748  4837 consensus_queue.cc:1059] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:20.722559  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:20.729566  4837 raft_consensus.cc:3055] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:20.730008  4837 raft_consensus.cc:740] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:20.731285  4837 consensus_queue.cc:260] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:20.734586  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:20.735685  1538 raft_consensus.cc:2410] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:58:20.736449  1537 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:20.723338  1616 raft_consensus.cc:1275] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:58:20.739400  1440 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38804 (request call id 36) took 1639 ms. Trace:
W20260709 12:58:20.725487  5115 log.cc:927] Time spent T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:58:20.726100  1612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:58:20.728188  4943 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:20.741927  1612 raft_consensus.cc:606] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:20.765379  1686 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50708
I20260709 12:58:20.766129  1686 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:20.766539  1437 catalog_manager.cc:5697] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 6 to 9, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 9 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:20.767899  4837 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:20.769889  4943 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:20.770581  4943 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:20.770992  4943 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:20.772910  1508 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:20.773809  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:20.774500  1533 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:20.681190  4867 rpcz_store.cc:276] 0709 12:58:17.213332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.216186 (+  2854us) service_pool.cc:224] Handling call
0709 12:58:18.564441 (+1348255us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b5800483ed0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85cfad0aa 00007fc85d02f447 00007fc85d04c70a 00007fc85d04d76a 00007fc85d04c91b 00007fc85d05803c 00007fc85d0576b3 00007fc85d04f9fa 00007fc8620174c9 00007fc85b593c54
0709 12:58:18.729208 (+164767us) log.cc:844] Serialized 501 byte log entry
0709 12:58:19.036654 (+307446us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b180042b440. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f643f3 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd 000000000038f354 000000000038f199 00007fc859f4783a
0709 12:58:20.653343 (+1616689us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":170,"raft.queue_time_us":23047,"raft.run_cpu_time_us":38541,"raft.run_wall_time_us":88060,"spinlock_wait_cycles":1327903488,"thread_start_us":181578,"threads_started":1,"wal-append.queue_time_us":250402,"wal-append.run_cpu_time_us":2659,"wal-append.run_wall_time_us":1098923}
I20260709 12:58:20.713295  4591 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:20.766536  1686 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:20.665877  5026 rpcz_store.cc:276] 0709 12:58:17.676161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.676535 (+   374us) service_pool.cc:224] Handling call
0709 12:58:18.216674 (+540139us) ts_tablet_manager.cc:1151] Deleting tablet 07ac6d2e7442458585e7eca31089d547
0709 12:58:18.216768 (+    94us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:58:20.024725 (+1807957us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:20.535069 (+510344us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:20.639969 (+104900us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":811810,"tablet-delete.queue_time_us":469814,"thread_start_us":274426,"threads_started":1}
I20260709 12:58:20.777750  1437 catalog_manager.cc:5697] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 6 to 9, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 9 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:20.781062  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:20.782173  1437 catalog_manager.cc:5697] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 7 to 8, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 8 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:20.776134  1426 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d127be99e2af41c0808e03480c1b64e3 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:20.786078  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:20.764634  4913 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:20.790287  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:20.792901  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:20.547093  5043 rpcz_store.cc:276] 0709 12:58:17.577212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.581558 (+  4346us) service_pool.cc:224] Handling call
0709 12:58:17.654928 (+ 73370us) spinlock_profiling.cc:243] Waited 49.4 ms on lock 0x7b58007784d0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85cfad0aa 00007fc85d02f447 00007fc85d04c70a 00007fc85d04d76a 00007fc85d04c91b 00007fc85d05803c 00007fc85d0576b3 00007fc85d04f9fa 00007fc8620174c9 00007fc85b593c54
0709 12:58:17.838476 (+183548us) log.cc:844] Serialized 501 byte log entry
0709 12:58:20.529563 (+2691087us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":52725,"raft.run_cpu_time_us":15,"raft.run_wall_time_us":15,"spinlock_wait_cycles":113710848,"thread_start_us":448210,"threads_started":1,"wal-append.queue_time_us":675517,"wal-append.run_cpu_time_us":1725,"wal-append.run_wall_time_us":1004446}
I20260709 12:58:20.740631  1440 rpcz_store.cc:276] 0709 12:58:19.099568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:19.099729 (+   161us) service_pool.cc:224] Handling call
0709 12:58:20.739129 (+1639400us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:19.594442 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:19.862187 (+267745us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:19.880924 (+ 18737us) write_op.cc:435] Acquired schema lock
0709 12:58:19.892638 (+ 11714us) tablet.cc:662] Decoding operations
0709 12:58:19.957451 (+ 64813us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:19.993463 (+ 36012us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:19.998941 (+  5478us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:58:20.011727 (+ 12786us) tablet.cc:701] Row locks acquired
0709 12:58:20.014826 (+  3099us) write_op.cc:260] PREPARE: finished
0709 12:58:20.021639 (+  6813us) write_op.cc:270] Start()
0709 12:58:20.027372 (+  5733us) write_op.cc:276] Timestamp: P: 1783601900020695 usec, L: 0
0709 12:58:20.028528 (+  1156us) op_driver.cc:348] REPLICATION: starting
0709 12:58:20.029401 (+   873us) log.cc:844] Serialized 535 byte log entry
0709 12:58:20.297561 (+268160us) op_driver.cc:464] REPLICATION: finished
0709 12:58:20.408383 (+110822us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc859f470ac 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc860a87ef0
0709 12:58:20.568804 (+160421us) write_op.cc:301] APPLY: starting
0709 12:58:20.568962 (+   158us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:20.569102 (+   140us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:20.569135 (+    33us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:20.569464 (+   329us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:20.569770 (+   306us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:58:20.569811 (+    41us) write_op.cc:312] APPLY: finished
0709 12:58:20.570158 (+   347us) log.cc:844] Serialized 22 byte log entry
0709 12:58:20.572111 (+  1953us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:20.572216 (+   105us) write_op.cc:454] Released schema lock
0709 12:58:20.572266 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:20.572765 (+   499us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:20.572794 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":235253,"apply.run_cpu_time_us":2251,"apply.run_wall_time_us":28884,"num_ops":1,"prepare.queue_time_us":363442,"prepare.run_cpu_time_us":35293,"prepare.run_wall_time_us":673297,"raft.queue_time_us":197381,"raft.run_cpu_time_us":23941,"raft.run_wall_time_us":189325,"replication_time_us":268613,"spinlock_wait_cycles":66400128,"thread_start_us":825748,"threads_started":4,"wal-append.queue_time_us":67208}]]}
I20260709 12:58:20.796710  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:20.801569  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:20.806942  1542 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:20.789093  5073 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:20.791875  4909 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:58:20.810487  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 141630us
I20260709 12:58:20.814740  1533 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:20.797232  5086 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.806262  4567 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:20.826917  5122 log.cc:927] Time spent T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 12:58:20.834056  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 152857us
I20260709 12:58:20.817656  1437 catalog_manager.cc:5697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 6 to 8, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 8 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:20.822118  4909 raft_consensus.cc:697] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:20.821467  1425 catalog_manager.cc:5028] TS dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): tablet 07ac6d2e7442458585e7eca31089d547 (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:58:20.859150  4913 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 8 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:20.860544  1437 catalog_manager.cc:5697] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:20.862242  1437 catalog_manager.cc:5697] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 5 to 9, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 9 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:20.864076  1437 catalog_manager.cc:5697] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 7 to 8, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 8 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:20.864657  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:20.865538  1539 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:20.865315  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:20.867233  1689 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:20.874527  4909 consensus_queue.cc:237] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:20.852355  5086 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:20.878439  5086 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:20.882825  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:20.872014  1505 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:20.887992  1689 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 8.
I20260709 12:58:20.887887  1654 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:20.895262  2269 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
W20260709 12:58:20.895949  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:20.896682  1686 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:20.901389  1687 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:20.906598  1686 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:20.907507  4917 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:20.908143  4917 raft_consensus.cc:697] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:20.909119  4917 consensus_queue.cc:237] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:20.895817  4800 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:20.926105  4800 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:20.901916  5109 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:20.927228  5109 raft_consensus.cc:697] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 8 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:58:20.928292  5109 consensus_queue.cc:237] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:58:20.935134  5126 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.130s	user 0.001s	sys 0.001s
I20260709 12:58:20.939133  1581 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:20.946040  1437 catalog_manager.cc:5697] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 7 to 8, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 8 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:20.947948  1437 catalog_manager.cc:5697] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:20.903800  5086 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:20.955127  4994 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:20.956691  1426 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e4681eaad3084357b9677e4242b97c99 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:20.957468  4994 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:20.957916  4800 consensus_queue.cc:1059] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:20.958954  4800 raft_consensus.cc:3055] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:20.959308  4800 raft_consensus.cc:740] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:20.962716  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:58:20.973658  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 101256us
I20260709 12:58:20.976351  1437 catalog_manager.cc:5697] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 4 to 6, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 6 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:20.988098  1654 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:20.989931  1581 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:20.984200  1689 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:20.960201  4800 consensus_queue.cc:260] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:20.995995  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 151869us
I20260709 12:58:20.977129  4837 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:21.007791  1689 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:21.009476  1437 catalog_manager.cc:5697] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 5 to 9, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 9 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:21.009451  4631 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:58:21.012699  5127 log.cc:927] Time spent T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:58:20.995733  4909 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:21.018024  1437 catalog_manager.cc:5697] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 5 to 7, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 7 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:21.020181  1437 catalog_manager.cc:5697] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 7 to 8, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 8 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:21.022521  1437 catalog_manager.cc:5697] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:21.018916  4909 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:20.994917  5086 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:21.002843  4567 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:21.024950  1437 catalog_manager.cc:5697] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 7 to 9, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 9 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
W20260709 12:58:21.029242  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 53859.4us
I20260709 12:58:21.031523  1539 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:21.028039  1437 catalog_manager.cc:5697] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 4 to 7, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 7 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:21.037261  1505 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:21.039129  4796 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:58:21.037263  5123 log.cc:927] Time spent T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:58:21.042002  1654 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:21.042896  1505 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:21.044561  4796 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:21.045385  4717 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:21.056151  1437 catalog_manager.cc:5697] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 2 to 3, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 3 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:21.057063  4987 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:21.057675  4987 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.058534  1437 catalog_manager.cc:5697] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 7 to 10, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 10 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:21.060796  1654 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:21.036069  5015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:51498 (request call id 68) took 3732 ms. Trace:
I20260709 12:58:21.045665  5086 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:21.061908  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:21.063845  1581 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:21.064617  4591 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:58:21.057688  4909 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:21.066497  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:21.054847  4837 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:21.071545  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:21.072202  1691 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:21.069253  1686 raft_consensus.cc:1240] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:21.048370  4994 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:21.069636  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:21.065104  4987 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:21.078470  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:21.079128  1684 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:58:21.078619  4800 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:21.071462  4837 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.084932  4987 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:21.085561  4987 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.085883  4837 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:21.086984  4631 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:21.091034  1654 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:21.091957  5081 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:21.093226  1583 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:21.094493  1505 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:21.096390  4631 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:21.098281  4631 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:21.098088  5073 consensus_queue.cc:1059] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:21.098681  4631 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:21.101991  1583 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:21.103137  4909 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:58:21.104678  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 43494.9us
I20260709 12:58:21.103641  5009 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:21.104944  1654 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:21.092737  5086 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:21.103564  4909 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:21.116763  4909 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:21.106738  5009 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:21.112687  4987 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:21.092775  5081 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.113471  4591 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:21.114142  4938 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:21.125066  1684 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:58:21.094070  4994 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.099031  5073 raft_consensus.cc:3055] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:58:21.129158  4938 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.129789  5011 raft_consensus.cc:993] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:58:21.130080  1583 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:21.139559  5011 raft_consensus.cc:1081] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:58:21.140843  4938 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:21.127041  5009 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:21.141774  4903 consensus_queue.cc:1059] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:21.142971  4903 raft_consensus.cc:3055] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:21.143405  4903 raft_consensus.cc:740] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:21.131994  5093 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:58:21.134982  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 45632.2us
I20260709 12:58:21.138144  5081 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:21.106918  4991 consensus_queue.cc:1059] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:58:21.141686  1583 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:21.144842  5093 raft_consensus.cc:697] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 12 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:21.149767  4991 raft_consensus.cc:3055] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:21.150174  4991 raft_consensus.cc:740] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:21.150271  5093 consensus_queue.cc:237] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.151000  4991 consensus_queue.cc:260] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.152200  5005 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:58:21.153119  5130 log.cc:927] Time spent T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:58:21.152629  4993 consensus_queue.cc:1175] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" responder_term: 12 status { last_received { term: 9 index: 5 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 11. Current term is 12. Ops: [11.6-11.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:58:21.138918  5073 raft_consensus.cc:740] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:21.154878  5005 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:21.140194  4843 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:21.152313  4991 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:21.144815  4591 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:21.155686  4843 raft_consensus.cc:697] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:21.158638  4843 consensus_queue.cc:237] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.159010  4909 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.159968  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:21.161823  4591 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:21.162264  5005 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.144297  4903 consensus_queue.cc:260] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:21.165297  4903 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:21.061844  5015 rpcz_store.cc:276] 0709 12:58:17.298558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:17.299186 (+   628us) service_pool.cc:224] Handling call
0709 12:58:17.646730 (+347544us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b54000ba020. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85cfce520 00007fc85d057b42 00007fc85d056800 00007fc85d04f9fa 00007fc8620174c9 00007fc85b593c54 00007fc85b593be2 00007fc85b593b11 00007fc85b593a8c 00007fc85b592d42
0709 12:58:18.726236 (+1079506us) spinlock_profiling.cc:243] Waited 881 ms on lock 0x7b5800704fd0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85cfad0aa 00007fc85d02f447 00007fc85d04c70a 00007fc85d04d76a 00007fc85d04c91b 00007fc85d05803c 00007fc85d0576b3 00007fc85d04f9fa 00007fc8620174c9 00007fc85b593c54
0709 12:58:18.740878 (+ 14642us) log.cc:844] Serialized 501 byte log entry
0709 12:58:19.037026 (+296148us) spinlock_profiling.cc:243] Waited 891 us on lock 0x7b18002be8e0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f643f3 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd 000000000038f354 000000000038f199 00007fc859f4783a
0709 12:58:21.028965 (+1991939us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72771,"raft.queue_time_us":2201,"raft.run_cpu_time_us":1383,"raft.run_wall_time_us":50985,"spinlock_wait_cycles":2637750656,"thread_start_us":137389,"threads_started":1,"wal-append.queue_time_us":328397,"wal-append.run_cpu_time_us":1639,"wal-append.run_wall_time_us":1001648}
I20260709 12:58:21.169116  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d5d52e25b9814edbb805e7d6bcce5b5d with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:21.169370  5005 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:21.170998  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:21.171680  1687 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 5.
I20260709 12:58:21.155121  5073 consensus_queue.cc:260] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.173120  5073 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:21.130640  1654 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:21.177103  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 46550us
I20260709 12:58:21.138725  4631 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.178709  1654 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:58:21.180090  4631 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:21.180568  4987 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:21.181249  4987 raft_consensus.cc:697] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:21.182185  4987 consensus_queue.cc:237] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.182703  1687 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50708
I20260709 12:58:21.183466  5086 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:21.183686  1687 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:21.183992  5086 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:21.184264  1687 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:21.186833  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:21.187638  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:21.188647  1610 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:58:21.188815  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:21.189275  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:21.190467  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:21.188884  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:21.192417  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:21.192989  1686 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:21.196051  1612 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:58:21.147387  4994 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:21.096036  4837 consensus_queue.cc:1059] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:58:21.091506  4943 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.199957  1691 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:21.197317  1687 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.184459  5086 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:21.202409  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:21.202551  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:21.214738  1608 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 12:58:21.203286  1505 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:21.204162  4917 consensus_queue.cc:1048] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:21.205011  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:21.211304  1687 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:21.218649  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 90505.5us
I20260709 12:58:21.220089  1689 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:21.221756  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:21.222486  1686 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:21.222841  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:21.224926  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:21.225497  1690 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:21.225896  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:21.226485  1609 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:21.226711  1583 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:21.229359  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:21.219727  4994 raft_consensus.cc:3055] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:21.230584  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:21.232990  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:21.233139  1581 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:21.219686  5015 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:21.231194  1583 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:21.241333  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:21.242604  1689 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:21.238523  1583 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:21.243546  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:21.243790  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:21.244267  1617 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:58:21.244047  5005 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:21.245414  5005 raft_consensus.cc:697] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:21.246685  1505 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:21.246361  5005 consensus_queue.cc:237] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.249142  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:21.249603  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:21.249245  4631 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:21.250815  4911 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:21.254040  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:21.254870  1617 raft_consensus.cc:2410] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:58:21.250923  4631 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:21.255457  4631 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:21.257592  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:21.245024  1613 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:21.259105  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:21.259706  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:21.260320  1616 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:21.259765  1613 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:21.266180  1690 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:21.267151  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:21.232668  4994 raft_consensus.cc:740] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:21.269233  4994 consensus_queue.cc:260] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.270606  4994 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:21.270725  4567 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:21.271310  4567 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.268334  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:21.273291  1611 raft_consensus.cc:2393] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 14: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:21.273420  4567 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:21.274021  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:21.265729  5103 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:21.274791  1581 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:21.249207  4591 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:21.274959  5103 raft_consensus.cc:697] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:21.275650  4591 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.276872  5103 consensus_queue.cc:237] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.277959  4591 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:21.279666  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:21.280522  1608 raft_consensus.cc:2393] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 11: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:21.281627  1615 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:21.282555  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:21.238584  4843 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:58:21.284421  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:21.284178  4843 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:21.285284  4843 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:21.257071  4909 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:21.288668  1609 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:58:21.289680  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:21.290284  1616 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:21.292498  4991 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:21.292824  5134 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:21.293066  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:21.293467  5134 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.294308  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:21.295675  5134 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:21.292326  4631 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.298898  5009 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.300024  1612 raft_consensus.cc:2368] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15.
I20260709 12:58:21.305699  1581 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:21.306492  4991 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:21.306905  4991 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:21.313127  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:21.314006  1691 raft_consensus.cc:2393] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 12: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:21.315822  1616 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
I20260709 12:58:21.313967  4943 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:21.323076  1583 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:21.324148  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:21.324168  1583 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:21.325778  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.326287  1583 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:21.327023  5134 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:21.327453  5134 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:21.327885  5134 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:21.328567  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.329293  1539 raft_consensus.cc:2368] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13.
I20260709 12:58:21.329650  4903 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:21.330153  4903 raft_consensus.cc:697] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:21.330991  4903 consensus_queue.cc:237] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.332891  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:21.333564  1691 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:58:21.336736  1616 raft_consensus.cc:1240] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:21.344097  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:21.344794  1686 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:21.347810  1581 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:21.353428  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:21.354069  1682 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:21.327663  4631 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:21.350323  1583 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:21.357813  1687 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:21.327143  5009 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:21.341271  4994 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:58:21.364487  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:21.344521  4837 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:21.346325  4909 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:21.373399  4909 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:21.353600  5011 consensus_queue.cc:1059] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:58:21.380604  1682 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:21.370332  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:21.382417  1537 raft_consensus.cc:2393] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 12: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:21.367873  1608 raft_consensus.cc:2955] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 6 to 8, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:58:21.387486  1616 raft_consensus.cc:1240] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:21.387643  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.377203  4800 raft_consensus.cc:2764] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:58:21.377453  4994 raft_consensus.cc:697] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:21.393826  5011 raft_consensus.cc:3055] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:58:21.394269  5011 raft_consensus.cc:740] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:21.383759  4631 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:58:21.395535  4631 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:21.395251  5011 consensus_queue.cc:260] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.396445  5011 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:21.399175  1684 raft_consensus.cc:1240] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:21.399901  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:21.400767  1685 raft_consensus.cc:1240] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 12:58:21.401077  4994 consensus_queue.cc:237] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.402760  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:21.404299  1534 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:58:21.404877  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.405395  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.406726  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:21.407461  1538 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:21.406126  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:21.406173  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:21.406788  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:21.406045  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.420789  1686 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:58:21.426625  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:21.427444  1684 raft_consensus.cc:2393] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 11: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:21.365268  4843 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.389427  4993 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:21.395949  4631 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:21.430413  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.434960  1691 raft_consensus.cc:1240] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:21.435518  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:21.440712  1540 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:21.436532  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.437217  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:21.438426  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:58:21.441830  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 94076.9us
I20260709 12:58:21.441946  1682 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:58:21.442452  4993 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.444573  4993 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:21.444952  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:21.445712  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.445932  1689 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:21.448429  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:21.449326  1691 raft_consensus.cc:2393] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 10: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:21.454695  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.455417  1542 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:21.460325  1534 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:21.461544  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:21.462333  1688 raft_consensus.cc:2368] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15.
I20260709 12:58:21.463829  1581 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:21.464166  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:21.464851  5011 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:21.465381  5086 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:21.466114  1581 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:21.467687  5086 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:21.468353  5011 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:21.468844  5011 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:21.469188  5011 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:21.473547  1538 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:21.474059  5134 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.474906  1612 raft_consensus.cc:1240] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:58:21.476017  4843 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:21.394290  4991 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.480191  4991 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:21.482664  1610 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:21.478595  5134 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:21.460209  4909 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:21.487246  1541 raft_consensus.cc:2393] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 10: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:21.491187  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.491577  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.498769  1535 raft_consensus.cc:2393] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 14: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:21.491909  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:21.494783  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.495014  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:21.510067  1682 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:21.513517  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:21.506590  1689 raft_consensus.cc:1275] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:58:21.515530  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 165297us
I20260709 12:58:21.501621  1691 raft_consensus.cc:1240] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:21.521426  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:21.521939  1581 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:21.521960  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:21.526693  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:21.526369  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:21.529865  1686 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:21.529251  1689 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:58:21.534137  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:21.534886  1689 raft_consensus.cc:2393] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 14: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:21.505494  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:58:21.537147  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.553892  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:21.554816  1538 raft_consensus.cc:2393] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 14: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:21.504706  4631 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.558039  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.561614  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.561774  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.562942  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.564992  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:21.567690  1682 raft_consensus.cc:1240] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:21.569394  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.577405  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.577759  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:21.578330  1534 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:58:21.579042  1540 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:21.531208  5108 consensus_queue.cc:1048] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:58:21.583628  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:21.585355  5143 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:21.585973  5143 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.588095  5011 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.588088  5143 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:21.590636  5011 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:21.592592  4631 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:21.543592  4994 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:21.596050  1686 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:21.601851  1534 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:58:21.603392  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:21.564564  4963 consensus_queue.cc:1059] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:58:21.608938  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.616088  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.619405  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:21.620282  1691 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 13
W20260709 12:58:21.633430  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 104752us
I20260709 12:58:21.609861  4994 raft_consensus.cc:697] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:21.637602  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:21.638490  4994 consensus_queue.cc:237] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.642781  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:21.643332  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:21.647945  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.651490  1614 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 8.
I20260709 12:58:21.653623  1610 raft_consensus.cc:1275] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:58:21.667593  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.671301  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:21.675320  1583 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:21.678182  1583 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:21.679508  1537 raft_consensus.cc:1275] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:21.686427  1691 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
I20260709 12:58:21.693740  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:21.694525  1542 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:21.695640  1583 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:21.699338  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.706836  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:21.707199  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:21.707806  1539 raft_consensus.cc:2393] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 10: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:21.695907  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:21.710743  1537 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:21.711340  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.714640  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:47506
I20260709 12:58:21.715412  1541 raft_consensus.cc:606] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:21.715794  1541 raft_consensus.cc:614] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:21.690376  4631 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:58:21.682624  4911 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:21.720458  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:21.727236  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.706905  4843 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:21.730957  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.693955  4963 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:58:21.732389  4631 raft_consensus.cc:697] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:21.718683  4909 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:58:21.742977  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 47442.4us
I20260709 12:58:21.749738  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.750087  1583 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:21.755334  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:21.732683  4911 raft_consensus.cc:697] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:21.734695  4843 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:21.759021  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.765614  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.766178  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:21.766824  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:21.768159  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:21.772920   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:58:21.759244  5005 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:21.778663  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:21.785090  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:21.785988  1534 raft_consensus.cc:2393] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 14: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:21.761202  4843 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:21.792991  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:21.794296   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:21.795233  4911 consensus_queue.cc:237] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.801455  1691 raft_consensus.cc:1275] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:58:21.753039  4909 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.804903  1691 raft_consensus.cc:1275] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:21.809423  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:21.813270  1617 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:58:21.813490  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:21.818775  1610 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 14.
I20260709 12:58:21.826781  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:21.827699  1541 raft_consensus.cc:2368] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 11. Current term is 12.
I20260709 12:58:21.814009  1508 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:21.823801  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:21.828737  1613 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:58:21.829741  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:21.770210  5152 consensus_queue.cc:1048] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:58:21.841825  1541 raft_consensus.cc:3055] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:21.842301  1541 raft_consensus.cc:740] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:21.843030  1541 consensus_queue.cc:260] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.844000  1541 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:21.844571  3947 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:21.845762  1534 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:58:21.847879  1610 raft_consensus.cc:1240] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:58:21.849090  1610 raft_consensus.cc:1240] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:21.849957  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:21.853036  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:21.801734  4631 consensus_queue.cc:237] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.862051  1611 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:21.863716  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:21.860167  1537 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:21.861105  1655 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:21.868386  1615 raft_consensus.cc:1240] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:21.868669  1609 raft_consensus.cc:1275] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:21.877606  1541 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:58:21.877761  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 63834.6us
W20260709 12:58:21.879204  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 121071us
I20260709 12:58:21.880388  1581 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:21.882192  1581 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:21.882120  1508 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:21.884780  4837 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:58:21.887112  5154 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:58:21.889873  1581 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:21.890683  4837 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:58:21.892815  1581 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:21.899178  3947 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:58:21.899335  1542 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:58:21.900954  1581 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:21.903435  1655 leader_election.cc:400] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13.
I20260709 12:58:21.903744  1655 leader_election.cc:403] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:21.906054  1540 raft_consensus.cc:3055] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:21.906468  1540 raft_consensus.cc:740] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:21.907176  1540 consensus_queue.cc:260] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.908058  1540 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:21.908950  1536 raft_consensus.cc:3055] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:21.909327  1683 raft_consensus.cc:1240] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:21.911034  4867 consensus_queue.cc:1059] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:58:21.913944  1508 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:21.909336  1536 raft_consensus.cc:740] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:21.885222  5086 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:21.900775  4993 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:21.912333  1612 raft_consensus.cc:2955] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 4 to 9, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:58:21.927824  1536 consensus_queue.cc:260] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.920920  5073 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:58:21.940791  1536 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:21.922851  5005 raft_consensus.cc:697] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:58:21.958441  5146 log.cc:927] Time spent T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.217s	user 0.001s	sys 0.002s
I20260709 12:58:21.960767  5073 raft_consensus.cc:697] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:58:21.961995  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 48139.1us
I20260709 12:58:21.961787  5073 consensus_queue.cc:237] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.943269  5086 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13.
I20260709 12:58:21.953824  4843 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:21.967805  1614 raft_consensus.cc:2393] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 9: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:21.969084  4843 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:21.978185  1654 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:58:21.978832  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:21.992657  1540 raft_consensus.cc:1275] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:58:22.017383  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 54670.1us
I20260709 12:58:22.016916  1654 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:22.020011  1654 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:22.022696  5169 raft_consensus.cc:2764] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:58:22.028429  4631 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:22.022746  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 127932us
W20260709 12:58:22.022960  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 67622.8us
I20260709 12:58:22.031216  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:22.031963  1655 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:22.036993  1685 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:58:22.006731  5086 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:58:22.013108  5009 consensus_queue.cc:1048] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:58:22.050503  4911 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:22.051296  1583 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:22.035306  5163 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:58:22.038522  5169 raft_consensus.cc:2764] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:58:22.029057  4631 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:22.048177  4987 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:22.041841  5165 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:58:22.050494  5086 consensus_queue.cc:1243] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer c262eac7fc904ae9bb91e450f6532e3f log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:58:22.070935  1655 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:22.087399  1505 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:58:22.087486  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 67546.2us
I20260709 12:58:22.088594  1505 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:22.090525  1655 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:22.092206  1541 raft_consensus.cc:3055] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:22.092708  1541 raft_consensus.cc:740] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:22.067796  1616 raft_consensus.cc:2955] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 4 to 7, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:58:22.033697  5005 consensus_queue.cc:237] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:22.065527  4994 consensus_queue.cc:1048] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:58:22.097743  1542 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:58:22.069003  5073 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:22.072342  5108 raft_consensus.cc:3055] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:58:22.091859  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 69838.9us
I20260709 12:58:22.081053  5086 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:22.102502  1505 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:22.104175  1541 consensus_queue.cc:260] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:22.090457  1654 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:22.073388  5165 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:22.114964  1541 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:22.118392  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:22.118516  5172 raft_consensus.cc:2764] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:58:22.119415  5172 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:22.083284  5169 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:58:22.105701  5108 raft_consensus.cc:740] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
W20260709 12:58:22.137337  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 46890us
W20260709 12:58:22.138418  5148 log.cc:927] Time spent T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.421s	user 0.002s	sys 0.000s
I20260709 12:58:22.138290  1655 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:22.139936  5108 consensus_queue.cc:260] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:22.140408  1655 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:22.141260  5108 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:22.141639  1541 raft_consensus.cc:1275] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:58:22.142016  1541 pending_rounds.cc:85] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 5
I20260709 12:58:22.144044  5086 raft_consensus.cc:2804] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:22.130541  5170 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:58:22.109453  5165 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:22.147084  1541 pending_rounds.cc:107] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:58:22.151067  1541 raft_consensus.cc:2889] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:22.151234  5170 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:22.149500  5086 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:22.152354  5086 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:22.131762  5172 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:58:22.170943  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 80556.1us
I20260709 12:58:22.150241  4987 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:22.164595  5174 consensus_queue.cc:1059] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:58:22.172833  1654 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:22.174181  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 71751.4us
I20260709 12:58:22.155700  5163 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:22.185586  1505 leader_election.cc:400] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15.
I20260709 12:58:22.186021  1505 leader_election.cc:403] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:22.186355  1654 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:22.189039  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 81498us
I20260709 12:58:22.189872  1508 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:22.190977  1654 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:22.166563  5172 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:22.193184  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 52890.4us
I20260709 12:58:22.193984  1655 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:22.192098  5170 raft_consensus.cc:2764] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:58:22.199154  1536 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:58:22.202006  2267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:22.202373  5166 raft_consensus.cc:3055] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:22.202809  5166 raft_consensus.cc:740] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:22.203694  5166 consensus_queue.cc:260] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:22.206789  1654 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:22.209694  4987 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:22.210249  4987 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:22.210637  4987 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:22.213789  1655 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:22.215379  5170 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:22.216140  5170 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:22.204805  5169 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:22.220839  5169 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:22.221233  5169 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:22.223044  1655 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:22.226042  5178 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:22.228380  1655 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:22.284181  1682 raft_consensus.cc:1275] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:58:22.280012  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:22.242138  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:22.284179  1688 raft_consensus.cc:1275] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:22.303066  1534 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:22.265497  1689 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:58:22.229807  1654 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:22.306627  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:22.205845  5166 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:22.301002  1690 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
W20260709 12:58:22.320947  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 91236.6us
I20260709 12:58:22.322687  1654 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:22.324399  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 118549us
I20260709 12:58:22.326133  1508 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:22.245226  4837 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:22.262108  5163 raft_consensus.cc:697] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:22.261902  4567 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15.
I20260709 12:58:22.236074  4631 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:22.279884  5176 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:22.308372  5178 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:22.230545  5179 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:22.344652  1611 raft_consensus.cc:1240] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 10. Current term is 11. Ops: []
W20260709 12:58:22.345080  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 137854us
I20260709 12:58:22.348906  5179 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:58:22.349211  5185 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:22.357508  5185 raft_consensus.cc:697] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:22.357627  5163 consensus_queue.cc:237] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:22.358518  5185 consensus_queue.cc:237] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:22.356598  1508 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:22.375547  3947 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:58:22.385061  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 57031.6us
I20260709 12:58:22.394502  1508 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:22.364974  4567 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.364566  5170 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:22.356657  5178 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:22.339395  4837 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:22.378033  5176 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:22.411298  1583 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:22.427075  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 59317.9us
I20260709 12:58:22.438812  1508 leader_election.cc:400] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15.
I20260709 12:58:22.413630  5174 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:22.401481  4800 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:58:22.441324  1505 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:22.452826  1691 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:58:22.452860  5177 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:22.401782  4567 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:22.460155  4993 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:22.464665  1690 raft_consensus.cc:3055] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:58:22.465070  1690 raft_consensus.cc:740] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:22.465903  1690 consensus_queue.cc:260] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:22.438586  5073 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:58:22.468303  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 73495.1us
I20260709 12:58:22.476401  1654 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:22.479182  1690 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:22.431679  5086 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:22.483244  1616 raft_consensus.cc:1275] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:22.503042  1611 raft_consensus.cc:1217] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Deduplicated request from leader. Original: 8.6->[9.7-13.9]   Dedup: 9.7->[11.8-13.9]
I20260709 12:58:22.503633  1611 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 13. Current term is 14. Ops: [9.7-13.9]
I20260709 12:58:22.478273  5073 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:22.502020  5009 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:58:22.500160  5179 raft_consensus.cc:697] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 14 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:22.442512  5165 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:22.527647  5086 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:22.531534  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:22.535151  4987 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:22.537084  5181 log.cc:927] Time spent T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 12:58:22.480841  4909 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:22.557878  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 154473us
W20260709 12:58:22.561206  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:22.392688  5161 consensus_queue.cc:1048] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.185s
W20260709 12:58:22.639345  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 143178us
I20260709 12:58:22.465452  5151 consensus_queue.cc:1048] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.212s
I20260709 12:58:22.502627  5170 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:22.570720  5073 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:22.637977  1690 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:58:22.440138  5158 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.161s
I20260709 12:58:22.495164  5191 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.142s
I20260709 12:58:22.404525  5184 consensus_queue.cc:1059] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.216s
I20260709 12:58:22.525468  5189 consensus_queue.cc:1048] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
W20260709 12:58:22.574353  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 348627us
I20260709 12:58:22.390074  5187 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.225s
I20260709 12:58:22.609351  5172 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:22.658697  1690 pending_rounds.cc:85] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 8
I20260709 12:58:22.813494  5157 consensus_queue.cc:1048] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:58:22.838248  5172 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:22.828593  1537 raft_consensus.cc:1275] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:58:22.839196  1690 pending_rounds.cc:107] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:58:22.839536  1690 raft_consensus.cc:2889] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:22.846855  5073 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
W20260709 12:58:22.833244  5166 consensus_meta.cc:287] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.504s	user 0.006s	sys 0.004s
I20260709 12:58:22.732447  5179 consensus_queue.cc:237] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:22.732165  5169 consensus_meta.cc:287] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.510s	user 0.007s	sys 0.000s
I20260709 12:58:22.850343  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:22.850667  5169 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:22.802328   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:58:22.852733  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:22.859632  5189 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.841226  5184 raft_consensus.cc:3055] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:58:22.861399  5184 raft_consensus.cc:740] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:22.862759  5166 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:22.863428  5166 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:22.865675  5166 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:22.673075  4837 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:22.735359  4567 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:22.862329  5184 consensus_queue.cc:260] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:22.869292  5184 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:58:22.674599  5165 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:22.830686  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:22.886791  1612 raft_consensus.cc:2393] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 6: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:22.840179  5195 consensus_queue.cc:1059] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:58:22.737967  5186 consensus_queue.cc:1048] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 12:58:22.859464  1440 catalog_manager.cc:5697] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 4 to 9, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New cstate: current_term: 9 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:22.888353  5195 raft_consensus.cc:3055] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:22.839697  5174 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:22.888777  5195 raft_consensus.cc:740] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:22.889658  5195 consensus_queue.cc:260] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:22.891139  5195 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:22.861128  5189 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:22.894295  5189 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:22.677168  5188 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 12:58:22.880970  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:22.883244  4843 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:22.895293  4843 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:22.896399  1615 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:22.897509  4843 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:22.727612  5163 consensus_queue.cc:1059] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.116s
I20260709 12:58:22.852747  5169 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:22.899053  5163 raft_consensus.cc:3055] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:22.899505  5163 raft_consensus.cc:740] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:22.900537  5163 consensus_queue.cc:260] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:22.901170  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:22.903824  1613 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:58:22.902431  1612 raft_consensus.cc:1275] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:58:22.905046  1610 raft_consensus.cc:1240] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:22.906665  5163 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:22.907053  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:22.908535  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:22.909704  1615 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:22.912374  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:22.722738  4909 consensus_queue.cc:1059] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.192s
I20260709 12:58:22.915457  5174 raft_consensus.cc:3055] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:22.915940  5174 raft_consensus.cc:740] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:22.916375  1505 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:22.916785  5174 consensus_queue.cc:260] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:22.917757  5186 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:22.918601  5186 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:22.918545  4567 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:22.919209  5186 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:22.920501  4567 consensus_queue.cc:1059] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:22.921691  4567 raft_consensus.cc:3055] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:22.922055  4567 raft_consensus.cc:740] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:22.927611  5186 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:22.928138  1654 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:22.930009  5186 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:22.932104  5198 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:22.932896  5198 raft_consensus.cc:697] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:22.931617  1684 raft_consensus.cc:1275] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:58:22.933812  5198 consensus_queue.cc:237] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:22.935595  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:22.935616  5185 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.918776  5174 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:22.940156  1687 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:58:22.940877  1690 raft_consensus.cc:1275] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:58:22.838727  1655 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:22.946671  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:22.963845  1615 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 14.
I20260709 12:58:22.961084  1612 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:22.967871  1537 raft_consensus.cc:1275] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:58:22.968025  1542 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
W20260709 12:58:22.969543  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 130894us
I20260709 12:58:22.874898  4987 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:22.971369  1655 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:22.977599  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:22.971125  5185 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:22.983654  5185 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:22.983767  5187 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:22.976248  5134 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.985170  5134 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:22.985713  5178 consensus_meta.cc:287] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.554s	user 0.004s	sys 0.005s
I20260709 12:58:22.987129  4843 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.922909  4567 consensus_queue.cc:260] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:22.903318  5190 log.cc:927] Time spent T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.451s	user 0.006s	sys 0.007s
W20260709 12:58:23.014931  1508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.000s	sys 0.004s
W20260709 12:58:23.017091  1508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.000s	sys 0.004s
W20260709 12:58:23.017436  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 521370us
I20260709 12:58:23.018131  1508 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:23.021014  1654 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:23.024353  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:23.026798  1535 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:58:23.023553  1505 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:23.028730  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:22.985085  5073 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:23.033967  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:23.036127  1616 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 10. Current term is 11. Ops: []
W20260709 12:58:23.037312  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 66047.5us
I20260709 12:58:23.038148  1655 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:23.040032  1611 raft_consensus.cc:1275] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:58:23.042588  1508 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:23.025326  5134 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:23.030027  4987 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:23.050755  1655 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:23.053587  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:23.014237  5178 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:23.031100  5195 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:23.029745  4800 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:23.061816  1655 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:23.151875  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:23.037063  5189 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:23.046288  5193 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:23.043716  4909 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:23.044270  5103 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:23.150580  1615 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:58:23.015544  4843 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:23.051160  5187 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:23.151861  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:23.204345  1535 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:23.055325  5166 consensus_queue.cc:1059] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.116s
W20260709 12:58:23.154919  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 95700.5us
I20260709 12:58:23.153399  4987 raft_consensus.cc:697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 12 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:23.159384  1683 raft_consensus.cc:1240] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: []
W20260709 12:58:23.162760  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 110098us
I20260709 12:58:23.158774  5134 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:58:23.051067  5158 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.109s
I20260709 12:58:23.195588  1505 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:23.153517  1542 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:23.061260  5177 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.115s
I20260709 12:58:23.158449  5170 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:23.155668  5189 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:23.052038  4567 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:23.215471  1508 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:23.182255  5086 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 14 LEADER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:58:23.219336  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 163884us
I20260709 12:58:23.187721  5182 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.127281  5195 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:23.211871  5103 raft_consensus.cc:697] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:23.229388  1508 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:23.238174  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:23.163942  4800 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:23.297037  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 85554.8us
I20260709 12:58:23.297593  5154 consensus_queue.cc:1048] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:23.293475  5172 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:58:23.309515  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 247779us
W20260709 12:58:23.294103  5205 log.cc:927] Time spent T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:58:23.222208  5158 consensus_queue.cc:1243] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:58:23.170281  5196 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:58:23.315935  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:23.385313  1686 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:23.220027  5187 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 12:58:23.335457  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 106174us
I20260709 12:58:23.335343  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:58:23.387758  5211 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:58:23.295466  5189 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:23.299734  4909 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:23.395850  1508 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:23.369421  1655 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:23.370343  1581 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:23.377869  1533 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:58:23.410430  1655 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:23.411846  1655 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:23.437047  1615 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:58:23.311204  5182 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:23.400697  5184 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:58:23.463335  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 93065.2us
W20260709 12:58:23.476509  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 80783.3us
I20260709 12:58:23.478138  1508 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:23.479846  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 68096us
I20260709 12:58:23.475507  5219 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:23.463572  5185 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:23.437285  4993 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:58:23.492071  1535 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:23.398536  4994 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 12:58:23.487248  5214 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.404763  5187 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:23.496340  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 102117us
I20260709 12:58:23.505579  1690 pending_rounds.cc:85] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 7
I20260709 12:58:23.506055  1690 pending_rounds.cc:107] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:58:23.506314  1690 raft_consensus.cc:2889] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:23.481757  5134 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:23.481487  5227 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:23.525449  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:23.526314  1688 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:23.527498  5194 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.528043  5194 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:23.529686  5207 log.cc:927] Time spent T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 12:58:23.451509  5103 consensus_queue.cc:237] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:23.459740  4987 consensus_queue.cc:237] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:23.498411  5178 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:23.521925  5185 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:23.500573  5143 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:58:23.533766  5224 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:23.560746  1581 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:23.522617  5172 raft_consensus.cc:697] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:23.576395  5226 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:58:23.515527  5214 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:23.577754  5213 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:23.578326  5213 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:23.524871  5134 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:23.579640  5163 consensus_meta.cc:287] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.672s	user 0.008s	sys 0.000s
I20260709 12:58:23.533743  5217 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.599136  5172 consensus_queue.cc:237] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:23.562036  5086 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.109s
I20260709 12:58:23.889911  5225 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:24.044440  5234 log.cc:927] Time spent T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.450s	user 0.001s	sys 0.000s
I20260709 12:58:23.827292  5005 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.950074  5187 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:23.928395  5200 log.cc:927] Time spent T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 12:58:23.580739  5134 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:23.896850  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 418786us
I20260709 12:58:24.055822  1508 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:23.857520  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:23.677368  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 94543.7us
I20260709 12:58:23.931566  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:23.960301  4567 consensus_meta.cc:287] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.659s	user 0.007s	sys 0.002s
W20260709 12:58:23.715412  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 233268us
I20260709 12:58:24.096325  1655 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:23.575567  4911 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:58:23.928790  5210 log.cc:927] Time spent T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.403s	user 0.001s	sys 0.000s
I20260709 12:58:24.104871  1687 raft_consensus.cc:2393] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 9: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 12:58:24.105187  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 45970us
I20260709 12:58:23.955528  5215 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 12:58:23.936239  5174 consensus_meta.cc:287] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.966s	user 0.005s	sys 0.005s
I20260709 12:58:24.125705  5236 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:23.586055  5213 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:23.771733  5163 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.922448  5214 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:23.890710  5221 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:23.933892  5195 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:23.891109  5231 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:23.685302  5227 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:23.966517  5182 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.050608  5005 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:24.167881  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 71671.4us
W20260709 12:58:24.168406  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 112705us
I20260709 12:58:24.174484  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1814) took 1238 ms. Trace:
I20260709 12:58:24.207986  1608 rpcz_store.cc:276] 0709 12:58:22.929820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.932414 (+  2594us) service_pool.cc:224] Handling call
0709 12:58:22.932745 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:22.953370 (+ 20625us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:22.953404 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:22.962064 (+  8660us) log.cc:844] Serialized 26 byte log entry
0709 12:58:23.051644 (+ 89580us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:23.051678 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:23.051741 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:24.167554 (+1115813us) raft_consensus.cc:1685] finished
0709 12:58:24.167573 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:24.167711 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68053,"raft.queue_time_us":26531,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":4926,"thread_start_us":74753,"threads_started":1,"wal-append.queue_time_us":235921}
I20260709 12:58:24.174463  4911 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.167498  5232 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:24.182689  1583 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:23.945492  5194 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.049801  5225 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:24.194046  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:24.128017  4567 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:58:24.197520  1684 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.001s	sys 0.018s
W20260709 12:58:23.937994  5189 consensus_meta.cc:287] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.000s
I20260709 12:58:24.196969  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:24.215695  1655 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:23.971244  5152 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:24.212225  3947 consensus_queue.cc:1048] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:24.219738  1583 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:24.194087  5174 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:24.224916  1687 raft_consensus.cc:2393] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 10: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 12:58:24.222882  1684 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.002s	sys 0.018s
W20260709 12:58:24.264248  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 48663.7us
I20260709 12:58:23.638545  5217 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.178442  5163 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:24.266804  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 47839.3us
W20260709 12:58:24.270961  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 109653us
I20260709 12:58:24.272581  1655 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:24.169958  5215 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.280572  1655 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:24.224457  5236 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.287407  1655 leader_election.cc:400] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 11. Current term is 12.
I20260709 12:58:24.221794  4911 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.288666  5187 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:24.273386  5195 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:24.304294  4911 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.288884  5237 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:58:24.221257  5182 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:58:24.301368  5225 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.317181  5187 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:24.301347  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2118) took 1861 ms. Trace:
I20260709 12:58:24.317894  1683 rpcz_store.cc:276] 0709 12:58:22.439911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.440111 (+   200us) service_pool.cc:224] Handling call
0709 12:58:22.450962 (+ 10851us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:23.215125 (+764163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:24.300984 (+1085859us) spinlock_profiling.cc:243] Waited 708 ms on lock 0x7b5400158454. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:24.301211 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1628851456}
I20260709 12:58:24.295759  1655 leader_election.cc:403] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:58:24.251677  4567 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.320575  5239 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:24.321180  4567 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.322711  5005 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.323143  5239 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:24.323807  5239 consensus_queue.cc:1243] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:58:24.326619  5163 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.329982  5217 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.198769  5221 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.336760  5221 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.223378  5232 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.339515  5232 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:24.280515  4991 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:24.192924  5231 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:24.210316  5227 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.261695  5189 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:24.374469  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 82982.3us
I20260709 12:58:24.291790  5157 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:24.280020  5214 consensus_queue.cc:1048] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.091s
I20260709 12:58:24.267982  5152 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:58:24.374418  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 89160.2us
I20260709 12:58:24.379105  1581 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:24.371513  4991 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.370582  5232 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:24.353433  5239 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.378131  5195 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 11. Current term is 12.
I20260709 12:58:24.379515  5157 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.387272  5221 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.405642  5227 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.407814  5157 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:24.416857  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:24.417575  1686 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 10.
I20260709 12:58:24.418613  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:24.418938  5209 log.cc:927] Time spent T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 1.002s	user 0.012s	sys 0.011s
I20260709 12:58:24.412631  5248 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.419982  5248 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.421386  5235 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.422428  5248 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:24.423108  5219 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:24.423679  5219 raft_consensus.cc:697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:24.424561  5219 consensus_queue.cc:237] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:24.426582  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:24.428002  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:24.411926  5221 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.428954  2269 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 12:58:24.429823  5225 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:24.430230  5225 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.430622  5225 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:24.430825  5221 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.431771  1686 raft_consensus.cc:2368] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15.
I20260709 12:58:24.432396  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2136) took 1129 ms. Trace:
I20260709 12:58:24.432811  1685 rpcz_store.cc:276] 0709 12:58:23.303459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:23.303574 (+   115us) service_pool.cc:224] Handling call
0709 12:58:23.303939 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:23.568521 (+264582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:23.568558 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:23.772202 (+203644us) log.cc:844] Serialized 26 byte log entry
0709 12:58:24.270522 (+498320us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:24.270558 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:24.270625 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:24.432188 (+161563us) raft_consensus.cc:1685] finished
0709 12:58:24.432213 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:24.432340 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21982,"raft.queue_time_us":33166,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":7151,"thread_start_us":527101,"threads_started":2,"wal-append.queue_time_us":466868}
I20260709 12:58:24.434605  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:24.434921  5231 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:24.435920  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:24.436414  5215 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.438153  1689 raft_consensus.cc:2393] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 10: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:24.438002  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:24.438297  5189 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:24.440286  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:24.441059  1686 raft_consensus.cc:2368] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15.
I20260709 12:58:24.441820  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:24.434857  5248 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:24.443143  5214 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:24.442785  5248 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.437273  5157 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.443704  5214 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:24.445173  5152 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.421970  5235 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.445603  5248 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:24.445933  5214 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:24.447145  5235 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.447626  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:24.448261  5225 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:24.387812  4991 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:24.445050  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:24.450394  1508 leader_election.cc:400] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15.
I20260709 12:58:24.450613  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:24.453864  1686 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:24.460948  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1813) took 1548 ms. Trace:
I20260709 12:58:24.465090  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:24.340539  5236 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.468766  1508 leader_election.cc:400] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15.
I20260709 12:58:24.465962  1685 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 3.
I20260709 12:58:24.474318  2269 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 12:58:24.461669  1613 rpcz_store.cc:276] 0709 12:58:22.912303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.912833 (+   530us) service_pool.cc:224] Handling call
0709 12:58:22.913188 (+   355us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:22.943416 (+ 30228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:22.943449 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:22.944095 (+   646us) log.cc:844] Serialized 52 byte log entry
0709 12:58:23.047779 (+103684us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:23.056694 (+  8915us) log.cc:844] Serialized 14 byte log entry
0709 12:58:23.208504 (+151810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:23.208580 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:24.418201 (+1209621us) spinlock_profiling.cc:243] Waited 8.85 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:58:24.452170 (+ 33969us) raft_consensus.cc:1685] finished
0709 12:58:24.460676 (+  8506us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:24.460881 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50482,"prepare.queue_time_us":8289,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":110729,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":67971,"spinlock_wait_cycles":20360448,"thread_start_us":154156,"threads_started":2,"wal-append.queue_time_us":365276}
I20260709 12:58:24.389508  5161 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:58:24.394050  5232 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.460994  5241 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:24.393833  5239 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.546773  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:24.549055  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 170027us
W20260709 12:58:24.551940  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 97255.9us
I20260709 12:58:24.557098  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:24.558306  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:24.558857  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:24.559011  1538 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:24.559114  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:24.559609  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:24.560168  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:24.560735  1686 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:24.560860  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:24.556250  1508 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:24.563644  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:24.563828  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:24.564272  1536 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:58:24.564410  1538 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:24.561517  1537 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:24.452665  5179 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.572125  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:24.578902  1536 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:58:24.573241  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:24.573997  4843 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.561196  5169 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:24.574841  5157 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.576205  5244 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.487339  5163 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:24.486420  4567 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.518522  5217 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:24.555128  5221 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:24.554517  5225 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 11 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.486744  5182 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.598944  1685 raft_consensus.cc:1240] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:24.487493  5152 raft_consensus.cc:2804] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:58:24.561623  5214 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:24.569921  5260 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:24.577530  5174 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:24.614060  1686 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 11.
I20260709 12:58:24.630205  1685 raft_consensus.cc:1275] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 12:58:24.631048  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 74859.1us
I20260709 12:58:24.633759  1508 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:24.609905  5227 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:24.562602  5241 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:24.604015  4567 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:24.639969  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 58666.2us
I20260709 12:58:24.610550  5152 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:24.587566  5179 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.644723  5266 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:24.645496  5239 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:24.651232  4994 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.651793  4991 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.652572  5143 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:24.653709  4631 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.654163  5241 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:24.604934  5163 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.655987  5184 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:24.637874  5227 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:24.678520  5227 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:24.657903  5259 log.cc:927] Time spent T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:58:24.600548  5169 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:24.606393  5217 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:24.602903  5244 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.607687  5221 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.645403  5177 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.614039  5182 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.666002  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:24.667514  5219 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:24.701337  5219 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.669364  4631 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.670059  5143 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.670449  1542 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:24.626157  5214 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.672298  5179 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:24.672816  5258 log.cc:927] Time spent T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:58:24.628672  5174 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.670753  4994 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.659384  5152 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:24.711853  5217 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:24.670151  4567 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.697885  5244 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.699656  5221 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.700213  5177 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.713295  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:24.713174  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2127) took 1802 ms. Trace:
I20260709 12:58:24.714457  1682 rpcz_store.cc:276] 0709 12:58:22.910547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:22.910686 (+   139us) service_pool.cc:224] Handling call
0709 12:58:22.934670 (+ 23984us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b5800190898. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc86202afc0 00007fc862015929 00007fc8620153d2 00007fc85b58cbd4
0709 12:58:22.934847 (+   177us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:22.935174 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:58:22.935200 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:24.311376 (+1376176us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b2c00128aa8. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85b94aa11 00007fc85b95a372 00007fc85d08ca01 00007fc85d05143a 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2
0709 12:58:24.311961 (+   585us) log.cc:844] Serialized 26 byte log entry
0709 12:58:24.377224 (+ 65263us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:58:24.377273 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:24.377346 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:24.712953 (+335607us) raft_consensus.cc:1685] finished
0709 12:58:24.712979 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:24.713115 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6201,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"spinlock_wait_cycles":114468352,"thread_start_us":64420,"threads_started":1,"wal-append.queue_time_us":154354}
I20260709 12:58:24.664489  5266 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.708390  5174 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.627074  5260 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:24.717272  5236 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:24.737573  5182 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.738325  5177 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.741581  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1402) took 1692 ms. Trace:
I20260709 12:58:24.742008  1616 rpcz_store.cc:276] 0709 12:58:23.049059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:23.049212 (+   153us) service_pool.cc:224] Handling call
0709 12:58:23.063396 (+ 14184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:23.063585 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:23.169698 (+106113us) log.cc:844] Serialized 14 byte log entry
0709 12:58:24.658328 (+1488630us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b180043e040. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f61455 00007fc85d049060 00007fc85d05b716 00007fc85d06c287 00007fc85d06c208
0709 12:58:24.741028 (+ 82700us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:24.741081 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:24.741134 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:24.741380 (+   246us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:24.741521 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79851,"prepare.queue_time_us":18742,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":70,"raft.queue_time_us":125290,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":12126,"spinlock_wait_cycles":9181056,"thread_start_us":82560,"threads_started":1}
I20260709 12:58:24.744771  1616 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:24.744979  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:24.746564  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:24.749020  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:24.749655  1614 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:58:24.749018  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:24.752033  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:24.755098  1614 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:58:24.756549  2299 raft_consensus.cc:2368] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 10. Current term is 11.
I20260709 12:58:24.756421  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:24.757472  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:24.759933  1654 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:24.763582  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:24.764277  1608 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:24.717736  5266 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.768198  1654 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:24.765966  4631 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.769259  5163 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.772946  5231 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:24.741261  5235 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:24.773684  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:24.779263  1615 raft_consensus.cc:1813] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Handling vote request from an unknown peer 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:24.779886  1615 raft_consensus.cc:2410] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:58:24.776005  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:24.763787  5239 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:24.770802  4631 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:24.778748  5231 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:24.831805  5214 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:24.832598  5272 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.833359  5272 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.796697  5239 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:24.844295  5239 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:24.773805  5189 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:58:24.849694  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:24.851025  1615 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:58:24.794057  5235 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.853396  5227 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.855201  5152 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:24.856326  5272 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.855659  5227 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.860592  1582 leader_election.cc:400] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Vote denied by peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437) with higher term. Message: Invalid argument: T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 10. Current term is 11.
I20260709 12:58:24.878840  1582 leader_election.cc:403] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:24.839207  4631 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.839663  5231 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:24.863642  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:24.866034  4994 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.877753  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:24.882295  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 248585us
I20260709 12:58:24.997121  1613 raft_consensus.cc:2410] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:58:24.997259  1508 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:24.883350  5232 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:24.884315  5219 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.887604  5260 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:24.913587  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2135) took 1610 ms. Trace:
I20260709 12:58:25.000577  1691 rpcz_store.cc:276] 0709 12:58:23.303050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:23.304553 (+  1503us) service_pool.cc:224] Handling call
0709 12:58:23.304883 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:23.311116 (+  6233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:23.311147 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:23.311191 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:23.311233 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:24.913313 (+1602080us) spinlock_profiling.cc:243] Waited 6 ms on lock 0x7b5400288cd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:24.913362 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:24.913517 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13796096}
I20260709 12:58:24.920928  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:25.002040  1609 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:24.894977  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1819) took 1489 ms. Trace:
I20260709 12:58:24.925479  5193 raft_consensus.cc:3055] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:24.929062  1612 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:24.931450  5185 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:25.005964  5185 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:24.933952  5195 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:25.008373  5158 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:25.008719  5195 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:25.005088  1617 rpcz_store.cc:276] 0709 12:58:23.405816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:23.405976 (+   160us) service_pool.cc:224] Handling call
0709 12:58:23.440584 (+ 34608us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:23.488678 (+ 48094us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:23.488711 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:23.489235 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 12:58:24.894331 (+1405096us) spinlock_profiling.cc:243] Waited 8.24 ms on lock 0x7b180043df20. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc85cbf94bc 00007fc859f4748b 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf10d1
0709 12:58:24.894511 (+   180us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:24.894550 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:24.894622 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:24.894671 (+    49us) raft_consensus.cc:1685] finished
0709 12:58:24.894682 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:24.894909 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47558,"raft.queue_time_us":50318,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":7388,"spinlock_wait_cycles":18953472,"thread_start_us":21505,"threads_started":1,"wal-append.queue_time_us":77646}
I20260709 12:58:24.935328  5179 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:24.936776  5169 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:24.939914  5235 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.948935  4991 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.949909  5143 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:24.951447  5170 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.962025  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:25.014645  1609 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 12:58:25.010563  5179 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:25.010627  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:25.016160  1617 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 11
W20260709 12:58:25.017413  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 76583.6us
I20260709 12:58:25.017269  5170 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:25.019454  5170 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:24.990538  1615 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:25.011300  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:24.997994  2299 raft_consensus.cc:1240] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:58:24.999956  5196 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:25.013477  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:25.028457  1541 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:25.030632  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:25.031131  4631 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:25.030686  5270 consensus_queue.cc:1059] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:58:24.874523  5236 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:58:25.023690  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 256019us
I20260709 12:58:25.033612  5194 raft_consensus.cc:3055] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:24.977589  4909 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.016655  4993 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:25.022548  1581 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:25.037012  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:25.068583  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:25.069064  1689 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:25.016955  5193 raft_consensus.cc:740] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:24.977537  5272 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:25.075918  1541 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
W20260709 12:58:25.079356  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 59756.7us
I20260709 12:58:25.022956  1617 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 11.
I20260709 12:58:25.080171  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:25.017055  5011 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:25.080651  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:25.081581  1534 raft_consensus.cc:1217] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Deduplicated request from leader. Original: 8.6->[9.7-13.9]   Dedup: 9.7->[11.8-13.9]
I20260709 12:58:25.011909  5186 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:25.008319  5185 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:25.036183  5170 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:25.172765  5170 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:25.081527  4909 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:25.070003  5158 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:25.176738  5103 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:25.178112  5158 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:25.179840  5153 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:25.180507  5153 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:25.182798  5153 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:25.183408  5229 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:25.184005  5229 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:25.086372  4993 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:25.041175  5194 raft_consensus.cc:740] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:24.998322  5239 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:25.083089  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 85939.5us
I20260709 12:58:25.082700  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:25.079795  5165 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.021s	sys 0.025s
I20260709 12:58:25.148566  1534 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 13. Current term is 14. Ops: [9.7-13.9]
I20260709 12:58:25.148512  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:25.011581  5202 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:25.169956  5011 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:25.170732  5186 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:25.037065  5196 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:25.073726  5169 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:58:25.364115  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 341645us
I20260709 12:58:25.456804  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:25.492856  5227 consensus_queue.cc:1059] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:58:25.491485  5165 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.192s	user 0.028s	sys 0.040s
I20260709 12:58:25.493880  5239 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:25.494311  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:25.494253  1581 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:25.495609  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:25.495867  5186 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:25.149042  5219 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437) with higher term. Message: Invalid argument: T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 10. Current term is 11.
I20260709 12:58:25.186563  5198 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:25.497881  5198 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:25.498984  4800 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:25.499148  5196 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:25.364984  5289 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:25.499996  5289 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:25.500348  5289 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:25.074129  5179 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:25.501364  5202 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:25.503723  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:25.504927  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:25.505522  1539 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:25.506392  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:25.506772  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:25.507195  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:25.241070  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:25.068295  5236 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:25.423203  5152 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 4 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:25.292681  1535 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 12:58:25.512585  1685 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:25.513597  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:25.514195  1687 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:25.516292  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:25.517308  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:25.517465  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:25.517937  1690 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 6.
I20260709 12:58:25.518755  1539 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:58:25.518551  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:25.519740  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:25.079593  5243 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.006s	sys 0.004s
I20260709 12:58:25.519937  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:25.521811  5011 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:25.549382  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:25.550751  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:25.551997  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:25.492012  5169 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:25.522460  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:25.523015  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:25.332504  5232 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:25.186295  5229 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:25.366165  5269 consensus_queue.cc:1059] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.443s
I20260709 12:58:25.512274  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:25.528173  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:25.529323  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:25.529050  5194 consensus_queue.cc:260] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:25.563882  1690 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:25.530867  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:25.532245  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:25.533344  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:25.534595  2269 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 12:58:25.568675  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:25.569300  1683 raft_consensus.cc:2393] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 9: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:25.536653  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:25.491532  1536 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:25.538141  1534 raft_consensus.cc:1813] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Handling vote request from an unknown peer 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:25.570778  1534 raft_consensus.cc:2410] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 12:58:25.538267  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 45901.2us
W20260709 12:58:25.538527  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 45089.5us
I20260709 12:58:25.496318  1537 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:25.548134  5252 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:25.192126  5272 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:25.541035  1687 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:25.540189  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:25.580014  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:25.580717  1537 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:25.581817  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:25.556161  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:25.557379  1541 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:25.559005  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:25.583663  1689 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:25.567483  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:25.350090  5185 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:25.568776  1685 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:25.543107  5243 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.238s	user 0.018s	sys 0.019s
I20260709 12:58:25.568769  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:25.569447  1684 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:58:25.596957  1617 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:25.535274  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:25.512207  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:25.540907  5187 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:58:25.535365  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:25.554621  5239 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:25.608404  1535 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:58:25.610680  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:25.611394  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:25.613394  1616 raft_consensus.cc:2393] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 13: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:25.661173  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:25.622375  1617 raft_consensus.cc:2393] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 12: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:25.641384  3947 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:25.635895  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:25.665773  3947 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:25.666108  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:25.666765  1688 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:58:25.617642  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 46246.4us
I20260709 12:58:25.667788  1581 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:25.639611  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:25.563707  5212 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:58:25.666991  1541 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
W20260709 12:58:26.287825  1508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.000s	sys 0.026s
I20260709 12:58:25.611353  5187 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:25.610078  5185 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:26.437011  1655 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:25.607307  5170 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:26.438253  5170 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:58:26.004010  2266 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 1.700s (SENT) [suppressed 12 similar messages]
W20260709 12:58:25.607596  5231 consensus_meta.cc:287] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.583s	user 0.009s	sys 0.000s
I20260709 12:58:25.844105  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:26.286042  1507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.013s	sys 0.013s
I20260709 12:58:25.583633  5195 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:25.744565  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:26.548991  1617 raft_consensus.cc:1813] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Handling vote request from an unknown peer 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:26.549708  1617 raft_consensus.cc:2410] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:58:25.662763  5229 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:58:26.031420  5285 log.cc:927] Time spent T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.582s	user 0.001s	sys 0.000s
W20260709 12:58:26.442055  1541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2131) took 1361 ms (client timeout 1535 ms). Trace:
I20260709 12:58:25.881224  3947 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:25.839514  5243 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:58:25.779999  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 112326us
I20260709 12:58:26.614727  1581 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:58:26.442919  1689 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.008s	sys 0.000s
W20260709 12:58:26.341540  2269 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.010s	sys 0.000s
W20260709 12:58:26.615916  2269 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.011s	sys 0.000s
W20260709 12:58:26.616376  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 1.08187e+06us
W20260709 12:58:26.351984  1533 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.009s	sys 0.001s
W20260709 12:58:26.617390  1533 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.051s	user 0.009s	sys 0.001s
I20260709 12:58:26.444291  5169 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:26.157188  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.045328  5198 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:25.607617  5270 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 12:58:26.140213  5289 consensus_meta.cc:287] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.639s	user 0.007s	sys 0.000s
I20260709 12:58:25.979408  5202 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:26.435273  1508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.005s	sys 0.030s
I20260709 12:58:25.579648  5232 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:26.208076  5252 consensus_meta.cc:287] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.619s	user 0.006s	sys 0.000s
I20260709 12:58:25.668418  4909 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:26.121353  5291 log.cc:927] Time spent T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 12:58:26.438355  1655 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:26.341358  2267 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.001s	sys 0.009s
W20260709 12:58:26.650581  2267 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.047s	user 0.001s	sys 0.010s
I20260709 12:58:26.448411  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:25.671597  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:26.652765  1690 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:26.652853  1691 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:26.150825  1688 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 4.
I20260709 12:58:26.451941  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:26.653882  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33206 (request call id 227) took 1039 ms. Trace:
W20260709 12:58:26.172461  1685 consensus_meta.cc:287] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.577s	user 0.008s	sys 0.000s
I20260709 12:58:26.453364  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 158) took 1445 ms. Trace:
W20260709 12:58:26.460270  1507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.016s	sys 0.018s
W20260709 12:58:26.655663  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 1.03868e+06us
I20260709 12:58:25.783316  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:26.656909  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1371) took 1129 ms. Trace:
I20260709 12:58:26.613402  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:26.613795  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:26.615504  1689 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.008s	sys 0.000s
I20260709 12:58:26.659169  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2177) took 1075 ms. Trace:
W20260709 12:58:26.613593  1541 rpcz_store.cc:269] 0709 12:58:25.080428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.522217 (+441789us) service_pool.cc:224] Handling call
0709 12:58:26.441983 (+919766us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:26.637442  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:25.640295  5227 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:58:25.979485  5279 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.023s	sys 0.028s
I20260709 12:58:25.868459  5152 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:26.643700  5165 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:26.645720  3947 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:26.454154  5233 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:25.616402  5239 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:25.670315  5194 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:58:26.668000  5279 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.334s	user 0.024s	sys 0.029s
I20260709 12:58:26.648262  5252 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:26.661490  1685 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:26.654279  1688 rpcz_store.cc:276] 0709 12:58:25.614384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.614527 (+   143us) service_pool.cc:224] Handling call
0709 12:58:26.653820 (+1039293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:26.640911  5229 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:26.634192  5243 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 12:58:26.687796  1685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 2169) took 1154 ms (client timeout 1535 ms). Trace:
W20260709 12:58:26.688294  1685 rpcz_store.cc:269] 0709 12:58:25.528951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.530654 (+  1703us) service_pool.cc:224] Handling call
0709 12:58:26.682841 (+1152187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:26.669428  5302 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:26.644532  5270 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:26.664539  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 243336us
I20260709 12:58:26.657264  1535 rpcz_store.cc:276] 0709 12:58:25.527620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.641605 (+113985us) service_pool.cc:224] Handling call
0709 12:58:26.656838 (+1015233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:26.697358  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:26.672833  5298 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:26.698201  1535 raft_consensus.cc:2410] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:58:26.659560  1689 rpcz_store.cc:276] 0709 12:58:25.584257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.584929 (+   672us) service_pool.cc:224] Handling call
0709 12:58:25.589443 (+  4514us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:25.589784 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:25.589812 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:25.616676 (+ 26864us) log.cc:844] Serialized 26 byte log entry
0709 12:58:26.658801 (+1042125us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:26.658845 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:26.658918 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:26.658966 (+    48us) raft_consensus.cc:1685] finished
0709 12:58:26.658978 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:26.659108 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15049,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":17114,"thread_start_us":803696,"threads_started":1,"wal-append.queue_time_us":757417}
W20260709 12:58:26.669727  1608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1839) took 1332 ms (client timeout 1659 ms). Trace:
W20260709 12:58:26.699288  1608 rpcz_store.cc:269] 0709 12:58:25.326558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.499968 (+173410us) service_pool.cc:224] Handling call
0709 12:58:26.613656 (+1113688us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b5800091e98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc8620170a0 00007fc862016984 00007fc85b5916d4 00007fc85b591662
0709 12:58:26.658459 (+ 44803us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53487872}
W20260709 12:58:26.669957  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 231695us
I20260709 12:58:26.673580  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:26.701913  1541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1346) took 1665 ms (client timeout 2141 ms). Trace:
W20260709 12:58:26.702287  1541 rpcz_store.cc:269] 0709 12:58:25.037623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:26.673325 (+1635702us) service_pool.cc:224] Handling call
0709 12:58:26.701852 (+ 28527us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:26.673221  3947 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:26.614217  5231 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:26.619434  5236 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:26.647053  5212 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:26.679731  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:26.705775  1535 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1342) took 1670 ms (client timeout 2157 ms). Trace:
I20260709 12:58:26.828862  5187 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:26.672089  5202 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:26.671231  5303 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:26.646579  5289 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:26.654639  1612 rpcz_store.cc:276] 0709 12:58:25.008338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.026731 (+ 18393us) service_pool.cc:224] Handling call
0709 12:58:25.027063 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:25.176945 (+149882us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:25.176977 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:25.177019 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:25.177056 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:26.453116 (+1276060us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5400445554. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:26.453166 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:26.453302 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344246656}
I20260709 12:58:26.917140  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:26.668933  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 664971us
I20260709 12:58:26.918517  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:26.919900  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:26.678922  5152 raft_consensus.cc:697] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 11 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:58:26.922041  5152 consensus_queue.cc:237] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:26.923035  5232 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:26.712886  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:26.926591  5289 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:26.927058  1541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42356 (request call id 262) took 1384 ms (client timeout 1715 ms). Trace:
W20260709 12:58:26.927508  1541 rpcz_store.cc:269] 0709 12:58:25.542440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:26.712578 (+1170138us) service_pool.cc:224] Handling call
0709 12:58:26.926976 (+214398us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:26.928747  5257 log.cc:927] Time spent T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 2.394s	user 0.045s	sys 0.052s
I20260709 12:58:26.930071  5303 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:26.932588  5202 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:26.935943  5202 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:26.937225  1610 raft_consensus.cc:2393] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 11: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:26.645558  5157 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:26.712394  1655 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:26.736691  5212 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:26.705385  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2123) took 1683 ms. Trace:
I20260709 12:58:26.799664  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2124) took 1776 ms. Trace:
I20260709 12:58:26.736269  2269 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 12:58:26.757046  1583 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:26.663832  1538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2129) took 1622 ms (client timeout 1903 ms). Trace:
I20260709 12:58:26.830226  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:26.838501  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 160) took 1829 ms. Trace:
W20260709 12:58:26.941370  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 184421us
I20260709 12:58:26.835964  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1430) took 1151 ms. Trace:
W20260709 12:58:26.941314  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 205136us
W20260709 12:58:26.859825  1535 rpcz_store.cc:269] 0709 12:58:25.035580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:26.697116 (+1661536us) service_pool.cc:224] Handling call
0709 12:58:26.705714 (+  8598us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:26.827299  1654 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:26.744006  5255 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:26.800886  5185 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:26.786832  5231 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:26.800091  5229 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:26.677363  5165 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:26.948065  5212 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:26.941382  1538 rpcz_store.cc:269] 0709 12:58:25.040984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:26.637177 (+1596193us) service_pool.cc:224] Handling call
0709 12:58:26.663752 (+ 26575us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:26.940305  1533 rpcz_store.cc:276] 0709 12:58:25.023223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.027292 (+  4069us) service_pool.cc:224] Handling call
0709 12:58:25.027586 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:25.167825 (+140239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:25.167858 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:25.456449 (+288591us) log.cc:844] Serialized 26 byte log entry
0709 12:58:26.617863 (+1161414us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:26.617907 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:26.617982 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:26.799450 (+181468us) raft_consensus.cc:1685] finished
0709 12:58:26.799471 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:26.799602 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":204341,"raft.queue_time_us":140484,"raft.run_cpu_time_us":3808,"raft.run_wall_time_us":57565,"thread_start_us":1051749,"threads_started":1,"wal-append.queue_time_us":1124696}
I20260709 12:58:26.949559  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:26.949812  5165 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:26.671361  5227 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:26.950220  1538 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:26.798827  5270 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:26.864610  5194 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.945756  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1790) took 2522 ms. Trace:
I20260709 12:58:26.867646  4909 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.785386  5239 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:26.776995  5296 log.cc:927] Time spent T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:58:26.763866  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 225) took 1150 ms. Trace:
I20260709 12:58:26.699222  5302 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:26.952682  5227 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:26.718469  1616 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:26.711833  5252 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:26.686954  5243 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:26.677553  5233 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:26.953132  5302 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:26.872716  2299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32794 (request call id 241) took 1939 ms. Trace:
I20260709 12:58:26.867580  5272 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:58:26.881718  1540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2132) took 1714 ms (client timeout 1583 ms). Trace:
I20260709 12:58:26.953245  5157 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:58:26.954066  1540 rpcz_store.cc:269] 0709 12:58:25.167430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:26.881469 (+1714039us) service_pool.cc:211] Skipping call since client already timed out
0709 12:58:26.881615 (+   146us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:58:26.950958  5255 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:26.953960  4909 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:26.955297  5233 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:26.955509  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:26.956283  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1341) took 1921 ms. Trace:
I20260709 12:58:26.884135  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1426) took 1279 ms. Trace:
I20260709 12:58:26.953627  5252 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:26.951068  5194 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:26.957878  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 1431) took 1196 ms. Trace:
I20260709 12:58:26.958431  1540 rpcz_store.cc:276] 0709 12:58:25.035345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:26.955206 (+1919861us) service_pool.cc:224] Handling call
0709 12:58:26.956224 (+  1018us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:26.959120  1616 rpcz_store.cc:276] 0709 12:58:25.761798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:26.670216 (+908418us) service_pool.cc:224] Handling call
0709 12:58:26.957820 (+287604us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:26.959949  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:26.960062  5194 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:26.894557  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:26.962842  1615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1828) took 1724 ms (client timeout 1803 ms). Trace:
W20260709 12:58:26.963382  1615 rpcz_store.cc:269] 0709 12:58:25.238901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.241505 (+  2604us) service_pool.cc:224] Handling call
0709 12:58:26.894391 (+1652886us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b5800091e98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc8620170a0 00007fc862016984 00007fc85b5916d4 00007fc85b591662
0709 12:58:26.962785 (+ 68394us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76866432}
I20260709 12:58:26.897053  4993 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:26.898380  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:26.956534  5255 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:26.904440  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:26.975322  1614 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:58:26.940853  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:26.975948  1541 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:58:26.943266  1539 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:26.942575  1583 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:26.939049  1542 rpcz_store.cc:276] 0709 12:58:25.012393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.012580 (+   187us) service_pool.cc:224] Handling call
0709 12:58:25.012946 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:25.072975 (+ 60029us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:25.073005 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:25.082475 (+  9470us) log.cc:844] Serialized 26 byte log entry
0709 12:58:25.545549 (+463074us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:25.545593 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:25.545666 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:26.695442 (+1149776us) raft_consensus.cc:1685] finished
0709 12:58:26.695467 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:26.695632 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":170207,"raft.queue_time_us":69459,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":19546,"thread_start_us":373818,"threads_started":1,"wal-append.queue_time_us":468764}
I20260709 12:58:26.944586  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:26.945171  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 232864us
I20260709 12:58:26.977524  1612 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:26.977998  1655 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:26.945096  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:26.945662  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 118489us
I20260709 12:58:26.942243  1617 rpcz_store.cc:276] 0709 12:58:25.684315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:26.835149 (+1150834us) service_pool.cc:224] Handling call
0709 12:58:26.835427 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:26.835625 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:26.835649 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:26.835693 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:26.835731 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:26.835782 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:26.835903 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:26.979295  1535 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:26.979537  1654 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:26.948648  5300 raft_consensus.cc:2804] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:26.985577  5300 raft_consensus.cc:697] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 4 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:58:26.986596  5300 consensus_queue.cc:237] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:26.987761  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:26.988649  5239 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:26.988694  4993 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:58:26.990043  4993 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:26.990368  4993 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:26.950557  5187 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:26.821161  5230 consensus_queue.cc:1059] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:26.951151  1686 rpcz_store.cc:276] 0709 12:58:24.416042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:24.628722 (+212680us) service_pool.cc:224] Handling call
0709 12:58:24.629009 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:24.633146 (+  4137us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:24.663782 (+ 30636us) log.cc:844] Serialized 14 byte log entry
0709 12:58:24.965645 (+301863us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b180043bbe0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf123a 00007fc85d05ba2a
0709 12:58:25.080646 (+115001us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:25.150196 (+ 69550us) log.cc:844] Serialized 26 byte log entry
0709 12:58:25.455337 (+305141us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:25.455383 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:25.455453 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:26.926138 (+1470685us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b54000e2520. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85cfc6dbe 00007fc85cfd1930 00007fc85cfd18d8 00007fc85cfd1858 00007fc85cfd1813 00007fc85cfd0a9c 00007fc862ebc626 00007fc862eb6dd8 00007fc85d00d7cb 00007fc85d0102c0
0709 12:58:26.937703 (+ 11565us) raft_consensus.cc:1685] finished
0709 12:58:26.937725 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:26.937843 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22739,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":90,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":5704,"spinlock_wait_cycles":638696064,"thread_start_us":114861,"threads_started":1,"wal-append.queue_time_us":391038}
W20260709 12:58:26.704571  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 89951.1us
I20260709 12:58:26.995930  1581 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:26.755532  5186 raft_consensus.cc:3055] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:26.996666  5186 raft_consensus.cc:740] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:26.985481  5243 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:26.996821  1537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1359) took 1954 ms (client timeout 2345 ms). Trace:
I20260709 12:58:26.997568  5186 consensus_queue.cc:260] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:26.998584  5243 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:26.999083  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:26.954216  2299 rpcz_store.cc:276] 0709 12:58:24.932847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:24.933001 (+   154us) service_pool.cc:224] Handling call
0709 12:58:24.933303 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:25.036102 (+102799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:26.872382 (+1836280us) spinlock_profiling.cc:243] Waited 64.5 ms on lock 0x7b54001617d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:26.872609 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148370176}
I20260709 12:58:27.001438  5194 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:27.001778  1583 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:27.003031  5243 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:27.003654  1583 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:27.004418  5243 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:27.004832  5243 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:27.005160  5243 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:27.007368  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:27.008162  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1368) took 1481 ms. Trace:
W20260709 12:58:26.997275  1537 rpcz_store.cc:269] 0709 12:58:25.042397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:26.904105 (+1861708us) service_pool.cc:224] Handling call
0709 12:58:26.996755 (+ 92650us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:26.885735  1505 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:26.960213  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:27.000268  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:26.893224  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:26.958362  5157 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:27.011063  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1366) took 1484 ms. Trace:
I20260709 12:58:27.011806  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:27.012192  1609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1825) took 1774 ms (client timeout 2043 ms). Trace:
I20260709 12:58:27.008455  1542 rpcz_store.cc:276] 0709 12:58:25.526893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:27.007102 (+1480209us) service_pool.cc:224] Handling call
0709 12:58:27.008105 (+  1003us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:26.956707  4909 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:26.950167  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:27.016575  1533 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:58:26.961887  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1370) took 1434 ms. Trace:
I20260709 12:58:27.012615  5187 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:27.017319  1538 rpcz_store.cc:276] 0709 12:58:25.527371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:26.949257 (+1421886us) service_pool.cc:224] Handling call
0709 12:58:26.961821 (+ 12564us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:26.953402  5289 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:26.953680  1684 rpcz_store.cc:276] 0709 12:58:25.613687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.614103 (+   416us) service_pool.cc:224] Handling call
0709 12:58:25.678633 (+ 64530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:26.436860 (+758227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:26.436892 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:26.436932 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:26.436969 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:26.763597 (+326628us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b54002882d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:26.763648 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:26.763798 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1743427968}
I20260709 12:58:26.941565  1611 rpcz_store.cc:276] 0709 12:58:25.009032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.010984 (+  1952us) service_pool.cc:224] Handling call
0709 12:58:25.031955 (+ 20971us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:25.640968 (+609013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:25.641001 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:25.641042 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:25.641080 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:26.838218 (+1197138us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b540008c0d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:26.838270 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:26.838428 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1400169728}
I20260709 12:58:26.969071  1536 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 12:58:27.018631  4993 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:26.958563  5252 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:27.020421  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:27.021376  5187 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:27.021669  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:26.902472  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2181) took 1196 ms. Trace:
I20260709 12:58:27.023371  5187 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:27.022578  1687 rpcz_store.cc:276] 0709 12:58:25.706583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.706780 (+   197us) service_pool.cc:224] Handling call
0709 12:58:25.707157 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:26.686189 (+979032us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:58:26.704825 (+ 18636us) log.cc:844] Serialized 14 byte log entry
0709 12:58:26.901001 (+196176us) log.cc:844] Serialized 14 byte log entry
0709 12:58:26.901194 (+   193us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:26.901243 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:26.901299 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:26.902194 (+   895us) spinlock_profiling.cc:243] Waited 979 ms on lock 0x7b5400158e54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:26.902241 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:26.902393 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20826,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":88,"raft.queue_time_us":13669,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":13821,"spinlock_wait_cycles":2253050880,"thread_start_us":195592,"threads_started":1,"wal-append.queue_time_us":190828}
I20260709 12:58:26.970412  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:26.971378  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1824) took 1733 ms. Trace:
I20260709 12:58:26.970288  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:26.972873  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:27.024503  1610 rpcz_store.cc:276] 0709 12:58:25.237784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.240767 (+  2983us) service_pool.cc:224] Handling call
0709 12:58:26.971168 (+1730401us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b540032a854. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:26.971318 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3283844352}
I20260709 12:58:27.017037  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1373) took 1035 ms. Trace:
I20260709 12:58:27.025465  1533 rpcz_store.cc:276] 0709 12:58:25.981875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:26.949933 (+968058us) service_pool.cc:224] Handling call
0709 12:58:27.016982 (+ 67049us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:26.972038  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 12:58:26.976910  1539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1361) took 1934 ms (client timeout 2248 ms). Trace:
I20260709 12:58:26.980808  1654 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:58:26.980371  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:27.027007  5289 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:26.947225  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:26.984053  5170 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:58:26.984866  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:27.018644  1538 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:58:27.016610  5230 consensus_queue.cc:1243] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:58:27.028712  5179 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:58:27.028916  1536 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1369) took 1501 ms (client timeout 1779 ms). Trace:
I20260709 12:58:26.999006  5186 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:27.029224  5179 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:27.029659  5179 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:27.030090  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1425) took 1437 ms. Trace:
I20260709 12:58:27.030442  1614 rpcz_store.cc:276] 0709 12:58:25.592789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.660430 (+ 67641us) service_pool.cc:224] Handling call
0709 12:58:26.975105 (+1314675us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:26.998583 (+ 23478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:27.029899 (+ 31316us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b540032a850. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:27.030033 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3013517568}
I20260709 12:58:27.021098  1537 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:27.031491  4993 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:27.013542  1535 rpcz_store.cc:276] 0709 12:58:25.526395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:26.944851 (+1418456us) service_pool.cc:224] Handling call
0709 12:58:27.011005 (+ 66154us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:27.026893  1539 rpcz_store.cc:269] 0709 12:58:25.042851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:26.829861 (+1787010us) service_pool.cc:224] Handling call
0709 12:58:26.976855 (+146994us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:27.035286  1539 pending_rounds.cc:85] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 5
I20260709 12:58:27.035367  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1344) took 1999 ms. Trace:
I20260709 12:58:27.035647  1539 pending_rounds.cc:107] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 11.6
W20260709 12:58:27.036018  1536 rpcz_store.cc:269] 0709 12:58:25.527131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:26.898049 (+1370918us) service_pool.cc:224] Handling call
0709 12:58:27.028839 (+130790us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:27.037699  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 99023.1us
W20260709 12:58:27.027503  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 46775.5us
I20260709 12:58:27.025533  1581 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:26.957038  1608 rpcz_store.cc:276] 0709 12:58:25.604350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:26.723082 (+1118732us) service_pool.cc:224] Handling call
0709 12:58:26.736218 (+ 13136us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:26.736428 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:26.747669 (+ 11241us) log.cc:844] Serialized 14 byte log entry
0709 12:58:26.883140 (+135471us) log.cc:844] Serialized 14 byte log entry
0709 12:58:26.883613 (+   473us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:26.883679 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:26.883742 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:26.883842 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:26.884044 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11606,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":72,"raft.queue_time_us":218,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":181,"thread_start_us":134363,"threads_started":1,"wal-append.queue_time_us":133104}
I20260709 12:58:26.961278  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:27.012202  1583 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:27.015219  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:27.019811  3947 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:58:27.014618  1609 rpcz_store.cc:269] 0709 12:58:25.238059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.238631 (+   572us) service_pool.cc:224] Handling call
0709 12:58:26.892957 (+1654326us) spinlock_profiling.cc:243] Waited 50.7 ms on lock 0x7b5800091e98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc8620170a0 00007fc862016984 00007fc85b5916d4 00007fc85b591662
0709 12:58:27.012135 (+119178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116605312}
I20260709 12:58:27.026373  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:27.027417  5289 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:26.965013  5232 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:26.983479  1655 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:27.027541  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1355) took 1986 ms. Trace:
I20260709 12:58:27.034106  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1349) took 1995 ms. Trace:
I20260709 12:58:25.642846   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:27.035866  1538 rpcz_store.cc:276] 0709 12:58:25.036019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:27.018024 (+1982005us) service_pool.cc:224] Handling call
0709 12:58:27.018319 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:27.035130 (+ 16811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:27.035314 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:27.046360  1539 raft_consensus.cc:2889] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:27.046720  1542 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:58:27.052742  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:27.051355  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:58:27.056967  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 171376us
I20260709 12:58:27.058212  1541 rpcz_store.cc:276] 0709 12:58:25.041502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:26.980120 (+1938618us) service_pool.cc:224] Handling call
0709 12:58:27.027483 (+ 47363us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:27.073918  1541 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:27.074571  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1365) took 1548 ms. Trace:
I20260709 12:58:27.074908  1541 rpcz_store.cc:276] 0709 12:58:25.526149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:27.073339 (+1547190us) service_pool.cc:224] Handling call
0709 12:58:27.073716 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:27.074311 (+   595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:27.074506 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:27.059157  1612 raft_consensus.cc:1275] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:58:27.040601  5302 consensus_queue.cc:1059] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:58:27.056854  5255 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:27.068743  1440 catalog_manager.cc:5697] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 6 to 8, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New cstate: current_term: 9 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:58:27.078606  1440 catalog_manager.cc:5697] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 4 to 7, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New cstate: current_term: 8 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:27.051810  5151 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:27.027959  5170 raft_consensus.cc:697] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:27.082140  5170 consensus_queue.cc:237] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:27.043434  1654 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:27.026849  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1345) took 1990 ms. Trace:
I20260709 12:58:27.085685  1538 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:58:27.086299  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1358) took 2044 ms. Trace:
I20260709 12:58:27.084870  1533 rpcz_store.cc:276] 0709 12:58:25.036250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:27.026103 (+1989853us) service_pool.cc:224] Handling call
0709 12:58:27.026382 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:27.026543 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:27.026568 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:27.026617 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:27.026654 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:27.026703 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:27.026799 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:27.049854  1540 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
W20260709 12:58:27.058557  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 75172.5us
I20260709 12:58:27.087735  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1367) took 1561 ms. Trace:
I20260709 12:58:27.060617  1537 rpcz_store.cc:276] 0709 12:58:25.038578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:27.032152 (+1993574us) service_pool.cc:224] Handling call
0709 12:58:27.032420 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:27.033794 (+  1374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:27.033819 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:27.033859 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:27.033900 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:27.033951 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:27.034043 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:27.087987  1655 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:27.086673  1538 rpcz_store.cc:276] 0709 12:58:25.042178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:27.067272 (+2025094us) service_pool.cc:224] Handling call
0709 12:58:27.067619 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:27.086076 (+ 18457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:27.086249 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:27.091424  1655 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:27.085454  3947 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:27.088068  1540 rpcz_store.cc:276] 0709 12:58:25.526637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:26.961006 (+1434369us) service_pool.cc:224] Handling call
0709 12:58:27.087675 (+126669us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:27.062922  1583 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:27.097986  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 54633.7us
I20260709 12:58:27.099275  1654 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:27.086069  1581 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:27.097981  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:27.047976  4993 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:27.040737  5187 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:27.056555  5165 consensus_queue.cc:1059] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:58:27.041704  5303 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:27.040599  5193 consensus_queue.cc:260] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:27.100672  3947 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:27.112442  5185 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:58:27.115955  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 53109us
I20260709 12:58:27.195227  1583 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:27.110095  5236 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:58:27.106105  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2185) took 1114 ms. Trace:
I20260709 12:58:27.194069  5270 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:27.060415  5229 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:27.117162  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2130) took 2048 ms. Trace:
I20260709 12:58:27.098064  5163 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.105297  5151 raft_consensus.cc:697] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:58:27.120705  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 48321.3us
I20260709 12:58:27.110839  5194 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:27.224781  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 138803us
I20260709 12:58:27.109452  5152 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:27.193059  4993 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:27.189846  5231 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:27.112504  5239 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:27.110600  5289 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:27.149372  1654 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:27.226240  1690 rpcz_store.cc:276] 0709 12:58:25.991884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:26.680294 (+688410us) service_pool.cc:224] Handling call
0709 12:58:26.695540 (+ 15246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:26.695756 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:26.907813 (+212057us) log.cc:844] Serialized 14 byte log entry
0709 12:58:27.105744 (+197931us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:27.105800 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:27.105852 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:27.105920 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:27.106049 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26583,"prepare.queue_time_us":49167,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":9400,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":62698,"thread_start_us":373570,"threads_started":2,"wal-append.queue_time_us":283405}
W20260709 12:58:27.220691  5327 log.cc:927] Time spent T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:58:27.197703  5165 consensus_queue.cc:1243] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer c262eac7fc904ae9bb91e450f6532e3f log is divergent from this leader: its last log entry 13.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:58:27.234396  3947 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:27.234760  1583 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:27.234910  1437 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54606 (request call id 144) took 24284 ms (client timeout 15000 ms). Trace:
I20260709 12:58:27.192941  5185 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:27.235495  1542 rpcz_store.cc:276] 0709 12:58:25.068521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:27.071516 (+2002995us) service_pool.cc:224] Handling call
0709 12:58:27.116629 (+ 45113us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:27.116835 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:27.116861 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:27.116903 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:27.116940 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:27.116993 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:27.117103 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:27.261620  5185 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:27.240729  1581 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:27.110466  5187 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:27.261365  1583 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:27.264693  5154 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:27.265053  5187 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:27.265084  5154 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:27.266300  5154 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:27.267344  5151 consensus_queue.cc:237] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:27.261101  1437 rpcz_store.cc:269] 0709 12:58:02.950559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:02.950939 (+   380us) service_pool.cc:224] Handling call
0709 12:58:27.234842 (+24283903us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:21.362839 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:21.446767 (+ 83928us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:21.446816 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:58:21.446835 (+    19us) tablet.cc:662] Decoding operations
0709 12:58:21.448410 (+  1575us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:21.448506 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:21.448534 (+    28us) tablet.cc:685] Acquiring locks for 18 operations
0709 12:58:21.449881 (+  1347us) tablet.cc:701] Row locks acquired
0709 12:58:21.449939 (+    58us) write_op.cc:260] PREPARE: finished
0709 12:58:21.450145 (+   206us) write_op.cc:270] Start()
0709 12:58:21.450323 (+   178us) write_op.cc:276] Timestamp: P: 1783601901450073 usec, L: 0
0709 12:58:21.450343 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:58:21.451232 (+   889us) log.cc:844] Serialized 7133 byte log entry
0709 12:58:21.711527 (+260295us) op_driver.cc:464] REPLICATION: finished
0709 12:58:21.860095 (+148568us) write_op.cc:301] APPLY: starting
0709 12:58:21.860173 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:21.860566 (+   393us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:21.860699 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:21.934851 (+ 74152us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:21.935167 (+   316us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 12:58:21.935214 (+    47us) write_op.cc:312] APPLY: finished
0709 12:58:21.935599 (+   385us) log.cc:844] Serialized 124 byte log entry
0709 12:58:21.935768 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:21.935939 (+   171us) write_op.cc:454] Released schema lock
0709 12:58:21.935988 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:21.936412 (+   424us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:21.936440 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":245090,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":142710,"apply.run_cpu_time_us":4991,"apply.run_wall_time_us":76304,"num_ops":18,"prepare.queue_time_us":204367,"prepare.run_cpu_time_us":6001,"prepare.run_wall_time_us":104904,"replication_time_us":227752,"spinlock_wait_cycles":29056,"thread_start_us":154171,"threads_started":2}]]}
I20260709 12:58:27.271338  1505 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:27.030102  5252 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:27.288434  1613 raft_consensus.cc:1240] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:27.290763  5252 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:27.224104  5232 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:27.040428  5179 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:58:27.246979  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 144214us
I20260709 12:58:27.229269  5157 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:27.193912  5243 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:27.246555  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 162400us
W20260709 12:58:27.314258  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 49823.3us
W20260709 12:58:27.257704  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 108442us
I20260709 12:58:27.242806  5163 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:27.243115  5229 raft_consensus.cc:697] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:27.283373  5154 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:27.245935  5194 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:27.286664  5325 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 12:58:27.105894  5321 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:58:27.294703  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 54076.9us
I20260709 12:58:27.302928  1505 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:27.349189  1690 raft_consensus.cc:1240] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 9. Current term is 10. Ops: []
W20260709 12:58:27.351125  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 48302.1us
I20260709 12:58:27.247139  5231 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:27.253472  5239 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:27.233312  5270 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:27.316336  1654 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:27.316681  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1427) took 1707 ms. Trace:
I20260709 12:58:27.301393  5195 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:27.318925  5165 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:27.285295  5312 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:27.307982  5236 raft_consensus.cc:697] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:27.304347  5302 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.384742  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:27.316633  5232 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:27.310791  4837 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:27.353554  3947 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:27.247808  5152 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:27.311234  5186 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:27.353034  1505 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:27.317008  5157 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:27.362681  1613 rpcz_store.cc:276] 0709 12:58:25.609538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:26.834085 (+1224547us) service_pool.cc:224] Handling call
0709 12:58:26.834468 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:27.288874 (+454406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:27.316416 (+ 27542us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b5400339ad4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:27.316615 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1043666688}
I20260709 12:58:27.365242  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:27.367165  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:27.370296  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:27.259863  5212 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:58:27.372408  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 56140.3us
I20260709 12:58:27.391825  5337 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:27.403170  5337 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:27.403523  5337 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:27.374554  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:27.380780  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:27.382521  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:27.391883  1684 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:27.361515  5231 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:27.363137  5239 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:27.373322  5270 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:27.375290  5170 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:27.406858  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:58:27.405851  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 52903.4us
I20260709 12:58:27.424504  1684 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:27.406772  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:27.395274  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:27.381011  5312 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:27.424785  1505 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:27.433107  1505 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:27.385233  5339 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:27.361729  5321 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:27.407927  5157 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:27.437917  1505 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:27.438534  3947 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:27.414232  5177 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:27.408458  5186 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:27.402277  5243 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:27.402226  5154 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:27.383316  5165 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:27.464850  1684 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:27.433190  5312 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:27.430408  4837 raft_consensus.cc:697] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:27.400744  5212 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:27.487059  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:27.515398  1613 raft_consensus.cc:1240] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:27.524655  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:27.394292  5302 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:27.497272  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:27.526958  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:27.482257  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:27.479406  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:27.440732  5172 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:27.530597  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:27.531325  5172 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:27.532203  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:27.529414  1538 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:58:27.455549  5186 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:27.534036  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:27.534694  1538 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 14.
I20260709 12:58:27.488970  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:27.559466  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:27.395093  5229 consensus_queue.cc:237] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:27.561794  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:27.522805  5255 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:27.477082  5202 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:27.532213  1542 raft_consensus.cc:2393] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 12: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:27.531351  1533 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:27.457317  5187 consensus_queue.cc:1059] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 12:58:27.439440  5185 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:27.440227  5170 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:27.537356  5172 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:27.572188  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:27.444447  5339 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:27.463397  5177 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:27.580510  5163 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:27.562856  5289 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:27.585886  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 181011us
I20260709 12:58:27.587276  5195 raft_consensus.cc:3055] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:27.587741  5195 raft_consensus.cc:740] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:27.588127  5185 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:27.588533  5195 consensus_queue.cc:260] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:27.589699  5195 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:27.605433  5321 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:27.606876  5152 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:27.582453  5179 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:27.608929  5302 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:27.611537  3947 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:58:27.582554  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 188095us
I20260709 12:58:27.628841  1581 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:27.529589  1537 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
W20260709 12:58:27.531575  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 127583us
I20260709 12:58:27.635036  1583 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:27.638535  5339 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:27.639714  5346 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:27.640257  5346 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:27.640733  5346 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:27.641609  5212 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:27.529629  5236 consensus_queue.cc:237] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:27.646250  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:27.588444  5170 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:27.651052  1610 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:27.656252  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:27.656997  1610 raft_consensus.cc:1813] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Handling vote request from an unknown peer dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:27.657454  1610 raft_consensus.cc:2368] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 10. Current term is 11.
I20260709 12:58:27.656381  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:27.657769  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:27.658293  1684 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:27.666953  1684 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:27.674252  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:27.667917  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:27.640347  4993 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:27.677850  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:27.683398  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:27.684087  1612 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:27.686781  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:27.677129  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:27.677830  1614 raft_consensus.cc:2393] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 15: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:27.688771  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:27.689771  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:27.693213  1655 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:27.690426  1615 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
I20260709 12:58:27.698491  1655 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:27.704349  5170 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:27.690366  5315 raft_consensus.cc:3055] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:27.708971  5315 raft_consensus.cc:740] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:27.709851  5315 consensus_queue.cc:260] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:27.711256  5315 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:27.712533  5339 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:27.712996  5339 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:27.713378  5339 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:27.718842  5334 log.cc:927] Time spent T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 12:58:27.719025  5231 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:27.721637  5345 log.cc:927] Time spent T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:58:27.722878  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1351) took 2682 ms. Trace:
I20260709 12:58:27.723261  1539 rpcz_store.cc:276] 0709 12:58:25.040505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:27.034786 (+1994281us) service_pool.cc:224] Handling call
0709 12:58:27.035100 (+   314us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:27.232131 (+197031us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:27.232164 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:27.232753 (+   589us) log.cc:844] Serialized 52 byte log entry
0709 12:58:27.467379 (+234626us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:27.467444 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:27.467572 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:27.722659 (+255087us) raft_consensus.cc:1685] finished
0709 12:58:27.722680 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:27.722818 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":208806,"raft.queue_time_us":162331,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":4215,"thread_start_us":234218,"threads_started":1,"wal-append.queue_time_us":344610}
I20260709 12:58:27.723199  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:27.654268  5194 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:27.672772  5272 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:58:27.744586  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 157738us
W20260709 12:58:27.733212  5338 log.cc:927] Time spent T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 12:58:27.680274  5157 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:27.736245  5231 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:27.711450  5186 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:27.612464  4837 consensus_queue.cc:237] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:27.750509  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:27.652767  5337 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:27.759260  1687 raft_consensus.cc:2393] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 11: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:27.759378  5339 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:27.743942  5312 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:27.748023  5272 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:27.749503  5355 consensus_queue.cc:1048] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:27.827527  1655 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:27.744323  5179 consensus_queue.cc:1059] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:58:27.860734  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1356) took 2819 ms. Trace:
I20260709 12:58:27.861240  1536 rpcz_store.cc:276] 0709 12:58:25.041721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:27.036755 (+1995034us) service_pool.cc:224] Handling call
0709 12:58:27.037056 (+   301us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:27.114784 (+ 77728us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:58:27.196163 (+ 81379us) log.cc:844] Serialized 14 byte log entry
0709 12:58:27.363349 (+167186us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:27.363909 (+   560us) log.cc:844] Serialized 52 byte log entry
0709 12:58:27.364079 (+   170us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:27.463723 (+ 99644us) log.cc:844] Serialized 14 byte log entry
0709 12:58:27.528360 (+ 64637us) log.cc:844] Serialized 14 byte log entry
0709 12:58:27.787674 (+259314us) spinlock_profiling.cc:243] Waited 99 ms on lock 0x7b180029ef60. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859edec0a 00007fc86361e219 00007fc859f66a40 00007fc859f614e4 00007fc859f61455 00007fc85d049060 00007fc85d05b716 00007fc85d06c287 00007fc85d06c208
0709 12:58:27.860235 (+ 72561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:27.860423 (+   188us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:27.860489 (+    66us) raft_consensus.cc:1685] finished
0709 12:58:27.860504 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:27.860659 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":388588,"prepare.queue_time_us":156869,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":114,"raft.queue_time_us":414278,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":80734,"spinlock_wait_cycles":228280448,"thread_start_us":290786,"threads_started":3,"wal-append.queue_time_us":217136}
I20260709 12:58:27.761453  5232 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:27.897434  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:27.898774  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:27.900303  1542 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:58:27.905746  1542 raft_consensus.cc:1240] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:27.906774  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:27.908330  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:27.796639  5272 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:27.947984  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:27.992298  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 262790us
I20260709 12:58:27.761118  5347 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.181s
I20260709 12:58:27.786291  5231 consensus_queue.cc:1059] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.163s
W20260709 12:58:28.001456  5338 log.cc:927] Time spent T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 12:58:28.004393  5239 consensus_meta.cc:287] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.570s	user 0.007s	sys 0.002s
I20260709 12:58:28.007540  5239 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:28.008085  1505 leader_election.cc:400] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 10. Current term is 11.
I20260709 12:58:28.008538  1505 leader_election.cc:403] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:28.008646  1688 raft_consensus.cc:1240] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:28.012746  5302 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:58:27.948763  5179 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:28.016855  5179 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:28.017254  5179 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:28.022614  5157 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:28.025018  5177 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:28.027279  5312 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:27.909879  5261 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.028988  5261 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:28.029914  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 202533us
I20260709 12:58:28.030819  1655 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:28.006907  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1350) took 2968 ms. Trace:
I20260709 12:58:28.033776  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:28.007928  5247 consensus_queue.cc:1059] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:28.033679  1535 rpcz_store.cc:276] 0709 12:58:25.038818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:27.032844 (+1994026us) service_pool.cc:224] Handling call
0709 12:58:27.033188 (+   344us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:27.113602 (+ 80414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:27.113634 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:27.114222 (+   588us) log.cc:844] Serialized 52 byte log entry
0709 12:58:27.290681 (+176459us) spinlock_profiling.cc:243] Waited 5.99 ms on lock 0x7b48001401d8. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc861f7aaa1 00007fc861f71b37 00007fc861f719ca 00007fc86206926f 00007fc862068f37 00007fc86207d55c 00007fc86207d508 00007fc86207d488 00007fc86207d443 00007fc86207c6ec 00007fc860fa6a96
0709 12:58:27.387003 (+ 96322us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:27.395920 (+  8917us) log.cc:844] Serialized 14 byte log entry
0709 12:58:27.396871 (+   951us) log.cc:844] Serialized 14 byte log entry
0709 12:58:27.397183 (+   312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:27.397293 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:28.006665 (+609372us) raft_consensus.cc:1685] finished
0709 12:58:28.006688 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:28.006840 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80009,"prepare.queue_time_us":7946,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":65,"raft.queue_time_us":89368,"raft.run_cpu_time_us":2765,"raft.run_wall_time_us":170817,"spinlock_wait_cycles":13779328,"thread_start_us":272414,"threads_started":1,"wal-append.queue_time_us":321867}
I20260709 12:58:28.050532  5358 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:27.946449  5220 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.067482  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:28.004519  5352 log.cc:927] Time spent T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.251s	user 0.000s	sys 0.000s
I20260709 12:58:28.074851  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:28.063957  5154 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:28.112741  1617 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:58:28.005246  5231 raft_consensus.cc:3055] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:28.044731  5165 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:28.149209  5154 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:28.175570  5261 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:28.176900  5154 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:28.177107  5186 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:28.175594  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:28.182073  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:28.183693  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 152963us
I20260709 12:58:28.184798  1655 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:28.187463  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:28.187837  1655 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:28.188097  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:28.188233  1617 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:58:28.188956  1684 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:28.189129  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:28.203315  1685 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:58:28.178013  5172 consensus_meta.cc:287] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.589s	user 0.009s	sys 0.001s
I20260709 12:58:28.208938  5172 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:28.004880  5351 consensus_queue.cc:1059] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.177s
I20260709 12:58:28.192945  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:28.213403  1655 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:28.215605  5172 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:28.220984  1655 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:28.150261  5231 raft_consensus.cc:740] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:28.228780  1539 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:28.227612  5231 consensus_queue.cc:260] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:28.225670  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:28.234002  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:28.235927  5231 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:28.236450  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:28.236675  1690 raft_consensus.cc:1240] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:28.237315  1682 raft_consensus.cc:2393] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 9: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:28.225914  1684 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:58:28.226573  1685 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:28.261729  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:28.132058  5272 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:28.309958  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:28.343483  1539 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:58:28.313216  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 92312.7us
I20260709 12:58:28.325445  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:28.352286  1655 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:28.356033  1539 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:58:28.333364  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:28.190137  5358 raft_consensus.cc:476] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 14 LEADER]: Not starting pre-election -- already a leader
I20260709 12:58:28.227622  5351 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:28.111177  5220 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:58:28.604382  1540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.022s	sys 0.094s
W20260709 12:58:28.586664  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 359824us
I20260709 12:58:28.305600  5298 raft_consensus.cc:3055] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:58:28.731295  2266 leader_election.cc:336] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 1.700s (SENT)
I20260709 12:58:28.250871  5347 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:28.721995  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:28.745561  1535 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:58:28.437433  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:28.244840  5247 raft_consensus.cc:3055] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:58:28.714184  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 362025us
I20260709 12:58:28.472376  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:28.753523  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:28.716517  1687 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 2206) took 1311 ms (client timeout 1559 ms). Trace:
I20260709 12:58:28.737957  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:28.755586  1537 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:28.738111  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:28.739544  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2195) took 1373 ms. Trace:
I20260709 12:58:28.756620  1688 rpcz_store.cc:276] 0709 12:58:27.365982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:27.369580 (+  3598us) service_pool.cc:224] Handling call
0709 12:58:27.369869 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:28.010256 (+640387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:28.739285 (+729029us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b540029a9d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:28.739474 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1468685056}
I20260709 12:58:28.740545  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:58:28.758355  1687 rpcz_store.cc:269] 0709 12:58:27.404924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:27.406498 (+  1574us) service_pool.cc:224] Handling call
0709 12:58:28.716220 (+1309722us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b5400299fd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:28.716417 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":767983360}
I20260709 12:58:28.759812  1533 raft_consensus.cc:1240] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:28.759341  1655 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:28.552174  5361 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.456792  5358 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:28.518249  5369 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.768616  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:28.773921  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:28.773012  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:28.574436  5165 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:28.778646  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:28.783553  1535 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 7.
I20260709 12:58:28.788177  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:28.854380  1608 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:58:28.788801  1655 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:28.855185  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:28.855583  1612 raft_consensus.cc:2368] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13.
I20260709 12:58:28.812959  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:28.800267  1537 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
W20260709 12:58:28.817914  1580 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.001s	sys 0.005s
W20260709 12:58:28.856812  1580 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.002s	sys 0.006s
I20260709 12:58:28.754315  5247 raft_consensus.cc:740] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:28.742741  5298 raft_consensus.cc:740] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:28.768191  5362 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.788246  5347 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:28.866205  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:28.866400  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:28.866595  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:28.851140  5371 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:58:28.899631  1616 raft_consensus.cc:2393] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 7: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:28.870273  5358 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:28.870282  5236 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:58:28.908123  2266 leader_election.cc:336] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 1.762s (SENT)
I20260709 12:58:28.874387  5372 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:28.876542  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:28.855583  5165 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:28.867576  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:28.909924  1533 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:28.898213  1611 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:28.867846  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 79156.2us
I20260709 12:58:28.911489  1655 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:28.913157  1655 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:28.900591  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:28.915000  1616 raft_consensus.cc:2410] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:58:28.859797  5369 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:28.903659  1612 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 14. Current term is 15. Ops: []
I20260709 12:58:28.916822  1612 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13. Ops: [8.5-12.6]
I20260709 12:58:28.751134  5351 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:28.852582  5361 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:28.896981  5347 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:28.930258  1612 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15. Ops: []
W20260709 12:58:28.915225  5231 consensus_meta.cc:287] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.679s	user 0.006s	sys 0.005s
I20260709 12:58:28.905810  5272 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:28.930804  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:28.938278  1537 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:28.933956  1617 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:28.916114  5165 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:28.921697  5270 consensus_meta.cc:287] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 1.488s	user 0.010s	sys 0.002s
I20260709 12:58:28.920327  5364 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:28.939759  5229 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.003s	sys 0.030s
I20260709 12:58:28.939155  1608 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:58:28.927284  5371 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:28.905018  5362 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:28.977267  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2204) took 1608 ms. Trace:
I20260709 12:58:29.034955  1691 rpcz_store.cc:276] 0709 12:58:27.368359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:27.409187 (+ 40828us) service_pool.cc:224] Handling call
0709 12:58:27.409432 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:27.422980 (+ 13548us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:27.423012 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:27.423050 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:27.423079 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:28.948089 (+1525010us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b54000efe54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:28.977015 (+ 28926us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:28.977195 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30717824}
I20260709 12:58:28.932554  5358 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:29.036209  5358 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:29.036659  5358 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:28.935278  5347 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:58:28.986647  5302 consensus_meta.cc:287] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.973s	user 0.008s	sys 0.000s
I20260709 12:58:29.038573  5302 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 10. Current term is 11.
I20260709 12:58:29.039253  5302 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:29.039731  5302 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:29.040156  1537 raft_consensus.cc:1275] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:58:28.987093  5220 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:58:28.987519  5367 log.cc:927] Time spent T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.079s	user 0.002s	sys 0.005s
I20260709 12:58:28.989567  5369 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:29.044766  5369 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.045272  5337 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:29.047394  5339 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:29.049997  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:29.050693  1538 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 12:58:29.051173  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1388) took 1041 ms. Trace:
I20260709 12:58:28.989580  5351 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:28.946918  5364 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:29.052548  1688 raft_consensus.cc:1275] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:58:28.995133  5346 consensus_meta.cc:287] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 1.354s	user 0.009s	sys 0.000s
I20260709 12:58:29.054610  1686 raft_consensus.cc:1275] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:58:28.937057  5247 consensus_queue.cc:260] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:28.997843  5361 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:28.920327  5298 consensus_queue.cc:260] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:28.999037  1533 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:28.928419  5372 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:28.945158  5229 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.003s	sys 0.031s
I20260709 12:58:29.051503  1538 rpcz_store.cc:276] 0709 12:58:28.009782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:29.049750 (+1039968us) service_pool.cc:224] Handling call
0709 12:58:29.051114 (+  1364us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:29.053594  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:29.070080  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:29.070703  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:29.057782  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:29.071565  1608 raft_consensus.cc:2376] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 11. Re-sending same reply.
I20260709 12:58:29.060158  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:29.057286  1610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:58:28.944495  5270 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:29.059852  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:29.074851  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:29.033003  5272 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.058455  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:29.075525  1617 raft_consensus.cc:2376] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 11. Re-sending same reply.
I20260709 12:58:29.075781  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:29.072669  1610 raft_consensus.cc:606] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:29.033439  5371 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:29.064273  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:29.080892  1610 raft_consensus.cc:614] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:29.051375  5358 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:29.089453  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:29.095525  1537 raft_consensus.cc:2368] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13.
I20260709 12:58:29.102533  1611 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:29.103143  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 1452) took 1067 ms. Trace:
I20260709 12:58:29.103463  1611 rpcz_store.cc:276] 0709 12:58:28.035687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:28.865853 (+830166us) service_pool.cc:224] Handling call
0709 12:58:29.103073 (+237220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:29.106117  1611 raft_consensus.cc:1275] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:58:29.107254  1616 raft_consensus.cc:1240] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:29.095623  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:29.108876  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:29.109490  1535 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:29.098773  1655 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:29.056854  5362 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:29.119428  1655 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:29.122579  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:29.036660  5239 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:29.121544  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:29.074277  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
W20260709 12:58:29.120992  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:29.125741  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:29.062626  5247 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:29.057456  5220 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:29.133462  1540 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:29.165371  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:29.167351  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:29.168368  1540 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:29.169582  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:29.151386  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:29.099409  5343 consensus_queue.cc:1048] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 12:58:29.172401  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:29.172847  1537 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:58:29.069238  5368 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.170498  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:29.136435  1535 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:58:29.170099  5364 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:29.170827  5383 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:29.173682  5368 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:29.174469  5383 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:29.175868  5376 log.cc:927] Time spent T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 12:58:29.176116  5302 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:29.062841  5152 consensus_queue.cc:1059] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 12:58:29.177237  5383 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:29.074486  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:29.180527  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:29.181565  1533 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
W20260709 12:58:29.155830  1655 leader_election.cc:336] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.560s (SENT)
I20260709 12:58:29.183118  1655 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:29.185079  1654 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.002s	sys 0.028s
I20260709 12:58:29.113819  5298 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:58:29.185668  1654 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.002s	sys 0.028s
W20260709 12:58:29.128778  5179 consensus_meta.cc:287] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 1.111s	user 0.008s	sys 0.003s
I20260709 12:58:29.045301  5369 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:29.057667  5346 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:29.198698  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.203202  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.204020  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.204711  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.205457  1685 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:29.206353  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.207046  1685 raft_consensus.cc:2393] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 9: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:29.207628  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.199659  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.100220  5371 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:29.210827  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.122356  5185 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:58:29.211807  5185 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:29.200664  5179 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:29.212244  5185 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:29.212765  1683 raft_consensus.cc:1240] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:29.212555  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:29.210501  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.151672  5229 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:29.208745  1687 raft_consensus.cc:2393] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 13: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:29.101603  5272 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:29.236642  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.238114  1687 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:29.239094  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.213917  1685 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:29.220350  1691 raft_consensus.cc:1240] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:29.196532  5364 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:29.242851  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:29.234066  1541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.006s	sys 0.009s
I20260709 12:58:29.223377  1688 raft_consensus.cc:1240] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 3. Current term is 4. Ops: []
W20260709 12:58:29.301213  1541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.006s	sys 0.010s
I20260709 12:58:29.220675  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:29.225701  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.224030  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.224808  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.210973  1505 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:58:29.237412  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.213946  5179 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:29.293807  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:29.200866  5232 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:29.201087  5239 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:29.234684  1542 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.987s	user 0.008s	sys 0.008s
I20260709 12:58:29.302577  1535 raft_consensus.cc:2393] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 10: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:29.303038  1684 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:29.303615  1686 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:29.164294  5220 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:29.307199  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:29.219416  5365 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.033s	sys 0.035s
I20260709 12:58:29.308293  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.214571  5362 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:29.308571  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 97682.1us
I20260709 12:58:29.197391  5379 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 12:58:29.221446  5172 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:29.210028  5341 consensus_queue.cc:1048] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.104s
I20260709 12:58:29.304909  5231 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.310274  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:29.311697  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.310992  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.457732  1684 raft_consensus.cc:1813] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Handling vote request from an unknown peer dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:29.458196  1684 raft_consensus.cc:2368] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 10. Current term is 11.
I20260709 12:58:29.458972  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.460012  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.319149  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.461652  1690 raft_consensus.cc:2393] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 9: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:29.320246  1505 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:29.326550  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:29.328416  1583 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
W20260709 12:58:29.319861  1508 leader_election.cc:336] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 1.535s (SENT)
I20260709 12:58:29.465665  1691 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
W20260709 12:58:29.466053  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 145914us
I20260709 12:58:29.467052  1505 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:29.466185  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 146679us
W20260709 12:58:29.467437  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 139138us
W20260709 12:58:29.309070  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:29.313679  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:29.470531  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:29.446239  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 383062us
W20260709 12:58:29.453037  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 282012us
I20260709 12:58:29.509023  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:29.515180  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.540036  1583 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:29.332835  5378 log.cc:927] Time spent T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:58:29.543120  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:29.551420  1539 raft_consensus.cc:2393] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 9: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:29.544286  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.552659  1686 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:29.553673  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.541230  1583 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:29.545491  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.555511  1684 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
W20260709 12:58:29.559479  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 92508.4us
I20260709 12:58:29.560505  1505 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:29.561029  1686 raft_consensus.cc:1240] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:29.393371  5220 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:29.565191  5393 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:29.573462  5272 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:29.375273  5347 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:29.577380  5347 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:29.508741  5359 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:29.557504  5391 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:58:29.581854  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.583806  1691 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:58:29.584741  5276 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:29.382110  5270 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:29.399698  5231 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:29.607582  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 66408.3us
I20260709 12:58:29.610365  1691 raft_consensus.cc:1240] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:29.632169  5276 raft_consensus.cc:697] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:58:29.633960  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 73534.2us
I20260709 12:58:29.609915  5220 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:29.636334  5220 raft_consensus.cc:697] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:29.636512  5276 consensus_queue.cc:237] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:29.637308  5220 consensus_queue.cc:237] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:29.634503  5383 raft_consensus.cc:2764] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:58:29.640187  3947 consensus_queue.cc:1059] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:58:29.634286  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2161) took 1159 ms. Trace:
I20260709 12:58:29.332713  5172 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:29.333343  5375 log.cc:927] Time spent T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260709 12:58:29.398689  5195 consensus_meta.cc:287] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 1.809s	user 0.013s	sys 0.000s
W20260709 12:58:29.411455  5386 log.cc:927] Time spent T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:58:29.366974  5389 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:58:29.345224  5382 log.cc:927] Time spent T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
W20260709 12:58:29.422981  5366 log.cc:927] Time spent T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.424s	user 0.000s	sys 0.003s
W20260709 12:58:29.548967  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 80554.1us
W20260709 12:58:29.675365  1508 leader_election.cc:336] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 1.566s (SENT)
I20260709 12:58:29.676831  3947 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:29.677350  3947 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:29.679054  5394 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:29.679379  1508 leader_election.cc:336] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 1.701s (SENT)
I20260709 12:58:29.679809  1508 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:29.679625  5394 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:29.681747  5389 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:29.682216  5389 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:29.641566  1541 rpcz_store.cc:276] 0709 12:58:28.475208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:28.475457 (+   249us) service_pool.cc:224] Handling call
0709 12:58:28.475785 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:28.476033 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:28.542218 (+ 66185us) log.cc:844] Serialized 14 byte log entry
0709 12:58:29.533634 (+991416us) log.cc:844] Serialized 14 byte log entry
0709 12:58:29.633897 (+100263us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:29.633960 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:29.634014 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:29.634086 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:29.634219 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":319914,"prepare.queue_time_us":76974,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":11899,"raft.queue_time_us":264989,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":57106688,"thread_start_us":759147,"threads_started":1,"wal-append.queue_time_us":991839}
I20260709 12:58:29.318631  5232 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:29.546962  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:29.442288  1687 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:29.661976  1685 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
W20260709 12:58:29.311967  1542 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.064s	user 0.008s	sys 0.008s
I20260709 12:58:29.637326  5193 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:29.635244  5301 raft_consensus.cc:3055] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:29.666460  1583 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:29.667244  5215 consensus_queue.cc:1059] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:29.635712  5368 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:29.698918  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 157427us
I20260709 12:58:29.361115  5346 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:29.326982  5362 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:29.656144  5392 raft_consensus.cc:3055] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:58:29.696338  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.696542  5231 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:29.688818  1508 leader_election.cc:336] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 1.777s (SENT)
I20260709 12:58:29.699051  1583 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:29.702376  1581 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.093s	sys 0.145s
I20260709 12:58:29.702077  5344 consensus_queue.cc:1048] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:29.319303  5239 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:29.757802  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:29.758471  1533 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:29.684324  5353 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.708310  1689 raft_consensus.cc:2410] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:58:29.692145  5383 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:29.700692  1690 raft_consensus.cc:1240] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12. Ops: []
W20260709 12:58:29.715257  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 76118.6us
I20260709 12:58:29.716114  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2154) took 1638 ms. Trace:
I20260709 12:58:29.698750  5301 raft_consensus.cc:740] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:58:29.764417  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.711836  5388 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:58:29.692389  5391 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:29.726488  5232 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:29.727741  5185 consensus_meta.cc:287] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.515s	user 0.005s	sys 0.005s
I20260709 12:58:29.731410  5233 raft_consensus.cc:3055] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:29.709481  5392 raft_consensus.cc:740] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:29.782073  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:29.764773  5353 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:29.744412  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2221) took 1509 ms. Trace:
I20260709 12:58:29.754691  1508 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:29.755205  1581 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.093s	sys 0.145s
I20260709 12:58:29.359511  5165 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:29.759625  1684 raft_consensus.cc:1240] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:29.701634  5358 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:29.769997  1542 rpcz_store.cc:276] 0709 12:58:28.078151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:28.191568 (+113417us) service_pool.cc:224] Handling call
0709 12:58:28.191873 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:28.192070 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:29.698076 (+1506006us) log.cc:844] Serialized 14 byte log entry
0709 12:58:29.715711 (+ 17635us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:29.715769 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:29.715825 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:29.715903 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:29.716046 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":56340,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":59,"raft.queue_time_us":6772,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":1467151,"threads_started":2}
I20260709 12:58:29.771257  1691 raft_consensus.cc:2393] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 12: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:29.770247  3947 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:58:29.713193  5247 consensus_meta.cc:287] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.541s	user 0.010s	sys 0.000s
I20260709 12:58:29.758658  5239 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:29.799237  5185 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:29.807816  1682 raft_consensus.cc:2393] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 16: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:29.808804  5185 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:29.809994  1538 raft_consensus.cc:2410] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:58:29.799057  5388 raft_consensus.cc:697] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:29.812521  5185 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:29.813099  5185 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:29.815492  5185 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:29.736307  5369 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:29.776415  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 78815.2us
I20260709 12:58:29.777945  5301 consensus_queue.cc:260] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:29.778577  5194 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:29.817167  5194 raft_consensus.cc:697] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:58:29.817400  5371 consensus_meta.cc:287] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.582s	user 0.008s	sys 0.001s
I20260709 12:58:29.799238  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.818198  1690 raft_consensus.cc:2393] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 13: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:29.817873  5371 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:29.801857  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:29.819427  1688 raft_consensus.cc:2393] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 13: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:29.817309  5301 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:29.820032  5371 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:29.820318  5194 consensus_queue.cc:237] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:29.821664  5362 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:29.774025  5393 consensus_queue.cc:1059] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:58:29.822836  5393 raft_consensus.cc:3055] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:58:29.823220  5393 raft_consensus.cc:740] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:29.819535  1684 raft_consensus.cc:2393] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 9: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 12:58:29.772241  5298 consensus_meta.cc:287] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.000s
I20260709 12:58:29.784327  5391 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:29.780375  5392 consensus_queue.cc:260] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:29.825649  5392 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:29.826359  5391 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:29.826897  5227 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.827476  5227 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:29.816596  5172 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:29.784708  1683 rpcz_store.cc:276] 0709 12:58:28.234479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:28.235724 (+  1245us) service_pool.cc:224] Handling call
0709 12:58:28.236012 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:29.213209 (+977197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:29.744073 (+530864us) spinlock_profiling.cc:243] Waited 977 ms on lock 0x7b54002c01d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:29.744330 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2246109440}
I20260709 12:58:29.823984  5393 consensus_queue.cc:260] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:29.834048  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 145287us
I20260709 12:58:29.836046  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:29.836767  1691 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:29.840448  1534 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:29.841606  5393 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:29.841444  5388 consensus_queue.cc:237] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:29.844767  5406 log.cc:927] Time spent T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 12:58:29.833189  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 720858us
I20260709 12:58:29.847891  1581 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:29.849866  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:29.851110  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.852942  5394 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:29.851743  1683 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:29.799693  5233 raft_consensus.cc:740] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:29.860734  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:29.873904  1581 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:29.874639  1583 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:29.854099  5362 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:58:29.875572  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.879356  1581 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:29.858539  4837 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:29.886555  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.887285  1682 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:29.890414  5389 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:29.855754  5384 consensus_queue.cc:1059] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:58:29.894649  5233 consensus_queue.cc:260] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:29.895268  5384 raft_consensus.cc:3055] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:29.895772  5233 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:29.877233  5398 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:29.896853  5398 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:29.899086  5398 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:29.900516  5357 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:29.860170  5172 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:29.881970  1581 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:29.890818  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:29.858946  5157 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:29.853958  5385 consensus_queue.cc:1059] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:58:29.915961  1691 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:29.877382  5374 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:29.881028  5261 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:29.931452  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:29.932451  5389 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:29.918121  1535 raft_consensus.cc:1240] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:29.895766  5384 raft_consensus.cc:740] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:29.935225  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.937487  1689 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:29.938679  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.939544  1689 raft_consensus.cc:2393] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 16: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:29.940639  5165 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:29.940727  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:58:29.941156  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.941856  1689 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:29.930850  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:29.934456  1581 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:29.910629  5371 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:30.037380  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:30.036628  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:30.035513  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:30.019228  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:30.052618  1686 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 12:58:30.050659  1691 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:30.039355  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:29.944211  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:30.016613  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:30.047726  1611 raft_consensus.cc:1240] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:30.042842  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:29.981460  2269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:30.051728  1609 raft_consensus.cc:2393] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 10: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:30.054941  1610 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:30.054558  1683 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:30.051486  1687 raft_consensus.cc:2376] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10. Re-sending same reply.
I20260709 12:58:30.055977  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:30.057349  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:30.038926  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:30.058806  1612 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:30.059708  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:30.053315  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:30.061537  1614 raft_consensus.cc:2393] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 10: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:29.929925  5374 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:30.064075  1583 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:30.064492  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 229170us
W20260709 12:58:30.065670  1534 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1340) took 5001 ms (client timeout 2055 ms). Trace:
I20260709 12:58:30.063248  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:30.067063  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 132681us
I20260709 12:58:30.067278  1690 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:30.067806  1581 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:30.068171  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:30.068782  1690 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:58:30.068972  1581 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:30.069118  1583 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:30.069479  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:58:30.055473  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:30.072216  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:30.062273  1687 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
W20260709 12:58:30.024662  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:30.073763  1687 pending_rounds.cc:85] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 5
I20260709 12:58:30.025104  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:30.074026  1687 pending_rounds.cc:107] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 12:58:29.923137  4837 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:30.079424  1581 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:30.075064  1687 raft_consensus.cc:2889] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:30.074798  1610 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
W20260709 12:58:30.066246  1534 rpcz_store.cc:269] 0709 12:58:25.035105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:25.608829 (+573724us) service_pool.cc:224] Handling call
0709 12:58:30.036625 (+4427796us) spinlock_profiling.cc:243] Waited 4.16 s on lock 0x7b5400246654. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:30.036725 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9575472000}
I20260709 12:58:30.076295  1616 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:30.069065  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:30.077745  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:30.078369  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:30.082466  1614 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:30.082885  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:30.083742  1691 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:58:30.083901  1688 raft_consensus.cc:2393] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 12: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:29.928460  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:30.084802  1581 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:30.086069  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:30.086830  1689 raft_consensus.cc:2393] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 13: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:30.077363  5194 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:29.932600  5372 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:30.091156  1683 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:58:30.096268  1682 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: []
I20260709 12:58:30.084854  1505 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:30.014495  5227 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:30.097240  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:30.100168  1689 raft_consensus.cc:2393] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 15: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:30.075721  5374 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:30.014950  5353 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:29.929651  5157 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:30.082585  5385 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:30.107040  1505 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:29.917130  5172 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:30.158890  5172 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:30.159548  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:30.159870  5389 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:30.160312  5389 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:30.160688  5389 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:30.065783  5371 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:29.970634  5384 consensus_queue.cc:260] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:30.161017  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:30.082940  5215 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:29.971390  5301 consensus_queue.cc:1059] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.128s
W20260709 12:58:30.113246  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:30.089146  5151 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:30.097524  4911 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:58:30.135083  4837 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:58:30.095933  4909 consensus_queue.cc:1059] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:58:30.089035  5361 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:30.125159  5157 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:30.089358  5346 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:30.097344  5379 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:58:30.115140  5227 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:30.162707  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:30.119299  1505 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:30.122532  1507 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:30.189343  1612 raft_consensus.cc:1240] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:30.189122  1690 raft_consensus.cc:2393] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 9: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:30.143512  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:30.191242  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:30.191936  1685 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:30.192890  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:30.120438  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:30.170646  5353 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:30.153894  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:30.172462  5151 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:30.182273  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 96024.5us
I20260709 12:58:30.183732  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:30.201356  1508 leader_election.cc:400] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 10. Current term is 11.
I20260709 12:58:30.184605  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:30.185474  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:30.186270  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:30.125588  1613 raft_consensus.cc:1240] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:30.194067  1691 raft_consensus.cc:2393] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 9: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 12:58:30.196300  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 73906us
I20260709 12:58:30.195564  1688 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 12:58:30.203727  1581 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:30.197613  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 78432.8us
I20260709 12:58:30.173610  4909 consensus_queue.cc:1243] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer c262eac7fc904ae9bb91e450f6532e3f log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:58:30.200286  1685 raft_consensus.cc:1240] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:30.210345  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:30.202566  1508 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:30.205519  1581 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:30.201481  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:30.173074  4911 raft_consensus.cc:697] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:30.216820  1581 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:30.217615  1505 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:30.204931  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:30.207129  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:30.207823  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:30.208649  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:30.154495  5385 raft_consensus.cc:697] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:30.210647  1685 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:58:30.211584  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:30.215236  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:30.220839  1508 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:30.226178  1614 raft_consensus.cc:2393] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 10: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:30.174631  5346 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:30.230931  1542 raft_consensus.cc:1240] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:30.234910  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:30.236455  1541 raft_consensus.cc:2393] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 10: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:30.237532  3947 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:30.239025  1508 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:30.231592  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:30.240151  1536 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:30.232496  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:30.241084  1539 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:30.194312  5379 consensus_queue.cc:1243] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:58:30.243876  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:30.188745  5227 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:30.199954  5362 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:30.209606  5151 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:30.304044  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:30.253050  3947 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:30.252135  1691 raft_consensus.cc:1240] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:30.260085  1616 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:58:30.233551  5193 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:30.244994  5346 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:30.302042  1537 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 12:58:30.344590  1537 pending_rounds.cc:85] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 9
I20260709 12:58:30.344887  1537 pending_rounds.cc:107] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 12:58:30.345118  1537 raft_consensus.cc:2889] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:30.346560  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:30.347266  1537 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:58:30.214560  5215 consensus_queue.cc:1059] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:58:30.349182  5363 raft_consensus.cc:3055] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:30.349560  5363 raft_consensus.cc:740] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:30.304044  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:30.350441  5363 consensus_queue.cc:260] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:30.351629  5363 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:30.253371  1541 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:58:30.208294  5392 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:30.353662  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:30.354295  1541 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:30.311290  5231 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:30.355111  5231 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:30.309629  1536 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:30.357291  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:30.357985  5231 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:30.358428  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:30.359053  1536 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:30.305802  5227 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:30.359589  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:30.360955  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:30.362315  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:30.363556  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:30.311134  4911 consensus_queue.cc:237] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:30.312386  5385 consensus_queue.cc:237] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:30.198079  5393 consensus_queue.cc:1059] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.105s
I20260709 12:58:30.207158  5353 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:30.317898  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:30.233821  1581 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:30.326560  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:30.371765  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:30.378885  1541 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 12:58:30.329922  5193 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:30.331581  1654 connection.cc:256] RPC call timeout handler was delayed by -1.0023131680000006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
I20260709 12:58:30.237098  5361 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:58:30.392313  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 158582us
W20260709 12:58:30.395352  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 285878us
I20260709 12:58:30.226491  5157 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:30.397732  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:30.234925  5247 consensus_queue.cc:1059] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 12:58:30.243927  5351 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:30.367796  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:30.348269  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:30.207505  5371 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:30.335250  5165 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:30.403398  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:30.403987  1608 raft_consensus.cc:2393] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 11: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:30.243664  5276 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:30.386384  1654 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:30.405169  1690 raft_consensus.cc:2410] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 14 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:58:30.406002  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:30.401551  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:30.402055  1581 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:30.412562  1654 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:58:30.412895  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:30.413964  1654 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:30.416006  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 244537us
I20260709 12:58:30.417141  1654 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:30.418529  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:30.420019  1537 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:30.398711  5193 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:30.401101  5363 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:58:30.453692  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 48572.4us
I20260709 12:58:30.472167  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:30.473421  1687 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
W20260709 12:58:30.463007  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 45969.4us
I20260709 12:58:30.475157  1654 leader_election.cc:400] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13.
I20260709 12:58:30.475587  1654 leader_election.cc:403] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:58:30.426230  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:30.422569  1615 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:58:30.476588  1685 raft_consensus.cc:1240] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: []
W20260709 12:58:30.477710  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 75752.7us
I20260709 12:58:30.479101  1581 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:30.252408  5383 consensus_queue.cc:1059] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.145s
W20260709 12:58:30.480258  1655 leader_election.cc:336] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.055s (SENT)
W20260709 12:58:30.482193  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:30.420696  5185 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:58:30.466097  5388 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.041s	sys 0.089s
I20260709 12:58:30.463918  5276 raft_consensus.cc:697] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:30.455047  5359 raft_consensus.cc:3055] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:30.420586  5298 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:30.485481  1581 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:30.467331  5411 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:58:30.488355  1683 raft_consensus.cc:1275] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:58:30.419870  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:30.429220  5353 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:30.448855  5361 raft_consensus.cc:697] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:30.464303  5372 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:30.467849  5363 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:30.440388  5227 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:30.482271  5261 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:30.456923  5272 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 12:58:30.490811  5388 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.041s	sys 0.090s
I20260709 12:58:30.468772  5371 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:30.418299  5165 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:30.436036  5151 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:30.489492  5185 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:30.491155  5359 raft_consensus.cc:740] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:30.498351  5399 raft_consensus.cc:3055] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:30.494316  5298 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:30.508497  5353 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13.
I20260709 12:58:30.507436  5215 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:58:30.540186  1686 raft_consensus.cc:1240] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:30.530366  5372 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:30.516819  5363 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:30.519369  5398 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:58:30.534754  5185 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:30.540063  5298 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:30.536963  5399 raft_consensus.cc:740] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:58:30.578644  5384 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:30.582726  5172 raft_consensus.cc:3055] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:30.530248  5374 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:30.351583  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:30.653257  1535 raft_consensus.cc:1240] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:30.384461  1536 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
W20260709 12:58:30.657230  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 182086us
I20260709 12:58:30.658713  1611 raft_consensus.cc:2393] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 12: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:30.663249  1655 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:30.671679  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:30.677577  1655 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:30.539603  5151 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:30.681034  1654 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:30.683763  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 279292us
I20260709 12:58:30.687075  5165 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:30.687459  3947 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:30.687888  5165 consensus_queue.cc:1059] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:30.688344  3947 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:30.689715  5165 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:58:30.690677  5165 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:30.692826  5165 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:58:30.689234  2269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:30.691511  3947 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:30.692850  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:30.693775  5165 raft_consensus.cc:697] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:30.694329  3947 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:30.695147  3947 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:30.695554  5165 consensus_queue.cc:237] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:30.682694  1654 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:58:30.539585  5227 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:30.702900  5231 raft_consensus.cc:3055] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:58:30.554714  5276 consensus_queue.cc:237] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:30.703485  5231 raft_consensus.cc:740] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:30.705029  5231 consensus_queue.cc:260] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:30.706884  5231 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:30.593595  5172 raft_consensus.cc:740] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:30.695501  1655 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:30.710638  5172 consensus_queue.cc:260] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:30.697383  3947 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:30.714339  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:30.722123  1655 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:30.727571  5298 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:30.720160  1654 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:30.747803  5353 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:30.783103  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:30.783978  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:30.786305  1508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.024s	sys 0.024s
I20260709 12:58:30.788720  1536 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:30.745904  1438 catalog_manager.cc:5697] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:30.792973  1537 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:58:30.793506  1438 catalog_manager.cc:5697] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 4 to 11, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:30.794898  5389 consensus_meta.cc:287] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.001s
I20260709 12:58:30.795684  5389 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:30.797012  5430 consensus_queue.cc:1059] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:30.549639  5372 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:30.801491  1508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.024s	sys 0.024s
I20260709 12:58:30.746518  5346 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:30.798259  5399 consensus_queue.cc:260] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:58:30.806002  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 288866us
I20260709 12:58:30.832703  5431 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:30.833434  5431 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:30.833920  5431 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:30.834584  5372 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:30.835315  5372 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:58:30.598223  5361 consensus_queue.cc:237] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:30.844069  1541 raft_consensus.cc:2393] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 10: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:30.846114  5389 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:30.847239  5371 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:30.847855  5371 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:30.848330  5371 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:30.852620  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:30.853127  1675 tablet_service.cc:1558] Processing DeleteTablet for tablet d5d52e25b9814edbb805e7d6bcce5b5d with delete_type TABLET_DATA_TOMBSTONED (TS 4487a53c51be4634bf1ef29c5248353d not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:50688
W20260709 12:58:30.857668  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:30.859516  5392 raft_consensus.cc:3055] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:30.860059  5392 raft_consensus.cc:740] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:30.802717  1438 catalog_manager.cc:5697] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
W20260709 12:58:30.860774  5417 log.cc:927] Time spent T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 12:58:30.862457  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 142456us
I20260709 12:58:30.862236  1438 catalog_manager.cc:5697] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 3 to 12, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 12 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:30.866289  1684 pending_rounds.cc:85] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 4
I20260709 12:58:30.866735  1684 pending_rounds.cc:107] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:58:30.867049  1684 raft_consensus.cc:2889] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:30.882915  1540 raft_consensus.cc:1813] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Handling vote request from an unknown peer 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:30.883601  1540 raft_consensus.cc:2393] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 9: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:30.886656  1440 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38804 (request call id 37) took 9973 ms. Trace:
I20260709 12:58:30.888777  1616 raft_consensus.cc:2393] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 10: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:30.892877  5351 raft_consensus.cc:3055] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:30.893426  5351 raft_consensus.cc:740] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:30.898597  5383 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:30.899488  5247 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:30.900451  5247 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:30.901594  5298 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:30.902174  5437 log.cc:927] Time spent T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.119s	user 0.003s	sys 0.000s
I20260709 12:58:30.903306  5374 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:30.904215  5399 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:30.905049  5346 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:30.905934  5359 consensus_queue.cc:260] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:30.907195  5359 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:30.908742  5185 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:58:30.909446  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 670538us
I20260709 12:58:30.899422  5383 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:30.911697  4909 consensus_queue.cc:1059] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:30.913233  4909 consensus_queue.cc:1059] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:30.825958  5353 raft_consensus.cc:697] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:30.914229  5420 raft_consensus.cc:3055] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:30.914740  5420 raft_consensus.cc:740] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:30.911593  5185 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:30.920724  1690 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:58:30.921087  1654 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:30.903434  1534 raft_consensus.cc:1240] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:30.922902  5353 consensus_queue.cc:237] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:30.887140  1440 rpcz_store.cc:276] 0709 12:58:20.913042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:20.913238 (+   196us) service_pool.cc:224] Handling call
0709 12:58:30.886416 (+9973178us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:27.444164 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:27.633011 (+188847us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:27.645799 (+ 12788us) write_op.cc:435] Acquired schema lock
0709 12:58:27.648437 (+  2638us) tablet.cc:662] Decoding operations
0709 12:58:27.704389 (+ 55952us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:27.704456 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:27.704506 (+    50us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:58:27.704869 (+   363us) tablet.cc:701] Row locks acquired
0709 12:58:27.704888 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:58:27.705047 (+   159us) write_op.cc:270] Start()
0709 12:58:27.705185 (+   138us) write_op.cc:276] Timestamp: P: 1783601907704992 usec, L: 0
0709 12:58:27.705212 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:58:27.705916 (+   704us) log.cc:844] Serialized 1301 byte log entry
0709 12:58:28.531151 (+825235us) op_driver.cc:464] REPLICATION: finished
0709 12:58:29.548494 (+1017343us) write_op.cc:301] APPLY: starting
0709 12:58:29.581550 (+ 33056us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:29.581721 (+   171us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:29.581859 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:29.582337 (+   478us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:29.582565 (+   228us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:58:29.582618 (+    53us) write_op.cc:312] APPLY: finished
0709 12:58:29.582859 (+   241us) log.cc:844] Serialized 34 byte log entry
0709 12:58:29.741486 (+158627us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:29.741584 (+    98us) write_op.cc:454] Released schema lock
0709 12:58:29.741631 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:29.756198 (+ 14567us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:29.756236 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4193473,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":916555,"apply.run_cpu_time_us":12690,"apply.run_wall_time_us":221934,"num_ops":3,"prepare.queue_time_us":305606,"prepare.run_cpu_time_us":19474,"prepare.run_wall_time_us":463643,"raft.queue_time_us":200869,"raft.run_cpu_time_us":69484,"raft.run_wall_time_us":985216,"replication_time_us":750563,"spinlock_wait_cycles":4992,"thread_start_us":1385352,"threads_started":5,"wal-append.queue_time_us":522924,"wal-append.run_cpu_time_us":9160,"wal-append.run_wall_time_us":2213492}]]}
I20260709 12:58:30.924799  1508 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:30.915834  5420 consensus_queue.cc:260] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:30.898993  5172 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:30.935969  1683 raft_consensus.cc:1240] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:30.936627  1685 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 14. Current term is 15. Ops: []
I20260709 12:58:30.941300  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
W20260709 12:58:30.944168  2267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:30.950876  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 228942us
I20260709 12:58:30.963320  5420 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:30.964521  1689 raft_consensus.cc:1275] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:30.959910  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:30.970827  5389 raft_consensus.cc:3055] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:30.971450  5389 raft_consensus.cc:740] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:30.972918  5389 consensus_queue.cc:260] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:30.974535  5261 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:30.976717  1438 catalog_manager.cc:5697] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 7 to 9, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:30.978880  1438 catalog_manager.cc:5697] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 6 to 8, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:30.979560  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:58:30.980767  4909 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:58:30.982242  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 70046.4us
I20260709 12:58:30.983889  1508 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:30.977320  5341 consensus_queue.cc:1059] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:58:30.984748  5443 tablet_replica.cc:333] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 12:58:30.985373  1675 tablet_service.cc:1558] Processing DeleteTablet for tablet d127be99e2af41c0808e03480c1b64e3 with delete_type TABLET_DATA_TOMBSTONED (TS 4487a53c51be4634bf1ef29c5248353d not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:50688
I20260709 12:58:30.959335  5185 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:58:30.986814  5193 consensus_meta.cc:287] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.005s
I20260709 12:58:30.987282  5341 raft_consensus.cc:3055] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:30.987839  5341 raft_consensus.cc:740] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:58:30.989270  5341 consensus_queue.cc:260] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:58:30.991741  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 59641.5us
I20260709 12:58:30.990866  5341 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:31.002214  1655 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:30.992758  5185 raft_consensus.cc:697] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:30.995761  4909 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:31.012549  1685 raft_consensus.cc:1240] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:30.987370  5193 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:30.974777  5389 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:31.030228  5193 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:31.037199  5185 consensus_queue.cc:237] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:31.039906  1542 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:58:31.041006  1533 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 11. Current term is 12. Ops: []
W20260709 12:58:31.049719  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 50306.5us
I20260709 12:58:31.021441  5430 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:31.050765  4909 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:31.009415  5392 consensus_queue.cc:260] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:31.053393  4909 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:31.054122  3947 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:31.054716  3947 raft_consensus.cc:697] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:31.035933  1438 catalog_manager.cc:5697] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:31.050760  1655 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:31.055871  3947 consensus_queue.cc:237] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:31.068677  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 84968.7us
I20260709 12:58:31.053773  5392 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:31.077594  5301 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:31.078402  5301 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:31.077688  5444 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:31.080638  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:31.082123  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:31.095688  5348 consensus_queue.cc:1048] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:58:31.166041  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 98442.4us
I20260709 12:58:31.085807  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:31.087085  1438 catalog_manager.cc:5697] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 6 to 8, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:31.184338  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:31.169073  1508 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:31.261474  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 90736.4us
I20260709 12:58:31.263339  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:31.264846  5231 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:58:31.265602  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 125629us
I20260709 12:58:31.266782  4909 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:31.267450  4909 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:31.267897  1612 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:31.268589  1655 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:31.268797  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:31.269574  1616 raft_consensus.cc:2393] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 10: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:31.269781  4909 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:31.270416  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:31.270535  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:31.270752  5430 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:31.271281  5430 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:31.271695  5430 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:31.272715  5231 consensus_queue.cc:1059] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:31.276243  5445 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:31.276898  5445 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:31.277357  5445 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:31.255066  5301 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:31.309505  5446 log.cc:927] Time spent T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:58:31.318815  5371 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:31.332762  1438 catalog_manager.cc:5697] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 9 to 11, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:31.336239  1438 catalog_manager.cc:5697] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 7 to 8, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:31.328540  5445 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:31.260002  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:31.848167  1438 catalog_manager.cc:5697] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:31.728112  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1412) took 1497 ms. Trace:
I20260709 12:58:32.076923  1533 rpcz_store.cc:276] 0709 12:58:30.230933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.231092 (+   159us) service_pool.cc:224] Handling call
0709 12:58:30.234576 (+  3484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:31.055677 (+821101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.727695 (+672018us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b5400246654. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:31.728001 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1853968128}
I20260709 12:58:32.129264  5445 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:32.129541  1438 catalog_manager.cc:5697] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 5 to 9, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:32.133481  1438 catalog_manager.cc:5697] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 5 to 6, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:32.135212  1438 catalog_manager.cc:5697] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 9 to 11, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:32.136973  1438 catalog_manager.cc:5697] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 7 to 9, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:32.138945  1438 catalog_manager.cc:5697] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 6 to 9, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:32.140424  1438 catalog_manager.cc:5697] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 4 to 5, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:32.142797  1438 catalog_manager.cc:5697] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:32.144404  1438 catalog_manager.cc:5697] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:32.146205  1438 catalog_manager.cc:5697] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 6 to 7, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:32.147737  1438 catalog_manager.cc:5697] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:32.149205  1438 catalog_manager.cc:5697] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 3 to 5, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:32.158672  5363 consensus_meta.cc:287] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 1.604s	user 0.016s	sys 0.007s
I20260709 12:58:32.160957  5363 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:32.163261  5363 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:32.181546  1609 raft_consensus.cc:1240] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:32.184176  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1472) took 1997 ms. Trace:
I20260709 12:58:32.192584  1609 rpcz_store.cc:276] 0709 12:58:30.186794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.454310 (+267516us) service_pool.cc:224] Handling call
0709 12:58:30.454668 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:32.182031 (+1727363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:32.183874 (+  1843us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b54000023d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:32.184101 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3971082112}
I20260709 12:58:32.201946  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:32.205260  5363 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:32.205961  5363 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:32.207860  1609 raft_consensus.cc:1240] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:32.208243  5363 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:32.210273  5363 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.210894  5363 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:32.213006  5363 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:32.215389  5247 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:32.216001  5363 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.217552  5363 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:32.223105  5363 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:32.223658  5363 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.224162  5363 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:32.227711  5363 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:32.233786  5185 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.968s	user 0.021s	sys 0.004s
W20260709 12:58:32.234211  5185 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.021s	sys 0.004s
I20260709 12:58:32.242210  5185 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.249810  5185 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:32.253954  5185 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:32.274899  5420 consensus_meta.cc:287] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 1.311s	user 0.016s	sys 0.005s
I20260709 12:58:32.275149  1654 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:32.285964  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 979616us
I20260709 12:58:32.287459  1654 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:32.287613  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1853) took 2345 ms. Trace:
I20260709 12:58:32.289041  5185 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:32.300948  1655 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:32.302374  1655 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:32.304021  1655 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:32.289332  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:32.311895  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:31.273244  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 186986us
I20260709 12:58:32.316607  1508 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:32.318289  1508 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:32.320855  1617 raft_consensus.cc:1240] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 6. Current term is 7. Ops: []
I20260709 12:58:32.288060  1688 rpcz_store.cc:276] 0709 12:58:29.942081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.204208 (+262127us) service_pool.cc:224] Handling call
0709 12:58:30.227719 (+ 23511us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:30.227944 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:30.499747 (+271803us) log.cc:844] Serialized 14 byte log entry
0709 12:58:31.262709 (+762962us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:31.306774 (+ 44065us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:31.306826 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:32.287221 (+980395us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:32.287401 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14649,"prepare.queue_time_us":78890,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":66540,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":272,"thread_start_us":981163,"threads_started":3,"wal-append.queue_time_us":284089,"wal-append.run_cpu_time_us":10538,"wal-append.run_wall_time_us":1476598}
W20260709 12:58:32.327586  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 47603.4us
W20260709 12:58:32.335650  1471 debug-util.cc:398] Leaking SignalData structure 0x7b0800302ba0 after lost signal to thread 434
I20260709 12:58:32.387996  5363 consensus_queue.cc:1059] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:58:32.389873  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:32.390738  1609 raft_consensus.cc:1813] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Handling vote request from an unknown peer 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:32.391352  1609 raft_consensus.cc:2410] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:58:32.391228  5420 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:32.401602  5371 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:32.404230  5420 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:32.676172  5420 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:58:32.401093  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 82990.7us
I20260709 12:58:32.698097  1508 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:32.672158  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:32.388679  5185 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:32.409332  5371 consensus_queue.cc:1059] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.308s
I20260709 12:58:32.391554  5363 raft_consensus.cc:3055] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:58:32.717456  5363 raft_consensus.cc:740] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:32.717657  5371 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:32.400799  5247 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:32.718878  5363 consensus_queue.cc:260] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:32.720397  5363 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:32.721169  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2259) took 1777 ms. Trace:
I20260709 12:58:32.387676  1655 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:32.725039  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:32.737092  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:32.737859  1611 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:32.721583  1682 rpcz_store.cc:276] 0709 12:58:30.943522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.943800 (+   278us) service_pool.cc:224] Handling call
0709 12:58:30.944809 (+  1009us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:30.950718 (+  5909us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:30.962000 (+ 11282us) log.cc:844] Serialized 14 byte log entry
0709 12:58:31.037056 (+ 75056us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:31.037691 (+   635us) log.cc:844] Serialized 26 byte log entry
0709 12:58:31.037851 (+   160us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:31.037890 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.037964 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:32.720800 (+1682836us) raft_consensus.cc:1685] finished
0709 12:58:32.720825 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:32.720990 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15471,"prepare.queue_time_us":7539,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":70,"raft.queue_time_us":23106,"raft.run_cpu_time_us":509,"raft.run_wall_time_us":39115,"thread_start_us":61007,"threads_started":1,"wal-append.queue_time_us":298830,"wal-append.run_cpu_time_us":2634,"wal-append.run_wall_time_us":1031037}
I20260709 12:58:32.758183  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:32.869150  1508 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:32.891297  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:32.909857  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 523793us
W20260709 12:58:32.902117  5430 consensus_meta.cc:287] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 1.629s	user 0.023s	sys 0.009s
W20260709 12:58:32.916591  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 81887.1us
W20260709 12:58:32.917241  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 122657us
I20260709 12:58:32.919342  1608 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 13. Current term is 14. Ops: []
W20260709 12:58:32.924011  5431 consensus_meta.cc:287] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 2.089s	user 0.016s	sys 0.012s
I20260709 12:58:32.930143  5431 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:32.932161  5441 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:32.932694  5441 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:32.932827  5431 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:32.934237  5431 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.935177  5431 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:32.933102  5441 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:32.934139  1616 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:32.939286  5431 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:32.940274  5431 raft_consensus.cc:3055] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:58:32.941134  5431 raft_consensus.cc:740] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:32.942751  5165 raft_consensus.cc:3055] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:58:32.942970  5431 consensus_queue.cc:260] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:32.946391  5441 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:32.948853  5441 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:32.949935  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:32.953006  1616 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:32.954370  5458 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:58:32.950264  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:32.957028  1508 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:32.959196  5374 consensus_queue.cc:1059] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:32.959707  1583 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:32.961054  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:32.961298  5359 raft_consensus.cc:3055] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:32.961727  5384 raft_consensus.cc:2804] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:32.962180  1690 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:32.950423  5430 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:32.950726  5431 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:32.964468  5430 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:32.962198  5384 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:32.965134  5384 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:32.965829  5351 consensus_queue.cc:260] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:32.943259  5165 raft_consensus.cc:740] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:32.967658  5165 consensus_queue.cc:260] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:32.970606  5227 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:32.971096  5227 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:32.971583  5372 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:32.972189  5372 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:32.974778  5372 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:32.975389  5372 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:32.981977  5363 consensus_queue.cc:1059] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:32.983728  5361 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:32.985569  5361 raft_consensus.cc:3055] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:32.985978  5361 raft_consensus.cc:740] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:32.972132  5458 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:32.986992  5361 consensus_queue.cc:260] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:32.923980  5420 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:32.967234  5351 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:32.986166  1655 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:32.957032  1608 raft_consensus.cc:2393] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 14: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:32.976217  5372 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:32.961776  5359 raft_consensus.cc:740] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:32.992058  5193 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:33.008914  5298 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:32.997176  5374 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:58:32.996892  5227 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:33.029309  1616 raft_consensus.cc:2410] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:58:33.008888  1655 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:32.988446  5361 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:33.027786  5372 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:32.990702  5420 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.006902  5247 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:58:33.027607  5430 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.049381  5371 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:33.049832  5459 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:33.052270  1583 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:33.054630  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.054467  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.055473  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.054464  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2256) took 2132 ms. Trace:
I20260709 12:58:33.019600  5165 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:58:33.035389  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:33.022840  5193 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:33.057415  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.028889  5363 consensus_queue.cc:1059] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
W20260709 12:58:33.064230  5172 consensus_meta.cc:287] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 2.114s	user 0.018s	sys 0.012s
I20260709 12:58:33.060750  5298 raft_consensus.cc:697] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:32.987128  5458 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.066856  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.026393  5185 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:33.067250  1690 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:33.069494  5372 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:33.072722  1685 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:33.073282  5247 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:33.065013  1611 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:33.079725  5193 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:33.090509  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:33.090771  1689 raft_consensus.cc:2368] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 13. Current term is 14.
I20260709 12:58:33.100076  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:33.101172  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:33.027498  5359 consensus_queue.cc:260] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.080994  5420 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:33.106447  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 97716.4us
I20260709 12:58:33.105340  1583 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:33.102442  2266 connection.cc:256] RPC call timeout handler was delayed by -1.5230467190000354s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19110000000000002s for a response
I20260709 12:58:33.108686  1683 raft_consensus.cc:2393] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 10: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:33.099915  5247 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:33.110109  1682 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:33.074379  1686 rpcz_store.cc:276] 0709 12:58:30.921630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.927621 (+  5991us) service_pool.cc:224] Handling call
0709 12:58:30.965978 (+ 38357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:31.022933 (+ 56955us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:31.043670 (+ 20737us) log.cc:844] Serialized 14 byte log entry
0709 12:58:32.212050 (+1168380us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b1800348ac0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f643f3 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd 000000000038f354 000000000038f199 00007fc859f4783a
0709 12:58:32.325784 (+113734us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b1800348ac0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf123a 00007fc85d05ba2a
0709 12:58:33.048020 (+722236us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:33.048836 (+   816us) log.cc:844] Serialized 26 byte log entry
0709 12:58:33.049108 (+   272us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:33.049164 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:33.049769 (+   605us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:33.053794 (+  4025us) raft_consensus.cc:1685] finished
0709 12:58:33.053814 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:33.054089 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3709,"prepare.queue_time_us":19174,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":197516,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":5955,"spinlock_wait_cycles":71564800,"thread_start_us":721662,"threads_started":2,"wal-append.queue_time_us":1980591}
I20260709 12:58:33.112612  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.078130  5430 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.110931  5427 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.114748  5463 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:33.112327  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.115727  5298 consensus_queue.cc:237] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.111066  5374 consensus_queue.cc:1048] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:58:33.078959  5459 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.119715  5384 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.110327  5172 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:33.120695  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.120849  1655 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.128353  1608 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:33.128651  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:33.128913  1655 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:33.129451  1539 raft_consensus.cc:2393] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 10: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:33.128108  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:33.116847  5359 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:33.125097  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:33.112926  5431 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:58:33.126948  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 170075us
I20260709 12:58:33.112660  5247 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:33.126255  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.130470  1537 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:33.130693  1541 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:33.133113  1690 raft_consensus.cc:1275] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:58:33.133580  1683 raft_consensus.cc:2393] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 12: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:33.134483  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:33.134704  1685 raft_consensus.cc:2393] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 13: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:33.141629  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:33.137482  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:33.137526  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:33.121445  5420 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.148219  5462 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:58:33.149817  1616 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:33.147953  1686 raft_consensus.cc:2410] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:58:33.148520  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:33.127393  5427 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:33.151585  5430 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:33.153585  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 277) took 1881 ms. Trace:
I20260709 12:58:33.137372  5463 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.157290  1613 raft_consensus.cc:1240] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:33.157680  5384 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.158349  5384 raft_consensus.cc:3055] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:58:33.154700  5420 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.159749  1508 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.161944  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.154168  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:33.134985  5374 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:58:33.154961  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.164655  5374 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:33.165140  5427 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.175927  5420 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.158671  5463 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.165912  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:33.177150  5463 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.176647  5420 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.177738  5463 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.179117  1508 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.127540  5227 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.158720  5384 raft_consensus.cc:740] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:33.166574  5361 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.173290  5379 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:33.156833  1534 rpcz_store.cc:276] 0709 12:58:31.272012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:31.272259 (+   247us) service_pool.cc:224] Handling call
0709 12:58:31.272619 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:31.272900 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:31.273313 (+   413us) log.cc:844] Serialized 14 byte log entry
0709 12:58:31.273572 (+   259us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:31.273623 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:31.273728 (+   105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:33.153386 (+1879658us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:33.153528 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1226,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":10919,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":16718}
I20260709 12:58:33.180238  5463 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.136730  5172 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:33.188645  1655 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:33.169472  1654 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 1.983s (SENT) [suppressed 50 similar messages]
I20260709 12:58:33.185839  1613 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:33.184942  5374 raft_consensus.cc:697] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:33.192204  5430 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:33.192662  1655 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:33.168408  5193 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.194787  5420 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.196583  5420 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:33.198019  5459 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:33.195281  5460 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:58:33.195415  5430 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:33.192553  5374 consensus_queue.cc:237] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.191438  5379 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:33.198408  5398 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.201069  5379 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:33.201459  5458 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:33.198884  5460 raft_consensus.cc:697] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:33.200768  5398 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.193976  1655 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.203859  1655 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:33.204444  3947 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.885s	user 0.010s	sys 0.004s
W20260709 12:58:33.204834  3947 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.885s	user 0.012s	sys 0.004s
I20260709 12:58:33.205243  5398 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.205422  3947 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:58:33.205942  5172 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:33.206348  5231 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:33.206743  5231 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:33.207109  5231 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:33.205117  1655 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.194905  5193 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.197258  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.216640  1686 raft_consensus.cc:1275] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:58:33.212567  5361 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.218509  1690 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:33.219210  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.219892  1683 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:33.220220  5384 consensus_queue.cc:260] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.215348  5458 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:58:33.238300  5389 consensus_meta.cc:287] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 2.192s	user 0.022s	sys 0.003s
I20260709 12:58:33.213058  5463 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:58:33.250792  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:33.252660  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 73638.2us
I20260709 12:58:33.242568  5459 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:33.255200  1655 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:33.255643  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:33.248622  5384 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:33.253998  5389 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:58:33.257608  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 88176.8us
I20260709 12:58:33.245805  5247 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:33.261719  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:33.261657  1508 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.263352  5458 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:58:33.263899  5379 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.264405  5379 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.265717  5465 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.266279  5465 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.266618  5379 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.269709  5465 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.271739  1689 raft_consensus.cc:2410] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:58:33.273558  5231 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.273965  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:33.274631  1610 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:33.275138  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1908) took 1072 ms. Trace:
I20260709 12:58:33.221714  5460 consensus_queue.cc:237] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.275417  1610 rpcz_store.cc:276] 0709 12:58:32.202885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:33.273680 (+1070795us) service_pool.cc:224] Handling call
0709 12:58:33.275056 (+  1376us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:33.280779  2266 leader_election.cc:336] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 1.911s (SENT)
I20260709 12:58:33.272300  5443 raft_consensus.cc:2243] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:33.282132  1654 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.282948  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:33.273962  5227 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.283718  1534 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:33.260236  5459 raft_consensus.cc:697] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:33.284693  5165 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:33.285269  5165 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:33.285552  5459 consensus_queue.cc:237] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.287621  5165 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:33.288995  1533 raft_consensus.cc:1240] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:33.260040  5463 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.290174  5247 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.291800  5463 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.292558  1508 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.294323  1508 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.279163  5465 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:33.297281  5465 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:33.279019  5467 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.281168  5231 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:33.309003  5247 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:33.306278  5467 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.309547  5247 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:33.309985  5247 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:33.311307  5467 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.312510  5443 raft_consensus.cc:2272] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:33.315716  1609 raft_consensus.cc:1240] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:58:33.316069  5443 ts_tablet_manager.cc:1916] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:33.316751  1508 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.316887  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:33.317499  1613 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 10.
I20260709 12:58:33.318547  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:33.319200  1610 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 9.
I20260709 12:58:33.319692  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:33.319960  5467 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:33.320549  1608 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 8.
I20260709 12:58:33.309829  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:33.318431  1508 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:33.322956  1534 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:58:33.308531  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 46135.6us
I20260709 12:58:33.320649  5462 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:33.308673  2266 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:33.259306  5389 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.334633  1654 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.294384  5420 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:33.342963  1654 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.343561  1508 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.346168  1508 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.323591  5467 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:33.349356  5231 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:33.352572  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:33.353091  1690 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:33.353273  1683 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:33.354157  5463 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:33.354655  5463 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:33.355014  5463 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:33.354398  5440 raft_consensus.cc:3055] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:33.355403  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.355587  5440 raft_consensus.cc:740] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:33.356559  5440 consensus_queue.cc:260] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.357290  1508 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.357592  5440 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:33.358294  5351 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:33.358562  5247 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.359002  1508 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.360455  1508 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.363108  1541 raft_consensus.cc:1240] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:33.353273  1537 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 14. Current term is 15. Ops: []
I20260709 12:58:33.361121  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.334161  5462 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:33.360654  1654 raft_consensus.cc:2686] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:58:33.369143  1534 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:58:33.374435  1583 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:33.377511  1534 raft_consensus.cc:1240] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:33.375411  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:33.377411  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.377571  1654 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:33.362936  5363 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.381187  1690 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:33.381359  5363 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.381979  5432 consensus_queue.cc:1048] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:33.382138  5165 consensus_queue.cc:1059] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:33.369486  5462 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:33.383464  5432 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:33.383868  5432 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:33.385107  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:33.385711  1614 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:33.367048  5398 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.386781  5398 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.380649  1583 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:33.360559  5172 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:33.380386  1537 raft_consensus.cc:1275] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:58:33.384199  5432 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:33.390617  1533 raft_consensus.cc:2393] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 10: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:33.384110  1690 raft_consensus.cc:1240] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:33.397666  1688 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 14. Current term is 15. Ops: []
I20260709 12:58:33.403210  5359 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.403898  5359 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.405179  1581 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:33.406303  5359 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.397091  1654 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:33.374341  5467 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:33.406649  1581 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:33.411742  1537 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:58:33.411768  1534 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:58:33.380577  5468 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:33.407017  5398 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.389822  5427 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:33.419410  1683 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:33.397512  5430 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:33.422360  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:33.407821  5247 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.421530  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:33.421263  5450 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:33.411599  5467 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:33.423349  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:33.426134  1534 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:33.425595  1691 raft_consensus.cc:1240] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 10. Current term is 11. Ops: []
W20260709 12:58:33.426400  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 66087.4us
I20260709 12:58:33.389309  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:58:33.436559  1614 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:58:33.436976  1609 raft_consensus.cc:606] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:33.427292  5441 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:33.427785  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:33.425021  5398 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:33.429016  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:33.408425  5371 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:58:33.424732  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 144012us
I20260709 12:58:33.425681  1536 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:33.419020  5359 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:58:33.441762  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:33.432857  5435 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:33.429845  5450 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:33.434144  1581 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:33.442896  5450 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:33.435865  1533 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:33.441075  1537 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:33.443691  5363 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.407734  5185 consensus_queue.cc:1059] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:58:33.444535  5185 raft_consensus.cc:3055] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:33.444929  5185 raft_consensus.cc:740] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:33.425894  5374 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:33.445575  5374 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:33.445977  5374 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:33.445725  5185 consensus_queue.cc:260] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.446909  5185 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:33.437387  1609 raft_consensus.cc:614] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:33.435966  5361 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.425161  5389 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.435658  5430 raft_consensus.cc:697] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:33.449538  5462 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.441963  5371 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:33.450731  1537 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:33.453987  5427 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.454285  5361 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:33.454869  5450 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.455081  1581 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:33.437338  5467 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:33.467897  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.471283  5432 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.471907  1689 raft_consensus.cc:1240] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:33.472095  1683 raft_consensus.cc:1240] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:33.475271  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:33.476308  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:33.477051  5441 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.487321  5441 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:33.488370  5462 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:33.489310  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:33.483248  2266 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:33.421792  5468 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:33.492859  5430 consensus_queue.cc:237] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.494503  5468 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:33.495762  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:33.496628  1538 raft_consensus.cc:2410] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:58:33.496966  5432 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.497386  1508 leader_election.cc:400] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 13. Current term is 14.
I20260709 12:58:33.497704  1508 leader_election.cc:403] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:33.498869  1508 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.483162  5398 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:33.499635  5398 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:33.500016  5398 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:33.500650  5247 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:58:33.501427  1542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.421s	user 0.059s	sys 0.061s
W20260709 12:58:33.501736  1542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.422s	user 0.059s	sys 0.061s
I20260709 12:58:33.502532  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2188) took 2428 ms. Trace:
W20260709 12:58:33.479773  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 100031us
I20260709 12:58:33.503397  5227 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:33.481168  5372 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:33.499254  5341 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:33.504891  5341 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:33.505231  5341 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:33.506614  1612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 1470) took 3320 ms (client timeout 1983 ms). Trace:
I20260709 12:58:33.507189  1533 raft_consensus.cc:1240] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:33.508713  1540 raft_consensus.cc:1240] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:33.509162  1536 raft_consensus.cc:1275] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:58:33.509970  1539 raft_consensus.cc:1240] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:33.512668  5389 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:33.514128  5463 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:33.507021  1612 rpcz_store.cc:269] 0709 12:58:30.186322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.204641 (+ 18319us) service_pool.cc:224] Handling call
0709 12:58:33.506381 (+3301740us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b54001f6dd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:33.506522 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1800463616}
I20260709 12:58:33.480226  5427 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:33.504593  5432 consensus_queue.cc:1048] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:33.516217  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:33.517272  1537 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:33.504528  5372 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.519858  5372 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:33.520566  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:33.522183  1583 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:33.522774  1612 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 10.
W20260709 12:58:33.526397  1471 debug-util.cc:398] Leaking SignalData structure 0x7b080018f1a0 after lost signal to thread 1474
I20260709 12:58:33.528038  1533 raft_consensus.cc:1240] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:33.528532  5463 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.529896  1535 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 14. Current term is 15. Ops: []
I20260709 12:58:33.502873  1542 rpcz_store.cc:276] 0709 12:58:31.073900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:31.074030 (+   130us) service_pool.cc:224] Handling call
0709 12:58:31.078634 (+  4604us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:31.079082 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:31.079113 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:31.079772 (+   659us) log.cc:844] Serialized 52 byte log entry
0709 12:58:33.502109 (+2422337us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:33.502156 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:33.502245 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:33.502290 (+    45us) raft_consensus.cc:1685] finished
0709 12:58:33.502302 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:33.502448 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23235,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":89449,"thread_start_us":2421919,"threads_started":1,"wal-append.queue_time_us":1805066}
I20260709 12:58:33.500128  1508 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.476637  1534 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:58:33.536227  5443 ts_tablet_manager.cc:1929] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.7
I20260709 12:58:33.536854  5443 log.cc:1199] T d5d52e25b9814edbb805e7d6bcce5b5d P 4487a53c51be4634bf1ef29c5248353d: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-2-root/wals/d5d52e25b9814edbb805e7d6bcce5b5d
I20260709 12:58:33.536271  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:33.537928  1538 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:58:33.538218  5443 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50688 (request call id 63) took 2705 ms. Trace:
I20260709 12:58:33.538792  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.539412  5341 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:33.539633  5344 consensus_queue.cc:1059] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:58:33.539443  1691 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 9.
I20260709 12:58:33.541987  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:33.546690  1542 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
W20260709 12:58:33.548084  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:33.548961  5351 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:33.549245  5172 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:33.550002  5227 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.550215  5485 consensus_queue.cc:1059] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:58:33.550160  5351 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:33.551277  1541 raft_consensus.cc:1240] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:33.551573  5383 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.552402  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2251) took 3082 ms. Trace:
I20260709 12:58:33.552663  5351 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:33.552317  5227 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:33.553877  1538 raft_consensus.cc:1275] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:33.553109  1684 rpcz_store.cc:276] 0709 12:58:30.470187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.471348 (+  1161us) service_pool.cc:224] Handling call
0709 12:58:30.865674 (+394326us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:30.867946 (+  2272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:30.867985 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:30.926786 (+ 58801us) log.cc:844] Serialized 52 byte log entry
0709 12:58:31.072018 (+145232us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:31.072043 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:31.075707 (+  3664us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:31.310856 (+235149us) raft_consensus.cc:1685] finished
0709 12:58:31.310878 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:33.552125 (+2241247us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b54000de650. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:33.552340 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22694,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":151,"spinlock_wait_cycles":905873792,"thread_start_us":142506,"threads_started":1,"wal-append.queue_time_us":159915,"wal-append.run_cpu_time_us":2267,"wal-append.run_wall_time_us":1165128}
I20260709 12:58:33.555207  5227 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:33.551208  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:33.552318  5344 raft_consensus.cc:3055] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:33.556195  2297 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:33.558688  5465 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:33.556524  5344 raft_consensus.cc:740] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:58:33.561357  5344 consensus_queue.cc:260] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:58:33.562057  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 62001.4us
I20260709 12:58:33.549764  5172 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.567240  5172 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.482100  5450 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:33.563337  1508 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.562366  1654 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:33.568317  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 85151.3us
I20260709 12:58:33.570499  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:33.572723  1654 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:58:33.573393  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:33.575546  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:33.575803  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:33.576293  2300 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:33.576721  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:33.577119  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:33.577358  2297 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:33.575547  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:33.578613  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:33.575712  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:33.580358  1608 raft_consensus.cc:2376] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11. Re-sending same reply.
W20260709 12:58:33.580749  1471 debug-util.cc:398] Leaking SignalData structure 0x7b0800150b20 after lost signal to thread 1566
I20260709 12:58:33.581611  5165 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:33.582119  5165 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:33.582522  5165 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:58:33.581938  1471 debug-util.cc:398] Leaking SignalData structure 0x7b0800151920 after lost signal to thread 1641
I20260709 12:58:33.585057  5458 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:33.585681  5458 raft_consensus.cc:697] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:33.586544  5458 consensus_queue.cc:237] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:33.590549  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:33.576542  1616 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:58:33.555424  5427 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:33.544183  5463 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:33.602037  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:33.542515  5432 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:33.604535  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:33.607533  1533 raft_consensus.cc:1275] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:58:33.609205  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:33.610157  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:33.610095  1614 raft_consensus.cc:2393] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 12: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:33.593216  5247 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 13. Current term is 14.
I20260709 12:58:33.615090  1617 raft_consensus.cc:2393] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 13: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:33.614566  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:33.618986  1538 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 9.
W20260709 12:58:33.618068  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 55268.1us
I20260709 12:58:33.604249  5172 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:33.626403  2266 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:33.627331  2267 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:58:33.628995  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 97249us
I20260709 12:58:33.629413  1508 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.617190  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:33.586463  5398 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.609447  5344 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:33.630286  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:33.630882  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:33.607223  5432 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:33.538632  5443 rpcz_store.cc:276] 0709 12:58:30.833119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.852707 (+ 19588us) service_pool.cc:224] Handling call
0709 12:58:30.921308 (+ 68601us) ts_tablet_manager.cc:1151] Deleting tablet d5d52e25b9814edbb805e7d6bcce5b5d
0709 12:58:30.921405 (+    97us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:58:33.491802 (+2570397us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:33.536076 (+ 44274us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:33.538142 (+  2066us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2287125,"tablet-delete.queue_time_us":67121,"thread_start_us":26669,"threads_started":1}
I20260709 12:58:33.646584  5432 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:33.646872  5301 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:33.637108  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:33.647302  5301 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:33.647814  5301 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:33.648337  1427 catalog_manager.cc:5028] TS 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): tablet d5d52e25b9814edbb805e7d6bcce5b5d (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:58:33.647339  5443 tablet_replica.cc:333] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 12:58:33.650094  5443 raft_consensus.cc:2243] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:33.650636  5467 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.651774  1540 raft_consensus.cc:1240] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:33.652631  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:58:33.653260  1614 raft_consensus.cc:606] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:33.653568  1614 raft_consensus.cc:614] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:33.654606  5371 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.657832  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:33.658718  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:33.631327  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:33.659353  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:33.659559  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:33.659931  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:33.660866  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:33.660596  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:33.661276  5341 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 10 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.660586  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:33.663138  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:58:33.647068  1471 debug-util.cc:398] Leaking SignalData structure 0x7b0800355420 after lost signal to thread 1715
W20260709 12:58:33.638856  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:33.618490  5455 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.013s	sys 0.014s
I20260709 12:58:33.640262  5486 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:33.641168  1538 raft_consensus.cc:1275] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:58:33.642426  5398 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.645726  5374 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.658907  5389 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:33.661851  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:33.639622  1609 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
W20260709 12:58:33.664088  1471 debug-util.cc:398] Leaking SignalData structure 0x7b0800336e20 after lost signal to thread 1716
W20260709 12:58:33.669863  1471 debug-util.cc:398] Leaking SignalData structure 0x7b080038ec40 after lost signal to thread 2327
W20260709 12:58:33.670363  1471 debug-util.cc:398] Leaking SignalData structure 0x7b080037b780 after lost signal to thread 5215
I20260709 12:58:33.671216  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:33.668248  5465 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:33.671849  5465 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:33.672308  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:33.673717  5443 raft_consensus.cc:2272] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:58:33.665944  5455 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.014s	sys 0.014s
I20260709 12:58:33.671815  1612 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:33.672394  5465 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:33.674186  1541 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:58:33.669230  5481 raft_consensus.cc:3055] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:58:33.666882  5486 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:33.677624  5481 raft_consensus.cc:740] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:33.677078  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:33.678453  1535 raft_consensus.cc:2393] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 9: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:33.678530  5481 consensus_queue.cc:260] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.679849  5481 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:58:33.680392  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 417267us
I20260709 12:58:33.666296  5371 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:33.681244  1655 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.682264  1612 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 10.
I20260709 12:58:33.676873  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:33.683053  1537 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:33.684183  5486 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:33.637985  5361 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:33.674687  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:33.685675  1616 raft_consensus.cc:1240] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:33.685927  1610 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 8.
I20260709 12:58:33.686677  1538 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 13. Current term is 14. Ops: [11.6-13.7]
I20260709 12:58:33.687109  2266 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:33.677356  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:33.688220  5427 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:33.688845  5427 raft_consensus.cc:697] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 10 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:58:33.689221  5374 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.688269  1613 raft_consensus.cc:2393] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 13: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:33.689718  5427 consensus_queue.cc:237] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:33.691305  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:33.693845  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:33.694471  1612 raft_consensus.cc:1813] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Handling vote request from an unknown peer dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:33.694931  1612 raft_consensus.cc:2393] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 12: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:33.699491  1583 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:33.700318  1539 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
W20260709 12:58:33.701498  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 72167.3us
I20260709 12:58:33.702329  1508 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.701599  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:33.703197  5247 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:58:33.704196  5443 ts_tablet_manager.cc:1916] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:33.705559  5438 consensus_queue.cc:1059] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:58:33.710042  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 82794.2us
I20260709 12:58:33.706363  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.710755  1608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:58:33.707180  1684 raft_consensus.cc:1275] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:58:33.707679  5398 raft_consensus.cc:2804] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:33.706173  1508 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.711369  1608 raft_consensus.cc:606] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:33.710983  1688 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:33.712204  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:33.711395  1684 pending_rounds.cc:85] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 4
I20260709 12:58:33.719141  1537 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:33.719515  1684 pending_rounds.cc:107] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:58:33.719694  1685 raft_consensus.cc:1240] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:33.720216  1684 raft_consensus.cc:2889] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:33.721042  1685 raft_consensus.cc:1240] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:58:33.719043  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.714252  1535 raft_consensus.cc:2376] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14. Re-sending same reply.
I20260709 12:58:33.700659  5371 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:33.724290  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:33.720847  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:33.726171  1690 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:33.725139  1683 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:58:33.725162  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.727133  1686 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
W20260709 12:58:33.727465  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:33.727133  1689 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:33.727586  1539 raft_consensus.cc:2393] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 10: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:33.729462  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:58:33.712571  5392 consensus_meta.cc:287] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 2.639s	user 0.023s	sys 0.011s
I20260709 12:58:33.729053  5398 raft_consensus.cc:697] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:33.733613  5398 consensus_queue.cc:237] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.736100  5463 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:33.730999  5193 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:33.721597  5468 consensus_queue.cc:1059] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:58:33.738775  5468 raft_consensus.cc:3055] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:33.739147  5468 raft_consensus.cc:740] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:58:33.745352  1471 debug-util.cc:398] Leaking SignalData structure 0x7b08002d1f00 after lost signal to thread 5233
W20260709 12:58:33.745894  1471 debug-util.cc:398] Leaking SignalData structure 0x7b08003bc7c0 after lost signal to thread 5357
I20260709 12:58:33.747181  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:33.747859  1533 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:33.751379  5485 raft_consensus.cc:3055] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:33.751832  5485 raft_consensus.cc:740] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:33.736441  1689 raft_consensus.cc:1240] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:33.759447  3947 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.760322  2301 raft_consensus.cc:1813] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Handling vote request from an unknown peer dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:33.761042  5361 consensus_queue.cc:1059] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:33.761802  2301 raft_consensus.cc:2410] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:58:33.763084  1690 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:33.759928  3947 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.765908  1534 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:33.756112  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.767020  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:33.767884  1690 raft_consensus.cc:2410] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:58:33.726569  5467 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.725903  5371 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:33.766815  1685 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:33.761305  5485 consensus_queue.cc:260] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.770874  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:33.771481  1688 raft_consensus.cc:1240] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:33.736955  5450 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:58:33.713174  5185 consensus_queue.cc:1059] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:58:33.773190  5361 raft_consensus.cc:3055] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:33.782537  5361 raft_consensus.cc:740] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:33.783471  5361 consensus_queue.cc:260] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.784255  5486 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:33.740120  5468 consensus_queue.cc:260] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.774041  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:33.775584  1583 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:33.776523  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:33.776449  5469 consensus_queue.cc:1059] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:33.712945  5165 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.776358  5438 consensus_queue.cc:1059] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:58:33.773986  1505 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:58:33.781952  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 52387.6us
I20260709 12:58:33.809470  1683 raft_consensus.cc:2393] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 13: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:33.810286  1684 raft_consensus.cc:2393] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 10: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:33.779449  5371 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:58:33.794920  5487 log.cc:927] Time spent T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6: Append to log took a long time: real 0.182s	user 0.000s	sys 0.003s
I20260709 12:58:33.765688  5301 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:33.817945  5482 consensus_queue.cc:1059] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:58:33.815308  1583 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:33.821257  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:58:33.822741  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 48830us
I20260709 12:58:33.824887  1655 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:33.811321  5193 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:33.812336  5363 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:33.824843  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.840140  1690 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:33.834837  5193 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.836225  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.821373  5485 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:33.838016  5165 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:33.857764  5301 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:33.857980  5193 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.837882  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:33.859298  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:33.859877  1687 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:33.859794  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.841181  1686 raft_consensus.cc:2368] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13.
I20260709 12:58:33.830610  5392 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:33.861008  5392 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:33.861354  5392 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:33.861935  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.862565  1686 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:33.863478  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:33.863750  5165 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:33.864557  1508 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.865780  1508 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.818367  5361 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:33.844606  1525 tablet_service.cc:1558] Processing DeleteTablet for tablet e4681eaad3084357b9677e4242b97c99 with delete_type TABLET_DATA_TOMBSTONED (TS dbe6a89d0e1c4137b3a1b17bf4b520d8 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:51498
I20260709 12:58:33.845212  5385 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:58:33.847016  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:33.817999  5465 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.882269  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.883091  1684 raft_consensus.cc:2393] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 11: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:33.850139  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.850598  5468 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:33.814649  5379 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:58:33.886054  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.843425  1505 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.887825  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:33.888361  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 45003.4us
I20260709 12:58:33.872908  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:33.891113  1685 raft_consensus.cc:2393] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 13: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:33.892556  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.877018  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.895543  1507 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.875635  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:33.896340  1688 raft_consensus.cc:2393] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 13: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:33.876057  5193 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:58:33.893688  1508 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.895430  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:33.867904  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:33.897367  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.898248  1683 raft_consensus.cc:2393] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 13: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:33.880105  1582 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:33.896457  1540 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:33.841739  5363 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:33.879267  5463 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:33.922869  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.898463  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:33.920826  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.885273  5359 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:58:33.954489  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 236671us
I20260709 12:58:33.955569  1691 raft_consensus.cc:2393] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 11: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 12:58:33.947739  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 132536us
W20260709 12:58:33.948132  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 54568.1us
I20260709 12:58:33.956894  1583 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:33.892278  5467 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:33.899497  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.963306  1688 raft_consensus.cc:1813] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Handling vote request from an unknown peer dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:33.963773  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.957213  1508 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.964087  1688 raft_consensus.cc:2410] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:58:33.897493  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.915969  5231 raft_consensus.cc:3055] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:58:33.947110  5363 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:33.914564  5172 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:33.983085  1682 raft_consensus.cc:1240] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:33.983773  1690 raft_consensus.cc:2410] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:58:33.915174  5465 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.993170  1508 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:33.948504  5463 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:33.950095  5247 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:34.001700  1508 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:33.995035  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:33.995460  1583 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:33.951581  5359 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:33.999235  3947 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:33.958158  5458 raft_consensus.cc:3055] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:34.005415  1689 raft_consensus.cc:2393] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 12: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 12:58:34.005976  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 189616us
I20260709 12:58:33.983448  5481 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:33.984704  5231 raft_consensus.cc:740] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:33.988374  5435 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:33.955469  1582 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:33.957651  5469 consensus_queue.cc:1048] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:58:33.986008  5432 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:33.997764  5463 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:34.002405  5467 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:34.090646  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:34.068859  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 67237.7us
I20260709 12:58:34.036710  1687 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
I20260709 12:58:33.999902  5193 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:58:34.097905  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:34.120127  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:58:34.098840  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 60501.5us
I20260709 12:58:34.124011  1508 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:34.124761  1539 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
W20260709 12:58:34.098609  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 64685.8us
I20260709 12:58:34.125522  1508 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:34.101657  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 146294us
I20260709 12:58:34.126703  1582 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:34.126986  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:34.127666  1686 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 14. Current term is 15. Ops: []
I20260709 12:58:34.129137  1533 raft_consensus.cc:2368] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13.
I20260709 12:58:34.131325  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:34.132170  1508 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:34.010893  5481 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:34.133498  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:34.093276  5435 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:34.133445  1508 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:34.134563  1611 raft_consensus.cc:2393] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 12: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:34.086649  5385 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:34.008451  5359 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:34.008330  5458 raft_consensus.cc:740] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:34.136682  1617 raft_consensus.cc:1240] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:34.166715  1535 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 12:58:34.136325  5389 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:34.170725  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:34.203469  1614 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:34.171984  1508 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:34.062968  5465 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:34.010298  5379 consensus_queue.cc:1059] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.127s
I20260709 12:58:34.098171  5374 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 12:58:34.176649  1613 raft_consensus.cc:1275] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:58:34.177661  1583 leader_election.cc:400] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13.
I20260709 12:58:34.207767  1583 leader_election.cc:403] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:58:34.208268  3947 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:58:34.209769  1508 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:34.212190  3947 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:34.176635  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:34.167232  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:34.131243  5247 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:34.187815  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:34.134193  5227 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:34.170218  1616 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:58:34.217607  1542 raft_consensus.cc:2393] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 13: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:34.137856  5497 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:34.190126  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:34.193136  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:34.194664  5185 consensus_queue.cc:1059] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:34.176195  5398 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:34.199095  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:34.200596  1615 raft_consensus.cc:1275] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:34.168985  1581 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:34.213675  1508 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:34.167927  5486 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 11 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:34.134577  5361 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:58:34.176743  5435 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:34.221243  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 95365.1us
I20260709 12:58:34.230330  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:34.244926  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 76007.3us
I20260709 12:58:34.249531  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:34.177460  5467 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:34.217002  5247 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:34.253700  1508 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:34.218392  5385 raft_consensus.cc:697] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:34.172564  5481 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:34.258009  1508 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:34.225945  5497 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:34.253005  5389 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.269060  1508 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:34.236790  5398 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:34.269773  1614 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:58:34.268637  3947 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:34.185154  5231 consensus_queue.cc:260] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:34.263185  5384 raft_consensus.cc:3055] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:34.258484  5247 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:34.285355  3947 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:58:34.266175  5465 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:34.281745  1686 raft_consensus.cc:3055] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:34.288523  1686 raft_consensus.cc:740] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:58:34.277275  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 131075us
I20260709 12:58:34.269804  5193 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:58:34.278997  5398 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:34.271987  5497 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:34.295234  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:34.298000  5220 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13.
I20260709 12:58:34.298355  5443 ts_tablet_manager.cc:1929] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.6
I20260709 12:58:34.299420  5165 consensus_queue.cc:1048] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:34.290805  1686 consensus_queue.cc:260] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:34.303490  1540 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 10.
I20260709 12:58:34.292268  5231 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:34.305111  5438 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.340837  5438 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:34.336236  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 67269.6us
I20260709 12:58:34.304802  5385 consensus_queue.cc:237] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:34.278936  5389 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:34.348439  5389 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:34.256258  5392 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:34.309819  1654 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:34.285589  5505 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:34.285370  5384 raft_consensus.cc:740] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:34.349678  5505 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:34.350152  5505 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:34.350270  5384 consensus_queue.cc:260] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:34.350761  5392 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:34.334730  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:34.343016  1508 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:34.351760  1533 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:34.354825  1508 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:34.355988  1508 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:34.357628  1508 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:34.358758  1508 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:34.355971  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:34.361095  1508 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:34.335166  5443 log.cc:1199] T d127be99e2af41c0808e03480c1b64e3 P 4487a53c51be4634bf1ef29c5248353d: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-2-root/wals/d127be99e2af41c0808e03480c1b64e3
I20260709 12:58:34.364511  3947 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:58:34.367221  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 68895.4us
I20260709 12:58:34.368566  1581 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:34.368417  5379 consensus_queue.cc:1059] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:34.369652  5379 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:34.370041  5379 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:34.370348  1581 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:34.370414  5379 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:34.371708  5515 consensus_queue.cc:1059] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:58:34.363507  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 73373us
I20260709 12:58:34.373703  1581 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:34.309427  5469 consensus_queue.cc:1059] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:58:34.310109  5506 consensus_queue.cc:1059] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:58:34.381238  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:34.343016  5438 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:34.386070  5438 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:58:34.358759  5389 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:58:34.358533  5392 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:34.395993  5460 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:34.366215  5465 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:34.397703  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:34.402740  1533 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:58:34.360890  5432 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:34.363128  5512 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:58:34.400666  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 90989.1us
W20260709 12:58:34.390035  5495 log.cc:927] Time spent T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
W20260709 12:58:34.400308  5468 consensus_meta.cc:287] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.513s	user 0.010s	sys 0.005s
I20260709 12:58:34.411736  1614 raft_consensus.cc:1240] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:34.372889  5220 consensus_queue.cc:1048] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:58:34.405493  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:34.417508  1540 raft_consensus.cc:2393] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 15: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:34.419778  1534 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 14.
I20260709 12:58:34.420833  1611 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:58:34.422725  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:34.425623  5513 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:58:34.426649  5504 log.cc:927] Time spent T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 12:58:34.428653  5496 raft_consensus.cc:3055] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:34.429129  5496 raft_consensus.cc:740] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:34.430064  5496 consensus_queue.cc:260] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:34.431300  5496 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:58:34.411403  5371 consensus_meta.cc:287] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.581s	user 0.003s	sys 0.007s
W20260709 12:58:34.444444  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 77778.5us
I20260709 12:58:34.412645  5460 raft_consensus.cc:697] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:34.448035  1540 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:34.416222  5443 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50688 (request call id 64) took 3449 ms. Trace:
W20260709 12:58:34.451087  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 73284.6us
I20260709 12:58:34.449958  5468 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:34.456185  1508 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:34.461026  1690 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:34.456924  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:34.463011  1540 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:34.460255  1508 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:34.464074  1508 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:34.450220  5220 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.467325  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:34.467939  1689 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:34.445865  5371 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:34.471287  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:34.455809  5468 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:34.475641  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:34.476290  1691 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:58:34.475602  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:34.456820  5438 raft_consensus.cc:697] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:34.480403  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:34.481099  1690 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:34.483382  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:34.477190  1683 raft_consensus.cc:2393] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 12: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:34.452718  5464 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:58:34.469110  5506 raft_consensus.cc:3055] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:34.512950  1687 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:34.469458  5392 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:58:34.470963  5513 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:34.516264  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:58:34.519693  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:34.459347  5389 consensus_queue.cc:1059] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:58:34.469072  5526 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:58:34.542407  1540 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:34.479130  5468 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:34.553413  1535 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:34.550555  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 162809us
I20260709 12:58:34.561257  1610 raft_consensus.cc:1275] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:34.562510  5438 consensus_queue.cc:237] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:34.564549  5460 consensus_queue.cc:237] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:34.474712  5385 consensus_queue.cc:1059] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 12:58:34.511436  5506 raft_consensus.cc:740] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:34.569068  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:34.571758  1540 raft_consensus.cc:2393] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 9: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:34.471540  5220 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:34.592144  1690 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:34.472393  5522 consensus_queue.cc:1059] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 12:58:34.594866  1683 raft_consensus.cc:1240] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:58:34.452167  5443 rpcz_store.cc:276] 0709 12:58:30.966714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:30.968335 (+  1621us) service_pool.cc:224] Handling call
0709 12:58:33.647005 (+2678670us) ts_tablet_manager.cc:1151] Deleting tablet d127be99e2af41c0808e03480c1b64e3
0709 12:58:33.647068 (+    63us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:58:33.852373 (+205305us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:34.298193 (+445820us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:34.414366 (+116173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35753,"tablet-delete.queue_time_us":2661046}
I20260709 12:58:34.599951  2301 raft_consensus.cc:1240] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:34.599529  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:58:34.601677  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 46711.5us
I20260709 12:58:34.604694  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:34.605460  1540 raft_consensus.cc:2368] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13.
I20260709 12:58:34.609368  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:34.610081  1533 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:34.611091  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:34.613363  1540 raft_consensus.cc:2393] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 13: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:34.619148  1540 raft_consensus.cc:1275] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:58:34.621109  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:34.593066  5359 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:34.623683  1508 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:34.614863  5464 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:34.624167  5172 consensus_meta.cc:287] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.626s	user 0.005s	sys 0.005s
I20260709 12:58:34.641582  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:34.694953  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:34.628990  5469 consensus_queue.cc:1059] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
W20260709 12:58:34.700774  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 77368.3us
I20260709 12:58:34.645090  5172 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:34.625598  5463 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:34.708424  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:34.642951  5379 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:34.711043  5516 consensus_queue.cc:1048] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.124s
I20260709 12:58:34.712153  5379 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:34.713197  5220 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:34.714202  5467 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:34.689414  5525 consensus_queue.cc:1048] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 12:58:34.721290  1615 raft_consensus.cc:1240] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:58:34.723479  1533 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:58:34.726317  5513 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:34.733423  1534 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:34.747501  1655 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:34.709170  5469 consensus_queue.cc:1243] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:58:34.749989  5359 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:34.750478  5531 log.cc:927] Time spent T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:58:34.751200  5435 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:34.752832  1617 raft_consensus.cc:2393] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 10: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:34.737046  5512 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:34.753664  5465 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:34.738513  5247 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:34.760003  5247 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:34.760687  5532 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:58:34.625171  5506 consensus_queue.cc:260] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:34.766551  5506 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:34.699394  5497 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:34.770560  5505 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:34.771327  5497 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:34.771723  1616 raft_consensus.cc:1240] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:34.643242  5464 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:34.778853  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 155249us
I20260709 12:58:34.777585  1655 leader_election.cc:400] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13.
I20260709 12:58:34.781534  1535 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:58:34.753829  5512 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:34.708889  5371 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:34.791064  5512 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:34.792753  1691 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
W20260709 12:58:34.795118  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 186399us
I20260709 12:58:34.799041  1581 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:34.801350  1655 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:34.802829  1655 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:34.760324  5481 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:34.810220  1655 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:34.812247  1655 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:34.804458  5392 raft_consensus.cc:697] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:34.821962  5521 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:58:34.823602  5527 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:58:34.826078  2267 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:34.827425  5301 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:34.828152  5545 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:34.828670  5545 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:34.829030  5545 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:34.814484  5516 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:58:34.806207  5371 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:58:34.852648  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 53690.9us
I20260709 12:58:34.852814  1612 raft_consensus.cc:1240] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 12:58:34.818341  5363 consensus_meta.cc:287] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.814s	user 0.012s	sys 0.000s
I20260709 12:58:34.791278  5538 consensus_queue.cc:1059] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.190s
I20260709 12:58:34.861876  1505 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:34.855006  5371 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:34.858726  5521 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:58:34.856988  5516 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:34.858121  5435 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:34.814025  5398 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:34.876945  1505 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:34.870822  5227 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:58:34.876912  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 49874.2us
I20260709 12:58:34.861418  5460 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:34.872655  5371 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:34.885866  1505 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:34.860497  5363 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:34.877959  5497 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.878592  5543 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:34.896677  5543 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:34.898929  5543 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:34.879961  5521 raft_consensus.cc:697] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:34.900002  5521 consensus_queue.cc:237] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:34.873052  5361 consensus_queue.cc:1059] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:58:34.885368  5467 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:58:34.902243  5398 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:34.878297  5392 consensus_queue.cc:237] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:34.882400  5538 raft_consensus.cc:3055] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:34.903574  5538 raft_consensus.cc:740] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:34.904466  5538 consensus_queue.cc:260] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:34.905318  5458 consensus_queue.cc:260] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:34.905766  5538 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:34.884402  5505 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:34.910671  1505 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:34.920111  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:34.920337  1535 raft_consensus.cc:1275] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:58:34.920701  1533 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:34.922919  1614 raft_consensus.cc:2393] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 13: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:34.908871  5463 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:34.924793  5505 raft_consensus.cc:3055] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:34.925184  5505 raft_consensus.cc:740] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:34.916276  5467 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:58:34.888099  5526 consensus_queue.cc:1048] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:58:34.932852  5552 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:34.933483  5552 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:34.935786  5552 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:34.917107  5497 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:34.934067  1533 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 14.
I20260709 12:58:34.948814  5464 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:34.948945  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:34.951139  5510 raft_consensus.cc:3055] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:34.951658  5510 raft_consensus.cc:740] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:34.922649  5468 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:34.954419  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:58:34.955030  1609 raft_consensus.cc:1240] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:34.954826  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:58:34.921636  5227 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:34.957221  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:34.957964  1539 raft_consensus.cc:2393] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 12: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:34.958473  1538 raft_consensus.cc:1240] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:34.959812  5500 raft_consensus.cc:3055] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:34.960206  5500 raft_consensus.cc:740] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:34.960814  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:34.961027  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:34.961651  1541 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:34.963282  1538 raft_consensus.cc:1240] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:34.963588  1539 raft_consensus.cc:1240] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:34.961062  5500 consensus_queue.cc:260] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:34.961403  1542 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:34.965510  5500 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:58:34.963634  5548 log.cc:927] Time spent T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 12:58:34.954592  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:34.975011  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:34.976527  1508 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:34.977097  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:34.977844  1616 raft_consensus.cc:2393] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 12: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:34.976430  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:34.954531  5468 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:34.979488  1689 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
I20260709 12:58:34.987335  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:34.988090  1535 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:34.979197  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:34.989387  1691 raft_consensus.cc:2393] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 12: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 12:58:34.980647  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:34.985950  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:34.992033  1611 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
I20260709 12:58:34.983132  1542 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:34.980020  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:34.993700  1685 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:34.994894  1613 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:58:34.993278  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 181108us
I20260709 12:58:35.001633  5544 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.001937  5301 raft_consensus.cc:697] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 10 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:58:35.002548  5544 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:34.998445  1655 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:35.004163  5460 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:35.005117  5544 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:35.003114  5301 consensus_queue.cc:237] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:35.006402  1655 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:35.009730  1655 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:34.940446  5497 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:35.014015  1541 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:35.007407  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:35.022955  1542 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:35.025629  1538 raft_consensus.cc:1275] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:35.023717  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:35.012759  1609 raft_consensus.cc:1240] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:34.994544  5464 consensus_queue.cc:1059] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:58:35.019127  5516 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:35.019603  5549 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:35.047260  1613 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:35.020480  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:35.053998  1534 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:34.994572  5227 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:35.011459  5467 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.007053  5544 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.029141  5545 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.013034  5481 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:35.015607  1655 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:35.079890  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 64394.4us
I20260709 12:58:35.036577  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:35.036806  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:35.038362  1538 raft_consensus.cc:1240] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:35.039189  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:35.012072  1536 raft_consensus.cc:1275] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:35.040969  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:35.042140  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:35.049659  1505 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:35.083436  1611 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:35.024626  5510 consensus_queue.cc:260] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.061416  5363 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:35.089111  1541 raft_consensus.cc:2368] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 9. Current term is 10.
I20260709 12:58:35.090862  1534 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:35.081249  1655 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:35.045794  5516 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:35.091586  1535 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
W20260709 12:58:35.068882  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:35.093983  2266 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:35.094589  1581 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:35.101675  1614 raft_consensus.cc:1275] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:58:35.073681  5227 raft_consensus.cc:697] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:35.119971  1581 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:35.096422  5526 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:35.122148  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:35.102129  5516 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:35.101519  5549 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:58:35.109061  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:58:35.125422  1536 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:35.125552  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 44393.7us
I20260709 12:58:35.133939  1655 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:35.123198  1581 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:35.073431  5467 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.117641  5506 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:35.075708  5371 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.076506  5544 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.126144  5363 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:35.125042  5526 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:35.122685  5485 raft_consensus.cc:3055] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:35.118172  5496 consensus_queue.cc:1059] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:58:35.144090  1611 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 10.
I20260709 12:58:35.145525  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:58:35.146104  1614 raft_consensus.cc:606] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:35.123979  5227 consensus_queue.cc:237] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.129601  5497 consensus_queue.cc:1059] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:58:35.139683  5468 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:35.136838  5506 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:35.154142  5530 consensus_queue.cc:1059] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:58:35.145709  5526 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:35.157528  5556 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:35.172945  1508 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:35.160090  5508 log.cc:927] Time spent T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.852s	user 0.005s	sys 0.000s
I20260709 12:58:35.161262  5497 raft_consensus.cc:3055] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:58:35.161841  5467 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:35.179070  5463 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:58:35.181636  2297 raft_consensus.cc:2393] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 11: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:58:35.162213  5557 consensus_queue.cc:1048] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:58:35.162950  5544 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:35.163872  5545 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:35.191186  5432 raft_consensus.cc:3055] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:58:35.191479  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:35.165527   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:58:35.149770  5546 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.146004  5485 raft_consensus.cc:740] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:35.139454  5385 consensus_queue.cc:1048] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:58:35.172093  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:35.188287  5532 consensus_queue.cc:1048] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:35.193921  1581 leader_election.cc:400] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 9. Current term is 10.
I20260709 12:58:35.194324  1536 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:35.152243  5468 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:35.153487  5363 raft_consensus.cc:697] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:35.169433  5506 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:35.199883  1581 leader_election.cc:403] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:58:35.201193  5558 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:58:35.231103  5565 log.cc:927] Time spent T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.152s	user 0.000s	sys 0.002s
I20260709 12:58:35.230919  5526 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:35.233438  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 46169.5us
I20260709 12:58:35.234262  1581 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:58:35.234779  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:35.233451  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1522) took 1099 ms. Trace:
I20260709 12:58:35.243594  1612 rpcz_store.cc:276] 0709 12:58:34.134522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.134669 (+   147us) service_pool.cc:224] Handling call
0709 12:58:34.170002 (+ 35333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:34.853507 (+683505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.233198 (+379691us) spinlock_profiling.cc:243] Waited 683 ms on lock 0x7b54001f77d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:35.233391 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1570236416}
I20260709 12:58:35.201874  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:35.199945  5546 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.205792  5516 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.208755  5567 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:58:35.209921  5384 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:35.210048  5485 consensus_queue.cc:260] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.210822  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:35.255836  1581 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:35.256079  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:35.151556  5512 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.214293  5363 consensus_queue.cc:237] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.193361  5432 raft_consensus.cc:740] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:35.221263  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:35.222848  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:35.223966  5514 raft_consensus.cc:3055] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:35.211643  5552 raft_consensus.cc:3055] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:35.179710  5497 raft_consensus.cc:740] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:35.226101  5371 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:35.226284  5523 raft_consensus.cc:3055] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:35.229737  1685 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:35.249529  1539 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:35.251145  1440 catalog_manager.cc:5697] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:35.253327  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:35.251086  3947 consensus_queue.cc:1059] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:58:35.251216   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:35.212738  5468 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:35.257457  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:35.279155  1542 raft_consensus.cc:2393] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 10: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 12:58:35.247525  5389 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.003s	sys 0.024s
I20260709 12:58:35.234264  5435 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 9. Current term is 10.
I20260709 12:58:35.251138  5500 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:35.265863  1537 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 12:58:35.270047  5552 raft_consensus.cc:740] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:35.261194  5385 consensus_queue.cc:1059] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:58:35.270941  5556 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.274307  3947 raft_consensus.cc:3055] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:35.309846  3947 raft_consensus.cc:740] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:35.262897  5482 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:35.232890  5568 consensus_queue.cc:1059] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:58:35.276979  1541 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 14. Current term is 15. Ops: []
I20260709 12:58:35.277374  1539 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:58:35.277514  5526 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:35.277698  5523 raft_consensus.cc:740] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:35.248689  5538 consensus_queue.cc:1059] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:58:35.263123  5514 raft_consensus.cc:740] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:35.318807  3947 consensus_queue.cc:260] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:58:35.294025  5389 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.003s	sys 0.024s
I20260709 12:58:35.310359  5485 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:35.328210  5568 raft_consensus.cc:3055] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:35.330374  5568 raft_consensus.cc:740] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:35.332288  5482 raft_consensus.cc:697] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:35.333290  5514 consensus_queue.cc:260] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.333936  5505 consensus_queue.cc:260] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.334692  5514 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:35.337556  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:35.364079  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 151341us
I20260709 12:58:35.361372  1541 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:58:35.366808  3947 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:35.308305  5432 consensus_queue.cc:260] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.328650  5500 raft_consensus.cc:697] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:35.338997  5389 consensus_queue.cc:1243] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:58:35.333506  5482 consensus_queue.cc:237] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.377717  1533 raft_consensus.cc:1240] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:35.372396  5505 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:35.384892  5558 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:58:35.385119  5523 consensus_queue.cc:260] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.388588  5516 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:35.331488  5568 consensus_queue.cc:260] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.389962  2297 raft_consensus.cc:1240] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 10 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:35.313635  5556 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:35.392797  5432 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:35.394273  5546 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:35.426462  5374 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.398180  1542 raft_consensus.cc:1240] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:35.401099  1541 raft_consensus.cc:1240] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:35.402086  5512 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:35.402451  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1938) took 1209 ms. Trace:
I20260709 12:58:35.413185  5510 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:35.463368  1617 rpcz_store.cc:276] 0709 12:58:34.192725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.192856 (+   131us) service_pool.cc:224] Handling call
0709 12:58:35.402226 (+1209370us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b5400444654. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:35.402363 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1217801600}
W20260709 12:58:35.417635  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:35.336309  5524 consensus_queue.cc:1059] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:58:35.471901  1685 raft_consensus.cc:1240] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9. Ops: []
W20260709 12:58:35.429287  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 56920us
W20260709 12:58:35.430941  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 297083us
I20260709 12:58:35.473867  1655 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:35.424113  5414 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.394850  5506 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.451964  5523 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:35.424043  5247 consensus_queue.cc:1059] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:58:35.431342  5549 raft_consensus.cc:697] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 14 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:35.361274  5527 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.473754  1654 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:35.474584  1685 raft_consensus.cc:1240] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:35.486654  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:58:35.488076  5579 log.cc:927] Time spent T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:58:35.501986  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:35.489778  5556 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:35.503549  1685 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:35.492895  5497 consensus_queue.cc:260] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
W20260709 12:58:35.494350  5569 log.cc:927] Time spent T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 12:58:35.494769  5500 consensus_queue.cc:237] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.495196  5552 consensus_queue.cc:260] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.497545  1613 raft_consensus.cc:1240] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10. Ops: []
W20260709 12:58:35.429713  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:35.492916  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:35.517870  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:35.490419  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:35.518577  1685 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:35.518800  1614 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
W20260709 12:58:35.519254  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:35.501104  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:35.462373  5568 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:35.497398  5546 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.507639  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:35.523121  1684 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:35.498826  5506 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:35.522025  1616 raft_consensus.cc:2393] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 10: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:35.470795  5516 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:35.525004  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 51228.5us
W20260709 12:58:35.542420  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:35.499186  5577 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:35.529762  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 56120.7us
I20260709 12:58:35.532294  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:58:35.533896  1488 auto_rebalancer.cc:629] Failed to schedule move for tablet f0eedb9e9c8c4177903e544c600553f3: Illegal state: Replica dbe6a89d0e1c4137b3a1b17bf4b520d8 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:35.522202  5497 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:35.536818  5575 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:35.461506  5374 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.542536  1655 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:35.554193  1508 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:35.526364  1505 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:35.555142  3947 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:58:35.543324  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:35.556130  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:35.474874  5414 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.560288  1535 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 13. Current term is 14. Ops: []
W20260709 12:58:35.556535  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:35.557050  1508 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:35.554838  1655 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:35.560217  1687 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:58:35.562093  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:35.562366  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:58:35.562605  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:35.562836  1688 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 12:58:35.558143  1685 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:35.564826  1687 raft_consensus.cc:1275] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:35.547971  1684 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:35.541770  5165 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:35.541483  5552 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:35.570636  1508 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:35.571050  3947 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:58:35.563727  1581 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:35.567426  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:35.531296  5514 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.565653  1655 leader_election.cc:400] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13.
I20260709 12:58:35.573658  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:35.574213  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:35.574517  1684 raft_consensus.cc:1275] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:35.575596  3947 raft_consensus.cc:697] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:35.576602  1689 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:35.576315  1655 leader_election.cc:403] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:35.581604  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:35.582573  1581 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:35.505759  5527 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.586508  1655 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:35.588598  3947 consensus_queue.cc:237] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.560057  5389 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:58:35.553634  5575 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:35.530025  5546 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.592865  1581 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:35.595332  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:35.597213  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:35.615664  1685 raft_consensus.cc:2410] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:58:35.598111  5389 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:35.596135  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:35.569589  5538 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:35.604561  5496 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:58:35.607154  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:35.608536  1689 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:58:35.624083  1508 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:35.616689  1535 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:35.625028  1655 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:35.627678  5460 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:58:35.629969  5526 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:58:35.630594  5526 raft_consensus.cc:697] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:35.631451  5526 consensus_queue.cc:237] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.632386  1539 raft_consensus.cc:1275] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:58:35.622926  5389 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:58:35.634948  5464 raft_consensus.cc:3055] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:35.635352  5464 raft_consensus.cc:740] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:35.636109  5464 consensus_queue.cc:260] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.637677  1535 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:35.638275  1655 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:35.641062  1608 raft_consensus.cc:1240] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:58:35.580915  5543 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:35.565274  5571 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:35.551108  5516 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.587972  5485 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:35.650187  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:35.654393  1685 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:35.656831  5361 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.657490  5361 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.659982  5361 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:35.666098  1581 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:35.668943  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:35.669801  1535 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 14.
W20260709 12:58:35.672909  1488 auto_rebalancer.cc:629] Failed to schedule move for tablet 3c62b87395ba4c3a9a99163b300d7ddf: Illegal state: Replica dbe6a89d0e1c4137b3a1b17bf4b520d8 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:35.673395  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:35.617821  5575 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:35.675526  1689 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:58:35.594599  5578 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13.
I20260709 12:58:35.646797  5502 tablet_replica.cc:333] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 12:58:35.590157  5514 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:35.642326  5544 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:35.651794  5344 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:58:35.647116  5463 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.697345  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:35.679422  1687 raft_consensus.cc:1240] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:35.683841  1684 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 14. Current term is 15. Ops: []
I20260709 12:58:35.562668  5577 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:35.643512  5460 consensus_queue.cc:1048] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:58:35.653261  5227 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.651613  5414 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:35.651885  5558 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:58:35.686440  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:35.684737  1537 raft_consensus.cc:1240] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:35.701624  3947 consensus_queue.cc:1059] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:35.709538  1689 raft_consensus.cc:1240] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:35.702940  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:35.713605  1684 raft_consensus.cc:2393] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 13: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:35.682603  5450 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.707204  1614 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 12.
I20260709 12:58:35.701694  1541 raft_consensus.cc:2393] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 12: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:35.692217  5544 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:35.687332  5540 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:35.691148  5482 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:58:35.718303  3947 consensus_queue.cc:1243] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:58:35.716753  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:35.690824  5398 raft_consensus.cc:3055] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:35.720620  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:35.723464  1682 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 12.
I20260709 12:58:35.675709  5529 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:58:35.701403  5578 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.590468  5549 consensus_queue.cc:237] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.738384  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:35.727144  1684 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
W20260709 12:58:35.733829  5583 log.cc:927] Time spent T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:58:35.730355  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:35.779098  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:35.779826  1538 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:35.706519  5512 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:58:35.705168  5463 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.725713  5558 raft_consensus.cc:697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 14 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:35.786141  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:35.727730  5482 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:35.782752  1689 raft_consensus.cc:1275] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:58:35.721829  5544 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:35.819275  5584 log.cc:927] Time spent T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:58:35.821208  5463 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:35.728724  5398 raft_consensus.cc:740] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:35.764164  5193 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.730341  5374 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:35.781771  5481 raft_consensus.cc:3055] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:35.803393  1610 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:58:35.804872  5514 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:35.806041  5546 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:35.812429  1691 raft_consensus.cc:2410] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:58:35.718247  5227 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.817382  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:35.850566  1541 raft_consensus.cc:1275] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:58:35.817687  5598 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:35.843600  5481 raft_consensus.cc:740] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:35.826748  5482 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:58:35.859675  5398 consensus_queue.cc:260] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.859912  5481 consensus_queue.cc:260] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.860927  5398 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:35.850204  5193 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.864178  5193 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:35.864216  1689 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:35.867594  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:35.818075  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:35.765890  5578 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.730664  5540 raft_consensus.cc:697] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 12 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:35.826565  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:35.721632  5450 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.773259  5485 raft_consensus.cc:697] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:58:35.849109  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:35.850710  1539 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:35.852823  3947 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:35.853871  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:35.861003  5481 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:58:35.841821  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:35.875468  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:35.877022  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:35.875813  1687 raft_consensus.cc:2410] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:58:35.859193  5598 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.882596  1538 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:35.884855  1541 raft_consensus.cc:1275] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:58:35.873749  5389 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.887487  5558 consensus_queue.cc:237] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:35.893920  1536 raft_consensus.cc:1240] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:35.896936  1541 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:58:35.898762  5540 consensus_queue.cc:237] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.895357  1536 raft_consensus.cc:1240] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:58:35.911314  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:35.800117  5468 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:35.917693  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:35.924762  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:35.925661  1687 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:35.926936  1688 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:35.859190  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:35.928298  2297 raft_consensus.cc:2410] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:58:35.928591  1540 raft_consensus.cc:3055] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:35.928941  1540 raft_consensus.cc:740] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:35.929805  1540 consensus_queue.cc:260] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.930918  1540 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:35.933284  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:35.933955  1682 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:35.937840  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:35.941596  1611 raft_consensus.cc:1275] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:58:35.943226  1655 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:35.848876  5552 consensus_queue.cc:1059] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:58:35.945720  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:35.946610  1617 raft_consensus.cc:2393] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 14: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:35.947075  3947 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:35.947247  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:35.947609  3947 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.948743  1655 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:35.949839  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:35.950753  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:35.951412  1616 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:35.936908  2269 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 12:58:35.952390  1611 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:35.959112  5301 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:35.959645  5301 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:35.959985  5301 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:35.961817  1505 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:35.959112  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:35.963210  1615 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:35.968464  1540 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:58:35.969298  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1462) took 1348 ms. Trace:
I20260709 12:58:35.969647  1540 rpcz_store.cc:276] 0709 12:58:34.620716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.624547 (+  3831us) service_pool.cc:224] Handling call
0709 12:58:34.624927 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:35.928455 (+1303528us) spinlock_profiling.cc:243] Waited 795 ms on lock 0x7b54000bc320. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85cfc8dc0 00007fc85d0531c0 00007fc85d054231 00007fc85d050d8f 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c
0709 12:58:35.968962 (+ 40507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.969230 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1828700416}
I20260709 12:58:35.974653  1505 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:35.971379  1583 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:35.922703  5571 raft_consensus.cc:697] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 12 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:35.980798  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:35.974964  5578 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:35.981519  1615 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 12:58:35.992841  3947 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:36.000720  5599 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.001396  5599 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.003731  5599 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:36.005678  5468 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:36.012220  5485 consensus_queue.cc:237] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.014596  5578 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.015245  5578 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:35.972139  5546 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:58:36.017424  5578 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:36.018158  5578 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:36.018666  5578 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:36.020009  5505 consensus_meta.cc:287] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.593s	user 0.006s	sys 0.006s
I20260709 12:58:35.975356  5552 raft_consensus.cc:3055] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:35.966813  5597 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:36.021579  5549 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:35.993691  5529 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:35.991827  5512 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:35.985644  5526 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:36.060701  1583 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:36.062047  1583 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:36.008369  5598 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:36.048168  5538 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:36.051934  5552 raft_consensus.cc:740] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:36.095468  2301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32788 (request call id 118) took 1141 ms. Trace:
W20260709 12:58:36.069839  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 121216us
I20260709 12:58:36.118486  1685 raft_consensus.cc:1240] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:36.022189  5575 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.064795  5512 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:36.118279  1616 raft_consensus.cc:1275] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:58:36.119987  1655 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:36.121594  5512 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:36.072732  5568 consensus_meta.cc:287] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.549s	user 0.007s	sys 0.004s
I20260709 12:58:36.122884  1690 raft_consensus.cc:2410] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:58:36.123692  5595 consensus_queue.cc:1048] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:36.123855  5571 consensus_queue.cc:237] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.126626  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:36.127556  1683 raft_consensus.cc:2410] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:58:36.127794  5575 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:36.127943  5450 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:36.131654  5301 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:58:36.152727  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 54867.9us
I20260709 12:58:36.102167  2301 rpcz_store.cc:276] 0709 12:58:34.954032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.954177 (+   145us) service_pool.cc:224] Handling call
0709 12:58:36.095208 (+1141031us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b54007706d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:36.095377 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1169968896}
I20260709 12:58:36.053121  5597 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:36.133428  5544 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.134558  5546 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.135912  5552 consensus_queue.cc:260] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.137166  1684 raft_consensus.cc:1275] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:58:36.138329  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:36.137215  5577 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:36.063854  5526 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:36.066255  5529 raft_consensus.cc:697] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:36.165146  5612 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:58:36.066741  5510 consensus_queue.cc:1059] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:58:36.144253  1609 raft_consensus.cc:1275] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:58:36.149228  1686 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:36.065744  5468 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:58:36.087179  5481 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:36.152630  1505 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:36.165583  5529 consensus_queue.cc:237] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.166314  5526 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:36.156052  5505 consensus_queue.cc:1048] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:58:36.159761  5546 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.157289  5597 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:36.173592  1505 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:36.154654  1655 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:36.158983  1583 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:36.140281  5464 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:58:36.123626  5606 log.cc:927] Time spent T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:58:36.088603  5514 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 12:58:36.182142  5552 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:36.204921  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 46030.5us
I20260709 12:58:36.205567  5532 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:36.206025  5516 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:36.207093  1583 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:36.207937  5463 consensus_queue.cc:1048] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:36.208230  5570 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:58:36.181885  5546 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:36.209728  1581 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:36.210594  1581 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:36.211655  1581 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:36.211843  5599 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:36.212292  5523 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:36.212432  5599 raft_consensus.cc:697] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:36.222571  5431 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:58:36.222653  5599 consensus_queue.cc:237] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:36.224730  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 70079.6us
I20260709 12:58:36.176694  3947 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:36.226789  3947 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:36.227105  3947 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:36.227479  1686 raft_consensus.cc:1275] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 12:58:36.069779  5578 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:36.169649  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.219169  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:36.247228  3947 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.219871  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:36.196746  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:36.197151  5193 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:36.198793  5374 raft_consensus.cc:3055] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:58:36.260432  1488 auto_rebalancer.cc:629] Failed to schedule move for tablet d3cb0f1c44ec45f38ff2f0c27480a08c: Illegal state: Replica dbe6a89d0e1c4137b3a1b17bf4b520d8 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:36.171063  2297 raft_consensus.cc:2393] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 13: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
W20260709 12:58:36.186829  5536 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:58:36.214811  5389 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:36.236127  5545 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:36.172897  5481 raft_consensus.cc:697] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:36.215283  5510 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:58:36.210620  5458 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:36.173931  5544 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:36.190491  5438 raft_consensus.cc:993] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:58:36.273175  5438 raft_consensus.cc:1081] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:58:36.273818  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:36.274430  1689 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:58:36.237805  5512 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.219515  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:36.194021  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:36.275808  1684 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:36.217242  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:36.220526  1583 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:36.228371  1686 pending_rounds.cc:85] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 9
I20260709 12:58:36.277096  1686 pending_rounds.cc:107] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:58:36.277390  1686 raft_consensus.cc:2889] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:36.278170  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 254) took 1997 ms. Trace:
I20260709 12:58:36.252292  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:36.279564  1611 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
W20260709 12:58:36.254022  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.251211  1610 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:36.259644  3947 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:36.262120  1581 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:58:36.217164  5581 log.cc:927] Time spent T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.675s	user 0.004s	sys 0.000s
W20260709 12:58:36.269456  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.186017  5301 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 13 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:36.271113  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:36.225972  5227 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:36.281073  1654 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:36.275066  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:36.278486  1686 rpcz_store.cc:276] 0709 12:58:34.280765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:34.281257 (+   492us) service_pool.cc:224] Handling call
0709 12:58:34.281619 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:35.332200 (+1050581us) spinlock_profiling.cc:243] Waited 688 ms on lock 0x7b180026ca60. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d08c646 00007fc85cfc658e 00007fc85d047f9e 00007fc85d0497de 00007fc85d053b49 00007fc85d054416 00007fc85d050d8f 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4
0709 12:58:35.496657 (+164457us) spinlock_profiling.cc:243] Waited 4.73 ms on lock 0x7b58007991d0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85cfad0aa 00007fc85d02f447 00007fc85d047fe7 00007fc85d0497de 00007fc85d053b49 00007fc85d054416 00007fc85d050d8f 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4
0709 12:58:36.148154 (+651497us) spinlock_profiling.cc:243] Waited 8.24 ms on lock 0x7b54004504a0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85cfc6a1d 00007fc85cfad1a4 00007fc85d02f447 00007fc85d047fe7 00007fc85d0497de 00007fc85d053b49 00007fc85d054416 00007fc85d050d8f 00007fc85d05083e 00007fc862015419
0709 12:58:36.277869 (+129715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.278103 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1612311040}
I20260709 12:58:36.219565  5526 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.213131  5432 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:36.297387  1616 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:36.299625  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:36.299322  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 44309.7us
I20260709 12:58:36.305980  1611 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:36.301770  1691 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 12:58:36.302700  1683 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:36.255545  5193 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:36.213152  5523 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:36.309291  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 88883.9us
I20260709 12:58:36.223202  5482 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:36.310034  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 47999.3us
I20260709 12:58:36.313719  1508 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:36.314965  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 107303us
I20260709 12:58:36.320765  1540 raft_consensus.cc:1275] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:58:36.323061  3947 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:36.323617  3947 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.326402  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:36.264815  5374 raft_consensus.cc:740] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:36.330090  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:36.330857  1535 raft_consensus.cc:2393] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 11: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 12:58:36.331599  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 50649.8us
I20260709 12:58:36.333173  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:36.333714  1691 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:36.303555  5546 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.360957  1613 raft_consensus.cc:2393] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 17: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:36.327034  1686 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
W20260709 12:58:36.353775  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.346370  1690 raft_consensus.cc:1275] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:58:36.310863  5432 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:36.375789  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:36.378361  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:36.383997  1617 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:36.379647  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:36.384675  1533 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:58:36.324961  5193 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:36.385762  1684 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 13.
I20260709 12:58:36.384951  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:36.381752  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:36.382222  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 47477.7us
I20260709 12:58:36.325327  5502 raft_consensus.cc:2243] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:36.384857  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:36.383946  1614 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
W20260709 12:58:36.380927  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 67779.1us
I20260709 12:58:36.328969  5435 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:58:36.327384  5227 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:58:36.382671  1654 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:36.425999  1609 raft_consensus.cc:1275] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:58:36.424948  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 43659.8us
I20260709 12:58:36.341079  5521 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:36.430464  1583 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:36.431526  1505 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:36.432250  1691 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:36.433167  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:36.273559  5609 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.110s
I20260709 12:58:36.328420  5523 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:36.434693  1654 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:36.360356  5361 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.390700  5432 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:36.436717  1689 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 17.
I20260709 12:58:36.436866  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 185) took 1168 ms. Trace:
I20260709 12:58:36.437621  1581 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:36.361125  5500 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:36.439589  1654 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:36.435828  2269 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 12:58:36.342592  5431 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:58:36.438802  5595 consensus_queue.cc:1059] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:58:36.461283  5595 raft_consensus.cc:3055] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:58:36.461658  5595 raft_consensus.cc:740] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:36.418758  5371 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.446239  1655 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:36.449491  5533 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:36.450026  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.343809  5301 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 12:58:36.381376  5556 consensus_queue.cc:1048] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 12:58:36.434321  5612 raft_consensus.cc:2764] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:58:36.436995  5165 raft_consensus.cc:2764] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:58:36.452412  5524 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:36.386199  5546 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.454826  5512 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:36.455569  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:36.456897  5621 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:36.422493  5610 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:36.468391  1689 raft_consensus.cc:1275] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:58:36.485899  5464 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:36.469077  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:36.442765  1612 rpcz_store.cc:276] 0709 12:58:35.268926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.269181 (+   255us) service_pool.cc:224] Handling call
0709 12:58:35.303074 (+ 33893us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:35.316793 (+ 13719us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:35.316834 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:35.319984 (+  3150us) log.cc:844] Serialized 26 byte log entry
0709 12:58:35.430429 (+110445us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:35.430470 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:35.430541 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:36.216447 (+785906us) spinlock_profiling.cc:243] Waited 5.12 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:58:36.425098 (+208651us) raft_consensus.cc:1685] finished
0709 12:58:36.425117 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:36.436805 (+ 11688us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7618,"raft.queue_time_us":19622,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":12081,"spinlock_wait_cycles":13328512,"thread_start_us":65951,"threads_started":1,"wal-append.queue_time_us":141980}
I20260709 12:58:36.422607  5578 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:36.438522  5571 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.497015  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:36.534123  1690 raft_consensus.cc:2393] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 14: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:36.453070  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:36.500710  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:36.445343  5545 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:36.444717  5500 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:36.506534  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 60166.1us
I20260709 12:58:36.502274  5524 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:36.536743  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:36.538057  1690 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:36.521977  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:36.473694  5247 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.524426  1538 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:36.473354  5344 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:36.468720  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:36.438270  5505 consensus_queue.cc:1048] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:58:36.485618  5497 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.501267  5438 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:36.444541  5361 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.504420  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:36.536821  1533 raft_consensus.cc:2393] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 11: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:36.539031  1684 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:36.462568  5595 consensus_queue.cc:260] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.540820  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:36.440675  5374 consensus_queue.cc:260] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.544812  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:36.538399  5524 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:36.536410  5500 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:36.569408  1609 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:36.520735  5502 raft_consensus.cc:2272] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:36.545569  5193 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.548610  5578 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.549623  5545 raft_consensus.cc:697] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 12 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:36.549387  5571 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.550308  1687 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:36.526950  5621 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:36.489161  5371 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.548647  5491 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:36.565645  1690 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:36.487536  5543 consensus_queue.cc:1048] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:58:36.566696  1608 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:36.521024  5463 consensus_queue.cc:1048] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:58:36.437232  5481 consensus_queue.cc:237] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.563884  5438 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:36.577201  5526 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:36.605475  1690 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: []
I20260709 12:58:36.582266  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:36.607132  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:36.607730  1614 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:36.608359  5546 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:36.609907  5615 log.cc:927] Time spent T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:58:36.563773  5344 raft_consensus.cc:697] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 13 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:58:36.611862  5344 consensus_queue.cc:237] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:36.553823  5247 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.616019  5247 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:36.491539  5533 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:36.562888  5497 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.623013  5497 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:36.596392  5596 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.598261  5361 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:36.572055  5506 consensus_queue.cc:1048] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:58:36.601326  1541 raft_consensus.cc:1275] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:58:36.601732  5578 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:36.602715  5502 ts_tablet_manager.cc:1916] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:36.591949  5482 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:36.603024  5193 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:36.531968  5610 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.592841  1534 raft_consensus.cc:2368] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13.
I20260709 12:58:36.618505  1690 raft_consensus.cc:1275] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:58:36.618981  1608 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:36.587963  5621 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:36.664454  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:36.634620  1617 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 13.
I20260709 12:58:36.665094  1608 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:36.644704  1614 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
I20260709 12:58:36.666028  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:36.666641  1608 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 12:58:36.617551  5438 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:36.623417  5527 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:36.652123  5361 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.668627  5468 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:36.669827  1538 raft_consensus.cc:1240] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:36.669982  1690 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50708
I20260709 12:58:36.670466  5571 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:36.678635  1541 raft_consensus.cc:1275] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:58:36.682327  1690 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:36.685518  1690 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:58:36.617252  5491 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:58:36.700850  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:36.696585  1690 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.649622  5545 consensus_queue.cc:237] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.677320  5497 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:36.667922  5638 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:36.705273  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 228584us
I20260709 12:58:36.647179  5596 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.684948  5361 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.687007  5597 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.722039  1508 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:36.789880  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:36.799780  1609 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
W20260709 12:58:37.043083  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 321138us
I20260709 12:58:37.047724  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:36.788005  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.049865  1614 raft_consensus.cc:2393] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 10: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:37.048910  1508 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:37.048192  5247 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:36.721606  5361 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:37.055380  1686 raft_consensus.cc:1240] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 14. Current term is 15. Ops: []
W20260709 12:58:36.821089  5584 log.cc:927] Time spent T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 12:58:37.056830  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:37.050705  5523 consensus_meta.cc:287] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.606s	user 0.008s	sys 0.002s
I20260709 12:58:36.812968  5371 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:36.777060  5557 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.030406  5500 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:37.047585  5621 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.721572  5491 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:37.071731  5247 raft_consensus.cc:697] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:36.986939  5524 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.940183  5610 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:36.728381  5432 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:36.719339  5497 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:36.786852  5638 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:37.082664  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:37.068833  5463 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:58:37.088073  1688 raft_consensus.cc:2393] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 11: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:37.095027  1610 raft_consensus.cc:1240] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 11. Ops: []
I20260709 12:58:37.095721  1611 raft_consensus.cc:2393] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 11: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:37.079160  5630 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.069350  5523 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:37.070346  5557 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:37.076539  5546 consensus_queue.cc:1048] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:58:37.088428  5543 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:37.154443  1536 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:58:37.076542  5247 consensus_queue.cc:237] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:37.179473  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1957) took 1234 ms. Trace:
I20260709 12:58:37.179895  1613 rpcz_store.cc:276] 0709 12:58:35.944761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.945354 (+   593us) service_pool.cc:224] Handling call
0709 12:58:37.179262 (+1233908us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b540008bbd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:37.179413 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":952071936}
I20260709 12:58:37.180011  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 2347) took 1292 ms. Trace:
I20260709 12:58:37.181772  1687 rpcz_store.cc:276] 0709 12:58:35.883747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:35.937558 (+ 53811us) service_pool.cc:224] Handling call
0709 12:58:37.175618 (+1238060us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b5400389354. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:37.175708 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1406944512}
I20260709 12:58:37.105265  5610 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:37.098788  5438 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:37.307821  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:37.366580  5641 log.cc:927] Time spent T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 12:58:37.113039  5630 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:37.369269  5630 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:37.375875  5557 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:37.378371  5438 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:37.379886  5637 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
I20260709 12:58:37.201095  5193 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:37.174410  5543 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:37.437764  5642 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:37.511854  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.385191  5621 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:37.565698  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:37.566656  1687 raft_consensus.cc:2410] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:58:37.480228  5597 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:37.481317  5363 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:37.573098  1488 auto_rebalancer.cc:629] Failed to schedule move for tablet 9a7bc646e9bf4d2e9952c8b5d4a5be14: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:58:37.382910  5610 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:37.595039  5502 ts_tablet_manager.cc:1929] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.8
I20260709 12:58:37.481523  5193 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:37.675586  5546 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:37.681376  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.509702  5642 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:37.717815  5630 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.595491  5575 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.597054  5621 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:37.599692  5597 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:37.834527  5384 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:37.846134  5630 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:37.846566  5621 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:37.846941  5384 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:37.849107  5621 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:37.756563  5646 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:37.846164  5575 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:37.745572  5612 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:37.704990  5497 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:37.583464  5363 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:37.842029  1687 raft_consensus.cc:1275] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:58:37.845216  5546 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:37.610107  5524 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:37.699946  5500 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:37.836256  5638 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:37.839597  5463 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.089s	sys 0.179s
I20260709 12:58:37.854913  5502 log.cc:1199] T e4681eaad3084357b9677e4242b97c99 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-0-root/wals/e4681eaad3084357b9677e4242b97c99
W20260709 12:58:37.963131  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:37.849169  5384 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:37.908934  5481 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.093s	user 0.032s	sys 0.023s
I20260709 12:58:37.959033  5497 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:37.960141  5621 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 12:58:37.961351  5463 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.089s	sys 0.179s
I20260709 12:58:37.960378  5557 consensus_queue.cc:1048] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:58:37.964071  5524 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 12:58:37.972980  5481 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.158s	user 0.032s	sys 0.026s
I20260709 12:58:37.850340  5646 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:37.879308  5597 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:37.953823  5612 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:37.990335  5463 raft_consensus.cc:697] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:38.018213  5536 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.026072  5536 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.026983  5597 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:38.000221  5524 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.018688  3947 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:38.020610  5575 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:38.029340  5524 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:38.029636  5575 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:38.022078  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 100889us
I20260709 12:58:38.029870  5524 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.030294  5524 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.019797  5610 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:38.023942  5363 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:38.030730  5575 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.031363  5536 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:38.032908  5575 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:38.035109  5524 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:38.026311  5463 consensus_queue.cc:237] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.007107  5502 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51498 (request call id 70) took 4168 ms. Trace:
I20260709 12:58:37.985201  5497 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.010341  5543 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:37.995949  5621 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.018115  5193 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:38.053297  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.045137  5642 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:38.046803  5502 rpcz_store.cc:276] 0709 12:58:33.832891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:33.844268 (+ 11377us) service_pool.cc:224] Handling call
0709 12:58:34.252844 (+408576us) ts_tablet_manager.cc:1151] Deleting tablet e4681eaad3084357b9677e4242b97c99
0709 12:58:34.257825 (+  4981us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:58:35.646670 (+1388845us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b54003147d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d059ff9 00007fc862067482 00007fc8620982d0 00007fc86207e83d 00007fc86207e7e9 00007fc86207e779 00007fc86207e741 00007fc86207d96d 000000000038f354 000000000038f199
0709 12:58:36.988573 (+1341903us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:37.572582 (+584009us) tablet_metadata.cc:665] Metadata flushed
0709 12:58:37.986363 (+413781us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":559980,"spinlock_wait_cycles":1051056384,"tablet-delete.queue_time_us":343729,"thread_start_us":251017,"threads_started":1}
I20260709 12:58:38.065440  5546 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:38.066397  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:38.069387  5649 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.070117  5649 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:38.069641  5633 log.cc:927] Time spent T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 1.164s	user 0.000s	sys 0.037s
I20260709 12:58:38.073627  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:38.078418  1583 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:38.079469  5524 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:38.080090  5524 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.081156  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:38.082337  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:38.082429  5524 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:38.082950  1687 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:38.083308  5652 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:38.083742  5652 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:38.083810  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:38.084134  5652 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:38.085304  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2356) took 1590 ms. Trace:
I20260709 12:58:38.085681  1684 rpcz_store.cc:276] 0709 12:58:36.495405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.563067 (+ 67662us) service_pool.cc:224] Handling call
0709 12:58:36.568505 (+  5438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:36.572274 (+  3769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:36.572305 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:36.577940 (+  5635us) log.cc:844] Serialized 26 byte log entry
0709 12:58:36.710105 (+132165us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:36.710157 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.711849 (+  1692us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:38.021103 (+1309254us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:58:38.085018 (+ 63915us) raft_consensus.cc:1685] finished
0709 12:58:38.085040 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:38.085245 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":110,"raft.queue_time_us":257,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":4391,"spinlock_wait_cycles":3290496,"thread_start_us":111559,"threads_started":1,"wal-append.queue_time_us":226957}
I20260709 12:58:38.087704  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:38.059001  5657 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.092538  5652 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.093544  5649 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:38.094681  1583 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:38.097697  5621 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:38.098438  5638 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:38.099470  5646 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:38.100133  1583 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:38.101537  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:38.102288  1684 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:58:38.112816  1687 raft_consensus.cc:2393] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 17: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:38.079365  5597 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.118238  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:38.118989  1687 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:38.120893  1508 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:38.124783  1684 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:38.126957  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:38.105007  5638 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:38.112982  5621 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.105419  5463 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:38.139897  1508 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:38.141758  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:38.146287  3947 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:38.146543  1534 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 10.
I20260709 12:58:38.146803  3947 raft_consensus.cc:697] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:38.115160  5646 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:38.117942  5655 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:38.129040  5193 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:38.114948  5468 consensus_queue.cc:1059] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:58:38.115197  5546 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.129694  1684 raft_consensus.cc:2393] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 14: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:38.151665  5463 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.159813  2267 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:38.150489  3947 consensus_queue.cc:237] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.142258  1687 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:58:38.168735  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:38.166484  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 64413.8us
I20260709 12:58:38.169395  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:38.169693  1508 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:38.171592  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:38.172181  5663 consensus_queue.cc:1048] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:58:38.126292  5597 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.113168  5657 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.149103  5621 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.237995  1613 raft_consensus.cc:1275] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:58:38.218670  5656 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.174629  5524 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:38.221235  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 61509.8us
I20260709 12:58:38.174773  5575 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.173691  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:38.213527  5247 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.247826  5597 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:38.252458  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:38.243770  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:38.273303  1608 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 11.
I20260709 12:58:38.240727  5301 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:38.175001  5610 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.270892  1684 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:38.172996  5536 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:58:38.261929  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 91598.4us
I20260709 12:58:38.175729  5649 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.165663  5646 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:38.241164  5463 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:38.284601  1583 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:38.280102  5661 log.cc:927] Time spent T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 12:58:38.272511  5647 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:38.273483  5497 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:38.280184  5597 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:38.173013  5546 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.276880  5301 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:38.279764  5543 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:38.269961  5524 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.261173  5656 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.295848  3947 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.168242  5655 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.272250  5575 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.298331  1505 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:38.288051  5536 raft_consensus.cc:697] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:38.296620  5669 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:38.303850  5672 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.304605  5543 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.301625  5301 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:38.305661  5621 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:38.297240  5463 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:38.308460  5546 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:38.309407  5657 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:38.310978  5646 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:38.274268  5247 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.288722  5649 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:38.280990  5610 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.536702  5414 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 12:58:38.357870  1581 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.043s (SENT) [suppressed 6 similar messages]
I20260709 12:58:38.557974  1690 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:38.558105  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 200291us
I20260709 12:58:38.293196  5667 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:38.520231  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:38.550225  5672 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.551440  5610 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:38.553802  5247 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:38.557093  3947 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.320284  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:38.557705  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:38.298794  5497 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:38.286584  5638 raft_consensus.cc:697] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:38.589464  1684 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 8.
I20260709 12:58:38.325004  5670 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:38.590839  1687 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
I20260709 12:58:38.576411  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:50708 (request call id 2363) took 2060 ms. Trace:
W20260709 12:58:38.598081  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 300103us
I20260709 12:58:38.312417  5524 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:38.556578  5543 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:38.596917  5497 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:38.603327  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:38.561069  5414 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.603485  1505 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:38.606021  3947 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:38.601765  1690 rpcz_store.cc:276] 0709 12:58:36.521887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.663656 (+141769us) service_pool.cc:224] Handling call
0709 12:58:38.324851 (+1661195us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b4c001c78c0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85b31da20 00007fc85b32ea29 00007fc85b32f13f 00007fc85b2f32ab 00007fc85b320f3c 00007fc85b3213fe 00007fc85b5ae88b 00007fc85cfad495 00007fc85cffe30f 00007fc85d048a55 00007fc862018cd0
0709 12:58:38.558438 (+233587us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37635328}
I20260709 12:58:38.295078  5647 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.613752  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:38.614363  1540 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:38.615707  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 205247us
I20260709 12:58:38.611104  1505 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:38.562089  5621 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:38.601014  5516 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.559818  5669 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.608796  5497 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:38.591326  5657 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:58:38.612946  2297 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32802 (request call id 153) took 2475 ms (client timeout 2701 ms). Trace:
I20260709 12:58:38.298980  5597 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.615993  1583 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:38.618029  3947 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:38.627806  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:38.619211  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:38.628935  3947 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:38.629323  3947 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:58:38.620826  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 113102us
I20260709 12:58:38.559844  5463 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.631034  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:38.638276  1540 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:38.589960  5667 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:38.642419  1540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2303) took 2319 ms (client timeout 1606 ms). Trace:
I20260709 12:58:38.620749  5524 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.639601  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:38.639942  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:38.618109  5543 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:58:38.642920  1540 rpcz_store.cc:269] 0709 12:58:36.319829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.327986 (+  8157us) service_pool.cc:224] Handling call
0709 12:58:38.613605 (+2285619us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b5800002798. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc8620170a0 00007fc862016984 00007fc85b5916d4 00007fc85b591662
0709 12:58:38.638913 (+ 25308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49909632}
I20260709 12:58:38.621770  5621 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:38.644961  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:38.646090  1690 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:38.661675  1691 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
I20260709 12:58:38.639601  5546 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.662271  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:38.605688  5670 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.668021  3947 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.669690  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:38.673695  5414 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:38.674326  5414 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:38.663411  5621 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:38.674492  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:38.677115  5533 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:58:38.628265  2297 rpcz_store.cc:269] 0709 12:58:36.137881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.138047 (+   166us) service_pool.cc:224] Handling call
0709 12:58:38.612695 (+2474648us) spinlock_profiling.cc:243] Waited 9.02 ms on lock 0x7b5400700654. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:38.612857 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20742016}
I20260709 12:58:38.627723  5516 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:38.681715  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 82804.3us
I20260709 12:58:38.632263  5657 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.684316  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:38.684865  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:38.684931  1608 raft_consensus.cc:2376] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 13. Re-sending same reply.
I20260709 12:58:38.685109  5649 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:38.685702  1613 raft_consensus.cc:2393] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 10: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:38.686465  5575 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:38.686816  5679 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:38.683424  1655 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:38.688658  1684 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:38.687721  5655 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:38.687394  5679 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.692958  5463 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:38.649924  5524 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.678591  5656 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:38.711462  5597 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:38.693429  5679 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:38.680737  5546 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.718423  5523 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:38.713419  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:38.661872  5675 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.678753  5414 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:38.649745  5536 consensus_queue.cc:237] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.713871  5669 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:38.666749  5543 raft_consensus.cc:697] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:38.725521  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:38.740825  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:38.747072  2301 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:38.747272  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:38.747823  1691 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:38.748663  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:38.749174  1691 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:38.762804  1690 raft_consensus.cc:2368] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 16. Current term is 17.
I20260709 12:58:38.690775  5526 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:38.771646  5670 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:38.723618  5683 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:38.730151  5414 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:38.779891  1691 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:38.694940  5575 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:38.774333  1656 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 12:58:38.780638  5610 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.662649  5638 consensus_queue.cc:237] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.726177  5463 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:38.738459  5516 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:38.730289  5577 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.732861  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:38.732851  5193 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.732932  5570 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:38.733017  5247 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.735406  5655 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:38.761570  5505 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:38.792749  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 68296.1us
I20260709 12:58:38.793226  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:38.760496  5646 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.735358  5432 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:38.772723  5682 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.726688  5597 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:58:38.780786  5669 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.773943  5546 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:38.788801  1583 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:38.782752  5567 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:38.773188  5544 consensus_queue.cc:1048] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:58:38.733153  5675 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.783685  5526 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.816529  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:38.927628  1691 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:38.928733  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:38.929555  1691 raft_consensus.cc:2393] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 12: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:38.810411  5672 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:38.798302  5649 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:58:38.939844  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 151145us
I20260709 12:58:38.817054  5536 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:38.944993  1611 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 1966) took 2561 ms (client timeout 3248 ms). Trace:
W20260709 12:58:38.945485  1611 rpcz_store.cc:269] 0709 12:58:36.383591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.384258 (+   667us) service_pool.cc:224] Handling call
0709 12:58:38.944741 (+2560483us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b5400445054. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:38.944913 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1547349760}
W20260709 12:58:38.955736  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 73563.6us
I20260709 12:58:38.868808  5657 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:38.857435  5679 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.796314  5610 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.843971  5647 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:38.788069  5683 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.810758  5577 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.943704  5649 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:38.993180  5649 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:38.949084  5536 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.817626  5193 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.895219  5612 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:38.946488  5432 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:38.808408  5463 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.794440  5684 consensus_queue.cc:1048] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.174s
I20260709 12:58:38.814064  5247 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.997925  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:38.817222  5655 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.842422  5646 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.868213  5543 consensus_queue.cc:237] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.930418  5567 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:39.008458  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:38.986131  5546 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:38.997057  5647 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:38.841653  5505 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:39.012526  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:39.020669  1536 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:38.939538  5669 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:39.018865  1691 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:39.001457  5667 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:39.026865  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:39.024796  5546 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:39.029047  5193 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:39.029640  5546 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:39.030737  5655 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:39.031247  5647 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:39.009879  1583 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:39.033331  5544 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:39.034008  5544 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:39.034170  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:39.034453  5544 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:39.034854  1536 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:39.035869  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:39.037899  5646 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:38.817262  5570 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:38.986887  5679 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:39.041800  5570 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:39.042088  5679 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:39.042867  5544 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:39.044644  5527 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.045248  5544 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:39.045179  5527 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:39.033528  5647 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:39.048200  1536 raft_consensus.cc:2410] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 12:58:39.027549  1539 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:58:39.051626  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:39.053784  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:39.054594  1691 raft_consensus.cc:2393] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 11: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:38.996399  5301 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:38.942111  5682 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:39.046042  5629 log.cc:927] Time spent T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 2.378s	user 0.000s	sys 0.024s
W20260709 12:58:39.059303  5631 log.cc:927] Time spent T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 2.360s	user 0.016s	sys 0.037s
I20260709 12:58:39.017876  5432 raft_consensus.cc:697] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:39.015062  5621 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:39.060870  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:39.066764  5683 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:39.067267  5675 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:39.068307  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2298) took 2750 ms. Trace:
I20260709 12:58:39.069620  1691 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:39.087137  5621 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:39.087584  5577 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:39.088165  5577 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.088913  5247 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:39.089844  5526 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:39.092888  5683 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.093410  5683 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:39.068902  1539 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:58:39.021646  5630 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:39.098345  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:39.084206  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:39.100772  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1965) took 2717 ms. Trace:
I20260709 12:58:39.105125  1616 rpcz_store.cc:276] 0709 12:58:36.383270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.383380 (+   110us) service_pool.cc:224] Handling call
0709 12:58:36.426137 (+ 42757us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:36.426533 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:36.426559 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:36.427004 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 12:58:36.564786 (+137782us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:36.564825 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.564902 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:39.045331 (+2480429us) spinlock_profiling.cc:243] Waited 48.1 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:58:39.100407 (+ 55076us) raft_consensus.cc:1685] finished
0709 12:58:39.100434 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:39.100692 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18236,"raft.queue_time_us":488,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":6142,"spinlock_wait_cycles":110700800,"thread_start_us":87184,"threads_started":1,"wal-append.queue_time_us":164801}
I20260709 12:58:39.074846  1533 rpcz_store.cc:276] 0709 12:58:36.318326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.565451 (+247125us) service_pool.cc:224] Handling call
0709 12:58:36.565797 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:36.566124 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:36.566147 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:36.571369 (+  5222us) log.cc:844] Serialized 26 byte log entry
0709 12:58:36.687566 (+116197us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:36.688720 (+  1154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.688834 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:39.047178 (+2358344us) spinlock_profiling.cc:243] Waited 34.9 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:58:39.067993 (+ 20815us) raft_consensus.cc:1685] finished
0709 12:58:39.068016 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:39.068229 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1273,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":3245,"spinlock_wait_cycles":80272640,"thread_start_us":94911,"threads_started":1,"wal-append.queue_time_us":114620}
W20260709 12:58:39.107264  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 149873us
I20260709 12:58:39.108143  1533 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:58:39.108424  1533 pending_rounds.cc:85] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 6
I20260709 12:58:39.108629  1533 pending_rounds.cc:107] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 10.7
W20260709 12:58:39.103206  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:39.108814  1533 raft_consensus.cc:2889] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:39.108773  2266 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:39.110131  1539 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:58:39.111955  5690 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:39.113787  1539 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:58:39.089306  5536 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:39.122731  1691 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:39.125003  1583 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:39.106885  5599 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:39.130741  5692 consensus_queue.cc:1048] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:58:39.132185  5599 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:39.112416  5690 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.131039  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:39.135092  1533 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:39.135787  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:39.136204  1533 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:39.141556  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:39.088891  5432 consensus_queue.cc:237] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:39.101435  5577 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:39.130510  5544 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.145925  5544 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:39.145522  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:39.147994  1611 raft_consensus.cc:2393] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 10: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:39.133992  5529 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:58:39.138804  5497 consensus_meta.cc:287] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.506s	user 0.005s	sys 0.005s
I20260709 12:58:39.154023  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:39.157878  1533 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:39.139432  5690 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:39.159210  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:39.164647  5497 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:39.165194  1539 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:39.165218  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:39.165933  1533 raft_consensus.cc:2376] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12. Re-sending same reply.
I20260709 12:58:39.166260  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:39.166792  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:39.166927  5497 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:39.167462  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:39.167708  1533 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:39.168628  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:39.168663  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:39.169349  1539 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:39.169430  1533 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:58:39.170372  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:39.171430  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:39.171543  1536 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 10.
I20260709 12:58:39.171964  1533 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:39.172905  2267 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:39.174263  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:39.174777  1539 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:39.175876  5463 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:39.176633  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1554) took 2958 ms. Trace:
I20260709 12:58:39.177073  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 2370) took 1113 ms. Trace:
I20260709 12:58:39.177013  1610 rpcz_store.cc:276] 0709 12:58:36.218685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.298831 (+ 80146us) service_pool.cc:224] Handling call
0709 12:58:36.299186 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:37.104625 (+805439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:39.176386 (+2071761us) spinlock_profiling.cc:243] Waited 796 ms on lock 0x7b54002a67d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:39.176579 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1829919616}
I20260709 12:58:39.177211  5649 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:39.183228  5683 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:39.185663  3947 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:39.177531  1691 rpcz_store.cc:276] 0709 12:58:38.063803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.127379 (+1063576us) service_pool.cc:224] Handling call
0709 12:58:39.177009 (+ 49630us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:39.196749  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:39.193918  5435 raft_consensus.cc:3055] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:58:39.197428  5435 raft_consensus.cc:740] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:58:39.197733  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:39.197918  5682 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:39.198256  5435 consensus_queue.cc:260] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:39.199060  1688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 1945) took 2727 ms (client timeout 2040 ms). Trace:
I20260709 12:58:39.199524  5435 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:58:39.199451  1688 rpcz_store.cc:269] 0709 12:58:36.468189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.468441 (+   252us) service_pool.cc:224] Handling call
0709 12:58:39.194989 (+2726548us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b5400288cd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:39.195128 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1225882880}
I20260709 12:58:39.198616  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:39.203879  5521 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.204890  5521 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:39.178733  5556 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:39.206295  5556 raft_consensus.cc:697] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 10 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:58:39.203189  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:39.203702  5398 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.170504  5529 raft_consensus.cc:697] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:39.182814  5414 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:39.212450  5521 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:39.212224  5556 consensus_queue.cc:237] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:39.213747  5414 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:39.214493  5398 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:39.214851  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:39.215504  1613 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:39.216842  5398 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:39.217394  5301 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:39.183008  5610 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:39.220013  5577 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:39.222636  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:39.223090  5595 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:39.225052  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:39.225621  1581 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:39.225942  1608 raft_consensus.cc:2410] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:58:39.226846  1581 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:39.227527  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:39.228657  5599 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:39.229219  5599 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:58:39.229458  5497 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:39.229903  5497 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.230250  5497 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:39.230609  5505 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:39.234402  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2357) took 2738 ms. Trace:
I20260709 12:58:39.234849  1686 rpcz_store.cc:276] 0709 12:58:36.495661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.563101 (+ 67440us) service_pool.cc:224] Handling call
0709 12:58:36.563407 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:37.056058 (+492651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:39.234175 (+2178117us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b5400158454. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:39.234341 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1130802432}
I20260709 12:58:39.235726  1613 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:58:39.236720  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2295) took 2919 ms. Trace:
I20260709 12:58:39.237212  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:39.238651  5524 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:39.240944  1581 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:39.237142  1542 rpcz_store.cc:276] 0709 12:58:36.317494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.322942 (+  5448us) service_pool.cc:224] Handling call
0709 12:58:38.535141 (+2212199us) spinlock_profiling.cc:243] Waited 28.7 ms on lock 0x7b5800002798. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc86202afc0 00007fc862015929 00007fc8620153d2 00007fc85b58cbd4
0709 12:58:38.535415 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:38.592777 (+ 57362us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:38.604696 (+ 11919us) log.cc:844] Serialized 14 byte log entry
0709 12:58:38.664176 (+ 59480us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:38.664232 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:38.664281 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:39.236465 (+572184us) spinlock_profiling.cc:243] Waited 57.1 ms on lock 0x7b5400187ed4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:39.236538 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:39.236659 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7601,"prepare.queue_time_us":14442,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":2916,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"spinlock_wait_cycles":197504256,"thread_start_us":58768,"threads_started":1,"wal-append.queue_time_us":105367}
W20260709 12:58:39.251757  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:39.211846  1533 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:39.257477  1583 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:39.318055  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:39.318899  1536 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:39.321640  1542 raft_consensus.cc:1275] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:58:39.325083  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:39.327096  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 69728.8us
W20260709 12:58:39.328872  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 88028us
I20260709 12:58:39.330202  1581 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:39.332049  5598 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:58:39.332698  5598 raft_consensus.cc:697] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:39.333642  5598 consensus_queue.cc:237] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:39.336583  5398 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:39.350903  5649 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:39.353536  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:58:39.206893  5669 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:39.459904  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:39.460881  1691 raft_consensus.cc:2393] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 14: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 12:58:39.468128  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 138018us
I20260709 12:58:39.469113  1581 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:39.442963  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:39.308943  5524 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:39.324532  5634 log.cc:927] Time spent T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 2.557s	user 0.030s	sys 0.062s
W20260709 12:58:39.447597  5639 log.cc:927] Time spent T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 2.161s	user 0.005s	sys 0.010s
I20260709 12:58:39.486333  1581 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:39.487990  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:39.488428  5500 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:39.488691  1691 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:39.491673  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:39.492450  1613 raft_consensus.cc:2393] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 10: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:39.493475  1581 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:39.497018  1581 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:39.229137  5529 consensus_queue.cc:237] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:39.481309  5599 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:39.499430  1581 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:39.500666  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:39.501379  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:39.504398  5596 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:39.504781  5496 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:39.506697  5496 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:39.507099  5496 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:39.493255  5435 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:58:39.516649  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:39.517524  1691 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:58:39.492657  5506 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:39.524989  5506 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.525439  5506 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:39.526746  5496 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:39.527756  1581 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:39.533370  5435 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:58:39.531605  1691 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:39.537565  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:39.493920  5521 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:39.543609  1581 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:39.546720  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:39.547559  1613 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 13: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:39.533934  5435 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:39.548058  1581 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:39.534428  5642 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:39.534634  5682 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:39.492503  5524 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:39.556604  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2361) took 3058 ms. Trace:
I20260709 12:58:39.553961  5599 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:39.552760  5435 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:39.568004  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:39.560740  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2362) took 3062 ms. Trace:
I20260709 12:58:39.544010  5521 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.556226  5638 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:39.563156  1685 rpcz_store.cc:276] 0709 12:58:36.498010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.607557 (+109547us) service_pool.cc:224] Handling call
0709 12:58:36.607835 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:36.608165 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:36.608192 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:36.608717 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 12:58:36.672503 (+ 63786us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:36.672546 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.672608 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:39.186092 (+2513484us) spinlock_profiling.cc:243] Waited 40.1 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:58:39.549178 (+363086us) raft_consensus.cc:1685] finished
0709 12:58:39.549200 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:39.556534 (+  7334us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2599,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"spinlock_wait_cycles":92255104,"thread_start_us":63396,"threads_started":1,"wal-append.queue_time_us":84212}
I20260709 12:58:39.561018  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:39.572182  1608 raft_consensus.cc:1275] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:58:39.572697  1538 raft_consensus.cc:2393] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 10: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:39.576869  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:39.569608  1682 rpcz_store.cc:276] 0709 12:58:36.498290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.640198 (+141908us) service_pool.cc:224] Handling call
0709 12:58:36.661797 (+ 21599us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:36.668171 (+  6374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:36.668204 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:36.681671 (+ 13467us) log.cc:844] Serialized 26 byte log entry
0709 12:58:36.891171 (+209500us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:36.891219 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.891303 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:39.186297 (+2294994us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:58:39.556099 (+369802us) raft_consensus.cc:1685] finished
0709 12:58:39.556121 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:39.560671 (+  4550us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1361,"raft.queue_time_us":6013,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":8541,"spinlock_wait_cycles":3816704,"thread_start_us":177147,"threads_started":1,"wal-append.queue_time_us":377921}
I20260709 12:58:39.577560  1685 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:58:39.560110  5361 consensus_queue.cc:1048] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:58:39.574188  5521 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:39.560300  5682 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 12:58:39.583595  5636 log.cc:927] Time spent T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 2.886s	user 0.038s	sys 0.053s
W20260709 12:58:39.588541  5632 log.cc:927] Time spent T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 2.880s	user 0.021s	sys 0.017s
I20260709 12:58:39.595635  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:39.558178  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:39.627393  1691 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:39.567993  5596 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:39.575296  5638 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:39.631685  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:39.631278  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:39.641902  1538 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:39.638345  1685 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:39.562245  5642 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:39.645484  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:39.642059  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 1958) took 1524 ms. Trace:
I20260709 12:58:39.653327  1691 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:39.653553  1682 rpcz_store.cc:276] 0709 12:58:38.117843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.581616 (+1463773us) service_pool.cc:224] Handling call
0709 12:58:39.641981 (+ 60365us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:39.580967  5599 raft_consensus.cc:697] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:39.646797  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:39.647450  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:39.647571  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:39.592202  5682 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:39.646909  5524 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:39.659816  1617 raft_consensus.cc:2393] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 14: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:39.660459  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:39.666906  1614 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 12:58:39.668766  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:39.669905  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:39.670928  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:39.672464  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:58:39.673635  5698 log.cc:927] Time spent T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:58:39.674075  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:39.674960  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 264) took 3115 ms. Trace:
I20260709 12:58:39.675381  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:39.675360  1683 rpcz_store.cc:276] 0709 12:58:36.559562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:37.202348 (+642786us) service_pool.cc:224] Handling call
0709 12:58:37.202706 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:37.203084 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:37.203113 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:37.203527 (+   414us) log.cc:844] Serialized 26 byte log entry
0709 12:58:39.189299 (+1985772us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b180028e700. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf10d1 00007fc85d00ca0f
0709 12:58:39.447420 (+258121us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:39.447465 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:39.447539 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:39.674540 (+227001us) raft_consensus.cc:1685] finished
0709 12:58:39.674562 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:39.674893 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":12111,"spinlock_wait_cycles":2998656,"thread_start_us":255680,"threads_started":1,"wal-append.queue_time_us":2359966}
I20260709 12:58:39.676357  1613 raft_consensus.cc:2368] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 11.
I20260709 12:58:39.680049  1617 raft_consensus.cc:1275] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:58:39.681558  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:39.685460  1609 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:58:39.644294  5638 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:39.689142  1683 raft_consensus.cc:1275] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:58:39.691224  1683 pending_rounds.cc:85] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 6
I20260709 12:58:39.691576  1683 pending_rounds.cc:107] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:58:39.691849  1683 raft_consensus.cc:2889] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:39.692696  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2367) took 1629 ms. Trace:
I20260709 12:58:39.693046  1683 rpcz_store.cc:276] 0709 12:58:38.063005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.688173 (+1625168us) service_pool.cc:224] Handling call
0709 12:58:39.688734 (+   561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:39.692330 (+  3596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:39.692589 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:39.642649  5669 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:39.700131  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:39.703716  1682 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:39.704273  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 1971) took 1060 ms. Trace:
I20260709 12:58:39.704589  1682 rpcz_store.cc:276] 0709 12:58:38.644133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.662139 (+1018006us) service_pool.cc:224] Handling call
0709 12:58:39.704207 (+ 42068us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:39.705760  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1971) took 3118 ms. Trace:
I20260709 12:58:39.706214  1612 rpcz_store.cc:276] 0709 12:58:36.587881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.588047 (+   166us) service_pool.cc:224] Handling call
0709 12:58:36.596386 (+  8339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:36.596748 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:36.596773 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:36.597760 (+   987us) log.cc:844] Serialized 26 byte log entry
0709 12:58:36.683442 (+ 85682us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:36.683498 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.683594 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:39.501166 (+2817572us) spinlock_profiling.cc:243] Waited 5.77 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:58:39.700852 (+199686us) raft_consensus.cc:1685] finished
0709 12:58:39.700889 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:39.705688 (+  4799us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8745,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"spinlock_wait_cycles":13263232,"thread_start_us":85212,"threads_started":1,"wal-append.queue_time_us":110052}
I20260709 12:58:39.707279  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:39.709843  1691 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:39.711040  1691 raft_consensus.cc:1275] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 12:58:39.711304  1691 pending_rounds.cc:85] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 6
I20260709 12:58:39.711530  1691 pending_rounds.cc:107] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:58:39.711712  1691 raft_consensus.cc:2889] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:39.705107  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:39.716167  1611 raft_consensus.cc:2393] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 11: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:39.717070  1683 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:58:39.717569  1683 pending_rounds.cc:85] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 7
I20260709 12:58:39.717814  1683 pending_rounds.cc:107] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:58:39.718061  1683 raft_consensus.cc:2889] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:39.718768  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2373) took 1654 ms. Trace:
I20260709 12:58:39.719137  1683 rpcz_store.cc:276] 0709 12:58:38.064652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.693853 (+1629201us) service_pool.cc:224] Handling call
0709 12:58:39.694214 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:39.718515 (+ 24301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:39.718712 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:39.682332  1617 raft_consensus.cc:2368] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10.
I20260709 12:58:39.667795  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:39.721899  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:39.644126  5596 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:39.726046  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:39.712364  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2374) took 1647 ms. Trace:
W20260709 12:58:39.706008  5545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.123s	user 0.029s	sys 0.036s
I20260709 12:58:39.723263  1685 raft_consensus.cc:2410] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:58:39.728274  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:39.925632  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:39.728991  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 190) took 3116 ms. Trace:
I20260709 12:58:39.714908  5435 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:39.727291  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2375) took 1662 ms. Trace:
I20260709 12:58:39.937970  1683 rpcz_store.cc:276] 0709 12:58:38.065186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.719884 (+1654698us) service_pool.cc:224] Handling call
0709 12:58:39.720209 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:39.726900 (+  6691us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:39.726932 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:39.726978 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:39.727018 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:39.727081 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:39.727237 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6318,"raft.queue_time_us":9188,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":4049}
I20260709 12:58:39.731599  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:39.732753  1611 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 14. Current term is 15. Ops: []
I20260709 12:58:39.730544  1691 rpcz_store.cc:276] 0709 12:58:38.064930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.710431 (+1645501us) service_pool.cc:224] Handling call
0709 12:58:39.710774 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:39.712168 (+  1394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:39.712321 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:39.664083  5690 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:58:39.967533  5710 log.cc:927] Time spent T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:58:39.703166  5506 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
W20260709 12:58:39.749583  5700 log.cc:927] Time spent T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:58:39.754698  1538 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:58:40.002079  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:40.003728  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:39.734213  5545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.159s	user 0.030s	sys 0.037s
I20260709 12:58:39.724874  5496 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:39.773046  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 295) took 1652 ms. Trace:
I20260709 12:58:39.774331  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 1950) took 1677 ms. Trace:
I20260709 12:58:40.030098  1684 rpcz_store.cc:276] 0709 12:58:38.097186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:38.674199 (+577013us) service_pool.cc:224] Handling call
0709 12:58:39.774131 (+1099932us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b5400388e54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:39.774263 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30535040}
I20260709 12:58:39.775439  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2355) took 3280 ms. Trace:
I20260709 12:58:39.775861  5567 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:39.776202  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 1968) took 1142 ms. Trace:
I20260709 12:58:39.777403  5544 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:39.787654  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:39.789645  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:39.791822  5497 consensus_meta.cc:287] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.561s	user 0.007s	sys 0.000s
I20260709 12:58:39.794184  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:39.796213  5599 consensus_queue.cc:237] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:39.798100  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:39.806360  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1951) took 1709 ms. Trace:
I20260709 12:58:39.813684  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:39.815594  1687 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 1953) took 1714 ms (client timeout 2102 ms). Trace:
I20260709 12:58:39.725591  5524 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 12:58:39.804442  5701 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.146s	user 0.002s	sys 0.000s
I20260709 12:58:39.716172  5669 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:39.895872  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:39.917065  1533 raft_consensus.cc:2393] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 13: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:39.926563  1615 rpcz_store.cc:276] 0709 12:58:36.612315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.612506 (+   191us) service_pool.cc:224] Handling call
0709 12:58:36.612830 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:36.613177 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:36.613204 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:36.613650 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 12:58:36.697348 (+ 83698us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:36.697405 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:36.697508 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:39.557738 (+2860230us) spinlock_profiling.cc:243] Waited 94.9 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:58:39.716637 (+158899us) raft_consensus.cc:1685] finished
0709 12:58:39.716658 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:39.728924 (+ 12266us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1020,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"spinlock_wait_cycles":218162944,"thread_start_us":83249,"threads_started":1,"wal-append.queue_time_us":83699}
I20260709 12:58:34.965131  1427 catalog_manager.cc:5028] TS 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): tablet d127be99e2af41c0808e03480c1b64e3 (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:58:39.968705  2301 raft_consensus.cc:2393] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 12: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:58:39.963115  5521 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:39.969764  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 1967) took 1337 ms. Trace:
I20260709 12:58:36.329643   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:39.986820  1611 raft_consensus.cc:1240] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:39.984535  1440 catalog_manager.cc:5697] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 3 to 4, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:40.032577  1690 rpcz_store.cc:276] 0709 12:58:38.633983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:38.662019 (+ 28036us) service_pool.cc:224] Handling call
0709 12:58:39.776000 (+1113981us) spinlock_profiling.cc:243] Waited 97.4 ms on lock 0x7b540029b3d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:39.776144 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":224062208}
I20260709 12:58:40.256011  1508 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:40.258733  1685 rpcz_store.cc:276] 0709 12:58:38.631882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.667216 (+1035334us) service_pool.cc:224] Handling call
0709 12:58:39.945318 (+278102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:40.212376  5389 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:40.260962  1612 raft_consensus.cc:1240] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:40.261883  5669 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:40.029148  1535 rpcz_store.cc:276] 0709 12:58:38.120755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:38.121639 (+   884us) service_pool.cc:224] Handling call
0709 12:58:38.134559 (+ 12920us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:38.295202 (+160643us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:38.295234 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:38.295277 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:38.295313 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:39.772737 (+1477424us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54003f8ed4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:39.772795 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:39.772970 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368986880}
W20260709 12:58:40.256639  1583 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.027s	sys 0.046s
W20260709 12:58:40.262995  1583 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.027s	sys 0.046s
I20260709 12:58:40.259711  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:40.263092  5524 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:40.264427  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:40.264506  1427 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 5.29935e+06us
I20260709 12:58:40.265091  1685 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:58:38.059597  1425 catalog_manager.cc:5028] TS dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): tablet e4681eaad3084357b9677e4242b97c99 (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:58:40.266117  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:40.266705  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:40.260246  5497 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:40.066159  1614 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 14. Current term is 15. Ops: []
I20260709 12:58:40.268966  1685 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:58:40.265547  5524 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:58:40.266469  1425 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 2.207e+06us
I20260709 12:58:40.031303  1689 rpcz_store.cc:276] 0709 12:58:36.495133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:36.548826 (+ 53693us) service_pool.cc:224] Handling call
0709 12:58:36.549167 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:39.070890 (+2521723us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:39.095054 (+ 24164us) log.cc:844] Serialized 14 byte log entry
0709 12:58:39.143570 (+ 48516us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:39.143607 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:39.143641 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:39.775210 (+631569us) spinlock_profiling.cc:243] Waited 2.52 s on lock 0x7b5400389d54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:39.775255 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:39.775381 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23998,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":80,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"spinlock_wait_cycles":5799313664,"thread_start_us":48156,"threads_started":1,"wal-append.queue_time_us":122381}
W20260709 12:58:40.260026  1687 rpcz_store.cc:269] 0709 12:58:38.100854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:38.173452 (+ 72598us) service_pool.cc:224] Handling call
0709 12:58:39.815408 (+1641956us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b540029a9d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:39.815518 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":754637568}
I20260709 12:58:40.321743  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:40.322662  1687 raft_consensus.cc:2393] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 11: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:40.271288  1608 raft_consensus.cc:2393] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 14: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:40.278159  1617 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:40.278659  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:40.272465  1686 rpcz_store.cc:276] 0709 12:58:38.097420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.805490 (+1708070us) service_pool.cc:224] Handling call
0709 12:58:39.805850 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:39.806032 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:39.806055 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:39.806095 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:39.806126 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:39.806186 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:39.806300 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:40.326364  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:40.327315  1686 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:40.301720  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:40.328898  1537 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:58:40.260632  5374 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:40.330639  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:40.250639  5668 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.705s	user 0.006s	sys 0.058s
I20260709 12:58:40.331874  1534 raft_consensus.cc:2393] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 9: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:40.334270  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:58:40.879225  1690 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.022s	sys 0.028s
I20260709 12:58:40.335079  1534 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:40.448736  1539 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.023s	sys 0.077s
W20260709 12:58:40.861321  1684 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.020s	sys 0.029s
W20260709 12:58:40.860047  1691 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.015s	sys 0.034s
W20260709 12:58:40.940832  1691 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.015s	sys 0.041s
I20260709 12:58:40.398730  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:40.940567  1505 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:51512 dropped due to backpressure: service queue is full with 50 items
I20260709 12:58:40.340066  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:40.940366  1684 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.020s	sys 0.036s
W20260709 12:58:40.938999  1690 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.022s	sys 0.034s
I20260709 12:58:40.776161  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:40.776582  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:40.402513  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:58:40.939741  1539 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.122s	user 0.036s	sys 0.111s
I20260709 12:58:40.944005  1533 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
W20260709 12:58:40.530023  1682 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.007s	sys 0.015s
I20260709 12:58:40.945451  1611 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 14.
I20260709 12:58:40.451633  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:40.945015  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2344) took 1378 ms. Trace:
I20260709 12:58:40.338363  1583 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:40.946708  1533 rpcz_store.cc:276] 0709 12:58:39.566916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:40.278384 (+711468us) service_pool.cc:224] Handling call
0709 12:58:40.944893 (+666509us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:40.453936  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 198) took 1309 ms. Trace:
I20260709 12:58:40.335012  1617 raft_consensus.cc:1240] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:40.947705  1616 rpcz_store.cc:276] 0709 12:58:39.144827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.144957 (+   130us) service_pool.cc:224] Handling call
0709 12:58:39.146101 (+  1144us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:39.146523 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:39.146552 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:39.226095 (+ 79543us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b2c00125b38. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85b94aa11 00007fc85b95a372 00007fc85d08ca01 00007fc85d05143a 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2
0709 12:58:39.226680 (+   585us) log.cc:844] Serialized 52 byte log entry
0709 12:58:39.491017 (+264337us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:58:39.700802 (+209785us) log.cc:844] Serialized 14 byte log entry
0709 12:58:39.702607 (+  1805us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:39.702689 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:39.803745 (+101056us) spinlock_profiling.cc:243] Waited 4.35 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:58:40.453690 (+649945us) raft_consensus.cc:1685] finished
0709 12:58:40.453714 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:40.453872 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":186479,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":2473,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":16093,"spinlock_wait_cycles":16800768,"thread_start_us":460318,"threads_started":2,"wal-append.queue_time_us":341170}
W20260709 12:58:40.469846  1581 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.010s	sys 0.012s
W20260709 12:58:40.950075  1581 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.226s	user 0.010s	sys 0.020s
W20260709 12:58:40.950371  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 1.22651e+06us
I20260709 12:58:40.353484  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:40.270145  5682 consensus_meta.cc:287] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.584s	user 0.013s	sys 0.002s
W20260709 12:58:40.877315  1508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.004s	sys 0.012s
I20260709 12:58:41.003296  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:40.944061  1535 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:41.004611  1688 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.042s	sys 0.069s
W20260709 12:58:41.005192  1688 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.042s	sys 0.069s
W20260709 12:58:40.985980  1686 consensus_meta.cc:287] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.658s	user 0.007s	sys 0.000s
I20260709 12:58:41.006083  1686 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:40.336856  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:40.669458  1537 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:58:41.007371  1538 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:41.007817  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1491) took 1244 ms. Trace:
I20260709 12:58:40.939085  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:40.945091  1682 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.135s	user 0.009s	sys 0.021s
I20260709 12:58:40.941807  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:40.953917  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2350) took 1381 ms. Trace:
I20260709 12:58:41.008248  1537 rpcz_store.cc:276] 0709 12:58:39.762942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:40.301400 (+538458us) service_pool.cc:224] Handling call
0709 12:58:41.007751 (+706351us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.009447  1614 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:58:41.012411  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:41.010749  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:41.013989  1615 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:41.010701  1687 raft_consensus.cc:2393] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 11: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 12:58:41.003990  1508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.004s	sys 0.016s
W20260709 12:58:40.334872  5668 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.790s	user 0.007s	sys 0.064s
W20260709 12:58:41.016455  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 760511us
I20260709 12:58:41.010984  1542 rpcz_store.cc:276] 0709 12:58:39.572062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:40.289501 (+717439us) service_pool.cc:224] Handling call
0709 12:58:40.953833 (+664332us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.017364  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:40.331648  5596 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:40.433195  5638 consensus_meta.cc:287] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.728s	user 0.010s	sys 0.000s
I20260709 12:58:41.019778  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:41.032716  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:41.020049  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:41.011796  1683 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.982s	user 0.002s	sys 0.018s
I20260709 12:58:41.021469  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:40.403558  5414 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:40.530102  5432 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.330s	user 0.011s	sys 0.023s
I20260709 12:58:41.018146  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:40.275794  5642 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:40.472921  5711 log.cc:927] Time spent T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.566s	user 0.000s	sys 0.001s
W20260709 12:58:40.529832  5529 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.005s	sys 0.018s
W20260709 12:58:40.471576  5685 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.072s	sys 0.147s
I20260709 12:58:41.027931  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:41.006173  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 667861us
I20260709 12:58:41.008127  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1499) took 1242 ms. Trace:
I20260709 12:58:40.428144  5527 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:41.032025  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:40.737201  5708 log.cc:927] Time spent T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.341s	user 0.001s	sys 0.000s
I20260709 12:58:40.676435  5544 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:40.513732  5690 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:40.393185  5506 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:41.034968  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:41.070732  1655 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.014s	sys 0.026s
I20260709 12:58:41.071271  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:58:41.099972  1655 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.015s	sys 0.026s
W20260709 12:58:41.100345  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 670181us
I20260709 12:58:41.100675  1689 raft_consensus.cc:2393] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 12: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:41.033479  1608 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:58:40.548564  5435 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:41.074391  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:41.035526  5596 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:41.076499  1683 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.046s	user 0.002s	sys 0.019s
I20260709 12:58:40.270573  5389 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:40.861397  5713 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.017026  5682 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:40.354966  5684 consensus_queue.cc:1059] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.717s
I20260709 12:58:41.094653  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:41.095172  1687 raft_consensus.cc:2393] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 15: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:41.022863  5715 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:58:41.075600  5432 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.876s	user 0.014s	sys 0.030s
W20260709 12:58:41.094290  5529 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.296s	user 0.006s	sys 0.026s
I20260709 12:58:41.071504  5638 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:41.076113  1686 raft_consensus.cc:2393] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 12: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:41.094614  5642 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:41.094612  5685 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.339s	user 0.131s	sys 0.245s
I20260709 12:58:41.117949  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:41.096258  5414 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:58:41.115005  5706 log.cc:927] Time spent T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.388s	user 0.001s	sys 0.001s
I20260709 12:58:41.114073  5684 consensus_queue.cc:1243] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:58:41.104727  5544 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:41.112207  5596 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:58:41.129771  5712 log.cc:927] Time spent T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:58:41.128670  5497 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:41.113672  5713 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:41.122157  5642 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:41.129479  5652 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:41.145568  5682 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:41.147858  5642 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:41.132174  5725 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:41.150656  5725 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.151157  5725 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:41.161707  5544 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:41.166402  5725 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:41.169263  5638 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:41.177702  5713 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:40.942507  1505 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:51512 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1510)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1488)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1503)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1496)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1513)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1508)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1518)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1526)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1524)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1490)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1502)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1489)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1514)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1522)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1516)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1507)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2347)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2348)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2349)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2353)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2354)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2356)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2357)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 303)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2360)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2361)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2362)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1486)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1487)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1492)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1494)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 304)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 305)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1511)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1521)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1525)
I20260709 12:58:41.214735  1505 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:51512 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1496)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1513)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1508)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1518)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1526)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1524)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1490)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1530)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1502)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1489)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1514)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1522)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1516)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1507)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2347)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2348)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2349)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2353)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2354)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2356)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2357)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 303)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2360)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2361)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2362)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1486)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1487)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1492)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1494)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 304)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 305)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1511)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1521)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1525)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2363)
W20260709 12:58:41.224889  1507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.000s	sys 0.011s
W20260709 12:58:41.225554  1507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.000s	sys 0.012s
I20260709 12:58:41.026326  1508 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:58:41.229537  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 203180us
I20260709 12:58:41.230937  1508 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:41.031296  1534 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:41.233719  1535 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:41.095083  1538 rpcz_store.cc:276] 0709 12:58:39.765631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:40.336568 (+570937us) service_pool.cc:224] Handling call
0709 12:58:41.008038 (+671470us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:41.234967  1535 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2345) took 1666 ms (client timeout 2126 ms). Trace:
I20260709 12:58:41.234012  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2340) took 2012 ms. Trace:
I20260709 12:58:41.235435  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2335) took 2087 ms. Trace:
I20260709 12:58:41.233803  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2351) took 1660 ms. Trace:
I20260709 12:58:41.235702  1536 rpcz_store.cc:276] 0709 12:58:39.221508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.461406 (+239898us) service_pool.cc:224] Handling call
0709 12:58:39.485693 (+ 24287us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:39.486069 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:39.486096 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:39.486641 (+   545us) log.cc:844] Serialized 52 byte log entry
0709 12:58:39.660579 (+173938us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:39.660624 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:39.660700 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:41.233260 (+1572560us) raft_consensus.cc:1685] finished
0709 12:58:41.233345 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:41.233794 (+   449us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":4821,"thread_start_us":156341,"threads_started":1,"wal-append.queue_time_us":761560}
W20260709 12:58:41.235486  1535 rpcz_store.cc:269] 0709 12:58:39.568659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:40.334481 (+765822us) service_pool.cc:224] Handling call
0709 12:58:41.234864 (+900383us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.235852  1540 rpcz_store.cc:276] 0709 12:58:39.147865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.234440 (+ 86575us) service_pool.cc:224] Handling call
0709 12:58:39.234716 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:39.240155 (+  5439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:39.240188 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:39.302476 (+ 62288us) log.cc:844] Serialized 26 byte log entry
0709 12:58:39.764178 (+461702us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:39.764217 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:39.764278 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:41.234875 (+1470597us) raft_consensus.cc:1685] finished
0709 12:58:41.234916 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:41.235259 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31007,"raft.queue_time_us":5092,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":94,"thread_start_us":282331,"threads_started":1,"wal-append.queue_time_us":1242749}
I20260709 12:58:41.236594  1534 rpcz_store.cc:276] 0709 12:58:39.572782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:40.334004 (+761222us) service_pool.cc:224] Handling call
0709 12:58:41.233529 (+899525us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.106215  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:41.096325  1583 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:41.247493  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 151098us
W20260709 12:58:41.093155  1610 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.203s	user 0.007s	sys 0.042s
W20260709 12:58:41.249078  1610 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.358s	user 0.007s	sys 0.042s
I20260709 12:58:41.249653  1609 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 14: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:41.251664  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:41.253013  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1948) took 3156 ms. Trace:
I20260709 12:58:41.253193  1611 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:58:41.254528  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:41.253523  1682 rpcz_store.cc:276] 0709 12:58:38.096710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.731640 (+1634930us) service_pool.cc:224] Handling call
0709 12:58:39.764351 (+ 32711us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:39.764754 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:39.764784 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:39.810176 (+ 45392us) log.cc:844] Serialized 26 byte log entry
0709 12:58:41.010269 (+1200093us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:41.010326 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.010431 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:41.252364 (+241933us) raft_consensus.cc:1685] finished
0709 12:58:41.252406 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:41.252764 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":737,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":87,"thread_start_us":1199592,"threads_started":1,"wal-append.queue_time_us":1314381}
I20260709 12:58:41.251286  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 1975) took 2050 ms. Trace:
I20260709 12:58:41.256731  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:41.257737  1682 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:41.257895  1612 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 15. Current term is 16. Ops: []
I20260709 12:58:41.259508  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:41.260447  1613 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:41.260744  1682 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 12:58:41.261458  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 1982) took 1004 ms. Trace:
I20260709 12:58:41.261831  1682 rpcz_store.cc:276] 0709 12:58:40.257505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.259024 (+1001519us) service_pool.cc:224] Handling call
0709 12:58:41.261380 (+  2356us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.262174  1614 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:41.264068  1615 raft_consensus.cc:2410] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:58:41.264837  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2382) took 2968 ms. Trace:
I20260709 12:58:41.265311  1684 rpcz_store.cc:276] 0709 12:58:38.296293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:40.031032 (+1734739us) service_pool.cc:224] Handling call
0709 12:58:40.254304 (+223272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:40.284779 (+ 30475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:40.284811 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:40.285321 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 12:58:40.943855 (+658534us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:40.943896 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:40.943958 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:41.264153 (+320195us) raft_consensus.cc:1685] finished
0709 12:58:41.264192 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:41.264498 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30194,"raft.queue_time_us":36598,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":7818,"thread_start_us":658234,"threads_started":1,"wal-append.queue_time_us":834059}
I20260709 12:58:41.267783  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:41.269045  1684 raft_consensus.cc:2410] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:58:41.263782  1610 rpcz_store.cc:276] 0709 12:58:39.200940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.201058 (+   118us) service_pool.cc:224] Handling call
0709 12:58:39.201375 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:39.240074 (+ 38699us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:39.240103 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:39.321063 (+ 80960us) log.cc:844] Serialized 26 byte log entry
0709 12:58:39.890433 (+569370us) spinlock_profiling.cc:243] Waited 38.8 ms on lock 0x7b180043e4c0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf10d1 00007fc85d00ca0f
0709 12:58:41.250068 (+1359635us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:41.250181 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.250354 (+   173us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:41.250412 (+    58us) raft_consensus.cc:1685] finished
0709 12:58:41.250429 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:41.251107 (+   678us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":126240,"raft.queue_time_us":56804,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":1136,"spinlock_wait_cycles":89303296,"thread_start_us":1359045,"threads_started":1,"wal-append.queue_time_us":1808203}
I20260709 12:58:41.269660  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 1977) took 1013 ms. Trace:
I20260709 12:58:41.270385  1684 rpcz_store.cc:276] 0709 12:58:40.256201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.267293 (+1011092us) service_pool.cc:224] Handling call
0709 12:58:41.269591 (+  2298us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.271863  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:41.273170  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 1978) took 1016 ms. Trace:
I20260709 12:58:41.273670  1583 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:41.275179  1655 leader_election.cc:336] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.735s (SENT)
I20260709 12:58:41.275966  1655 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:41.279549  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:41.281555  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:41.282770  1612 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:58:41.234395  1508 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:58:41.285106  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 51012.7us
I20260709 12:58:41.119414  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:41.288206  1686 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:41.288321  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1954) took 3187 ms. Trace:
I20260709 12:58:41.289872  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:41.288975  1688 rpcz_store.cc:276] 0709 12:58:38.101045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.807174 (+1706129us) service_pool.cc:224] Handling call
0709 12:58:39.807548 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:40.281148 (+473600us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:40.281195 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:40.293545 (+ 12350us) log.cc:844] Serialized 26 byte log entry
0709 12:58:41.006066 (+712521us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:41.006137 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.006226 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:41.287788 (+281562us) raft_consensus.cc:1685] finished
0709 12:58:41.287830 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:41.288131 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":473210,"raft.queue_time_us":476740,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":40225,"thread_start_us":601740,"threads_started":1,"wal-append.queue_time_us":785468}
I20260709 12:58:41.122601  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:41.293090  1688 raft_consensus.cc:1275] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:58:41.293529  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 1986) took 1034 ms. Trace:
I20260709 12:58:41.293875  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1970) took 2653 ms. Trace:
I20260709 12:58:41.294152  1687 rpcz_store.cc:276] 0709 12:58:40.258622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.122368 (+863746us) service_pool.cc:224] Handling call
0709 12:58:41.293315 (+170947us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.294394  1688 rpcz_store.cc:276] 0709 12:58:38.640338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.291456 (+2651118us) service_pool.cc:224] Handling call
0709 12:58:41.292163 (+   707us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:41.293539 (+  1376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.293775 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68992}
I20260709 12:58:41.296931  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2386) took 2627 ms. Trace:
I20260709 12:58:41.120285  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:41.298126  1689 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:58:41.300302  1508 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:41.297395  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2385) took 2646 ms. Trace:
I20260709 12:58:41.301039  1687 rpcz_store.cc:276] 0709 12:58:38.651131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.295223 (+2644092us) service_pool.cc:224] Handling call
0709 12:58:41.295835 (+   612us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:41.296325 (+   490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:41.296359 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:41.296427 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:41.297128 (+   701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.297215 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:41.297335 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.309122  1686 raft_consensus.cc:1240] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:41.310279  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1969) took 2675 ms. Trace:
I20260709 12:58:41.310671  1686 rpcz_store.cc:276] 0709 12:58:38.635012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.291369 (+2656357us) service_pool.cc:224] Handling call
0709 12:58:41.292184 (+   815us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:41.309837 (+ 17653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.310168 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58368}
I20260709 12:58:41.256367  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:41.318284  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:41.319900  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:41.320751  1583 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:41.321916  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 46276.5us
I20260709 12:58:41.331267  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:41.341701  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:41.342979  1612 raft_consensus.cc:2393] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 14: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:41.273824  1684 rpcz_store.cc:276] 0709 12:58:40.256438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.271383 (+1014945us) service_pool.cc:224] Handling call
0709 12:58:41.273059 (+  1676us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.346011  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 270) took 2551 ms. Trace:
I20260709 12:58:41.346510  1684 rpcz_store.cc:276] 0709 12:58:38.794208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.344532 (+2550324us) service_pool.cc:224] Handling call
0709 12:58:41.345188 (+   656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:41.345647 (+   459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:41.345673 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:41.345737 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:41.345768 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.345822 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:41.345943 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.297365  1688 rpcz_store.cc:276] 0709 12:58:38.669302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.295775 (+2626473us) service_pool.cc:224] Handling call
0709 12:58:41.296211 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:41.296544 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:41.296568 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:41.296628 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:41.296665 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.296727 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:41.296857 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.353866  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2393) took 2200 ms. Trace:
I20260709 12:58:41.354378  1688 rpcz_store.cc:276] 0709 12:58:39.153475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.352143 (+2198668us) service_pool.cc:224] Handling call
0709 12:58:41.352711 (+   568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:41.353175 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:41.353497 (+   322us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:41.353577 (+    80us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:41.353617 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.353677 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:41.353804 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.355638  1608 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:58:41.375947  5389 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:41.221288  1505 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:51512 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1496)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1513)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1508)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1518)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1526)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1524)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1490)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1530)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1502)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1489)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1514)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1522)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1516)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1507)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2347)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2348)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2349)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2353)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2354)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2356)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2357)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 303)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2360)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2361)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2362)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1486)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1487)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1492)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1494)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 304)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 305)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1511)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1521)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1525)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2363)
I20260709 12:58:41.394091  5389 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:41.394585  5389 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:41.394994  5389 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:41.395215  1505 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:51512 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1505)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1496)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1513)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1508)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1518)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1526)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1524)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1490)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1530)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1502)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1489)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1514)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1522)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1516)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1507)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2347)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2348)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2349)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2353)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2354)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2356)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2357)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 303)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2360)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2361)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2362)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1486)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1487)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1492)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1494)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 304)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 305)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1511)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1521)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1525)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2363)
I20260709 12:58:41.263268  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:41.399695  1682 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 12:58:41.404848  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 1980) took 1147 ms. Trace:
I20260709 12:58:41.408674  1682 rpcz_store.cc:276] 0709 12:58:40.257018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.262762 (+1005744us) service_pool.cc:224] Handling call
0709 12:58:41.404775 (+142013us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.410238  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:41.400938  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2397) took 2170 ms. Trace:
I20260709 12:58:41.412839  1688 rpcz_store.cc:276] 0709 12:58:39.230533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.393230 (+2162697us) service_pool.cc:224] Handling call
0709 12:58:41.393711 (+   481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:41.400505 (+  6794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:41.400540 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:41.400616 (+    76us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:41.400662 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.400727 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:41.400851 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.414513  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:41.413749  1505 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:51512 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1518)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1526)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1524)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1490)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1538)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1530)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1502)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1489)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1514)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1534)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1522)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1516)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1507)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2347)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2348)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2349)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2353)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2354)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2356)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2357)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 303)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2360)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2361)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2362)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1486)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1487)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1492)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1494)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 304)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 305)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1511)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1521)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1525)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2363)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 306)
I20260709 12:58:41.415735  1682 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:58:41.421779  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:41.431716  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:41.392552  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 271) took 2280 ms. Trace:
I20260709 12:58:41.444753  1684 rpcz_store.cc:276] 0709 12:58:39.112409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.390917 (+2278508us) service_pool.cc:224] Handling call
0709 12:58:41.391529 (+   612us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:41.392016 (+   487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:41.392042 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:41.392202 (+   160us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:41.392250 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.392320 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:41.392451 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.419165  1505 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:51512 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1518)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1526)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1524)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1490)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1538)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1530)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1502)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1489)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1514)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1534)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1522)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1516)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1507)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2347)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2348)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2349)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2353)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2354)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2356)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2357)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 303)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2360)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2361)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2362)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1486)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1487)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1492)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1494)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 304)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 305)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1511)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1521)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1525)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2363)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 306)
I20260709 12:58:41.441064  5389 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:41.417711  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:41.457739  1689 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
I20260709 12:58:41.462421  1682 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:58:41.464162  1691 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.007s	sys 0.010s
W20260709 12:58:41.487358  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 164031us
I20260709 12:58:41.489279  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 1975) took 1211 ms. Trace:
I20260709 12:58:41.493085  1689 rpcz_store.cc:276] 0709 12:58:40.255664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.111457 (+855793us) service_pool.cc:224] Handling call
0709 12:58:41.464029 (+352572us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:41.496280  1691 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.008s	sys 0.010s
W20260709 12:58:41.499843  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 199819us
I20260709 12:58:41.502197  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:41.505728  5670 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:58:41.501318  1505 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:51512 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1518)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1526)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1524)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1490)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1538)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1530)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1502)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1489)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1514)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1534)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1522)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1516)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1507)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2347)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2348)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2349)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2353)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2354)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2356)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2357)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 303)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2360)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2361)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2362)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1486)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1487)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1492)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1494)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 304)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 305)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1511)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1521)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1525)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2363)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 306)
I20260709 12:58:41.510010  5544 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:41.508118  1505 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:51512 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1518)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1526)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1524)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1490)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1538)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1530)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1502)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1489)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1514)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1534)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1522)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1516)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1507)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2347)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2348)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2349)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2353)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2354)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2356)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2357)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 303)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2360)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2361)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2362)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1486)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1487)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1492)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1494)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 304)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 305)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1511)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1521)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1525)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2363)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 306)
I20260709 12:58:41.513641  5652 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:41.518216  5733 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:41.519168  5733 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:41.520008  5713 consensus_queue.cc:1048] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:41.521196  5732 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:41.523909  5725 raft_consensus.cc:2764] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:58:41.510838  5544 raft_consensus.cc:697] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:41.525403  1684 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:41.531301  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:41.532438  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 1987) took 1273 ms. Trace:
I20260709 12:58:41.533181  1688 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:58:41.527493  1539 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.010s	sys 0.002s
I20260709 12:58:41.518266  5652 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.527540  5737 raft_consensus.cc:2764] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:58:41.534587  1685 rpcz_store.cc:276] 0709 12:58:40.258879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:40.278661 (+ 19782us) service_pool.cc:224] Handling call
0709 12:58:41.530988 (+1252327us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b5800190898. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ceee 0000000000375939 00007fc861fa01e0 00007fc8620690c4 00007fc862069131 00007fc8620170a0 00007fc862016984 00007fc85b5916d4 00007fc85b591662
0709 12:58:41.532355 (+  1367us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31115520}
I20260709 12:58:41.536528  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2401) took 2303 ms. Trace:
I20260709 12:58:41.531100  5389 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:41.539556  1688 rpcz_store.cc:276] 0709 12:58:39.231538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.500598 (+2269060us) service_pool.cc:224] Handling call
0709 12:58:41.525192 (+ 24594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:41.534270 (+  9078us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.534466 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.543035  1688 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 12:58:41.540694  5682 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:41.532421  5596 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:58:41.537238  1539 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.010s	sys 0.003s
I20260709 12:58:41.538445  5652 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:41.543771  2266 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.001s	sys 0.010s
I20260709 12:58:41.545025  5682 raft_consensus.cc:697] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:41.534893  5732 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:41.549398  1682 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:58:41.536216  5729 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:41.541638  1505 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:51512 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1515)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1518)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1526)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1512)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1524)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1490)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1538)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1530)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1502)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1489)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1509)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1514)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1534)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1522)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1516)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1507)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2347)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2348)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2349)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2353)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2354)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2356)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2357)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 303)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2360)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2361)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2362)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1486)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1487)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1492)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1494)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1497)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 304)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 305)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1511)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1521)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1525)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2363)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 306)
W20260709 12:58:41.540870  1690 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.000s	sys 0.011s
W20260709 12:58:41.557376  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 282493us
I20260709 12:58:41.557776  5544 consensus_queue.cc:237] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:41.545095  5596 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:58:41.562469  1583 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:41.563848  1684 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:58:41.564605  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:41.556440  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 602528us
W20260709 12:58:41.565699  1541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2346) took 1996 ms (client timeout 2072 ms). Trace:
W20260709 12:58:41.564909  1690 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.000s	sys 0.012s
W20260709 12:58:41.566841  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 44560.8us
W20260709 12:58:41.566087  1541 rpcz_store.cc:269] 0709 12:58:39.569420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.524168 (+1954748us) service_pool.cc:224] Handling call
0709 12:58:41.565617 (+ 41449us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.564528  5732 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:41.570657  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.571684  1541 raft_consensus.cc:2368] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13.
I20260709 12:58:41.574895  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.575457  1685 raft_consensus.cc:1275] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:58:41.554756  5729 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:41.576597  5735 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
W20260709 12:58:41.589468  5705 log.cc:927] Time spent T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 1.627s	user 0.018s	sys 0.045s
I20260709 12:58:41.591545  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.592525  1541 raft_consensus.cc:2410] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:58:41.593331  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.593374  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 302) took 2353 ms. Trace:
I20260709 12:58:41.594301  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.585860  1682 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:58:41.593827  1539 rpcz_store.cc:276] 0709 12:58:39.239689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.476804 (+237115us) service_pool.cc:224] Handling call
0709 12:58:39.489264 (+ 12460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:39.489447 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:58:39.817045 (+327598us) log.cc:844] Serialized 14 byte log entry
0709 12:58:41.592879 (+1775834us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:41.592985 (+   106us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:41.593030 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.593131 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:41.593287 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":183349,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":222610,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"thread_start_us":2060645,"threads_started":3,"wal-append.queue_time_us":1286519}
W20260709 12:58:41.596688  1581 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.006s	sys 0.029s
I20260709 12:58:41.586041  5729 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:41.605100  1541 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:41.550932  5682 consensus_queue.cc:237] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:41.609831  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 47527us
I20260709 12:58:41.610782  1508 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:41.566390  5432 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:58:41.618964  5414 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:41.619724  5713 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:41.622044  5638 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:41.622593  5735 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:41.625231  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2384) took 3075 ms. Trace:
I20260709 12:58:41.634990  5521 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:41.631990  5713 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.636721  5685 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:41.637360  5713 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:41.637646  5435 raft_consensus.cc:3055] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:58:41.638085  5435 raft_consensus.cc:740] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:41.639271  5435 consensus_queue.cc:260] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:41.641362  5715 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.641858  5715 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:41.645982  1583 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:41.647715  5432 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:58:41.647617  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.648352  5432 raft_consensus.cc:697] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:41.649117  5435 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:41.649605  5432 consensus_queue.cc:237] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:41.652209  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:58:41.646911  5599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.008s	sys 0.005s
I20260709 12:58:41.653059  1540 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:41.653505  5599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.009s	sys 0.006s
I20260709 12:58:41.654182  1615 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:58:41.657925  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:41.658461  5638 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:41.659643  1581 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:41.661501  5638 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:41.632884  1690 rpcz_store.cc:276] 0709 12:58:38.549568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:40.255359 (+1705791us) service_pool.cc:224] Handling call
0709 12:58:40.255653 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:40.255863 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:40.943422 (+687559us) log.cc:844] Serialized 14 byte log entry
0709 12:58:41.607487 (+664065us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:41.624754 (+ 17267us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:41.624827 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.624922 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:41.625149 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":854774,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":16367,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":4823,"thread_start_us":1291791,"threads_started":2,"wal-append.queue_time_us":582936}
I20260709 12:58:41.669857  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:41.670671  1610 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:58:41.670972  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.670660  5414 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:41.672173  5735 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:41.674721  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:41.675143  5735 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:41.675668  1536 raft_consensus.cc:2393] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 11: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 12:58:41.676141  1536 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1496) took 1911 ms (client timeout 2359 ms). Trace:
I20260709 12:58:41.677449  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.677779  1581 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:41.678223  1542 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 14.
I20260709 12:58:41.678655  5735 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:41.679996  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.680178  5732 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.680675  1537 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:58:41.680856  5732 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:41.681993  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:41.682813  1533 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1510) took 1351 ms (client timeout 1544 ms). Trace:
I20260709 12:58:41.683182  5732 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:41.684859  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.685702  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1512) took 1291 ms. Trace:
I20260709 12:58:41.686021  1541 rpcz_store.cc:276] 0709 12:58:40.393990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.609519 (+1215529us) service_pool.cc:224] Handling call
0709 12:58:41.685620 (+ 76101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.672274  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.686708  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1559) took 2018 ms. Trace:
I20260709 12:58:41.687690  1534 raft_consensus.cc:2393] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 10: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:41.687975  5733 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:41.688172  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1508) took 1690 ms. Trace:
I20260709 12:58:41.688573  1534 rpcz_store.cc:276] 0709 12:58:39.997883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.671916 (+1674033us) service_pool.cc:224] Handling call
0709 12:58:41.688108 (+ 16192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.689538  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:41.689965  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 107182us
I20260709 12:58:41.690404  1534 raft_consensus.cc:2410] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:58:41.690197  5737 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:41.690797  5737 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:41.691205  5737 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:41.691875  1508 leader_election.cc:400] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 16. Current term is 17.
I20260709 12:58:41.692212  1508 leader_election.cc:403] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:58:41.678709  1542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1488) took 1916 ms (client timeout 2124 ms). Trace:
I20260709 12:58:41.687068  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:41.695393  1536 rpcz_store.cc:269] 0709 12:58:39.764244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.674389 (+1910145us) service_pool.cc:224] Handling call
0709 12:58:41.676076 (+  1687us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.671772  1539 raft_consensus.cc:2468] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
W20260709 12:58:41.694489  1542 rpcz_store.cc:269] 0709 12:58:39.762181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.677000 (+1914819us) service_pool.cc:224] Handling call
0709 12:58:41.678655 (+  1655us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.687408  1613 rpcz_store.cc:276] 0709 12:58:39.668800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.723992 (+ 55192us) service_pool.cc:224] Handling call
0709 12:58:39.734644 (+ 10652us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:41.261190 (+1526546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.686396 (+425206us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54002a62d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:41.686647 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3507632000}
W20260709 12:58:41.683151  1533 rpcz_store.cc:269] 0709 12:58:40.331553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.681485 (+1349932us) service_pool.cc:224] Handling call
0709 12:58:41.682756 (+  1271us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:41.694021  1537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1503) took 1797 ms (client timeout 2004 ms). Trace:
I20260709 12:58:41.716888  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2390) took 2979 ms. Trace:
I20260709 12:58:41.717906  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 272) took 1950 ms. Trace:
W20260709 12:58:41.647578  5374 consensus_meta.cc:287] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 1.306s	user 0.010s	sys 0.006s
W20260709 12:58:41.719293  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 153286us
W20260709 12:58:41.718881  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 213731us
I20260709 12:58:41.734722  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1490) took 1958 ms. Trace:
I20260709 12:58:41.735199  1534 rpcz_store.cc:276] 0709 12:58:39.762699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.689213 (+1926514us) service_pool.cc:224] Handling call
0709 12:58:41.720764 (+ 31551us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:41.710247  1537 rpcz_store.cc:269] 0709 12:58:39.897053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.679560 (+1782507us) service_pool.cc:224] Handling call
0709 12:58:41.693955 (+ 14395us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.718613  1689 rpcz_store.cc:276] 0709 12:58:39.767807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.505247 (+1737440us) service_pool.cc:224] Handling call
0709 12:58:41.523200 (+ 17953us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:41.537687 (+ 14487us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:58:41.582037 (+ 44350us) log.cc:844] Serialized 14 byte log entry
0709 12:58:41.717514 (+135477us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:41.717563 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:58:41.717613 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.717678 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:41.717812 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31252,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"thread_start_us":112164,"threads_started":1,"wal-append.queue_time_us":109848}
I20260709 12:58:41.717511  1687 rpcz_store.cc:276] 0709 12:58:38.737095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.302223 (+2565128us) service_pool.cc:224] Handling call
0709 12:58:41.302839 (+   616us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:41.465365 (+162526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:41.465400 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:41.468191 (+  2791us) log.cc:844] Serialized 26 byte log entry
0709 12:58:41.714737 (+246546us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:41.714785 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.714859 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:41.716585 (+  1726us) raft_consensus.cc:1685] finished
0709 12:58:41.716603 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:41.716780 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":259682,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":137,"thread_start_us":407674,"threads_started":2,"wal-append.queue_time_us":246486}
I20260709 12:58:41.739781  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.740983  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.738066  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.743664  1542 raft_consensus.cc:2368] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13.
W20260709 12:58:41.746076  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 100249us
I20260709 12:58:41.749120  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.664301  5715 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:41.754333  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.754370  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.758487  1541 raft_consensus.cc:2393] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 11: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:41.759217  5738 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 16. Current term is 17.
I20260709 12:58:41.760058  5384 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:41.760661  5384 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:41.761744  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:58:41.765740  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 88082.4us
I20260709 12:58:41.766183  1536 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:41.766323  5715 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:41.761780  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:41.767896  1616 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:41.774412  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.775465  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.762287  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.766677  1581 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:41.777006  1535 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
W20260709 12:58:41.777611  1535 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1505) took 1878 ms (client timeout 2136 ms). Trace:
W20260709 12:58:41.777959  1535 rpcz_store.cc:269] 0709 12:58:39.898763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.774057 (+1875294us) service_pool.cc:224] Handling call
0709 12:58:41.777517 (+  3460us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.778939  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.780580  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1961) took 3584 ms. Trace:
I20260709 12:58:41.780184  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.763142  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1502) took 1900 ms. Trace:
I20260709 12:58:41.766396  1617 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:41.782546  1534 rpcz_store.cc:276] 0709 12:58:39.863045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.735896 (+1872851us) service_pool.cc:224] Handling call
0709 12:58:41.763075 (+ 27179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.782074  1535 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:41.788836  1508 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:41.789361  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:41.789945  1508 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:41.791054  1508 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:41.791889  5725 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:41.792302  5725 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:41.792678  5725 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:41.796780  5389 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:41.797348  5389 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:41.800251  1540 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:41.797919  1533 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
W20260709 12:58:41.804970  1540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2359) took 2083 ms (client timeout 2357 ms). Trace:
W20260709 12:58:41.805341  1540 rpcz_store.cc:269] 0709 12:58:39.717632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.651856 (+1934224us) service_pool.cc:224] Handling call
0709 12:58:41.800830 (+148974us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.804597  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 1963) took 3524 ms. Trace:
I20260709 12:58:41.806015  1542 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:58:41.806602  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1514) took 1373 ms. Trace:
I20260709 12:58:41.806981  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:41.801357  1609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 1575) took 2060 ms (client timeout 2004 ms). Trace:
I20260709 12:58:41.807466  1542 rpcz_store.cc:276] 0709 12:58:40.433303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.748665 (+1315362us) service_pool.cc:224] Handling call
0709 12:58:41.806548 (+ 57883us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:41.808177  1609 rpcz_store.cc:269] 0709 12:58:39.737485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.789362 (+ 51877us) service_pool.cc:224] Handling call
0709 12:58:41.797451 (+2008089us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54002ff154. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:41.797640 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2795841280}
I20260709 12:58:41.808777  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.809617  1542 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 4.
I20260709 12:58:41.801757  5389 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:41.810413  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.811399  1535 raft_consensus.cc:2368] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 9. Current term is 10.
I20260709 12:58:41.803632  5374 consensus_queue.cc:1048] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:58:41.810542  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.812631  1438 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet d5d52e25b9814edbb805e7d6bcce5b5d with cas_config_opid_index 6: aborting the task: latest config opid_index 8; task opid_index 6
I20260709 12:58:41.812870  1542 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:41.813948  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.815030  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:41.815563  1542 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:41.810738  5652 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:41.806427  1691 rpcz_store.cc:276] 0709 12:58:38.276115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.963109 (+1686994us) service_pool.cc:224] Handling call
0709 12:58:40.256319 (+293210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:40.256529 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:40.941261 (+684732us) log.cc:844] Serialized 14 byte log entry
0709 12:58:41.754962 (+813701us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:41.781182 (+ 26220us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:41.781235 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.799897 (+ 18662us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:41.800014 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24352,"prepare.queue_time_us":856606,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":64020,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":1449235,"threads_started":3,"wal-append.queue_time_us":591890}
I20260709 12:58:41.817435  5735 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:41.818593  5652 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:41.819453  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:41.820271  1540 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:41.820997  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 1587) took 1029 ms. Trace:
I20260709 12:58:41.821156  5738 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:41.812276  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.824151  1535 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:58:41.824767  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.788859  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:41.827725  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:41.828732  1581 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:41.830188  5745 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:41.830857  5599 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:41.831755  5599 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:41.830873  5745 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:41.835673  5435 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:58:41.836094  5435 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:41.836186  5745 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:41.837468  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:41.839920  1537 raft_consensus.cc:2410] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:58:41.825174  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:41.844061  1535 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:41.844585  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.821432  1614 rpcz_store.cc:276] 0709 12:58:40.791382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.019799 (+228417us) service_pool.cc:224] Handling call
0709 12:58:41.820807 (+801008us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54001f77d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:41.820940 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":425065344}
I20260709 12:58:41.846393  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:41.847302  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1489) took 2084 ms. Trace:
I20260709 12:58:41.847719  1537 rpcz_store.cc:276] 0709 12:58:39.762432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.747662 (+1985230us) service_pool.cc:224] Handling call
0709 12:58:41.847243 (+ 99581us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.781006  1683 rpcz_store.cc:276] 0709 12:58:38.162584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:39.939361 (+1776777us) service_pool.cc:224] Handling call
0709 12:58:39.964362 (+ 25001us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:39.964635 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:58:41.104294 (+1139659us) log.cc:844] Serialized 14 byte log entry
0709 12:58:41.717058 (+612764us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:41.717152 (+    94us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:41.717204 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.733486 (+ 16282us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:41.746592 (+ 13106us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1130923,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":2117,"raft.queue_time_us":43222,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":142,"thread_start_us":1674022,"threads_started":3,"wal-append.queue_time_us":413676}
I20260709 12:58:41.854753  1539 raft_consensus.cc:2393] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 12: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:41.855298  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1509) took 1750 ms. Trace:
I20260709 12:58:41.855629  1539 rpcz_store.cc:276] 0709 12:58:40.105387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.744943 (+1639556us) service_pool.cc:224] Handling call
0709 12:58:41.855234 (+110291us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.852236  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1522) took 1057 ms. Trace:
I20260709 12:58:41.857734  1534 rpcz_store.cc:276] 0709 12:58:40.794766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.844291 (+1049525us) service_pool.cc:224] Handling call
0709 12:58:41.852170 (+  7879us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.859948  5738 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:41.862772  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:41.840636  5435 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:41.867509  1540 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:41.863893  1541 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:41.867684  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 269) took 3069 ms. Trace:
I20260709 12:58:41.869854  1537 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:41.827752  5747 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:41.870002  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:58:41.869015  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 60960.6us
I20260709 12:58:41.860420  5738 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:41.874071  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:41.882622  1537 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:58:41.883518  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:41.885986  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1519) took 1092 ms. Trace:
I20260709 12:58:41.887817  1682 raft_consensus.cc:3055] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:58:41.888285  1682 raft_consensus.cc:740] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:41.886941  1533 rpcz_store.cc:276] 0709 12:58:40.793915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.711074 (+917159us) service_pool.cc:224] Handling call
0709 12:58:41.885801 (+174727us) spinlock_profiling.cc:243] Waited 5.51 ms on lock 0x7b540010ccd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:41.885921 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12673792}
I20260709 12:58:41.890733  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.875051  1686 rpcz_store.cc:276] 0709 12:58:38.793324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.311830 (+2518506us) service_pool.cc:224] Handling call
0709 12:58:41.337959 (+ 26129us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:41.495536 (+157577us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:41.495591 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:41.514284 (+ 18693us) log.cc:844] Serialized 26 byte log entry
0709 12:58:41.744998 (+230714us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:58:41.745036 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.745095 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:41.862315 (+117220us) raft_consensus.cc:1685] finished
0709 12:58:41.862334 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:41.862470 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":226416,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":159,"thread_start_us":364952,"threads_started":2,"wal-append.queue_time_us":315555}
I20260709 12:58:41.887818  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.892732  1582 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:41.894917  1438 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54582 (request call id 151) took 31935 ms (client timeout 15000 ms). Trace:
I20260709 12:58:41.895684  5384 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:41.897487  5729 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:41.899791  5729 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:41.900668  1538 raft_consensus.cc:2393] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 10: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:41.900889  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.901645  1540 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:41.902772  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.905237  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2349) took 2333 ms. Trace:
W20260709 12:58:41.905366  1655 leader_election.cc:336] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.016s (SENT)
I20260709 12:58:41.908252  2266 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:41.905557  1540 rpcz_store.cc:276] 0709 12:58:39.571357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.903732 (+2332375us) service_pool.cc:224] Handling call
0709 12:58:41.904110 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:41.904324 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:41.904349 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:41.904389 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:41.904427 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.905058 (+   631us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:41.905165 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.909000  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:41.909503  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:58:41.909813  1538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1513) took 1504 ms (client timeout 1883 ms). Trace:
I20260709 12:58:41.909969  5747 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:41.910249  1538 rpcz_store.cc:269] 0709 12:58:40.406551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.647134 (+1240583us) service_pool.cc:224] Handling call
0709 12:58:41.909608 (+262474us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b54003f98d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:41.909739 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":579578240}
I20260709 12:58:41.911005  1540 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:41.908635  1534 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:41.913867  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1507) took 1973 ms. Trace:
I20260709 12:58:41.909713  1688 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
I20260709 12:58:41.914463  1534 rpcz_store.cc:276] 0709 12:58:39.940995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.866067 (+1925072us) service_pool.cc:224] Handling call
0709 12:58:41.913802 (+ 47735us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.912135  1683 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:41.920019  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:41.920790  1689 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:41.924531  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2347) took 2350 ms. Trace:
I20260709 12:58:41.924971  1537 rpcz_store.cc:276] 0709 12:58:39.570105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.892108 (+2322003us) service_pool.cc:224] Handling call
0709 12:58:41.919974 (+ 27866us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:41.920165 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:41.920188 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:41.920233 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:41.920271 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.920322 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:41.920438 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.928958  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.929200  5737 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:41.864603  5713 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:41.925007  1508 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:41.913815  1539 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:41.920020  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:41.938457  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1516) took 1145 ms. Trace:
W20260709 12:58:41.925097  1655 leader_election.cc:336] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:51512 dropped due to backpressure: service queue is full with 50 items
I20260709 12:58:41.938731  1538 raft_consensus.cc:2393] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 10: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:41.863406  5725 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:41.931293  1535 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:41.932464  1541 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:41.933960  1542 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 12:58:41.936816  1689 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:58:41.938881  1539 rpcz_store.cc:276] 0709 12:58:40.793083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.856283 (+1063200us) service_pool.cc:224] Handling call
0709 12:58:41.938386 (+ 82103us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:41.943451  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 51416.3us
I20260709 12:58:41.944816  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:41.886904  5389 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:41.946661  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:41.945815  5750 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:58:41.951982  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:41.952301  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 124042us
I20260709 12:58:41.940510  1682 consensus_queue.cc:260] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:41.953106  5690 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
W20260709 12:58:41.895368  1438 rpcz_store.cc:269] 0709 12:58:09.959135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:09.960649 (+  1514us) service_pool.cc:224] Handling call
0709 12:58:10.044957 (+ 84308us) spinlock_profiling.cc:243] Waited 63 ms on lock 0x7b54001b99d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfbb090 00007fc85d059f3a 00007fc862e101cc 00007fc862f0e37e 00007fc8613cf2a4 00007fc8613cf232 00007fc8613cf161 00007fc8613cf0dc 00007fc8613ce392 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:41.894766 (+31849809us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:32.884248 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:32.924728 (+ 40480us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:32.924782 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:58:32.924801 (+    19us) tablet.cc:662] Decoding operations
0709 12:58:32.930597 (+  5796us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:32.930685 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:32.930712 (+    27us) tablet.cc:685] Acquiring locks for 22 operations
0709 12:58:32.979493 (+ 48781us) tablet.cc:701] Row locks acquired
0709 12:58:32.979550 (+    57us) write_op.cc:260] PREPARE: finished
0709 12:58:32.979757 (+   207us) write_op.cc:270] Start()
0709 12:58:32.979947 (+   190us) write_op.cc:276] Timestamp: P: 1783601912979685 usec, L: 0
0709 12:58:32.979969 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:58:33.035213 (+ 55244us) log.cc:844] Serialized 8685 byte log entry
0709 12:58:33.530749 (+495536us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc859f470ac 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b
0709 12:58:34.268946 (+738197us) op_driver.cc:464] REPLICATION: finished
0709 12:58:34.477344 (+208398us) write_op.cc:301] APPLY: starting
0709 12:58:34.477437 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:34.477827 (+   390us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:34.477874 (+    47us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:34.497407 (+ 19533us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:34.497818 (+   411us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0709 12:58:34.497863 (+    45us) write_op.cc:312] APPLY: finished
0709 12:58:34.498334 (+   471us) log.cc:844] Serialized 151 byte log entry
0709 12:58:34.498523 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:34.498713 (+   190us) write_op.cc:454] Released schema lock
0709 12:58:34.498784 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:34.499212 (+   428us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:34.499240 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":85991,"reported_tablets":48,"spinlock_wait_cycles":144868992,"child_traces":[["op",{"apply.queue_time_us":187895,"apply.run_cpu_time_us":5060,"apply.run_wall_time_us":24313,"num_ops":22,"prepare.queue_time_us":699521,"prepare.run_cpu_time_us":36159,"prepare.run_wall_time_us":790408,"raft.queue_time_us":368363,"raft.run_cpu_time_us":17808,"raft.run_wall_time_us":213413,"replication_time_us":1267169,"spinlock_wait_cycles":51995904,"thread_start_us":841121,"threads_started":4,"wal-append.queue_time_us":577570,"wal-append.run_cpu_time_us":27545,"wal-append.run_wall_time_us":1891651}]]}
I20260709 12:58:41.957207  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2348) took 2386 ms. Trace:
I20260709 12:58:41.957633  5725 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:41.957893  5729 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:41.967001  1533 rpcz_store.cc:276] 0709 12:58:39.570763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.892368 (+2321605us) service_pool.cc:224] Handling call
0709 12:58:41.946749 (+ 54381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:41.956830 (+ 10081us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:41.956863 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:41.956904 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:41.956941 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:41.957000 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:41.957121 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4352}
I20260709 12:58:41.958791  5737 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:41.962018  1540 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:58:41.941171  5652 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:41.974517  1682 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:41.975548  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:41.960311  1655 leader_election.cc:336] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:51512 dropped due to backpressure: service queue is full with 50 items
W20260709 12:58:41.978168  1655 leader_election.cc:336] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:51512 dropped due to backpressure: service queue is full with 50 items
W20260709 12:58:41.978832  1655 leader_election.cc:336] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:51512 dropped due to backpressure: service queue is full with 50 items
I20260709 12:58:41.981943  1535 raft_consensus.cc:2410] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 12:58:41.993211  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:41.957927  5747 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:41.965257  5713 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:42.001076  1682 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 12:58:42.001473  1682 pending_rounds.cc:85] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 7
I20260709 12:58:41.988547  5729 raft_consensus.cc:697] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:42.002494  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:41.999641  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 48286us
I20260709 12:58:42.010150  1536 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 12:58:42.012063  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:42.021322  2300 raft_consensus.cc:2393] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 12: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:58:42.021091  5729 consensus_queue.cc:237] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:42.070987  1689 raft_consensus.cc:2393] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 12: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:42.018877  1682 pending_rounds.cc:107] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:58:42.071483  1682 raft_consensus.cc:2889] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:42.073441  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 303) took 2489 ms. Trace:
I20260709 12:58:42.073930  1536 rpcz_store.cc:276] 0709 12:58:39.583922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.024604 (+2440682us) service_pool.cc:224] Handling call
0709 12:58:42.071128 (+ 46524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:42.072907 (+  1779us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:42.072941 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:42.072985 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:42.073024 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.073095 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:42.073367 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:42.075246  1542 raft_consensus.cc:1240] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:58:42.075969  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2357) took 2493 ms. Trace:
I20260709 12:58:42.076283  1542 rpcz_store.cc:276] 0709 12:58:39.582598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.013156 (+2430558us) service_pool.cc:224] Handling call
0709 12:58:42.071721 (+ 58565us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:42.075678 (+  3957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.075904 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:41.971612  5435 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:42.083547  1540 raft_consensus.cc:1240] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:42.084034  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:42.084250  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2362) took 2365 ms. Trace:
I20260709 12:58:42.084757  1540 rpcz_store.cc:276] 0709 12:58:39.718488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.082977 (+2364489us) service_pool.cc:224] Handling call
0709 12:58:42.083363 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:42.083992 (+   629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.084198 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:42.102415  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:42.101972  1685 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:58:42.083540  1581 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:42.103091  1682 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 9.
W20260709 12:58:42.105803  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:42.117956  5761 log.cc:927] Time spent T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:58:42.119867  1534 raft_consensus.cc:1240] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:58:42.120693  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2361) took 2402 ms. Trace:
I20260709 12:58:42.121058  1534 rpcz_store.cc:276] 0709 12:58:39.718193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.081218 (+2363025us) service_pool.cc:224] Handling call
0709 12:58:42.119623 (+ 38405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:42.120376 (+   753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.120632 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:42.122530  1536 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:42.123275  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1485) took 2362 ms. Trace:
I20260709 12:58:42.123615  1536 rpcz_store.cc:276] 0709 12:58:39.761346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.103571 (+2342225us) service_pool.cc:224] Handling call
0709 12:58:42.122339 (+ 18768us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:42.123008 (+   669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.123216 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:42.129714  5747 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:58:42.143118  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2360) took 2425 ms. Trace:
I20260709 12:58:42.143606  1542 rpcz_store.cc:276] 0709 12:58:39.717921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.077002 (+2359081us) service_pool.cc:224] Handling call
0709 12:58:42.104587 (+ 27585us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:42.130400 (+ 25813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:42.130471 (+    71us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:42.130569 (+    98us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:42.142866 (+ 12297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.142931 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:42.143055 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:42.159304  1540 raft_consensus.cc:1240] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:42.160138  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1487) took 2398 ms. Trace:
I20260709 12:58:42.160507  1540 rpcz_store.cc:276] 0709 12:58:39.761926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.128296 (+2366370us) service_pool.cc:224] Handling call
0709 12:58:42.159086 (+ 30790us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:42.159843 (+   757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.160072 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:42.190898  5685 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:58:42.191197  5760 log.cc:927] Time spent T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:58:42.196655  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1494) took 2433 ms. Trace:
I20260709 12:58:42.198395  1536 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:58:42.200997  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1486) took 2439 ms. Trace:
I20260709 12:58:42.201375  1536 rpcz_store.cc:276] 0709 12:58:39.761638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.131494 (+2369856us) service_pool.cc:224] Handling call
0709 12:58:42.198144 (+ 66650us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:42.200680 (+  2536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.200923 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:42.230211  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 52038.2us
W20260709 12:58:42.228922  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 259460us
I20260709 12:58:42.226188  1540 rpcz_store.cc:276] 0709 12:58:39.763721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.172047 (+2408326us) service_pool.cc:224] Handling call
0709 12:58:42.190581 (+ 18534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:42.190839 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:42.190867 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:42.190914 (+    47us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:58:42.190964 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.191019 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:42.196576 (+  5557us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:42.236876  5685 raft_consensus.cc:697] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:42.238132  5685 consensus_queue.cc:237] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:42.232420  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2354) took 2624 ms. Trace:
I20260709 12:58:42.249967  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:42.255079  1684 raft_consensus.cc:2393] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 10: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:42.252974  1534 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 14. Current term is 15. Ops: []
I20260709 12:58:42.256274  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1492) took 2493 ms. Trace:
I20260709 12:58:42.256665  1534 rpcz_store.cc:276] 0709 12:58:39.763182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.144732 (+2381550us) service_pool.cc:224] Handling call
0709 12:58:42.234644 (+ 89912us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:42.256017 (+ 21373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.256219 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:42.241391  1538 rpcz_store.cc:276] 0709 12:58:39.579902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.947882 (+2367980us) service_pool.cc:224] Handling call
0709 12:58:41.980824 (+ 32942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:41.981079 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:42.138911 (+157832us) log.cc:844] Serialized 14 byte log entry
0709 12:58:42.203671 (+ 64760us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:42.203732 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:42.203774 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.203836 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:42.203956 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11429,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":7098,"thread_start_us":210342,"threads_started":2}
W20260709 12:58:42.240242  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 102524us
I20260709 12:58:42.263304  1542 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:42.264133  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1497) took 2499 ms. Trace:
I20260709 12:58:42.264545  1542 rpcz_store.cc:276] 0709 12:58:39.765061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.177856 (+2412795us) service_pool.cc:224] Handling call
0709 12:58:42.263121 (+ 85265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:42.263833 (+   712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.264071 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:42.267551  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 191586us
I20260709 12:58:42.273994  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 304) took 2476 ms. Trace:
I20260709 12:58:42.274638  1536 rpcz_store.cc:276] 0709 12:58:39.797387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.202189 (+2404802us) service_pool.cc:224] Handling call
0709 12:58:42.202577 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:42.273402 (+ 70825us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:42.273459 (+    57us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:42.273543 (+    84us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:42.273607 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.273724 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:42.273883 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:42.281917  1538 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 14. Current term is 15. Ops: [14.7-14.7]
W20260709 12:58:42.243954  1505 connection.cc:256] RPC call timeout handler was delayed by -2.3815928679999843s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32480000000000003s for a response
W20260709 12:58:42.250777  5763 log.cc:927] Time spent T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:58:42.285444  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1521) took 1488 ms. Trace:
W20260709 12:58:42.263914  5760 log.cc:927] Time spent T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:58:42.288420  1538 rpcz_store.cc:276] 0709 12:58:40.794496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.281208 (+1486712us) service_pool.cc:224] Handling call
0709 12:58:42.281661 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:42.282735 (+  1074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.282953 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:42.242302  5389 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:42.290122  1534 raft_consensus.cc:1240] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:58:42.290783  1536 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 14. Current term is 15. Ops: []
I20260709 12:58:42.299541  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2363) took 1348 ms. Trace:
W20260709 12:58:42.289605  1505 connection.cc:256] RPC call timeout handler was delayed by -1.8998912060000066s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16490000000000002s for a response
I20260709 12:58:42.300098  1536 rpcz_store.cc:276] 0709 12:58:40.951567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.275725 (+1324158us) service_pool.cc:224] Handling call
0709 12:58:42.290466 (+ 14741us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:42.299225 (+  8759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.299459 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:42.300297  1505 connection.cc:256] RPC call timeout handler was delayed by -1.8710912060000169s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16810000000000003s for a response
W20260709 12:58:42.301592  1505 connection.cc:256] RPC call timeout handler was delayed by -1.835991206000017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17200000000000001s for a response
W20260709 12:58:42.302021  1505 connection.cc:256] RPC call timeout handler was delayed by -1.7306912060000172s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1837s for a response
W20260709 12:58:42.302505  1505 connection.cc:256] RPC call timeout handler was delayed by -1.5056912059999945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20870000000000002s for a response
W20260709 12:58:42.302817  1505 connection.cc:256] RPC call timeout handler was delayed by -1.4921912060000295s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2102s for a response
W20260709 12:58:42.303100  1505 connection.cc:256] RPC call timeout handler was delayed by -1.4516912060000209s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2147s for a response
W20260709 12:58:42.303376  1505 connection.cc:256] RPC call timeout handler was delayed by -1.4007385440000348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1779s for a response
W20260709 12:58:42.303663  1505 connection.cc:256] RPC call timeout handler was delayed by -1.3814912060000211s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22250000000000003s for a response
W20260709 12:58:42.303951  1505 connection.cc:256] RPC call timeout handler was delayed by -1.1658385439999961s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
I20260709 12:58:42.305058  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1511) took 1950 ms. Trace:
I20260709 12:58:42.305182  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:42.305511  1534 rpcz_store.cc:276] 0709 12:58:40.355513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.257469 (+1901956us) service_pool.cc:224] Handling call
0709 12:58:42.289860 (+ 32391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:42.304776 (+ 14916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.305001 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:42.307387  1540 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:58:42.308122  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 305) took 2510 ms. Trace:
I20260709 12:58:42.308497  1540 rpcz_store.cc:276] 0709 12:58:39.797830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.252684 (+2454854us) service_pool.cc:224] Handling call
0709 12:58:42.290466 (+ 37782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:42.307858 (+ 17392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.308060 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:42.315892  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 306) took 1087 ms. Trace:
I20260709 12:58:42.317850  1581 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:42.317760  1538 rpcz_store.cc:276] 0709 12:58:41.228208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.289681 (+1061473us) service_pool.cc:224] Handling call
0709 12:58:42.313347 (+ 23666us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:42.315525 (+  2178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:42.315564 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:42.315607 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:42.315637 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.315705 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:42.315825 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:42.318853  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:42.319497  1689 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:42.320048  1540 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:58:42.321550  1609 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 12:58:42.322434  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:42.323146  1684 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:42.321699  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:42.324657  1508 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:42.322026  1542 raft_consensus.cc:1240] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:42.327775  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:42.330679  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1525) took 1511 ms. Trace:
I20260709 12:58:42.331092  1542 rpcz_store.cc:276] 0709 12:58:40.819417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.282576 (+1463159us) service_pool.cc:224] Handling call
0709 12:58:42.321863 (+ 39287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:42.326140 (+  4277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.330620 (+  4480us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:42.332507  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:42.333127  1689 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:42.330150  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:42.337841  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:42.362269  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 56589.4us
I20260709 12:58:42.362798  1608 raft_consensus.cc:1240] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 10. Current term is 11. Ops: []
W20260709 12:58:42.364045  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:42.364578  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:42.365324  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:42.331367  5389 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:42.362169  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:42.367578  1508 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:42.362181  1538 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:58:42.367461  5768 log.cc:927] Time spent T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.126s	user 0.001s	sys 0.001s
W20260709 12:58:42.372786  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 48727.5us
I20260709 12:58:42.373277  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:42.374233  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:42.378500  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:42.382578  5752 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:58:42.370656  5389 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:42.396189  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:42.402109  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:42.399718  1609 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:42.404914  1581 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:42.382751  5527 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:42.382669  5742 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:58:42.417563  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:42.418521  1614 raft_consensus.cc:2393] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 16: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 12:58:42.419528  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 50353.9us
I20260709 12:58:42.420001  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:42.420411  1581 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:42.420864  1609 raft_consensus.cc:2393] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 15: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 12:58:42.421111  5766 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:58:42.421324  5544 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:58:42.421949  5544 raft_consensus.cc:697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:42.422930  5544 consensus_queue.cc:237] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
W20260709 12:58:42.425249  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:42.430091  5527 raft_consensus.cc:697] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:58:42.430365  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 46115.8us
I20260709 12:58:42.431522  1505 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:42.405809  5389 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:42.434945  1684 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:58:42.376150  5738 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:42.442181  5738 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:42.442538  5715 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:42.443027  5715 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:42.443146  5773 log.cc:927] Time spent T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.207s	user 0.000s	sys 0.004s
I20260709 12:58:42.443482  5715 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:42.443203  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2358) took 2725 ms. Trace:
I20260709 12:58:42.444939  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2355) took 2864 ms. Trace:
I20260709 12:58:42.445407  1533 rpcz_store.cc:276] 0709 12:58:39.580847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.991694 (+2410847us) service_pool.cc:224] Handling call
0709 12:58:41.992159 (+   465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:42.022480 (+ 30321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:42.022516 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:42.083269 (+ 60753us) log.cc:844] Serialized 26 byte log entry
0709 12:58:42.224393 (+141124us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:42.224446 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.224556 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:42.426678 (+202122us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:58:42.444654 (+ 17976us) raft_consensus.cc:1685] finished
0709 12:58:42.444673 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:42.444881 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4672,"raft.queue_time_us":19801,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":51518,"spinlock_wait_cycles":14320896,"thread_start_us":54655,"threads_started":1,"wal-append.queue_time_us":121764}
W20260709 12:58:42.444561  5767 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 12:58:42.442909  5435 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:42.452311  1541 rpcz_store.cc:276] 0709 12:58:39.717295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.077323 (+2360028us) service_pool.cc:224] Handling call
0709 12:58:42.077702 (+   379us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:42.102680 (+ 24978us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:42.102709 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:42.106451 (+  3742us) log.cc:844] Serialized 52 byte log entry
0709 12:58:42.360992 (+254541us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:58:42.361031 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.361097 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:42.442964 (+ 81867us) raft_consensus.cc:1685] finished
0709 12:58:42.442981 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:42.443122 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1348,"raft.queue_time_us":20752,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":2074,"thread_start_us":182535,"threads_started":1,"wal-append.queue_time_us":282239}
I20260709 12:58:42.442875  1617 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
I20260709 12:58:42.445441  1581 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:42.445012  1539 raft_consensus.cc:1240] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:58:42.458098  1508 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:58:42.458922  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 47860.9us
I20260709 12:58:42.460955  5384 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:42.461627  5384 raft_consensus.cc:697] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:42.442844  5738 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:58:42.461030  5772 log.cc:927] Time spent T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:58:42.472244  5384 consensus_queue.cc:237] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:42.528658  5770 log.cc:927] Time spent T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.113s	user 0.000s	sys 0.002s
I20260709 12:58:42.566069  5527 consensus_queue.cc:237] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:42.598657  5738 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:42.607072  5738 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:42.607503  5738 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:42.634814  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 203463us
I20260709 12:58:42.640815  1689 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:42.636340  1581 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:42.648082  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:42.649796  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:42.649899  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 189960us
I20260709 12:58:42.534477  5715 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:42.653100  1690 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.004s	sys 0.019s
W20260709 12:58:42.653649  1690 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.004s	sys 0.019s
I20260709 12:58:42.642638  5759 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:42.659868  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:42.662675  1609 raft_consensus.cc:2393] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 10: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:42.663421  1581 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:42.665691  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:42.670099  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2353) took 3093 ms. Trace:
I20260709 12:58:42.670600  1539 rpcz_store.cc:276] 0709 12:58:39.574019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.966128 (+2392109us) service_pool.cc:224] Handling call
0709 12:58:42.066419 (+100291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:42.456991 (+390572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.666980 (+209989us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b54001874d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:42.667137 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":870207360}
I20260709 12:58:42.672216  1505 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:42.672791  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:42.671525  1583 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:42.675688  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:42.679841  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:42.681957  1617 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
I20260709 12:58:42.682993  1615 raft_consensus.cc:2410] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:58:42.679360  5599 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:58:42.694700  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 302565us
I20260709 12:58:42.707391  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:42.708343  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:42.710479  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:42.683900  5713 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:42.711167  1617 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:42.720939  1615 raft_consensus.cc:2393] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 17: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:42.726766  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:42.728744  1583 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:42.731774  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 66907.7us
I20260709 12:58:42.722054  5599 raft_consensus.cc:697] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:42.733917  5599 consensus_queue.cc:237] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:42.713743  5713 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:42.735879  5713 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:42.744915  5747 consensus_queue.cc:1059] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:42.745930  5747 consensus_queue.cc:1243] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer c262eac7fc904ae9bb91e450f6532e3f log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:58:42.746112  5749 consensus_queue.cc:1059] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:42.746577  5747 consensus_queue.cc:1059] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:42.747191  5749 consensus_queue.cc:1059] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:42.747524  5747 raft_consensus.cc:3055] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:42.747917  5747 raft_consensus.cc:740] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:42.748979  5733 raft_consensus.cc:3055] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:58:42.749459  5733 raft_consensus.cc:740] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:42.751308  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:42.728348  5595 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:58:42.768308  1655 leader_election.cc:336] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.523s (SENT)
I20260709 12:58:42.792627  1581 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:42.792930  1505 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:42.714584  5389 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:42.801836  1655 leader_election.cc:336] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.544s (SENT)
I20260709 12:58:42.803201  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:42.761047  5732 raft_consensus.cc:3055] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:58:42.796057  5782 log.cc:927] Time spent T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:58:42.750025  5787 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:42.826848  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:42.828985  1617 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:58:42.827035  1654 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:42.764946  5685 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:58:42.832028  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 64930us
W20260709 12:58:42.836802  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 161972us
I20260709 12:58:42.838356  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:42.839344  1617 raft_consensus.cc:2410] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:58:42.770409  5729 consensus_queue.cc:1048] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:58:42.803771  5749 consensus_queue.cc:1243] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer c262eac7fc904ae9bb91e450f6532e3f log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 12:58:42.844635  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 76730us
I20260709 12:58:42.849427  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:42.851917  1617 raft_consensus.cc:2368] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 12.
I20260709 12:58:42.826815  5732 raft_consensus.cc:740] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:42.830160  5435 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:58:42.858827  1655 leader_election.cc:336] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.599s (SENT)
W20260709 12:58:42.863763  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 69332.4us
I20260709 12:58:42.755678  5733 consensus_queue.cc:260] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:42.887768  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:42.834738  5652 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:58:42.848675  5715 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:42.893340  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 59813.1us
I20260709 12:58:42.857843  5685 raft_consensus.cc:697] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:42.898337  1688 raft_consensus.cc:1275] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:58:42.900997  1505 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:42.890020  5787 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:42.827613  5747 consensus_queue.cc:260] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:42.865228  5749 consensus_queue.cc:1059] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:58:42.901345  5789 raft_consensus.cc:3055] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:42.916940  1654 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:42.905691  5595 raft_consensus.cc:697] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:42.930027  1582 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:42.933642  5749 raft_consensus.cc:3055] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:42.934154  5749 raft_consensus.cc:740] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:42.935060  5749 consensus_queue.cc:260] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:42.919790  5789 raft_consensus.cc:740] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:42.925076  5733 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:42.947835  5747 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:42.936388  5749 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:42.942178  5729 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:42.950758  5789 consensus_queue.cc:260] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:42.952124  5789 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:42.942484  1508 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:42.952798  5793 raft_consensus.cc:2764] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:58:42.953143  5787 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:42.953620  5787 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:58:42.953783  5784 log.cc:927] Time spent T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 12:58:42.954109  5787 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:42.956624  5685 consensus_queue.cc:237] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:42.958057  5781 log.cc:927] Time spent T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 12:58:42.913888  5435 consensus_queue.cc:1059] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:58:42.945778  1654 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:42.947506  5384 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:42.927201  5544 consensus_queue.cc:1059] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:58:42.959053  1685 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:58:42.953680  1508 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:58:42.943428  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 49849.1us
W20260709 12:58:42.983618  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 182383us
I20260709 12:58:42.940130  5790 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:42.984645  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2356) took 3402 ms. Trace:
I20260709 12:58:42.985343  1583 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:42.985064  1537 rpcz_store.cc:276] 0709 12:58:39.581908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:41.999264 (+2417356us) service_pool.cc:224] Handling call
0709 12:58:42.075145 (+ 75881us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:42.083807 (+  8662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:42.083833 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:42.103011 (+ 19178us) log.cc:844] Serialized 26 byte log entry
0709 12:58:42.630690 (+527679us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:42.630717 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.630768 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:42.984387 (+353619us) raft_consensus.cc:1685] finished
0709 12:58:42.984407 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:42.984579 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21823,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":10280,"thread_start_us":499490,"threads_started":1,"wal-append.queue_time_us":556018}
I20260709 12:58:42.987747  5793 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:58:42.988269  5793 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:42.988720  5785 log.cc:927] Time spent T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 12:58:42.988797  5793 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:58:42.925868  5792 consensus_queue.cc:1059] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:58:43.023838  1583 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:43.026371  5792 raft_consensus.cc:3055] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:43.026913  5792 raft_consensus.cc:740] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 12:58:43.028797  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:42.983469  5737 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:43.028690  5715 raft_consensus.cc:3055] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:43.033231  1583 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:43.027884  5792 consensus_queue.cc:260] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:43.064844  1655 leader_election.cc:336] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.819s (SENT)
I20260709 12:58:43.065006  1505 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:43.091914  1655 leader_election.cc:336] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.839s (SENT)
I20260709 12:58:43.065059  1654 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:43.094133  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 68979.4us
I20260709 12:58:43.033990  5715 raft_consensus.cc:740] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:43.039467  5652 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:43.030718  5713 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:43.107486  5389 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:43.097800  5800 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:58:43.113246  5801 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:58:43.118610  5799 log.cc:927] Time spent T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:58:43.065730  5792 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:43.035424  5804 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:58:43.065245  5759 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:43.133459  5759 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:43.133525  5798 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:58:43.132604  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:43.134320  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:43.135084  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 99107us
I20260709 12:58:43.136265  1505 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:43.140722  5800 consensus_queue.cc:1048] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:58:43.132791  1655 leader_election.cc:336] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.877s (SENT)
I20260709 12:58:43.069554  5737 raft_consensus.cc:697] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 12:58:43.159060  1655 leader_election.cc:336] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.883s (SENT)
I20260709 12:58:43.132951  5804 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:43.160761  5804 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:43.162186  1505 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:43.163080  5805 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:43.065284  5802 consensus_queue.cc:1059] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.119s
I20260709 12:58:43.119280  5738 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:43.104382  5652 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 12:58:43.167052  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 127201us
I20260709 12:58:43.170547  1440 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38804 (request call id 38) took 10953 ms. Trace:
I20260709 12:58:43.189255  5652 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:43.189564  1654 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:43.192787  5798 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:43.189286  1440 rpcz_store.cc:276] 0709 12:58:32.182384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:32.182594 (+   210us) service_pool.cc:224] Handling call
0709 12:58:43.135123 (+10952529us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:41.836891 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:41.837600 (+   709us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:41.837656 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:58:41.837686 (+    30us) tablet.cc:662] Decoding operations
0709 12:58:41.838165 (+   479us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:41.838232 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:41.838257 (+    25us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:58:41.838634 (+   377us) tablet.cc:701] Row locks acquired
0709 12:58:41.838679 (+    45us) write_op.cc:260] PREPARE: finished
0709 12:58:41.838843 (+   164us) write_op.cc:270] Start()
0709 12:58:41.838994 (+   151us) write_op.cc:276] Timestamp: P: 1783601921838789 usec, L: 0
0709 12:58:41.839014 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:58:41.880777 (+ 41763us) log.cc:844] Serialized 918 byte log entry
0709 12:58:42.427735 (+546958us) op_driver.cc:464] REPLICATION: finished
0709 12:58:42.799575 (+371840us) write_op.cc:301] APPLY: starting
0709 12:58:42.825894 (+ 26319us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:42.843860 (+ 17966us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:42.893761 (+ 49901us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:42.947123 (+ 53362us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:42.956996 (+  9873us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:58:42.957042 (+    46us) write_op.cc:312] APPLY: finished
0709 12:58:42.982825 (+ 25783us) log.cc:844] Serialized 28 byte log entry
0709 12:58:43.022120 (+ 39295us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:43.029645 (+  7525us) write_op.cc:454] Released schema lock
0709 12:58:43.032793 (+  3148us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:43.128237 (+ 95444us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:43.142928 (+ 14691us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6297243,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":297480,"apply.run_cpu_time_us":6979,"apply.run_wall_time_us":328362,"num_ops":2,"prepare.queue_time_us":208674,"prepare.run_cpu_time_us":5274,"prepare.run_wall_time_us":82657,"raft.queue_time_us":307330,"raft.run_cpu_time_us":28573,"raft.run_wall_time_us":251285,"replication_time_us":588543,"thread_start_us":573623,"threads_started":4,"wal-append.queue_time_us":86489}]]}
I20260709 12:58:43.193240  5798 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:43.193616  5798 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:43.172601  5737 consensus_queue.cc:237] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:43.034962  5790 consensus_queue.cc:1059] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.130s
I20260709 12:58:43.202270  5790 raft_consensus.cc:3055] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:58:43.202648  5790 raft_consensus.cc:740] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:43.203553  5790 consensus_queue.cc:260] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:43.036382  5595 consensus_queue.cc:237] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:43.173558  5544 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:43.207315  5544 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:43.209048  1655 leader_election.cc:336] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.938s (SENT)
I20260709 12:58:43.209604  5544 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:43.210978  1654 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:43.211993  5795 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:58:43.212399  5795 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:43.212745  5795 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:58:43.213011  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:43.214948  1532 tablet_service.cc:1558] Processing DeleteTablet for tablet 07ac6d2e7442458585e7eca31089d547 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:51498
I20260709 12:58:43.215977  1525 tablet_service.cc:1558] Processing DeleteTablet for tablet e4681eaad3084357b9677e4242b97c99 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:51498
I20260709 12:58:43.216355  5652 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:43.183192  5787 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:43.129179  5435 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:43.065457  5529 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.117s
I20260709 12:58:43.218961  5787 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:43.216900  1488 auto_rebalancer.cc:629] Failed to schedule move for tablet eabf19413eea44dd86511e07a036166b: Illegal state: Replica dbe6a89d0e1c4137b3a1b17bf4b520d8 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:43.221635  5790 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:43.221750  5652 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:43.223459  5796 consensus_queue.cc:1059] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:43.229362  5798 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:43.233552  5798 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:43.224246  1654 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:43.235486  5798 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:43.236030  5798 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:43.236524  5798 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:43.235682  1654 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:43.238435  5796 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:43.238909  5796 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:43.239329  5796 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:43.242776  1425 catalog_manager.cc:5028] TS dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): tablet 07ac6d2e7442458585e7eca31089d547 (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
W20260709 12:58:43.246232  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 105149us
I20260709 12:58:43.249709  1425 catalog_manager.cc:5028] TS dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): tablet e4681eaad3084357b9677e4242b97c99 (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:58:43.249905  1654 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:43.249215  1655 leader_election.cc:336] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.004s (SENT)
I20260709 12:58:43.252009  5826 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:43.252568  5826 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:43.254266  5826 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:43.259896  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 210173us
I20260709 12:58:43.260975  1583 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:43.261669  1654 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:43.262306  1583 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:43.263168  5527 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:43.264014  5827 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:43.260941  5798 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:43.179879  5804 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:43.267133  5804 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:43.264655  5795 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:43.151355  5729 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:43.234511  5824 raft_consensus.cc:3055] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:43.184458  5738 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:43.296845  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 110501us
I20260709 12:58:43.298190  1505 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:43.298785  5795 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:43.300323  5787 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:43.300856  5787 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:43.301326  5787 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:43.301759  5642 raft_consensus.cc:3055] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:43.302240  5642 raft_consensus.cc:740] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:43.303234  5642 consensus_queue.cc:260] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:43.303154  5805 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:58:43.305836  5807 log.cc:927] Time spent T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 12:58:43.307274  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2443) took 1059 ms. Trace:
I20260709 12:58:43.307672  1691 rpcz_store.cc:276] 0709 12:58:42.248216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:42.706916 (+458700us) service_pool.cc:224] Handling call
0709 12:58:42.717653 (+ 10737us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:42.718034 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:42.727130 (+  9096us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:42.800660 (+ 73530us) log.cc:844] Serialized 26 byte log entry
0709 12:58:42.982698 (+182038us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:42.982731 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:42.982801 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:43.307013 (+324212us) raft_consensus.cc:1685] finished
0709 12:58:43.307054 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:43.307210 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":126812,"threads_started":1,"wal-append.queue_time_us":195994}
I20260709 12:58:43.293702  1583 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:43.314760  1505 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:43.325078  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 63468.8us
I20260709 12:58:43.118793  5732 consensus_queue.cc:260] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:43.328786  1654 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:43.308624  1436 catalog_manager.cc:5697] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:43.289849  5824 raft_consensus.cc:740] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:58:43.339612  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 242880us
I20260709 12:58:43.327662  1583 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:43.321521  5804 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:43.269112  5599 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:58:43.341274  1436 catalog_manager.cc:5697] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 9 to 10, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:43.300979  5798 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:43.352851  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 52669.2us
I20260709 12:58:43.339745  5729 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:43.269598  5715 consensus_queue.cc:260] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:43.312139  5826 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:43.347851  5802 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:43.326650  5787 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:43.345772  5804 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:43.360536  1654 leader_election.cc:400] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 12.
I20260709 12:58:43.352562  5795 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:58:43.372186  1654 leader_election.cc:403] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:43.349936  5642 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:43.344920  5821 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:58:43.362154  5527 consensus_queue.cc:1175] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4487a53c51be4634bf1ef29c5248353d" responder_term: 10 status { last_received { term: 10 index: 5 } last_committed_idx: 4 last_received_current_leader { term: 10 index: 5 } }
I20260709 12:58:43.385269  5821 raft_consensus.cc:697] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:43.384989  5824 consensus_queue.cc:260] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:43.386543  5824 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:43.386364  5821 consensus_queue.cc:237] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:43.387219  5384 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:43.391717  5796 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:43.361012  1436 catalog_manager.cc:5697] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 8 to 12, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 12 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:43.375422  5815 raft_consensus.cc:3055] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:58:43.377199  5529 consensus_queue.cc:1048] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:43.378012  5826 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:43.381120  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:43.381444  1654 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:43.409389  1436 catalog_manager.cc:5697] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 7 to 10, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 10 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:43.411185   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:43.410847  1436 catalog_manager.cc:5697] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 4 to 8, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 8 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
W20260709 12:58:43.382067  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:43.357897  5732 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:43.396975  5795 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 12.
W20260709 12:58:43.362576  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 197606us
I20260709 12:58:43.407121  5802 raft_consensus.cc:697] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:43.423563  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:43.424535  5802 consensus_queue.cc:237] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:43.425073  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:43.398320  5804 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:43.360589  1505 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:43.412341  1436 catalog_manager.cc:5697] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 8 to 9, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:43.414376  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:43.410096  1655 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.716s (SENT) [suppressed 67 similar messages]
W20260709 12:58:43.436338  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:43.448669  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:43.448971  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:43.461956  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 110861us
I20260709 12:58:43.448707  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:43.459070  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:43.456981  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 96506.5us
I20260709 12:58:43.467787  1611 raft_consensus.cc:2393] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 16: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 12:58:43.437017  1655 leader_election.cc:336] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.744s (SENT)
W20260709 12:58:43.469076  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:43.432606  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:43.471012  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:43.471647  1616 raft_consensus.cc:2368] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13.
I20260709 12:58:43.453224  1436 catalog_manager.cc:5697] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 8 to 9, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 9 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:43.462217  5652 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:43.475350  5787 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:43.475613  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:43.405741  5815 raft_consensus.cc:740] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:43.476238  5713 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:43.475478  5544 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.477052  5544 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:43.479308  5544 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:43.480305  5815 consensus_queue.cc:260] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:43.450456  5715 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:43.481823  5815 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:43.457332  5729 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:43.433450  5747 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:43.475411  5652 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:43.486129  1436 catalog_manager.cc:5697] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 8 to 10, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 10 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
W20260709 12:58:43.491791  5789 consensus_meta.cc:287] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.533s	user 0.007s	sys 0.000s
I20260709 12:58:43.492300  5713 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:43.494513  5796 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:43.507038  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:43.507929  1688 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:43.487897  1436 catalog_manager.cc:5697] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 3 to 8, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
W20260709 12:58:43.513499  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 161493us
W20260709 12:58:43.517792  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 45615.9us
I20260709 12:58:43.518798  1505 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:43.521883  1684 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:58:43.524004  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:58:43.524686  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:43.524943  1684 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:58:43.525882  1655 leader_election.cc:336] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.766s (SENT)
I20260709 12:58:43.528499  1436 catalog_manager.cc:5697] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 4 to 10, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 10 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:43.533066  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:43.537590  1505 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:43.546792  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:43.547520  1691 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:43.547897  1683 raft_consensus.cc:2393] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 10: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:43.476977  5738 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:58:43.548645  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:43.552356  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:43.559223  1687 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
W20260709 12:58:43.556586  1655 leader_election.cc:336] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.873s (SENT)
I20260709 12:58:43.562170  1617 raft_consensus.cc:2410] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:58:43.563391  1436 catalog_manager.cc:5697] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 6 to 9, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 9 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:43.470904  5737 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 12:58:43.566921  1682 raft_consensus.cc:1275] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:58:43.529955  5729 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:43.555516  5792 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:58:43.580613  1655 leader_election.cc:336] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.794s (SENT)
I20260709 12:58:43.581120  1655 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:43.584422  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 46950.4us
I20260709 12:58:43.584682  1654 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:43.585448  1436 catalog_manager.cc:5697] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 5 to 8, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:43.593957  1505 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:43.597539  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:43.500360  5759 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:43.614473  1654 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:43.615833  1654 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:43.603498  1436 catalog_manager.cc:5697] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 8 to 9, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 9 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:43.617031  1654 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:43.621716  1684 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:43.623286  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:58:43.624034  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:43.624681  1684 raft_consensus.cc:2368] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15.
I20260709 12:58:43.625593  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:43.627457  1654 leader_election.cc:400] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13.
I20260709 12:58:43.627831  1654 leader_election.cc:403] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:58:43.640888  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:43.643635  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:43.587826  5796 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:58:43.645888  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 52054.4us
I20260709 12:58:43.646731  1505 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:43.648723  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:43.649354  1687 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:43.660672  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:43.661414  1682 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:43.662597  1436 catalog_manager.cc:5697] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 6 to 9, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 9 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:43.670416  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:58:43.689522  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 115000us
I20260709 12:58:43.626638  5747 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:43.626493  5732 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:43.694447  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:43.695377  1436 catalog_manager.cc:5697] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 4 to 8, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 8 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
W20260709 12:58:43.698625  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 71330.6us
I20260709 12:58:43.650403  5833 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.700901  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:43.707923  1614 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 12:58:43.708084  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:43.668967  5795 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13.
W20260709 12:58:43.714077  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 67430.7us
I20260709 12:58:43.706298  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:43.662019  5729 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:43.706179  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:43.708901  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:43.720184  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:43.709375  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:43.720517  1538 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:43.720887  1609 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:43.710305  1508 leader_election.cc:400] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15.
I20260709 12:58:43.706776  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:43.721570  1508 leader_election.cc:403] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:58:43.711970  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:43.718333  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:43.722564  1684 raft_consensus.cc:2393] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 18: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:43.723493  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:43.718959  1683 raft_consensus.cc:2368] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 13. Current term is 14.
I20260709 12:58:43.719759  1537 raft_consensus.cc:1240] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:43.722275  1615 raft_consensus.cc:2376] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17. Re-sending same reply.
I20260709 12:58:43.729447  1583 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:43.688549  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:43.730566  1583 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:43.731477  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:43.775326  1615 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 15. Current term is 16. Ops: []
W20260709 12:58:43.764169  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 60599.2us
I20260709 12:58:43.731678  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:43.764370  1436 catalog_manager.cc:5697] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 5 to 8, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 8 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
W20260709 12:58:43.766378  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 50859.4us
I20260709 12:58:43.774106  1539 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:43.777899  1505 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:43.779680  1533 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:58:43.777319  1682 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:43.712432  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:43.698485  5725 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:43.742026  1614 raft_consensus.cc:1240] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:43.660778  5685 consensus_queue.cc:1059] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:58:43.705415  5821 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.802305  1505 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:43.772043  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 44866.2us
W20260709 12:58:43.722782  5793 consensus_meta.cc:287] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.733s	user 0.011s	sys 0.000s
W20260709 12:58:43.747318  1655 leader_election.cc:336] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.905s (SENT)
I20260709 12:58:43.803484  1655 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:43.792800  1612 raft_consensus.cc:2368] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 11. Current term is 12.
W20260709 12:58:43.780766  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 50287.5us
I20260709 12:58:43.796870  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:43.810479  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:43.811139  1611 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:43.812201  1436 catalog_manager.cc:5697] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 7 to 8, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 8 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:43.816372  1683 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:43.818075  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 70814.2us
I20260709 12:58:43.720508  5833 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:43.818693  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:43.819352  1655 leader_election.cc:336] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.109s (SENT)
W20260709 12:58:43.819878  1655 leader_election.cc:336] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.124s (SENT)
I20260709 12:58:43.735605  5713 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:58:43.820181  5833 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:43.820441  1655 leader_election.cc:336] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.136s (SENT)
I20260709 12:58:43.817651  1436 catalog_manager.cc:5697] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:43.797935  5840 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:43.812330  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:43.850731  1508 leader_election.cc:400] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 13. Current term is 14.
I20260709 12:58:43.856099  1508 leader_election.cc:403] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:58:43.775067  5815 consensus_queue.cc:1048] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 12:58:43.858000  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 55786.5us
I20260709 12:58:43.856865  1614 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:58:43.810566  5729 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:43.870532  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:43.872349  1505 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:43.873262  1615 raft_consensus.cc:2393] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 10: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:43.870836  1508 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:58:43.874643  1655 leader_election.cc:336] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.195s (SENT)
I20260709 12:58:43.882087  1655 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:43.827759  5845 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:43.883178  1436 catalog_manager.cc:5697] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
W20260709 12:58:43.881994  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 65754.3us
I20260709 12:58:43.811364  5821 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:43.858603  5840 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:43.888521  1654 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:43.859202  5800 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:43.901223  1611 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 14.
I20260709 12:58:43.866153  5729 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:43.902622  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:43.905366  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:43.906011  1612 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:43.873706  5792 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 13. Current term is 14.
I20260709 12:58:43.907608  5729 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:43.810289  5793 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:43.881505  5805 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:43.916529  1654 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:43.908777  5831 log.cc:927] Time spent T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.322s	user 0.001s	sys 0.000s
I20260709 12:58:43.906977  1436 catalog_manager.cc:5697] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 8 to 9, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 9 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
W20260709 12:58:43.910084  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 45265.4us
I20260709 12:58:43.923427  1436 catalog_manager.cc:5697] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 7 to 11, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 11 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
W20260709 12:58:43.924255  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:43.901647  5840 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:43.929672  1691 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:43.932551  1654 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:43.909597  5824 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:43.900003  5725 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:58:43.939378  1436 catalog_manager.cc:5697] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:43.949271  1654 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:43.918018  5747 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:43.961516  1436 catalog_manager.cc:5697] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:43.965054  1688 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 12:58:43.919281  5805 raft_consensus.cc:697] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:43.965476  1691 raft_consensus.cc:1240] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:58:43.912406  5804 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:44.032294  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:44.101162  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:44.103269  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 142330us
W20260709 12:58:44.101661  1655 leader_election.cc:336] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.288s (SENT)
I20260709 12:58:43.934444  5796 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:43.934185  5826 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:44.090617  5713 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:44.171038  1615 raft_consensus.cc:2393] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 12: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 12:58:44.325389  5838 log.cc:927] Time spent T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.468s	user 0.001s	sys 0.000s
I20260709 12:58:44.217440  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:58:44.137502  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:44.360702  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.152103  1436 catalog_manager.cc:5697] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
W20260709 12:58:44.192663  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 243495us
I20260709 12:58:44.098783  5824 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:58:44.178551  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 74576.1us
I20260709 12:58:44.217514  1535 raft_consensus.cc:1240] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 11. Current term is 12. Ops: []
W20260709 12:58:44.343433  5810 log.cc:927] Time spent T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
W20260709 12:58:44.155294  1655 leader_election.cc:336] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.359s (SENT)
W20260709 12:58:44.376020  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 220780us
I20260709 12:58:44.376215  1540 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:58:44.376663  1655 leader_election.cc:336] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.384s (SENT)
W20260709 12:58:43.993342  5832 log.cc:927] Time spent T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.298s	user 0.000s	sys 0.001s
I20260709 12:58:43.968858  5789 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:58:44.249639  1533 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:58:44.391749  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 247653us
I20260709 12:58:44.159310  1684 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
W20260709 12:58:44.243268  1687 consensus_meta.cc:287] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.593s	user 0.010s	sys 0.000s
I20260709 12:58:44.392870  1687 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
I20260709 12:58:44.177882  1534 raft_consensus.cc:1275] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:58:44.192840  1537 raft_consensus.cc:1275] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:58:44.281241  5816 raft_consensus.cc:3055] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:58:44.099043  5725 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.194423  1691 raft_consensus.cc:1275] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:58:44.217370  5836 log.cc:927] Time spent T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.402s	user 0.001s	sys 0.000s
I20260709 12:58:43.964174  5747 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:44.106775  5795 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:44.102461  5599 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:43.992842  5685 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:44.129670  1688 raft_consensus.cc:1240] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:44.176323  5652 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:44.349488  1542 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 14. Current term is 15. Ops: []
W20260709 12:58:44.279850  5837 log.cc:927] Time spent T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
W20260709 12:58:44.278188  5848 log.cc:927] Time spent T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.366s	user 0.000s	sys 0.001s
W20260709 12:58:44.279086  5857 log.cc:927] Time spent T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 12:58:44.259613  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:44.361243  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.364073  1436 catalog_manager.cc:5697] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 11 to 12, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 12 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:44.365239  1654 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:44.436409  1682 raft_consensus.cc:1240] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: []
W20260709 12:58:44.373363  1683 consensus_meta.cc:287] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.556s	user 0.007s	sys 0.003s
I20260709 12:58:44.104974  5833 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.378741  1505 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:44.396068  5816 raft_consensus.cc:740] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:44.408857  5747 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:44.392449  1684 pending_rounds.cc:85] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 8
I20260709 12:58:44.457131  1684 pending_rounds.cc:107] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:58:44.457511  1684 raft_consensus.cc:2889] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:44.371526  1583 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:44.376920  5713 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:44.411321  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:44.471213  1537 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:44.418442  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:44.472038  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:44.415845  1608 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.009s	sys 0.025s
W20260709 12:58:44.472780  1608 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.010s	sys 0.025s
I20260709 12:58:44.088692  5792 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.438719  1688 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:58:44.437649  1683 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
W20260709 12:58:44.396883  1538 consensus_meta.cc:287] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.676s	user 0.005s	sys 0.005s
I20260709 12:58:44.483078  1538 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:58:44.436260  1436 catalog_manager.cc:5697] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 8 to 11, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 11 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:44.349045  5805 consensus_queue.cc:237] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:44.465787  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 100654us
I20260709 12:58:44.490803  1654 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:44.468407  5817 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:44.433377  5750 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.409329  5725 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:44.483687  1683 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 14. Current term is 15. Ops: []
W20260709 12:58:44.467912  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 89276.6us
I20260709 12:58:44.452155  5824 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:44.493741  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:44.475776  1612 consensus_meta.cc:287] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.568s	user 0.007s	sys 0.002s
I20260709 12:58:44.494830  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:44.495334  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:44.480295  1682 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 17. Current term is 18. Ops: [17.8-17.8]
W20260709 12:58:44.501655  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 130245us
I20260709 12:58:44.526252  1682 raft_consensus.cc:1240] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 12:58:44.477810  5826 raft_consensus.cc:2764] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 12:58:44.497714  5829 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.008s	sys 0.006s
I20260709 12:58:44.529280  1612 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:44.529992  1505 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:44.526043  1583 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:44.499221  1611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.005s	sys 0.010s
W20260709 12:58:44.551045  1611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.005s	sys 0.010s
W20260709 12:58:44.492420  5809 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.031s	sys 0.040s
I20260709 12:58:44.527531  1682 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:58:44.495299  5804 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:44.546118  1614 consensus_meta.cc:287] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.672s	user 0.009s	sys 0.001s
I20260709 12:58:44.468977  5845 raft_consensus.cc:697] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:44.488498  5787 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15.
I20260709 12:58:44.421608  5599 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:44.434659  5685 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:58:44.556025  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 65322.2us
W20260709 12:58:44.545125  1685 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.005s	sys 0.031s
W20260709 12:58:44.580451  1685 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.005s	sys 0.032s
I20260709 12:58:44.581154  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2460) took 1063 ms. Trace:
I20260709 12:58:44.580765  1654 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:44.524034  5750 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:44.564092  1505 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:44.564512  1682 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:44.580837  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:44.477725  5833 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:44.579370  1541 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.017s	sys 0.028s
I20260709 12:58:44.553398  5817 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.560294  1614 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 12:58:44.584430  1537 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
W20260709 12:58:44.585767  5859 log.cc:927] Time spent T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
W20260709 12:58:44.586086  5854 log.cc:927] Time spent T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
W20260709 12:58:44.586630  5852 log.cc:927] Time spent T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:58:44.587651  5867 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:58:44.581538  1685 rpcz_store.cc:276] 0709 12:58:43.517480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.517621 (+   141us) service_pool.cc:224] Handling call
0709 12:58:43.536757 (+ 19136us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.537063 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:43.694030 (+156967us) log.cc:844] Serialized 14 byte log entry
0709 12:58:44.580782 (+886752us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:44.580863 (+    81us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:44.580915 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.580982 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:44.581098 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16029,"prepare.queue_time_us":329205,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":12865,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":15177,"thread_start_us":1010927,"threads_started":3,"wal-append.queue_time_us":523991}
I20260709 12:58:44.589237  1691 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:58:44.589633  5750 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:44.555686  5861 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:58:44.597549  1541 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.017s	sys 0.028s
I20260709 12:58:44.620705  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2456) took 1117 ms. Trace:
W20260709 12:58:44.561070  5809 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.031s	sys 0.041s
W20260709 12:58:44.554441  5829 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.009s	sys 0.006s
I20260709 12:58:44.562933  5796 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.544909  5824 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:44.613545  1654 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:44.493448  5792 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:44.628283  5729 consensus_meta.cc:287] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.706s	user 0.010s	sys 0.000s
I20260709 12:58:44.618366  5867 raft_consensus.cc:697] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:44.619091  5833 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:44.600505  5793 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:44.691133  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:44.582401  5733 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:44.611826  5864 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:58:44.629801  5713 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:44.630570  5845 consensus_queue.cc:237] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:44.708012  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:44.633965  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:44.643142  5821 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:44.643798  5599 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:44.646162  5685 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:58:44.647483  1655 leader_election.cc:336] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.162s (SENT)
I20260709 12:58:44.648320  5872 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.649923  5725 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:44.621178  1689 rpcz_store.cc:276] 0709 12:58:43.503470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.503717 (+   247us) service_pool.cc:224] Handling call
0709 12:58:43.504078 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:43.521944 (+ 17866us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:43.713631 (+191687us) log.cc:844] Serialized 14 byte log entry
0709 12:58:43.931956 (+218325us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:43.937226 (+  5270us) log.cc:844] Serialized 26 byte log entry
0709 12:58:43.937394 (+   168us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:43.937431 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:43.937504 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:44.620415 (+682911us) raft_consensus.cc:1685] finished
0709 12:58:44.620440 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:44.620610 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22260,"prepare.queue_time_us":328016,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":21829,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":41372,"thread_start_us":310779,"threads_started":2,"wal-append.queue_time_us":613099}
I20260709 12:58:44.720419  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:44.721199  1534 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:44.611258  5817 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:44.688817  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:44.633793  5861 raft_consensus.cc:697] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:58:44.648379  5847 log.cc:927] Time spent T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.473s	user 0.001s	sys 0.002s
I20260709 12:58:44.695670  1537 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:58:44.702957  1683 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 12:58:44.712333  1655 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:44.718189  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:44.717883  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:44.694942  5826 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.683969  5796 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:44.690747  5729 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:44.725220  1683 pending_rounds.cc:85] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 6
I20260709 12:58:44.729811  1683 pending_rounds.cc:107] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 12:58:44.730186  1683 raft_consensus.cc:2889] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:44.734944  5729 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:44.735747  5729 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:44.736096  5729 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:44.737098  1537 raft_consensus.cc:1240] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:44.722209  5793 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:44.742259  1535 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
W20260709 12:58:44.741858  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 94416.8us
W20260709 12:58:44.747723  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.740700  1542 raft_consensus.cc:1240] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:44.724906  5864 raft_consensus.cc:2764] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260709 12:58:44.727561  5725 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:44.770884  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:44.736451  5729 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:58:44.775549  1655 leader_election.cc:336] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.222s (SENT)
I20260709 12:58:44.776117  1655 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:44.737725  5792 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:44.783421  1684 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 12:58:44.785326  1688 raft_consensus.cc:1240] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:44.806134  5796 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:44.806800  5796 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:44.774874  5867 consensus_queue.cc:237] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:44.724300  5872 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:44.777486  5840 consensus_meta.cc:287] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.814s	user 0.007s	sys 0.004s
I20260709 12:58:44.732424  5826 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:44.814739  5840 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:44.817059  5826 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:44.817706  5826 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:44.820324  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:44.821873  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:44.822495  1536 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:44.824388  1534 raft_consensus.cc:1275] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:58:44.819861  5747 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:44.751919  5793 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:44.822599  1537 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:58:44.825544  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 273975us
I20260709 12:58:44.891414  1537 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:58:44.916703  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:44.921653  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.924265  1687 raft_consensus.cc:2410] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for term 13 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 12:58:44.927707  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:44.929103  5713 consensus_queue.cc:1059] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:44.942768  5817 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:44.916668  5821 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:58:44.945374  5759 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:44.947623  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2475) took 1091 ms. Trace:
I20260709 12:58:44.953552  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1618) took 1535 ms. Trace:
I20260709 12:58:44.955842  5793 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:58:44.984249  5800 consensus_meta.cc:287] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 1.056s	user 0.006s	sys 0.006s
I20260709 12:58:44.960058  1536 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
W20260709 12:58:45.010013  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 234507us
I20260709 12:58:44.959919  1537 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:58:44.965131  1691 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:58:45.022773  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:45.023154  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:58:45.023550  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.023876  1691 raft_consensus.cc:2393] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 12: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 12:58:45.024144  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:44.969113  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 405073us
W20260709 12:58:44.974962  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.010118  1688 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:58:45.025158  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:45.025503  1688 pending_rounds.cc:85] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 8
W20260709 12:58:44.957923  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 344465us
I20260709 12:58:45.025041  1505 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:44.956910  5840 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:44.738278  5861 consensus_queue.cc:237] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.010016  1683 rpcz_store.cc:276] 0709 12:58:43.856339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.525039 (+668700us) service_pool.cc:224] Handling call
0709 12:58:44.557245 (+ 32206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:44.741429 (+184184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.947336 (+205907us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b54000de654. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:44.947551 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":333975424}
I20260709 12:58:45.023931  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:45.025933  1691 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:58:44.969400  1540 raft_consensus.cc:1275] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:58:45.025774  1688 pending_rounds.cc:107] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:58:45.032371  1654 leader_election.cc:400] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 11. Current term is 12.
I20260709 12:58:45.033509  1688 raft_consensus.cc:2889] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:45.033645  1654 leader_election.cc:403] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:58:45.010303  1608 rpcz_store.cc:276] 0709 12:58:43.417922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.426073 (+  8151us) service_pool.cc:224] Handling call
0709 12:58:43.426416 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:43.426768 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:43.426798 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:43.427272 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 12:58:43.628037 (+200765us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:44.473175 (+845138us) log.cc:844] Serialized 14 byte log entry
0709 12:58:44.952846 (+479671us) spinlock_profiling.cc:243] Waited 55.3 ms on lock 0x7b540043ef20. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85cfcc733 00007fc85d051dbf 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c
0709 12:58:44.952961 (+   115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.953111 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:44.953174 (+    63us) raft_consensus.cc:1685] finished
0709 12:58:44.953295 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:44.953475 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62984,"prepare.queue_time_us":236561,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":4091,"raft.queue_time_us":92909,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":21791,"spinlock_wait_cycles":127241600,"thread_start_us":1025465,"threads_started":2,"wal-append.queue_time_us":342176}
W20260709 12:58:45.034168  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 262039us
I20260709 12:58:45.032588  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:45.034667  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:45.027475  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:45.032758  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:45.025645  1655 leader_election.cc:336] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.554s (SENT)
I20260709 12:58:45.034859  1535 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:58:44.969775  5795 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.038161  1655 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:45.014009  5713 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.037029  1691 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:45.040436  1505 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:58:45.041154  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:45.041782  1684 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:58:45.009976  5685 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:45.009661  5544 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.026979  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:45.052192  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:44.980340  5729 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.083962  1684 raft_consensus.cc:1275] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:58:45.052714  1540 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:58:45.079766  1535 raft_consensus.cc:1240] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:58:45.077019  1537 raft_consensus.cc:3055] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:45.032730  5824 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:45.050428  5872 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:44.966317  1542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:47506
I20260709 12:58:45.088938  1537 raft_consensus.cc:740] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:45.090540  1542 raft_consensus.cc:606] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 LEADER]: Received request to transfer leadership to TS c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:45.035634  5878 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.030992  5800 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:58:45.020666  5846 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
W20260709 12:58:45.100960  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 56654.9us
I20260709 12:58:45.052932  1654 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:45.041304  5759 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:58:45.102689  1655 leader_election.cc:336] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.941s (SENT)
I20260709 12:58:45.130659  1655 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:45.078042  5796 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:45.099402  1537 consensus_queue.cc:260] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.035471  5830 consensus_queue.cc:1059] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:58:45.033293  5793 consensus_queue.cc:1059] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 12:58:45.082322  5789 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 11. Current term is 12.
W20260709 12:58:45.136618  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 83756.5us
I20260709 12:58:45.137583  1654 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:45.051584  5795 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.141868  5795 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:45.142946  5877 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:58:45.143373  5892 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.146180  1688 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:58:45.161581  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 71534.3us
I20260709 12:58:45.148310  1688 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:58:45.149401  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 208) took 1229 ms. Trace:
I20260709 12:58:45.163775  1654 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:45.091634  2300 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:45.077714  5685 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.089445  5845 consensus_queue.cc:1059] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:58:45.083164  5599 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:58:45.085724  5802 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.057s
W20260709 12:58:45.165818  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 125469us
I20260709 12:58:45.168104  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:33450 (request call id 1) took 1940 ms. Trace:
I20260709 12:58:45.164842  1611 rpcz_store.cc:276] 0709 12:58:43.919963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.920101 (+   138us) service_pool.cc:224] Handling call
0709 12:58:43.920504 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:44.558139 (+637635us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:44.558176 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:44.558705 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 12:58:44.846875 (+288170us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:44.846919 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:44.847006 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:45.149167 (+302161us) raft_consensus.cc:1685] finished
0709 12:58:45.149189 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:45.149340 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":181816,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":35631,"thread_start_us":852523,"threads_started":2,"wal-append.queue_time_us":511135}
W20260709 12:58:45.176932  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.135313  5885 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:45.052949  5713 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.132295  5815 consensus_queue.cc:1048] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:58:45.077286  5544 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.166589  5732 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:58:45.181553  1686 rpcz_store.cc:276] 0709 12:58:43.222915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.223086 (+   171us) service_pool.cc:224] Handling call
0709 12:58:45.163304 (+1940218us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b5400189a54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d057735 00007fc862017d29 00007fc85b5961d4 00007fc85b596162 00007fc85b596091 00007fc85b59600c 00007fc85b5952c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:45.163474 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1608181504}
W20260709 12:58:45.182837  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 102046us
I20260709 12:58:45.212502  1656 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 12:58:45.132936  5809 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
W20260709 12:58:45.210585  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 107945us
I20260709 12:58:45.136263  5821 consensus_queue.cc:1048] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:58:45.207649  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:45.165822  5435 consensus_queue.cc:1059] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:58:45.182307  5864 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:45.293584  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 81186.2us
I20260709 12:58:45.213356  1508 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:45.293397  1537 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:45.174772  5795 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:58:45.208560  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 45990us
I20260709 12:58:45.143955  5892 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.128852  5878 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.135003  5867 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.075s
W20260709 12:58:45.355549  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.355789  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:45.230680  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:45.365521  1684 raft_consensus.cc:2368] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12.
I20260709 12:58:45.366534  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:45.358976  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:45.178439  5747 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:45.174031  5872 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:45.360185  1581 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:45.361315  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:45.205559  5793 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.214679  5787 consensus_queue.cc:1059] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.154s
I20260709 12:58:45.203890  5885 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:45.373299  1686 raft_consensus.cc:2376] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15. Re-sending same reply.
I20260709 12:58:45.379436  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2384) took 1669 ms. Trace:
W20260709 12:58:45.368070  1655 leader_election.cc:336] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.716s (SENT)
W20260709 12:58:45.369196  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 153292us
I20260709 12:58:45.269609  5713 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:45.269172  5889 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:58:45.311816  5789 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:45.268822  5891 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:58:45.420846  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2474) took 1595 ms. Trace:
I20260709 12:58:45.204505  5800 consensus_queue.cc:1059] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.158s
I20260709 12:58:45.429777  1505 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:45.378896  1688 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:58:45.206243  5759 consensus_queue.cc:1048] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.165s
I20260709 12:58:45.430506  1655 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:45.432407  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 72290.9us
I20260709 12:58:45.208299  5826 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.429593  1541 rpcz_store.cc:276] 0709 12:58:43.709726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:43.709869 (+   143us) service_pool.cc:224] Handling call
0709 12:58:43.731728 (+ 21859us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:43.791290 (+ 59562us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:58:44.620716 (+829426us) log.cc:844] Serialized 14 byte log entry
0709 12:58:44.916158 (+295442us) log.cc:844] Serialized 14 byte log entry
0709 12:58:44.916717 (+   559us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:44.916768 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:44.927676 (+ 10908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:45.149677 (+222001us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b18003ad260. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f322a6 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419
0709 12:58:45.379201 (+229524us) spinlock_profiling.cc:243] Waited 36.2 ms on lock 0x7b5400246654. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:45.379249 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:45.379363 (+   114us) inbound_call.cc:177] Queueing success response
0709 12:58:45.382318 (+  2955us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:58:45.387268 (+  4950us) spinlock_profiling.cc:243] Waited 30 ms on lock 0x7b18003ad260. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f643f3 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd 000000000038f354 000000000038f199 00007fc859f4783a
0709 12:58:45.404305 (+ 17037us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b18003ad260. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f64522 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd 000000000038f354 000000000038f199 00007fc859f4783a
Metrics: {"prepare.queue_time_us":33873,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":77,"raft.queue_time_us":212,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":56040,"spinlock_wait_cycles":226883328,"thread_start_us":1050734,"threads_started":2,"wal-append.queue_time_us":548759}
I20260709 12:58:45.442651  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:45.438899  1539 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
W20260709 12:58:45.374557  1488 auto_rebalancer.cc:629] Failed to schedule move for tablet ac600187e28f4d0fa948e0d053317e88: Illegal state: Replica 4487a53c51be4634bf1ef29c5248353d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:45.428682  5885 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:45.461676  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:45.381927  5878 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:45.390676  5729 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:45.472925  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:45.478104  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:45.472064  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:45.472294  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:45.470656  1537 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 5. (term mismatch)
I20260709 12:58:45.475131  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:45.395114  5685 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:45.479169  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 111154us
W20260709 12:58:45.375593  5882 log.cc:927] Time spent T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.210s	user 0.000s	sys 0.000s
I20260709 12:58:45.408864  5824 raft_consensus.cc:3055] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:58:45.474843  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:45.478389  5544 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:45.456039  5789 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:45.531651  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 316831us
I20260709 12:58:45.377029  5869 consensus_queue.cc:1059] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 12:58:45.439411  5384 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:45.438894  5845 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:45.522859  1655 leader_election.cc:336] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.114s (SENT)
I20260709 12:58:45.521052  1611 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:58:45.470928  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:45.543757  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:45.544135  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.363131  5864 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.523622  1612 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:45.483832  5747 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:58:45.521595  5824 raft_consensus.cc:740] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:58:45.529354  5904 log.cc:927] Time spent T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:58:45.530643  5814 raft_consensus.cc:3055] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:58:45.463009  5796 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:45.378759  5892 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:45.439003  5795 raft_consensus.cc:697] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 12 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:45.579005  5795 consensus_queue.cc:237] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.574069  5814 raft_consensus.cc:740] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:45.580438  5814 consensus_queue.cc:260] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.581861  5814 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:45.533282  1581 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:58:45.373456  5830 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.134s
I20260709 12:58:45.584131  5830 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:45.585057  5830 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:45.440450  1690 rpcz_store.cc:276] 0709 12:58:43.825125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.494112 (+668987us) service_pool.cc:224] Handling call
0709 12:58:44.527309 (+ 33197us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:44.547090 (+ 19781us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:44.547120 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:44.562325 (+ 15205us) log.cc:844] Serialized 26 byte log entry
0709 12:58:45.093444 (+531119us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b180045c880. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf10d1 00007fc85d00ca0f
0709 12:58:45.164585 (+ 71141us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:45.164626 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:45.164724 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:45.420310 (+255586us) raft_consensus.cc:1685] finished
0709 12:58:45.420332 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:45.420770 (+   438us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21679,"raft.queue_time_us":19967,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":6567,"spinlock_wait_cycles":2630912,"thread_start_us":70673,"threads_started":1,"wal-append.queue_time_us":842499}
I20260709 12:58:45.546783  1583 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:45.548100  1655 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:45.590502  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:45.591636  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 45099us
I20260709 12:58:45.592154  5796 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:45.592506  1583 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:45.593927  5846 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:58:45.591142  5824 consensus_queue.cc:260] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.594381  5846 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:45.594834  5846 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:45.551457  1611 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 12:58:45.596215  5830 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:45.597327  1654 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:45.598176  5747 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:58:45.598656  5747 raft_consensus.cc:697] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:45.599486  5747 consensus_queue.cc:237] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.520581  1537 pending_rounds.cc:85] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 4
I20260709 12:58:45.534363  5789 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:45.557752  5725 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:45.558825  5800 raft_consensus.cc:3055] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:58:45.559645  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 129966us
I20260709 12:58:45.560374  1536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:47506
I20260709 12:58:45.606437  1536 raft_consensus.cc:606] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:45.606837  1536 raft_consensus.cc:614] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:45.482669  5826 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.549527  5845 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.564002  1616 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 12:58:45.551014  5809 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:58:45.565418  5732 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.558887  5787 raft_consensus.cc:3055] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:45.560204  5878 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:45.567330  5642 raft_consensus.cc:3055] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:58:45.570783  5879 log.cc:927] Time spent T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:58:45.384645  5894 consensus_queue.cc:1059] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.336s
I20260709 12:58:45.445031  5793 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.622725  5793 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:45.576503  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2387) took 1401 ms. Trace:
I20260709 12:58:45.623332  1539 rpcz_store.cc:276] 0709 12:58:44.171576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.192568 (+ 20992us) service_pool.cc:224] Handling call
0709 12:58:45.572388 (+1379820us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b5400218ed4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:45.572730 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1848192256}
I20260709 12:58:45.570807  5529 raft_consensus.cc:3055] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:58:45.584563  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 51356us
I20260709 12:58:45.616067  5732 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.618988  5642 raft_consensus.cc:740] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:45.478183  5891 raft_consensus.cc:697] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 14 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:45.624441  5529 raft_consensus.cc:740] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:45.627619  5891 consensus_queue.cc:237] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.629776  5826 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:45.478340  5889 raft_consensus.cc:697] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:45.631963  5845 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:45.631701  5889 consensus_queue.cc:237] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.605026  5821 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:58:45.614513  5787 raft_consensus.cc:740] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:45.632822  5821 consensus_queue.cc:1243] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:58:45.627990  5529 consensus_queue.cc:260] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.633559  5787 consensus_queue.cc:260] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:45.592381  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 69548.3us
I20260709 12:58:45.414454  5816 consensus_queue.cc:260] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.602953  1583 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:45.635150  5816 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:45.608811  5800 raft_consensus.cc:740] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:45.636061  1583 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:45.636775  5800 consensus_queue.cc:260] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.637966  5800 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:45.639501  5599 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:45.613866  1654 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:45.602321  5861 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:45.619860  1614 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
W20260709 12:58:45.634647  1655 leader_election.cc:336] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.178s (SENT)
I20260709 12:58:45.634725  5787 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:45.636665  5713 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:45.626955  1581 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:45.640709  1684 raft_consensus.cc:2410] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:58:45.633970  5529 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:45.641430  1655 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:45.601258  1537 pending_rounds.cc:107] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 11.5
W20260709 12:58:45.609961  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 403720us
I20260709 12:58:45.611366  5725 raft_consensus.cc:697] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:45.668675  1537 raft_consensus.cc:2889] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:45.642365  5824 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:45.671154  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:45.671955  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 45076.2us
I20260709 12:58:45.673709  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:45.675709  1611 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:58:45.673997  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:45.673765  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97c958beecec40918b63217135840ff6"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:47506
I20260709 12:58:45.676789  1541 raft_consensus.cc:606] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:45.677076  1581 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:45.677129  1541 raft_consensus.cc:614] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:58:45.679471  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.626845  5732 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:45.668193  5384 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.667438  5826 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:58:45.626232  5894 raft_consensus.cc:3055] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:58:45.710075  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:45.727219  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 47038.4us
W20260709 12:58:45.731338  1655 leader_election.cc:336] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.802s (SENT)
W20260709 12:58:45.724629  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 46215.4us
I20260709 12:58:45.642912  5713 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:45.643079  5861 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:45.728826  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 50573.7us
I20260709 12:58:45.731774  1655 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:45.734138  5864 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:45.776273  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:45.734999  5885 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:45.735813  5908 consensus_queue.cc:1059] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:58:45.736739  5725 consensus_queue.cc:237] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.737226  5384 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.677819  5685 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:58:45.720651  5795 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.738479  5892 consensus_queue.cc:1059] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:45.738875  1508 leader_election.cc:400] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12.
I20260709 12:58:45.809293  1508 leader_election.cc:403] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 12:58:45.739342  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 62334us
I20260709 12:58:45.810201  1581 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:45.745498  5867 raft_consensus.cc:2764] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:58:45.745664  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:45.626108  5849 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:58:45.681005  5729 consensus_queue.cc:1059] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 12:58:45.743733  5830 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:45.669453  5821 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 12:58:45.626998  5829 consensus_queue.cc:1059] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 12:58:45.666508  5869 consensus_queue.cc:1059] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:58:45.727015  5599 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:58:45.773305  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:45.838958  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:45.839799  1612 raft_consensus.cc:2393] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 15: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:45.838493  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:45.677387  5793 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:45.728754  5833 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
W20260709 12:58:45.846719  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 107965us
I20260709 12:58:45.643142  5845 consensus_queue.cc:1048] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.124s
I20260709 12:58:45.850293  5845 consensus_queue.cc:1243] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:58:45.850478  5849 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:45.785131  1687 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:58:45.769846  5713 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:45.671831  5878 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.108s
I20260709 12:58:45.671561  5652 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.109s
I20260709 12:58:45.789888  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:45.853726  1686 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:45.730801  5894 raft_consensus.cc:740] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:45.811132  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:45.855502  1690 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:45.627112  5642 consensus_queue.cc:260] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.768869  5861 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:45.820712  1533 raft_consensus.cc:1240] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:45.774132  5826 raft_consensus.cc:697] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:45.823812  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:58:45.824651  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 93344.6us
W20260709 12:58:45.860124  1655 leader_election.cc:336] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 3.069s (SENT)
I20260709 12:58:45.827836  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:45.861434  1655 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:45.861687  1684 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:45.793962  5872 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:45.845317  1617 raft_consensus.cc:1240] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:45.848968  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:45.849308  1508 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:45.849823  5792 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12.
I20260709 12:58:45.850240  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:45.876892  1613 raft_consensus.cc:2410] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:58:45.854370  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:45.827740  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:45.877758  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:45.878376  1608 raft_consensus.cc:2410] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:58:45.878569  1541 raft_consensus.cc:2410] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:58:45.853165  5384 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:45.867762  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:45.870491  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:45.879995  1617 raft_consensus.cc:2393] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 18: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:45.870630  1690 raft_consensus.cc:1240] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:45.880400  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:45.871167  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.881110  1536 raft_consensus.cc:2393] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 11: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:45.871110  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:58:45.873900  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.851066  5849 raft_consensus.cc:697] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:45.896095  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:45.851990  5830 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:45.898973  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:45.901589  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:45.901697  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:45.902477  1536 raft_consensus.cc:2393] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 15: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:45.902585  1541 raft_consensus.cc:2393] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 11: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:45.903309  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:45.822253  5795 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.864948  5796 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:45.911512  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:45.911242  5826 consensus_queue.cc:237] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.912075  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:45.897655  5908 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:45.896754  5729 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.897856  5759 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.921795  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:45.922473  1610 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:45.895285  5892 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:58:45.923484  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:45.929241  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:45.938383  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:45.939051  1541 raft_consensus.cc:2393] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 15: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:45.931699  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:45.935647  1690 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:45.869534  5802 consensus_queue.cc:1048] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:58:45.942405  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:45.943300  1690 raft_consensus.cc:2410] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:58:45.940552  1691 raft_consensus.cc:1275] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:58:45.940781  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.945840  5729 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.944200  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:45.948367  1690 pending_rounds.cc:85] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 7
I20260709 12:58:45.945760  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:45.949484  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:45.950479  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:45.951628  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:45.951965  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:45.952736  1539 raft_consensus.cc:2393] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 14: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:45.952924  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:45.953439  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:45.953585  1542 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:45.954852  1608 raft_consensus.cc:1240] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:45.955261  1690 pending_rounds.cc:107] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:58:45.957013  1690 raft_consensus.cc:2889] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:45.949421  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:45.957693  1541 raft_consensus.cc:2368] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 11. Current term is 12.
I20260709 12:58:45.959993  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:45.952818  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:45.953275  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:45.960767  1538 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:58:45.896868  5800 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:58:45.948182  5729 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:45.968664  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:45.969004  1615 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
I20260709 12:58:45.969543  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:45.973742  1610 raft_consensus.cc:1240] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:58:45.975832  1615 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:58:45.960008  5759 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.979436  1615 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 12:58:45.979983  5759 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:45.980696  1615 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:45.981225  1535 raft_consensus.cc:2393] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 11: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:45.981616  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:45.981962  1615 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:58:45.983312  1615 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:58:45.989713  1610 raft_consensus.cc:1240] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:58:45.992995  1540 raft_consensus.cc:2410] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:58:45.993402  1685 raft_consensus.cc:1275] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:58:45.999258  1617 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 12:58:45.970542  5878 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.002341  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:46.003904  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 193808us
I20260709 12:58:46.016999  1581 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:45.965869  5846 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:46.024390  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:45.960706  5908 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:46.028173  5923 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:45.936996  5894 consensus_queue.cc:260] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:46.031512  1581 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:46.033007  1654 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:46.054566  1534 raft_consensus.cc:2410] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:58:46.055367  1654 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:46.014737  5878 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:46.057528  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.061836  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:46.037230  5821 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:58:46.031735  5800 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.043903  5892 raft_consensus.cc:697] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:46.024932  5865 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:58:46.073303  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:46.071034  1540 raft_consensus.cc:2393] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 12: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:46.074839  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:46.074581  5892 consensus_queue.cc:237] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:45.996678  5849 consensus_queue.cc:237] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:46.079317  1540 raft_consensus.cc:2393] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 11: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:46.084619  1538 raft_consensus.cc:2393] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 14: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:46.056006  5824 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:46.062909  5796 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:46.063378  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:58:46.053545  5713 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:46.068413  5915 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:46.090066  1581 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:46.096580  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:46.101794  1617 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:46.045923  5923 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:46.069427  5729 consensus_queue.cc:1048] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:58:46.108870  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:46.109642  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:46.110352  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:46.089799  5824 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.113018  1505 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:46.104341  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:46.089134  5796 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.118526  1540 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:58:46.076917  5829 consensus_queue.cc:1048] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:58:46.127310  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:46.128063  1610 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 12.
I20260709 12:58:46.130411  1617 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:46.122320  1686 raft_consensus.cc:2410] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:58:46.124372  1608 raft_consensus.cc:1240] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:58:46.078608  5800 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:46.086263  5863 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:58:46.108781  5599 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:58:46.143276  5789 consensus_meta.cc:287] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.003s
I20260709 12:58:46.114336  5933 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.146030  5923 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:46.123157  5824 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:46.150288  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:46.150520  1655 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:46.153621  5789 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:46.131908  5796 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:46.161231  5926 consensus_queue.cc:1059] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:46.164738  1685 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:58:46.167376  1690 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 14 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:46.169340  5878 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:46.151634  5883 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.003s	sys 0.026s
W20260709 12:58:46.194952  5883 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.003s	sys 0.026s
I20260709 12:58:46.182771  2266 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:46.208811  1540 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
W20260709 12:58:46.180352  1655 leader_election.cc:336] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.814s (SENT)
I20260709 12:58:46.210141  1655 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:46.146744  5795 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:46.188447  5891 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.188637  5789 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:46.188711  5846 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:46.190385  5800 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:46.133139  5840 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:58:46.218294  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:46.173102  5729 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.219630  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:46.219465  5729 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:46.213721  5864 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:46.223187  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:46.170640  5599 raft_consensus.cc:697] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:46.193472  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:46.188453  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:46.178874  1610 raft_consensus.cc:1240] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:46.195817  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:46.188755  5909 raft_consensus.cc:3055] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:58:46.194664  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:46.155354  5725 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:58:46.218503  5861 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:46.223966  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:46.176946  5793 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:46.227293  1542 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:46.242352  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:46.243185  1542 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:58:46.233542  1537 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 12:58:46.185813  5872 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.193523  5926 consensus_queue.cc:1243] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Peer c262eac7fc904ae9bb91e450f6532e3f log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:58:46.250159  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:46.250828  1537 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:46.239796  1540 raft_consensus.cc:2376] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18. Re-sending same reply.
I20260709 12:58:46.244215  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:46.253513  1542 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:58:46.251814  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:46.254246  1537 raft_consensus.cc:2393] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 14: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:46.227154  5833 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.255227  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:46.227660  5729 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:46.251823  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:46.257014  1613 raft_consensus.cc:1240] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:46.233112  5909 raft_consensus.cc:740] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:46.254474  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:46.260202  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:46.262501  1540 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:58:46.172683  5933 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:46.271061  1537 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:46.271626  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:46.272119  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:46.272284  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:46.272339  1533 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:46.273404  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:46.273432  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:46.274204  1533 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:46.276405  1537 raft_consensus.cc:2393] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 15: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:46.227078  5891 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:46.278240  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 95546.2us
I20260709 12:58:46.279420  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:46.280256  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:46.284364  1540 raft_consensus.cc:2376] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10. Re-sending same reply.
I20260709 12:58:46.285521  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:46.285653  1542 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 12:58:46.285880  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:46.286584  1540 raft_consensus.cc:2410] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:58:46.287657  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:46.288312  1533 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:46.273557  5908 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:46.252589  5872 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:46.264678  5833 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:46.290887  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:46.289562  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:46.293936  1533 raft_consensus.cc:2393] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 12: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:46.294106  1537 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
W20260709 12:58:46.295622  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 174776us
I20260709 12:58:46.297161  1505 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:46.297271  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:46.298949  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:46.299582  1533 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:46.295245  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:58:46.298514  5909 consensus_queue.cc:260] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:46.301011  2300 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:46.301512  5909 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:46.306075  5872 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:46.306541  5795 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:46.307108  5795 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:46.308625  5833 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:46.309130  5795 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:46.309648  5824 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:46.311304  5908 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:46.313062  1682 raft_consensus.cc:1240] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:46.314497  5861 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:46.313125  1505 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:46.316028  1505 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:46.317169  1505 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:46.318687  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:46.321578  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:46.320308  1505 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:46.328840  5725 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:46.329473  5885 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:46.331607  5652 raft_consensus.cc:3055] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:46.332046  5652 raft_consensus.cc:740] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:46.332146  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:46.320288  5928 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:58:46.332921  5652 consensus_queue.cc:260] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:46.306509  5796 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:46.286963  5599 consensus_queue.cc:237] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:46.333506  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:46.511353  1540 raft_consensus.cc:2393] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 13: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 12:58:46.513309  5938 log.cc:927] Time spent T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
W20260709 12:58:46.513885  5937 log.cc:927] Time spent T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 12:58:46.513319  1540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:47506
W20260709 12:58:46.515187  5939 log.cc:927] Time spent T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
W20260709 12:58:46.490052  1655 leader_election.cc:336] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 3.101s (SENT)
I20260709 12:58:46.515429  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:46.516130  1655 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:46.516275  1688 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:58:46.394353  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.379511  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:46.378125  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:46.359989  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 76064.8us
W20260709 12:58:46.517324  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:46.510356  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:46.557806  1540 raft_consensus.cc:606] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:46.558403  1540 raft_consensus.cc:614] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:46.593278  5864 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:58:46.595088  1540 raft_consensus.cc:1240] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 13. Current term is 14. Ops: []
W20260709 12:58:46.341456  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:46.515475  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 191165us
I20260709 12:58:46.635133  1689 raft_consensus.cc:1240] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:58:46.316691  5824 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:46.320243  5729 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:46.320892  5908 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:58:46.664510  5868 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 12:58:46.665076  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:58:46.667795  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 146766us
I20260709 12:58:46.353924  5861 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:46.670207  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 180211us
W20260709 12:58:46.769213  1655 leader_election.cc:336] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 3.346s (SENT)
I20260709 12:58:46.769692  1655 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:46.353618  5935 log.cc:927] Time spent T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:58:46.594030  5928 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:58:46.669960  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 349757us
I20260709 12:58:46.774178  1505 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:46.775368  1505 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:46.706017  1583 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:46.776425  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 70654.8us
I20260709 12:58:46.777042  1583 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:46.616621  5872 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:46.634102  5885 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.779311  5742 consensus_queue.cc:1059] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:58:46.783008  5890 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:46.783752  5890 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:46.785251  5891 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:46.786175  5890 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:46.786880  5928 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:46.790283  1537 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:58:46.793709  1655 leader_election.cc:336] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 3.532s (SENT)
I20260709 12:58:46.794257  1655 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:46.795745  1505 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:46.802130  1505 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:46.807094  1655 leader_election.cc:336] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.120s (SENT)
I20260709 12:58:46.810858  1537 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:58:46.807240  1688 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 12:58:46.807993  5945 raft_consensus.cc:3055] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:46.778673  5824 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:46.767915  2300 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
W20260709 12:58:46.829854  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 491722us
I20260709 12:58:46.798108  5849 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:58:46.847726  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 70735.6us
I20260709 12:58:46.798929  5908 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:58:46.811269  1655 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:46.806927  5729 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:58:46.809773  5814 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:46.805634  5890 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:46.812597  5891 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.851671  1537 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:58:46.812230  5945 raft_consensus.cc:740] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
W20260709 12:58:46.852097  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 45040.2us
I20260709 12:58:46.789167  5943 consensus_queue.cc:1059] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 12:58:46.778223  5861 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:46.850689  5849 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.850553  5940 raft_consensus.cc:2764] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:58:46.798492  5872 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:46.853163  5864 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:46.858105  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:46.855051  5814 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.803821  5885 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:46.871225  1688 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
I20260709 12:58:46.803465  5725 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:46.852730  1583 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:46.862208  5908 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:58:46.875408  1583 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:46.868014  5849 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:46.865142  5933 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:46.873805  5814 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:58:46.905709  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 103682us
I20260709 12:58:46.890996  5845 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:46.907428  1505 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:46.905019  5868 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:46.910243  5868 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.909409  5725 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:46.909126  1505 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:46.861995  5891 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:46.907501  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 313478us
I20260709 12:58:46.904258  5796 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:46.918270  1656 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 12:58:46.919456  5864 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:46.920030  5864 raft_consensus.cc:697] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:46.917404  1608 raft_consensus.cc:1240] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:46.922080  5864 consensus_queue.cc:237] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:46.927765  5872 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:46.909121  5845 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:46.928714  5845 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:46.929625  5891 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:46.931717  5861 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:46.953385  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
W20260709 12:58:46.959981  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 45148.9us
I20260709 12:58:46.913465  5868 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:46.962237  5793 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:46.932847  5908 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:58:46.960120  5943 consensus_queue.cc:1059] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.018s
W20260709 12:58:47.001011  1506 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:51500 dropped due to backpressure: service queue is full with 50 items [suppressed 8 similar messages]
I20260709 12:58:47.001365  1506 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:51500 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2433)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2434)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2437)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2440)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2445)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2447)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2448)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 333)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 334)
I20260709 12:58:46.976797  5729 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:58:46.979125  5944 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:58:46.987365  5908 consensus_queue.cc:1059] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:58:46.987442  5948 log.cc:927] Time spent T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:58:46.966023  5796 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:46.969005  5793 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:46.993546  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1571) took 1041 ms. Trace:
I20260709 12:58:47.030898  1538 rpcz_store.cc:276] 0709 12:58:45.952455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.964891 (+ 12436us) service_pool.cc:224] Handling call
0709 12:58:46.993310 (+1028419us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400073fd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:46.993473 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249721728}
I20260709 12:58:46.994354  5817 raft_consensus.cc:3055] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:58:46.995261  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1551) took 1146 ms. Trace:
I20260709 12:58:47.034945  1534 rpcz_store.cc:276] 0709 12:58:45.854889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.864727 (+  9838us) service_pool.cc:224] Handling call
0709 12:58:46.995051 (+1130324us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b5400246654. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:46.995197 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":354003840}
I20260709 12:58:46.999056  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:47.000377  1690 pending_rounds.cc:85] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 7
I20260709 12:58:46.982223  5955 consensus_queue.cc:1059] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:58:46.913632  5945 consensus_queue.cc:260] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:47.036427  5964 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:46.964382  5725 consensus_queue.cc:1059] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:58:47.036965  1690 pending_rounds.cc:107] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:58:47.037290  1690 raft_consensus.cc:2889] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:47.036446  1541 raft_consensus.cc:2410] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:58:47.037681  5817 raft_consensus.cc:740] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 12:58:47.040428  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 76343.9us
I20260709 12:58:47.043519  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1569) took 1091 ms. Trace:
I20260709 12:58:47.044584  1541 rpcz_store.cc:276] 0709 12:58:45.951926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.998779 (+1046853us) service_pool.cc:224] Handling call
0709 12:58:47.043456 (+ 44677us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:47.047201  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:58:47.054600  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 80411.3us
I20260709 12:58:46.984406  5849 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.061121  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:47.061674  1655 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:47.061866  1538 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:47.064848  1655 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:47.067780  1655 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:47.073110  1655 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:47.077850  1683 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 12:58:47.041724  5384 raft_consensus.cc:3055] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:47.042915  5793 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:47.089706  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 45247.9us
I20260709 12:58:47.097214  1538 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 12:58:47.038023  5796 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.098239  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:47.081939  5890 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:47.081723  5872 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:47.042192  5814 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.086781  5795 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:47.084800  5824 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:47.087239  5384 raft_consensus.cc:740] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:47.037072  5964 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.099804  5955 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:47.115484  5796 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:47.084271  5747 consensus_queue.cc:1059] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:58:47.131912  5814 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:47.109205  5872 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:47.109421  5885 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:47.111433  5890 raft_consensus.cc:697] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:47.112912  5824 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.140789  5796 raft_consensus.cc:3055] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:58:47.195968  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:47.200199  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1570) took 1248 ms. Trace:
I20260709 12:58:47.200632  1539 rpcz_store.cc:276] 0709 12:58:45.952196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.195639 (+1243443us) service_pool.cc:224] Handling call
0709 12:58:47.200135 (+  4496us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:47.201694  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:47.202329  1539 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:58:47.203209  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:47.142395  5872 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:47.167857  5891 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:47.116518  5955 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.142680  5729 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:47.142163  5868 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.140305  5845 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:47.216126  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 133239us
I20260709 12:58:47.197853  5796 raft_consensus.cc:740] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:47.207631  5787 raft_consensus.cc:3055] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:58:47.250746  5964 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:47.251605  5890 consensus_queue.cc:237] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.224036  5787 raft_consensus.cc:740] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:47.253686  5787 consensus_queue.cc:260] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.254747  5787 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:58:47.262331  5652 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:47.264035  5817 consensus_queue.cc:260] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.265139  5817 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:47.265982  5955 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:47.267000  5849 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:47.269536  5803 raft_consensus.cc:3055] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:47.269963  5803 raft_consensus.cc:740] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:58:47.270891  5803 consensus_queue.cc:260] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:47.272117  5803 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:47.283564  5982 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.284173  5982 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.287087  5982 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:47.186056  5384 consensus_queue.cc:260] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:47.306145  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 211917us
W20260709 12:58:47.308068  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:47.310209  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:47.308935  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 93109.2us
I20260709 12:58:47.311594  1581 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:47.317503  1583 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:47.317879  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2433) took 1135 ms. Trace:
I20260709 12:58:47.217712  5729 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:47.318707  1541 rpcz_store.cc:276] 0709 12:58:46.182730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.045272 (+862542us) service_pool.cc:224] Handling call
0709 12:58:47.045664 (+   392us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:47.046058 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:47.046086 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:47.046649 (+   563us) log.cc:844] Serialized 52 byte log entry
0709 12:58:47.191538 (+144889us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:47.317261 (+125723us) log.cc:844] Serialized 14 byte log entry
0709 12:58:47.317543 (+   282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:47.317614 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:47.317655 (+    41us) raft_consensus.cc:1685] finished
0709 12:58:47.317668 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:47.317819 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3241,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":5292,"thread_start_us":190971,"threads_started":2,"wal-append.queue_time_us":187135}
I20260709 12:58:47.327590  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:47.310918  5987 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:47.316291  5384 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:47.315562  5955 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.315343  5964 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:47.336262  1581 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:47.342145  5987 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.351104  5824 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:47.332868  5849 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:47.343034  5964 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.354537  5964 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:47.339943  5869 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:58:47.342803  5955 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.357987  5955 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:47.360122  5987 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:47.364660  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2437) took 1180 ms. Trace:
I20260709 12:58:47.343526  5846 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:58:47.384603  5869 raft_consensus.cc:697] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:47.385730  5869 consensus_queue.cc:237] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.386580  5802 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.387143  5802 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.316615  5796 consensus_queue.cc:260] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.334164  5865 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:58:47.388247  5435 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:47.371943  5824 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.344273  5821 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:58:47.395789  5824 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.392830  5435 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.389459  5964 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:47.400738  5964 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:47.403017  5964 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:47.400193  5435 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:47.386363  5795 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:47.409147  5845 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:47.410804  5872 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.411314  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:47.411975  1686 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
W20260709 12:58:47.415527  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.416877  1505 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:47.418406  1505 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:58:47.419200  5759 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:47.419920  5964 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:47.420558  5964 raft_consensus.cc:697] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:47.420439  5987 consensus_queue.cc:1059] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:47.421588  5964 consensus_queue.cc:237] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:47.423710  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:47.424012  1508 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:47.421903  5987 raft_consensus.cc:3055] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:58:47.424700  5987 raft_consensus.cc:740] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:47.426648  5985 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:47.425653  5987 consensus_queue.cc:260] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.428238  5987 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:47.428656  5849 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:47.431706  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:47.432215  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:47.431922  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:47.432615  1508 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:47.435519  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:47.436417  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:47.436975  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:47.437891  1617 raft_consensus.cc:1240] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:58:47.438496  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 2031) took 1419 ms. Trace:
I20260709 12:58:47.438782  1687 rpcz_store.cc:276] 0709 12:58:46.018899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.148731 (+129832us) service_pool.cc:224] Handling call
0709 12:58:46.149002 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:46.151871 (+  2869us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:46.151900 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:46.158676 (+  6776us) log.cc:844] Serialized 26 byte log entry
0709 12:58:47.275486 (+1116810us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b180041f8c0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf10d1 00007fc85d00ca0f
0709 12:58:47.381212 (+105726us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:47.381530 (+   318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:47.381602 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:47.432585 (+ 50983us) raft_consensus.cc:1685] finished
0709 12:58:47.432603 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:47.438443 (+  5840us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2388,"raft.queue_time_us":6025,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":114,"spinlock_wait_cycles":25741184,"thread_start_us":105535,"threads_started":1,"wal-append.queue_time_us":1238948}
I20260709 12:58:47.440196  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:47.441679  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:47.442175  1608 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 12:58:47.442397  1541 raft_consensus.cc:2410] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 18 because replica has last-logged OpId of term: 17 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 12:58:47.442946  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:47.441124  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:47.444528  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:47.444839  1617 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:47.445990  1615 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 12:58:47.446954  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:47.447579  1686 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:47.447870  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:58:47.421931  5969 log.cc:927] Time spent T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.216s	user 0.003s	sys 0.000s
I20260709 12:58:47.450179  1614 raft_consensus.cc:1275] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:58:47.450929  1610 raft_consensus.cc:1240] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:58:47.407974  5796 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:47.452597  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:47.454203  1611 raft_consensus.cc:1240] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:47.457825  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:47.459821  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:47.459945  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 2033) took 1406 ms. Trace:
I20260709 12:58:47.460615  1689 rpcz_store.cc:276] 0709 12:58:46.053606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.164142 (+110536us) service_pool.cc:224] Handling call
0709 12:58:46.164547 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:46.640222 (+475675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:47.459715 (+819493us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b5400388e54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:47.459890 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1081672448}
I20260709 12:58:47.440826  5759 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:58:47.461016  1535 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1563) took 1510 ms (client timeout 1905 ms). Trace:
W20260709 12:58:47.468362  1535 rpcz_store.cc:269] 0709 12:58:45.950302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.952578 (+  2276us) service_pool.cc:224] Handling call
0709 12:58:47.460816 (+1508238us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b54000744d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:47.460950 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44147456}
I20260709 12:58:47.469750  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:47.470153  5802 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:47.470347  1535 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:47.470629  5642 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:47.471820  5891 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:47.472270  5891 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:47.473702  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2524) took 1133 ms. Trace:
I20260709 12:58:47.474607  1538 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:58:47.475607  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:47.476236  1535 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 12:58:47.476447  5729 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:47.477061  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:47.429932  5985 consensus_queue.cc:1175] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4487a53c51be4634bf1ef29c5248353d" responder_term: 14 status { last_received { term: 14 index: 8 } last_committed_idx: 7 last_received_current_leader { term: 14 index: 8 } }
I20260709 12:58:47.477813  1535 raft_consensus.cc:2393] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 11: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:47.474107  1684 rpcz_store.cc:276] 0709 12:58:46.340041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.676587 (+336546us) service_pool.cc:224] Handling call
0709 12:58:46.773224 (+ 96637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:46.790427 (+ 17203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:46.790464 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:46.790513 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:46.790547 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:47.473486 (+682939us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b5400158954. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:47.473531 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:47.473647 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39027968}
I20260709 12:58:47.480172  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:47.476743  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:47.478734  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:47.486353  1535 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:47.451586  5824 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:47.490132  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:47.490991  1611 raft_consensus.cc:1275] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:58:47.451311  5435 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.468329  5759 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:47.501809  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 165632us
I20260709 12:58:47.505129  1610 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:58:47.505353  1581 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:47.506614  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:47.507392  1538 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:58:47.480187  5787 consensus_queue.cc:1059] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:58:47.501677  5759 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:47.530786  5435 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:47.503793  5872 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:47.533466  5787 raft_consensus.cc:3055] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:58:47.533987  5787 raft_consensus.cc:740] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:47.534799  5787 consensus_queue.cc:260] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.515583  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:47.522049  1581 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:47.536801  1610 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:47.537976  5652 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:47.538421  5652 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.538753  5652 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:47.522890  5998 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:58:47.540668  5804 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.541237  5804 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:47.546049  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.557359  1686 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:47.557263  1610 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:58:47.564656  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:47.565495  1610 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 12:58:47.553526  5787 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:47.585160  5868 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:47.544174  1506 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:51500 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1625)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1626)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1614)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1604)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1610)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1602)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1608)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1603)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1619)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1613)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2468)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1607)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1615)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2473)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1601)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1609)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1624)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2466)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2461)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47506 (request call id 9)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2440)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2445)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2447)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2448)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 333)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 334)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2451)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2453)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2454)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 335)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2459)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1605)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1606)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1612)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1617)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2463)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2464)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2467)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2469)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2470)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2471)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2472)
I20260709 12:58:47.587431  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2432) took 1405 ms. Trace:
I20260709 12:58:47.587815  1537 rpcz_store.cc:276] 0709 12:58:46.182443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.861306 (+678863us) service_pool.cc:224] Handling call
0709 12:58:46.869561 (+  8255us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:58:46.908716 (+ 39155us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:58:46.964712 (+ 55996us) log.cc:844] Serialized 14 byte log entry
0709 12:58:47.111508 (+146796us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:58:47.138348 (+ 26840us) log.cc:844] Serialized 78 byte log entry
0709 12:58:47.138635 (+   287us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:47.141100 (+  2465us) log.cc:844] Serialized 14 byte log entry
0709 12:58:47.164740 (+ 23640us) log.cc:844] Serialized 14 byte log entry
0709 12:58:47.169150 (+  4410us) log.cc:844] Serialized 14 byte log entry
0709 12:58:47.169345 (+   195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:47.587116 (+417771us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b54002e8954. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:47.587167 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:47.587214 (+    47us) raft_consensus.cc:1685] finished
0709 12:58:47.587229 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:47.587376 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17108,"prepare.queue_time_us":83707,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":4124,"raft.queue_time_us":58159,"raft.run_cpu_time_us":635,"raft.run_wall_time_us":36090,"spinlock_wait_cycles":87084160,"thread_start_us":156448,"threads_started":2,"wal-append.queue_time_us":248806}
W20260709 12:58:47.590727  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.590931  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 2037) took 1454 ms. Trace:
I20260709 12:58:47.591320  1683 rpcz_store.cc:276] 0709 12:58:46.136390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.187401 (+ 51011us) service_pool.cc:224] Handling call
0709 12:58:46.187742 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:47.078350 (+890608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:47.590682 (+512332us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b5400189a54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:47.590874 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2046523136}
I20260709 12:58:47.592453  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:47.593050  1683 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:58:47.592736  5804 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:47.595289  5652 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.598501  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:47.599738  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:47.598538  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:47.601210  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:47.602090  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:47.602252  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:47.602558  1616 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
I20260709 12:58:47.602931  1533 raft_consensus.cc:2410] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:58:47.603026  5958 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:47.603528  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1575) took 1574 ms. Trace:
W20260709 12:58:47.603945  1616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 2034) took 1769 ms (client timeout 1801 ms). Trace:
W20260709 12:58:47.604346  1616 rpcz_store.cc:269] 0709 12:58:45.834425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.877881 (+ 43456us) service_pool.cc:224] Handling call
0709 12:58:47.603794 (+1725913us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b54001f6dd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:47.603893 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3882817408}
I20260709 12:58:47.604724  1615 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:47.604991  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:47.605723  1608 raft_consensus.cc:2393] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 11: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:47.606527  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:47.607055  1608 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:47.603657  5958 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.607762  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:47.609191  1614 raft_consensus.cc:1275] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:58:47.610206  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:47.610991  1614 raft_consensus.cc:2368] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 14. Current term is 15.
I20260709 12:58:47.605572  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:47.586549  1506 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:51500 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1625)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1626)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1614)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1604)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1610)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1602)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1608)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1603)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1619)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1613)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2468)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1607)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1615)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2473)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1601)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1609)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1624)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2466)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2461)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47506 (request call id 9)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2440)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2445)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2447)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2448)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 333)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 334)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2451)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2453)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2454)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 335)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2459)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1605)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1606)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1612)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1617)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2463)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2464)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2467)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2469)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2470)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2471)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2472)
I20260709 12:58:47.603868  1533 rpcz_store.cc:276] 0709 12:58:46.028989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.326436 (+297447us) service_pool.cc:224] Handling call
0709 12:58:47.601925 (+1275489us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b5800002798. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc8620170a0 00007fc862016984 00007fc85b5916d4 00007fc85b591662
0709 12:58:47.603473 (+  1548us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3213056}
I20260709 12:58:47.604593  1611 raft_consensus.cc:1240] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:47.605654  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:47.613806  1608 raft_consensus.cc:2393] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 14: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:47.614849  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:47.609965  5891 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.617929  1683 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:58:47.619619  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2506) took 1843 ms. Trace:
I20260709 12:58:47.615499  1533 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 12:58:47.622181  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:47.623219  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:47.620949  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:47.624616  1533 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:58:47.621706  1691 rpcz_store.cc:276] 0709 12:58:45.776506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.788694 (+ 12188us) service_pool.cc:224] Handling call
0709 12:58:45.789139 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:45.945280 (+156141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:47.619346 (+1674066us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b5400388954. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:47.619551 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347396480}
I20260709 12:58:47.626044  1691 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:58:47.627385  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:47.632016  5891 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:47.632462  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:47.643760  1688 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:47.633301  5652 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:47.636201  5970 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:47.645985  5970 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.648753  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:47.648353  5970 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:47.650553  1610 raft_consensus.cc:2393] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 13: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:47.651361  5891 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:47.651993  5891 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:47.654211  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.655014  5891 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:47.638957  1506 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:51500 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1610)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2479)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1602)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1608)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1603)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1619)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1613)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2468)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1607)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2476)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2478)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1615)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2473)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1601)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2477)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1609)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1624)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2466)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2461)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47506 (request call id 9)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2440)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2445)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2447)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2448)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 333)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 334)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2451)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2453)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2454)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 335)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2459)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1605)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1606)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1612)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1617)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2463)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2464)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2467)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2469)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2470)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2471)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2472)
I20260709 12:58:47.639148  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2530) took 1288 ms. Trace:
I20260709 12:58:47.638461  5958 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:47.663690  1611 raft_consensus.cc:1275] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:58:47.628340  1582 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:47.661947  1691 raft_consensus.cc:1275] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:58:47.664736  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:58:47.667601  1581 consensus_peers.cc:597] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:51500 dropped due to backpressure: service queue is full with 50 items. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:47.668728  1505 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:47.659175  1690 rpcz_store.cc:276] 0709 12:58:46.350228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.230036 (+879808us) service_pool.cc:224] Handling call
0709 12:58:47.230388 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:47.254616 (+ 24228us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:47.328742 (+ 74126us) log.cc:844] Serialized 14 byte log entry
0709 12:58:47.454451 (+125709us) log.cc:844] Serialized 14 byte log entry
0709 12:58:47.455481 (+  1030us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:47.465201 (+  9720us) log.cc:844] Serialized 26 byte log entry
0709 12:58:47.465372 (+   171us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:47.465407 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:47.465477 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:47.638922 (+173445us) raft_consensus.cc:1685] finished
0709 12:58:47.638945 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:47.639094 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53568,"prepare.queue_time_us":103180,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":77,"raft.queue_time_us":27034,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":1038,"spinlock_wait_cycles":4297984,"thread_start_us":177486,"threads_started":2,"wal-append.queue_time_us":224616}
I20260709 12:58:47.667328  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:47.674482  1533 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:47.671252  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2531) took 1320 ms. Trace:
I20260709 12:58:47.678994  1687 rpcz_store.cc:276] 0709 12:58:46.350434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.456518 (+1106084us) service_pool.cc:224] Handling call
0709 12:58:47.456763 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:47.456906 (+   143us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:47.487627 (+ 30721us) log.cc:844] Serialized 14 byte log entry
0709 12:58:47.670923 (+183296us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:47.670976 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:47.671017 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:47.671078 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:47.671192 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":33524,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":5945,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":182926,"threads_started":1,"wal-append.queue_time_us":183228}
I20260709 12:58:47.668903  1683 raft_consensus.cc:1275] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:58:47.677109  1505 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:47.685732  1505 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:47.673712  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:47.662591  5826 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:47.690685  1505 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:47.686873  1691 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:47.694723  1654 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:47.670150  5642 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:47.712363  1581 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:47.676187  5970 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:58:47.717458  1654 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:47.720671  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 2035) took 1886 ms. Trace:
I20260709 12:58:47.721551  1613 rpcz_store.cc:276] 0709 12:58:45.834676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.975765 (+141089us) service_pool.cc:224] Handling call
0709 12:58:45.989135 (+ 13370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:46.263322 (+274187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:47.720353 (+1457031us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b5400066dd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:47.720602 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":615633792}
I20260709 12:58:47.722553  1654 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:47.696766  5787 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:47.697595  5891 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:58:47.725171  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:47.725639  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:47.720822  1505 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:47.726797  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:47.727366  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:47.703507  5713 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:47.727556  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:47.697088  5872 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:47.700672  5987 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:47.729980  1505 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:47.730970  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:47.723450  5792 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:47.736078  5796 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:58:47.736573  5885 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:58:47.698529  5795 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:58:47.739145  5759 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:47.703840  5826 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.742503  1533 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 14.
I20260709 12:58:47.743554  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:47.744179  5826 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:47.744850  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:47.746649  5928 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:47.729795  5982 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:58:47.743462  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.748188  5982 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.719206  5869 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:47.718962  5824 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:58:47.725471  5890 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:47.732450  5964 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:47.762799  5982 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:47.765690  5869 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.765944  5824 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.765174  5885 consensus_queue.cc:1059] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:58:47.777935  5824 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:47.778324  5885 raft_consensus.cc:3055] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:47.778806  5885 raft_consensus.cc:740] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:47.782450  5869 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:47.772766  5944 consensus_queue.cc:1059] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:58:47.783553  5944 raft_consensus.cc:3055] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:58:47.783957  5944 raft_consensus.cc:740] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:47.784965  5944 consensus_queue.cc:260] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.786335  5944 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:47.787467  1505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2446) took 1586 ms. Trace:
I20260709 12:58:47.789808  5826 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:47.790380  5826 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.787930  1505 rpcz_store.cc:276] 0709 12:58:46.201275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.787414 (+1586139us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:58:47.764962  5987 consensus_queue.cc:1059] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:58:47.794485  5787 raft_consensus.cc:3055] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:47.763164  5928 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:58:47.794889  5787 raft_consensus.cc:740] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:47.792969  1505 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:51500 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1631)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1619)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1613)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2468)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1607)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1628)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2476)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2478)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1629)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1627)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1615)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2473)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1630)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1601)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2477)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1609)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1624)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2466)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2461)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47506 (request call id 9)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2440)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2445)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2447)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2448)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 333)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 334)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2451)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2453)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2454)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 335)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2459)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1605)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1606)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1612)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1617)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2463)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2464)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2467)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2469)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2470)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2471)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2472)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2481)
I20260709 12:58:47.795756  5787 consensus_queue.cc:260] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.796985  5787 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:47.773562  5890 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:47.798832  5890 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:47.759960  5872 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.802591  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:47.803040  5872 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:47.803666  1612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 2045) took 1965 ms (client timeout 1523 ms). Trace:
W20260709 12:58:47.804122  1612 rpcz_store.cc:269] 0709 12:58:45.840945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.865504 (+ 24559us) service_pool.cc:224] Handling call
0709 12:58:47.803472 (+1937968us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54003b7254. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:47.803594 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":872566528}
I20260709 12:58:47.805217  5759 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:47.773360  5964 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.806015  5964 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:47.779768  5885 consensus_queue.cc:260] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.806859  5885 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:47.810086  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 213) took 1664 ms. Trace:
I20260709 12:58:47.806746  1506 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:51500 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1631)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1619)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1613)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2468)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1607)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1628)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2476)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2478)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1629)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1627)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1615)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2473)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1630)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1601)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2477)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1609)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1624)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2466)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2461)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47506 (request call id 9)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2440)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2445)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2447)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2448)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 333)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 334)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2451)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2453)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2454)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 335)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2459)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1605)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1606)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1612)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1617)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2463)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2464)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2467)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2469)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2470)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2471)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2472)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2481)
I20260709 12:58:47.810498  1609 rpcz_store.cc:276] 0709 12:58:46.145575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.145791 (+   216us) service_pool.cc:224] Handling call
0709 12:58:46.146134 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:47.583169 (+1437035us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:47.583202 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:47.583245 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:47.583273 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:47.809847 (+226574us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b5400445554. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:47.809894 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:47.810029 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3304665984}
I20260709 12:58:47.811383  1583 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:47.813050  5958 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:58:47.813393  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2434) took 1630 ms. Trace:
I20260709 12:58:47.788121  1655 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:47.823367  1583 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:47.820199  1655 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:47.824273  5872 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:47.824627  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:47.813759  1534 rpcz_store.cc:276] 0709 12:58:46.183042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.048764 (+865722us) service_pool.cc:224] Handling call
0709 12:58:47.463103 (+414339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:47.463449 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:47.463475 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:47.463914 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 12:58:47.497503 (+ 33589us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:47.512419 (+ 14916us) log.cc:844] Serialized 14 byte log entry
0709 12:58:47.543113 (+ 30694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:47.543194 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:47.582280 (+ 39086us) raft_consensus.cc:1685] finished
0709 12:58:47.582303 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:47.813230 (+230927us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b54000744d0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:47.813340 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30372,"prepare.queue_time_us":12830,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":33054,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":10105,"spinlock_wait_cycles":952136576,"thread_start_us":33170,"threads_started":1,"wal-append.queue_time_us":107091}
W20260709 12:58:47.831621  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 107006us
I20260709 12:58:47.822412  1506 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:51500 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1631)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1619)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1613)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2468)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1607)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1628)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2476)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2478)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1629)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1627)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1632)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1615)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2473)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1601)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2477)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1609)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1624)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2466)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2461)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47506 (request call id 9)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2440)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2445)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2447)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2448)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 333)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 334)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2451)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2453)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2454)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 335)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2459)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1605)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1606)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1612)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1617)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2463)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2464)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2467)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2469)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2470)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2471)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2472)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2481)
I20260709 12:58:47.832494  1583 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:47.834240  1581 consensus_peers.cc:597] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:51500 dropped due to backpressure: service queue is full with 50 items. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:47.834816  5815 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:58:47.835757  5642 consensus_queue.cc:1048] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:47.826969  5872 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:47.839514  5872 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:47.837052  5713 consensus_queue.cc:1059] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:58:47.840253  5713 raft_consensus.cc:3055] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:47.840632  5713 raft_consensus.cc:740] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:47.841418  5652 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:47.841473  5713 consensus_queue.cc:260] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.842780  5713 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:47.835357  1654 leader_election.cc:400] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 14. Current term is 15.
I20260709 12:58:47.845947  1654 leader_election.cc:403] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:58:47.815536  5826 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:47.849313  1655 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:47.849016  1506 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:51500 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1619)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1613)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2468)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1607)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1628)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2476)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2478)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1629)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1627)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1632)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1615)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2473)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1601)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2477)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1609)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1624)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2466)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2461)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47506 (request call id 9)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2440)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2445)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2447)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2448)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 333)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 334)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2451)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2453)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2454)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 335)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2459)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1605)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1606)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1612)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1617)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2463)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2464)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2467)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2469)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2470)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2471)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2472)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2481)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2484)
I20260709 12:58:47.835462  5815 raft_consensus.cc:697] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:47.863443  5894 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:47.833081  5889 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:58:47.854928  5685 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:58:47.864061  5889 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:47.864552  5889 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:58:47.855334  5652 raft_consensus.cc:697] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:47.861459  5725 raft_consensus.cc:3055] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:58:47.863037  5815 consensus_queue.cc:237] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:47.869746  1542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1592) took 1775 ms (client timeout 1795 ms). Trace:
I20260709 12:58:47.871949  1655 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:47.872972  1542 rpcz_store.cc:269] 0709 12:58:46.093840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.254210 (+160370us) service_pool.cc:224] Handling call
0709 12:58:47.869546 (+1615336us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b54001865d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:47.869686 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47716608}
I20260709 12:58:47.873976  1655 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:47.850626  5891 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 14. Current term is 15.
I20260709 12:58:47.879263  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:47.877605  5793 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:47.888978  5793 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:47.889350  5793 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:47.845327  5982 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.894930  5982 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:47.880398  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:47.897048  1611 raft_consensus.cc:2393] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 11: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:47.880628  1614 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 12:58:47.880775  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:47.877140  5826 consensus_queue.cc:1048] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:58:47.881744  6012 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:47.901544  6012 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:47.902053  6012 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:47.865586  5652 consensus_queue.cc:237] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.882057  5795 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:58:47.904641  5795 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:47.905057  5795 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:58:47.870848  5725 raft_consensus.cc:740] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:47.887379  5861 consensus_queue.cc:1048] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:58:47.879276  1655 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:47.909334  1655 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:47.909899  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 2043) took 1649 ms. Trace:
I20260709 12:58:47.910475  5747 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:47.910138  5826 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:47.910298  1682 rpcz_store.cc:276] 0709 12:58:46.260125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:46.260780 (+   655us) service_pool.cc:224] Handling call
0709 12:58:46.261060 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:46.313640 (+ 52580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:47.909631 (+1595991us) spinlock_profiling.cc:243] Waited 51.7 ms on lock 0x7b5400389854. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:47.909833 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118919936}
I20260709 12:58:47.913563  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:47.917212  1537 raft_consensus.cc:2393] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 16: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:47.918041  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:47.918496  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:47.918640  1537 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 12:58:47.919381  1535 raft_consensus.cc:2410] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:58:47.919656  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:58:47.914341  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.920307  1537 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:47.921677  5890 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.923941  5890 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:47.924585  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.907837  5725 consensus_queue.cc:260] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:47.915390  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:47.925473  5725 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:47.915364  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:47.920251  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:47.911347  1612 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:58:47.929136  1535 raft_consensus.cc:2393] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 12: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:47.929925  1581 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:47.932633  1682 raft_consensus.cc:1240] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:47.932632  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:47.934156  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:47.934425  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:47.935477  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:47.937119  1537 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:47.939159  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:47.939808  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:47.940299  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:47.928663  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 51877.8us
I20260709 12:58:47.949278  1687 raft_consensus.cc:2410] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:58:47.911881  1507 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:42356 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1628)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2476)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2478)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1629)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1627)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1632)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1615)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2473)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1601)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2477)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1609)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1624)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2466)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 2461)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:47506 (request call id 9)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2439)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2440)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2445)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2447)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2448)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 333)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 334)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2451)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2453)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2454)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 335)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2459)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1605)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1606)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1612)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1617)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2463)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2464)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2467)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2469)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2470)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2471)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2472)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2481)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2484)
I20260709 12:58:47.957988  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:47.911827  5826 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:47.962252  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:47.964075  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:47.966262  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:47.972153  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:47.973891  1508 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
W20260709 12:58:47.975955  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:47.976439  1508 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:47.979295  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:47.979936  1612 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:47.983340  1508 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:47.961074  5642 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:47.963001  5826 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:47.988169  1508 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:47.936877  5795 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:47.989699  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 59873.7us
I20260709 12:58:48.005510  1508 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:48.021075  1612 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:58:48.021466  1508 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:47.980253  5817 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:47.960486  5872 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:48.033070  1615 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:47.977142  5891 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:58:47.980609  5885 consensus_queue.cc:1059] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:58:47.984184  5944 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:47.991988  5909 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:48.016980  5926 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:58:48.048766  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 74820.3us
I20260709 12:58:48.018010  5979 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:48.054621  1654 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:48.055819  1508 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:48.027313  5928 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:48.057003  5869 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:48.047423  5964 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:48.057857  2300 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:58:47.984159  5747 consensus_queue.cc:1059] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:58:47.988907  5642 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:48.086882  5824 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:48.099321  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.099721  5652 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:48.082065  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 45386us
I20260709 12:58:48.038661  5970 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:48.040489  5892 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:47.366016  1540 rpcz_store.cc:276] 0709 12:58:46.183960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.260959 (+1076999us) service_pool.cc:224] Handling call
0709 12:58:47.261310 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:47.261699 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:47.261728 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:47.262199 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 12:58:47.314543 (+ 52344us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:47.338243 (+ 23700us) log.cc:844] Serialized 14 byte log entry
0709 12:58:47.338557 (+   314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:47.338638 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:47.364372 (+ 25734us) raft_consensus.cc:1685] finished
0709 12:58:47.364396 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:47.364592 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21008,"raft.queue_time_us":5004,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":2413,"thread_start_us":61375,"threads_started":2,"wal-append.queue_time_us":100054}
I20260709 12:58:48.171463  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:48.172217  1540 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:58:48.118641  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 62897.2us
I20260709 12:58:48.174292  1508 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:48.176023  1508 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
W20260709 12:58:48.119621  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 65099.2us
W20260709 12:58:48.124701  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 162887us
I20260709 12:58:48.138327  1610 raft_consensus.cc:2368] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 13. Current term is 14.
I20260709 12:58:48.143051  5872 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:48.150782  5864 raft_consensus.cc:3055] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:58:48.153174  5964 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:48.153853  1533 raft_consensus.cc:2368] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13.
I20260709 12:58:48.158140  5869 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:48.161019  5642 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:48.129347  5891 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:58:48.169564  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.177212  1654 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:48.124425  5944 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:48.197876  1611 raft_consensus.cc:1275] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:58:48.198863  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:48.180337  5864 raft_consensus.cc:740] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:48.183856  5926 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:48.163045  5928 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:58:48.192302  5909 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:48.183077  5885 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:48.208581  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:48.195745  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:48.169130  5652 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:48.181208  5595 consensus_queue.cc:1048] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:58:48.218173  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:48.218765  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:48.180856  5970 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:48.201963  5872 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:48.220294  1440 catalog_manager.cc:5697] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 7 to 10, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:58:48.221517  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.221690  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:48.201651  5891 raft_consensus.cc:697] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:48.224061  1537 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:48.224047  1541 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 12:58:48.185228  5889 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:48.208241  5795 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:48.229080  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:48.230602  1541 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 12:58:48.231424  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:48.234853  1541 raft_consensus.cc:2410] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:58:48.235440  1537 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:58:48.236364  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:48.236932  1540 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:58:48.236966  1537 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 12:58:48.238442  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:48.239205  1537 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:58:48.239583  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:48.239765  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:48.240906  1540 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:48.242997  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:58:48.234596  6020 log.cc:927] Time spent T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:58:48.240324  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:48.243769  1541 raft_consensus.cc:2393] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 13: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:48.245899  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:48.246819  1541 raft_consensus.cc:2410] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:58:48.248207  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2438) took 2064 ms. Trace:
I20260709 12:58:48.248647  1541 rpcz_store.cc:276] 0709 12:58:46.184243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.247408 (+2063165us) service_pool.cc:224] Handling call
0709 12:58:48.247714 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:48.247893 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:48.247919 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:48.247959 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:48.248000 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:48.248051 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:48.248156 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:48.215888  6021 consensus_queue.cc:1048] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:58:48.250299  5891 consensus_queue.cc:237] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:48.249802  1537 raft_consensus.cc:2393] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 14: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:48.253069  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:48.253719  1542 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:48.254349  1541 raft_consensus.cc:1240] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:48.254989  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2439) took 2070 ms. Trace:
I20260709 12:58:48.256814  1541 rpcz_store.cc:276] 0709 12:58:46.184696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.253933 (+2069237us) service_pool.cc:224] Handling call
0709 12:58:48.254192 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:48.254767 (+   575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:48.254938 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:48.259222  1541 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 12:58:48.259596  1683 raft_consensus.cc:1240] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:48.259860  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2442) took 2060 ms. Trace:
I20260709 12:58:48.260311  1541 rpcz_store.cc:276] 0709 12:58:46.199763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.258734 (+2058971us) service_pool.cc:224] Handling call
0709 12:58:48.259026 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:48.259622 (+   596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:48.259811 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:48.246269  1533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:47506
I20260709 12:58:48.265076  1533 raft_consensus.cc:606] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Received request to transfer leadership to TS c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:48.237326  5872 raft_consensus.cc:697] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:48.266260  1684 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:58:48.266474  1533 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:58:48.268594  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2447) took 2065 ms. Trace:
I20260709 12:58:48.269202  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:48.271075  1683 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:58:48.289170  5824 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:48.290062  1687 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 16. Current term is 17. Ops: []
I20260709 12:58:48.291206  6012 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:48.292274  5919 consensus_queue.cc:1059] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:48.238890  5864 consensus_queue.cc:260] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:48.292984  5821 consensus_queue.cc:1059] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:58:48.294692  1611 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:58:48.286537  5872 consensus_queue.cc:237] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:48.328234  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:48.329356  1687 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:58:48.269313  1533 rpcz_store.cc:276] 0709 12:58:46.201545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.265961 (+2064416us) service_pool.cc:224] Handling call
0709 12:58:48.266265 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:48.266988 (+   723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:48.267199 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:48.225381  5885 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:48.333699  1508 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:48.306850  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2445) took 2105 ms. Trace:
I20260709 12:58:48.308069  5793 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:48.300549  5787 consensus_meta.cc:287] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.001s
I20260709 12:58:48.308915  5970 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:48.310096  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:48.318898  1542 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:58:48.344856  1538 raft_consensus.cc:2410] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:58:48.344825  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 334) took 2053 ms. Trace:
I20260709 12:58:48.345867  1617 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:48.345383  1542 rpcz_store.cc:276] 0709 12:58:46.291620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.344053 (+2052433us) service_pool.cc:224] Handling call
0709 12:58:48.344348 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:48.344530 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:48.344553 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:48.344593 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:48.344621 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:48.344666 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:48.344772 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:48.348242  5919 raft_consensus.cc:3055] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:58:48.348682  5919 raft_consensus.cc:740] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:48.321969  5725 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:48.335970  1683 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:58:48.335465  1541 rpcz_store.cc:276] 0709 12:58:46.200994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.261146 (+2060152us) service_pool.cc:224] Handling call
0709 12:58:48.306440 (+ 45294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:48.306584 (+   144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:48.306602 (+    18us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:48.306630 (+    28us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:48.306650 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:48.306685 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:48.306782 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:48.335875  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 333) took 2050 ms. Trace:
W20260709 12:58:48.313277  6018 log.cc:927] Time spent T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 12:58:48.340569  5928 raft_consensus.cc:2804] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:48.382684  1617 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 12:58:48.383764  1583 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:48.330794  5815 consensus_queue.cc:1059] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
W20260709 12:58:48.391199  6016 log.cc:927] Time spent T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.353s	user 0.003s	sys 0.000s
I20260709 12:58:48.350014  5864 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:48.344192  5824 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:58:48.392246  5889 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:48.394575  5885 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:48.396787  5919 consensus_queue.cc:260] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:48.387962  1533 rpcz_store.cc:276] 0709 12:58:46.285690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.334894 (+2049204us) service_pool.cc:224] Handling call
0709 12:58:48.335332 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:48.335529 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:48.335557 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:48.335604 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:48.335642 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:48.335696 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:48.335811 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:48.401677  1691 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:58:48.403367  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:48.409530  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1610) took 1091 ms. Trace:
I20260709 12:58:48.411175  5817 raft_consensus.cc:3055] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:48.411739  5793 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:48.413509  1440 catalog_manager.cc:5697] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:48.414964  5652 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:48.415584  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:58:48.416100  5894 consensus_meta.cc:287] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.544s	user 0.007s	sys 0.003s
I20260709 12:58:48.353708  5725 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:48.388774  1505 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:51512 dropped due to backpressure: service queue is full with 50 items [suppressed 8 similar messages]
W20260709 12:58:48.390513  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.345647  5980 raft_consensus.cc:3055] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:58:48.426100  1654 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:48.438434  1538 rpcz_store.cc:276] 0709 12:58:47.318953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.802293 (+483340us) service_pool.cc:224] Handling call
0709 12:58:48.409279 (+606986us) spinlock_profiling.cc:243] Waited 541 ms on lock 0x7b540021a2d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:48.409458 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1244966784}
I20260709 12:58:48.438381  1683 raft_consensus.cc:1240] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:48.440717  1690 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:48.458911  1536 raft_consensus.cc:2410] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:58:48.445387  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:48.398254  5826 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:48.432556  5685 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:58:48.427349  5945 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:48.457717  1505 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:51512 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 335)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2459)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1605)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1606)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1612)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1617)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2463)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2464)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2467)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2469)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2470)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2471)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2472)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2481)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2484)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2486)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 337)
I20260709 12:58:48.421402  5928 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:48.473577  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:48.477406  1609 raft_consensus.cc:1240] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:58:48.439857  5817 raft_consensus.cc:740] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:48.481688  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:48.482846  1615 raft_consensus.cc:1240] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:58:48.456038  5868 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:58:48.488766  5994 consensus_queue.cc:1059] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:48.489220  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:48.495333  1505 leader_election.cc:400] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 13. Current term is 14.
I20260709 12:58:48.489801  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:48.506783  1687 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:48.507074  1505 leader_election.cc:403] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:58:48.500788  1690 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:58:48.507463  1611 raft_consensus.cc:2393] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 11: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:48.508172  1505 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:48.510675  1505 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:48.465888  5889 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:58:48.465637  5792 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.464077  5980 raft_consensus.cc:740] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:48.477098  5919 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:58:48.475396  5652 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.483829  5928 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:48.496994  5868 consensus_queue.cc:1243] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:58:48.491436  5885 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.494851  5821 raft_consensus.cc:3055] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:58:48.548858  1686 raft_consensus.cc:1240] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:58:48.508332  5595 consensus_queue.cc:1059] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:58:48.512728  5892 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:48.512410  5909 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:58:48.512400  5685 raft_consensus.cc:697] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:48.535977  5889 raft_consensus.cc:697] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:48.561370  5642 raft_consensus.cc:3055] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:58:48.554162  5821 raft_consensus.cc:740] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:58:48.567582  6028 log.cc:927] Time spent T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 12:58:48.572398  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 262880us
I20260709 12:58:48.560721  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:48.576659  5970 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.525545  5944 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:58:48.591351  1655 leader_election.cc:336] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.131s (SENT)
W20260709 12:58:48.595120  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.517885  5926 consensus_queue.cc:1059] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
W20260709 12:58:48.597676  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:48.600649  1655 leader_election.cc:336] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.636s (SENT)
W20260709 12:58:48.601555  1655 leader_election.cc:336] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.245s (SENT)
I20260709 12:58:48.601913  1655 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:48.526945  5792 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:48.607306  1655 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:51512 dropped due to backpressure: service queue is full with 50 items [suppressed 24 similar messages]
I20260709 12:58:48.608608  1655 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:48.582600  5642 raft_consensus.cc:740] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:48.554872  5599 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:58:48.626139  1655 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:48.547062  5652 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:48.559165  5885 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:48.638703  1655 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:48.639153  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2451) took 1633 ms. Trace:
I20260709 12:58:48.608954  6012 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:48.642302  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:48.645103  1655 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:48.649307  2297 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:58:48.639607  1542 rpcz_store.cc:276] 0709 12:58:47.006892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.347522 (+1340630us) service_pool.cc:224] Handling call
0709 12:58:48.347816 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:48.348018 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:48.480898 (+132880us) log.cc:844] Serialized 14 byte log entry
0709 12:58:48.638775 (+157877us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:48.638837 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:48.638893 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:48.638964 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:48.639092 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":262602,"raft.queue_time_us":252,"thread_start_us":285084,"threads_started":2}
I20260709 12:58:48.679957  1655 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:48.656144  1536 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1557) took 2724 ms (client timeout 2195 ms). Trace:
W20260709 12:58:48.680717  1536 rpcz_store.cc:269] 0709 12:58:45.931257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.931403 (+   146us) service_pool.cc:224] Handling call
0709 12:58:48.655794 (+2724391us) spinlock_profiling.cc:243] Waited 2.52 s on lock 0x7b540045c754. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:48.656008 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5793261952}
I20260709 12:58:48.657801  1539 raft_consensus.cc:1275] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:58:48.625447  5891 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:48.661167  5817 consensus_queue.cc:260] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:48.637586  5793 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:58:48.754743  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 70826.4us
I20260709 12:58:48.658635  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:48.756515  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:48.683317  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:48.757560  1536 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:48.606659  5970 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:48.677228  5824 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:58:48.698825  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.760732  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:48.776108  1542 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 12:58:48.674049  5890 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:58:48.596843  5980 consensus_queue.cc:260] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:48.698292  1655 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:48.684600  5872 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:58:48.781140  1536 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
W20260709 12:58:48.784094  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:48.767695  6027 log.cc:927] Time spent T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:58:48.761436  5795 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:48.795449  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:48.772565  5824 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:58:48.789140  6032 log.cc:927] Time spent T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 12:58:48.787881  5817 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:48.782325  5890 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:48.762562  5891 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:48.813107  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:48.786732  5872 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:48.680581  5685 consensus_queue.cc:237] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:48.681918  5889 consensus_queue.cc:237] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:48.821259  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.822078  1542 raft_consensus.cc:2393] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 11: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:48.786185  5826 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:48.678813  5821 consensus_queue.cc:260] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:48.839454  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.804448  5725 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:48.811049  5980 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:48.765697  5642 consensus_queue.cc:260] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:48.808264  5824 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:48.817030  5890 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:58:48.809834  5944 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 12:58:48.816721  5951 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.009s	sys 0.026s
I20260709 12:58:48.825174  5872 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:48.881942  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:48.883762  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2440) took 2698 ms. Trace:
I20260709 12:58:48.884262  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:48.876945  5951 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.010s	sys 0.026s
I20260709 12:58:48.884173  1537 rpcz_store.cc:276] 0709 12:58:46.185036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.255394 (+2070358us) service_pool.cc:224] Handling call
0709 12:58:48.255705 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:48.256081 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:48.256108 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:48.256588 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 12:58:48.421405 (+164817us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:48.421444 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:48.421513 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:48.883528 (+462015us) raft_consensus.cc:1685] finished
0709 12:58:48.883567 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:48.883701 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":86,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":98,"thread_start_us":124482,"threads_started":1,"wal-append.queue_time_us":257555}
I20260709 12:58:48.888001  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:48.877346  5821 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:58:48.877771  5642 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:48.876746  5926 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.893340  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:48.896039  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 197874us
I20260709 12:58:48.877132  5725 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:48.896191  1542 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:48.896937  1655 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:48.897328  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:48.897921  1542 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:48.877157  5826 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:58:48.902815  1655 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:48.876834  5944 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:58:48.911901  6037 log.cc:927] Time spent T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:58:48.912303  1542 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 14.
I20260709 12:58:48.913345  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:48.913900  1542 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:58:48.918108  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2453) took 1887 ms. Trace:
I20260709 12:58:48.918536  1541 rpcz_store.cc:276] 0709 12:58:47.030633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.387004 (+1356371us) service_pool.cc:224] Handling call
0709 12:58:48.387417 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:48.494582 (+107165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:48.494619 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:48.494665 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:48.494699 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:48.917866 (+423167us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b540045db54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:48.917925 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:48.918049 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245896064}
I20260709 12:58:48.919912  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:48.920781  1542 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:58:48.921841  5815 raft_consensus.cc:3055] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:48.922315  5815 raft_consensus.cc:740] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:48.923174  5815 consensus_queue.cc:260] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:48.923925  5891 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:48.927452  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:48.927762  1567 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:34735 (1 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:34735 timed out after 15.000s (SENT)
I20260709 12:58:48.930877  5872 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:48.907838  5652 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:48.905254  5826 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:58:48.940376  5872 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:48.942915  5872 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:48.945044  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:48.899775  6012 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.903258  5885 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:48.940852  1655 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:48.945837  1535 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:48.899924  5926 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:48.960178  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1628) took 1173 ms. Trace:
I20260709 12:58:48.971269  1535 rpcz_store.cc:276] 0709 12:58:47.786306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.944708 (+1158402us) service_pool.cc:224] Handling call
0709 12:58:48.960107 (+ 15399us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:48.903751  5795 raft_consensus.cc:697] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:48.963568   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:58:48.995518  1535 raft_consensus.cc:1240] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:48.996261  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2459) took 1907 ms. Trace:
I20260709 12:58:48.996611  1535 rpcz_store.cc:276] 0709 12:58:47.088966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.972107 (+1883141us) service_pool.cc:224] Handling call
0709 12:58:48.995328 (+ 23221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:48.996010 (+   682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:48.996202 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:48.997867  1535 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 14. Current term is 15. Ops: []
I20260709 12:58:48.998440  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1605) took 1681 ms. Trace:
I20260709 12:58:48.998747  1535 rpcz_store.cc:276] 0709 12:58:47.316923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.997368 (+1680445us) service_pool.cc:224] Handling call
0709 12:58:48.997689 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:48.998203 (+   514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:48.998387 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:48.999881  1535 raft_consensus.cc:1240] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 12. Current term is 13. Ops: []
W20260709 12:58:49.001242  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:48.900081  5725 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:49.003741  5725 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:48.924350  5815 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:48.957870  6034 log.cc:927] Time spent T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
W20260709 12:58:48.952453  6044 log.cc:927] Time spent T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:58:49.000406  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1606) took 1683 ms. Trace:
W20260709 12:58:48.963521  6039 log.cc:927] Time spent T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.174s	user 0.002s	sys 0.001s
W20260709 12:58:49.001142  6045 log.cc:927] Time spent T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:58:48.988149  5652 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.988095  5885 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.945248  6050 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:49.012370  1535 rpcz_store.cc:276] 0709 12:58:47.317143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.999435 (+1682292us) service_pool.cc:224] Handling call
0709 12:58:48.999718 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.000193 (+   475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.000359 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:49.014793  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 74027us
I20260709 12:58:49.022426  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2448) took 2816 ms. Trace:
I20260709 12:58:49.022541  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2454) took 1984 ms. Trace:
W20260709 12:58:48.963925  6038 log.cc:927] Time spent T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.163s	user 0.004s	sys 0.000s
I20260709 12:58:49.026654  1655 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:49.027981  1655 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:49.026831  1533 rpcz_store.cc:276] 0709 12:58:47.038032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.435715 (+1397683us) service_pool.cc:224] Handling call
0709 12:58:48.436095 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:48.436534 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:48.436566 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:48.461872 (+ 25306us) log.cc:844] Serialized 26 byte log entry
0709 12:58:48.678433 (+216561us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:49.021929 (+343496us) log.cc:844] Serialized 14 byte log entry
0709 12:58:49.022204 (+   275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.022298 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:49.022342 (+    44us) raft_consensus.cc:1685] finished
0709 12:58:49.022354 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:49.022478 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80345,"prepare.queue_time_us":258610,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":95,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":12858,"thread_start_us":391706,"threads_started":2,"wal-append.queue_time_us":306669}
I20260709 12:58:49.026607  1540 rpcz_store.cc:276] 0709 12:58:46.206416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.267783 (+2061367us) service_pool.cc:224] Handling call
0709 12:58:48.305371 (+ 37588us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:48.305765 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:48.305786 (+    21us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:48.339940 (+ 34154us) log.cc:844] Serialized 52 byte log entry
0709 12:58:48.626730 (+286790us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:58:48.798529 (+171799us) log.cc:844] Serialized 14 byte log entry
0709 12:58:48.799522 (+   993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:48.799594 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:49.022193 (+222599us) raft_consensus.cc:1685] finished
0709 12:58:49.022210 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:49.022362 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":306,"prepare.queue_time_us":258946,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":1898,"raft.queue_time_us":4318,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":7300,"thread_start_us":364711,"threads_started":2,"wal-append.queue_time_us":429555}
I20260709 12:58:49.038625  1533 raft_consensus.cc:1275] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:58:49.039454  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1617) took 1712 ms. Trace:
I20260709 12:58:49.039819  1533 rpcz_store.cc:276] 0709 12:58:47.326976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.031573 (+1704597us) service_pool.cc:224] Handling call
0709 12:58:49.031909 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.039219 (+  7310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.039400 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:49.040300  1655 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:49.010336  5970 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:49.013213  5725 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:48.965466  6012 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:49.047564  1533 raft_consensus.cc:1275] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:58:49.049860  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2464) took 1508 ms. Trace:
I20260709 12:58:49.050197  1533 rpcz_store.cc:276] 0709 12:58:47.541444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.040662 (+1499218us) service_pool.cc:224] Handling call
0709 12:58:49.040957 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.049501 (+  8544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.049794 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:49.052316  1655 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:49.053711  1655 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:49.054687  1535 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:58:49.055408  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1612) took 1736 ms. Trace:
I20260709 12:58:49.055714  1535 rpcz_store.cc:276] 0709 12:58:47.319372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.026445 (+1707073us) service_pool.cc:224] Handling call
0709 12:58:49.048667 (+ 22222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.055114 (+  6447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.055342 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:49.028111  6050 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:49.064414  6050 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:58:49.065184  6048 log.cc:927] Time spent T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 12:58:49.056717  5725 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:49.073165  6046 log.cc:927] Time spent T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:58:49.037002  5652 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:49.036827  5885 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:49.042456  5919 consensus_meta.cc:287] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.001s
I20260709 12:58:49.055960  6054 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:58:49.112670  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 59014us
W20260709 12:58:49.209158  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.023804  5982 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:49.128906  5795 consensus_queue.cc:237] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:49.215991  5944 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:49.218067  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2463) took 1677 ms. Trace:
I20260709 12:58:49.244586  1540 rpcz_store.cc:276] 0709 12:58:47.541182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.037864 (+1496682us) service_pool.cc:224] Handling call
0709 12:58:49.217581 (+179717us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.217769 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:49.217795 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:49.217835 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:49.217869 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.217922 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:49.218014 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:49.049321  6053 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:58:49.222159  1541 raft_consensus.cc:1240] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:49.221459  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2467) took 1679 ms. Trace:
I20260709 12:58:49.114111  6052 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:58:49.223781  5796 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:58:49.225500  5891 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:49.247959  1535 rpcz_store.cc:276] 0709 12:58:47.542133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.056773 (+1514640us) service_pool.cc:224] Handling call
0709 12:58:49.215108 (+158335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.215369 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:58:49.217203 (+  1834us) log.cc:844] Serialized 14 byte log entry
0709 12:58:49.221122 (+  3919us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:49.221177 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:49.221217 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.221282 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:49.221401 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1451,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"thread_start_us":3592,"threads_started":1}
I20260709 12:58:49.046020  5909 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:58:49.241248  5928 consensus_meta.cc:287] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.680s	user 0.014s	sys 0.005s
I20260709 12:58:49.242460  1655 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:49.258420  1540 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 13. Current term is 14. Ops: [11.8-13.9]
I20260709 12:58:49.262637  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2469) took 1720 ms. Trace:
I20260709 12:58:49.263073  1540 rpcz_store.cc:276] 0709 12:58:47.542590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.245520 (+1702930us) service_pool.cc:224] Handling call
0709 12:58:49.258165 (+ 12645us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:49.262314 (+  4149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.262570 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:49.265573  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2470) took 1722 ms. Trace:
I20260709 12:58:49.265988  1535 rpcz_store.cc:276] 0709 12:58:47.542811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.257512 (+1714701us) service_pool.cc:224] Handling call
0709 12:58:49.265040 (+  7528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.265229 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:49.265253 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:49.265291 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:49.265326 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.265381 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:49.265502 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:49.250368  5824 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:49.280565  5824 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:49.281725  5885 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:49.283046  5793 consensus_meta.cc:287] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.518s	user 0.010s	sys 0.002s
I20260709 12:58:49.283351  5652 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:49.283885  5926 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:49.283921  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:49.288178  5982 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:49.288887  5982 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:49.291321  5982 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:49.258242  5890 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:49.292603  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:49.293457  5890 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:49.298321  5945 consensus_meta.cc:287] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.818s	user 0.009s	sys 0.003s
I20260709 12:58:49.247804  6053 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:49.299482  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:49.254648  6054 raft_consensus.cc:697] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:49.300829  1683 pending_rounds.cc:85] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 8
I20260709 12:58:49.304647  1683 pending_rounds.cc:107] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:58:49.304982  1683 raft_consensus.cc:2889] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:49.303035  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:49.303170  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:49.258985  5964 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:49.306296  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.257426  5891 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 12:58:49.308360  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 65977.7us
I20260709 12:58:49.308756  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:49.298910  5742 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.317353  1655 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:49.317818  1684 raft_consensus.cc:1275] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:58:49.266944  5796 raft_consensus.cc:697] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 14 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:49.321074  1508 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:49.325044  1655 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:49.265467  5909 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:49.319083  1583 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:49.301316  5944 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.305253  6058 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:49.316164  6046 log.cc:927] Time spent T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:58:49.304086  6053 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:49.332527  1508 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:49.310369  5793 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:58:49.340070  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2575) took 1076 ms. Trace:
I20260709 12:58:49.341289  1687 rpcz_store.cc:276] 0709 12:58:48.263146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.342435 (+ 79289us) service_pool.cc:224] Handling call
0709 12:58:48.342760 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:48.508951 (+166191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.339815 (+830864us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b5400158954. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:49.340010 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":376735616}
I20260709 12:58:49.342269  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:49.334391  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.324612  5891 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:49.269032  5928 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:49.325196  6052 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:58:49.330722  5685 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:49.329133  5982 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:58:49.328917  5872 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:49.330318  5926 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.357571  5926 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:49.359881  5926 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:49.324049  5964 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:49.361044  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 2062) took 1130 ms. Trace:
I20260709 12:58:49.361440  1686 rpcz_store.cc:276] 0709 12:58:48.231115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.231974 (+   859us) service_pool.cc:224] Handling call
0709 12:58:48.242877 (+ 10903us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:48.553585 (+310708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.360764 (+807179us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b540008e8d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:49.360986 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":703069568}
I20260709 12:58:49.362622  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:49.362865  5964 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:49.363245  1686 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
I20260709 12:58:49.365062  5909 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:49.367556  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 335) took 2286 ms. Trace:
I20260709 12:58:49.336781  5824 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:49.337474  5885 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:49.351784  5970 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:49.337340  5826 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:49.352664  6054 consensus_queue.cc:237] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:49.353679  5928 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:49.354116  1540 raft_consensus.cc:1240] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:49.352223  6052 raft_consensus.cc:697] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:49.329365  5742 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:49.356652  5872 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:49.364328  1686 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: []
I20260709 12:58:49.368170  1541 rpcz_store.cc:276] 0709 12:58:47.081088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.950070 (+1868982us) service_pool.cc:224] Handling call
0709 12:58:48.987611 (+ 37541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.247911 (+260300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.367137 (+119226us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54003133d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:49.367444 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":539022208}
I20260709 12:58:49.334223  5944 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:49.371846  1611 consensus_queue.cc:237] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
W20260709 12:58:49.340065  5892 consensus_meta.cc:287] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.760s	user 0.008s	sys 0.005s
I20260709 12:58:49.352176  5725 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:49.378681  5824 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.338459  6012 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:49.349129  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:49.393298  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 155114us
I20260709 12:58:49.395062  1508 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:49.406263  1684 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:58:49.337700  6058 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:49.423036  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.350971  6050 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:49.416572  5824 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:49.386514  5826 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:49.442447  1508 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:58:49.425351  5817 consensus_meta.cc:287] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.610s	user 0.006s	sys 0.007s
W20260709 12:58:49.440164  5864 consensus_meta.cc:287] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.997s	user 0.008s	sys 0.008s
I20260709 12:58:49.449141  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:49.450170  1534 raft_consensus.cc:2410] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:58:49.402217  5892 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 13. Current term is 14.
I20260709 12:58:49.439795  6065 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.437054  5928 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:49.436875  2300 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
W20260709 12:58:49.446409  5821 consensus_meta.cc:287] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.003s
W20260709 12:58:49.458801  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 133848us
I20260709 12:58:49.445485  5885 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:58:49.460939  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:49.448773  5642 consensus_meta.cc:287] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.549s	user 0.011s	sys 0.003s
I20260709 12:58:49.391517  5796 consensus_queue.cc:237] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:49.464970  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.458961  5928 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.476527  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:49.464398  5885 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.466446  5821 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.471246  5889 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:58:49.489518  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:49.489609  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2481) took 1822 ms. Trace:
I20260709 12:58:49.469956  5864 consensus_queue.cc:1059] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:58:49.475060  5642 consensus_queue.cc:1048] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:58:49.481225  5795 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:49.497543  6053 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:49.498137  5795 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:49.501674  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2569) took 1239 ms. Trace:
I20260709 12:58:49.502172  1689 rpcz_store.cc:276] 0709 12:58:48.261764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.261879 (+   115us) service_pool.cc:224] Handling call
0709 12:58:49.500878 (+1238999us) spinlock_profiling.cc:243] Waited 9.67 ms on lock 0x7b5800190898. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc86202afc0 00007fc862015929 00007fc8620153d2 00007fc85b58cbd4
0709 12:58:49.501122 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.501325 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:49.501352 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:49.501397 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:49.501431 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.501491 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:49.501607 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22241024}
I20260709 12:58:49.503626  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:49.451390  6052 consensus_queue.cc:237] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:49.491146  5821 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:49.511125  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:49.511674  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.512979  1505 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:49.471401  6012 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:58:49.515671  5742 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:49.517683  5864 consensus_queue.cc:1243] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:58:49.480022  5928 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:49.522099  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:49.525146  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:49.523945  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:49.526098  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:49.523136  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:49.526615  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:49.526898  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:49.527390  1614 raft_consensus.cc:2393] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 15: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:49.528811  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:49.461179  6065 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:49.534157  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:49.535320  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:49.530145  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:49.504321  1689 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
I20260709 12:58:49.536968  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:49.527707  1684 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:58:49.486460  5885 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:49.539299  1505 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:49.540932  1684 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: []
I20260709 12:58:49.490109  1541 rpcz_store.cc:276] 0709 12:58:47.667111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.388514 (+1721403us) service_pool.cc:224] Handling call
0709 12:58:49.388862 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.389070 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:58:49.389363 (+   293us) log.cc:844] Serialized 14 byte log entry
0709 12:58:49.489218 (+ 99855us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:49.489278 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:49.489327 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.489399 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:49.489542 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1297,"prepare.queue_time_us":147,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":3078,"raft.queue_time_us":1443,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":33232,"thread_start_us":97763,"threads_started":1}
I20260709 12:58:49.542037  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:49.542454  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:49.544229  1690 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: []
I20260709 12:58:49.548624  1614 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 14.
I20260709 12:58:49.549104  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2472) took 2005 ms. Trace:
I20260709 12:58:49.549561  1535 rpcz_store.cc:276] 0709 12:58:47.543248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.267043 (+1723795us) service_pool.cc:224] Handling call
0709 12:58:49.272396 (+  5353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:49.326876 (+ 54480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:49.326918 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:49.327463 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 12:58:49.461578 (+134115us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:49.461618 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.461682 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:49.548883 (+ 87201us) raft_consensus.cc:1685] finished
0709 12:58:49.548907 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:49.549042 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62110,"raft.queue_time_us":56806,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":3099,"thread_start_us":115385,"threads_started":1,"wal-append.queue_time_us":158801}
I20260709 12:58:49.553063  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:49.555032  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:49.529572  5787 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:58:49.525157  5795 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:49.555845  1505 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:49.555121  1654 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:49.557576  1684 raft_consensus.cc:1240] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:49.558450  6067 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:49.560606  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:49.560883  5793 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:49.561299  5793 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.561619  5793 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:49.562726  6058 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:49.564815  5792 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:49.565178  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:49.565817  1609 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:58:49.504346  5824 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:49.566740  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:49.567333  1609 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:58:49.568378  6050 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:49.568958  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:49.569276  5872 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:49.552800  6063 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 12:58:49.570924  6053 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:49.572960  5824 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:49.573184  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2435) took 3389 ms. Trace:
I20260709 12:58:49.573583  1539 rpcz_store.cc:276] 0709 12:58:46.183345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:47.211485 (+1028140us) service_pool.cc:224] Handling call
0709 12:58:48.657390 (+1445905us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:48.681442 (+ 24052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.572989 (+891547us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b540045c750. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:49.573123 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3320320896}
I20260709 12:58:49.574740  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:49.576057  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:49.546105  5725 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:49.577667  5747 raft_consensus.cc:3055] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:49.577831  5944 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:49.578202  5747 raft_consensus.cc:740] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:49.579237  5747 consensus_queue.cc:260] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:49.578379  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:49.583868  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:49.586217  1615 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
I20260709 12:58:49.587019  1617 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 14.
I20260709 12:58:49.588027  1617 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:58:49.589300  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:49.590096  1688 raft_consensus.cc:1240] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:58:49.590399  1683 raft_consensus.cc:1240] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:49.590917  1539 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:49.568164  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:49.591840  1609 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
I20260709 12:58:49.593304  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:49.593966  1541 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:49.595536  5793 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:49.596822  6019 log.cc:927] Time spent T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 1.472s	user 0.008s	sys 0.005s
I20260709 12:58:49.599319  5793 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:49.600164  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2471) took 2057 ms. Trace:
I20260709 12:58:49.600670  1540 rpcz_store.cc:276] 0709 12:58:47.543019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.264243 (+1721224us) service_pool.cc:224] Handling call
0709 12:58:49.304940 (+ 40697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.379332 (+ 74392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.599915 (+220583us) spinlock_profiling.cc:243] Waited 49 ms on lock 0x7b54002e7a54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:49.600097 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112717696}
I20260709 12:58:49.601197  1615 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:58:49.517939  5891 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:49.602399  5725 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.605371  5725 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:49.613853  5725 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:49.616611  6065 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:49.622603  1539 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 12:58:49.601459  5747 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:49.626019  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:49.626241  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:49.627552  1535 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 14.
I20260709 12:58:49.602092  5787 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.604123  6021 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:58:49.639935  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2589) took 1140 ms. Trace:
I20260709 12:58:49.641660  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:49.644364  1541 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 12:58:49.640488  1691 rpcz_store.cc:276] 0709 12:58:48.499554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.500144 (+   590us) service_pool.cc:224] Handling call
0709 12:58:48.500525 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:48.500896 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:58:48.531048 (+ 30152us) log.cc:844] Serialized 14 byte log entry
0709 12:58:48.878536 (+347488us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:49.598770 (+720234us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b2c00128aa8. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85b94aa11 00007fc85b95a372 00007fc85d08ca01 00007fc85d05143a 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2
0709 12:58:49.599208 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 12:58:49.599370 (+   162us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:49.599404 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.599478 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:49.631985 (+ 32507us) raft_consensus.cc:1685] finished
0709 12:58:49.639682 (+  7697us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:49.639854 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":33373,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":3768,"raft.queue_time_us":86085,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":23025,"spinlock_wait_cycles":5373312,"thread_start_us":295162,"threads_started":2,"wal-append.queue_time_us":289619}
I20260709 12:58:49.645045  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:49.646085  1535 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:49.646178  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:49.647195  1541 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:58:49.649665  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:49.649634  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:49.648684  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:49.650506  1691 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:58:49.650521  1689 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:58:49.676522  1691 raft_consensus.cc:1240] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:49.724884  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:49.725778  1540 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 10.
I20260709 12:58:49.737015  1535 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 12:58:49.737975  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:49.741298  1541 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:49.741852  1539 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:58:49.742740  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:49.742916  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:49.743551  1541 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:49.743804  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:49.746754  1689 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:58:49.748557  6065 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:49.749231  6065 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:49.751542  6065 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:49.746842  5928 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:49.753489  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:49.754769  5928 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:49.756029  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:49.756793  1689 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:49.758759  5928 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:49.759390  5928 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:49.633607  5787 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:49.765987  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:49.766551  5787 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:49.767824  5885 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:49.768509  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:49.744369  1539 raft_consensus.cc:2376] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15. Re-sending same reply.
I20260709 12:58:49.769256  1691 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:49.770071  1689 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:58:49.770212  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:49.771523  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:49.773048  5821 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:49.774096  5891 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:49.764598  5928 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:49.748970  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:49.780869  2267 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:49.782330  1535 raft_consensus.cc:2410] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:58:49.780148  1540 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 12:58:49.783710  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:49.786752  1539 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:49.787932  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:49.788767  1689 raft_consensus.cc:2393] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 14: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:49.799394  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:49.800140  1540 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:58:49.784649  5856 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:49.809639  1689 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 16. Current term is 17. Ops: []
I20260709 12:58:49.808933  5856 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:49.812695  5856 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:49.818789  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:49.819401  1541 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 12:58:49.819710  1540 raft_consensus.cc:2368] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 15. Current term is 16.
I20260709 12:58:49.820609  1541 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 16. Current term is 17. Ops: []
I20260709 12:58:49.821441  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2484) took 1973 ms. Trace:
I20260709 12:58:49.809010  5928 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:58:49.844362  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.825022  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 337) took 1597 ms. Trace:
I20260709 12:58:51.102502  1535 rpcz_store.cc:276] 0709 12:58:48.227537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.824174 (+1596637us) service_pool.cc:224] Handling call
0709 12:58:49.824529 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.824704 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:49.824726 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:49.824765 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:49.824802 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.824868 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:49.824968 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:51.103152  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:50.499590  1429 maintenance_manager.cc:419] P 633384cf034a459c9c7300ebf04605f6: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033494
I20260709 12:58:50.525367  1540 raft_consensus.cc:1240] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 7. Current term is 8. Ops: []
I20260709 12:58:51.104528  1508 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:51.104741  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2486) took 3174 ms. Trace:
I20260709 12:58:49.821873  1541 rpcz_store.cc:276] 0709 12:58:47.848286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.820140 (+1971854us) service_pool.cc:224] Handling call
0709 12:58:49.820423 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.821182 (+   759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.821387 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:51.106376  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 338) took 2180 ms. Trace:
I20260709 12:58:51.106794  1535 rpcz_store.cc:276] 0709 12:58:48.925659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.105478 (+2179819us) service_pool.cc:224] Handling call
0709 12:58:51.105844 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:51.106047 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:51.106075 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:51.106118 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:51.106152 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:51.106208 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:51.106317 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16768}
W20260709 12:58:50.729600  1655 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.032s	user 0.016s	sys 0.027s
W20260709 12:58:51.108877  1655 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.411s	user 0.016s	sys 0.028s
W20260709 12:58:51.109202  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 1.41153e+06us
W20260709 12:58:50.771705  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.112041  1540 rpcz_store.cc:276] 0709 12:58:47.930277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.821982 (+1891705us) service_pool.cc:224] Handling call
0709 12:58:50.525167 (+703185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:51.104439 (+579272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:51.104681 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:50.776321  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2465) took 3234 ms. Trace:
I20260709 12:58:51.113435  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:51.113834  1533 rpcz_store.cc:276] 0709 12:58:47.541686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.050978 (+1509292us) service_pool.cc:224] Handling call
0709 12:58:49.051361 (+   383us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:49.214787 (+163426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:49.214869 (+    82us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:49.216806 (+  1937us) log.cc:844] Serialized 52 byte log entry
0709 12:58:50.775777 (+1558971us) spinlock_profiling.cc:243] Waited 5.05 ms on lock 0x7b1800147760. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc85cbf94bc 00007fc859f4748b 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf10d1
0709 12:58:50.775911 (+   134us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:50.775936 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:50.775993 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:50.776032 (+    39us) raft_consensus.cc:1685] finished
0709 12:58:50.776046 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:50.776258 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16446,"raft.queue_time_us":171252,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":14040,"spinlock_wait_cycles":11624704,"thread_start_us":38748,"threads_started":1,"wal-append.queue_time_us":111584,"wal-append.run_cpu_time_us":1980,"wal-append.run_wall_time_us":1025781}
I20260709 12:58:51.115674  1540 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: []
I20260709 12:58:51.116040  1533 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:58:51.116425  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2488) took 1697 ms. Trace:
I20260709 12:58:51.116854  1540 rpcz_store.cc:276] 0709 12:58:49.418777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.115103 (+1696326us) service_pool.cc:224] Handling call
0709 12:58:51.115516 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:51.116126 (+   610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:51.116317 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:50.991678  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2603) took 1692 ms. Trace:
I20260709 12:58:51.117730  1686 rpcz_store.cc:276] 0709 12:58:49.298752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.387944 (+ 89192us) service_pool.cc:224] Handling call
0709 12:58:49.418046 (+ 30102us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.424214 (+  6168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:49.424250 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:49.424298 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:49.424345 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:50.991348 (+1567003us) spinlock_profiling.cc:243] Waited 5.92 ms on lock 0x7b540022b0d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:50.991411 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:50.991595 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13612800}
I20260709 12:58:51.118964  1508 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:58:50.993256  1683 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.368s	user 0.011s	sys 0.023s
I20260709 12:58:50.994359  6091 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 12:58:51.119789  1683 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.494s	user 0.011s	sys 0.023s
I20260709 12:58:51.119877  6091 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:51.122265  6091 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:51.008250  1536 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 8. (term mismatch)
I20260709 12:58:51.122706  1536 pending_rounds.cc:85] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 7
I20260709 12:58:51.101644  6099 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.122989  1536 pending_rounds.cc:107] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 17.8
I20260709 12:58:51.123311  1536 raft_consensus.cc:2889] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:51.123992  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1633) took 2610 ms. Trace:
W20260709 12:58:51.038793  1539 consensus_meta.cc:287] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 1.251s	user 0.006s	sys 0.011s
I20260709 12:58:51.124310  1536 rpcz_store.cc:276] 0709 12:58:48.513348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.007524 (+2494176us) service_pool.cc:224] Handling call
0709 12:58:51.007856 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:51.123762 (+115906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:51.123941 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:51.124900  1539 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:58:51.125480  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1663) took 1553 ms. Trace:
I20260709 12:58:51.125813  1539 rpcz_store.cc:276] 0709 12:58:49.572329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.772337 (+200008us) service_pool.cc:224] Handling call
0709 12:58:51.125420 (+1353083us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:51.123319  6099 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:51.127385  1539 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:58:51.039269  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2596) took 1718 ms. Trace:
I20260709 12:58:51.128773  1690 rpcz_store.cc:276] 0709 12:58:49.296950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.299216 (+  2266us) service_pool.cc:224] Handling call
0709 12:58:49.303807 (+  4591us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.552348 (+248541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:51.014769 (+1462421us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b540041da54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:51.015043 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":552516864}
I20260709 12:58:51.129662  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2490) took 1710 ms. Trace:
I20260709 12:58:51.130043  1533 rpcz_store.cc:276] 0709 12:58:49.419327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.115529 (+1696202us) service_pool.cc:224] Handling call
0709 12:58:51.115821 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:51.129379 (+ 13558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:51.129605 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:50.489002  5742 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:51.138567  1508 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:51.139442  1533 raft_consensus.cc:1275] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:58:51.144835  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 339) took 1907 ms. Trace:
I20260709 12:58:53.408979  1535 rpcz_store.cc:276] 0709 12:58:49.237924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.107847 (+1869923us) service_pool.cc:224] Handling call
0709 12:58:51.108172 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:51.108368 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:51.108395 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:51.108436 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:51.108490 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:51.144608 (+ 36118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:51.144765 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.411497  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:51.132216  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2494) took 1707 ms. Trace:
W20260709 12:58:52.485986  1563 debug-util.cc:398] Leaking SignalData structure 0x7b08003590a0 after lost signal to thread 431
W20260709 12:58:53.415234  1563 debug-util.cc:398] Leaking SignalData structure 0x7b080011ab60 after lost signal to thread 434
I20260709 12:58:51.417037  1655 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:51.075927  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.401576  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2610) took 1927 ms. Trace:
W20260709 12:58:51.021765  1684 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.410s	user 0.011s	sys 0.015s
I20260709 12:58:51.095062  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2601) took 1796 ms. Trace:
I20260709 12:58:51.103775  1687 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 16
W20260709 12:58:53.057734  1534 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 1636) took 4543 ms (client timeout 1785 ms). Trace:
W20260709 12:58:50.996853  2300 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32794 (request call id 264) took 2486 ms (client timeout 2047 ms). Trace:
I20260709 12:58:51.446620  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 12:58:53.545243  2300 rpcz_store.cc:269] 0709 12:58:48.509999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.525784 (+ 15785us) service_pool.cc:224] Handling call
0709 12:58:50.996620 (+2470836us) spinlock_profiling.cc:243] Waited 829 ms on lock 0x7b54007706d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:50.996742 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1905996544}
I20260709 12:58:49.936671  5856 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:49.933169  5885 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:49.887688  5926 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:49.905037  5928 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.571327  5928 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:50.961290  5970 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:53.573191  5970 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.575625  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1696) took 4063 ms. Trace:
I20260709 12:58:53.575896  5856 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:51.097368  6092 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:50.995267  6021 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:53.577078  5926 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:50.748462  6056 log.cc:927] Time spent T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 1.442s	user 0.009s	sys 0.014s
I20260709 12:58:53.579329  6092 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.581601  1536 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:58:53.582357  6092 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:53.583649  6092 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:51.087256  6094 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:51.069218  6095 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:51.067373  6096 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:53.586369  6094 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.587119  6096 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.589794  1541 raft_consensus.cc:1275] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:58:53.590066  6096 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:53.590921  6094 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:51.070313  6097 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:53.586341  6092 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:51.133209  6099 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:51.101663  6100 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:53.596189  6100 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.596884  6092 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:53.599025  6100 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:51.112437  6101 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:51.372651  6102 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.600804  1581 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:53.558141  6145 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:53.601876  6145 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:53.603154  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2491) took 4183 ms. Trace:
I20260709 12:58:51.134428  6105 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.604413  6145 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:53.605325  6105 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:51.137820  6106 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:58:53.608719  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 44260.7us
I20260709 12:58:51.418478  6107 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:53.609776  1581 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:53.610004  6107 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.611043  5815 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:58:53.611662  5815 raft_consensus.cc:697] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:58:53.611902  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:51.402956  6108 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:53.612968  6074 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:58:51.388078  6111 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:51.391150  6110 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.613415  6074 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:53.613909  6074 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:58:53.614188  6110 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:51.396528  6113 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:53.617153  6113 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.620050  6113 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:51.417290  6115 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:53.626704  6115 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.608448  6105 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:53.625218  6107 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:53.603667  1540 rpcz_store.cc:276] 0709 12:58:49.419598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.117645 (+1698047us) service_pool.cc:224] Handling call
0709 12:58:51.117938 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:53.601847 (+2483909us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:53.601910 (+    63us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:53.601960 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:53.602003 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.602635 (+   632us) spinlock_profiling.cc:243] Waited 2.48 s on lock 0x7b54000744d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:53.602682 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:53.602955 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5711998208}
W20260709 12:58:53.629051  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:53.629562  6115 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:51.417630  6116 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:51.416579  6117 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:53.632989  6117 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:53.635860  6117 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:51.436394  6118 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:52.308820  6121 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:50.994952  5826 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:50.765923  6043 log.cc:927] Time spent T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 1.887s	user 0.015s	sys 0.006s
W20260709 12:58:49.925442  6077 log.cc:927] Time spent T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:58:53.226542  6123 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.647636  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2455) took 6593 ms. Trace:
I20260709 12:58:53.647441  6123 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:53.649029  2266 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 1.701s (SENT) [suppressed 12 similar messages]
I20260709 12:58:53.648010  1538 rpcz_store.cc:276] 0709 12:58:47.054062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.459191 (+1405129us) service_pool.cc:224] Handling call
0709 12:58:48.492383 (+ 33192us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:48.492858 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:48.492889 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:48.493509 (+   620us) log.cc:844] Serialized 52 byte log entry
0709 12:58:48.644739 (+151230us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:48.877214 (+232475us) log.cc:844] Serialized 14 byte log entry
0709 12:58:48.877446 (+   232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:48.879233 (+  1787us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:50.765292 (+1886059us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:58:53.647098 (+2881806us) raft_consensus.cc:1685] finished
0709 12:58:53.647222 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:53.647476 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30142,"prepare.queue_time_us":250926,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":3745,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":6710,"spinlock_wait_cycles":5981952,"thread_start_us":219304,"threads_started":2,"wal-append.queue_time_us":293189}
I20260709 12:58:53.649982  6123 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:53.228770  6124 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.230885  6125 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.234460  6126 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.651121  6124 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.651623  6126 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.654146  6124 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:53.237267  6127 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.654964  6127 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.657464  6127 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:53.651087  1538 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:58:53.258128  1537 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.108s	user 0.030s	sys 0.049s
I20260709 12:58:53.298164  6128 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:58:53.299310  1712 debug-util.cc:398] Leaking SignalData structure 0x7b08000d6140 after lost signal to thread 431
I20260709 12:58:53.314980  5742 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:53.321745  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2495) took 3900 ms. Trace:
W20260709 12:58:53.329131  1505 connection.cc:256] RPC call timeout handler was delayed by -2.17262936100002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
I20260709 12:58:53.330202  6130 raft_consensus.cc:2764] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260709 12:58:53.331019  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 2.19239e+06us
I20260709 12:58:53.334323  6129 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:53.354720  6133 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:53.373764  6135 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.376127  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2567) took 5114 ms. Trace:
I20260709 12:58:53.414976  1539 rpcz_store.cc:276] 0709 12:58:49.420393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.126734 (+1706341us) service_pool.cc:224] Handling call
0709 12:58:51.127049 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:51.127762 (+   713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:51.127951 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.431932  6137 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.437464  6138 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:53.654402  6126 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:53.470961  1563 debug-util.cc:398] Leaking SignalData structure 0x7b08001cadc0 after lost signal to thread 1440
W20260709 12:58:53.494984  1507 leader_election.cc:336] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Timed out: RequestConsensusVote RPC to 127.0.107.196:33437 timed out after 2.047s (SENT)
W20260709 12:58:53.498245  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 2.3863e+06us
I20260709 12:58:53.498016  1440 catalog_manager.cc:5697] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:53.667068  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.667955  1613 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
I20260709 12:58:53.485795  1683 rpcz_store.cc:276] 0709 12:58:49.474508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.591074 (+116566us) service_pool.cc:224] Handling call
0709 12:58:49.591293 (+   219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:49.591445 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:58:51.120227 (+1528782us) log.cc:844] Serialized 14 byte log entry
0709 12:58:51.357467 (+237240us) log.cc:844] Serialized 14 byte log entry
0709 12:58:51.401227 (+ 43760us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:51.401280 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:51.401325 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:51.401392 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:51.401515 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5378,"prepare.queue_time_us":356105,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":2395,"raft.queue_time_us":93131,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":146,"thread_start_us":1603839,"threads_started":5,"wal-append.queue_time_us":258732,"wal-append.run_cpu_time_us":1638,"wal-append.run_wall_time_us":1011700}
W20260709 12:58:53.506731  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 2.08718e+06us
I20260709 12:58:53.485772  6141 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.514078  6143 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:58:53.522409  1684 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.910s	user 0.015s	sys 0.015s
I20260709 12:58:53.671901  5826 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:53.661478  6125 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.672807  5826 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.673280  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 2611) took 4164 ms. Trace:
I20260709 12:58:53.673807  1655 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:53.526228  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.675149  5826 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:53.675660  1655 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:53.527447  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.525701  1685 rpcz_store.cc:276] 0709 12:58:49.298269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.312111 (+ 13842us) service_pool.cc:224] Handling call
0709 12:58:49.312406 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:49.319993 (+  7587us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:58:49.320025 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:49.324544 (+  4519us) log.cc:844] Serialized 26 byte log entry
0709 12:58:49.508342 (+183798us) spinlock_profiling.cc:243] Waited 7.84 ms on lock 0x7b18002f35c0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf10d1 00007fc85d00ca0f
0709 12:58:49.785278 (+276936us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:49.785324 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.785397 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:51.094691 (+1309294us) raft_consensus.cc:1685] finished
0709 12:58:51.094712 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:51.094985 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5853,"raft.queue_time_us":10580,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":4182,"spinlock_wait_cycles":18026240,"thread_start_us":276555,"threads_started":1,"wal-append.queue_time_us":591484,"wal-append.run_cpu_time_us":1693,"wal-append.run_wall_time_us":1013937}
I20260709 12:58:53.675076  6125 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:53.529157  5951 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.676601  1507 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:53.676208  6138 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:53.677556  5951 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.677379  6151 consensus_queue.cc:1059] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:58:53.678437  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 183794us
I20260709 12:58:53.529987  5980 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:53.531390  5962 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.676645  6135 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:53.681784  5962 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.532753  6140 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:53.683014  5742 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:53.683321  6140 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.683862  6135 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:53.532924  5821 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.684218  6127 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.533950  5867 consensus_queue.cc:1059] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:58:53.538720  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:53.540163  1534 rpcz_store.cc:269] 0709 12:58:48.514150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.756182 (+242032us) service_pool.cc:224] Handling call
0709 12:58:53.056969 (+4300787us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b540007d854. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:53.057423 (+   454us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1586752384}
W20260709 12:58:49.925606  6079 log.cc:927] Time spent T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:58:53.688800  5652 consensus_queue.cc:1059] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:58:53.689021  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:53.577930  6021 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:50.684001  6040 log.cc:927] Time spent T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 1.876s	user 0.011s	sys 0.001s
I20260709 12:58:53.583722  5926 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:50.745757  6069 log.cc:927] Time spent T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 1.290s	user 0.006s	sys 0.012s
I20260709 12:58:53.691790  6021 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:53.692552  1611 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 11.
I20260709 12:58:53.693848  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.576143  5970 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:53.592617  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1638) took 5078 ms. Trace:
I20260709 12:58:53.592888  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2493) took 4172 ms. Trace:
I20260709 12:58:53.695205  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.591336  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2456) took 6531 ms. Trace:
I20260709 12:58:51.086994  6098 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.592288  6095 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.582530  1687 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 12:58:53.694608  1541 rpcz_store.cc:276] 0709 12:58:48.514655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.105439 (+2590784us) service_pool.cc:224] Handling call
0709 12:58:51.105792 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:53.591496 (+2485704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.592261 (+   765us) spinlock_profiling.cc:243] Waited 2.48 s on lock 0x7b54001879d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:53.592534 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5711692160}
I20260709 12:58:53.697054  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:51.422750  6114 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:53.609015  6106 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.704128  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.704581  6106 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:53.695923  1542 rpcz_store.cc:276] 0709 12:58:47.059454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.921516 (+1862062us) service_pool.cc:224] Handling call
0709 12:58:48.921897 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:48.922242 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:48.922269 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:48.922713 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 12:58:49.014184 (+ 91471us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:58:49.014220 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:49.014298 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:50.747863 (+1733565us) spinlock_profiling.cc:243] Waited 4.76 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:58:53.590747 (+2842884us) raft_consensus.cc:1685] finished
0709 12:58:53.590790 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:53.591147 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6426,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"spinlock_wait_cycles":10953472,"thread_start_us":91061,"threads_started":1,"wal-append.queue_time_us":313743}
I20260709 12:58:53.706343  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:53.684725  5821 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.707036  1613 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:53.707864  1611 raft_consensus.cc:2410] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:58:53.613164  6108 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.685123  5980 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:53.709779  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.710593  1611 raft_consensus.cc:2393] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 15: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:53.710757  5980 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:53.601181  6102 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.711803  1611 raft_consensus.cc:1275] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:58:53.711766  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:53.613176  5815 consensus_queue.cc:237] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.713611  1611 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:58:53.623432  6074 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.624265  6110 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:53.625123  6111 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.631088  1540 raft_consensus.cc:1275] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:58:53.630759  6116 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.637883  6148 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.637835  5804 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.611722  1581 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:53.640826  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.640686  6121 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:53.639187  6092 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:53.641607  6118 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.637838  5685 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.661563  6128 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.660349  1533 rpcz_store.cc:276] 0709 12:58:49.420930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.130858 (+1709928us) service_pool.cc:224] Handling call
0709 12:58:51.139206 (+  8348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:53.321010 (+2181804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.321464 (+   454us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:58:53.662331  1712 debug-util.cc:398] Leaking SignalData structure 0x7b08001cec40 after lost signal to thread 434
I20260709 12:58:53.659171  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1651) took 4187 ms. Trace:
W20260709 12:58:53.654466  1436 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54606 (request call id 145) took 32159 ms (client timeout 15000 ms). Trace:
I20260709 12:58:53.735278  1538 rpcz_store.cc:276] 0709 12:58:49.472056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.650074 (+4178018us) service_pool.cc:224] Handling call
0709 12:58:53.650559 (+   485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:53.658887 (+  8328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.659098 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.664634  6133 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.664757  6137 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.465080   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 12:58:53.664460  1537 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.515s	user 0.031s	sys 0.050s
I20260709 12:58:53.667730  1440 catalog_manager.cc:5697] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 9 to 10, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:53.670957  6129 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:53.675871  1508 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:53.678001  6125 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:53.532164  5814 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.673763  1684 rpcz_store.cc:276] 0709 12:58:49.508870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.606241 (+ 97371us) service_pool.cc:224] Handling call
0709 12:58:49.606573 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:49.606910 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:49.606938 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:49.607418 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 12:58:53.672775 (+4065357us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:53.672846 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.672957 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:53.673012 (+    55us) raft_consensus.cc:1685] finished
0709 12:58:53.673023 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:53.673197 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2191,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":4064774,"threads_started":1,"wal-append.queue_time_us":325199,"wal-append.run_cpu_time_us":1424,"wal-append.run_wall_time_us":1001467}
W20260709 12:58:53.676887  1563 debug-util.cc:398] Leaking SignalData structure 0x7b080010a520 after lost signal to thread 1474
I20260709 12:58:53.663549  1688 rpcz_store.cc:276] 0709 12:58:48.261141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.261249 (+   108us) service_pool.cc:224] Handling call
0709 12:58:49.351957 (+1090708us) spinlock_profiling.cc:243] Waited 6.05 ms on lock 0x7b5800190898. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2ce9c 00007fc859f2ca5b 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc86202afc0 00007fc862015929 00007fc8620153d2 00007fc85b58cbd4
0709 12:58:49.352158 (+   201us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:49.590587 (+238429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.375432 (+3784845us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b5400288cd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:53.375887 (+   455us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":549043840}
I20260709 12:58:53.672039  6141 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.552853  2301 raft_consensus.cc:2368] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12.
I20260709 12:58:53.665609  6113 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.675935  5826 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:58:53.684939  6127 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.684983  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.689131  6140 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:53.576165  1612 rpcz_store.cc:276] 0709 12:58:49.512322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:49.521279 (+  8957us) service_pool.cc:224] Handling call
0709 12:58:49.524050 (+  2771us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:53.501891 (+3977841us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:53.501961 (+    70us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:53.503694 (+  1733us) log.cc:844] Serialized 52 byte log entry
0709 12:58:53.512101 (+  8407us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:53.512141 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.536141 (+ 24000us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:53.575147 (+ 39006us) raft_consensus.cc:1685] finished
0709 12:58:53.575170 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:53.575424 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3976681,"raft.queue_time_us":4010487,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":293,"spinlock_wait_cycles":2432,"thread_start_us":7916,"threads_started":1,"wal-append.queue_time_us":61231}
I20260709 12:58:53.689877  1615 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:53.691118  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.693914  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.695465  1536 rpcz_store.cc:276] 0709 12:58:49.420143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.125212 (+1705069us) service_pool.cc:224] Handling call
0709 12:58:51.125519 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:53.582025 (+2456506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.586040 (+  4015us) spinlock_profiling.cc:243] Waited 2.46 s on lock 0x7b54003d2554. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:53.592836 (+  6796us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5647656320}
I20260709 12:58:53.592388  6097 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:53.696691  1687 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 2085) took 2594 ms (client timeout 1802 ms). Trace:
I20260709 12:58:53.595153  1428 maintenance_manager.cc:643] P 633384cf034a459c9c7300ebf04605f6: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 2.489s	user 0.163s	sys 0.042s Metrics: {"bytes_written":29360,"cfile_init":1,"dirs.queue_time_us":10676,"dirs.run_cpu_time_us":575,"dirs.run_wall_time_us":1462,"drs_written":1,"lbm_read_time_us":372,"lbm_reads_lt_1ms":4,"lbm_write_time_us":127932,"lbm_writes_gt_100_ms":1,"lbm_writes_lt_1ms":29,"peak_mem_usage":0,"rows_written":63,"thread_start_us":53100,"threads_started":2,"wal-append.queue_time_us":73914}
I20260709 12:58:53.676816  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.697414  6098 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:53.745831  1687 rpcz_store.cc:269] 0709 12:58:51.102738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.102891 (+   153us) service_pool.cc:224] Handling call
0709 12:58:53.696554 (+2593663us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.686949  1616 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 11.
I20260709 12:58:53.677064  6117 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:53.696599  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:53.675558  6142 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:53.706672  1542 raft_consensus.cc:1275] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:58:53.715871  1613 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 12:58:53.684429  5962 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:53.722803  1540 pending_rounds.cc:85] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 6
I20260709 12:58:53.725204  1614 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:53.725606  5804 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.727051  6074 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:53.727614  5951 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:53.704730  6114 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:53.741840  1563 debug-util.cc:398] Leaking SignalData structure 0x7b080010b0c0 after lost signal to thread 1488
W20260709 12:58:53.754755  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 79269.3us
I20260709 12:58:53.756769  1608 raft_consensus.cc:2410] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 19 because replica has last-logged OpId of term: 18 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 8.
I20260709 12:58:53.754978  1540 pending_rounds.cc:107] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:58:53.756547  1610 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:58:53.740630  5821 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:53.743474  6095 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:53.759318  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2499) took 4166 ms. Trace:
W20260709 12:58:53.766217  1563 debug-util.cc:398] Leaking SignalData structure 0x7b08002b8f60 after lost signal to thread 1494
I20260709 12:58:53.765036  1542 rpcz_store.cc:276] 0709 12:58:49.589729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.705909 (+4116180us) service_pool.cc:224] Handling call
0709 12:58:53.706342 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:53.750797 (+ 44455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.755690 (+  4893us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.764382  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:58:53.765686  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 89982.1us
I20260709 12:58:53.765743  1540 raft_consensus.cc:2889] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:53.761976  5814 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.768985  6153 raft_consensus.cc:3055] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:58:53.751487  6117 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:53.762202  1617 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:53.757261  5826 raft_consensus.cc:697] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:53.769340  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1648) took 4299 ms. Trace:
I20260709 12:58:53.771476  1540 rpcz_store.cc:276] 0709 12:58:49.470053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.630160 (+4160107us) service_pool.cc:224] Handling call
0709 12:58:53.630663 (+   503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:53.769083 (+138420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.769262 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:58:53.774642  6160 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.774876  6074 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:53.735365  1436 rpcz_store.cc:269] 0709 12:58:21.494959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:21.495371 (+   412us) service_pool.cc:224] Handling call
0709 12:58:53.654153 (+32158782us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:45.096814 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:45.144962 (+ 48148us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:45.144998 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:58:45.145018 (+    20us) tablet.cc:662] Decoding operations
0709 12:58:45.147136 (+  2118us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:45.147226 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:45.147262 (+    36us) tablet.cc:685] Acquiring locks for 26 operations
0709 12:58:45.376212 (+228950us) tablet.cc:701] Row locks acquired
0709 12:58:45.376234 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:58:45.376400 (+   166us) write_op.cc:270] Start()
0709 12:58:45.376555 (+   155us) write_op.cc:276] Timestamp: P: 1783601925376348 usec, L: 0
0709 12:58:45.376577 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:58:45.377447 (+   870us) log.cc:844] Serialized 10237 byte log entry
0709 12:58:46.106002 (+728555us) spinlock_profiling.cc:243] Waited 60.9 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc859f470ac 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b
0709 12:58:46.899896 (+793894us) op_driver.cc:464] REPLICATION: finished
0709 12:58:46.992782 (+ 92886us) write_op.cc:301] APPLY: starting
0709 12:58:46.992868 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:46.993321 (+   453us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:46.993341 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:46.995707 (+  2366us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:46.996034 (+   327us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=26
0709 12:58:46.996095 (+    61us) write_op.cc:312] APPLY: finished
0709 12:58:46.996914 (+   819us) log.cc:844] Serialized 175 byte log entry
0709 12:58:47.038447 (+ 41533us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:47.063537 (+ 25090us) write_op.cc:454] Released schema lock
0709 12:58:47.085230 (+ 21693us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:47.110165 (+ 24935us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:47.111744 (+  1579us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":31926,"reported_tablets":57,"spinlock_wait_cycles":1619840,"child_traces":[["op",{"apply.queue_time_us":90972,"apply.run_cpu_time_us":5074,"apply.run_wall_time_us":107379,"num_ops":26,"prepare.queue_time_us":450634,"prepare.run_cpu_time_us":37246,"prepare.run_wall_time_us":1118954,"raft.queue_time_us":562636,"raft.run_cpu_time_us":24250,"raft.run_wall_time_us":123273,"replication_time_us":1494084,"spinlock_wait_cycles":140111616,"thread_start_us":1246802,"threads_started":4,"wal-append.queue_time_us":863450,"wal-append.run_cpu_time_us":26243,"wal-append.run_wall_time_us":1773683}]]}
I20260709 12:58:53.775511  6160 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.775579  6074 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.776628  5867 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.751820  5685 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.777315  5867 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.779063  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.764281  6138 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:53.750218  6092 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.769388  6153 raft_consensus.cc:740] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:58:53.791311  1563 debug-util.cc:398] Leaking SignalData structure 0x7b080019bda0 after lost signal to thread 1566
I20260709 12:58:53.771258  6117 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:53.743796  6148 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.764401  6113 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.793263  1672 tablet_service.cc:1558] Processing DeleteTablet for tablet d5d52e25b9814edbb805e7d6bcce5b5d with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:50688
I20260709 12:58:53.794154  6128 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:53.795024  6114 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:53.796890  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:53.797113  6121 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:53.794896  6129 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:58:53.792629  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:53.800132  1563 debug-util.cc:398] Leaking SignalData structure 0x7b08001991c0 after lost signal to thread 1581
I20260709 12:58:53.780148  5970 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:58:53.771908  6116 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:53.800894  1712 debug-util.cc:398] Leaking SignalData structure 0x7b08002654e0 after lost signal to thread 1474
I20260709 12:58:53.813037  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1659) took 4290 ms. Trace:
I20260709 12:58:53.804068  1429 maintenance_manager.cc:419] P 633384cf034a459c9c7300ebf04605f6: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8120 bytes on disk
I20260709 12:58:53.777915  5826 consensus_queue.cc:237] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.807475  1616 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 18. Current term is 19. Ops: []
I20260709 12:58:53.842413  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:53.843211  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:53.843538  6102 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:53.800894  1675 tablet_service.cc:1558] Processing DeleteTablet for tablet d127be99e2af41c0808e03480c1b64e3 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:50688
I20260709 12:58:53.808234  6118 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:53.809226  1610 raft_consensus.cc:1275] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:58:53.791010  5867 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:53.802408  6092 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:53.809957  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.810710  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:53.811333  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:53.834704  6133 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:53.836338  6148 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:53.777333  6142 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.809271  5685 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:53.812569  6137 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:53.816013  1563 debug-util.cc:398] Leaking SignalData structure 0x7b080035eb60 after lost signal to thread 1582
I20260709 12:58:53.849489  1612 raft_consensus.cc:1275] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:58:53.850134  1563 debug-util.cc:398] Leaking SignalData structure 0x7b0800037660 after lost signal to thread 1612
W20260709 12:58:53.850823  1563 debug-util.cc:398] Leaking SignalData structure 0x7b080019d9c0 after lost signal to thread 1641
W20260709 12:58:53.851104  1563 debug-util.cc:398] Leaking SignalData structure 0x7b080037a520 after lost signal to thread 1642
I20260709 12:58:53.817956  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:53.851194  1608 raft_consensus.cc:2393] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 11: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:53.852654  6097 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:53.850831  1612 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 12:58:53.853793  1612 pending_rounds.cc:85] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f: Aborting all ops after (but not including) 10
I20260709 12:58:53.854046  1612 pending_rounds.cc:107] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 12:58:53.854285  1612 raft_consensus.cc:2889] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:53.855150  6111 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:53.855415  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:53.856001  6108 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:53.856191  1612 raft_consensus.cc:2393] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 11: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:53.856841  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:53.825678  6098 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:53.858008  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.811960  6106 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.817060  1541 rpcz_store.cc:276] 0709 12:58:49.522787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.697259 (+4174472us) service_pool.cc:224] Handling call
0709 12:58:53.697715 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:53.701702 (+  3987us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:53.701739 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:53.715566 (+ 13827us) log.cc:844] Serialized 26 byte log entry
0709 12:58:53.733725 (+ 18159us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:58:53.764648 (+ 30923us) log.cc:844] Serialized 14 byte log entry
0709 12:58:53.767112 (+  2464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.767279 (+   167us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:53.812776 (+ 45497us) raft_consensus.cc:1685] finished
0709 12:58:53.812796 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:53.812944 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2171,"raft.queue_time_us":2638,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":3280,"spinlock_wait_cycles":20567424,"thread_start_us":43082,"threads_started":2,"wal-append.queue_time_us":18093}
I20260709 12:58:53.824868  6141 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:53.825845  1712 debug-util.cc:398] Leaking SignalData structure 0x7b080017a5c0 after lost signal to thread 1488
W20260709 12:58:53.826042  2301 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32794 (request call id 269) took 2379 ms (client timeout 2047 ms). Trace:
I20260709 12:58:53.825709  6152 raft_consensus.cc:3055] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:58:53.826800  6127 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:53.816529  5970 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.887660  6159 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:53.887831  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.888346  6159 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:53.889438  6155 log.cc:927] Time spent T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.092s	user 0.002s	sys 0.000s
I20260709 12:58:53.889873  1613 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:58:53.801705  5814 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:53.829439  6153 consensus_queue.cc:260] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.889297  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.891464  6153 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:53.891578  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2496) took 4470 ms. Trace:
I20260709 12:58:53.818150  5962 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:53.831463  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.826977  6074 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:53.892023  1535 rpcz_store.cc:276] 0709 12:58:49.421208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.429442 (+4008234us) service_pool.cc:224] Handling call
0709 12:58:53.430009 (+   567us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:53.658338 (+228329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:53.658376 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:53.658904 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 12:58:53.744683 (+ 85779us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:53.744723 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.845663 (+100940us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54002bf054. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:53.845707 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:53.888994 (+ 43287us) spinlock_profiling.cc:243] Waited 7.1 ms on lock 0x7b2400130238. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859dea9c4 00007fc859de8acb 00007fc859fa3dc9 00007fc859fa3a55 00007fc859fa309d 00007fc85cbd510e 00007fc85cbec88c 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221
0709 12:58:53.891330 (+  2336us) raft_consensus.cc:1685] finished
0709 12:58:53.891353 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:53.891504 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1768,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":23691,"spinlock_wait_cycles":540490496,"thread_start_us":85206,"threads_started":1,"wal-append.queue_time_us":126220}
W20260709 12:58:53.832769  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 221265us
I20260709 12:58:53.893334  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.894258  1581 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:53.833425  1655 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:53.891498  1610 raft_consensus.cc:2393] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 15: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:53.834609  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:53.835822  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:53.824060  1508 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:53.891592  1428 maintenance_manager.cc:643] P 633384cf034a459c9c7300ebf04605f6: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.031s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15354,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":3}
I20260709 12:58:53.800899  5804 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:53.844836  1616 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:58:53.847944  1617 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:53.835268  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1657) took 4332 ms. Trace:
I20260709 12:58:53.819428  6160 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:53.878825  1563 debug-util.cc:398] Leaking SignalData structure 0x7b0800183d00 after lost signal to thread 1715
I20260709 12:58:53.847519  6113 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:53.875762  2301 rpcz_store.cc:269] 0709 12:58:51.446206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.446355 (+   149us) service_pool.cc:224] Handling call
0709 12:58:53.825782 (+2379427us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b54007706d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:53.825950 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14338304}
I20260709 12:58:53.882673  6117 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.884946  1615 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:58:53.876277  6152 raft_consensus.cc:740] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:53.890790  6159 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:53.914736  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.915416  6152 consensus_queue.cc:260] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.913486  6111 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:58:53.916553  6152 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:53.917094  6111 raft_consensus.cc:697] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 8 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:53.918229  6111 consensus_queue.cc:237] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.922472  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.922767  1427 catalog_manager.cc:5028] TS 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): tablet d5d52e25b9814edbb805e7d6bcce5b5d (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:58:53.923456  5962 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:53.923784  1427 catalog_manager.cc:5028] TS 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): tablet d127be99e2af41c0808e03480c1b64e3 (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:58:53.915310  6117 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:53.925500  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:53.926195  1611 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:58:53.894695  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.807979  5951 consensus_queue.cc:1059] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:53.877548  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:58:53.897967  1563 debug-util.cc:398] Leaking SignalData structure 0x7b0800368ae0 after lost signal to thread 1716
W20260709 12:58:53.930203  1563 debug-util.cc:398] Leaking SignalData structure 0x7b0800382700 after lost signal to thread 2300
I20260709 12:58:53.897428  1539 rpcz_store.cc:276] 0709 12:58:49.503345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:53.664630 (+4161285us) service_pool.cc:224] Handling call
0709 12:58:53.665102 (+   472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:53.667306 (+  2204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:53.667336 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:53.668012 (+   676us) log.cc:844] Serialized 26 byte log entry
0709 12:58:53.791368 (+123356us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:53.791409 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:53.791485 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:53.835057 (+ 43572us) raft_consensus.cc:1685] finished
0709 12:58:53.835082 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:53.835211 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3264,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":5713,"thread_start_us":122974,"threads_started":1,"wal-append.queue_time_us":151913}
W20260709 12:58:53.900059  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 238222us
W20260709 12:58:53.906834  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 108106us
I20260709 12:58:53.887661  5970 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:58:53.913252  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 79969.5us
I20260709 12:58:53.931876  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:53.933866  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.929193  5962 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:53.933329  1617 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
W20260709 12:58:53.937742  1563 debug-util.cc:398] Leaking SignalData structure 0x7b0800374f40 after lost signal to thread 2327
W20260709 12:58:53.938158  1563 debug-util.cc:398] Leaking SignalData structure 0x7b08003ace80 after lost signal to thread 2328
W20260709 12:58:53.938396  1563 debug-util.cc:398] Leaking SignalData structure 0x7b08003854c0 after lost signal to thread 5652
W20260709 12:58:53.938606  1563 debug-util.cc:398] Leaking SignalData structure 0x7b08003c3500 after lost signal to thread 5685
W20260709 12:58:53.938898  1563 debug-util.cc:398] Leaking SignalData structure 0x7b080011aaa0 after lost signal to thread 5826
W20260709 12:58:53.939116  1563 debug-util.cc:398] Leaking SignalData structure 0x7b080031f180 after lost signal to thread 5856
W20260709 12:58:53.939327  1563 debug-util.cc:398] Leaking SignalData structure 0x7b08001730e0 after lost signal to thread 5885
I20260709 12:58:53.940548  6142 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:53.941783  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.923321  6127 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:58:53.944779  1563 debug-util.cc:398] Leaking SignalData structure 0x7b08003ac240 after lost signal to thread 5926
W20260709 12:58:53.945137  1563 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5080 after lost signal to thread 5928
W20260709 12:58:53.946468  1563 debug-util.cc:398] Leaking SignalData structure 0x7b08003387c0 after lost signal to thread 5970
I20260709 12:58:53.946408  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.947793  5980 raft_consensus.cc:3055] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:58:53.949033  1563 debug-util.cc:398] Leaking SignalData structure 0x7b08002c5540 after lost signal to thread 6021
I20260709 12:58:53.948268  5980 raft_consensus.cc:740] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:53.949496  5814 consensus_queue.cc:1059] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:58:53.952455  1505 connection.cc:256] RPC call timeout handler was delayed by -2.0925136070000576s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21389999999999998s for a response
W20260709 12:58:53.953086  1563 debug-util.cc:398] Leaking SignalData structure 0x7b080033f620 after lost signal to thread 6040
W20260709 12:58:53.953858  1563 debug-util.cc:398] Leaking SignalData structure 0x7b080026d840 after lost signal to thread 6043
W20260709 12:58:53.954111  1563 debug-util.cc:398] Leaking SignalData structure 0x7b08001565a0 after lost signal to thread 6056
I20260709 12:58:53.953800  1655 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:53.955430  6097 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:53.943346  6074 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:58:53.956075  6097 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:53.958333  6097 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:53.959970  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 12:58:53.960721  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 66609.1us
W20260709 12:58:53.961771  6157 log.cc:927] Time spent T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.154s	user 0.003s	sys 0.000s
I20260709 12:58:53.961845  1508 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:53.962494  6098 consensus_queue.cc:1059] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:53.963366  6098 consensus_queue.cc:1243] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 16.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:58:53.945461  6127 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.963905  6127 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:53.964246  6128 raft_consensus.cc:3055] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:58:53.964668  6128 raft_consensus.cc:740] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:53.965378  5951 raft_consensus.cc:3055] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:58:53.962775  6121 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:53.965792  5951 raft_consensus.cc:740] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:53.965718  6128 consensus_queue.cc:260] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.966851  5951 consensus_queue.cc:260] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.967334  6128 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:58:53.968969  1563 debug-util.cc:398] Leaking SignalData structure 0x7b08001cfb80 after lost signal to thread 6069
I20260709 12:58:53.963518  1508 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:58:53.973453  1563 debug-util.cc:398] Leaking SignalData structure 0x7b08001ee480 after lost signal to thread 6077
I20260709 12:58:53.975096  6121 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:53.977416  6121 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:53.963966  6098 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:53.978246  6098 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:53.978710  6098 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:53.979352  1712 debug-util.cc:398] Leaking SignalData structure 0x7b08000f6fc0 after lost signal to thread 1566
I20260709 12:58:53.979563  5814 raft_consensus.cc:3055] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:53.980000  5814 raft_consensus.cc:740] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:53.980791  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.981026  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.982440  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.982602  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.983198  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.983393  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.978488  1655 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:58:53.973937  1563 debug-util.cc:398] Leaking SignalData structure 0x7b08003a4e20 after lost signal to thread 6079
I20260709 12:58:53.985569  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.991472  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.993386  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.995101  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:53.996678  1505 connection.cc:256] RPC call timeout handler was delayed by -1.9714547260000472s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2215s for a response
W20260709 12:58:53.997161  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:53.997392  1505 connection.cc:256] RPC call timeout handler was delayed by -1.7937129759999948s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24270000000000003s for a response
I20260709 12:58:53.998507  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:53.989763  5951 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:58:54.003536  5814 consensus_queue.cc:260] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.002149  6117 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:54.012995  6117 raft_consensus.cc:697] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:54.002291  6097 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:58:54.014106  6152 consensus_queue.cc:1059] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:58:53.999621  6142 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:58:54.015089  6142 raft_consensus.cc:697] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:54.015877  6074 consensus_queue.cc:1059] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:54.016418  6142 consensus_queue.cc:237] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.017355  6151 raft_consensus.cc:3055] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:54.017783  6151 raft_consensus.cc:740] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:54.018806  6151 consensus_queue.cc:260] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.019713  6152 raft_consensus.cc:3055] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:58:53.999784  5652 consensus_queue.cc:1059] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:58:54.020650  5652 raft_consensus.cc:3055] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:58:54.021005  5652 raft_consensus.cc:740] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:54.022142  1687 raft_consensus.cc:1275] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:58:54.021881  5652 consensus_queue.cc:260] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.009627  6106 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:54.020196  6152 raft_consensus.cc:740] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:54.011631  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.024557  1609 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:54.025198  6125 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:53.977653  5980 consensus_queue.cc:260] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:54.010176  1655 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:54.025904  1534 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:54.026258  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.026969  1614 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 14.
I20260709 12:58:54.027971  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.028335  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.028849  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.001116  6121 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:54.029150  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:54.029980  5980 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:54.030483  6113 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:58:54.009658  5814 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:54.031328  5821 consensus_queue.cc:1175] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" responder_term: 16 status { last_received { term: 13 index: 6 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: [15.7-15.7]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:58:54.032529  6113 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:54.033474  1655 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:54.034420  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:54.023314  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.035838  6113 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:58:54.010875  1581 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:54.036711  5826 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:58:54.012152  1712 debug-util.cc:398] Leaking SignalData structure 0x7b0800190740 after lost signal to thread 1641
I20260709 12:58:53.998471  5685 consensus_queue.cc:1059] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:58:54.043468  1508 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:54.029676  6121 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.036768  1655 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:54.014003  6117 consensus_queue.cc:237] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.048352  1616 raft_consensus.cc:2393] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 14: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 12:58:54.037460  1712 debug-util.cc:398] Leaking SignalData structure 0x7b080037ca00 after lost signal to thread 1642
I20260709 12:58:54.024814  6152 consensus_queue.cc:260] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.023335  5652 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:58:54.050563  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.011740  6127 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.050292  5821 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:54.020186  6151 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:58:54.054349  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.057344  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:58:54.059281  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:54.065704  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.046468  6095 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:54.056815  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 53219.6us
I20260709 12:58:54.075160  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.056984  6108 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:54.077200  1655 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:58:54.078680  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 77230.4us
I20260709 12:58:54.083076  1534 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 12.
I20260709 12:58:54.053121  6097 raft_consensus.cc:697] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 12:58:54.087929  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.094175  6125 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.094750  6125 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.096776  1610 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:54.097376  5926 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:58:54.096910  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 68983.5us
I20260709 12:58:54.094005  6098 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.094058  6152 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:58:54.104249  1712 debug-util.cc:398] Leaking SignalData structure 0x7b080030fb40 after lost signal to thread 1715
W20260709 12:58:54.107410  1505 connection.cc:256] RPC call timeout handler was delayed by -1.0098136070000692s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33420000000000005s for a response
I20260709 12:58:54.079087  6108 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:54.108960  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.109666  6097 consensus_queue.cc:237] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.110692  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.111373  1684 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
W20260709 12:58:54.113976  1712 debug-util.cc:398] Leaking SignalData structure 0x7b080016d4a0 after lost signal to thread 1716
I20260709 12:58:54.114459  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:54.115269  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 47216.8us
I20260709 12:58:54.113380  6126 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:54.113507  6124 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.122828  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2487) took 4704 ms. Trace:
I20260709 12:58:54.116645  6108 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:54.133739  6130 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.137851  6124 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.138320  6130 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.140313  1684 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: []
I20260709 12:58:54.140640  6122 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:54.141229  6122 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.142978  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.144712  1655 leader_election.cc:400] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 15. Current term is 16.
I20260709 12:58:54.144985  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.145511  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.146332  6141 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:58:54.146588  1686 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:54.146986  6141 raft_consensus.cc:697] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:54.147396  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.147845  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.148226  1691 raft_consensus.cc:2410] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:58:54.147989  6141 consensus_queue.cc:237] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.117273  6123 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:54.149485  6123 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:54.150064  1712 debug-util.cc:398] Leaking SignalData structure 0x7b08002e3320 after lost signal to thread 2327
W20260709 12:58:54.150422  1712 debug-util.cc:398] Leaking SignalData structure 0x7b0800329520 after lost signal to thread 2328
I20260709 12:58:54.146986  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.145057  1655 leader_election.cc:403] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:58:54.132298  1582 consensus_peers.cc:597] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 95abfe15f7d54f3fb0f01f162b262561. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:58:54.154228  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 55335.2us
I20260709 12:58:54.085952  6095 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.159865  1688 raft_consensus.cc:2393] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 17: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:54.162128  2267 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:54.162732  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.128877  6096 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:54.163818  5856 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:58:54.163658  6096 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.164501  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.165141  1616 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 17.
I20260709 12:58:54.165813  5970 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.161167  5926 raft_consensus.cc:697] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:54.168123  5970 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:54.167747  5926 consensus_queue.cc:237] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.117100  5962 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.183764  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.168321  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.157560  6126 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.169143  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.169430  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.164543  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.167603  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.162773  6127 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:54.166121  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.164070  6101 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:54.184510  1608 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:54.153195  6105 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.171047  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.171597  6160 raft_consensus.cc:3055] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:54.172840  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.191906  1690 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:58:54.174117  1655 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:54.196132  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.117712  5814 consensus_queue.cc:1048] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:58:54.174779  6111 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 15. Current term is 16.
I20260709 12:58:54.201222  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.170578  6125 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:54.176162  6124 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:54.184876  1683 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 12:58:54.164501  5856 raft_consensus.cc:697] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 12 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:58:54.196539  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.218477  1615 raft_consensus.cc:2410] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:58:54.173502  6123 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:54.198391  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.196133  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.199080  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:54.206604  6173 log.cc:927] Time spent T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:58:54.206794  6121 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:54.205046  6098 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:54.207899  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.227592  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.228513  1612 raft_consensus.cc:2410] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 17 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 12:58:54.229382  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.208190  6095 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:54.208761  6096 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:54.208988  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.231818  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.212390  6122 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:54.212783  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.233073  1613 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 12:58:54.206874  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:54.234014  1608 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:54.214526  6130 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:54.236941  1617 raft_consensus.cc:2393] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 19: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:54.214929  6113 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:54.215373  6101 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.215083  1655 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:54.220321  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.131083  1537 rpcz_store.cc:276] 0709 12:58:49.418440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:51.110527 (+1692087us) service_pool.cc:224] Handling call
0709 12:58:51.110906 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:51.148443 (+ 37537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:51.148498 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:51.149185 (+   687us) log.cc:844] Serialized 26 byte log entry
0709 12:58:53.746231 (+2597046us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:53.945888 (+199657us) log.cc:844] Serialized 14 byte log entry
0709 12:58:54.103735 (+157847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:54.114938 (+ 11203us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:54.114988 (+    50us) raft_consensus.cc:1685] finished
0709 12:58:54.114999 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:54.122755 (+  7756us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33338,"prepare.queue_time_us":97966,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":42265,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":1513,"thread_start_us":2896135,"threads_started":4,"wal-append.queue_time_us":252999,"wal-append.run_cpu_time_us":2219,"wal-append.run_wall_time_us":1014801}
W20260709 12:58:54.223578  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.221719  1616 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
I20260709 12:58:54.207410  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.216667  5826 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:54.196374  6160 raft_consensus.cc:740] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:54.249130  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.260506  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:54.257305  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.263357  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.213233  6105 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.265342  6160 consensus_queue.cc:260] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:58:54.268061  1611 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 12:58:54.283560  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:54.278358  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 63421.1us
I20260709 12:58:54.266986  6160 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:54.256455  6123 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.291272  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.293772  1683 raft_consensus.cc:2393] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 17: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:54.263628  6124 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.285763  6105 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:54.316108  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.302176  6113 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:54.345727  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:54.349244  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.344152  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.314296  6123 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.352135  6123 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:54.353539  1581 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:54.354476  5826 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:54.355903  6116 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:54.364869  1583 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:54.368846  1612 raft_consensus.cc:2410] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:58:54.372975  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.373844  1687 raft_consensus.cc:2393] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 12: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:54.373052  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.374923  1683 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:58:54.316646  5814 consensus_queue.cc:1048] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:58:54.382423  1608 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
I20260709 12:58:54.321429  6124 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.322749  6118 consensus_queue.cc:1048] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:58:54.343344  5951 consensus_queue.cc:1059] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:58:54.394594  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.395237  6124 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:54.395514  1683 raft_consensus.cc:2410] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 17 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 12:58:54.321959  5856 consensus_queue.cc:237] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:54.396267  6101 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:54.398154  5826 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.398737  5826 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.399730  6108 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:54.409929  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 65020.4us
I20260709 12:58:54.410610  1583 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:54.411260  1614 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 17.
I20260709 12:58:54.412709  5962 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:54.412827  6101 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:58:54.420222  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.415441  6126 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:54.416091  1505 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:54.421308  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.427804  1686 raft_consensus.cc:2410] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:58:54.373565  6113 raft_consensus.cc:697] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:54.424120  1583 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:54.424718  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.390076  6151 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:58:54.408465  5652 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:58:54.428309  6182 log.cc:927] Time spent T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:58:54.443295  1505 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:54.428194  5826 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:54.433836  5814 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:54.513581  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.440097  6151 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:54.452534  5804 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:58:54.529088  5804 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.529423  5821 raft_consensus.cc:3055] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:54.529536  5804 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:58:54.529856  5821 raft_consensus.cc:740] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:54.530742  5821 consensus_queue.cc:260] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.514688  5814 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.535040  5814 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:58:54.524302  6187 log.cc:927] Time spent T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:58:54.524595  6151 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:54.547333  6113 consensus_queue.cc:237] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.562184  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.562443  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.563160  1684 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 12:58:54.563544  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:54.563910  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.564126  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:54.564801  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:54.565227  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.565685  6108 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:54.566126  1682 raft_consensus.cc:2410] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:58:54.567209  1685 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:54.564747  1687 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:58:54.567112  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.573166  1684 raft_consensus.cc:2393] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 14: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:54.574366  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.565407  1683 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:54.579092  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:58:54.584026  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 159280us
I20260709 12:58:54.585289  1687 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
I20260709 12:58:54.583380  1505 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:54.449787  5926 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:58:54.519286  6126 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:54.589098  1686 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:54.591655  5814 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.596645  5814 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:54.594120  1685 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
W20260709 12:58:54.602315  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 89265.9us
I20260709 12:58:54.606631  1581 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:54.590693  6126 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.589833  5926 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:54.619880  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:54.621112  5926 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:58:54.621356  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:54.622045  1682 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:58:54.625460  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.624377  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:54.625974  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.629887  1687 raft_consensus.cc:1275] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 12:58:54.630390  1687 pending_rounds.cc:85] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 7
I20260709 12:58:54.630986  1687 pending_rounds.cc:107] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:58:54.631273  1687 raft_consensus.cc:2889] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:54.604974  6101 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:58:54.623227  6126 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:54.641912  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 57134.8us
W20260709 12:58:54.641952  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 58658.8us
I20260709 12:58:54.645273  1505 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:54.629808  6154 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:54.647850  1687 raft_consensus.cc:1240] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 14. Current term is 15. Ops: []
I20260709 12:58:54.653987  1686 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 12:58:54.656669  1682 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:58:54.656770  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.657281  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.657800  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.658437  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.659197  1686 raft_consensus.cc:2393] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 14: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:54.627221  5804 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.659920  1581 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:54.661018  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.662055  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.662567  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.663113  1687 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 15: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:54.665354  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.658233  6124 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:54.666487  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.665808  6154 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:58:54.675556  1505 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:54.676991  1505 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:54.661732  6113 consensus_queue.cc:1059] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:58:54.685135  6101 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:54.674714  6154 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.689345  1505 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:54.692687  1505 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:54.690181  6124 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:54.694435  6105 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:58:54.699087  6124 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.699532  6124 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:54.700273  1683 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 12:58:54.690464  6101 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:54.691963  6154 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:54.702320  5970 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:58:54.701347  6105 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:54.703095  1505 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:54.697054  6108 raft_consensus.cc:3055] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:58:54.703522  5970 raft_consensus.cc:697] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:54.709823  6108 raft_consensus.cc:740] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:54.710498  5970 consensus_queue.cc:237] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.710851  6108 consensus_queue.cc:260] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:54.712088  6197 log.cc:927] Time spent T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.092s	user 0.002s	sys 0.000s
I20260709 12:58:54.702672  6101 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:54.711010  6124 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:54.706913  5652 consensus_queue.cc:1175] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4487a53c51be4634bf1ef29c5248353d" responder_term: 10 status { last_received { term: 10 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 10 index: 6 } }
I20260709 12:58:54.695262  6151 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.705209  6105 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:54.720408  6151 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:54.723095  6124 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:54.729836  1440 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38804 (request call id 39) took 10351 ms. Trace:
I20260709 12:58:54.730286  5821 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:54.733336  5685 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:54.712188  6108 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:58:54.734011  1583 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:54.735351  5685 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:58:54.735929  5685 raft_consensus.cc:697] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:54.735275  5951 consensus_queue.cc:1059] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:58:54.737545  5951 raft_consensus.cc:3055] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:58:54.737323  5685 consensus_queue.cc:237] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.737936  5951 raft_consensus.cc:740] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:54.738847  5951 consensus_queue.cc:260] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.739990  5951 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:54.744555  1654 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:54.744131  1438 catalog_manager.cc:5697] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 5 to 12, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 12 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:54.745633  6117 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:58:54.745832  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 70934.6us
I20260709 12:58:54.746891  6117 consensus_queue.cc:1048] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:54.746927  6105 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.747514  1654 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:54.748718  6117 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:58:54.750754  1438 catalog_manager.cc:5697] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 9 to 11, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 11 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:54.747939  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:54.754010  5980 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:58:54.754527  6101 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.755591  6165 consensus_queue.cc:1048] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:54.756668  6152 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:54.757220  6151 consensus_queue.cc:1048] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:54.759284   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:54.730293  1440 rpcz_store.cc:276] 0709 12:58:44.378842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:44.379016 (+   174us) service_pool.cc:224] Handling call
0709 12:58:54.729740 (+10350724us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:53.904695 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:53.905339 (+   644us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:53.905392 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:58:53.905410 (+    18us) tablet.cc:662] Decoding operations
0709 12:58:53.906070 (+   660us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:53.906174 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:53.906202 (+    28us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:58:53.933604 (+ 27402us) tablet.cc:701] Row locks acquired
0709 12:58:53.933658 (+    54us) write_op.cc:260] PREPARE: finished
0709 12:58:53.933864 (+   206us) write_op.cc:270] Start()
0709 12:58:53.934007 (+   143us) write_op.cc:276] Timestamp: P: 1783601933933800 usec, L: 0
0709 12:58:53.934046 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 12:58:53.934890 (+   844us) log.cc:844] Serialized 1685 byte log entry
0709 12:58:54.181485 (+246595us) op_driver.cc:464] REPLICATION: finished
0709 12:58:54.534044 (+352559us) write_op.cc:301] APPLY: starting
0709 12:58:54.534145 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:54.635094 (+100949us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:54.635223 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:54.686711 (+ 51488us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:54.688235 (+  1524us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 12:58:54.688286 (+    51us) write_op.cc:312] APPLY: finished
0709 12:58:54.690121 (+  1835us) log.cc:844] Serialized 48 byte log entry
0709 12:58:54.691705 (+  1584us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:54.692771 (+  1066us) write_op.cc:454] Released schema lock
0709 12:58:54.692863 (+    92us) write_op.cc:341] FINISH: Updating metrics
0709 12:58:54.694324 (+  1461us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:54.697235 (+  2911us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5528724,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":324414,"apply.run_cpu_time_us":13771,"apply.run_wall_time_us":160248,"cfile_cache_hit":14,"cfile_cache_hit_bytes":14637,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6218,"cfile_init":1,"lbm_read_time_us":40962,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":7,"num_ops":4,"prepare.queue_time_us":46012,"prepare.run_cpu_time_us":3630,"prepare.run_wall_time_us":30697,"replication_time_us":196554,"thread_start_us":197125,"threads_started":2}]]}
I20260709 12:58:54.762648  6126 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.763523  6105 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:54.763257  6154 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.786978  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:54.764192  5804 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:54.766983  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:54.788444  1685 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:58:54.767500  5926 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:54.768419  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 65370.1us
I20260709 12:58:54.768688  6130 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:58:54.777024  6202 log.cc:927] Time spent T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:58:54.777348  1537 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 12:58:54.793355  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 45922.1us
I20260709 12:58:54.780081  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:54.780012  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:54.795126  1535 raft_consensus.cc:2393] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 14: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:54.785796  6113 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:58:54.790305  6130 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:54.790601  1539 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 12:58:54.795581  1438 catalog_manager.cc:5697] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 11 to 15, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 15 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:54.797668  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:54.796554  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.798367  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:54.802899  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:54.810781  1541 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:54.800182  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:54.811568  1612 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:54.800287  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.798592  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.811249  1610 raft_consensus.cc:2393] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 16: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:54.812973  1614 raft_consensus.cc:2410] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:58:54.806041  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:54.814131  6200 log.cc:927] Time spent T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 12:58:54.802699  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:54.806283  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.799418  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:54.815564  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.816143  1542 raft_consensus.cc:2393] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 15: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:54.816447  1608 raft_consensus.cc:2410] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:58:54.799721  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:54.817113  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.817423  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.806599  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.818446  1616 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
I20260709 12:58:54.798179  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:54.821063  1613 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:54.799970  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.800945  5867 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:54.820307  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:54.805441  6126 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:54.825713  1688 raft_consensus.cc:2393] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 16: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:54.824888  1438 catalog_manager.cc:5697] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 10 to 13, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 13 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:54.805737  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:54.826892  1540 raft_consensus.cc:2393] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 12: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:54.798506  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:54.827821  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:54.828462  1541 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:54.817757  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.817335  1536 raft_consensus.cc:2410] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:58:54.813369  1685 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 12:58:54.815521  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.831168  1612 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 12:58:54.835887  1537 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 12:58:54.838002  1613 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
I20260709 12:58:54.827069  1438 catalog_manager.cc:5697] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:54.802870  6130 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:58:54.825276  5867 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.839501  6117 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:54.839730  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:54.841514  1583 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:54.847451  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.844761  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.845304  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.843920  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:54.848107  1616 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 11.
I20260709 12:58:54.848713  1608 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 11.
I20260709 12:58:54.848706  1609 raft_consensus.cc:2376] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15. Re-sending same reply.
I20260709 12:58:54.847904  1542 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:58:54.803503  6154 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:54.853610  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.854946  1654 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:54.859992  1615 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:54.862236  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:54.862862  1610 raft_consensus.cc:2376] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16. Re-sending same reply.
I20260709 12:58:54.863229  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.863859  1617 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:58:54.863979  5867 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:54.865320  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.862031  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.865765  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.866016  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:54.866201  1616 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 12:58:54.863709  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.867406  1610 raft_consensus.cc:2376] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12. Re-sending same reply.
I20260709 12:58:54.868274  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:54.868825  1614 raft_consensus.cc:2393] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 16: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:54.869583  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.870769  1614 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:54.873313  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.875432  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.864253  2266 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:54.875887  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:54.866348  1609 raft_consensus.cc:2376] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16. Re-sending same reply.
I20260709 12:58:54.877338  1542 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:58:54.878245  5926 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:54.880494  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:54.881104  1536 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:58:54.884752  1608 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 17.
I20260709 12:58:54.862102  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:54.886487  1537 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:54.868404  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.888144  1610 raft_consensus.cc:2376] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15. Re-sending same reply.
I20260709 12:58:54.889878  1617 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:54.890362  1542 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:58:54.892141  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.893157  1614 raft_consensus.cc:1275] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:58:54.861320  1438 catalog_manager.cc:5697] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:54.852730  6151 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:58:54.880352  6183 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:54.898809  6117 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:54.906059  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.906983  1614 raft_consensus.cc:2393] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 15: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:54.907059  1537 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:58:54.908151  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:54.905442  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 50579.6us
I20260709 12:58:54.914593  1537 raft_consensus.cc:1240] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:54.917768  2266 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:54.918442  1438 catalog_manager.cc:5697] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 5 to 12, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 12 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:54.922973  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:54.924060  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:54.924479  1615 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:58:54.924705  1617 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:54.923913  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:54.926290  1614 raft_consensus.cc:2376] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14. Re-sending same reply.
I20260709 12:58:54.928138  1542 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:58:54.904978  6183 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:54.932708  1541 raft_consensus.cc:1275] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 12:58:54.934530  1542 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:58:54.933202  1541 pending_rounds.cc:85] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 7
I20260709 12:58:54.935652  1541 pending_rounds.cc:107] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 12:58:54.936092  1541 raft_consensus.cc:2889] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:54.917810  6151 raft_consensus.cc:697] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:54.923676  5742 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:54.937245  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:54.938697  1610 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:54.938941  1654 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:54.942322  1534 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:58:54.935029  1438 catalog_manager.cc:5697] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:54.944169  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:54.933881  6183 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:54.921849  6137 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:58:54.922482  6130 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:54.948879  1438 catalog_manager.cc:5697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 8 to 15, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 15 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:54.927304  6175 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:58:54.986718  1581 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:54.957080  1617 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 12:58:54.993302  1541 raft_consensus.cc:1240] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:54.956453  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:54.958170  1654 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:54.986764  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:55.012703  1542 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 12:58:54.990782  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:58:55.014470  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:55.012872  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 54797.4us
I20260709 12:58:55.018265  1534 raft_consensus.cc:2393] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 16: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:55.017961  1438 catalog_manager.cc:5697] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 11 to 13, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 13 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:55.009383  1536 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 12:58:55.015390  6092 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:58:54.965152  6206 log.cc:927] Time spent T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:58:54.944492  6113 raft_consensus.cc:2764] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:58:55.021096  1581 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:54.990314  6101 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:55.035585  5951 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:55.037004  5821 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:55.037459  1581 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:55.038556  5804 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:58:55.039014  5804 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:55.039389  5804 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:58:55.045800  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:55.047595  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:55.048890  1541 raft_consensus.cc:2393] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 11: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:55.050163  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:55.077461  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:55.056840  6101 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:55.058350  1438 catalog_manager.cc:5697] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:55.058969  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:55.058409  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:54.942394  6117 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 12:58:55.056989  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:55.068992  6130 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:55.078138  1654 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:54.958647  6151 consensus_queue.cc:237] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:55.088653  1610 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 12:58:55.079488  1581 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:55.079677  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 156601us
I20260709 12:58:55.078577  1541 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 12:58:55.105175  1654 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:55.110886  1581 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:55.114485  5821 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:55.116276  1581 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:55.119372  1654 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:55.119586  1438 catalog_manager.cc:5697] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 9 to 12, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 12 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:55.120390  1581 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:55.120543  1654 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:55.121016  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:55.107053  6153 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:55.124123  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:55.124212  6153 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:55.125526  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:55.126643  6153 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:55.128566  5826 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:55.129030  5826 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:55.129390  5826 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:55.126691  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:55.131204  5980 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:55.131695  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:55.132050  6153 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:55.078299  6101 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:55.137127  6101 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:55.132848  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:55.115720  6108 raft_consensus.cc:2764] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:58:55.109627  6113 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:55.137945  1536 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 12:58:55.123680  1581 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:55.119186  6152 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:58:55.131619  5980 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:55.139297  5951 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:58:55.139711  5980 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:55.138980  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:55.140552  6116 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:55.140798  1536 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:58:55.122789  5867 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:58:55.141923  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:55.143018  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:55.143563  1536 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 14.
I20260709 12:58:55.144624  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:55.145010  1581 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:55.145252  1536 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:58:55.146227  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:55.148636  1536 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:55.148876  6153 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:55.147831  1581 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:55.154820  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:55.155709  1534 raft_consensus.cc:2393] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 18: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:55.169209  1615 raft_consensus.cc:1240] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:55.172914  1438 catalog_manager.cc:5697] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:55.173930  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:55.175598  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:55.176646  1541 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:55.185746  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:55.186043  1610 raft_consensus.cc:1275] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:58:55.186828  5804 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:55.188658  1608 raft_consensus.cc:1240] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:58:55.189406  1613 raft_consensus.cc:1240] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:55.190142  1615 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:58:55.190016  5980 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:55.192245  1614 raft_consensus.cc:1275] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:58:55.140981  6116 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:55.196717  6116 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:58:55.197016  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 49910.2us
I20260709 12:58:55.197453  5821 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:55.197873  5821 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:55.198247  5821 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:55.199052  1581 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:55.201337  5867 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:55.201702  1508 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:55.201871  5867 raft_consensus.cc:697] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:55.202893  5867 consensus_queue.cc:237] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:55.203480  1508 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:55.204350  6101 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:55.204783  6101 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:55.204941  1581 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:55.205210  6101 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:55.206238  5804 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:55.208786  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:55.204859  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:55.211709  1508 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:55.209703  1616 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 14.
I20260709 12:58:55.213408  1581 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:55.192155  5980 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:55.216032  1438 catalog_manager.cc:5697] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:55.217140  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:55.217402  1581 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:55.217926  1617 raft_consensus.cc:2368] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 15. Current term is 16.
I20260709 12:58:55.219651  1508 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:55.220954  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:55.223397  1534 raft_consensus.cc:2393] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 15: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:55.223759  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:55.226194  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:55.226866  1536 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:55.229382  1438 catalog_manager.cc:5697] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 8 to 13, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 13 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:55.118636  6183 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:55.220778  5815 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:58:55.233327  1438 catalog_manager.cc:5697] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 11 to 14, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 14 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:55.221125  6159 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:58:55.222043  5926 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:55.237704  1508 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:55.223367  6124 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:55.241998  1691 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:58:55.241837  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:55.243336  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:55.244259  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:55.244899  1685 raft_consensus.cc:2368] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 17. Current term is 18.
I20260709 12:58:55.245870  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:55.227527  5951 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:58:55.252666  1438 catalog_manager.cc:5697] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 8 to 11, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 11 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:55.255249  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:55.254855  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:55.256505  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:55.257051  1541 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:58:55.257540  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:55.258070  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:55.254220  1685 raft_consensus.cc:1275] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:58:55.261408  1683 raft_consensus.cc:2393] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 17: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:55.233713  6126 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:55.261269  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:55.258219  1533 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:55.269317  1534 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:55.269984  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:55.267904  1613 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:58:55.235965  5815 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:55.271157  1438 catalog_manager.cc:5697] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 7 to 15. New cstate: current_term: 15 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:55.273502  1533 raft_consensus.cc:2368] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 15. Current term is 16.
I20260709 12:58:55.273650  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:55.274159  1438 catalog_manager.cc:5697] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:55.268018  1615 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 15. Current term is 16. Ops: []
I20260709 12:58:55.275228  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:55.262128  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:55.277069  1536 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 12:58:55.277338  1613 raft_consensus.cc:1240] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:55.283257  1614 raft_consensus.cc:1275] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:58:55.283706  1614 pending_rounds.cc:85] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f: Aborting all ops after (but not including) 6
I20260709 12:58:55.283943  1614 pending_rounds.cc:107] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:58:55.284189  1614 raft_consensus.cc:2889] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:55.290858  1690 raft_consensus.cc:2393] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 13: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:55.295481  1536 raft_consensus.cc:1275] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:58:55.281697  5815 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:58:55.302250  6108 consensus_queue.cc:1059] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:58:55.317126  6117 raft_consensus.cc:3055] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:58:55.317603  6117 raft_consensus.cc:740] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:55.318528  6117 consensus_queue.cc:260] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:55.313102  1438 catalog_manager.cc:5697] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 8 to 10, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 10 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
W20260709 12:58:55.340619  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 103004us
I20260709 12:58:55.303557  6123 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:55.341464  1508 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:55.345901  1508 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:55.347035  1508 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:55.350970  2300 raft_consensus.cc:1240] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:58:55.351271  1540 raft_consensus.cc:1240] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:58:55.355516  6126 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:58:55.357923  6183 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:55.358651  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:55.359550  6101 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:55.365545  1535 raft_consensus.cc:1240] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:58:55.365197  5826 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:55.367666  5826 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:55.371909  1508 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:55.367906  1535 raft_consensus.cc:1275] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:58:55.331928  5821 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:55.378674  1534 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:58:55.382272  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:55.387748  1534 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:58:55.382941  6105 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:55.388535  6126 consensus_queue.cc:1059] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:58:55.310601  6177 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
W20260709 12:58:55.384087  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 132965us
I20260709 12:58:55.390637  1438 catalog_manager.cc:5697] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 8 to 10, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 10 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:55.392930  1508 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:55.364025  6116 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:55.401166  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 124951us
W20260709 12:58:55.392765  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 57887.2us
I20260709 12:58:55.411288  1535 raft_consensus.cc:1275] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 12:58:55.414970  1683 raft_consensus.cc:1275] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:58:55.384236  5926 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:58:55.420143  1438 catalog_manager.cc:5697] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 9 to 14, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 14 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:55.425041  1438 catalog_manager.cc:5697] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:55.426590  1438 catalog_manager.cc:5697] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 11 to 14, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 14 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:55.429312  1581 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:55.430419  1535 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:58:55.428239  1438 catalog_manager.cc:5697] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 7 to 9, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 9 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:55.434046  1608 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:58:55.434530  1533 raft_consensus.cc:1240] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 8. Current term is 9. Ops: []
I20260709 12:58:55.437180  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:55.437994  1612 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:58:55.407361  6097 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:58:55.447592  1655 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:55.402390  6105 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:55.444087  1684 raft_consensus.cc:2368] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 12. Current term is 13.
I20260709 12:58:55.443869  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:55.441974  1505 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:55.449671  1535 raft_consensus.cc:1275] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:58:55.449590  1438 catalog_manager.cc:5697] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 8 to 10, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 10 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:55.452880  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:55.453238  1438 catalog_manager.cc:5697] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 9 to 11, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 11 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:55.454635  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:55.455041  1438 catalog_manager.cc:5697] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 3 to 9, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:58:55.461015  1611 raft_consensus.cc:2410] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 5.
I20260709 12:58:55.464748  1614 raft_consensus.cc:1275] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:58:55.417968  5826 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:58:55.442822  6160 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:58:55.480306  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 87470.8us
I20260709 12:58:55.481200  1508 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:55.482494  1508 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:55.483606  1508 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:55.484812  6126 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:58:55.485532  6126 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:55.486129  6126 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:58:55.486776  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 44879.8us
I20260709 12:58:55.487897  1505 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:55.489048  1505 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:55.489773  1505 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:55.475322  6137 consensus_queue.cc:1059] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:58:55.490895  6124 raft_consensus.cc:2764] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:58:55.491505  6124 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:55.492054  6124 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:55.492668  6227 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:58:55.493202  6227 raft_consensus.cc:697] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:55.494261  6116 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:55.494004  6227 consensus_queue.cc:237] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:55.463761  6224 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:58:55.450606  6105 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:55.499328  5821 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:55.501310  6092 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:58:55.511479  1615 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 12:58:55.515522  1610 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 17.
I20260709 12:58:55.447077  5970 raft_consensus.cc:3055] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:55.436443  6142 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:58:55.591506  1438 catalog_manager.cc:5697] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 7 to 12, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 12 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:55.492355  6124 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:55.590471  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 106947us
I20260709 12:58:55.594597  1508 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:55.596274  1508 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:55.590415  1541 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
W20260709 12:58:55.598203  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 176602us
W20260709 12:58:55.599815  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 151054us
I20260709 12:58:55.602125  1508 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:55.604457  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 114741us
I20260709 12:58:55.589408  6113 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:58:55.603367  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 156459us
I20260709 12:58:55.474929  6222 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:55.588284  5970 raft_consensus.cc:740] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:55.593518  6124 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:55.608150  1438 catalog_manager.cc:5697] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 5 to 11, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 11 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:55.613494  1654 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:55.598758  6126 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:58:55.617730  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 176363us
I20260709 12:58:55.617467  1508 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:55.598378  6116 raft_consensus.cc:3055] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:58:55.617921  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 179290us
I20260709 12:58:55.621572  1581 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:55.601033  6097 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:55.624498  1655 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:55.600608  6130 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:58:55.625423  1505 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:55.620981  1438 catalog_manager.cc:5697] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 5 to 7, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 7 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:55.623476  1654 leader_election.cc:400] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 15. Current term is 16.
I20260709 12:58:55.631348  1654 leader_election.cc:403] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:58:55.619186  6222 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:55.639163  6222 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:55.621524  5867 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.640122  5867 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:55.642340  5867 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:55.623804  6153 consensus_queue.cc:1048] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:58:55.635015  6232 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:58:55.618757  6126 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:55.622625  6116 raft_consensus.cc:740] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:55.618542  5826 consensus_queue.cc:1048] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:58:55.656041  6116 consensus_queue.cc:260] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:55.657349  6116 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:55.660945  6231 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:55.661473  6231 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:55.661813  6231 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:55.664942  6142 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:55.618793  6224 consensus_queue.cc:1059] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:58:55.666466  6224 raft_consensus.cc:3055] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:58:55.666822  6224 raft_consensus.cc:740] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:55.667615  6224 consensus_queue.cc:260] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:55.668905  5970 consensus_queue.cc:260] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:55.670222  5970 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:55.631856  5926 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:58:55.674435  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 51147.7us
W20260709 12:58:55.688892  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 63555.6us
I20260709 12:58:55.689935  1505 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:55.616189  6092 consensus_queue.cc:1059] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
W20260709 12:58:55.708252  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 90839.2us
I20260709 12:58:55.675705  6126 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:55.683038  6151 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:58:55.675545  6101 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:55.681545  6113 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 15. Current term is 16.
I20260709 12:58:55.719491  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:58:55.714108  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 63874.5us
I20260709 12:58:55.720250  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:55.726802  6142 raft_consensus.cc:3055] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:55.727391  6236 consensus_queue.cc:1059] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:58:55.684110  6222 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:55.728463  1505 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:55.713474  6224 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:58:55.713775  1508 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:55.715891  6097 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:58:55.757284  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 132912us
I20260709 12:58:55.856829  1655 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:55.851568   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:55.685020  5826 consensus_queue.cc:1059] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:58:55.854173  6242 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:58:55.854194  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 140492us
I20260709 12:58:55.874617  1508 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:55.728703  6159 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:55.715189  6239 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:55.757043  6142 raft_consensus.cc:740] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:58:55.878507  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 120849us
I20260709 12:58:55.861361  1505 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:55.757757  5926 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:58:55.886870  1505 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:55.887243  1508 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:55.734042  6092 consensus_queue.cc:1059] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.134s
I20260709 12:58:55.888756  1581 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:55.897733  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:55.736409  6105 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:55.898404  1614 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:55.863284  6240 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:55.764008  5815 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:55.878322  6097 raft_consensus.cc:697] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:55.876911  6151 raft_consensus.cc:697] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:55.930140  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:55.933068  1611 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:58:55.891574  6227 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:55.933427  1505 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:55.899498  6222 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:55.939528  1614 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:58:55.932104  5926 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:58:55.962719  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 52896.9us
I20260709 12:58:55.963191  1505 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:55.987140  1616 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 12:58:55.889199  6159 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:56.016006  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 52905.9us
I20260709 12:58:56.016279  1608 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:58:56.017369  1505 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:56.017752  6240 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:58:56.018657  6240 raft_consensus.cc:2764] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:58:56.017278  6159 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:56.019176  1505 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:55.913880  6239 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:58:56.021013  1505 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:56.019935  6240 raft_consensus.cc:2804] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:58:56.025456  6240 raft_consensus.cc:697] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:56.026453  6240 consensus_queue.cc:237] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:56.026996  1505 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:55.892804  6124 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:55.899931  6113 consensus_queue.cc:1048] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:58:55.966713  6242 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:55.957882  6222 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:55.964216  5926 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:56.065164  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 177987us
I20260709 12:58:56.067930  6092 consensus_queue.cc:1059] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:58:56.041373  5826 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:56.069888  6245 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:58:56.033970  5804 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:58:56.084715  6097 consensus_queue.cc:237] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:56.088696  6251 raft_consensus.cc:3055] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:58:56.089754  5815 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:56.090121  6105 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:56.091913  6124 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:56.100600  1611 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 14.
W20260709 12:58:56.022185  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:56.218187  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 329530us
I20260709 12:58:56.224030  1508 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:58:56.069144  6237 log.cc:927] Time spent T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:58:56.044528  6227 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:58:56.234681  5970 consensus_meta.cc:287] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.564s	user 0.011s	sys 0.000s
I20260709 12:58:56.105340  6232 raft_consensus.cc:3055] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:58:56.282122  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 255179us
I20260709 12:58:56.223891  6222 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:56.285835  6151 consensus_queue.cc:237] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:56.236243  6231 consensus_meta.cc:287] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.574s	user 0.006s	sys 0.004s
W20260709 12:58:56.284740  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.234586  5926 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:58:56.233922  6239 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:58:56.312829  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 88914.3us
I20260709 12:58:55.986892  6142 consensus_queue.cc:260] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:56.285567  5804 raft_consensus.cc:697] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:56.281016  6251 raft_consensus.cc:740] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:58:56.345311  6248 log.cc:927] Time spent T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.298s	user 0.000s	sys 0.001s
I20260709 12:58:56.323801  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:58:56.332885  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 476143us
I20260709 12:58:56.345600  6251 consensus_queue.cc:260] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:56.346385  1655 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:56.346939  6251 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:56.347575  1655 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:56.348717  1655 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:56.349720  1655 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:56.353166  1610 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:58:56.353780  6116 consensus_meta.cc:287] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.696s	user 0.009s	sys 0.000s
I20260709 12:58:56.354417  6116 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:56.355218  6116 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:56.356329  6251 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:56.359077  6251 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:58:56.361954  6159 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.362597  6159 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:56.316365  6253 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:56.365847  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 2129) took 1122 ms. Trace:
I20260709 12:58:56.366353  1684 rpcz_store.cc:276] 0709 12:58:55.243581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:55.243696 (+   115us) service_pool.cc:224] Handling call
0709 12:58:56.365635 (+1121939us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b540041c654. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:56.365764 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":428136832}
I20260709 12:58:56.367129  6239 raft_consensus.cc:697] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:56.360289  6251 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:56.367974  6251 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:58:56.369056  6126 consensus_meta.cc:287] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.000s
W20260709 12:58:56.343389  6244 log.cc:927] Time spent T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
I20260709 12:58:56.369527  6126 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:56.329515  1654 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:58:56.377061  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 47644.5us
I20260709 12:58:56.321435  6160 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:56.378876  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 71018.2us
I20260709 12:58:56.324642  1505 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:56.312031  6092 raft_consensus.cc:3055] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:58:56.336176  1508 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:56.332957  1611 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "480b368f643b4d85a5daa23529132504"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:58:56.380076  1654 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:56.318244  6250 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.388954  2266 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:56.394214  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 69674.7us
I20260709 12:58:56.353703  6142 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:58:56.395612  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 59501.1us
I20260709 12:58:56.388345  1611 raft_consensus.cc:606] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:56.324064  6255 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:56.324213  6232 raft_consensus.cc:740] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:56.400537  1508 leader_election.cc:400] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 17. Current term is 18.
I20260709 12:58:56.404624  1508 leader_election.cc:403] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:58:56.400180  5826 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:56.404217  6126 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:56.425400  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 237) took 1093 ms. Trace:
I20260709 12:58:56.427780  1508 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:56.399621  6116 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:58:56.434999  6260 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:58:56.435906  6227 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 17. Current term is 18.
W20260709 12:58:56.438830  6229 log.cc:927] Time spent T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.962s	user 0.055s	sys 0.070s
I20260709 12:58:56.387817  6092 raft_consensus.cc:740] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:56.425906  1617 rpcz_store.cc:276] 0709 12:58:55.313109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:55.313651 (+   542us) service_pool.cc:224] Handling call
0709 12:58:55.360871 (+ 47220us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:55.402495 (+ 41624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:55.402532 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:55.420804 (+ 18272us) log.cc:844] Serialized 26 byte log entry
0709 12:58:55.683340 (+262536us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:55.683385 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:55.683461 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:56.406403 (+722942us) raft_consensus.cc:1685] finished
0709 12:58:56.406428 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:56.406611 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":155988,"raft.queue_time_us":60402,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":34716,"spinlock_wait_cycles":98560,"thread_start_us":229421,"threads_started":1,"wal-append.queue_time_us":448076}
I20260709 12:58:56.440375  6257 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:56.400362  6253 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:58:56.452437  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 63567.7us
I20260709 12:58:56.445586  1508 leader_election.cc:400] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 12. Current term is 13.
I20260709 12:58:56.456612  1508 leader_election.cc:403] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:58:56.389169  6113 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:56.335685  6231 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:56.397627  6266 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:58:56.408416  6245 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:58:56.462116  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1773) took 1197 ms. Trace:
I20260709 12:58:56.465140  1685 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:58:56.467150  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:56.462788  1616 rpcz_store.cc:276] 0709 12:58:55.264323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:55.264503 (+   180us) service_pool.cc:224] Handling call
0709 12:58:55.289860 (+ 25357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:56.015706 (+725846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:56.461873 (+446167us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b54001f68d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:56.462060 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1603108096}
I20260709 12:58:56.472100  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:56.368184  6239 consensus_queue.cc:237] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:56.474361  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:56.476907  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:56.479445  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:56.475677  6258 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.480868  6258 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:56.483079  6258 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:56.401978  6250 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:56.488015  6250 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:56.447201  5970 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:58:56.466342  6235 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:58:56.470086  6253 raft_consensus.cc:697] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:56.496856  6253 consensus_queue.cc:237] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:56.464723  6260 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:56.430027  6101 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:58:56.394795  5804 consensus_queue.cc:237] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:56.441754  6255 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:56.500769  6266 raft_consensus.cc:697] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 14 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:56.474512  6245 raft_consensus.cc:697] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:56.394038  6160 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:58:56.469609  6113 raft_consensus.cc:697] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:56.456378  6227 consensus_queue.cc:1048] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
W20260709 12:58:56.567207  6224 consensus_meta.cc:287] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.704s	user 0.004s	sys 0.004s
I20260709 12:58:56.475858  6159 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:56.548168  6231 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:56.548028  6232 consensus_queue.cc:260] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:56.571971  6232 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:56.572598  6113 consensus_queue.cc:237] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:56.576980  6245 consensus_queue.cc:237] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:56.583263  6160 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:56.549010  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 199301us
I20260709 12:58:56.584306  1655 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:56.562350  6222 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:56.585572  1655 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:56.549068  6105 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:58:56.588809  1685 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:56.591393  1655 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:56.594794  1655 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:56.606261  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:56.657155  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 185790us
W20260709 12:58:56.657670  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 62978.5us
I20260709 12:58:56.658402  1655 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:56.662163  1655 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:56.663977  1655 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:56.469250  6257 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:56.588426  6137 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:58:56.599303  6231 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:56.673906  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:56.658447  6224 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:58:56.623874  6160 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:56.678709  1655 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:56.666416  6116 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:58:56.690264  6243 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:56.669625  5826 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:58:56.670132  6108 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:56.670039  6222 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:56.693176  1655 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:56.694415  1685 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
I20260709 12:58:56.678695  6250 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:58:56.703197  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 228063us
I20260709 12:58:56.723902  1655 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:56.727175  1655 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:56.690882  6243 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:56.697647  5826 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:56.676748  5926 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:56.700098  6137 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:56.744984  1655 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:56.684085  6160 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:56.736591  6116 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:56.739114  6224 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:56.740265  5826 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:58:56.778823  1687 raft_consensus.cc:1240] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:56.730299  6266 consensus_queue.cc:237] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:56.747051  6250 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:56.756101  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:56.783638  1688 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:56.741993  6137 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:56.787660  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:56.789160  1535 raft_consensus.cc:1275] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:58:56.788403  1542 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:58:56.773911  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 371165us
I20260709 12:58:56.761947  1690 raft_consensus.cc:1275] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:58:56.753394  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:56.791095  1505 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:56.790679  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:47506
I20260709 12:58:56.792747  1541 raft_consensus.cc:606] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:56.756806  1689 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:58:56.786959  1655 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:56.792696  1505 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
W20260709 12:58:56.780946  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.793238  1541 raft_consensus.cc:614] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:56.793206  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:56.795310  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:56.795958  1536 raft_consensus.cc:1240] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 10. Current term is 11. Ops: []
W20260709 12:58:56.785192  6240 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.014s	sys 0.028s
W20260709 12:58:56.796996  6240 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.014s	sys 0.029s
I20260709 12:58:56.797160  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:56.797649  1536 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:58:56.794240  1535 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:56.800923  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:56.801406  1539 raft_consensus.cc:1240] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 14. Current term is 15. Ops: []
I20260709 12:58:56.802340  1535 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:58:56.795957  1533 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
W20260709 12:58:56.803755  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.759802  5951 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.804949  1535 raft_consensus.cc:1275] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:58:56.805574  1536 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 12:58:56.752739  6117 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:58:56.749990  6116 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:56.808822  1655 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:56.753414  6255 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:56.763839  6257 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:56.766680  6260 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 12. Current term is 13.
I20260709 12:58:56.767905  6224 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:56.815495  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:56.816112  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:56.816778  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:56.789391  6130 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:56.818230  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:56.817047  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:56.790827  6137 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:56.818805  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:58:56.806537  6278 log.cc:927] Time spent T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:58:56.790405  6258 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:56.817531  1533 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:56.829810  1655 leader_election.cc:400] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 15. Current term is 16.
I20260709 12:58:56.818745  1583 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:56.806382  6245 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:56.759449  6092 consensus_queue.cc:260] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:56.836416  1655 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:56.836154  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:56.837177  1541 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 12:58:56.833125  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:56.839171  1688 raft_consensus.cc:1240] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 12:58:56.840054  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.841586  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:56.841944  5926 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:56.811622  6108 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:58:56.807631  5951 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:56.845575  5951 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:56.846073  6258 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:56.846482  6258 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:56.847647  5962 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:56.848109  5962 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:56.818404  6224 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:56.848500  5962 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:56.849761  6092 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:58:56.852121  6238 log.cc:927] Time spent T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.997s	user 0.000s	sys 0.013s
I20260709 12:58:56.812186  6116 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:56.866925  1609 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:58:56.859354  1508 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:56.804292  6105 consensus_queue.cc:1048] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:58:56.873026  1683 raft_consensus.cc:2393] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 14: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:56.814428  6250 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:58:56.818987  6242 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:58:56.896399  6142 consensus_queue.cc:1059] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:58:56.898228  1542 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:58:56.834900  6260 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:56.874367  6255 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:58:56.904629  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:58:56.906525  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 67757.4us
I20260709 12:58:56.912075  1542 raft_consensus.cc:1275] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:58:56.892623  5867 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:56.915649  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:56.910792  6260 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:56.923556  6260 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:56.852372  6251 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:56.898095  5926 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:56.934166  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2531) took 1939 ms. Trace:
I20260709 12:58:56.834893  6130 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:56.925593  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:56.855121  5826 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
W20260709 12:58:56.940975  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.934675  1537 rpcz_store.cc:276] 0709 12:58:54.985309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:55.175240 (+189931us) service_pool.cc:224] Handling call
0709 12:58:55.216780 (+ 41540us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:55.282676 (+ 65896us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:55.282709 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:55.293704 (+ 10995us) log.cc:844] Serialized 52 byte log entry
0709 12:58:55.614545 (+320841us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:58:56.363119 (+748574us) spinlock_profiling.cc:243] Waited 975 us on lock 0x7b1800439de0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc85cbf94bc 00007fc859f4748b 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f61455 00007fc860a493c7 00007fc85d05b9a7 00007fc85d06b0bf
0709 12:58:56.363269 (+   150us) log.cc:844] Serialized 14 byte log entry
0709 12:58:56.371586 (+  8317us) log.cc:844] Serialized 14 byte log entry
0709 12:58:56.371768 (+   182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:56.577395 (+205627us) spinlock_profiling.cc:243] Waited 9.81 ms on lock 0x7b1800439de0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f643f3 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd 000000000038f354 000000000038f199 00007fc859f4783a
0709 12:58:56.777932 (+200537us) spinlock_profiling.cc:243] Waited 48.7 ms on lock 0x7b54003d2554. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:56.777979 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:56.851547 (+ 73568us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 12:58:56.924624 (+ 73077us) raft_consensus.cc:1685] finished
0709 12:58:56.924645 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:56.924778 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82669,"prepare.queue_time_us":156091,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":71,"raft.queue_time_us":67135,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":15947,"spinlock_wait_cycles":400856064,"thread_start_us":417396,"threads_started":2,"wal-append.queue_time_us":403186}
I20260709 12:58:56.899668  6242 raft_consensus.cc:697] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:56.894213  6113 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:58:56.951228  1683 raft_consensus.cc:1275] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:58:56.954463  1534 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:58:56.955768  6137 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:56.957859  5826 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:56.899446  6222 consensus_queue.cc:1059] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
W20260709 12:58:56.942042  6236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.070s	user 0.009s	sys 0.043s
I20260709 12:58:56.967029  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:56.962035  1682 raft_consensus.cc:2393] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 17: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:56.927680  6255 raft_consensus.cc:697] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:56.969877  6251 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:56.974407  6160 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:56.975199  6243 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:56.976830  6130 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:56.977092  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.966217  6101 consensus_queue.cc:1048] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:58:56.949447  5926 raft_consensus.cc:697] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 12:58:56.967507  6236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.105s	user 0.009s	sys 0.044s
I20260709 12:58:56.928247  5867 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:56.997346  5867 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:57.000768  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:57.001986  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:57.002138  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 92648.5us
I20260709 12:58:57.002931  1539 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:58:57.002509  1533 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 14.
I20260709 12:58:57.005142  1691 raft_consensus.cc:1240] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 14. Current term is 15. Ops: []
W20260709 12:58:57.007606  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:56.992887  6222 raft_consensus.cc:3055] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:58:57.009197  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:57.012669  1537 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 12:58:57.011590  1684 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:58:56.994531  5926 consensus_queue.cc:237] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.006304  5826 consensus_queue.cc:1048] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:58:57.021152  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:57.021916  1539 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:58:57.012403  6222 raft_consensus.cc:740] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:57.035143  1581 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:57.023586  6261 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.025470  5814 consensus_queue.cc:1048] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:58:56.976925  6242 consensus_queue.cc:237] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.041990  1581 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:57.023453  6113 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:58:57.028857  6130 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:58:57.066148  1581 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:57.074747  6108 consensus_queue.cc:1048] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:57.036963  6142 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:58:57.031921  6290 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:58:57.057493  6153 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:58:57.032660  6258 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.048329  6159 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:58:57.048534  6165 consensus_queue.cc:1059] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:58:57.084249  5951 consensus_queue.cc:1059] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:58:57.087703  6245 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:57.083148  6160 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:58:57.116640  1539 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 13. Current term is 14. Ops: [12.8-13.9]
I20260709 12:58:57.117038  6160 raft_consensus.cc:697] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:57.118002  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:57.072125  6222 consensus_queue.cc:260] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.118628  1539 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:58:57.117962  6160 consensus_queue.cc:237] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.058871  6255 consensus_queue.cc:237] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.080660  6153 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:57.049278  6261 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.119303  1538 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:57.053839  5867 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:58:57.121764  5962 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:58:57.122752  6261 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:57.123387  1541 raft_consensus.cc:1240] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:57.123792  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:57.123993  5962 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:57.124382  1581 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:57.124976  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:57.126147  5951 raft_consensus.cc:3055] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:57.126557  5951 raft_consensus.cc:740] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:57.127349  5951 consensus_queue.cc:260] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.124385  1538 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:57.119066  6222 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:57.129248  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:57.130020  2303 raft_consensus.cc:2393] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 12: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:58:57.058833  6243 consensus_queue.cc:1048] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:58:57.121109  6153 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:58:57.094051  6224 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.096951  6137 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:57.099278  1685 raft_consensus.cc:1275] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:58:57.082901  6159 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:57.110175  6241 raft_consensus.cc:3055] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:58:57.110402  1540 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:58:57.111105  1533 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 14. Current term is 15. Ops: [11.8-14.10]
I20260709 12:58:57.112668  1534 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 12:58:57.113294  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:57.157156  1537 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 14.
I20260709 12:58:57.158037  1534 raft_consensus.cc:1240] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:58:57.111256  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:57.114050  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:57.159969  1536 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 12:58:57.118261  5814 raft_consensus.cc:3055] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:58:57.161839  5814 raft_consensus.cc:740] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:57.162741  5814 consensus_queue.cc:260] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.163954  5814 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:57.165273  6117 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.165896  6117 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.090437  6116 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.119372  6293 raft_consensus.cc:3055] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:58:57.168793  6293 raft_consensus.cc:740] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:57.169772  6293 consensus_queue.cc:260] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.096700  6258 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:57.170692  1686 raft_consensus.cc:1240] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:57.135075  1581 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:57.170854  6293 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:58:57.136453  1505 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:57.137742  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:57.172860  1505 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:57.173430  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:57.174206  1505 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:57.150794  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:57.174665  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:57.175300  1691 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:57.175865  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:57.176559  1690 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:58:57.154665  1685 pending_rounds.cc:85] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 5
I20260709 12:58:57.178444  1685 pending_rounds.cc:107] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:58:57.178762  1685 raft_consensus.cc:2889] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:57.180238  1685 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 12:58:57.180616  1685 pending_rounds.cc:85] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 8
I20260709 12:58:57.180842  1685 pending_rounds.cc:107] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 12:58:57.181071  1685 raft_consensus.cc:2889] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:57.149580  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:57.184657  6271 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.185324  6271 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.159433  1534 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:58:57.170205  6116 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:57.168177  6117 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:57.155622  1683 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: []
I20260709 12:58:57.189356  6240 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:57.189848  1505 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:57.190609  6240 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:58:57.191493  6239 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:57.192103  6245 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:58:57.196206  6130 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:58:57.196880  1505 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:57.145489  1538 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 12:58:57.192423  1690 raft_consensus.cc:1275] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:58:57.201732  6253 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:58:57.209184  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 52767.2us
I20260709 12:58:57.207878  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:57.210098  1655 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:57.134840  5951 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:57.212314  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:57.266160  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 56022.1us
I20260709 12:58:57.238030  1655 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:57.219200  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:57.236609  1688 raft_consensus.cc:1240] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:57.272957  1613 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 12:58:57.266460  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:57.212872  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:57.242575  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:57.216687  1608 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:58:57.276021  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:57.258450  1691 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:58:57.278278  1655 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:57.156086  6234 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:58:57.279779  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:57.282729  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:57.283474  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:57.282778  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:57.157063  6159 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:57.156571  6241 raft_consensus.cc:740] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:57.202798  6253 raft_consensus.cc:697] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:58:57.339308  1542 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
W20260709 12:58:57.279219  6291 log.cc:927] Time spent T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:58:57.333701  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:57.364809  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:57.335956  1612 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 14.
I20260709 12:58:57.361091  1536 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:58:57.327474  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 192516us
I20260709 12:58:57.367996  1505 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:57.368964  1654 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:57.280210  6117 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:57.376204  1505 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:57.377596  1654 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:57.285539  5652 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.202564  6130 consensus_queue.cc:1048] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.133s
I20260709 12:58:57.280102  6250 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.156205  5804 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.179s
I20260709 12:58:57.285238  6142 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:58:57.327256  6234 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:57.388327  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 114544us
I20260709 12:58:57.389565  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:57.391419  1505 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:57.280423  6137 consensus_queue.cc:1059] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
I20260709 12:58:57.392417  6239 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:58:57.455241  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:58:57.464221  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 92192.9us
I20260709 12:58:57.464637  1611 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 12:58:57.283860  6231 consensus_queue.cc:1059] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.109s
I20260709 12:58:57.334508  6113 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:58:57.463218  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:57.388536  5926 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:57.388646  6251 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:57.382853  6117 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:57.537169  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 145844us
I20260709 12:58:57.407610  6266 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:58:57.552951  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:57.596379  1541 raft_consensus.cc:2393] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 15: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:57.467936  6142 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:57.383605  6261 consensus_queue.cc:1059] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.135s
I20260709 12:58:57.500624  6234 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:58:57.580251  6264 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.578907  1539 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:58:57.553889  6260 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:58:57.583452  6265 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:57.407459  5814 consensus_queue.cc:1048] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.144s
I20260709 12:58:57.478062  6250 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:57.607169  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.597729  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:57.407791  5652 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.560942  5962 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:57.573856  6151 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:57.580371  6152 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.594310  6117 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:57.532320  6220 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
W20260709 12:58:57.601401  6270 log.cc:927] Time spent T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 12:58:57.606094  6299 log.cc:927] Time spent T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 12:58:57.605036  6298 log.cc:927] Time spent T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 12:58:57.630726  6236 raft_consensus.cc:3055] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:58:57.607601  6142 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:58:57.633811  6223 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:58:57.639840  6222 consensus_meta.cc:287] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.511s	user 0.009s	sys 0.000s
W20260709 12:58:57.605572  6304 log.cc:927] Time spent T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:58:57.597169  6113 raft_consensus.cc:697] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:58:57.630604  6306 log.cc:927] Time spent T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 12:58:57.611730  5867 raft_consensus.cc:3055] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:58:57.656668  6302 log.cc:927] Time spent T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 12:58:57.656461  6305 log.cc:927] Time spent T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6: Append to log took a long time: real 0.082s	user 0.002s	sys 0.000s
I20260709 12:58:57.676744  1535 raft_consensus.cc:2410] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:58:57.606514  6264 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.628155  5962 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.663538  6224 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:57.662159  6236 raft_consensus.cc:740] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:57.644490  6151 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.647742  6152 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.675767  5867 raft_consensus.cc:740] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:57.694748  1611 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:58:57.696363  6250 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:57.699275  5652 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:57.707131  6294 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.601495  6253 consensus_queue.cc:237] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:57.711020  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 128961us
I20260709 12:58:57.688665  6223 raft_consensus.cc:697] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:57.660370  6241 consensus_queue.cc:260] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.722813  1581 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:58:57.733179  1613 raft_consensus.cc:1275] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:58:57.678694  6113 consensus_queue.cc:237] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.735514  6152 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:57.737366  1613 raft_consensus.cc:1275] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:58:57.738302  1615 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:58:57.727514  6294 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.740262  1615 raft_consensus.cc:1275] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:58:57.759063  6151 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:57.748148  6159 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.760991  6294 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:57.761643  1610 raft_consensus.cc:1240] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 13. Current term is 14. Ops: []
I20260709 12:58:57.762073  6159 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:57.752740  6236 consensus_queue.cc:260] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.743762  6271 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:57.763788  6236 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:58:57.766436  6153 consensus_meta.cc:287] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.633s	user 0.007s	sys 0.003s
I20260709 12:58:57.766965  6153 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.768435  1608 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:58:57.770617  6153 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:57.771783  6271 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.772512  6271 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.741186  5867 consensus_queue.cc:260] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.774998  6271 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:57.775346  5867 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:57.747558  6223 consensus_queue.cc:237] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.740525  5962 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:57.779488  6142 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.748543  6264 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:57.794412  6142 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:57.804643  6239 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.823273  6239 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.813004  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:57.824259  1537 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:57.813963  1541 raft_consensus.cc:1240] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:58:57.816320  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:57.817620  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.818161  1534 raft_consensus.cc:1275] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:58:57.819442  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:57.826277  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:57.820432  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:57.827986  1616 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 12:58:57.720232  6117 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:57.841596  1683 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:58:57.844653  1654 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:57.826982  1535 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 12:58:57.849102  1655 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:57.849967  6290 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:58:57.850229  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:57.850827  1541 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:58:57.851181  6290 raft_consensus.cc:697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:57.852039  6290 consensus_queue.cc:237] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:58:57.855268  1685 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:58:57.856804  1542 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
W20260709 12:58:57.863066  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 140342us
I20260709 12:58:57.863867  1581 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:58:57.867542  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 322227us
I20260709 12:58:57.870307  1655 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:57.875047  1541 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
W20260709 12:58:57.913043  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 69112.3us
I20260709 12:58:57.932065  5951 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:58:57.935073  5951 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:57.935539  5951 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:58:57.877162  6236 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:58:57.814049  6295 raft_consensus.cc:3055] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:58:57.928277  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 64495.6us
W20260709 12:58:57.929132  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 57963.2us
I20260709 12:58:57.915295  1616 raft_consensus.cc:1275] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:58:57.940941  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:57.942059  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:57.942620  1616 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:58:57.936026  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:57.868983  6264 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:57.951103  1537 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:58:57.924641  5962 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.940838  1581 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:57.926146  6296 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:58:57.955284  1583 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:57.964334  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:57.966136  1611 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 12:58:57.835855  6234 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
W20260709 12:58:57.952121  6255 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.818s	user 0.023s	sys 0.054s
I20260709 12:58:57.968966  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:57.982307  1615 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 9.
I20260709 12:58:57.961745  6264 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:57.969497  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:57.947188  6295 raft_consensus.cc:740] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:57.970692  6227 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:58:57.938688  6245 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:57.990190  1614 raft_consensus.cc:2393] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 17: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 12:58:57.981531  6255 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.023s	sys 0.054s
W20260709 12:58:57.990061  6314 log.cc:927] Time spent T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:58:57.995929  1654 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:58.032912  6117 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:58.035450  6234 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:58.006151  1616 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 12:58:58.047981  1655 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:58.048806  1655 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:58.049525  1655 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:57.989548  6264 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:58:58.069690  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 73864.9us
I20260709 12:58:58.071655  1654 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:57.984889  6130 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 12:58:58.039950  5951 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:58.124969  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 347164us
I20260709 12:58:57.956156  5962 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.050793  6239 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:58:58.141208  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 69624.2us
I20260709 12:58:57.996196  6245 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.137619  6142 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:58:58.147022  5951 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:58.148198  6231 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:58.136934  6255 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:58:58.142575  6108 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.166117  6255 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:58.166712  6255 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:58:58.166329  6108 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.169935  6224 consensus_queue.cc:1059] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:58:58.170953  6293 raft_consensus.cc:3055] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:58:58.171351  6293 raft_consensus.cc:740] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:58.137552  6116 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:58:58.172227  6293 consensus_queue.cc:260] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.136742  6137 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:58:58.174093  6253 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.174641  6253 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.176812  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:58.177332  6101 consensus_queue.cc:1048] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:58:58.177594  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 236834us
W20260709 12:58:58.178063  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 222896us
I20260709 12:58:58.179037  6101 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:58:58.182075  6245 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:58.052230  6295 consensus_queue.cc:260] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.182896  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:58.183172  6326 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:58:58.183568  1534 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:58:58.183959  6159 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:58:58.184521  5962 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:58.185447  1610 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:58:58.176653  6105 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:58.188683  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:58.069772  6117 consensus_queue.cc:1048] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 12:58:58.192414  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:58.195501  1614 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:58:58.191007  1655 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:58.195657  1538 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:58.197286  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:58.197978  1542 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
W20260709 12:58:58.149111  6320 log.cc:927] Time spent T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:58:58.144838  6113 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:58:58.201205  1616 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 15. Current term is 16. Ops: []
I20260709 12:58:58.198720  1583 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:58.208521  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:58.208920  1538 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:58:58.209889  1611 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:58:58.211699  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:58.156664  6250 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:58:58.216989  1654 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:58.218178  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:58.225440  1538 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 12:58:58.230394  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:58.231665  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:58.232347  1614 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:58.197343  6117 consensus_queue.cc:1243] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:58:58.237035  1583 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:58.239943  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:58.190203  6294 consensus_queue.cc:1059] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:58:58.201905  6113 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:58.250527  1583 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:58.256901  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:58.214159  6116 raft_consensus.cc:697] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:58.296928  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:58.206429  6108 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:58.221020  6296 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:58.302770  6239 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:58.302644  6324 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.303371  6245 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:58.307426  1614 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 12:58:58.235807  6266 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:58.166540  6231 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.359251  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:58:58.359895  1614 raft_consensus.cc:606] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:58.360307  1614 raft_consensus.cc:614] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:58:58.220448  6153 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 12:58:58.250101  6234 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:58:58.233047  6243 consensus_queue.cc:1059] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.103s
I20260709 12:58:58.180378  6101 consensus_queue.cc:1048] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:58:58.221400  6319 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:58.237205  6240 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 12:58:58.294054  6253 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:58.298416  6224 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:58:58.337499  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 87071.6us
I20260709 12:58:58.294656  6250 raft_consensus.cc:697] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:58.305678  6333 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.351110  1541 raft_consensus.cc:2393] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 12: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:58.305984  6326 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.251288  6251 consensus_queue.cc:1048] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
W20260709 12:58:58.331202  6312 log.cc:927] Time spent T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:58:58.352753  6296 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.336666  6113 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:58:58.334901  6105 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:58.364328  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:58.353117  5867 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:58:58.359696  5815 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:58:58.475274  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:58.366616  6108 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:58:58.476513  6255 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:58.466501  6334 log.cc:927] Time spent T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:58:58.464635  6224 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:58.481771  6328 log.cc:927] Time spent T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 12:58:58.488013  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.360088  6239 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.487689  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:58.498955  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 2181) took 1288 ms. Trace:
I20260709 12:58:58.363232  6266 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:58.487874  1683 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.024s	sys 0.016s
W20260709 12:58:58.550948  1683 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.024s	sys 0.016s
I20260709 12:58:58.372730  6319 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:58.539901  1686 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 12:58:58.557047  1686 pending_rounds.cc:85] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 10
I20260709 12:58:58.557327  1686 pending_rounds.cc:107] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 12:58:58.558717  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:58.559361  1684 raft_consensus.cc:1240] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 10. Current term is 11. Ops: []
I20260709 12:58:58.560814  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:58.562503  1686 raft_consensus.cc:2889] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:58.541214  1617 rpcz_store.cc:276] 0709 12:58:57.210695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.214037 (+  3342us) service_pool.cc:224] Handling call
0709 12:58:57.336419 (+122382us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:57.456210 (+119791us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:57.456240 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:57.462823 (+  6583us) log.cc:844] Serialized 52 byte log entry
0709 12:58:57.896797 (+433974us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:57.943217 (+ 46420us) log.cc:844] Serialized 14 byte log entry
0709 12:58:58.176466 (+233249us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b180043dc20. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859edec0a 00007fc86361e219 00007fc859f66a40 00007fc859f614e4 00007fc859f61455 00007fc85d049060 00007fc85d05b716 00007fc85d06c287 00007fc85d06c208
0709 12:58:58.176673 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:58.176746 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:58.473497 (+296751us) raft_consensus.cc:1685] finished
0709 12:58:58.496621 (+ 23124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:58.498892 (+  2271us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":190751,"prepare.queue_time_us":64957,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":4320,"raft.queue_time_us":353358,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":37328,"spinlock_wait_cycles":5836160,"thread_start_us":322817,"threads_started":1,"wal-append.queue_time_us":519866}
I20260709 12:58:58.483734  6108 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:58.477874  6265 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:58.539347  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:58.553867  1691 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 18. Current term is 19. Ops: [18.12-18.12]
W20260709 12:58:58.511574  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 320659us
I20260709 12:58:58.472877  6220 consensus_queue.cc:1059] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 12:58:58.572450  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:58.511554  6236 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.479168  6325 consensus_queue.cc:1059] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:58:58.501974  5867 raft_consensus.cc:697] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:58.510943  6224 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:58.570794  1655 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:58.569346  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:58.510826  6152 consensus_queue.cc:1059] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 12:58:58.576112  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:58:58.577560  6331 log.cc:927] Time spent T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.336s	user 0.000s	sys 0.000s
I20260709 12:58:58.579757  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:58.477672  6116 consensus_queue.cc:237] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.488618  5815 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:58.583458  5962 raft_consensus.cc:3055] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:58:58.474675  6333 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:58.480894  6105 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:58.585682  6342 log.cc:927] Time spent T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 12:58:58.586726  6336 log.cc:927] Time spent T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
W20260709 12:58:58.587831  6335 log.cc:927] Time spent T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.237s	user 0.000s	sys 0.000s
I20260709 12:58:58.362772  6245 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:58.590273  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 373398us
I20260709 12:58:58.678941  1654 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:58.589246  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1728) took 1351 ms. Trace:
I20260709 12:58:58.616539  6253 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:58:58.591054  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:58.680615  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:58.540580  6130 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:58.362568  6324 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.688890  6231 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:58.690397  6324 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:58.691908  6231 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:58:58.560238  6319 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:58:58.692409  6339 log.cc:927] Time spent T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 12:58:58.692768  6253 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:58.693867  6337 log.cc:927] Time spent T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.318s	user 0.000s	sys 0.001s
I20260709 12:58:58.695540  6253 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:58.568830  6108 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:58.626648  1536 raft_consensus.cc:2393] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 17: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 12:58:58.592818  6312 log.cc:927] Time spent T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:58:58.627733  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:58.699375  1541 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:58:58.700450  6239 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:58.478652  6326 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.704263  6295 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:58.610316  6240 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:58.631958  5962 raft_consensus.cc:740] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:58.588965  6265 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.687654  6347 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:58:58.705952  6240 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.706710  6347 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:58.707268  6347 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:58.709143  6231 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:58.709817  6231 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:58.710440  5815 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:58.709941  6240 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:58.702651  1541 raft_consensus.cc:1240] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: []
W20260709 12:58:58.714805  6264 consensus_meta.cc:287] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.628s	user 0.009s	sys 0.000s
I20260709 12:58:58.770375  6264 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:58.613556  6236 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.773718  6236 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:58.774415  6236 consensus_queue.cc:1059] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:58:58.705188  6349 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.775646  6349 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.778213  6349 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:58.778810  6349 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:58:58.715884  6332 log.cc:927] Time spent T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.406s	user 0.000s	sys 0.001s
I20260709 12:58:58.716442  6353 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.781654  6353 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.784150  6353 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:58.611980  6250 consensus_queue.cc:237] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.660166  6258 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.788767  6258 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.791200  6258 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:58.791870  6258 raft_consensus.cc:3055] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:58:58.785104  6353 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:58.793246  6353 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.723062  5867 consensus_queue.cc:237] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:58:58.724412  6130 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.801522  6130 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:58.726099  6255 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:58.620201  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:58.727802  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 2180) took 1517 ms. Trace:
I20260709 12:58:58.680015  1540 rpcz_store.cc:276] 0709 12:58:57.237424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.237594 (+   170us) service_pool.cc:224] Handling call
0709 12:58:57.325724 (+ 88130us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:57.347180 (+ 21456us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:58:57.548066 (+200886us) log.cc:844] Serialized 14 byte log entry
0709 12:58:57.980903 (+432837us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:57.984854 (+  3951us) log.cc:844] Serialized 26 byte log entry
0709 12:58:57.985034 (+   180us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:57.985282 (+   248us) log.cc:844] Serialized 14 byte log entry
0709 12:58:57.985489 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:57.985564 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:58.169425 (+183861us) spinlock_profiling.cc:243] Waited 55.5 ms on lock 0x7b18001fc5a0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f64522 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd 000000000038f354 000000000038f199 00007fc859f4783a
0709 12:58:58.173050 (+  3625us) spinlock_profiling.cc:243] Waited 4.97 ms on lock 0x7b18001fc5a0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859edec0a 00007fc86361e219 00007fc860f2558f 00007fc859f64571 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd
0709 12:58:58.588963 (+415913us) raft_consensus.cc:1685] finished
0709 12:58:58.588991 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:58.589175 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":139550,"prepare.queue_time_us":217373,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":81,"raft.queue_time_us":49900,"raft.run_cpu_time_us":434,"raft.run_wall_time_us":39278,"spinlock_wait_cycles":139158272,"thread_start_us":452816,"threads_started":2,"wal-append.queue_time_us":444321}
I20260709 12:58:58.736438  6296 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:58.803386  1609 rpcz_store.cc:276] 0709 12:58:57.210307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.213094 (+  2787us) service_pool.cc:224] Handling call
0709 12:58:57.213567 (+   473us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:57.368907 (+155340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:57.368939 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:57.375965 (+  7026us) log.cc:844] Serialized 52 byte log entry
0709 12:58:57.823849 (+447884us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b1800328840. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf10d1 00007fc85d00ca0f
0709 12:58:58.028821 (+204972us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:58:58.028862 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:58.030846 (+  1984us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:58.727446 (+696600us) raft_consensus.cc:1685] finished
0709 12:58:58.727475 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:58.727737 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":209392,"raft.queue_time_us":168127,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":97,"spinlock_wait_cycles":60080000,"thread_start_us":204774,"threads_started":1,"wal-append.queue_time_us":818351}
I20260709 12:58:58.738438  6105 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:58.745401  6319 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.746620  6333 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:58.859031  6296 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.749225  6245 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:58.754944  6113 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:58.688062  6338 log.cc:927] Time spent T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:58:58.722159  6266 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:58.795655  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 1729) took 1557 ms. Trace:
I20260709 12:58:58.919641  1533 rpcz_store.cc:276] 0709 12:58:57.238291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.238494 (+   203us) service_pool.cc:224] Handling call
0709 12:58:57.238847 (+   353us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:58:57.280350 (+ 41503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:57.280386 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:58:57.928104 (+647718us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b2c00000658. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85b94aa11 00007fc85b95a372 00007fc85d08ca01 00007fc85d05143a 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2
0709 12:58:57.935165 (+  7061us) log.cc:844] Serialized 52 byte log entry
0709 12:58:58.127668 (+192503us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:58:58.193423 (+ 65755us) log.cc:844] Serialized 14 byte log entry
0709 12:58:58.198075 (+  4652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:58.198140 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:58.795259 (+597119us) raft_consensus.cc:1685] finished
0709 12:58:58.795385 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:58.795563 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43870,"prepare.queue_time_us":65490,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":41796,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":62118,"spinlock_wait_cycles":3109248,"thread_start_us":192063,"threads_started":1,"wal-append.queue_time_us":371292}
I20260709 12:58:58.779325  6349 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:58:58.832376  1508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.011s	sys 0.014s
W20260709 12:58:58.926951  1508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.011s	sys 0.015s
I20260709 12:58:58.792264  6258 raft_consensus.cc:740] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:58.767854  6108 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.937042  6347 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.938091  6108 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:58.905402  6245 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.939510  6347 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:58.939038  6245 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.941862  6245 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:58.942592  1682 raft_consensus.cc:2393] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 16: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:58.910854  6222 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.834362  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:58.944257  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:58.944921  6358 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:58.945439  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:58.927908  1581 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:58.945487  6358 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.947962  6265 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:58.949539  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1810) took 1036 ms. Trace:
I20260709 12:58:58.949277  6231 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.949931  1610 rpcz_store.cc:276] 0709 12:58:57.913650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.913780 (+   130us) service_pool.cc:224] Handling call
0709 12:58:57.914117 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:58.185842 (+271725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:58.949250 (+763408us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b5400122ad4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:58.949447 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":613675776}
I20260709 12:58:58.947557  6222 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.954358  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:58.955057  1609 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 12.
I20260709 12:58:58.954375  1688 raft_consensus.cc:2393] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 18: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:58.859733  6296 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.962847  1684 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
W20260709 12:58:58.964927  1535 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.002s	sys 0.010s
W20260709 12:58:58.965303  1535 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.002s	sys 0.010s
I20260709 12:58:58.966058  6231 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:58.949935  6358 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:58.960536  6265 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:58:58.965667  1608 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.000s	sys 0.011s
I20260709 12:58:58.958662  6349 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:58:58.982044  1608 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.000s	sys 0.012s
I20260709 12:58:58.983276  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 2157) took 1152 ms. Trace:
I20260709 12:58:58.984012  1687 rpcz_store.cc:276] 0709 12:58:57.829376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:57.829824 (+   448us) service_pool.cc:224] Handling call
0709 12:58:57.830105 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:57.830422 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:57.830447 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:57.860299 (+ 29852us) log.cc:844] Serialized 26 byte log entry
0709 12:58:58.237860 (+377561us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:58:58.237898 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:58.237961 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:58.981854 (+743893us) raft_consensus.cc:1685] finished
0709 12:58:58.981875 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:58.982042 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1642,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":20921,"thread_start_us":301978,"threads_started":1,"wal-append.queue_time_us":434602}
I20260709 12:58:58.961495  6243 consensus_queue.cc:1059] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:58:58.981253  6265 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:58.994398  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:58:59.005345  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 424900us
W20260709 12:58:59.004721  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 318417us
I20260709 12:58:58.984864  6258 consensus_queue.cc:260] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.984259  6241 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:58.981444  6224 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:58.993085  6355 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.010000  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:58:58.997704  6137 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.000s	sys 0.048s
I20260709 12:58:59.005004  6265 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:59.005199  6325 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 12:58:59.018492  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.005852  6264 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:59.021788  1690 raft_consensus.cc:1240] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 12:58:59.016611  6137 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.000s	sys 0.052s
W20260709 12:58:59.021435  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 74346.7us
I20260709 12:58:59.025168  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:59.026229  1687 raft_consensus.cc:2393] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 11: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:59.016124  6258 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:58:59.025039  6137 raft_consensus.cc:697] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:59.033084  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:58:59.033728  1609 raft_consensus.cc:606] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:59.023357  6231 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:59.037215  6231 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.033238  6137 consensus_queue.cc:237] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.046149  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:59.046439  6113 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:59.016880  6355 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:59.047469  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:59.049188  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:59.052737  1688 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
I20260709 12:58:59.032059  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:59.054929  1684 raft_consensus.cc:2393] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 10: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:59.088867  1687 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 12:58:59.090790  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:59.091487  2303 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 12:58:59.095929  1507 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:59.096776  6227 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:59.098052  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:58:59.099866  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:58:59.097200  6227 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.100548  6227 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:59.049090  6355 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:59.022650  6325 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.110242  6325 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:59.111027  6293 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:58:59.111428  2303 raft_consensus.cc:2393] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 12: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:58:59.113322  6369 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:59.113867  6369 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.114477  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:59.114385  1608 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 12:58:59.115370  1691 raft_consensus.cc:2410] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 12:58:59.115837  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:59.116823  6296 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:59.049500  6319 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:59.117534  1615 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 18. Current term is 19. Ops: []
I20260709 12:58:59.088841  6353 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:59.118867  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:59.121547  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:59.120465  6369 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:59.117373  6322 raft_consensus.cc:3055] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:58:59.120906  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:59.127924  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:59.128607  1613 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:59.129908  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:59.131623  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:59.132274  1608 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:59.116202  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:59.123656  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:59.120581  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:59.124915  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:59.125051  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:59.125959  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:59.138607  1616 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:58:59.141569  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:59.142390  1541 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:58:59.143579  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:59.147042  2266 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:59.147187  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:59.147877  1535 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:58:59.148877  1508 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:59.150565  1508 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:59.139078  1687 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:58:59.131803  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:59.155361  1654 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:59.151453  1508 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:59.137499  1691 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 18.
I20260709 12:58:59.156498  1541 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:58:59.153359  1684 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 12:58:59.160820  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:59.164608  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:59.166770  1687 raft_consensus.cc:2410] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 15 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:58:59.167543  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:59.168246  1539 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:59.173462  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:59.176091  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:59.107969  6227 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:59.244437  1533 raft_consensus.cc:1275] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 12:58:59.243407  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:58:59.190785  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.250216  1541 raft_consensus.cc:2393] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 17: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 12:58:59.252339  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 88202.8us
I20260709 12:58:59.260207  1539 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:58:59.262056  1535 raft_consensus.cc:2368] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13.
I20260709 12:58:59.159266  6355 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:59.127375  6322 raft_consensus.cc:740] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:59.158669  6353 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:59.162864  6260 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:58:59.273434  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:59.175189  5926 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:59.253206  1581 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:59.267968  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:59.268539  1685 raft_consensus.cc:1275] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:58:59.162681  6183 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:59.271713  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:59.164013  6222 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:59.176712  6271 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.145219  6142 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:59.274806  1613 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 12:58:59.283281  1581 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:59.243057  6236 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:58:59.278823  1685 pending_rounds.cc:85] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 7
I20260709 12:58:59.290203  1685 pending_rounds.cc:107] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:58:59.279016  1688 raft_consensus.cc:2410] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 18 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 12:58:59.256105  6324 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.262023  6105 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.283345  1608 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:58:59.243886  6251 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:58:59.277839  6130 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.243587  6296 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:58:59.290439  1685 raft_consensus.cc:2889] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:59.276172  6260 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.249145  6349 consensus_queue.cc:1059] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 18.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:58:59.304018  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:59.282204  6183 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.290457  1581 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:59.282783  5926 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:59.286253  6264 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:59.289955  6368 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:59.367230  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:58:59.365686  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 47726.2us
I20260709 12:58:59.413316  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:58:59.419327  1583 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:59.420688  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:59.421578  1616 raft_consensus.cc:2393] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 15: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:58:59.280714  6353 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.304649  6260 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:59.432541  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:58:59.440510  1688 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 17. Current term is 18. Ops: []
I20260709 12:58:59.308537  6183 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:59.307745  6159 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:59.445462  6159 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:59.445374  5867 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:58:59.315963  5926 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:59.316419  6264 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.320696  6368 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:59.423060  6222 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.457804  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 2572) took 1266 ms. Trace:
I20260709 12:58:59.418213  6251 raft_consensus.cc:697] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:58:59.459170  6371 log.cc:927] Time spent T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.314s	user 0.001s	sys 0.000s
I20260709 12:58:59.317544  6319 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:58:59.460592  1683 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 12:58:59.307473  6105 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.462107  1583 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:59.364657  6322 consensus_queue.cc:260] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.452867  6358 consensus_queue.cc:1059] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:58:59.465966  1534 rpcz_store.cc:276] 0709 12:58:58.191701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:58.196356 (+  4655us) service_pool.cc:224] Handling call
0709 12:58:58.196667 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:58:58.220696 (+ 24029us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:58:58.298430 (+ 77734us) log.cc:844] Serialized 14 byte log entry
0709 12:58:58.953805 (+655375us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b180028ef40. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf123a 00007fc85d05ba2a
0709 12:58:59.271259 (+317454us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:58:59.285934 (+ 14675us) log.cc:844] Serialized 26 byte log entry
0709 12:58:59.286084 (+   150us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:58:59.286115 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:59.286181 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:58:59.457480 (+171299us) raft_consensus.cc:1685] finished
0709 12:58:59.457586 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:59.457726 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13979,"prepare.queue_time_us":69633,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":2724,"raft.queue_time_us":18207,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":29050,"spinlock_wait_cycles":3497344,"thread_start_us":317213,"threads_started":1,"wal-append.queue_time_us":1121481}
I20260709 12:58:59.418213  6369 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:58:59.492772  6322 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:59.288590  6271 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.438938  5685 raft_consensus.cc:3055] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:58:59.469576  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:59.494998  1688 raft_consensus.cc:2393] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 15: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:58:59.495855  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:59.428004  6295 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:59.496639  6295 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.497273  6231 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:59.498646  6295 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:59.441581  6227 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:58:59.463714  6264 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:59.308035  6130 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.501081  1508 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:59.502038  1508 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:59.502844  1508 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:59.504971  6227 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:58:59.505429  6227 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:59.505796  6227 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:59.328711  6324 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.494303  6358 raft_consensus.cc:3055] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:58:59.465476  6368 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:59.509986  1654 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:59.290581  6142 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.465111  6325 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
W20260709 12:58:59.508944  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 131901us
W20260709 12:58:59.510303  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 83506.7us
I20260709 12:58:59.468694  6347 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.515213  6381 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:59.481874  1583 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:59.524072  1581 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:59.528528  1654 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:59.490846  6223 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:58:59.533610  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 51813.9us
I20260709 12:58:59.531117  1654 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:59.522552  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 247) took 1170 ms. Trace:
I20260709 12:58:59.534360  1583 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:59.534610  1612 rpcz_store.cc:276] 0709 12:58:58.351881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:58.554273 (+202392us) service_pool.cc:224] Handling call
0709 12:58:58.554634 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:58:58.681295 (+126661us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:58:58.681327 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:58:58.681370 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:58:58.681411 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:58:59.522332 (+840921us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b540008c0d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:58:59.522378 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:58:59.522496 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":290810112}
I20260709 12:58:59.531785  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:59.532333  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 114111us
I20260709 12:58:59.536175  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:59.536887  1612 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:58:59.501359  6130 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:59.471953  6222 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.508436  5685 raft_consensus.cc:740] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:59.509338  6358 raft_consensus.cc:740] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:59.539626  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:59.512352  6355 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:58:59.523260  6353 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:59.551055  6152 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:58:59.532711  6293 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:58:59.532889  6381 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:59.578361  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:59.579823  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:59.542457  6319 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:58:59.581800  1583 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:59.554136  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:58:59.541999  6231 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:58:59.529250  6296 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.557279  6358 consensus_queue.cc:260] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.560791  6222 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:59.535357  6243 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:58:59.561430  5685 consensus_queue.cc:260] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.562718  6142 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:59.566354  6183 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:58:59.568457  6324 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:59.572975  6251 consensus_queue.cc:237] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.575152  6271 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:59.575388  6224 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:59.541234  6137 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:58:59.613382  6137 raft_consensus.cc:697] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:59.613819  5685 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:58:59.614295  6137 consensus_queue.cc:237] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.577131  6159 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.603824  6151 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:58:59.618019  6159 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:59.582772  1691 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:58:59.583585  1685 raft_consensus.cc:2410] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:58:59.624112  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:59.625305  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:59.589306  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 2737) took 1071 ms. Trace:
I20260709 12:58:59.590806  1581 leader_election.cc:400] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13.
I20260709 12:58:59.627333  1581 leader_election.cc:403] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 12:58:59.629907  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:59.630632  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.631808  1616 raft_consensus.cc:1240] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 12:58:59.606050  6258 consensus_meta.cc:287] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.555s	user 0.009s	sys 0.000s
I20260709 12:58:59.591022  5962 consensus_queue.cc:260] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.634218  5962 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:58:59.635481  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:59.637015  6358 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:59.593225  6250 raft_consensus.cc:3055] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:58:59.638126  6250 raft_consensus.cc:740] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:59.596728  6231 raft_consensus.cc:697] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:58:59.597661  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:59.578411  6381 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:58:59.552356  6355 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.598856  6319 raft_consensus.cc:697] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:59.599244  6105 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:59.532615  6347 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.581086  6293 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.599699  6384 consensus_queue.cc:1059] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:58:59.598881  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:58:59.601303  1583 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:59.561331  6265 consensus_meta.cc:287] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.539s	user 0.009s	sys 0.001s
I20260709 12:58:59.600498  1654 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:58:59.530018  6383 consensus_queue.cc:1048] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:58:59.605168  1689 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:58:59.626827  6326 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:59.626590  1683 rpcz_store.cc:276] 0709 12:58:58.517895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:58.557874 (+ 39979us) service_pool.cc:224] Handling call
0709 12:58:59.589103 (+1031229us) spinlock_profiling.cc:243] Waited 899 ms on lock 0x7b5400159354. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:59.589217 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2067651968}
I20260709 12:58:59.636901  1537 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:58:59.643422  6159 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:58:59.639559  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.637041  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 2736) took 1119 ms. Trace:
I20260709 12:58:59.640828  1691 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:58:59.645923  2303 raft_consensus.cc:2393] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 13: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:58:59.664551  1682 rpcz_store.cc:276] 0709 12:58:58.517576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:58.517702 (+   126us) service_pool.cc:224] Handling call
0709 12:58:59.636846 (+1119144us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b5400388e54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:59.636985 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":881048320}
I20260709 12:58:59.665396  1691 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: []
I20260709 12:58:59.666043  1682 raft_consensus.cc:1240] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:59.666834  1691 raft_consensus.cc:1275] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 8. (term mismatch)
I20260709 12:58:59.667219  1691 pending_rounds.cc:85] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 7
I20260709 12:58:59.667538  1691 pending_rounds.cc:107] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 16.8
I20260709 12:58:59.667773  1691 raft_consensus.cc:2889] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:59.647081  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:59.646883  6227 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.669112  1541 raft_consensus.cc:2393] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 13: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:58:59.669543  6381 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.670502  6227 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:59.648104  6183 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:59.648912  6368 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.652671  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:59.677337  6293 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:58:59.681872  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 81471us
I20260709 12:58:59.667250  1682 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: []
I20260709 12:58:59.737627  1683 raft_consensus.cc:1240] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 9. Current term is 10. Ops: []
W20260709 12:58:59.738240  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 137015us
I20260709 12:58:59.745106  1583 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:58:59.745249  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:59.650279  6355 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:58:59.641785  6271 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:59.752887  1688 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 12:58:59.604442  6296 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.757037  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:59.765663  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:59.766320  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:58:59.766914  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:59.771374  1583 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:58:59.766428  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 210906us
I20260709 12:58:59.744766  5867 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:58:59.676133  6265 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.641870  6260 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.744508  6117 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:58:59.756901  6242 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:59.779817  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:59.738296  6222 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.765370  6105 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:59.743187  6290 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:58:59.783080  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:59.757200  6245 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:59.783756  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:59.784204  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:59.777251  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 2743) took 1258 ms. Trace:
I20260709 12:58:59.757596  6325 consensus_queue.cc:1059] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:58:59.809782  1689 rpcz_store.cc:276] 0709 12:58:58.519301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:58.575765 (+ 56464us) service_pool.cc:224] Handling call
0709 12:58:59.777040 (+1201275us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b5400288cd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:58:59.777179 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2051032320}
I20260709 12:58:59.759737  6152 consensus_queue.cc:1059] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:58:59.743929  6243 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:58:59.798246  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:59.794497  5951 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:58:59.817654  1617 raft_consensus.cc:2410] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 12:58:59.766914  6324 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:59.803848  1611 raft_consensus.cc:1240] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:58:59.791929  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:59.779217  5867 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:59.810405  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:59.811264  1614 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
I20260709 12:58:59.760069  6234 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:58:59.758623  6271 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.793929  6117 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:58:59.837337  1691 raft_consensus.cc:1240] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:58:59.838855  1610 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
W20260709 12:58:59.823231  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:59.807145  5815 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:58:59.862764  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 101221us
I20260709 12:58:59.863592  1505 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:59.841959  5867 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:58:59.803974  6242 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.866423  1505 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:58:59.818774  5951 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:59.838649  6386 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:58:59.809610  6105 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.809137  6222 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.873983  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:59.812908  6290 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.814918  6245 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.876678  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:59.879365  1542 raft_consensus.cc:2368] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16.
I20260709 12:58:59.854826  6117 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:58:59.806453  6319 consensus_queue.cc:237] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.838140  6383 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:58:59.885370  6296 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:59.886230  6368 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:59.887404  6151 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:58:59.872386  5951 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:58:59.891127  6242 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:59.892194  6290 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:59.812716  5926 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.807297  6231 consensus_queue.cc:237] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.841382  6324 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.880610  1581 leader_election.cc:400] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16.
W20260709 12:58:59.893330  1582 consensus_peers.cc:597] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 95abfe15f7d54f3fb0f01f162b262561. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:59.895888  1581 leader_election.cc:403] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:58:59.871717  6381 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:59.899725  6381 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:58:59.876874  6386 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.905655  6250 consensus_queue.cc:260] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.906771  6250 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:58:59.910674  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:58:59.911448  1609 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:58:59.914004  1610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db702b262c1644109366a56f6f0d805a"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:58:59.914620  1610 raft_consensus.cc:606] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:58:59.914973  1610 raft_consensus.cc:614] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:58:59.915714  6392 log.cc:927] Time spent T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:58:59.916610  1610 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:58:59.930796  6375 raft_consensus.cc:3055] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:58:59.931582  6375 raft_consensus.cc:740] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:58:59.928865  1613 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:58:59.932650  6375 consensus_queue.cc:260] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.943650  5926 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:58:59.892145  6242 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:58:59.946007  1611 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:58:59.912405  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:58:59.964016  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 83591.4us
I20260709 12:58:59.814584  6264 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:58:59.963611  1610 raft_consensus.cc:1240] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:58:59.987844  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:58:59.989001  1542 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:58:59.993194  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:00.004407  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 231366us
I20260709 12:59:00.005074  1608 raft_consensus.cc:1240] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:58:59.986593  6223 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:00.005999  1541 raft_consensus.cc:1240] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: []
I20260709 12:58:59.986935  6243 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.022351  1542 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:59:00.025995  1581 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:58:59.999624  6260 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:00.028575  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:59:00.026427  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 255142us
I20260709 12:59:00.019284  6265 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:00.034669  1609 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:59:00.015213  6271 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:58:59.995455  6113 consensus_queue.cc:1059] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:59:00.000169  6266 consensus_queue.cc:1059] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:59:00.052832  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:00.000653  6353 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:59:00.015637  6152 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:00.047947  1615 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:59:00.030258  6326 raft_consensus.cc:3055] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:59:00.039145  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:00.058815  1683 raft_consensus.cc:2410] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 12:59:00.052109  1689 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:00.019457  6105 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:00.054833  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:00.063000  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:59:00.056402  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 190085us
I20260709 12:59:00.032433  6151 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:00.055035  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:00.053648  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:00.039729  6245 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:00.058218  6326 raft_consensus.cc:740] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:00.021132  6243 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.116173  1617 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 18. Current term is 19. Ops: []
W20260709 12:59:00.125411  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.042771  6381 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:00.031845  6325 consensus_queue.cc:1059] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 12:59:00.126864  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 62944us
I20260709 12:59:00.130748  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
W20260709 12:59:00.083166  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.046473  5926 consensus_queue.cc:1059] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:59:00.139719  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:00.141508  1609 raft_consensus.cc:606] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:00.141944  1609 raft_consensus.cc:614] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:00.128222  6251 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.131527  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:59:00.133108  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 97805.3us
I20260709 12:59:00.066480  6324 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:00.062784  6152 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:00.139815  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:00.145862  1691 raft_consensus.cc:2393] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 14: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:59:00.144573  1685 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 12:59:00.138581  1617 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 12:59:00.139379  5685 consensus_meta.cc:287] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.525s	user 0.008s	sys 0.004s
I20260709 12:59:00.148335  1617 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:59:00.126816  6398 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:00.150218  6159 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13.
I20260709 12:59:00.147495   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 12:59:00.150152  5962 consensus_meta.cc:287] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.004s
I20260709 12:59:00.152024  1616 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:59:00.152638  5926 consensus_queue.cc:1243] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:59:00.153285  6264 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:00.157752  6243 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:00.150218  6293 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.147884  6222 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:00.161780  6293 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:00.162513  5867 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.162597  1687 raft_consensus.cc:2393] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 13: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:59:00.164191  1614 raft_consensus.cc:2410] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:59:00.165022  5867 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:00.133313  6151 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.165987  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:00.167124  6151 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:00.143334  6381 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.172782  6223 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16.
I20260709 12:59:00.174273  1583 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:00.181092  1611 raft_consensus.cc:1275] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:59:00.164229  1612 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 13.
I20260709 12:59:00.182065  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:00.182705  1686 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:59:00.186968  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.188112  1505 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:00.196626  6245 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:00.197259  6368 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:00.198462  6386 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:00.198745  6368 raft_consensus.cc:993] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:00.199195  6368 raft_consensus.cc:1081] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:00.196244  1505 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:00.146589  6251 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.211198  6251 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:00.191761  5815 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:00.210839  6355 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.203356  6386 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:00.219900  1535 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 18. Current term is 19. Ops: []
I20260709 12:59:00.220764  1686 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 12:59:00.220563  6355 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:00.214195  1505 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:00.186098  6326 consensus_queue.cc:260] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.227587  1684 raft_consensus.cc:1240] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 15. Current term is 16. Ops: [13.8-15.9]
I20260709 12:59:00.217629  5685 consensus_queue.cc:1059] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:00.212860  6381 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:00.182911  6398 raft_consensus.cc:697] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:00.212577  1583 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:00.238734  1583 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:00.233096  1505 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:59:00.239945  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.236877  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:00.245860  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:00.246207  5962 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:00.247272  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:00.247610  6368 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:00.248252  6368 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:00.248667  6368 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:00.254997  5962 raft_consensus.cc:697] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:00.235618  6399 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:00.253347  1691 raft_consensus.cc:2368] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16.
I20260709 12:59:00.256076  6381 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:00.202236  5951 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.242952  5685 consensus_queue.cc:1243] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:59:00.256049  5962 consensus_queue.cc:237] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.256433  1683 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:59:00.230022  6117 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.263540  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:00.265509  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:00.266541  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:00.263828  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:00.256850  1505 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:00.259220  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:00.273422  1690 raft_consensus.cc:1240] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:59:00.274013  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 1840) took 1123 ms. Trace:
I20260709 12:59:00.274418  1608 rpcz_store.cc:276] 0709 12:58:59.150821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:59.426081 (+275260us) service_pool.cc:224] Handling call
0709 12:58:59.461941 (+ 35860us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:00.006600 (+544659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:00.273763 (+267163us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b5400445054. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:59:00.273956 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1248647936}
I20260709 12:59:00.283553  1583 leader_election.cc:400] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16.
I20260709 12:59:00.282064  1505 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:00.305357  1682 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:59:00.307161  1583 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:00.259963  5951 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:00.311058  1505 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:00.258471  6381 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:00.277935  6386 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:00.284034  6265 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:00.340507  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:00.280572  5815 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:00.342166  1535 raft_consensus.cc:1240] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:59:00.343698  1542 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 12:59:00.343523  1536 raft_consensus.cc:1275] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:59:00.350086  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:00.351428  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:00.352515  1534 raft_consensus.cc:2393] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 19: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:59:00.346030  1583 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:00.281482  6399 consensus_queue.cc:1059] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:59:00.280508  6355 consensus_queue.cc:1059] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 12:59:00.314953  6324 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:59:00.362886  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:00.338842  6381 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:00.352377  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:00.296275  6245 consensus_queue.cc:1059] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:59:00.369560  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:00.360330  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:00.360649  1583 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:00.370702  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:00.362725  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:00.319231  6386 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:00.317716  6222 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:00.340842  6358 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:00.350086  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:00.365787  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:00.366053  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:00.366652  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:00.356761  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:00.378901  6117 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:00.357645  5815 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.381779  5815 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:59:00.385193  6408 log.cc:927] Time spent T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:59:00.355928  6265 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.370203  6224 raft_consensus.cc:3055] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:00.388988  6224 raft_consensus.cc:740] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:00.389494  6347 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:00.389869  6265 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:00.378790  6264 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:59:00.256816  6398 consensus_queue.cc:237] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.397513  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:00.363675  6324 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:00.367027  5980 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:00.401762  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:00.402392  1537 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:59:00.402966  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:00.376153  6386 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:00.388537  6400 raft_consensus.cc:3055] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:59:00.412798  6400 raft_consensus.cc:740] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:00.414572  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:00.407989  6324 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:00.415818  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:00.417088  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:00.417289  6403 raft_consensus.cc:3055] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:59:00.418471  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.421568  1541 raft_consensus.cc:2393] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 15: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:59:00.417755  6403 raft_consensus.cc:740] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:00.422923  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:00.424592  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:00.389894  6224 consensus_queue.cc:260] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.425200  1534 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 12:59:00.427189  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:00.429574  1539 pending_rounds.cc:85] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 6
I20260709 12:59:00.430141  1539 pending_rounds.cc:107] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:59:00.430433  1539 raft_consensus.cc:2889] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:00.434461  1686 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:59:00.435621  1583 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:00.436412  1541 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:59:00.453969  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:00.455322  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:00.456745  1687 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:00.457970  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:00.473368  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:00.474433  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:00.479841  1687 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 12:59:00.481367  1583 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:00.461063  6415 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:00.489738  6264 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:59:00.490489  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:00.494377  6368 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.497602  6386 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.528887  1685 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:59:00.527954  1534 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:59:00.535544  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:59:00.540985  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.526728  1687 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50708
W20260709 12:59:00.544049  6410 log.cc:927] Time spent T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:59:00.546264  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 2162) took 1536 ms. Trace:
I20260709 12:59:00.546667  1684 rpcz_store.cc:276] 0709 12:58:59.010016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:59.165916 (+155900us) service_pool.cc:224] Handling call
0709 12:58:59.637061 (+471145us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:00.228049 (+590988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:00.545347 (+317298us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b5400388e54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:59:00.546087 (+   740us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b5400388e50. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:59:00.546207 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2400067712}
I20260709 12:59:00.549296  6415 raft_consensus.cc:697] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:00.550501  6415 consensus_queue.cc:237] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.551699  6271 raft_consensus.cc:3055] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:00.552114  6271 raft_consensus.cc:740] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:00.552980  6271 consensus_queue.cc:260] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.554217  6271 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:00.556622  6159 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:00.558784  6264 raft_consensus.cc:697] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:00.561897  6220 raft_consensus.cc:3055] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:00.562345  6220 raft_consensus.cc:740] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:00.494530  6358 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:00.528828  6152 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:00.559825  6264 consensus_queue.cc:237] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.568228  1687 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:00.568706  1687 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:00.571260  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:00.572587  1533 raft_consensus.cc:2368] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 11. Current term is 12.
I20260709 12:59:00.530553  6347 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.574944  6347 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.576047  6324 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.582167  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:00.583266  1691 raft_consensus.cc:1217] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Deduplicated request from leader. Original: 9.7->[11.8-15.10]   Dedup: 13.9->[15.10-15.10]
I20260709 12:59:00.583818  1691 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: [11.8-15.10]
W20260709 12:59:00.586592  6412 log.cc:927] Time spent T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:59:00.413774  6400 consensus_queue.cc:260] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.422945  6403 consensus_queue.cc:260] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.595028  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:00.590972  5962 consensus_queue.cc:1059] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:59:00.600605  5962 consensus_queue.cc:1243] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:59:00.603307  1655 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:00.604555  1655 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:00.605492  6375 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:00.605871  6296 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:00.606094  6293 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:59:00.606611  6414 log.cc:927] Time spent T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:59:00.588377  6400 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:00.607383  6293 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:00.607352  6296 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:00.605633  1655 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:00.613447  1655 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:00.582281  6243 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:00.616796  6117 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:00.580786  6153 raft_consensus.cc:3055] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:00.605218  6381 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.618464  1534 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:59:00.598975  1687 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.594309  6227 raft_consensus.cc:3055] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:59:00.625346  1655 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:00.629561  1655 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:00.630481  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:00.631129  1542 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 12:59:00.636626  1687 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:00.636775  1655 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:00.639371  1655 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:00.640271  1537 raft_consensus.cc:1240] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 15. Current term is 16. Ops: []
I20260709 12:59:00.620760  6347 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:00.619700  6153 raft_consensus.cc:740] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:00.642941   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:00.631397  6227 raft_consensus.cc:740] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:00.663794  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:00.648032  2266 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:00.665112  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:00.633563  6296 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:59:00.655870  6250 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:00.641083  6113 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:00.661164  6403 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:00.661528  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:00.617000  6243 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.637688  6353 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:59:00.637933  6117 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:00.669066  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:00.674227  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:00.678720  1608 raft_consensus.cc:2410] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 12:59:00.682334  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:00.683866  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:00.668862  6359 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:00.689786  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:00.692261  1608 raft_consensus.cc:1240] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 15. Current term is 16. Ops: [13.8-15.9]
I20260709 12:59:00.699447  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:00.713054  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:00.714015  1608 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 16: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:59:00.714855  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:00.715523  1613 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 12:59:00.716130  1611 raft_consensus.cc:2393] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 19: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:59:00.718029  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:00.724063  1541 raft_consensus.cc:1275] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 12:59:00.724582  1541 pending_rounds.cc:85] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 9
I20260709 12:59:00.724828  1541 pending_rounds.cc:107] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 12:59:00.725049  1541 raft_consensus.cc:2889] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:00.727171  6386 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:00.727999  6381 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:00.729610  6243 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:00.691880  6153 consensus_queue.cc:260] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.729799  6151 raft_consensus.cc:2955] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Committing config change with OpId 12.6: config changed from index -1 to 6, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:00.731218  6153 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:00.727782  6417 consensus_queue.cc:1059] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:59:00.734772  6422 log.cc:927] Time spent T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:59:00.745901  1610 raft_consensus.cc:1240] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 12. Current term is 13. Ops: []
W20260709 12:59:00.717056  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 77765.1us
I20260709 12:59:00.749086  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:00.750650  1655 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:00.754016  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:00.754772  1610 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:00.755841  1655 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:00.758839  1615 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 12:59:00.761665  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:00.748881  1654 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:00.727283  6293 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:59:00.763217  1686 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 18. Current term is 19. Ops: []
I20260709 12:59:00.763479  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:00.764046  1615 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:59:00.764784  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:00.765280  1615 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:59:00.765949  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:00.762501  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:00.694419  6227 consensus_queue.cc:260] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.773416  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:59:00.823870  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 75111.9us
I20260709 12:59:00.777494  1615 raft_consensus.cc:3055] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:00.824519  1615 raft_consensus.cc:740] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:00.830370  1609 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 10.
I20260709 12:59:00.749800  6326 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:00.841528  1610 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 12:59:00.843145  1610 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 12:59:00.844913  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 71299.9us
I20260709 12:59:00.846535  1655 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:00.847851  1654 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:00.848008  1655 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:00.823503  6295 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:00.825721  6293 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 12:59:00.854524  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 183274us
I20260709 12:59:00.855885  1608 raft_consensus.cc:1275] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:00.844532  6424 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:00.844637  6359 raft_consensus.cc:697] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 13 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:59:00.844991  6227 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:00.845765  6117 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:00.852312  6324 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:00.889053  1654 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:00.875519  6251 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:00.849357  6294 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:59:00.928097  6359 consensus_queue.cc:237] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:00.930169  6220 consensus_queue.cc:260] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.931507  6220 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:00.902041  6152 raft_consensus.cc:3055] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:59:00.932732  6152 raft_consensus.cc:740] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:00.933584  6152 consensus_queue.cc:260] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.934584  6152 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:59:00.943637  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 95703.4us
I20260709 12:59:00.944674  1655 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:00.883091  6296 consensus_queue.cc:1059] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:59:00.870013  6290 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:59:00.951014  1655 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:00.869735  6293 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:00.888598  6117 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:00.953462  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:00.887373  6295 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:59:00.924767  6271 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:59:00.957073  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:00.908617  6424 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:59:00.953156  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 296711us
I20260709 12:59:00.934154  6224 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:00.961558  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:00.962335  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:00.974869  1684 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 19.
I20260709 12:59:00.964569  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:00.975212  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:59:00.971333  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 108932us
W20260709 12:59:00.972675  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.972676  1505 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:00.973810  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:00.872376  6347 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:59:00.975736  1685 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:59:00.980459  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:00.986049  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:00.987993  1690 raft_consensus.cc:2393] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 10: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:59:00.988979  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:00.990751  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:00.990927  1685 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 12:59:00.992136  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:00.992837  1539 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:59:00.966624  6117 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:00.966871  6251 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:00.997141  1533 raft_consensus.cc:2393] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 12: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:59:00.965974  6295 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:00.960413  6245 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:00.996661  1683 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:59:00.954535  6250 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:59:00.972589  6271 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:01.007822  6295 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:01.008742  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:00.977373  6296 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:01.014684  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:01.019333  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:01.033632  1539 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 12:59:01.034394  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:01.036434  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:01.038400  1533 raft_consensus.cc:2393] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 17: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:59:01.011395  6245 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.052680  6245 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:01.011729  6271 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:59:01.057135  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 101418us
W20260709 12:59:01.057379  6433 log.cc:927] Time spent T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:59:01.059037  1508 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:01.016861  6431 ts_tablet_manager.cc:933] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:01.050503  6368 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:01.018325  6296 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:01.089270  1508 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:59:01.090385  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:01.099671  1539 raft_consensus.cc:1240] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 14. Current term is 15. Ops: []
W20260709 12:59:01.101529  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 128983us
W20260709 12:59:01.101662  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 150738us
I20260709 12:59:01.102416  1505 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:01.103348  1655 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:01.107805  1655 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:01.109988  1655 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:01.094635  6296 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:01.094200  6239 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:01.124223  1655 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:01.131502  1655 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:01.106120  6347 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:01.135265  1540 raft_consensus.cc:1240] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:01.134835  1655 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:59:01.136365  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 47156.7us
I20260709 12:59:01.114979  6384 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:01.139201  1505 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:01.139487  1655 leader_election.cc:400] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 11. Current term is 12.
I20260709 12:59:01.139787  6400 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:59:01.115485  6440 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:01.151347  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:01.152127  1539 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:59:01.134043  6251 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:01.134632  6353 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:01.162153  1536 raft_consensus.cc:1275] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:59:01.162425  1539 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:01.165814  1540 raft_consensus.cc:1240] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:01.137810  6241 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:01.162642  1535 raft_consensus.cc:2955] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Committing config change with OpId 12.6: config changed from index -1 to 6, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:01.141757  6239 raft_consensus.cc:2764] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:59:01.164026  1505 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:01.165412  1508 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:01.139015  6384 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:01.140812  6424 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:01.171200  1536 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:59:01.126732  6444 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
W20260709 12:59:01.175369  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 49258.9us
W20260709 12:59:01.186942  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 210851us
I20260709 12:59:01.175248  1539 raft_consensus.cc:1275] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:59:01.178361  1581 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:01.177270  1505 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:01.177116  6400 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:59:01.192142  6439 log.cc:927] Time spent T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:59:01.184897  6251 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:01.194839  6271 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.175014  6384 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:01.183691  6324 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:01.202687  1508 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:01.209074  1505 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:01.209239  1508 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:01.210114  6245 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:01.202591  6386 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:01.188002  6381 consensus_queue.cc:1059] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:59:01.232383  5926 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:59:01.207490  6251 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.220810  6324 raft_consensus.cc:697] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:01.238570  5926 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:01.238974  5926 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:01.239290  6324 consensus_queue.cc:237] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.213809  6400 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:01.240202  6251 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:59:01.237568  6151 consensus_meta.cc:287] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.003s
I20260709 12:59:01.206686  6239 consensus_queue.cc:1059] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:59:01.231920  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:01.220293  1505 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:01.260689  6458 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:59:01.255816  6271 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:59:01.267582  6454 log.cc:927] Time spent T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:59:01.218657  6245 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:01.264273  5926 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.258244  6381 consensus_queue.cc:1243] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 16.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:59:01.250523  6400 raft_consensus.cc:697] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:01.280769  6290 raft_consensus.cc:3055] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:01.281311  6290 raft_consensus.cc:740] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:01.281498  6400 consensus_queue.cc:237] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.282423  5926 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:01.282310  6290 consensus_queue.cc:260] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.284840  6290 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:01.261020  6324 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:01.286322  6324 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.290453  6324 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:01.286504  6296 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.312532  6368 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:59:01.290572  1691 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 12:59:01.288430  6357 consensus_queue.cc:1059] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:59:01.218374  6384 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.211494  6117 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.294178  6295 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.307449  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:01.308202  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:01.313817  6458 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:01.317449  6458 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:59:01.317602  1689 raft_consensus.cc:2393] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 19: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 12:59:01.308455  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 88231.8us
W20260709 12:59:01.309146  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 130872us
I20260709 12:59:01.321127  1581 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:01.322881  1505 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:01.325098  6296 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:01.326529  1534 raft_consensus.cc:1275] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:59:01.326933  1686 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 19.
I20260709 12:59:01.334333  1505 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:01.334977  1581 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:01.336283  1581 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:01.336879  1687 raft_consensus.cc:1240] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:01.339552  1655 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:01.339413  6462 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:59:01.341882  6459 log.cc:927] Time spent T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:59:01.332949  6151 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:39748 (request call id 0) took 12565 ms. Trace:
I20260709 12:59:01.343024  6266 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:01.343431  6266 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:01.342459  6151 rpcz_store.cc:276] 0709 12:58:48.767759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:48.769533 (+  1774us) service_pool.cc:224] Handling call
0709 12:58:49.370173 (+600640us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b2c00125b38. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85b94aa11 00007fc85b959a0a 00007fc85b959693 00007fc85b959631 00007fc85d08c902 00007fc85d08c6dd 00007fc85d057f3f 00007fc85d0576b3 00007fc862017d29 00007fc85b5961d4 00007fc85b596162
0709 12:58:49.444524 (+ 74351us) log.cc:844] Serialized 506 byte log entry
0709 12:58:51.043367 (+1598843us) spinlock_profiling.cc:243] Waited 3.65 ms on lock 0x7b1800116320. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859edec0a 00007fc86361e219 00007fc859f66a40 00007fc859f614e4 00007fc859f61455 00007fc85cfaab0b 00007fc85d02fb63 00007fc85d057752 00007fc862017d29
0709 12:59:01.332830 (+10289463us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1487732,"raft.queue_time_us":1533753,"raft.run_cpu_time_us":2465,"raft.run_wall_time_us":37884,"spinlock_wait_cycles":12688512,"thread_start_us":79201,"threads_started":1,"wal-append.queue_time_us":115765,"wal-append.run_cpu_time_us":1743,"wal-append.run_wall_time_us":1001771}
W20260709 12:59:01.337175  6448 log.cc:927] Time spent T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.186s	user 0.002s	sys 0.000s
I20260709 12:59:01.344434  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:01.345158  1540 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:59:01.345489  6452 log.cc:927] Time spent T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:59:01.347327  6384 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:01.349023  6293 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:01.349177  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:01.349980  1683 raft_consensus.cc:2393] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 11: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:59:01.354239  6117 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:01.340355  6381 consensus_queue.cc:1059] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:59:01.338798  6358 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:01.356148  1617 consensus_queue.cc:237] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:01.357486  1686 raft_consensus.cc:1240] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 15. Current term is 16. Ops: [13.8-15.9]
I20260709 12:59:01.339088  6326 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:01.361848  1508 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:01.343781  6266 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:01.364996  1540 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 14.
I20260709 12:59:01.365959  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:01.368150  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:01.332448  6239 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:01.371286  6461 raft_consensus.cc:3055] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:01.371757  6461 raft_consensus.cc:740] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:01.376456  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 12:59:01.379714  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 43509.4us
W20260709 12:59:01.381009  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:01.380188  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:01.383249  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:01.383817  1539 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:59:01.381501  1655 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:01.386921  1534 raft_consensus.cc:1275] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:01.373092  5926 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:59:01.368345  6384 consensus_queue.cc:1059] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:59:01.399544  1581 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:01.406220  1539 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 12:59:01.409106  1655 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:01.410213  6293 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:59:01.410760  6293 raft_consensus.cc:697] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:01.411674  6293 consensus_queue.cc:237] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.412628  6415 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:01.408548  5951 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:59:01.419200  6441 log.cc:927] Time spent T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.326s	user 0.003s	sys 0.000s
I20260709 12:59:01.420765  6250 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:59:01.424520  1615 consensus_queue.cc:260] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.425650  1615 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:01.392311  6245 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.394655  6224 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:01.431237  1581 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:01.427980  6326 consensus_queue.cc:1059] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:01.405270  6384 consensus_queue.cc:1243] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 16.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:59:01.438483  1615 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 14.
I20260709 12:59:01.433930  6245 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.440384  5951 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:01.433041  6220 consensus_queue.cc:1059] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:59:01.442028  6153 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:01.432298  6294 consensus_queue.cc:1048] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:59:01.442353  6224 raft_consensus.cc:697] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 14 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:01.451856  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:01.442786  6290 consensus_queue.cc:1059] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:59:01.448438  5685 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:59:01.452912  1538 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:01.459342  6369 consensus_queue.cc:1048] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:01.458812  6458 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.461377  1535 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 12:59:01.449476  5951 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:01.447391  6266 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:59:01.467942  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:01.470237  1688 raft_consensus.cc:1275] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:59:01.470337  1538 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 12:59:01.473868  1686 raft_consensus.cc:1240] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: []
I20260709 12:59:01.476787  1688 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:59:01.477273  1688 pending_rounds.cc:85] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 7
I20260709 12:59:01.477505  1688 pending_rounds.cc:107] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:59:01.477808  1688 raft_consensus.cc:2889] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:01.480250  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:01.475905  5685 consensus_queue.cc:1048] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:59:01.481707  1617 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:59:01.483816  1533 raft_consensus.cc:1275] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:59:01.484680  1542 raft_consensus.cc:1275] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:59:01.472270  1655 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:01.488348  1686 raft_consensus.cc:2368] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 17. Current term is 18.
I20260709 12:59:01.492252  6326 consensus_queue.cc:1048] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:01.464268  5951 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:01.495836  6183 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:59:01.499130  1534 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:59:01.499745  6295 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:01.453807  6153 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.504974  6250 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:59:01.505491  6266 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:01.496752  6151 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:59:01.509136  6245 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:59:01.512171  6451 log.cc:927] Time spent T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.364s	user 0.003s	sys 0.000s
I20260709 12:59:01.514223  6461 consensus_queue.cc:260] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.515287  1689 raft_consensus.cc:1275] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:59:01.516254  6296 raft_consensus.cc:3055] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:01.517978  1654 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:01.525476  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:01.536993  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:01.517802  1684 raft_consensus.cc:2955] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Committing config change with OpId 12.6: config changed from index -1 to 6, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:01.527948  1682 raft_consensus.cc:1275] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:59:01.538628  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:01.539273  1686 raft_consensus.cc:2410] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 16 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:59:01.541018  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:01.541755  1613 raft_consensus.cc:2393] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 14: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:59:01.540688  6296 raft_consensus.cc:740] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:01.542989  6461 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:01.543524  6152 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:01.543753  6450 log.cc:927] Time spent T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.383s	user 0.004s	sys 0.000s
I20260709 12:59:01.524232  6358 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.544559  6358 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.546819  6153 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:01.547257  6266 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:01.547792  5926 raft_consensus.cc:697] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:01.531154  6369 consensus_queue.cc:1048] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:59:01.548785  5926 consensus_queue.cc:237] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.555241  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:01.556063  1613 raft_consensus.cc:2393] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 19: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:59:01.560631  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:01.561101  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:01.562444  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:01.566370  1609 raft_consensus.cc:1240] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:59:01.546775  6358 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:01.561403  1538 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:01.542066  6250 raft_consensus.cc:697] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:01.588152  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:01.557224  6295 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:59:01.537189  5685 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:59:01.534607  6224 consensus_queue.cc:237] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.608889  1538 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:59:01.611390  1655 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:01.558334  6152 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.612351  6231 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:01.608783  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:01.613058  6231 raft_consensus.cc:697] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:01.614061  6231 consensus_queue.cc:237] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.616595  1613 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 19.
I20260709 12:59:01.618319  1508 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:01.623981  1617 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 12:59:01.638283  1538 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:59:01.641323  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:01.648705  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:01.649163  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:01.650667  1538 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 12:59:01.654309  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:01.655165  1617 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:01.657402  1612 raft_consensus.cc:1275] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:59:01.659319  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:01.599861  6271 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.575810  6117 consensus_queue.cc:1048] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:59:01.662434  1616 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
W20260709 12:59:01.669226  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 50999.4us
I20260709 12:59:01.656037  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:01.677641  1683 raft_consensus.cc:1240] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 14 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:01.602460  6355 consensus_queue.cc:1059] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 12:59:01.682966  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:01.664573  6463 raft_consensus.cc:3055] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:01.675025  6375 raft_consensus.cc:3055] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:01.676028  6462 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:01.696277  1505 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:01.701022  1654 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:01.703295  6375 raft_consensus.cc:740] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:01.694748  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:01.709775  1615 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:01.710603  1505 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:01.712945  1654 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:01.714527  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:01.715066  1616 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:01.690034  6224 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:01.706506  1617 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
W20260709 12:59:01.707671  1582 consensus_peers.cc:597] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dbdf9662619648c4a3b76fbbda8d0e14. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:01.708282  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 189693us
I20260709 12:59:01.716674  6355 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:59:01.723950  1686 raft_consensus.cc:1275] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:59:01.673085  6443 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:59:01.727236  1505 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:01.718963  1654 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:01.722772  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:01.723186  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:01.716930  6386 raft_consensus.cc:3055] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:01.728878  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:59:01.707264  6449 log.cc:927] Time spent T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.559s	user 0.004s	sys 0.000s
I20260709 12:59:01.672631  6271 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.689575  6463 raft_consensus.cc:740] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:01.730430  1615 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:59:01.743053  6463 consensus_queue.cc:260] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.708346  6462 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:01.720026  6293 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:01.685642  6431 tablet_copy_client.cc:323] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:41953
I20260709 12:59:01.720656  6113 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:01.734025  6381 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:01.717648  6368 raft_consensus.cc:3055] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:01.734278  6458 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:01.731712  6386 raft_consensus.cc:740] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:01.734328  1654 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:01.752560  1616 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 12:59:01.736018  6231 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:59:01.685176  6250 consensus_queue.cc:237] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.754472  6368 raft_consensus.cc:740] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:01.759791  5951 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.767994  6386 consensus_queue.cc:260] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.786304  6386 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:01.744774  6355 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:01.760121  6368 consensus_queue.cc:260] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.789875  6368 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:01.746479  6117 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.749226  6462 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:01.791198  6271 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:01.774966  6375 consensus_queue.cc:260] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.792901  6375 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:01.793576  6117 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.784914  6152 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:01.795770  6117 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:01.734661  6266 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:59:01.796964  1608 raft_consensus.cc:1240] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:59:01.797952  5951 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:01.792299  1540 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 12:59:01.800215  1540 pending_rounds.cc:85] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 7
I20260709 12:59:01.800534  1540 pending_rounds.cc:107] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:59:01.644331   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:01.800873  1540 raft_consensus.cc:2889] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:01.801270  1540 pending_rounds.cc:107] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:59:01.801493  1540 raft_consensus.cc:2889] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:01.800500  6462 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.803448  6463 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:01.801755  1440 catalog_manager.cc:5697] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:01.820221  5685 consensus_queue.cc:1059] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:59:01.829721  6469 raft_consensus.cc:3055] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:01.830222  6469 raft_consensus.cc:740] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:01.831073  6469 consensus_queue.cc:260] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.805781  6462 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:01.832724  6296 consensus_queue.cc:260] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.833910  6296 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:01.838387  1581 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:01.832319  6469 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:01.841246  6369 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.841861  6369 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.844062  6369 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:59:01.800712  6468 log.cc:927] Time spent T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.164s	user 0.002s	sys 0.000s
I20260709 12:59:01.818820  6326 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.820379  1627 tablet_copy_service.cc:140] P c262eac7fc904ae9bb91e450f6532e3f: Received BeginTabletCopySession request for tablet 95abfe15f7d54f3fb0f01f162b262561 from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:58006)
I20260709 12:59:01.848052  6326 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.821142  6151 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:01.822154  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:01.731175  6224 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.845252  6152 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:59:01.821390  1583 leader_election.cc:400] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 17. Current term is 18.
I20260709 12:59:01.848278  1627 tablet_copy_service.cc:161] P c262eac7fc904ae9bb91e450f6532e3f: Beginning new tablet copy session on tablet 95abfe15f7d54f3fb0f01f162b262561 from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:58006: session id = 1d6516ff61104bdda54bde95e92fe579-95abfe15f7d54f3fb0f01f162b262561
I20260709 12:59:01.850785  1583 leader_election.cc:403] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:59:01.850497  6326 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:01.844970  1440 catalog_manager.cc:5697] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 10 to 11, leader changed from 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:01.852437  1440 catalog_manager.cc:5697] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 9 to 13, leader changed from 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 13 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:01.850471  6152 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:01.856395  6152 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:59:01.858906  1627 tablet_copy_source_session.cc:215] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:01.860690  6151 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 17. Current term is 18.
I20260709 12:59:01.862684  6224 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:01.866639  6153 consensus_queue.cc:1048] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:01.870093  6326 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:01.870853  6153 consensus_queue.cc:1048] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:01.870185  1583 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:01.872496  6153 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:01.872778  1583 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:01.888614  5951 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:01.889418  5951 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.892903  5951 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:01.896428  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:01.899004  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:01.866864  6152 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:01.900743  1682 raft_consensus.cc:1275] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:59:01.901508  6152 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:01.901978  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:01.912269  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:01.899837  1683 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 12:59:01.912988  1687 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 12:59:01.913800  1691 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:59:01.907117  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:01.908633  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:01.914743  5951 raft_consensus.cc:2955] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Committing config change with OpId 10.10: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:01.919651  6431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95abfe15f7d54f3fb0f01f162b262561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:01.924887  6250 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:59:01.926425  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 192197us
I20260709 12:59:01.932098  1583 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:01.935781  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:01.941799  1686 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 12:59:01.936048  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:01.943313  1689 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:59:01.943884  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 216731us
I20260709 12:59:01.944698  1505 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:01.945502  6357 raft_consensus.cc:2764] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:59:01.947192  1505 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:01.950567  1583 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:01.952889  1583 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:01.951232  1689 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 20.
I20260709 12:59:01.958750  6319 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:59:01.959252  6319 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:01.959610  6319 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:59:01.960108  6117 consensus_queue.cc:1059] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:01.961969  6296 raft_consensus.cc:3055] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:01.962414  5685 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:01.962868  5685 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:01.963197  5685 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:01.965956  1583 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:01.969118  1583 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:01.969775  6326 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:59:01.938059  6469 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:59:01.937898  6152 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:01.982857  5951 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:59:01.983143  6326 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:02.000847  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:01.984524  6296 raft_consensus.cc:740] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:59:02.005007  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 57877.4us
I20260709 12:59:02.017204  1686 raft_consensus.cc:1240] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:59:02.025350  1505 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:02.018837  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:02.027179  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:02.028275  1537 raft_consensus.cc:2410] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:59:02.024652  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:02.033488  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:02.034116  1537 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:59:02.038666  1688 raft_consensus.cc:1275] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:59:02.040982  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:02.034310  1539 raft_consensus.cc:2955] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:02.010610  6326 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:02.009505  6151 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.016757  6357 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:02.073629  1611 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:59:02.059024  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:02.032634  6395 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:02.009867  6462 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:02.099500  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:02.051247  5951 raft_consensus.cc:697] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 20 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:02.039745  6319 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:02.100376  1613 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 16: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:59:02.101541  1537 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 20.
I20260709 12:59:02.103322  6355 consensus_queue.cc:1048] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:02.056070  5685 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:02.142156  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:02.146056  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:02.142285  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:02.144521  1533 raft_consensus.cc:1240] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:59:02.145519  1540 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:59:02.153630  6295 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.154310  6295 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:02.150781  6293 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:59:02.167305  1690 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 12:59:02.105436  6462 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:02.087059  6151 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:02.135190  6386 raft_consensus.cc:2764] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:59:02.112231  6357 raft_consensus.cc:697] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 12:59:02.166973  6441 log.cc:927] Time spent T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:59:02.227838  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 49856.9us
I20260709 12:59:02.235260  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:02.172260  6113 consensus_queue.cc:1059] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 12:59:02.109571  6296 consensus_queue.cc:260] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:02.250213  1655 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:59:02.253376  6496 log.cc:927] Time spent T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:59:02.255213  6431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:32788 (request call id 140) took 1589 ms. Trace:
I20260709 12:59:02.257252  6462 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:02.224406  5951 consensus_queue.cc:237] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:02.232383  6295 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:59:02.277925  6493 log.cc:927] Time spent T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.127s	user 0.003s	sys 0.002s
W20260709 12:59:02.285473  6487 log.cc:927] Time spent T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:59:02.282470  6447 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:02.282667  6295 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:02.295315  1655 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:02.302363  1616 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 19. Current term is 20. Ops: []
I20260709 12:59:02.301371  1655 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:02.310187  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:02.312028  1613 raft_consensus.cc:2393] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 15: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:59:02.310063  6447 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:02.303352  6293 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:02.298700  6224 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.020s
W20260709 12:59:02.320678  6494 log.cc:927] Time spent T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 12:59:02.323761  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 254413us
I20260709 12:59:02.304455  6295 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:02.329120  6295 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:59:02.334782  6498 log.cc:927] Time spent T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:59:02.317189  6500 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.342271  6500 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:02.303076  6357 consensus_queue.cc:237] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:02.343053  6151 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:02.444818  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:02.447479  1682 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
W20260709 12:59:02.447255  6504 log.cc:927] Time spent T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.128s	user 0.001s	sys 0.007s
W20260709 12:59:02.470623  6502 log.cc:927] Time spent T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:59:02.473628  6500 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:02.277112  6431 rpcz_store.cc:276] 0709 12:59:00.669770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:00.674159 (+  4389us) service_pool.cc:224] Handling call
0709 12:59:01.092246 (+418087us) ts_tablet_manager.cc:934] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
0709 12:59:01.587339 (+495093us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc859f470ac 00007fc862da1ab9 00007fc859f6369b 00007fc859f60caa 00007fc859f60bd2 00007fc861fc5131
0709 12:59:01.918105 (+330766us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:59:01.974397 (+ 56292us) tablet_metadata.cc:665] Metadata flushed
0709 12:59:01.974553 (+   156us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:59:02.232408 (+257855us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:59:02.254619 (+ 22211us) tablet_replica.cc:206] Creating consensus instance
0709 12:59:02.254949 (+   330us) ts_tablet_manager.cc:989] Replica registered.
0709 12:59:02.255113 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":38222,"spinlock_wait_cycles":6136576,"tablet-copy.queue_time_us":274980,"thread_start_us":581465,"threads_started":2}
I20260709 12:59:02.477509  6431 tablet_copy_client.cc:806] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:02.478135  6431 tablet_copy_client.cc:670] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
W20260709 12:59:02.494983  6501 log.cc:927] Time spent T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.216s	user 0.012s	sys 0.000s
I20260709 12:59:02.471853  6326 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:02.455349  6319 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:02.456218  5685 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:02.514151  6326 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:02.528363  6239 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:02.529119  6239 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:02.531589  6239 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:59:02.536657  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 239653us
I20260709 12:59:02.541306  6384 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:02.541965  6403 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.541869  6384 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:02.542594  6403 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:59:02.550071  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 205224us
I20260709 12:59:02.555560  1614 raft_consensus.cc:1275] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:59:02.557763  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:02.558425  1540 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:59:02.555764  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:02.562469  1612 raft_consensus.cc:2368] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 12. Current term is 13.
W20260709 12:59:02.563509  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:02.565830  1540 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:59:02.567286  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:02.567534  1691 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 12:59:02.571584  1687 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:59:02.572897  6296 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:02.576248  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:02.576924  1533 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:59:02.577895  1508 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:02.578823  6400 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:59:02.579799  1508 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:02.581419  6245 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:02.581915  6245 raft_consensus.cc:697] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:02.582751  6245 consensus_queue.cc:237] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:02.583688  1616 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:59:02.584801  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:02.585445  1613 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:59:02.586483  1614 raft_consensus.cc:1275] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:59:02.587193  1609 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:59:02.588442  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:02.589399  1615 raft_consensus.cc:2410] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 17 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:59:02.590730  1535 raft_consensus.cc:1275] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:59:02.593405  6403 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:02.578841  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:02.596976  1538 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:59:02.598378  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:02.598939  1538 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:02.598815  6403 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:02.599706  6400 consensus_queue.cc:1059] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:02.600097  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:02.600525  6381 consensus_queue.cc:1048] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:02.601074  6400 raft_consensus.cc:3055] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:59:02.601446  6400 raft_consensus.cc:740] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:02.602432  6400 consensus_queue.cc:260] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:02.603544  6400 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:59:02.606033  1438 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54590 (request call id 143) took 17215 ms (client timeout 15000 ms). Trace:
I20260709 12:59:02.544075  6384 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:02.600911  1534 raft_consensus.cc:2393] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 13: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:59:02.620801  1533 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:59:02.621991  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:02.622658  1682 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
I20260709 12:59:02.625311  1505 leader_election.cc:400] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 12. Current term is 13.
I20260709 12:59:02.625691  1505 leader_election.cc:403] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:02.628980  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:02.629698  1616 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 12:59:02.631795  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:02.632701  1616 raft_consensus.cc:2393] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 19: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:59:02.634689  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:02.635500  1687 raft_consensus.cc:2393] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 12: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:59:02.639334  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:02.640106  1505 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:02.640980  1687 raft_consensus.cc:2393] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 16: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:59:02.633308  6384 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 12. Current term is 13.
I20260709 12:59:02.608302  1538 raft_consensus.cc:2410] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 12:59:02.641173  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:02.655757  6513 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.644932  6447 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:59:02.659204  6513 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:02.661434  6513 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:02.643923  6424 consensus_queue.cc:1048] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:59:02.647141  6266 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:59:02.666090  6220 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.666592  6220 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:02.658763  6294 raft_consensus.cc:3055] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:59:02.668895  6294 raft_consensus.cc:740] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:02.668776  6220 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:02.669842  6294 consensus_queue.cc:260] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:02.673502  6294 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:59:02.606495  1438 rpcz_store.cc:269] 0709 12:58:45.391090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.391306 (+   216us) service_pool.cc:224] Handling call
0709 12:58:46.201637 (+810331us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b54001b99d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfbb090 00007fc85d059f3a 00007fc862e101cc 00007fc862f0e37e 00007fc8613cf2a4 00007fc8613cf232 00007fc8613cf161 00007fc8613cf0dc 00007fc8613ce392 00007fc85b38c48c 00007fc85b38b8c6
0709 12:59:02.605948 (+16404311us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:56.496743 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:56.497357 (+   614us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:56.497394 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:58:56.497414 (+    20us) tablet.cc:662] Decoding operations
0709 12:58:56.790547 (+293133us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:56.805678 (+ 15131us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:56.807834 (+  2156us) tablet.cc:685] Acquiring locks for 31 operations
0709 12:58:56.978764 (+170930us) tablet.cc:701] Row locks acquired
0709 12:58:56.978784 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:58:56.978928 (+   144us) write_op.cc:270] Start()
0709 12:58:56.979045 (+   117us) write_op.cc:276] Timestamp: P: 1783601936978882 usec, L: 0
0709 12:58:56.979066 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:58:57.036508 (+ 57442us) log.cc:844] Serialized 12173 byte log entry
0709 12:58:58.149585 (+1113077us) op_driver.cc:464] REPLICATION: finished
0709 12:58:58.586320 (+436735us) write_op.cc:301] APPLY: starting
0709 12:58:58.586424 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:59.113749 (+527325us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:59.113859 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:59.675635 (+561776us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b18002e0300. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f64522 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd 000000000038f354 000000000038f199 00007fc859f4783a
0709 12:58:59.899002 (+223367us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:59.899428 (+   426us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=62,key_file_lookups=62,delta_file_lookups=0,mrs_lookups=0
0709 12:58:59.899478 (+    50us) write_op.cc:312] APPLY: finished
0709 12:58:59.900044 (+   566us) log.cc:844] Serialized 267 byte log entry
0709 12:59:00.062490 (+162446us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:00.113164 (+ 50674us) write_op.cc:454] Released schema lock
0709 12:59:00.113242 (+    78us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:00.145180 (+ 31938us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:00.145651 (+   471us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11975,"reported_tablets":57,"spinlock_wait_cycles":1814174592,"child_traces":[["op",{"apply.queue_time_us":436414,"apply.run_cpu_time_us":86724,"apply.run_wall_time_us":1548797,"cfile_cache_hit":126,"cfile_cache_hit_bytes":133769,"num_ops":31,"prepare.queue_time_us":397982,"prepare.run_cpu_time_us":13792,"prepare.run_wall_time_us":664368,"raft.queue_time_us":402180,"raft.run_cpu_time_us":40389,"raft.run_wall_time_us":353122,"replication_time_us":1170345,"spinlock_wait_cycles":54035328,"thread_start_us":1135512,"threads_started":5,"wal-append.queue_time_us":613788,"wal-append.run_cpu_time_us":17648,"wal-append.run_wall_time_us":2604339}]]}
I20260709 12:59:02.681617  1583 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:02.685525  6369 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:02.685966  6369 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:02.686303  6369 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:59:02.690120  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:02.694377  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:02.695915  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:02.696605  1682 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:59:02.698589  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 58594.4us
I20260709 12:59:02.699535  1508 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:02.700788  1538 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 12:59:02.695128  1687 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 18.
I20260709 12:59:02.706110  1614 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:59:02.708703  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:02.713310  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:02.714038  1537 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 12:59:02.715245  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:02.715824  1537 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:59:02.719063  1687 raft_consensus.cc:2410] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:59:02.719463  1654 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:02.712316  1682 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 20.
I20260709 12:59:02.705331  6384 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:02.725917  6384 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:02.725055  1690 raft_consensus.cc:2955] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:02.728827  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:02.729554  1684 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:02.725118  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:02.731333  1687 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:02.735846  1654 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:02.726321  6384 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:02.723031  6245 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:02.730280  6447 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:02.718804  6357 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:59:02.755527  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:02.735036  6266 consensus_queue.cc:1048] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:59:02.746596  6431 tablet_copy_client.cc:538] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:02.736828  6290 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:59:02.746297  6231 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:59:02.738829  6505 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:59:02.770519  6518 log.cc:927] Time spent T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.113s	user 0.002s	sys 0.000s
I20260709 12:59:02.723295  6424 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:59:02.774559  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:02.756268  1682 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 12:59:02.778690  1684 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:59:02.775166  1688 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:59:02.807430  1687 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 12:59:02.746773  6245 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:02.812767  1687 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:59:02.748000  6447 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:02.751341  1581 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:59:02.820097  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 89532.4us
I20260709 12:59:02.826848  1583 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:59:02.835057  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 83796.4us
I20260709 12:59:02.837725  6358 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:59:02.838377  6358 raft_consensus.cc:697] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 20 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:02.839412  6358 consensus_queue.cc:237] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:02.791846  5926 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:02.813539  6245 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:02.841702  6375 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:02.840768  6447 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:02.885208  6375 raft_consensus.cc:697] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:03.099913  6375 consensus_queue.cc:237] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:03.100909  6431 tablet_bootstrap.cc:492] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:59:02.860526  5926 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:03.105353  5926 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:02.876266  6369 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:02.886296  1583 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:03.098331  6527 ts_tablet_manager.cc:933] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:03.109912  6369 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:03.112538  6527 tablet_copy_client.cc:323] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:41953
I20260709 12:59:03.105791  6384 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:59:03.123086  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 230248us
I20260709 12:59:03.123476  6384 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:03.134053  6368 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.134682  6368 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:03.135854  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:03.136535  1616 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
I20260709 12:59:03.136921  6368 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:03.137821  1612 raft_consensus.cc:1275] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:59:03.138537  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 276187us
W20260709 12:59:03.139341  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 253164us
I20260709 12:59:03.139603  6415 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.140110  6415 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:03.142103  6415 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:03.142331  6469 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:59:03.142829  6469 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:03.143168  6469 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:59:03.145926  1583 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:03.146909  1583 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:03.148017  6415 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:03.148379  6415 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:03.148748  6415 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:03.149173  6368 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:03.148748  6369 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:59:03.153260  6369 raft_consensus.cc:697] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:03.154142  6369 consensus_queue.cc:237] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:59:03.155246  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 412039us
I20260709 12:59:03.156774  6415 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:03.159116  6153 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:03.159667  6153 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:03.160051  6415 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:03.162473  6153 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:59:03.171198  6532 log.cc:927] Time spent T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.348s	user 0.004s	sys 0.006s
I20260709 12:59:03.171952  6231 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.172816  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:03.173563  1691 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:03.177186  6296 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:03.177775  6296 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:03.179530  6231 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:03.181277  1691 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 12:59:03.181702  6231 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:03.199221  1689 raft_consensus.cc:1275] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:59:03.200315  1687 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:59:03.203681  6296 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:03.209606  6469 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:03.213948  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:59:03.185570  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 370746us
I20260709 12:59:03.217271  1440 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38804 (request call id 40) took 8386 ms. Trace:
I20260709 12:59:03.162618  1508 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:59:03.220516  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 57981.3us
I20260709 12:59:03.220933  6461 raft_consensus.cc:2764] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:59:03.198419  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:03.222664  1682 raft_consensus.cc:2368] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 16. Current term is 17.
I20260709 12:59:03.222666  6461 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.223774  6461 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:03.216531  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:03.228365  6469 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:03.229197  1691 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:59:03.230259  6461 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:03.184245  6384 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:03.237120  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:03.217758  1440 rpcz_store.cc:276] 0709 12:58:54.807025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:54.807255 (+   230us) service_pool.cc:224] Handling call
0709 12:59:03.193236 (+8385981us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:01.904536 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:01.905145 (+   609us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:01.905191 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:59:01.905216 (+    25us) tablet.cc:662] Decoding operations
0709 12:59:01.905726 (+   510us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:01.905801 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:01.905829 (+    28us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:59:01.906141 (+   312us) tablet.cc:701] Row locks acquired
0709 12:59:01.906158 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:59:01.906321 (+   163us) write_op.cc:270] Start()
0709 12:59:01.906422 (+   101us) write_op.cc:276] Timestamp: P: 1783601941906273 usec, L: 0
0709 12:59:01.906442 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:59:01.907031 (+   589us) log.cc:844] Serialized 1301 byte log entry
0709 12:59:02.537207 (+630176us) op_driver.cc:464] REPLICATION: finished
0709 12:59:02.863892 (+326685us) write_op.cc:301] APPLY: starting
0709 12:59:02.863996 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:02.866472 (+  2476us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:02.866600 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:02.987155 (+120555us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:03.129971 (+142816us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 12:59:03.130028 (+    57us) write_op.cc:312] APPLY: finished
0709 12:59:03.130283 (+   255us) log.cc:844] Serialized 40 byte log entry
0709 12:59:03.130463 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:03.130555 (+    92us) write_op.cc:454] Released schema lock
0709 12:59:03.130594 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:03.131043 (+   449us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:03.131076 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":273253,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":326409,"apply.run_cpu_time_us":9999,"apply.run_wall_time_us":267143,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16673,"num_ops":3,"prepare.queue_time_us":48656,"prepare.run_cpu_time_us":12481,"prepare.run_wall_time_us":140899,"raft.queue_time_us":217091,"raft.run_cpu_time_us":10265,"raft.run_wall_time_us":216984,"replication_time_us":630596,"thread_start_us":630081,"threads_started":4,"wal-append.queue_time_us":243903}]]}
W20260709 12:59:03.255245  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 56592.7us
I20260709 12:59:03.277076  1688 raft_consensus.cc:2410] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
W20260709 12:59:03.283728  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 144542us
I20260709 12:59:03.295295  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:03.296147  1688 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:03.303643  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:03.304646  1691 raft_consensus.cc:2393] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 13: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:59:03.312829  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:03.314210  1691 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:59:03.316968  1613 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:59:03.288759  1581 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:03.318557  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:03.319235  1689 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
W20260709 12:59:03.323416  1533 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.048s	sys 0.112s
W20260709 12:59:03.323776  1533 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.048s	sys 0.112s
I20260709 12:59:03.324920  1508 leader_election.cc:400] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 16. Current term is 17.
I20260709 12:59:03.325306  1508 leader_election.cc:403] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:59:03.325933  1583 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:03.326521  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:03.330461  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:03.331070  1691 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 20.
I20260709 12:59:03.331166  1537 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 12:59:03.334278  1613 raft_consensus.cc:2368] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 16. Current term is 17.
I20260709 12:59:03.281491  6384 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:03.338338  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:03.343554  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:03.344188  1617 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 12:59:03.344261  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:03.344887  1613 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
W20260709 12:59:03.350353  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 45289.8us
I20260709 12:59:03.364928  1583 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:03.359551  1654 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:59:03.338557  6443 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.000s	sys 0.010s
I20260709 12:59:03.348663  6415 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:59:03.310819  6245 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:03.342029  6381 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
W20260709 12:59:03.371598  6443 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.000s	sys 0.011s
I20260709 12:59:03.341588  6324 consensus_queue.cc:1048] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:59:03.412549  1688 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:59:03.380504  6513 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:03.375514  6290 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:03.379137  6153 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:59:03.417413  6415 raft_consensus.cc:697] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:03.419864  6290 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:03.453013  6384 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:59:03.500998  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 175990us
I20260709 12:59:03.502947  1508 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:03.509337  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:03.511370  1534 raft_consensus.cc:2393] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 15: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:59:03.533666  6555 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:03.438531  6153 raft_consensus.cc:697] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 20 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:03.568889  6153 consensus_queue.cc:237] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:03.554435  6245 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:03.445230  6290 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:03.556846  6324 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:59:03.562003  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 61861.8us
I20260709 12:59:03.568806  6415 consensus_queue.cc:237] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:03.551450  6239 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:03.579546  6324 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:03.580730  6245 consensus_queue.cc:1048] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:03.588291  6384 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:03.592639  6266 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.593966  6231 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.596119  6239 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:03.626361  6324 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:03.632208  6266 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:03.632593  6231 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:03.635322  6266 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:03.635620  6231 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:03.622455  6239 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:03.690534  6241 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.691267  6241 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:03.710098  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:03.711282  1505 leader_election.cc:400] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 16. Current term is 17.
I20260709 12:59:03.716259  6326 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.717058  6326 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:03.719660  6326 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:59:03.725257  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 222610us
I20260709 12:59:03.721143  1612 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 12:59:03.719521  6431 tablet_bootstrap.cc:492] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:03.729703  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:03.730485  6431 tablet_bootstrap.cc:492] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:59:03.730660  1610 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 11.
I20260709 12:59:03.743345  1505 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:03.761484  5926 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.762389  5926 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:03.765108  5926 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:03.739998  6290 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:59:03.767526  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 362938us
I20260709 12:59:03.769773  5926 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:03.773380  5926 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:03.786625  6241 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:03.793349  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:03.794426  1688 raft_consensus.cc:2410] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 12:59:03.782881  6431 ts_tablet_manager.cc:1403] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 0.682s	user 0.079s	sys 0.041s
I20260709 12:59:03.789531  5926 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:03.807964   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:03.813565  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:03.821213  1654 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:03.823475  6555 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 16. Current term is 17.
W20260709 12:59:03.828606  6560 log.cc:927] Time spent T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.088s	user 0.004s	sys 0.002s
I20260709 12:59:03.832785  1435 catalog_manager.cc:5697] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 12 to 15, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:03.836730  6552 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:03.838590  1616 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 14.
I20260709 12:59:03.789324  6551 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:03.847494  1654 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:03.849246  6241 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:03.849840  6241 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:03.850262  6241 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:03.849396  6552 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:03.854338  6552 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:03.854614  6231 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:03.855109  6231 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:03.855510  6231 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:03.860706  6239 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:03.862792  1583 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:03.863415  6239 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:03.866851  1654 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:59:03.868579  6447 consensus_meta.cc:287] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.675s	user 0.016s	sys 0.008s
I20260709 12:59:03.868433  6250 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:03.869167  6250 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:03.869601  6250 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:59:03.872961  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 584116us
I20260709 12:59:03.875557  1655 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:03.878178  6266 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:03.878657  6266 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:03.879038  6266 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:03.881603  6559 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:03.882385  6559 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:03.884769  6559 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:03.885836  6290 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:03.886638  6551 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:03.893781  6551 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:03.896209  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:03.901659  6241 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:03.903198  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:03.904764  1533 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 12:59:03.905805  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:03.906695  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:03.908522  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:03.908929  6241 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:03.909181  1616 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 12:59:03.910972  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:03.911795  1617 raft_consensus.cc:2393] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 15: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:59:03.913160  1610 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 12:59:03.869131  6447 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:03.916169  6250 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:03.919446  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:03.920140  1616 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
I20260709 12:59:03.916661  6447 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:03.921814  6266 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:03.925417  6250 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:59:03.928895  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 63169.1us
I20260709 12:59:03.934311  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:59:03.934243  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 60133.2us
I20260709 12:59:03.924095  6266 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:03.925545  6358 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:03.948047  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:03.948715  1610 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:03.950316  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:03.950624  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:03.951159  1537 raft_consensus.cc:2393] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 13: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:59:03.951479  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:03.952028  1533 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:59:03.955297  1539 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:03.955345  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:03.961915  6358 raft_consensus.cc:697] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:03.962944  6358 consensus_queue.cc:237] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:03.967288  1539 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:59:03.967876  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:03.970012  1538 raft_consensus.cc:2368] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 15. Current term is 16.
I20260709 12:59:03.935216  1435 catalog_manager.cc:5697] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 11 to 15, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 15 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:03.973251  1687 raft_consensus.cc:2368] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 16. Current term is 17.
I20260709 12:59:03.974618  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:03.975358  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:03.976861  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:03.977027  1689 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 12:59:03.979882  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:03.991092  1533 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:59:03.989660  1616 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 12:59:03.996389  1691 raft_consensus.cc:2368] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 16. Current term is 17.
I20260709 12:59:04.001878  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:04.017911  6431 raft_consensus.cc:359] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:04.018929  6431 raft_consensus.cc:740] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:59:04.019675  6431 consensus_queue.cc:260] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:03.990800  1505 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:04.029726  1685 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
I20260709 12:59:04.027779  6324 raft_consensus.cc:2764] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:59:04.039846  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:04.042768  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:04.043424  1687 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
I20260709 12:59:04.056115  1505 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:04.060140  1583 leader_election.cc:400] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 16. Current term is 17.
I20260709 12:59:04.060420  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:04.061190  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:04.061084  1583 leader_election.cc:403] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:04.062964  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:04.057574  1533 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:59:04.066062  1689 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:04.061074  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:04.072185  1505 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:04.075125  1655 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:04.077761  1655 leader_election.cc:400] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 15. Current term is 16.
I20260709 12:59:04.078100  1655 leader_election.cc:403] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:59:04.067615  6324 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:04.081264  1655 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:04.088112  6505 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:59:04.088732  6548 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:04.089533  6555 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:04.089329  6548 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.090200  6555 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.092743  1535 raft_consensus.cc:2410] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:59:04.093575  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:04.080792  6241 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:59:04.073599  6559 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:04.076956  6245 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:04.080657  6326 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:59:04.097411  6241 raft_consensus.cc:697] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:04.099670  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:04.080729  6324 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:04.092177  6505 raft_consensus.cc:697] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:04.101624  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:04.105494  1533 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:04.099400  6245 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:04.104539  6557 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:04.111008  6557 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.112445  6505 consensus_queue.cc:237] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.102090  6239 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:04.105293  6324 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:04.120636  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:04.122121  1540 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 12:59:04.121227  1687 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
I20260709 12:59:04.129134  1610 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 12:59:04.117240  6245 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:04.060166  1435 catalog_manager.cc:5697] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:04.133486  6384 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:04.134265  6384 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.135571  6551 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:04.136117  6551 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.104786  6559 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.143183  1533 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:59:04.145119  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:04.145844  1539 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:59:04.124162  6548 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:04.151346  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:04.153190  1540 raft_consensus.cc:1275] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:59:04.155395  1538 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 20 index: 9. (term mismatch)
I20260709 12:59:04.155751  1538 pending_rounds.cc:85] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 8
I20260709 12:59:04.155997  1538 pending_rounds.cc:107] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 19.9
I20260709 12:59:04.156247  1538 raft_consensus.cc:2889] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:04.157213  6241 consensus_queue.cc:237] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.160887  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:04.160709  6239 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.161671  1540 raft_consensus.cc:2368] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 16. Current term is 17.
I20260709 12:59:04.162627  1542 raft_consensus.cc:2410] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 12:59:04.124214  6231 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.193038  1508 leader_election.cc:400] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 16. Current term is 17.
I20260709 12:59:04.195422  1540 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:59:04.133008  5926 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.212549  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:04.203600  1508 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:04.213415  1617 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:04.189117  6555 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:59:04.206758  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 130837us
I20260709 12:59:04.216638  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:04.213583  1685 raft_consensus.cc:1240] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 12:59:04.208434  6565 log.cc:927] Time spent T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:59:04.209408  6431 ts_tablet_manager.cc:1434] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.407s	user 0.005s	sys 0.004s
I20260709 12:59:04.185360  6384 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:04.206671  6239 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:04.210539  6557 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:04.206974  6358 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:59:04.249857  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:04.258630  1689 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 12:59:04.252648  1508 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:04.240178  6555 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:04.236792  6250 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:59:04.268841  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 57585.7us
I20260709 12:59:04.270912  1505 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:04.272107  1539 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 20.
I20260709 12:59:04.272606  6575 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:04.273056  1535 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:59:04.273306  6575 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:04.273768  6575 raft_consensus.cc:697] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:04.274768  6575 consensus_queue.cc:237] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.281179  1610 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:59:04.267568  1687 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:59:04.287982  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:04.257736  6384 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:04.258033  6153 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:04.265424  6266 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 15. Current term is 16.
I20260709 12:59:04.336876  6296 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.380820  6296 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.340580  6375 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:04.331519  5685 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:04.332554  6368 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:04.268225  6557 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:04.332057  6294 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.266647  6239 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:04.286718  6324 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.283931  6552 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:04.290329  6241 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:04.375619  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:04.382333  6375 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:04.418816  6375 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:04.420058  6514 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:04.413115  6581 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.405509  6368 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.408615  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:04.387127  6547 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:04.409909  6294 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.415510  6241 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.420624  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:59:04.411881  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 127051us
I20260709 12:59:04.408740  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:04.447934  1613 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:04.394328  5685 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:59:04.443320  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 193387us
W20260709 12:59:04.445367  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 92678.3us
I20260709 12:59:04.448580  1508 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:04.449563  1654 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:04.383157  6250 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:04.397053  6153 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:04.472396  6547 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.446571  6296 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:04.477456  6580 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:04.454878  6239 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:04.480175  6294 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:04.471763  5926 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:04.482072  6241 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:04.476292  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:04.478519  6368 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:04.432762  6552 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:04.485141  6239 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:04.485759  6447 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:04.455077  6514 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:04.447533  6555 raft_consensus.cc:697] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:04.495819  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:04.467871  6326 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 16. Current term is 17.
I20260709 12:59:04.501119  6324 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:04.501317  1684 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:59:04.454525  6557 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.502321  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:04.502995  1611 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:04.504097  6557 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:04.478120  6547 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:04.469372  6384 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.515477  1627 tablet_copy_service.cc:140] P c262eac7fc904ae9bb91e450f6532e3f: Received BeginTabletCopySession request for tablet dbdf9662619648c4a3b76fbbda8d0e14 from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:58006)
I20260709 12:59:04.516369  6250 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:04.486876  6245 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.497838  6447 raft_consensus.cc:697] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:04.518394  6514 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:04.518810  1435 catalog_manager.cc:5697] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:04.557274  6153 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:04.557669  1435 catalog_manager.cc:5697] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 12 to 14, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:04.452160  6581 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.524660  1626 tablet_copy_service.cc:342] P c262eac7fc904ae9bb91e450f6532e3f: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-95abfe15f7d54f3fb0f01f162b262561 received from {username='slave'} at 127.0.0.1:58006
I20260709 12:59:04.561322  1626 tablet_copy_service.cc:434] P c262eac7fc904ae9bb91e450f6532e3f: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-95abfe15f7d54f3fb0f01f162b262561 on tablet 95abfe15f7d54f3fb0f01f162b262561 with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:04.560882  6555 consensus_queue.cc:237] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.562247  6581 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:04.525688  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:04.524072  6358 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:04.562549  1627 tablet_copy_service.cc:161] P c262eac7fc904ae9bb91e450f6532e3f: Beginning new tablet copy session on tablet dbdf9662619648c4a3b76fbbda8d0e14 from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:58006: session id = 1d6516ff61104bdda54bde95e92fe579-dbdf9662619648c4a3b76fbbda8d0e14
I20260709 12:59:04.562929  6358 consensus_queue.cc:1243] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:59:04.526572  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:04.564841  1542 raft_consensus.cc:2393] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 21: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:59:04.566437  6271 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.540867  1617 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 12:59:04.543671  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:59:04.545203  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 96727us
I20260709 12:59:04.549292  6551 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:04.552925  6559 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:04.554914  1537 raft_consensus.cc:2368] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 13. Current term is 14.
I20260709 12:59:04.555837  6245 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:04.570358  1613 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:59:04.585178  6584 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:04.571698  6447 consensus_queue.cc:237] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.575284  1627 tablet_copy_source_session.cc:215] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:04.576175  1611 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:59:04.559423  1435 catalog_manager.cc:5697] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 11 to 12, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 12 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:04.591339  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:04.593055  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:04.588361  6271 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.559360  6384 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:04.607534  1581 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:04.609328  6271 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:04.609848  6326 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:59:04.610289  6395 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:04.613955  1581 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:04.617734  6469 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:04.623329  5685 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:04.625344  6559 consensus_queue.cc:1059] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:04.626233  6559 raft_consensus.cc:3055] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:04.626652  6559 raft_consensus.cc:740] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:04.627471  6559 consensus_queue.cc:260] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.628856  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:04.629365  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:04.629628  1685 raft_consensus.cc:2368] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15.
I20260709 12:59:04.630592  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:04.630975  6559 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:04.632208  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:04.629632  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:04.633643  1689 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:59:04.634289  6231 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:04.636893  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:59:04.612840  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 43691.3us
I20260709 12:59:04.640892  1615 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:59:04.641925  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:04.642314  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:04.653347  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:04.653947  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:04.642902  1684 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 21.
I20260709 12:59:04.658864  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:04.669095  1689 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:59:04.670151  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:04.672600  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:04.674180  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:04.674835  1691 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:59:04.681393  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 206116us
I20260709 12:59:04.690325  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:04.672353  6384 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.698676  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:04.699235  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:04.699544  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:04.703691  1617 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:04.703744  1581 leader_election.cc:400] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 16. Current term is 17.
I20260709 12:59:04.705976  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:04.707543  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:04.707599  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:04.708195  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:04.687935  6551 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.736014  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:04.738915  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:04.741060  1615 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:59:04.742873  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:04.748189  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:04.750061  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:04.733500  6395 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
W20260709 12:59:04.751132  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 133391us
I20260709 12:59:04.753501  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:04.755158  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:04.734061  6375 consensus_queue.cc:1048] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:59:04.756870  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:04.757529  1581 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:04.758349  6368 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:04.759225  6368 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:04.761133  2297 raft_consensus.cc:1217] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 14 LEARNER]: Deduplicated request from leader. Original: 12.6->[14.7-14.7]   Dedup: 14.7->[]
I20260709 12:59:04.762979  6551 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.758251  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:04.765331  6551 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:04.771315  1505 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:04.769619  1581 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:04.778446  1505 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:04.781891  1691 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:59:04.787274  1508 leader_election.cc:400] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15.
I20260709 12:59:04.787678  1508 leader_election.cc:403] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:04.789530  6592 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:04.747846  6384 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.790421  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:04.791095  1539 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 21.
I20260709 12:59:04.784608  1581 leader_election.cc:400] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 13. Current term is 14.
I20260709 12:59:04.759142  6153 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:59:04.795348  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:04.792132  1508 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:04.792681  1581 leader_election.cc:403] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:04.794728  1617 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:59:04.796782  1508 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:04.798416  1508 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:04.800261  1541 raft_consensus.cc:2410] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 14 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:59:04.796864  1655 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:04.800657  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:04.805119  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:04.801673  1542 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 12:59:04.808420  6575 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:59:04.809007  6241 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:59:04.809561  6241 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:04.809942  6241 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:59:04.812911  6583 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:04.813818  6595 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:04.815560  1654 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:04.783301  6551 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:04.818354  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:04.820724  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:04.822309  6250 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:04.823020  6250 raft_consensus.cc:697] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:04.785306  6555 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:04.847491  1615 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:59:04.820572  1537 raft_consensus.cc:1275] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:04.835988  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:04.821878  1508 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:04.850630  1617 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 12:59:04.824163  6250 consensus_queue.cc:237] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.863531  6556 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:04.858423  6551 raft_consensus.cc:697] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:04.866011  6551 consensus_queue.cc:237] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.872516  1684 raft_consensus.cc:1275] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:04.842280  6583 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:04.872033  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:04.877691  1533 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 12:59:04.878170  1533 pending_rounds.cc:85] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 10
I20260709 12:59:04.878404  1533 pending_rounds.cc:107] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 12:59:04.878631  1533 raft_consensus.cc:2889] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:04.860158  1508 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:04.893170  1583 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:04.894754  6558 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:59:04.895267  6558 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:04.895641  6558 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:59:04.885737  6583 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:04.905078  6583 raft_consensus.cc:697] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:04.906068  6583 consensus_queue.cc:237] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.851750  6592 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 13. Current term is 14.
I20260709 12:59:04.857776  6447 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:04.929767  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:04.938228  1691 raft_consensus.cc:1275] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:59:04.944243  1684 raft_consensus.cc:1217] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Deduplicated request from leader. Original: 9.7->[11.8-17.11]   Dedup: 13.9->[15.10-17.11]
I20260709 12:59:04.949232  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:59:04.955186  6568 log.cc:927] Time spent T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:59:04.959052  6527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbdf9662619648c4a3b76fbbda8d0e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:04.948057  1684 pending_rounds.cc:85] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 9
I20260709 12:59:04.960157  1684 pending_rounds.cc:107] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 12:59:04.960438  1684 raft_consensus.cc:2889] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:04.886574  6395 consensus_queue.cc:1048] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 12:59:04.970067  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:04.979910  1617 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:59:04.988340  6499 consensus_queue.cc:1048] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
W20260709 12:59:04.994168  6598 log.cc:927] Time spent T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.104s	user 0.003s	sys 0.000s
I20260709 12:59:04.999400  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:04.972865  6447 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.950943  6241 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:04.973853  6552 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:04.945442  1615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:05.017944  1615 raft_consensus.cc:606] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:05.018360  1615 raft_consensus.cc:614] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:05.008647  6447 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:59:05.083575  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 64005.8us
I20260709 12:59:05.087301  1654 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:59:05.086920  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 70769.5us
I20260709 12:59:05.100679  6271 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:05.101210  6575 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15.
I20260709 12:59:05.104310  1654 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:05.100646  1682 raft_consensus.cc:1275] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:59:05.108986  1582 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:05.111930  6415 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:05.082356  6153 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:59:05.121910  6231 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:59:05.175849  6559 consensus_meta.cc:287] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.544s	user 0.006s	sys 0.004s
I20260709 12:59:05.176728  1540 raft_consensus.cc:2410] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 12:59:05.190181  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 57493.3us
I20260709 12:59:05.190809  6290 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:05.195734  6583 consensus_queue.cc:1048] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:05.205159  1682 raft_consensus.cc:1275] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:59:05.208974  6580 consensus_queue.cc:1048] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:59:05.213148  6605 log.cc:927] Time spent T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:59:05.214496  6558 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:05.216993  6241 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:59:05.220885  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 112191us
I20260709 12:59:05.222074  1582 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:05.231879  1582 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:05.234846  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:05.234592  6514 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:05.225889  6375 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:05.245427  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:05.258371  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:05.258973  1615 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:59:05.260769  1617 raft_consensus.cc:1240] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:05.259035  6558 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:05.289037  1615 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 22.
I20260709 12:59:05.296710  6384 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:05.313083  6527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:32788 (request call id 143) took 2628 ms. Trace:
I20260709 12:59:05.313741  6527 rpcz_store.cc:276] 0709 12:59:02.679076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.679212 (+   136us) service_pool.cc:224] Handling call
0709 12:59:03.106274 (+427062us) ts_tablet_manager.cc:934] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
0709 12:59:04.957406 (+1851132us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:59:05.278915 (+321509us) tablet_metadata.cc:665] Metadata flushed
0709 12:59:05.279067 (+   152us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:59:05.307009 (+ 27942us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:59:05.307336 (+   327us) tablet_replica.cc:206] Creating consensus instance
0709 12:59:05.307695 (+   359us) ts_tablet_manager.cc:989] Replica registered.
0709 12:59:05.307814 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":236,"tablet-copy.queue_time_us":418629,"thread_start_us":324278,"threads_started":2}
I20260709 12:59:05.316262  6527 tablet_copy_client.cc:806] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:05.317026  6527 tablet_copy_client.cc:670] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:05.341264  1541 raft_consensus.cc:1275] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:59:05.342299  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:05.343602  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:05.344175  1541 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:59:05.351711  1541 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 22.
I20260709 12:59:05.355953  6578 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.362859  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:05.367507  1613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "480b368f643b4d85a5daa23529132504"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:05.369671  1505 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:05.358498  1536 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:59:05.370975  1542 raft_consensus.cc:2368] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 21. Current term is 22.
I20260709 12:59:05.368121  1613 raft_consensus.cc:606] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:05.382112  1613 raft_consensus.cc:614] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:05.384162  1690 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:59:05.386309  1581 leader_election.cc:400] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 21. Current term is 22.
I20260709 12:59:05.386808  1581 leader_election.cc:403] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 12:59:05.387023  1505 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:05.391464  1505 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:05.390420  6559 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:05.384042  6527 tablet_copy_client.cc:538] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:05.356611  6578 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:05.409415  1505 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:05.388201  6555 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:05.390569  6415 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 21. Current term is 22.
I20260709 12:59:05.412040  1613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:05.413057  1613 raft_consensus.cc:606] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:05.393566  6582 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:05.414832  1505 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:05.416639  6559 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:05.416450  1505 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:05.419225  6384 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:59:05.419253  1505 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:05.421201  6559 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:05.421788  6555 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:05.422281  6555 raft_consensus.cc:697] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:05.423146  6555 consensus_queue.cc:237] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:05.424852  1505 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:05.426016  6384 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:59:05.429234  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 159276us
I20260709 12:59:05.433966  1615 raft_consensus.cc:1275] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:59:05.434173  1617 raft_consensus.cc:1275] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:59:05.435849  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:05.431769  1655 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:05.437736  1655 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:05.441903  6231 consensus_queue.cc:1059] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:05.442471  6266 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:59:05.453241  6266 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:05.453835  6266 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:59:05.455412  6578 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:05.453850  1683 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:05.444190  6424 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:05.445396  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:05.445272  1654 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:05.468689  1690 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
I20260709 12:59:05.474853  6231 raft_consensus.cc:3055] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:05.475394  6231 raft_consensus.cc:740] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:05.476281  6231 consensus_queue.cc:260] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:05.483098  6231 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:59:05.490078  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 44878.9us
I20260709 12:59:05.500134  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:05.511354  1655 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:05.517729  1508 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:05.520998  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:05.521662  1685 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 19.
I20260709 12:59:05.485663  6294 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:05.470248  6469 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:05.526388  1617 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:05.536526  6632 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:05.536994  6632 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:05.537286  6632 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:05.522580  6241 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:59:05.520570  6581 consensus_queue.cc:1048] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:59:05.486235  6424 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:05.546353  6294 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:05.530090  6551 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:59:05.555043  6559 consensus_queue.cc:1048] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:59:05.535521  6469 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:59:05.569617  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 58421.4us
I20260709 12:59:05.544562  6579 consensus_queue.cc:1048] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:59:05.564016  6266 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:05.586325  6424 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:05.586875  6266 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:05.592658  1615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:05.593345  1615 raft_consensus.cc:606] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:05.595901  6375 consensus_queue.cc:1048] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:05.600241  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:59:05.602684  6607 log.cc:927] Time spent T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.398s	user 0.000s	sys 0.005s
I20260709 12:59:05.603332  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:05.594883  1583 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:05.606863  1508 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:05.620517  1615 raft_consensus.cc:1275] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:59:05.633520  1690 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 20. Current term is 21. Ops: []
I20260709 12:59:05.650472  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:05.657836  6469 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:05.622629  6415 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:59:05.677567  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 70339.8us
I20260709 12:59:05.653414  6368 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:59:05.705184  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:05.706055  1687 raft_consensus.cc:2393] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 12: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:59:05.676046  6384 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:59:05.712541  6384 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:05.713038  6384 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:59:05.720283  1608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:05.721236  1608 raft_consensus.cc:606] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:05.698593  6559 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
W20260709 12:59:05.725239  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 82475.8us
I20260709 12:59:05.675118  6241 raft_consensus.cc:697] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 22 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:05.734088  1691 raft_consensus.cc:1275] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:05.737999  6241 consensus_queue.cc:237] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:05.671089  6632 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:59:05.742038  6625 log.cc:927] Time spent T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:59:05.752312  6368 consensus_queue.cc:1059] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 20.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:05.753876  6631 consensus_queue.cc:1048] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:59:05.761158  6613 raft_consensus.cc:993] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:05.769958  6266 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:05.779850  6591 raft_consensus.cc:1081] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:05.785028  1691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50708
I20260709 12:59:05.786880  1691 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:05.787281  1691 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:05.775290  6266 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:05.791113  6527 tablet_bootstrap.cc:492] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:59:05.803426  6632 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:05.808142  1691 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:05.811353  6384 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:05.813992  6384 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:05.815527  1691 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:59:05.821611  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 181836us
W20260709 12:59:05.840085  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 142781us
I20260709 12:59:05.841595  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:05.842304  1539 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:59:05.851442  6266 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:59:05.851866  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.854192  6584 raft_consensus.cc:3055] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:59:05.854638  6584 raft_consensus.cc:740] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:05.851657  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:05.855779  1609 raft_consensus.cc:3055] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:05.855440  6584 consensus_queue.cc:260] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.9, Last appended by leader: 9, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:05.856086  1609 raft_consensus.cc:740] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:05.856957  1609 consensus_queue.cc:260] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:05.858208  1609 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:05.859972  6584 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:59:05.861099  6591 raft_consensus.cc:993] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:05.861608  6591 raft_consensus.cc:1081] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Signalling peer dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:05.863746  1581 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:05.865664  6587 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:05.866114  6587 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:05.866496  6587 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:05.877100  1540 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 19. Current term is 20. Ops: []
W20260709 12:59:05.888173  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 62738.5us
I20260709 12:59:05.889781  1655 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:05.909060  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:05.911077  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:05.897262   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:05.916103  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:05.917996  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:05.928790  1540 raft_consensus.cc:1240] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:05.939783  1538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:51500
I20260709 12:59:05.941442  1538 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:05.941888  1538 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:59:05.942338  6642 log.cc:927] Time spent T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:59:05.949003  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:05.950120  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:05.958918  1536 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:05.960269  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:05.961812  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:05.933777  6646 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:05.906862  6578 consensus_queue.cc:1048] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:59:05.967308  1533 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 12:59:06.003931  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 46143.8us
I20260709 12:59:06.001917  1508 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:59:06.007882  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 62883.4us
I20260709 12:59:06.009442  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:06.006160  1655 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:06.021994  1508 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:06.020323  6639 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:59:06.025070  6555 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:59:06.025838  6632 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:05.942819  6640 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:59:06.035966  1609 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
W20260709 12:59:06.099754  6650 log.cc:927] Time spent T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:59:06.130239  6375 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:06.018290  6499 consensus_queue.cc:1059] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.112s
W20260709 12:59:06.148528  6643 log.cc:927] Time spent T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:59:06.148778  6375 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:06.154804  1536 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
W20260709 12:59:06.147404  6645 log.cc:927] Time spent T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:59:06.156280  1538 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
W20260709 12:59:06.163089  6649 log.cc:927] Time spent T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:59:06.167065  6375 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:06.171554  6613 raft_consensus.cc:1064] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
W20260709 12:59:06.171998  6613 raft_consensus.cc:1068] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f: Unable to promote non-voter 1d6516ff61104bdda54bde95e92fe579: Service unavailable: leader transfer in progress
W20260709 12:59:06.175128  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 168055us
I20260709 12:59:06.187641  1538 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:06.188560  1655 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:06.191845  6584 raft_consensus.cc:3055] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:59:06.207262  6584 raft_consensus.cc:740] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:06.208144  6584 consensus_queue.cc:260] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:06.209460  6584 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:59:06.212692  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:06.213387  1685 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:59:06.229220  6587 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:59:06.236042  6648 log.cc:927] Time spent T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 12:59:06.231566  6587 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:06.243640  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:06.249006  1609 raft_consensus.cc:1275] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:59:06.250716   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:06.255872  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:06.256541  1610 raft_consensus.cc:3055] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:06.256853  1610 raft_consensus.cc:740] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:06.263358  1614 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 12:59:06.268131  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 81459.7us
I20260709 12:59:06.257616  1610 consensus_queue.cc:260] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:06.269297  6580 consensus_queue.cc:1048] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:06.271435  1440 catalog_manager.cc:5697] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 11 to 13, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:06.274452  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.276043  1610 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:06.258145  6558 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:06.287078  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:06.291095  1685 raft_consensus.cc:2393] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 12: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:59:06.287272  6579 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:06.301815  6558 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:06.317086  6558 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:06.325923  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:06.332368  6640 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:59:06.332228  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 63246.1us
I20260709 12:59:06.339125  1655 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:06.339697  1654 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:06.343832  1610 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
W20260709 12:59:06.345005  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 45424.5us
I20260709 12:59:06.347975  1542 raft_consensus.cc:1240] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:06.350737  1542 raft_consensus.cc:1240] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:06.350785  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:06.352185  6637 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:06.353003  6231 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:06.369308  1540 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:59:06.375566  1583 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:06.376358  6231 raft_consensus.cc:697] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:59:06.444706  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 67763.1us
I20260709 12:59:06.445730  6639 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:06.448827  6231 consensus_queue.cc:237] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:59:06.453673  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 78193.8us
I20260709 12:59:06.454079  6591 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:06.454530  6591 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:06.454877  6591 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:06.463438  1682 raft_consensus.cc:1275] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 12:59:06.463915  1682 pending_rounds.cc:85] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 6
I20260709 12:59:06.464146  1682 pending_rounds.cc:107] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 12:59:06.465524  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:06.466162  1685 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:06.464381  1682 raft_consensus.cc:2889] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:06.489055  1685 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
W20260709 12:59:06.499526  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 121518us
I20260709 12:59:06.501392  1538 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:59:06.505749  1581 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:06.507052  6319 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:06.507604  6319 raft_consensus.cc:697] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:06.507294  6591 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:06.508445  6319 consensus_queue.cc:237] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:06.510789  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:06.531998  6591 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:06.556556  1505 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:06.558838  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:06.543370  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:06.563807  1581 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:06.562866  6358 consensus_queue.cc:1059] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:59:06.568924  6630 consensus_queue.cc:1048] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:06.595819  1614 raft_consensus.cc:1240] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:06.569306  6638 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:06.604518  6638 raft_consensus.cc:697] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:06.605571  6638 consensus_queue.cc:237] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:06.620718  6632 consensus_queue.cc:1059] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:06.625350  6635 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:06.682533  6499 raft_consensus.cc:3055] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:06.682981  6499 raft_consensus.cc:740] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:59:06.687806  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 124074us
I20260709 12:59:06.683844  6499 consensus_queue.cc:260] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:06.692520  6592 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:06.869360  6499 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:59:06.877323  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 185290us
W20260709 12:59:06.955348  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 258782us
W20260709 12:59:07.009961  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 53611.7us
I20260709 12:59:07.011250  1581 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:07.012692  6358 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:59:07.018440  6676 log.cc:927] Time spent T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 12:59:07.021620  6552 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.022141  6552 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:07.024109  6552 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:07.026916  6384 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:07.028625  6384 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:07.030799  6384 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:07.038609  1617 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:59:07.053194  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:59:07.040342  6674 log.cc:927] Time spent T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 12:59:07.065917  6358 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.124949  6358 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:59:07.161516  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 193556us
I20260709 12:59:07.120819  6634 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:59:07.178719  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:07.179386  6527 tablet_bootstrap.cc:492] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:07.177361  6633 raft_consensus.cc:3055] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:07.226799  1541 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:59:07.229946  6671 log.cc:927] Time spent T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.360s	user 0.000s	sys 0.003s
I20260709 12:59:07.215641  6633 raft_consensus.cc:740] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:07.235752  6633 consensus_queue.cc:260] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:07.236812  6633 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:07.248898  6527 tablet_bootstrap.cc:492] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
W20260709 12:59:07.316114  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 219135us
W20260709 12:59:07.323992  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 148030us
I20260709 12:59:07.290555  6231 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:07.393282  1688 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:59:07.395684  6689 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:07.396631  6555 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:07.397177  6555 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:07.399222  6555 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:07.402446  6691 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:07.404959  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:07.383037  6527 ts_tablet_manager.cc:1403] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 1.592s	user 0.062s	sys 0.015s
I20260709 12:59:07.396353  6689 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:59:07.431209  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 205577us
I20260709 12:59:07.363798  6231 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:07.425907  6447 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:59:07.481057  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 53359.9us
I20260709 12:59:07.487871  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:07.493602  1612 raft_consensus.cc:1240] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:59:07.486501  1683 raft_consensus.cc:1275] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:59:07.499835  6584 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.500530  6584 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:07.503038  6584 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:07.504328  2297 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 14 LEARNER]: Advancing to term 15
I20260709 12:59:07.505016  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:07.507917  1615 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:59:07.451164  6639 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:59:07.516180  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:07.516884  1685 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
W20260709 12:59:07.522507  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 118662us
I20260709 12:59:07.463470  6447 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:07.507771  6697 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:07.536288  1505 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:59:07.555961  6683 log.cc:927] Time spent T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 12:59:07.542399  6559 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:07.561393  6231 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:07.564952  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:07.544817  6581 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:59:07.555318  6689 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:07.581655  2297 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 15 LEARNER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:59:07.542317  6697 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:07.591912  6697 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:07.550318  6527 raft_consensus.cc:359] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:07.606581  6527 raft_consensus.cc:740] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:59:07.607446  6527 consensus_queue.cc:260] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:07.627488  6699 consensus_queue.cc:1048] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:07.636991  6527 ts_tablet_manager.cc:1434] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.220s	user 0.009s	sys 0.000s
I20260709 12:59:07.645170  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:07.646035  1690 raft_consensus.cc:2393] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 21: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:59:07.654187  6447 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:07.656822  6358 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:07.661486  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:07.665730  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:07.666496  1540 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 20.
I20260709 12:59:07.671447  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:07.672158  1615 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 12:59:07.674213  1540 raft_consensus.cc:1275] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:59:07.680953  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:07.681787  1539 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 20.
I20260709 12:59:07.686136  1583 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:59:07.692689  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 234124us
W20260709 12:59:07.697857  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 153654us
I20260709 12:59:07.705479  6584 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:59:07.710673  1654 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:59:07.740283  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 205703us
I20260709 12:59:07.742053  1581 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:07.745434  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:07.747202  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:07.721372  6584 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:07.754592  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:07.750463  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:07.760725  1612 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 12:59:07.757673  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:07.746129  1686 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 21.
I20260709 12:59:07.763379  1534 raft_consensus.cc:2393] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 20: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:59:07.743708  6660 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:59:07.773211  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:07.349359   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:07.757105  6558 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:59:07.764247  6584 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:59:07.780205  1581 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:07.774991  6660 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:07.803548  1507 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:07.806766  6326 consensus_queue.cc:1048] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:59:07.816818  6220 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:59:07.817344  6220 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:07.817690  6220 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:59:07.818459  1505 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:07.820776  6583 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:59:07.821202  6583 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:07.821561  6583 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:59:07.796862  6660 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:59:07.837185  1507 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:07.841580  6580 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:07.843650  6681 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:59:07.843916  6630 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.865463  6630 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:07.867619  6630 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:07.877516  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:07.878093  1440 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38804 (request call id 41) took 4299 ms. Trace:
I20260709 12:59:07.878233  1608 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
W20260709 12:59:07.887391  1435 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54606 (request call id 146) took 22459 ms (client timeout 15000 ms). Trace:
I20260709 12:59:07.890535  1436 catalog_manager.cc:5697] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 12 to 16, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:07.878473  1440 rpcz_store.cc:276] 0709 12:59:03.579085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:03.579428 (+   343us) service_pool.cc:224] Handling call
0709 12:59:03.659816 (+ 80388us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b5400210610. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2d0b2 00007fc862ea6a89 00007fc862e3eda6 00007fc862e10088 00007fc862f0e37e 00007fc8613cf2a4 00007fc8613cf232 00007fc8613cf161 00007fc8613cf0dc
0709 12:59:07.878008 (+4218192us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:06.531345 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:06.531934 (+   589us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:06.531972 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:59:06.531991 (+    19us) tablet.cc:662] Decoding operations
0709 12:59:06.532331 (+   340us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:06.532383 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:06.532414 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:06.532618 (+   204us) tablet.cc:701] Row locks acquired
0709 12:59:06.532637 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:59:06.532795 (+   158us) write_op.cc:270] Start()
0709 12:59:06.532911 (+   116us) write_op.cc:276] Timestamp: P: 1783601946532745 usec, L: 0
0709 12:59:06.532935 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:59:06.533629 (+   694us) log.cc:844] Serialized 535 byte log entry
0709 12:59:06.964606 (+430977us) op_driver.cc:464] REPLICATION: finished
0709 12:59:07.311766 (+347160us) write_op.cc:301] APPLY: starting
0709 12:59:07.315784 (+  4018us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:07.529109 (+213325us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:07.534488 (+  5379us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:07.562081 (+ 27593us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:07.562290 (+   209us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:59:07.562339 (+    49us) write_op.cc:312] APPLY: finished
0709 12:59:07.562570 (+   231us) log.cc:844] Serialized 24 byte log entry
0709 12:59:07.562744 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:07.562833 (+    89us) write_op.cc:454] Released schema lock
0709 12:59:07.562876 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:07.563294 (+   418us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:07.563323 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":768888,"reported_tablets":2,"spinlock_wait_cycles":49681152,"child_traces":[["op",{"apply.queue_time_us":274446,"apply.run_cpu_time_us":5172,"apply.run_wall_time_us":314022,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8309,"num_ops":1,"prepare.queue_time_us":177066,"prepare.run_cpu_time_us":2593,"prepare.run_wall_time_us":2592,"replication_time_us":344830,"thread_start_us":310490,"threads_started":2}]]}
I20260709 12:59:07.898674  1436 catalog_manager.cc:5697] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 14 to 15, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 15 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:07.840615  6684 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:07.888916  1435 rpcz_store.cc:269] 0709 12:58:45.428080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:45.428359 (+   279us) service_pool.cc:224] Handling call
0709 12:58:47.249985 (+1821626us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b54001b99d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfbb090 00007fc85d059f3a 00007fc862e101cc 00007fc862f0e37e 00007fc8613cf2a4 00007fc8613cf232 00007fc8613cf161 00007fc8613cf0dc 00007fc8613ce392 00007fc85b38c48c 00007fc85b38b8c6
0709 12:59:07.887267 (+20637282us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:04.974838 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:05.107063 (+132225us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:05.122882 (+ 15819us) write_op.cc:435] Acquired schema lock
0709 12:59:05.124450 (+  1568us) tablet.cc:662] Decoding operations
0709 12:59:05.135222 (+ 10772us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:05.135323 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:05.135355 (+    32us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:59:05.135997 (+   642us) tablet.cc:701] Row locks acquired
0709 12:59:05.136044 (+    47us) write_op.cc:260] PREPARE: finished
0709 12:59:05.136252 (+   208us) write_op.cc:270] Start()
0709 12:59:05.136416 (+   164us) write_op.cc:276] Timestamp: P: 1783601945136173 usec, L: 0
0709 12:59:05.136454 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:59:05.207574 (+ 71120us) log.cc:844] Serialized 2481 byte log entry
0709 12:59:05.438573 (+230999us) op_driver.cc:464] REPLICATION: finished
0709 12:59:05.625662 (+187089us) write_op.cc:301] APPLY: starting
0709 12:59:05.625774 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:05.630050 (+  4276us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:05.630172 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:05.707557 (+ 77385us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:05.707865 (+   308us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=0,mrs_lookups=0
0709 12:59:05.707919 (+    54us) write_op.cc:312] APPLY: finished
0709 12:59:05.709057 (+  1138us) log.cc:844] Serialized 64 byte log entry
0709 12:59:05.710585 (+  1528us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:05.710703 (+   118us) write_op.cc:454] Released schema lock
0709 12:59:05.710764 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:05.711191 (+   427us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:05.711219 (+    28us) write_op.cc:454] Released schema lock
0709 12:59:07.220998 (+1509779us) spinlock_profiling.cc:243] Waited 8.43 ms on lock 0x7b54001b99d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d04e32a 00007fc85cfd3f14 00007fc85cfd3ec3 00007fc85cfd3e38 00007fc85cfd3df3 00007fc85cfd30dc 00007fc85cffce16 00007fc85cfe4cbb 00007fc85cfcf39d 00007fc85cfd2d75
Metrics: {"mutex_wait_us":1391906,"reported_tablets":57,"spinlock_wait_cycles":1672508288,"child_traces":[["op",{"apply.queue_time_us":177615,"apply.run_cpu_time_us":10556,"apply.run_wall_time_us":85537,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29219,"num_ops":6,"prepare.queue_time_us":154034,"prepare.run_cpu_time_us":27503,"prepare.run_wall_time_us":275214,"raft.queue_time_us":264432,"raft.run_cpu_time_us":56878,"raft.run_wall_time_us":664234,"replication_time_us":276592,"spinlock_wait_cycles":19382144,"thread_start_us":351352,"threads_started":5,"wal-append.queue_time_us":52436}]]}
W20260709 12:59:07.905776  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 46610.3us
W20260709 12:59:07.909816  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 138926us
I20260709 12:59:07.916287  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:07.919380  1655 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:07.910791  1505 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:07.923548  1627 tablet_copy_service.cc:342] P c262eac7fc904ae9bb91e450f6532e3f: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-dbdf9662619648c4a3b76fbbda8d0e14 received from {username='slave'} at 127.0.0.1:58006
I20260709 12:59:07.924075  1627 tablet_copy_service.cc:434] P c262eac7fc904ae9bb91e450f6532e3f: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-dbdf9662619648c4a3b76fbbda8d0e14 on tablet dbdf9662619648c4a3b76fbbda8d0e14 with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:07.926008  1436 catalog_manager.cc:5697] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 10 to 13, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 13 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:07.927412  1436 catalog_manager.cc:5697] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 9 to 14, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 14 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:07.934026  6290 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:07.929877  6630 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:07.951138  6583 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:07.954466  6583 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:59:07.947957  6703 log.cc:927] Time spent T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.209s	user 0.001s	sys 0.001s
I20260709 12:59:07.980849  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:07.989506  2297 raft_consensus.cc:1217] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.9->[10.10-10.10]   Dedup: 10.10->[]
I20260709 12:59:07.948738  6630 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:07.992957  6630 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:59:08.008770  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 92035.2us
I20260709 12:59:08.013787  6684 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:08.020507  6684 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:08.020970  6637 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:08.021497  6637 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:08.021783  6584 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:08.022730  6684 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:08.023461  6637 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:08.023976  6584 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:08.026156  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:08.026799  1540 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:59:08.032213  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:08.042635  6660 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:08.045148  6220 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:08.045488  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:08.046291  1687 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:59:08.047426  6220 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:08.048171  1616 raft_consensus.cc:2368] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 21. Current term is 22.
I20260709 12:59:08.049791  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:08.050515  1535 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:59:08.051671  1505 leader_election.cc:400] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 21. Current term is 22.
I20260709 12:59:08.052019  1505 leader_election.cc:403] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 12:59:08.056411  1540 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 21.
I20260709 12:59:08.064690  1687 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 21.
I20260709 12:59:08.078965  1581 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:08.079627  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:08.080323  1687 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:59:08.080247  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 70043.6us
I20260709 12:59:08.090764  1436 catalog_manager.cc:5697] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 9 to 12, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 12 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:08.104810  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:08.092715  6660 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:08.106724  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:08.095988  6591 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:59:08.108045  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:08.100420  1687 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 22.
I20260709 12:59:08.111980  1609 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 14.
I20260709 12:59:08.113533  1436 catalog_manager.cc:5697] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 13 to 18, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 18 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:08.115443  6630 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:08.121439  1535 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 22.
I20260709 12:59:08.123170  6681 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 21. Current term is 22.
I20260709 12:59:08.123553  6630 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:08.126348  1581 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:08.127242  6220 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:59:08.127748  6220 raft_consensus.cc:697] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:08.128754  6220 consensus_queue.cc:237] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.9, Last appended by leader: 9, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:59:08.131963  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 183077us
I20260709 12:59:08.140578  1508 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:08.142186  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:08.146167  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:08.146473  6689 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:08.147056  1614 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:08.135668  6591 raft_consensus.cc:697] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 21 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:08.165129  1654 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:08.152369  1436 catalog_manager.cc:5697] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 12 to 14, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:08.166370  6721 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:08.166877  6721 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:08.167280  6721 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:08.159257  6581 raft_consensus.cc:1064] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:59:08.158192  6591 consensus_queue.cc:237] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:08.180342  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:08.181149  1534 raft_consensus.cc:2368] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21.
I20260709 12:59:08.189247  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:08.191766  1538 raft_consensus.cc:2368] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 14. Current term is 15.
I20260709 12:59:08.194438  1614 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
I20260709 12:59:08.205245  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:08.219291  1655 leader_election.cc:400] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21.
I20260709 12:59:08.219570  1505 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:08.221082  6583 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:08.221601  6583 raft_consensus.cc:697] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:08.222443  6583 consensus_queue.cc:237] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:08.219702  1655 leader_election.cc:403] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:59:08.230006  6424 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21.
I20260709 12:59:08.230332  1655 leader_election.cc:400] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 14. Current term is 15.
I20260709 12:59:08.171366  6581 consensus_queue.cc:237] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 7, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:08.293931  2297 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 15 LEARNER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:59:08.296640  6680 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:08.196936  6721 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:08.309993  1683 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:59:08.310155  1691 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:08.336243  1691 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
I20260709 12:59:08.351302  1613 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:59:08.339232  6680 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:59:08.356187  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:08.364390  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:08.369011  1608 raft_consensus.cc:2368] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 14. Current term is 15.
I20260709 12:59:08.372531  1654 leader_election.cc:400] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 14. Current term is 15.
I20260709 12:59:08.372869  1654 leader_election.cc:403] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:59:08.359133  6721 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:08.381500  6719 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 14. Current term is 15.
I20260709 12:59:08.368095  6581 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:59:08.434553  6592 raft_consensus.cc:1064] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:59:08.450466  6555 raft_consensus.cc:2955] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Committing config change with OpId 15.9: config changed from index 6 to 9, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:08.461081  2297 raft_consensus.cc:2955] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 6 to 9, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:08.499835  1608 raft_consensus.cc:2955] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 6 to 9, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:08.503568  1691 raft_consensus.cc:2955] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 6 to 9, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:08.504993  6592 consensus_queue.cc:237] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:08.584031  1687 raft_consensus.cc:1275] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:59:08.585796  2297 raft_consensus.cc:1275] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 10 LEARNER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:59:08.587424  6558 consensus_queue.cc:1048] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:08.597856  1691 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 20 index: 9. Preceding OpId from leader: term: 22 index: 10. (index mismatch)
I20260709 12:59:08.605859  6700 consensus_queue.cc:1048] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 12:59:08.606477  6558 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:59:08.627650  1538 raft_consensus.cc:1275] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:59:08.634478  6375 consensus_queue.cc:1048] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:59:08.658916  6720 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:08.659571  6720 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:08.662118  6720 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:08.665251  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:08.665973  1538 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 12:59:08.669337  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:08.670259  1608 raft_consensus.cc:2393] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 15: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:59:08.675292  1655 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:08.678160  6720 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:08.678588  6720 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:08.678960  6720 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:08.679200  1435 catalog_manager.cc:5697] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index -1 to 6, term changed from 12 to 15, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193), NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 15 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:08.681380  1435 catalog_manager.cc:5697] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index -1 to 10, term changed from 8 to 10, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to <none>, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 10 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:08.693447  6319 raft_consensus.cc:2955] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Committing config change with OpId 10.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:08.695014  1539 raft_consensus.cc:2955] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Committing config change with OpId 10.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:08.693455  1540 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:59:08.710100  2297 raft_consensus.cc:2955] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Committing config change with OpId 10.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:08.716650  6700 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:08.741403  1439 catalog_manager.cc:5697] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 10 to 13, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 13 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:08.755900  1538 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 20 index: 9. Preceding OpId from leader: term: 22 index: 10. (index mismatch)
I20260709 12:59:08.755999  1687 raft_consensus.cc:2955] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Committing config change with OpId 10.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:08.760886  6720 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:08.764230  6499 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:08.771549  1609 raft_consensus.cc:1275] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:08.771685  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:08.775210  6720 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:08.781641  1535 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 12:59:08.783555  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:08.784693  1609 raft_consensus.cc:2393] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 15: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:59:08.787796  1655 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:08.792960  6241 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:08.808255  1687 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:59:08.791141  6581 consensus_queue.cc:1048] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
W20260709 12:59:08.822342  1436 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54582 (request call id 153) took 13686 ms (client timeout 15000 ms). Trace:
I20260709 12:59:08.813531  6700 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:59:08.820353  6241 raft_consensus.cc:697] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:59:08.822798  1436 rpcz_store.cc:269] 0709 12:58:55.133496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:55.133659 (+   163us) service_pool.cc:224] Handling call
0709 12:59:08.820193 (+13686534us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:08.372353 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:08.403085 (+ 30732us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:08.404201 (+  1116us) write_op.cc:435] Acquired schema lock
0709 12:59:08.404444 (+   243us) tablet.cc:662] Decoding operations
0709 12:59:08.406817 (+  2373us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:08.406893 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:08.406924 (+    31us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:59:08.407466 (+   542us) tablet.cc:701] Row locks acquired
0709 12:59:08.407483 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:59:08.407616 (+   133us) write_op.cc:270] Start()
0709 12:59:08.407728 (+   112us) write_op.cc:276] Timestamp: P: 1783601948407574 usec, L: 0
0709 12:59:08.407751 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:59:08.418649 (+ 10898us) log.cc:844] Serialized 2869 byte log entry
0709 12:59:08.539955 (+121306us) op_driver.cc:464] REPLICATION: finished
0709 12:59:08.577254 (+ 37299us) write_op.cc:301] APPLY: starting
0709 12:59:08.577334 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:08.609989 (+ 32655us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:08.610089 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:08.625823 (+ 15734us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:08.626051 (+   228us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=0,mrs_lookups=0
0709 12:59:08.626098 (+    47us) write_op.cc:312] APPLY: finished
0709 12:59:08.626327 (+   229us) log.cc:844] Serialized 72 byte log entry
0709 12:59:08.634718 (+  8391us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:08.648863 (+ 14145us) write_op.cc:454] Released schema lock
0709 12:59:08.650657 (+  1794us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:08.685558 (+ 34901us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:08.685591 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":18353,"reported_tablets":57,"child_traces":[["op",{"apply.queue_time_us":35182,"apply.run_cpu_time_us":10612,"apply.run_wall_time_us":108276,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33401,"num_ops":7,"prepare.queue_time_us":132662,"prepare.run_cpu_time_us":5502,"prepare.run_wall_time_us":62678,"replication_time_us":128594,"spinlock_wait_cycles":57600,"thread_start_us":88669,"threads_started":2}]]}
I20260709 12:59:08.841622  1439 catalog_manager.cc:5697] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 7 to 8, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 8 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:08.835850  6241 consensus_queue.cc:237] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:08.875182  1687 raft_consensus.cc:1275] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:08.884377  6581 consensus_queue.cc:1048] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:08.967219  1436 catalog_manager.cc:5697] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 6 to 9, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:08.975853  1436 catalog_manager.cc:5697] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 10 to 11, leader changed from <none> to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 12:59:09.018013  6740 log.cc:927] Time spent T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 12:59:09.101207  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 154819us
W20260709 12:59:09.130075  1439 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54590 (request call id 142) took 55921 ms (client timeout 15000 ms). Trace:
I20260709 12:59:09.124292  6375 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.146270  6375 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:09.161993  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:09.163049  1539 raft_consensus.cc:2410] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:59:09.206658  1437 catalog_manager.cc:5697] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 8 to 11, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 11 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:09.177037  6375 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:59:09.130545  1439 rpcz_store.cc:269] 0709 12:58:13.200912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:13.313969 (+113057us) service_pool.cc:224] Handling call
0709 12:59:09.122390 (+55808421us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:08.875826 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:08.876359 (+   533us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:08.876392 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:59:08.876409 (+    17us) tablet.cc:662] Decoding operations
0709 12:59:08.876848 (+   439us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:08.876916 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:08.876942 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:59:08.877286 (+   344us) tablet.cc:701] Row locks acquired
0709 12:59:08.877311 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:59:08.877466 (+   155us) write_op.cc:270] Start()
0709 12:59:08.877571 (+   105us) write_op.cc:276] Timestamp: P: 1783601948877417 usec, L: 0
0709 12:59:08.877593 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:59:08.878216 (+   623us) log.cc:844] Serialized 928 byte log entry
0709 12:59:08.880069 (+  1853us) op_driver.cc:464] REPLICATION: finished
0709 12:59:08.880538 (+   469us) write_op.cc:301] APPLY: starting
0709 12:59:08.880614 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:08.881815 (+  1201us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:08.881897 (+    82us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:08.883109 (+  1212us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:08.883264 (+   155us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 12:59:08.883307 (+    43us) write_op.cc:312] APPLY: finished
0709 12:59:08.883511 (+   204us) log.cc:844] Serialized 32 byte log entry
0709 12:59:08.883673 (+   162us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:08.883760 (+    87us) write_op.cc:454] Released schema lock
0709 12:59:08.883798 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:08.884167 (+   369us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:08.884194 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":49036,"reported_tablets":57,"spinlock_wait_cycles":3200,"child_traces":[["op",{"apply.queue_time_us":225,"apply.run_cpu_time_us":3619,"apply.run_wall_time_us":3618,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8364,"num_ops":2,"prepare.queue_time_us":203,"prepare.run_cpu_time_us":2683,"prepare.run_wall_time_us":2683,"replication_time_us":2354,"spinlock_wait_cycles":15232}]]}
W20260709 12:59:09.332644  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 163430us
I20260709 12:59:09.325228   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:09.341897  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:09.356837  1437 catalog_manager.cc:5697] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:09.381318  1583 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:09.382479  6591 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:09.390208  1538 raft_consensus.cc:1275] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:59:09.457352  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 54696.4us
W20260709 12:59:09.458437  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 75972.8us
I20260709 12:59:09.488437  6702 consensus_queue.cc:1048] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:59:09.520687  1608 raft_consensus.cc:1275] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:09.533205  1608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:09.533824  1608 raft_consensus.cc:606] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:09.548662  6231 consensus_queue.cc:1048] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:09.558076  1608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:09.558799  1608 raft_consensus.cc:606] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:09.563675  1608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:09.564352  1608 raft_consensus.cc:606] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:09.564771  1608 raft_consensus.cc:614] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:09.576318  1532 tablet_service.cc:1558] Processing DeleteTablet for tablet e4681eaad3084357b9677e4242b97c99 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:51498
W20260709 12:59:09.592411  1437 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54582 (request call id 152) took 35921 ms (client timeout 15000 ms). Trace:
I20260709 12:59:09.597927  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:09.598606  1614 raft_consensus.cc:606] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:09.604789  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97c958beecec40918b63217135840ff6"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:09.605489  1616 raft_consensus.cc:606] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:09.605849  1616 raft_consensus.cc:614] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:09.613036   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:09.614804   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:09.613200  1434 catalog_manager.cc:5697] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:09.622686  1434 catalog_manager.cc:5697] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:09.623440  1425 catalog_manager.cc:5028] TS dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): tablet e4681eaad3084357b9677e4242b97c99 (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:59:09.634950  6375 raft_consensus.cc:993] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:09.635500  6375 raft_consensus.cc:1081] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Signalling peer dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:09.641764  1538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:51500
I20260709 12:59:09.642385  1538 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:09.642757  1538 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:09.661485  1538 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:09.624282  1434 catalog_manager.cc:5697] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 13 to 15, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 15 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:09.667930  1434 catalog_manager.cc:5697] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 11 to 16, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 16 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:09.671725  1434 catalog_manager.cc:5697] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
W20260709 12:59:09.592916  1437 rpcz_store.cc:269] 0709 12:58:33.671371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:33.671696 (+   325us) service_pool.cc:224] Handling call
0709 12:59:09.592337 (+35920641us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:09.362865 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:09.363416 (+   551us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:09.363452 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:59:09.363472 (+    20us) tablet.cc:662] Decoding operations
0709 12:59:09.363890 (+   418us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:09.363944 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:09.363972 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:59:09.364310 (+   338us) tablet.cc:701] Row locks acquired
0709 12:59:09.364325 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:59:09.364518 (+   193us) write_op.cc:270] Start()
0709 12:59:09.364630 (+   112us) write_op.cc:276] Timestamp: P: 1783601949364432 usec, L: 0
0709 12:59:09.364652 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:59:09.365327 (+   675us) log.cc:844] Serialized 928 byte log entry
0709 12:59:09.368428 (+  3101us) op_driver.cc:464] REPLICATION: finished
0709 12:59:09.368985 (+   557us) write_op.cc:301] APPLY: starting
0709 12:59:09.369066 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:09.370449 (+  1383us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:09.370541 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:09.371852 (+  1311us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:09.372027 (+   175us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 12:59:09.372073 (+    46us) write_op.cc:312] APPLY: finished
0709 12:59:09.372311 (+   238us) log.cc:844] Serialized 32 byte log entry
0709 12:59:09.373176 (+   865us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:09.373287 (+   111us) write_op.cc:454] Released schema lock
0709 12:59:09.373336 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:09.373721 (+   385us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:09.373759 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":56,"child_traces":[["op",{"apply.queue_time_us":271,"apply.run_cpu_time_us":4048,"apply.run_wall_time_us":4675,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8364,"num_ops":2,"prepare.queue_time_us":126,"prepare.run_cpu_time_us":2760,"prepare.run_wall_time_us":2759,"replication_time_us":3643}]]}
I20260709 12:59:09.681948  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:09.682577  1616 raft_consensus.cc:3055] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:09.682874  1616 raft_consensus.cc:740] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:09.686981  1538 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:09.689306  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:09.689909  1688 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:09.703285  1616 consensus_queue.cc:260] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:09.704679  1616 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:09.673386  1434 catalog_manager.cc:5697] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 12 to 13, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 13 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:09.709484  1434 catalog_manager.cc:5697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 15 to 17, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 17 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:09.711375  1434 catalog_manager.cc:5697] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 15 to 18, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 18 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:09.714198  1434 catalog_manager.cc:5697] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 10 to 11, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:09.715706  1434 catalog_manager.cc:5697] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:09.738745  1616 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 12:59:09.745107  1688 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 12:59:09.745374  1505 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:09.747376  6763 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:09.747920  6763 raft_consensus.cc:697] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:09.748822  6763 consensus_queue.cc:237] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:09.755254  1434 catalog_manager.cc:5697] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 10 to 13, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 13 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:09.757939  1434 catalog_manager.cc:5697] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 10 to 11, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 11 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:09.759851  1434 catalog_manager.cc:5697] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:09.774181  1434 catalog_manager.cc:5697] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:09.776116  1434 catalog_manager.cc:5697] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:09.778031  1434 catalog_manager.cc:5697] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 15 to 18, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 18 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:09.779757  1434 catalog_manager.cc:5697] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 13 to 14, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 14 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:09.782488  1434 catalog_manager.cc:5697] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 7 to 10, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 10 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:09.795248  6591 raft_consensus.cc:993] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:09.795815  6591 raft_consensus.cc:1081] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Signalling peer dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:09.800896  1434 catalog_manager.cc:5697] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 9 to 11, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 11 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:09.802838  1434 catalog_manager.cc:5697] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 13 to 16, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 16 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:09.802834  1538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:51500
I20260709 12:59:09.806294  1538 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:09.806663  1538 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:09.804978  1434 catalog_manager.cc:5697] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:09.813509  1434 catalog_manager.cc:5697] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 12 to 15, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:09.829488  1538 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:09.836078  1538 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:09.838640  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:09.839284  1688 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:09.839694  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:09.840656  1608 raft_consensus.cc:3055] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:09.840955  1608 raft_consensus.cc:740] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:09.841619  1608 consensus_queue.cc:260] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:09.842754  1608 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:09.849609  1608 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
I20260709 12:59:09.850471  1688 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
I20260709 12:59:09.851890  1508 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:09.854792  6763 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:09.855309  6763 raft_consensus.cc:697] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:09.856177  6763 consensus_queue.cc:237] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:09.931990  6761 raft_consensus.cc:993] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:09.932507  6761 raft_consensus.cc:1081] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Signalling peer dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:09.934501  1538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:51500
I20260709 12:59:09.935091  1538 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:09.935470  1538 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:09.968454  1538 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:09.990212  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:09.991210  1616 raft_consensus.cc:3055] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:09.991628  1616 raft_consensus.cc:740] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:09.992604  1616 consensus_queue.cc:260] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:09.994369  1616 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:09.999511  1538 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:10.000813  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:10.001515  1688 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:10.006122  1616 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
I20260709 12:59:10.007565  1505 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:10.016520  1688 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
I20260709 12:59:10.011328  6759 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:10.034287  6759 raft_consensus.cc:697] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:10.048915  1438 catalog_manager.cc:5697] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 8 to 12, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:10.075670  6759 consensus_queue.cc:237] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:10.096141  1438 catalog_manager.cc:5697] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 15 to 20. New cstate: current_term: 20 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:10.098152  1438 catalog_manager.cc:5697] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:10.102932  1438 catalog_manager.cc:5697] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 15 to 19, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 19 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:10.119204  1438 catalog_manager.cc:5697] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
W20260709 12:59:10.160631  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 74600.7us
I20260709 12:59:10.168877  1438 catalog_manager.cc:5697] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 15 to 20, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 20 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:10.170784  1438 catalog_manager.cc:5697] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 15 to 20, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 20 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:10.172452  1438 catalog_manager.cc:5697] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 8 to 17, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 17 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:10.176875  1438 catalog_manager.cc:5697] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:10.178753  1438 catalog_manager.cc:5697] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 14 to 15, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 15 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:10.180375  1608 raft_consensus.cc:1275] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:59:10.182392  6759 consensus_queue.cc:1048] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:10.180214  1438 catalog_manager.cc:5697] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 15 to 17, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 17 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:10.199864  1438 catalog_manager.cc:5697] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 10 to 12, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:10.201211  1438 catalog_manager.cc:5697] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:10.202854  1438 catalog_manager.cc:5697] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 9 to 13, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 13 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:10.205078  1438 catalog_manager.cc:5697] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:10.210400  1434 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54606 (request call id 147) took 8121 ms. Trace:
I20260709 12:59:10.210820  1434 rpcz_store.cc:276] 0709 12:59:02.089261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:02.089455 (+   194us) service_pool.cc:224] Handling call
0709 12:59:10.210330 (+8120875us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:09.851997 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:09.852556 (+   559us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:09.852588 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:59:09.852605 (+    17us) tablet.cc:662] Decoding operations
0709 12:59:09.854249 (+  1644us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:09.854310 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:09.854351 (+    41us) tablet.cc:685] Acquiring locks for 22 operations
0709 12:59:09.855935 (+  1584us) tablet.cc:701] Row locks acquired
0709 12:59:09.855956 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:59:09.856099 (+   143us) write_op.cc:270] Start()
0709 12:59:09.856246 (+   147us) write_op.cc:276] Timestamp: P: 1783601949856052 usec, L: 0
0709 12:59:09.856274 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:59:09.858311 (+  2037us) log.cc:844] Serialized 8681 byte log entry
0709 12:59:09.868706 (+ 10395us) op_driver.cc:464] REPLICATION: finished
0709 12:59:09.869080 (+   374us) write_op.cc:301] APPLY: starting
0709 12:59:09.869162 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:09.882784 (+ 13622us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:09.882885 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:09.917828 (+ 34943us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:09.918116 (+   288us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=0,mrs_lookups=0
0709 12:59:09.918164 (+    48us) write_op.cc:312] APPLY: finished
0709 12:59:09.918584 (+   420us) log.cc:844] Serialized 195 byte log entry
0709 12:59:09.919389 (+   805us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:09.919576 (+   187us) write_op.cc:454] Released schema lock
0709 12:59:09.919638 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:09.920027 (+   389us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:09.920060 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7897,"reported_tablets":57,"child_traces":[["op",{"apply.queue_time_us":117,"apply.run_cpu_time_us":25429,"apply.run_wall_time_us":50920,"cfile_cache_hit":88,"cfile_cache_hit_bytes":92004,"num_ops":22,"prepare.queue_time_us":109,"prepare.run_cpu_time_us":5319,"prepare.run_wall_time_us":9172,"replication_time_us":10469}]]}
I20260709 12:59:10.232152  1682 raft_consensus.cc:1275] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:59:10.233986  6764 consensus_queue.cc:1048] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:10.293888  1608 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:10.297026  6764 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:10.363831  1439 catalog_manager.cc:5697] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:10.366050  1439 catalog_manager.cc:5697] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:10.367455  1439 catalog_manager.cc:5697] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:10.372424  1439 catalog_manager.cc:5697] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:10.381134  1439 catalog_manager.cc:5697] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 12 to 13, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 13 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:10.382905  1439 catalog_manager.cc:5697] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 12 to 14, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:10.371018  1438 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54590 (request call id 144) took 6290 ms. Trace:
I20260709 12:59:10.390645  1439 catalog_manager.cc:5697] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 14 to 16, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:10.388697  1438 rpcz_store.cc:276] 0709 12:59:04.082441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:04.087986 (+  5545us) service_pool.cc:224] Handling call
0709 12:59:10.370943 (+6282957us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:10.220877 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:10.221411 (+   534us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:10.221444 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:59:10.221458 (+    14us) tablet.cc:662] Decoding operations
0709 12:59:10.222691 (+  1233us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:10.222746 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:10.222773 (+    27us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:59:10.223828 (+  1055us) tablet.cc:701] Row locks acquired
0709 12:59:10.223847 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:59:10.223990 (+   143us) write_op.cc:270] Start()
0709 12:59:10.224104 (+   114us) write_op.cc:276] Timestamp: P: 1783601950223949 usec, L: 0
0709 12:59:10.224127 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:59:10.224982 (+   855us) log.cc:844] Serialized 5973 byte log entry
0709 12:59:10.227449 (+  2467us) op_driver.cc:464] REPLICATION: finished
0709 12:59:10.227793 (+   344us) write_op.cc:301] APPLY: starting
0709 12:59:10.227882 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:10.234919 (+  7037us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:10.235005 (+    86us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:10.251358 (+ 16353us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:10.251591 (+   233us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 12:59:10.251635 (+    44us) write_op.cc:312] APPLY: finished
0709 12:59:10.251971 (+   336us) log.cc:844] Serialized 138 byte log entry
0709 12:59:10.262537 (+ 10566us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:10.262686 (+   149us) write_op.cc:454] Released schema lock
0709 12:59:10.262740 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:10.265053 (+  2313us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:10.265081 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":119981,"reported_tablets":57,"child_traces":[["op",{"apply.queue_time_us":110,"apply.run_cpu_time_us":16888,"apply.run_wall_time_us":37233,"cfile_cache_hit":60,"cfile_cache_hit_bytes":62730,"num_ops":15,"prepare.queue_time_us":9730,"prepare.run_cpu_time_us":4221,"prepare.run_wall_time_us":7040,"replication_time_us":3192}]]}
I20260709 12:59:10.403975  1439 catalog_manager.cc:5697] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 13 to 17, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 17 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:10.417088  1439 catalog_manager.cc:5697] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:10.418805  1439 catalog_manager.cc:5697] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 14 to 16, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:10.420455  1439 catalog_manager.cc:5697] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:10.422343  1439 catalog_manager.cc:5697] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:10.424917  1439 catalog_manager.cc:5697] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 13 to 15, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:10.426657  1439 catalog_manager.cc:5697] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:10.428491  1682 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:10.436514  6759 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:10.436193  1439 catalog_manager.cc:5697] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 9 to 15, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:10.544318  1688 raft_consensus.cc:1275] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:10.546227  6764 consensus_queue.cc:1048] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:10.565434  1614 raft_consensus.cc:1275] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:10.578536  6680 consensus_queue.cc:1048] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:10.615796   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:10.755225  1434 catalog_manager.cc:5697] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 11 to 12, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:10.757202  1434 catalog_manager.cc:5697] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 12 to 15, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 15 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:10.775040  1439 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54582 (request call id 154) took 1377 ms. Trace:
I20260709 12:59:10.779619  1538 consensus_queue.cc:237] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:10.799799  1439 rpcz_store.cc:276] 0709 12:59:09.397665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.397825 (+   160us) service_pool.cc:224] Handling call
0709 12:59:10.774935 (+1377110us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:10.456931 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:10.457496 (+   565us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:10.457543 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:59:10.457561 (+    18us) tablet.cc:662] Decoding operations
0709 12:59:10.458951 (+  1390us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:10.459012 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:10.459038 (+    26us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:59:10.460251 (+  1213us) tablet.cc:701] Row locks acquired
0709 12:59:10.460268 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:59:10.460455 (+   187us) write_op.cc:270] Start()
0709 12:59:10.462356 (+  1901us) write_op.cc:276] Timestamp: P: 1783601950460406 usec, L: 0
0709 12:59:10.462375 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:59:10.468009 (+  5634us) log.cc:844] Serialized 5973 byte log entry
0709 12:59:10.472564 (+  4555us) op_driver.cc:464] REPLICATION: finished
0709 12:59:10.472988 (+   424us) write_op.cc:301] APPLY: starting
0709 12:59:10.473066 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:10.490142 (+ 17076us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:10.490245 (+   103us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:10.501277 (+ 11032us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b54001b99d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d04ce28 00007fc860a87581 00007fc860a86d58 00007fc860a8b9f1 00007fc860a8b9a9 00007fc860a8b939 00007fc860a8b901 00007fc860a8ab2d 000000000038f354 000000000038f199
0709 12:59:10.611986 (+110709us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:10.612248 (+   262us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 12:59:10.612296 (+    48us) write_op.cc:312] APPLY: finished
0709 12:59:10.612682 (+   386us) log.cc:844] Serialized 138 byte log entry
0709 12:59:10.667266 (+ 54584us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:10.669991 (+  2725us) write_op.cc:454] Released schema lock
0709 12:59:10.674476 (+  4485us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:10.676356 (+  1880us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:10.676389 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":78398,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":222,"apply.run_cpu_time_us":19369,"apply.run_wall_time_us":203286,"cfile_cache_hit":60,"cfile_cache_hit_bytes":62730,"num_ops":15,"prepare.queue_time_us":99,"prepare.run_cpu_time_us":9317,"prepare.run_wall_time_us":44513,"replication_time_us":10013,"spinlock_wait_cycles":2535296}]]}
I20260709 12:59:10.819130  2297 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:10.824658  1682 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:59:10.956709  6617 log.cc:927] Time spent T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6: Append to log took a long time: real 0.125s	user 0.005s	sys 0.007s
I20260709 12:59:10.969180  1438 catalog_manager.cc:5697] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 14 to 15, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
W20260709 12:59:11.101016  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 46953.7us
W20260709 12:59:11.101109  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 53267.9us
W20260709 12:59:11.129554  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 123067us
I20260709 12:59:11.112593  6763 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
W20260709 12:59:11.165325  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 61389us
W20260709 12:59:11.186631  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 75007.5us
W20260709 12:59:11.188584  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 84991.5us
W20260709 12:59:11.256894  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 52283.4us
I20260709 12:59:11.207823  6764 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:59:11.264374  1434 catalog_manager.cc:5697] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 14 to 15, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
W20260709 12:59:11.308771  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 50037.9us
W20260709 12:59:11.346772  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 137025us
W20260709 12:59:11.354226  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 93738us
W20260709 12:59:11.459041  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 83058.4us
W20260709 12:59:11.481412  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 121770us
W20260709 12:59:11.508343  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 63560.1us
I20260709 12:59:11.514559  2297 raft_consensus.cc:2955] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:11.496644  6750 raft_consensus.cc:2955] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index 9 to 10, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:11.549372  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 95abfe15f7d54f3fb0f01f162b262561 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:11.559006  1613 consensus_queue.cc:237] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:11.574642  1437 catalog_manager.cc:5697] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 9 to 10, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New cstate: current_term: 15 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:11.607164  1603 tablet_service.cc:1558] Processing DeleteTablet for tablet 95abfe15f7d54f3fb0f01f162b262561 with delete_type TABLET_DATA_TOMBSTONED (TS c262eac7fc904ae9bb91e450f6532e3f not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:54360
I20260709 12:59:11.639295  2297 raft_consensus.cc:1275] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 12:59:11.640776  1538 raft_consensus.cc:1275] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 12:59:11.642114  6591 consensus_queue.cc:1048] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:11.650208  6826 tablet_replica.cc:333] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 12:59:11.653911  6803 consensus_queue.cc:1048] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:11.673790  6826 raft_consensus.cc:2243] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:11.674646  6826 raft_consensus.cc:2272] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:11.674831  6591 raft_consensus.cc:2955] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Committing config change with OpId 10.12: config changed from index 11 to 12, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:11.676383  2297 raft_consensus.cc:2955] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Committing config change with OpId 10.12: config changed from index 11 to 12, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:11.677726  6826 ts_tablet_manager.cc:1916] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:11.692440  1424 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dbdf9662619648c4a3b76fbbda8d0e14 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:11.762207  1438 catalog_manager.cc:5697] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 11 to 12, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New cstate: current_term: 10 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:11.768235  1538 raft_consensus.cc:2955] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Committing config change with OpId 10.12: config changed from index 11 to 12, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:11.802179  6826 ts_tablet_manager.cc:1929] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.9
I20260709 12:59:11.810101  6826 log.cc:1199] T 95abfe15f7d54f3fb0f01f162b262561 P c262eac7fc904ae9bb91e450f6532e3f: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-1-root/wals/95abfe15f7d54f3fb0f01f162b262561
I20260709 12:59:11.808139  1672 tablet_service.cc:1558] Processing DeleteTablet for tablet dbdf9662619648c4a3b76fbbda8d0e14 with delete_type TABLET_DATA_TOMBSTONED (TS 4487a53c51be4634bf1ef29c5248353d not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:50688
I20260709 12:59:11.813814  1424 catalog_manager.cc:5028] TS c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): tablet 95abfe15f7d54f3fb0f01f162b262561 (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:59:11.835534  1688 raft_consensus.cc:2955] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:11.870980  6830 tablet_replica.cc:333] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 12:59:11.873543  6830 raft_consensus.cc:2243] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:11.874797  6830 raft_consensus.cc:2272] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:11.886765  6830 ts_tablet_manager.cc:1916] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:11.917970  6830 ts_tablet_manager.cc:1929] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.11
I20260709 12:59:11.918474  6830 log.cc:1199] T dbdf9662619648c4a3b76fbbda8d0e14 P 4487a53c51be4634bf1ef29c5248353d: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-2-root/wals/dbdf9662619648c4a3b76fbbda8d0e14
I20260709 12:59:11.931478  1427 catalog_manager.cc:5028] TS 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): tablet dbdf9662619648c4a3b76fbbda8d0e14 (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:59:12.130338   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:12.315781  1688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40880327f92147c1936b74eee0e6724d"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:54400
I20260709 12:59:12.316455  1688 raft_consensus.cc:606] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Received request to transfer leadership to TS c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:12.320334  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:54400
I20260709 12:59:12.320968  1682 raft_consensus.cc:606] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:12.341696  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "920d24d01316479692fb62f167beb41e"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:12.342628  1609 raft_consensus.cc:606] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:12.351116  1535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:47506
I20260709 12:59:12.351779  1535 raft_consensus.cc:606] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Received request to transfer leadership to TS c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:12.353407   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:59:12.355031   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:12.383891  6788 raft_consensus.cc:993] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d: : Instructing follower c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:12.384434  6788 raft_consensus.cc:1081] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Signalling peer c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:12.386430  1609 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40880327f92147c1936b74eee0e6724d"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:49312
I20260709 12:59:12.386984  1609 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:12.387329  1609 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:12.397608  1609 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:12.400787  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:12.401422  1538 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:12.403973  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:12.404631  1682 raft_consensus.cc:3055] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:12.404942  1682 raft_consensus.cc:740] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:12.405659  1682 consensus_queue.cc:260] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:12.406685  1682 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:12.415369  1682 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 12:59:12.422569  1583 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:12.423563  6591 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:12.424064  6591 raft_consensus.cc:697] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:12.424904  6591 consensus_queue.cc:237] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:12.406672  1609 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:12.408506  1538 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 12:59:12.463872  6750 raft_consensus.cc:993] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8: : Instructing follower c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:12.464339  6750 raft_consensus.cc:1081] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Signalling peer c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:12.467586  1608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:49296
I20260709 12:59:12.468161  1608 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:12.471414  1608 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:12.489915  6793 raft_consensus.cc:993] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d: : Instructing follower dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:12.490481  6793 raft_consensus.cc:1081] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Signalling peer dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:12.497234  1538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:51512
I20260709 12:59:12.497849  1538 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:12.498193  1538 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:12.526397  1437 catalog_manager.cc:5697] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 15 to 16, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 16 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:12.527366  1608 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:12.540535  1608 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:12.525247  1538 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:12.544413  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:12.545074  1688 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:12.545274  1538 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:12.547416  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:12.548074  1609 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:12.549937  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:12.550439  1538 raft_consensus.cc:3055] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:12.550655  1538 raft_consensus.cc:740] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:12.551198  1538 consensus_queue.cc:260] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:12.551905  1538 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:12.553414  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:12.553974  1687 raft_consensus.cc:3055] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:12.554191  1687 raft_consensus.cc:740] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:12.558382  1687 consensus_queue.cc:260] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:12.562227  1687 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:12.566290  1688 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:59:12.585942  1538 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:59:12.580403  1609 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 12:59:12.592643  1583 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:12.594956  1687 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 12:59:12.596088  1508 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:59:12.614776  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 55559us
I20260709 12:59:12.608395  6839 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:12.628271  6839 raft_consensus.cc:697] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:12.629951  6839 consensus_queue.cc:237] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:12.623450  6803 raft_consensus.cc:2804] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:12.641690  6803 raft_consensus.cc:697] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:12.637401  6822 raft_consensus.cc:993] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:12.649613  6822 raft_consensus.cc:1081] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:12.642663  6803 consensus_queue.cc:237] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:12.665634  1682 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "920d24d01316479692fb62f167beb41e"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50708
I20260709 12:59:12.666227  1682 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:12.666613  1682 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:12.675922  1682 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:12.684067  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:12.684701  1538 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:12.690248  1538 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 12:59:12.691231  1655 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:12.691967  1682 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:12.693531  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:12.693994  6785 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:59:12.694481  1609 raft_consensus.cc:3055] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:59:12.694677  6785 raft_consensus.cc:697] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:12.694967  1609 raft_consensus.cc:740] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:12.695950  1609 consensus_queue.cc:260] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:12.699019  1609 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:12.706710  6785 consensus_queue.cc:237] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:12.725785  1609 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 12:59:12.752128  1439 catalog_manager.cc:5697] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 15 to 16, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:12.756685  1438 catalog_manager.cc:5697] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 17 to 18, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 18 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:12.790711  1437 catalog_manager.cc:5697] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 11 to 12, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 12 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:12.823041  1682 raft_consensus.cc:1275] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:59:12.826874  1534 raft_consensus.cc:1275] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:59:12.827394  6803 consensus_queue.cc:1048] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:12.828744  6841 consensus_queue.cc:1048] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:12.971700  1682 consensus_queue.cc:237] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
W20260709 12:59:12.999859  1656 consensus_peers.cc:597] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 97c958beecec40918b63217135840ff6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:13.002053  1534 raft_consensus.cc:1275] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:59:13.004033  6785 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:13.009518  1616 raft_consensus.cc:1275] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:59:13.010762  6785 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:13.035555  6788 raft_consensus.cc:2955] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:13.036859  1616 raft_consensus.cc:2955] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:13.043996  1534 raft_consensus.cc:2955] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:13.064873  1539 consensus_queue.cc:237] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:13.065718  1437 catalog_manager.cc:5697] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index -1 to 8, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 10 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:13.068552  1688 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:59:13.072996  6839 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:59:13.101773  1507 consensus_peers.cc:597] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35beb9f05ad84a8fb211d701469ddd6c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:13.103132  1688 raft_consensus.cc:1275] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:59:13.118161  1616 raft_consensus.cc:1275] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:59:13.118786  6839 consensus_queue.cc:1048] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:13.140966  6790 consensus_queue.cc:1048] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:13.164139  1540 raft_consensus.cc:1275] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:59:13.170226  6841 consensus_queue.cc:1048] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:13.184751  1616 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:59:13.218261  6839 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:13.219390  1688 raft_consensus.cc:1275] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:59:13.222595  6841 consensus_queue.cc:1048] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:59:13.236701  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 44636.8us
I20260709 12:59:13.261767  6790 raft_consensus.cc:2955] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:13.272776  1691 raft_consensus.cc:2955] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:13.284102  1616 raft_consensus.cc:1275] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:59:13.287094  6785 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:13.310829  1439 catalog_manager.cc:5697] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index -1 to 9, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 12 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
W20260709 12:59:13.318776  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 115865us
I20260709 12:59:13.326821  1539 raft_consensus.cc:1275] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:59:13.338655  1691 consensus_queue.cc:237] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:13.350894  6785 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:13.355983   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:13.360885  1616 raft_consensus.cc:2955] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:13.462548  6876 ts_tablet_manager.cc:933] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:59:13.471829  1656 consensus_peers.cc:597] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a73b99964f4c4107aed2d05c6106b3b5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:13.473238  1608 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:59:13.491817  6793 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:13.483096  1539 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:59:13.495694  6793 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:13.499441  6876 tablet_copy_client.cc:323] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45275
I20260709 12:59:13.501310  1701 tablet_copy_service.cc:140] P 4487a53c51be4634bf1ef29c5248353d: Received BeginTabletCopySession request for tablet 97c958beecec40918b63217135840ff6 from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:33206)
I20260709 12:59:13.501950  1701 tablet_copy_service.cc:161] P 4487a53c51be4634bf1ef29c5248353d: Beginning new tablet copy session on tablet 97c958beecec40918b63217135840ff6 from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:33206: session id = 1d6516ff61104bdda54bde95e92fe579-97c958beecec40918b63217135840ff6
I20260709 12:59:13.506524  6878 ts_tablet_manager.cc:933] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903)
I20260709 12:59:13.511166  1701 tablet_copy_source_session.cc:215] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:13.523433  6793 raft_consensus.cc:2955] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:13.552614  6876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97c958beecec40918b63217135840ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:13.555132  1616 raft_consensus.cc:2955] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:13.564802  6878 tablet_copy_client.cc:323] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43903
I20260709 12:59:13.566762  1550 tablet_copy_service.cc:140] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Received BeginTabletCopySession request for tablet 35beb9f05ad84a8fb211d701469ddd6c from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:42356)
I20260709 12:59:13.567376  1550 tablet_copy_service.cc:161] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Beginning new tablet copy session on tablet 35beb9f05ad84a8fb211d701469ddd6c from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:42356: session id = 1d6516ff61104bdda54bde95e92fe579-35beb9f05ad84a8fb211d701469ddd6c
I20260709 12:59:13.575372  1550 tablet_copy_source_session.cc:215] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:13.588582  1539 raft_consensus.cc:2955] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:13.593958  6876 tablet_copy_client.cc:806] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:13.594687  6876 tablet_copy_client.cc:670] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:13.594537  1540 consensus_queue.cc:237] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:13.600411  6878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35beb9f05ad84a8fb211d701469ddd6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:13.610684  1439 catalog_manager.cc:5697] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index -1 to 11, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 17 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:13.628309  6876 tablet_copy_client.cc:538] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:13.656723  6876 tablet_bootstrap.cc:492] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:59:13.701653  1608 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:59:13.703016  1507 consensus_peers.cc:597] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6f1367cef67f42eab84cbda659b7ffb1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:13.704485  6869 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:13.715642  6839 raft_consensus.cc:2955] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:13.723187  6878 tablet_copy_client.cc:806] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:13.727317  1682 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:59:13.729187  6878 tablet_copy_client.cc:670] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:13.791445  6878 tablet_copy_client.cc:538] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:13.793058  1616 raft_consensus.cc:2955] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:13.863196  1438 catalog_manager.cc:5697] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 16 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:13.904079  6838 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:59:13.934441  6878 tablet_bootstrap.cc:492] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:59:13.939898  6888 ts_tablet_manager.cc:933] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:14.007494  6876 tablet_bootstrap.cc:492] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=2 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:14.056335  6876 tablet_bootstrap.cc:492] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:59:14.059839  6876 ts_tablet_manager.cc:1403] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 0.419s	user 0.035s	sys 0.010s
I20260709 12:59:14.100123  6888 tablet_copy_client.cc:323] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45275
W20260709 12:59:14.135717  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 54253.2us
I20260709 12:59:14.142807  1701 tablet_copy_service.cc:140] P 4487a53c51be4634bf1ef29c5248353d: Received BeginTabletCopySession request for tablet a73b99964f4c4107aed2d05c6106b3b5 from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:33206)
I20260709 12:59:14.143510  1701 tablet_copy_service.cc:161] P 4487a53c51be4634bf1ef29c5248353d: Beginning new tablet copy session on tablet a73b99964f4c4107aed2d05c6106b3b5 from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:33206: session id = 1d6516ff61104bdda54bde95e92fe579-a73b99964f4c4107aed2d05c6106b3b5
W20260709 12:59:14.168133  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 129952us
W20260709 12:59:14.168769  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 46215.9us
W20260709 12:59:14.198622  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 52649.7us
I20260709 12:59:14.206370  6876 raft_consensus.cc:359] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:14.209959  6876 raft_consensus.cc:740] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:59:14.214226  6876 consensus_queue.cc:260] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:14.223335  6876 ts_tablet_manager.cc:1434] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.162s	user 0.004s	sys 0.003s
I20260709 12:59:14.220109  1701 tablet_copy_source_session.cc:215] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:14.294404  6888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a73b99964f4c4107aed2d05c6106b3b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:14.283797  1701 tablet_copy_service.cc:342] P 4487a53c51be4634bf1ef29c5248353d: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-97c958beecec40918b63217135840ff6 received from {username='slave'} at 127.0.0.1:33206
I20260709 12:59:14.291999  1691 raft_consensus.cc:2955] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:14.307160  1701 tablet_copy_service.cc:434] P 4487a53c51be4634bf1ef29c5248353d: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-97c958beecec40918b63217135840ff6 on tablet 97c958beecec40918b63217135840ff6 with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:14.325276  6876 ts_tablet_manager.cc:933] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903)
W20260709 12:59:14.326251  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 72640.3us
W20260709 12:59:14.370908  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 73938.7us
I20260709 12:59:14.393877  6876 tablet_copy_client.cc:323] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43903
I20260709 12:59:14.410914  1550 tablet_copy_service.cc:140] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Received BeginTabletCopySession request for tablet 6f1367cef67f42eab84cbda659b7ffb1 from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:42356)
I20260709 12:59:14.411499  1550 tablet_copy_service.cc:161] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Beginning new tablet copy session on tablet 6f1367cef67f42eab84cbda659b7ffb1 from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:42356: session id = 1d6516ff61104bdda54bde95e92fe579-6f1367cef67f42eab84cbda659b7ffb1
I20260709 12:59:14.427131  6888 tablet_copy_client.cc:806] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:14.427888  6888 tablet_copy_client.cc:670] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
W20260709 12:59:14.429625  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 49883.5us
I20260709 12:59:14.432067  1550 tablet_copy_source_session.cc:215] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:14.432585  6888 tablet_copy_client.cc:538] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:14.453167  6876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f1367cef67f42eab84cbda659b7ffb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:14.459767  2297 raft_consensus.cc:1217] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.7->[10.8-10.8]   Dedup: 10.8->[]
I20260709 12:59:14.483704  6888 tablet_bootstrap.cc:492] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:59:14.493129  6878 tablet_bootstrap.cc:492] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:14.494818  6878 tablet_bootstrap.cc:492] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:59:14.529100  6878 ts_tablet_manager.cc:1403] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 0.595s	user 0.040s	sys 0.022s
I20260709 12:59:14.532393  6878 raft_consensus.cc:359] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:14.545488  6878 raft_consensus.cc:740] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:59:14.546214  6878 consensus_queue.cc:260] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:14.560793  6878 ts_tablet_manager.cc:1434] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:59:14.565423  6876 tablet_copy_client.cc:806] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:14.573117  6876 tablet_copy_client.cc:670] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:14.580807  6876 tablet_copy_client.cc:538] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:14.589555  1550 tablet_copy_service.cc:342] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-35beb9f05ad84a8fb211d701469ddd6c received from {username='slave'} at 127.0.0.1:42356
I20260709 12:59:14.590070  1550 tablet_copy_service.cc:434] P dbe6a89d0e1c4137b3a1b17bf4b520d8: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-35beb9f05ad84a8fb211d701469ddd6c on tablet 35beb9f05ad84a8fb211d701469ddd6c with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:14.595321   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:14.629127  6876 tablet_bootstrap.cc:492] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:59:14.742067  6888 tablet_bootstrap.cc:492] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:14.743134  6888 tablet_bootstrap.cc:492] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:59:14.743896  6888 ts_tablet_manager.cc:1403] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 0.260s	user 0.042s	sys 0.030s
I20260709 12:59:14.748766  6888 raft_consensus.cc:359] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:14.760386  6888 raft_consensus.cc:740] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:59:14.761224  6888 consensus_queue.cc:260] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:14.771726  6888 ts_tablet_manager.cc:1434] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.003s
I20260709 12:59:14.775139  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:14.775920  1616 raft_consensus.cc:606] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:14.780148  1701 tablet_copy_service.cc:342] P 4487a53c51be4634bf1ef29c5248353d: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-a73b99964f4c4107aed2d05c6106b3b5 received from {username='slave'} at 127.0.0.1:33206
I20260709 12:59:14.780632  1701 tablet_copy_service.cc:434] P 4487a53c51be4634bf1ef29c5248353d: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-a73b99964f4c4107aed2d05c6106b3b5 on tablet a73b99964f4c4107aed2d05c6106b3b5 with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:14.781432  1534 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:47506
I20260709 12:59:14.782063  1534 raft_consensus.cc:606] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Received request to transfer leadership to TS c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:14.814381  1691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:54400
I20260709 12:59:14.815022  1691 raft_consensus.cc:606] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:14.825800   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:59:14.827591   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:14.835098  6885 raft_consensus.cc:993] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:14.835680  6885 raft_consensus.cc:1081] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:14.836205  6876 tablet_bootstrap.cc:492] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:14.837702  1682 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50708
I20260709 12:59:14.838342  1682 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:14.838686  1682 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:14.852576  1682 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:14.854274  6876 tablet_bootstrap.cc:492] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:59:14.856024  6876 ts_tablet_manager.cc:1403] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 0.237s	user 0.037s	sys 0.006s
I20260709 12:59:14.858785  6876 raft_consensus.cc:359] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:14.859580  6876 raft_consensus.cc:740] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:59:14.860177  6876 consensus_queue.cc:260] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:14.866307  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:14.867125  1534 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:14.866464  1682 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:14.869277  6876 ts_tablet_manager.cc:1434] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 12:59:14.870119  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:14.870724  1616 raft_consensus.cc:3055] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:14.871021  1616 raft_consensus.cc:740] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:14.871811  1616 consensus_queue.cc:260] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:14.874287  1616 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:14.877226  1534 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 12:59:14.879439  1655 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:14.879515  1550 tablet_copy_service.cc:342] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-6f1367cef67f42eab84cbda659b7ffb1 received from {username='slave'} at 127.0.0.1:42356
I20260709 12:59:14.880088  1550 tablet_copy_service.cc:434] P dbe6a89d0e1c4137b3a1b17bf4b520d8: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-6f1367cef67f42eab84cbda659b7ffb1 on tablet 6f1367cef67f42eab84cbda659b7ffb1 with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:14.881258  6793 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:14.881794  6793 raft_consensus.cc:697] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:14.882701  6793 consensus_queue.cc:237] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:14.893646  1616 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 12:59:14.910624  1438 catalog_manager.cc:5697] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 15 to 16, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 16 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:14.963197  6785 raft_consensus.cc:1064] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:59:14.971146  6785 consensus_queue.cc:237] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:15.008215  2297 raft_consensus.cc:1275] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 10 LEARNER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:15.010754  1613 raft_consensus.cc:1275] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:15.011533  6887 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:15.012295  1534 raft_consensus.cc:1275] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:15.013438  6891 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:15.017870  2297 raft_consensus.cc:1217] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.10->[17.11-17.11]   Dedup: 17.11->[]
I20260709 12:59:15.018045  6785 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:59:15.089439  2298 raft_consensus.cc:1217] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.8->[12.9-12.9]   Dedup: 12.9->[]
I20260709 12:59:15.214280  6785 raft_consensus.cc:2955] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:15.239106  6793 raft_consensus.cc:993] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d: : Instructing follower dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:15.239804  6793 raft_consensus.cc:1081] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Signalling peer dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:15.241948  6871 raft_consensus.cc:993] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8: : Instructing follower c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:15.247539  6871 raft_consensus.cc:1081] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Signalling peer c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:15.254069  1539 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:51512
I20260709 12:59:15.254719  1609 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:49296
I20260709 12:59:15.255323  1609 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:15.255697  1609 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:15.254721  1539 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:15.261111  1539 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:15.269207  1609 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:15.271898  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:15.272691  1535 raft_consensus.cc:3055] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:15.273087  1535 raft_consensus.cc:740] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:15.273888  1535 consensus_queue.cc:260] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:15.273384  1613 raft_consensus.cc:2955] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:15.275065  1535 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:15.276865  1539 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:15.271955  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:15.285192  1682 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:59:15.289280  6914 log.cc:927] Time spent T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:59:15.292142  1682 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 12:59:15.282159  1535 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 12:59:15.293733  1583 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:15.294322  1534 raft_consensus.cc:2955] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:15.284575  1609 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:15.306766  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:15.306766  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:15.306334  2297 raft_consensus.cc:2955] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:15.307466  1691 raft_consensus.cc:3055] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:15.298659  6915 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:15.307902  1691 raft_consensus.cc:740] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:15.308693  6915 raft_consensus.cc:697] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:15.308797  1691 consensus_queue.cc:260] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:15.310093  1691 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:15.309826  6915 consensus_queue.cc:237] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:15.307539  1609 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:15.319078  1539 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:15.315714  1437 catalog_manager.cc:5697] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: config changed from index 8 to 9, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:15.325456  1691 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 17.
I20260709 12:59:15.326925  1508 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:15.327716  6871 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:59:15.328249  6871 raft_consensus.cc:697] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:15.329209  6871 consensus_queue.cc:237] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:15.331465  1609 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 17.
I20260709 12:59:15.337083  2297 raft_consensus.cc:1217] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.9->[16.10-16.10]   Dedup: 16.10->[]
I20260709 12:59:15.374632  1534 raft_consensus.cc:1275] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:59:15.376269  6785 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:15.435803  6793 raft_consensus.cc:1064] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:59:15.438432  6793 consensus_queue.cc:237] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:15.445310  1439 catalog_manager.cc:5697] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 15 to 16, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 16 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:15.471575  6871 raft_consensus.cc:1064] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:59:15.474327  1682 consensus_queue.cc:237] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:15.474551  6871 consensus_queue.cc:237] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:15.481208  1609 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:59:15.483137  2297 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEARNER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:59:15.484827  1534 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:59:15.485250  6891 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:15.486665  1613 raft_consensus.cc:1275] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:59:15.488325  6891 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:15.495759  6793 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:15.499037  2297 raft_consensus.cc:1275] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:59:15.499927  6785 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:15.505383  6785 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:15.521603  6928 raft_consensus.cc:2955] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:15.532802  1616 raft_consensus.cc:1275] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:59:15.534818  2298 raft_consensus.cc:2955] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:15.536247  1616 raft_consensus.cc:2955] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:15.558305  6887 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:15.604238  1434 catalog_manager.cc:5697] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 9 to 10, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New cstate: current_term: 10 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:15.624663  1427 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 97c958beecec40918b63217135840ff6 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:15.628167  1532 tablet_service.cc:1558] Processing DeleteTablet for tablet 97c958beecec40918b63217135840ff6 with delete_type TABLET_DATA_TOMBSTONED (TS dbe6a89d0e1c4137b3a1b17bf4b520d8 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:51498
I20260709 12:59:15.714993  6932 tablet_replica.cc:333] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
W20260709 12:59:15.718973  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 155061us
W20260709 12:59:15.792636  6926 log.cc:927] Time spent T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:59:15.797289  6785 raft_consensus.cc:2955] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:15.801167  2297 raft_consensus.cc:2955] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 12:59:15.812165  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 65888.8us
I20260709 12:59:15.814170  1691 raft_consensus.cc:1275] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:59:15.817308  6932 raft_consensus.cc:2243] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:15.816866  1608 raft_consensus.cc:2955] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:15.831862  6932 raft_consensus.cc:2272] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:15.835269  1439 catalog_manager.cc:5697] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 16 to 17, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 17 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:15.844800  6938 consensus_queue.cc:1048] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:15.847165  1609 raft_consensus.cc:1275] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:59:15.859030   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:15.859375  6939 consensus_queue.cc:1048] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:15.869056  6932 ts_tablet_manager.cc:1916] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:15.862329  1534 raft_consensus.cc:2955] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:15.875586  1682 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:59:15.891224  1682 raft_consensus.cc:1275] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:59:15.895313  6885 consensus_queue.cc:1048] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:15.867920  1438 catalog_manager.cc:5697] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 11 to 12, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:15.915068  2297 raft_consensus.cc:1275] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 12 LEARNER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:59:15.918960  6940 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:16.010751  1683 consensus_queue.cc:237] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:16.018096  6940 consensus_queue.cc:1048] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:16.019840  6944 raft_consensus.cc:1064] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:59:16.024820  1535 raft_consensus.cc:1275] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:59:16.022535  6944 consensus_queue.cc:237] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 8, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:59:16.043044  6947 log.cc:927] Time spent T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:59:16.060360  2298 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:59:16.064235  6793 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:59:16.086747  6887 raft_consensus.cc:2955] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:16.099828  2303 raft_consensus.cc:2955] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:16.103188  1614 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:59:16.104202  1612 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:59:16.106578  6785 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:59:16.118251  6939 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:16.123732  6932 ts_tablet_manager.cc:1929] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.9
I20260709 12:59:16.129252  6937 raft_consensus.cc:2955] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:16.115038  1612 raft_consensus.cc:2955] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:16.138991  1691 raft_consensus.cc:2955] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:16.124317  6932 log.cc:1199] T 97c958beecec40918b63217135840ff6 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-0-root/wals/97c958beecec40918b63217135840ff6
I20260709 12:59:16.141104  2297 raft_consensus.cc:2955] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:16.145383  1425 catalog_manager.cc:5028] TS dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): tablet 97c958beecec40918b63217135840ff6 (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:59:16.161000  6837 consensus_queue.cc:1048] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:59:16.190045  2297 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEARNER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:59:16.191843  6901 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:16.197926  1434 catalog_manager.cc:5697] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index 9 to 10, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:16.205047  1691 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:59:16.206845  6903 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:16.210807  1427 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a73b99964f4c4107aed2d05c6106b3b5 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:16.188366  1438 catalog_manager.cc:5697] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 12 to 13, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New cstate: current_term: 17 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:16.218617  1608 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:59:16.232676  6944 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:59:16.263976  1532 tablet_service.cc:1558] Processing DeleteTablet for tablet a73b99964f4c4107aed2d05c6106b3b5 with delete_type TABLET_DATA_TOMBSTONED (TS dbe6a89d0e1c4137b3a1b17bf4b520d8 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:51498
I20260709 12:59:16.265381  6932 tablet_replica.cc:333] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 12:59:16.266378  6932 raft_consensus.cc:2243] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:16.267146  6932 raft_consensus.cc:2272] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:16.268950  1612 raft_consensus.cc:2955] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:16.295017  6932 ts_tablet_manager.cc:1916] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:59:16.313998  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 116108us
I20260709 12:59:16.354776  6903 raft_consensus.cc:2955] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:16.358367  2297 raft_consensus.cc:2955] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:16.393360  1687 raft_consensus.cc:2955] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:16.398667  1535 consensus_queue.cc:237] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:16.415869  1438 catalog_manager.cc:5697] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:16.423157  1612 raft_consensus.cc:2955] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:16.429399  2297 raft_consensus.cc:1275] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:59:16.432623  6936 consensus_queue.cc:1048] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:16.437476  1691 raft_consensus.cc:1275] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:59:16.442600  6901 consensus_queue.cc:1048] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:16.486619  6939 raft_consensus.cc:2955] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:16.491969  1537 consensus_queue.cc:237] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:59:16.500702  6950 log.cc:927] Time spent T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.062s	user 0.017s	sys 0.016s
I20260709 12:59:16.508008  2297 raft_consensus.cc:2955] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:16.515728  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 35beb9f05ad84a8fb211d701469ddd6c with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:16.518337  2303 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:59:16.524158  1691 raft_consensus.cc:2955] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:16.530623  6932 ts_tablet_manager.cc:1929] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.12
I20260709 12:59:16.531111  6932 log.cc:1199] T a73b99964f4c4107aed2d05c6106b3b5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-0-root/wals/a73b99964f4c4107aed2d05c6106b3b5
I20260709 12:59:16.532330  1425 catalog_manager.cc:5028] TS dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): tablet a73b99964f4c4107aed2d05c6106b3b5 (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:59:16.520526  6903 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 12:59:16.536440  1434 catalog_manager.cc:5697] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index 10 to 11, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New cstate: current_term: 12 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:16.547930  1688 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:59:16.553045  6936 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:16.562001  1603 tablet_service.cc:1558] Processing DeleteTablet for tablet 35beb9f05ad84a8fb211d701469ddd6c with delete_type TABLET_DATA_TOMBSTONED (TS c262eac7fc904ae9bb91e450f6532e3f not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:54360
I20260709 12:59:16.559952  6936 raft_consensus.cc:2955] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:16.606400  1688 raft_consensus.cc:2955] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:16.613945  2297 raft_consensus.cc:2955] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:16.617651  6961 tablet_replica.cc:333] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 12:59:16.636109  1438 catalog_manager.cc:5697] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 11 to 12, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New cstate: current_term: 16 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:16.649652  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6f1367cef67f42eab84cbda659b7ffb1 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:16.695318  1603 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f1367cef67f42eab84cbda659b7ffb1 with delete_type TABLET_DATA_TOMBSTONED (TS c262eac7fc904ae9bb91e450f6532e3f not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:54360
I20260709 12:59:16.770473  6961 raft_consensus.cc:2243] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:16.771502  6961 raft_consensus.cc:2272] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:16.775836  6961 ts_tablet_manager.cc:1916] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:16.812366  6961 ts_tablet_manager.cc:1929] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.10
I20260709 12:59:16.815178  6961 log.cc:1199] T 35beb9f05ad84a8fb211d701469ddd6c P c262eac7fc904ae9bb91e450f6532e3f: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-1-root/wals/35beb9f05ad84a8fb211d701469ddd6c
I20260709 12:59:16.817327  1424 catalog_manager.cc:5028] TS c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): tablet 35beb9f05ad84a8fb211d701469ddd6c (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:59:16.817750  6961 tablet_replica.cc:333] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 12:59:16.818975  6961 raft_consensus.cc:2243] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:16.819837  6961 raft_consensus.cc:2272] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:16.837208  6961 ts_tablet_manager.cc:1916] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:16.863970  6961 ts_tablet_manager.cc:1929] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.11
I20260709 12:59:16.864548  6961 log.cc:1199] T 6f1367cef67f42eab84cbda659b7ffb1 P c262eac7fc904ae9bb91e450f6532e3f: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-1-root/wals/6f1367cef67f42eab84cbda659b7ffb1
I20260709 12:59:16.866217  1424 catalog_manager.cc:5028] TS c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): tablet 6f1367cef67f42eab84cbda659b7ffb1 (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:59:17.114866   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:17.309226  1537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:47506
I20260709 12:59:17.309894  1537 raft_consensus.cc:606] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Received request to transfer leadership to TS c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:17.320377  1537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:47506
I20260709 12:59:17.321043  1537 raft_consensus.cc:606] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Received request to transfer leadership to TS c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:17.324153  1612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eabf19413eea44dd86511e07a036166b"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:17.324796  1612 raft_consensus.cc:606] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:17.340445  6936 raft_consensus.cc:993] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8: : Instructing follower c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:17.340973  6936 raft_consensus.cc:1081] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Signalling peer c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:17.346407  1615 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:49296
I20260709 12:59:17.347039  1615 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:17.347404  1615 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:17.367198  1615 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:17.370699  1612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:17.425668  1612 raft_consensus.cc:606] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:17.427384   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:59:17.429206   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:17.439780  1615 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:17.441272  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:17.442498  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:17.443276  1691 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:17.449007  1537 raft_consensus.cc:3055] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:17.449451  1537 raft_consensus.cc:740] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:17.450291  1537 consensus_queue.cc:260] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:17.454873  1537 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:17.457990  1691 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 12:59:17.464654  1583 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:17.465987  6958 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:17.466540  6958 raft_consensus.cc:697] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:17.467386  6958 consensus_queue.cc:237] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:17.669579  1537 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 12:59:17.687336  6936 raft_consensus.cc:993] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8: : Instructing follower c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:17.688161  6970 raft_consensus.cc:1081] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Signalling peer c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:17.698364  1612 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:49296
I20260709 12:59:17.698939  1612 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:17.699293  1612 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:59:17.706127  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 46713.8us
I20260709 12:59:17.708053  6896 raft_consensus.cc:993] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:17.708673  6896 raft_consensus.cc:1081] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:17.714891  6958 raft_consensus.cc:993] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:17.715461  6958 raft_consensus.cc:1081] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Signalling peer dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:17.719116  1434 catalog_manager.cc:5697] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 15 to 16, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 16 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:17.722337  1691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50708
I20260709 12:59:17.723028  1691 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:17.723448  1691 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:17.729773  1612 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:17.731926  1612 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:17.733652  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:17.744531  1687 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:17.751762  1687 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
W20260709 12:59:17.753391  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 61951.9us
I20260709 12:59:17.755625  1583 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:17.758384  1538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eabf19413eea44dd86511e07a036166b"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:51500
I20260709 12:59:17.758545  1688 raft_consensus.cc:1240] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:59:17.759001  1538 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:17.759372  1538 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:17.759150  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:17.760291  1542 raft_consensus.cc:3055] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:17.760726  1542 raft_consensus.cc:740] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:17.761880  1542 consensus_queue.cc:260] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:17.763602  1542 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:17.759110  6837 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:17.766534  6837 raft_consensus.cc:697] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:17.767777  6837 consensus_queue.cc:237] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:17.736200  1691 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:17.775242  1538 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:17.782351  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:17.783281  1533 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:17.793700  1538 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:17.794191  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:17.797606  1612 raft_consensus.cc:3055] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:17.798180  1612 raft_consensus.cc:740] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:17.799319  1612 consensus_queue.cc:260] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:17.801091  1533 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:59:17.780098  1691 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:17.807808  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:17.808523  1608 raft_consensus.cc:3055] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:17.808822  1608 raft_consensus.cc:740] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:17.809595  1608 consensus_queue.cc:260] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:17.810653  1608 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:17.817797  1612 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:17.844043  1542 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 12:59:17.849110  1608 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:59:17.843799  1612 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 17.
I20260709 12:59:17.852912  1505 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:17.853948  6936 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:59:17.854504  6936 raft_consensus.cc:697] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:17.855432  6936 consensus_queue.cc:237] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:59:17.883842  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 46616us
I20260709 12:59:17.884891  1655 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:17.885648  6934 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:17.886173  6934 raft_consensus.cc:697] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:17.887010  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:17.887639  1691 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:17.887041  6934 consensus_queue.cc:237] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:17.898777  1691 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 17.
I20260709 12:59:17.913775  1438 catalog_manager.cc:5697] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 15 to 16, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 16 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:17.915364  1439 catalog_manager.cc:5697] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 16 to 17, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 17 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:17.953699  1438 catalog_manager.cc:5697] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 12 to 13, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 13 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:17.980129  1687 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:59:17.981585  6967 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:18.040418  1538 consensus_queue.cc:237] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:18.047380  1542 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:59:18.049918  6915 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:59:18.070540  1507 consensus_peers.cc:597] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7d92e33e89814e86abdebb8b54a3a5c5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:18.085250  1691 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:59:18.086896  6936 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:18.095677  1612 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:59:18.097587  6969 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:18.194320  6969 raft_consensus.cc:2955] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:18.196861  1687 raft_consensus.cc:2955] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:18.217710  1439 catalog_manager.cc:5697] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index -1 to 11, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 16 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:18.250975  1691 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:59:18.252743  6936 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:59:18.285135  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 92739.8us
I20260709 12:59:18.294637  1533 raft_consensus.cc:1275] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:59:18.317092  1542 raft_consensus.cc:1275] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:59:18.318621  6934 consensus_queue.cc:1048] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:18.322647  1612 raft_consensus.cc:2955] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:18.336460  6915 consensus_queue.cc:1048] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:18.339481  1608 consensus_queue.cc:237] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:18.354657  1613 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:59:18.355863  1687 raft_consensus.cc:1275] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:59:18.360832  6915 consensus_queue.cc:1048] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:18.384512  6965 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:18.426929  1613 raft_consensus.cc:1275] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:59:18.430451   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:18.467397  6887 consensus_queue.cc:1048] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:59:18.518174  1688 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:59:18.523109  6896 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:59:18.537106  1582 consensus_peers.cc:597] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 499cf87d55ba434fa03c7cf6c1bb54c8. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:18.537732  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 62203.2us
I20260709 12:59:18.590384  1542 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:59:18.602758  6993 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
W20260709 12:59:18.734257  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 49597.5us
I20260709 12:59:18.736721  6837 raft_consensus.cc:2955] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
W20260709 12:59:18.773794  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 128201us
I20260709 12:59:18.778788  1687 raft_consensus.cc:2955] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
W20260709 12:59:18.794279  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 155315us
W20260709 12:59:18.829792  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 63291.3us
I20260709 12:59:18.854573  1439 catalog_manager.cc:5697] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index -1 to 8, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 11 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:18.860148  1538 consensus_queue.cc:237] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:18.885300  1537 raft_consensus.cc:2955] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:18.906152  7023 ts_tablet_manager.cc:933] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903)
I20260709 12:59:18.916178  1615 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:59:18.916354  1688 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 12:59:18.918639  1507 consensus_peers.cc:597] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 42248b4b3b744072a3581db8c3874c55. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:18.919305  7013 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:18.921370  6965 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:18.945704  7028 ts_tablet_manager.cc:933] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:18.983547  1612 raft_consensus.cc:2955] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:19.008246  7023 tablet_copy_client.cc:323] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43903
I20260709 12:59:18.964728  7013 raft_consensus.cc:2955] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:19.010910  1550 tablet_copy_service.cc:140] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Received BeginTabletCopySession request for tablet 7d92e33e89814e86abdebb8b54a3a5c5 from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:42356)
I20260709 12:59:19.011485  1550 tablet_copy_service.cc:161] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Beginning new tablet copy session on tablet 7d92e33e89814e86abdebb8b54a3a5c5 from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:42356: session id = 1d6516ff61104bdda54bde95e92fe579-7d92e33e89814e86abdebb8b54a3a5c5
I20260709 12:59:19.003572  1688 raft_consensus.cc:2955] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:19.021775  1550 tablet_copy_source_session.cc:215] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:19.032377  1434 catalog_manager.cc:5697] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: config changed from index -1 to 11, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 15 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:19.033841  7028 tablet_copy_client.cc:323] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:41953
I20260709 12:59:19.039851  1627 tablet_copy_service.cc:140] P c262eac7fc904ae9bb91e450f6532e3f: Received BeginTabletCopySession request for tablet 499cf87d55ba434fa03c7cf6c1bb54c8 from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:58006)
I20260709 12:59:19.040436  1627 tablet_copy_service.cc:161] P c262eac7fc904ae9bb91e450f6532e3f: Beginning new tablet copy session on tablet 499cf87d55ba434fa03c7cf6c1bb54c8 from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:58006: session id = 1d6516ff61104bdda54bde95e92fe579-499cf87d55ba434fa03c7cf6c1bb54c8
I20260709 12:59:19.066587  1538 consensus_queue.cc:237] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:19.070869  1627 tablet_copy_source_session.cc:215] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:19.081915  7028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 499cf87d55ba434fa03c7cf6c1bb54c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:19.096536  7023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d92e33e89814e86abdebb8b54a3a5c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:19.112711  1688 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:59:19.113678  1507 consensus_peers.cc:597] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 03a87bdd56034cbaa09fbc461a7bd313. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:19.114675  6968 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:19.117900  1612 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:59:19.120707  7013 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:19.146570  7012 raft_consensus.cc:2955] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:19.148238  1688 raft_consensus.cc:2955] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:19.153205  1608 raft_consensus.cc:2955] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:19.177496  7028 tablet_copy_client.cc:806] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:19.182592  7023 tablet_copy_client.cc:806] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:19.183432  7023 tablet_copy_client.cc:670] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:19.182341  7028 tablet_copy_client.cc:670] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:19.184439  1438 catalog_manager.cc:5697] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 14 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:19.191684  7023 tablet_copy_client.cc:538] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:19.202207  7028 tablet_copy_client.cc:538] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:19.219646  7028 tablet_bootstrap.cc:492] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:59:19.226760  7023 tablet_bootstrap.cc:492] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:59:19.432279  7023 tablet_bootstrap.cc:492] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:19.433676  7023 tablet_bootstrap.cc:492] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:59:19.434502  7023 ts_tablet_manager.cc:1403] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 0.208s	user 0.030s	sys 0.014s
I20260709 12:59:19.436569  7038 ts_tablet_manager.cc:933] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903)
I20260709 12:59:19.443099  7023 raft_consensus.cc:359] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:19.444022  7023 raft_consensus.cc:740] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:59:19.452888  7028 tablet_bootstrap.cc:492] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:19.453974  7028 tablet_bootstrap.cc:492] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:59:19.460172  7023 consensus_queue.cc:260] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:19.469632  7028 ts_tablet_manager.cc:1403] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 0.250s	user 0.042s	sys 0.048s
I20260709 12:59:19.469619  7038 tablet_copy_client.cc:323] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43903
I20260709 12:59:19.484663  1550 tablet_copy_service.cc:140] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Received BeginTabletCopySession request for tablet 42248b4b3b744072a3581db8c3874c55 from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:42356)
I20260709 12:59:19.485280  1550 tablet_copy_service.cc:161] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Beginning new tablet copy session on tablet 42248b4b3b744072a3581db8c3874c55 from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:42356: session id = 1d6516ff61104bdda54bde95e92fe579-42248b4b3b744072a3581db8c3874c55
I20260709 12:59:19.481985  7028 raft_consensus.cc:359] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:19.490411  7028 raft_consensus.cc:740] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:59:19.491119  7028 consensus_queue.cc:260] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:19.498021  7023 ts_tablet_manager.cc:1434] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.001s
I20260709 12:59:19.500528  1551 tablet_copy_service.cc:342] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-7d92e33e89814e86abdebb8b54a3a5c5 received from {username='slave'} at 127.0.0.1:42356
I20260709 12:59:19.501031  1551 tablet_copy_service.cc:434] P dbe6a89d0e1c4137b3a1b17bf4b520d8: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-7d92e33e89814e86abdebb8b54a3a5c5 on tablet 7d92e33e89814e86abdebb8b54a3a5c5 with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:19.504400  7028 ts_tablet_manager.cc:1434] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:59:19.505163  1550 tablet_copy_source_session.cc:215] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:19.514365  1627 tablet_copy_service.cc:342] P c262eac7fc904ae9bb91e450f6532e3f: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-499cf87d55ba434fa03c7cf6c1bb54c8 received from {username='slave'} at 127.0.0.1:58006
I20260709 12:59:19.514847  1627 tablet_copy_service.cc:434] P c262eac7fc904ae9bb91e450f6532e3f: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-499cf87d55ba434fa03c7cf6c1bb54c8 on tablet 499cf87d55ba434fa03c7cf6c1bb54c8 with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:19.515695  7038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42248b4b3b744072a3581db8c3874c55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:19.528234  7028 ts_tablet_manager.cc:933] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903)
I20260709 12:59:19.538116  2301 raft_consensus.cc:1217] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
I20260709 12:59:19.544205  7028 tablet_copy_client.cc:323] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43903
I20260709 12:59:19.546831  1550 tablet_copy_service.cc:140] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Received BeginTabletCopySession request for tablet 03a87bdd56034cbaa09fbc461a7bd313 from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:42356)
I20260709 12:59:19.547394  1550 tablet_copy_service.cc:161] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Beginning new tablet copy session on tablet 03a87bdd56034cbaa09fbc461a7bd313 from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:42356: session id = 1d6516ff61104bdda54bde95e92fe579-03a87bdd56034cbaa09fbc461a7bd313
I20260709 12:59:19.561964   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:19.597612  7038 tablet_copy_client.cc:806] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:19.598318  7038 tablet_copy_client.cc:670] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:19.620342  7038 tablet_copy_client.cc:538] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:19.636037  7038 tablet_bootstrap.cc:492] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:59:19.685168  1550 tablet_copy_source_session.cc:215] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:19.689208  7028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03a87bdd56034cbaa09fbc461a7bd313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:19.771600  7028 tablet_copy_client.cc:806] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:19.772708  7028 tablet_copy_client.cc:670] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:19.785130  7028 tablet_copy_client.cc:538] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:59:19.806012  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 49175.8us
I20260709 12:59:19.822988  1537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:47506
I20260709 12:59:19.823621  1537 raft_consensus.cc:606] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Received request to transfer leadership to TS c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:19.826192  1688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "920d24d01316479692fb62f167beb41e"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:54400
I20260709 12:59:19.826798  1688 raft_consensus.cc:606] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:19.833402  1612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:19.834048  1612 raft_consensus.cc:606] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 20 LEADER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:19.843590  1615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:19.844182  1615 raft_consensus.cc:606] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:19.852212  7028 tablet_bootstrap.cc:492] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:59:19.862421   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:59:19.864137   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:19.890164  6974 raft_consensus.cc:993] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d: : Instructing follower dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:19.890877  7017 raft_consensus.cc:1081] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Signalling peer dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:19.893362  1542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "920d24d01316479692fb62f167beb41e"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:51512
I20260709 12:59:19.893929  1542 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:19.894310  1542 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:19.895994  7038 tablet_bootstrap.cc:492] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:19.897152  7038 tablet_bootstrap.cc:492] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:59:19.897990  7038 ts_tablet_manager.cc:1403] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 0.262s	user 0.039s	sys 0.006s
I20260709 12:59:19.901364  7038 raft_consensus.cc:359] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:19.902365  7038 raft_consensus.cc:740] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:59:19.905515  1542 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:19.906994  6965 raft_consensus.cc:993] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8: : Instructing follower c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:19.907544  7013 raft_consensus.cc:1081] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Signalling peer c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:19.909348  1612 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:49296
I20260709 12:59:19.909911  1612 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:19.910305  1612 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:19.912364  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:19.912387  1542 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:19.912997  1615 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:19.913789  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:19.914352  1688 raft_consensus.cc:3055] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:59:19.914624  1688 raft_consensus.cc:740] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:19.915364  1688 consensus_queue.cc:260] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:19.920841  7015 raft_consensus.cc:993] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:19.921384  7015 raft_consensus.cc:1081] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:19.924206  1682 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50708
I20260709 12:59:19.924854  1682 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:19.925309  1682 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:19.920753  1688 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:19.903059  7038 consensus_queue.cc:260] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:19.924399  1612 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:19.978008  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:19.978761  1687 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:19.979969  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:19.980636  1537 raft_consensus.cc:3055] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:19.980927  1537 raft_consensus.cc:740] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:19.981129  2301 raft_consensus.cc:1217] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.7->[11.8-11.8]   Dedup: 11.8->[]
I20260709 12:59:19.981703  1537 consensus_queue.cc:260] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:19.983405  1537 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:19.985116  1688 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 19.
I20260709 12:59:19.986428  1508 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:19.987388  7013 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:59:19.987883  7013 raft_consensus.cc:697] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:19.988741  7013 consensus_queue.cc:237] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:19.983486  7038 ts_tablet_manager.cc:1434] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.085s	user 0.008s	sys 0.000s
I20260709 12:59:20.020095  1550 tablet_copy_service.cc:342] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-42248b4b3b744072a3581db8c3874c55 received from {username='slave'} at 127.0.0.1:42356
I20260709 12:59:20.020606  1550 tablet_copy_service.cc:434] P dbe6a89d0e1c4137b3a1b17bf4b520d8: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-42248b4b3b744072a3581db8c3874c55 on tablet 42248b4b3b744072a3581db8c3874c55 with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:20.024608  1612 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:20.027053  1537 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 12:59:20.027763  1687 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 12:59:20.028013  1615 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 19.
I20260709 12:59:20.029042  1691 raft_consensus.cc:1240] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:59:20.029647  1682 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:20.032025  1581 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:20.032881  7020 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:20.033422  7020 raft_consensus.cc:697] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:20.034483  7020 consensus_queue.cc:237] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:20.046772  1682 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:20.047645  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:20.049183  1615 raft_consensus.cc:3055] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:59:20.049295  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:20.049578  1615 raft_consensus.cc:740] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:20.049981  1537 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:20.056604  1615 consensus_queue.cc:260] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:20.148351  1615 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:20.138545  1438 catalog_manager.cc:5697] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 18 to 19, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 19 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:20.141163  1537 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 12:59:20.157169  1615 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 12:59:20.192405  1655 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:20.198459  6974 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:59:20.211517  6974 raft_consensus.cc:697] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:20.212647  6974 consensus_queue.cc:237] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:20.244401  1439 catalog_manager.cc:5697] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 15 to 16, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 16 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:20.298623  7028 tablet_bootstrap.cc:492] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:59:20.331013  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 157082us
I20260709 12:59:20.413913  7028 tablet_bootstrap.cc:492] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:59:20.417338  7028 ts_tablet_manager.cc:1403] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 0.566s	user 0.035s	sys 0.023s
W20260709 12:59:20.543115  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 80848.8us
I20260709 12:59:20.558147  7028 raft_consensus.cc:359] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:20.559121  7028 raft_consensus.cc:740] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:59:20.559791  7028 consensus_queue.cc:260] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
W20260709 12:59:20.564888  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 92742.3us
I20260709 12:59:20.567016  7028 ts_tablet_manager.cc:1434] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.149s	user 0.003s	sys 0.003s
W20260709 12:59:20.581053  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 205143us
I20260709 12:59:20.557189  7059 raft_consensus.cc:1064] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:59:20.638032  1550 tablet_copy_service.cc:342] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-03a87bdd56034cbaa09fbc461a7bd313 received from {username='slave'} at 127.0.0.1:42356
W20260709 12:59:20.683663  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 113964us
I20260709 12:59:20.675218  1550 tablet_copy_service.cc:434] P dbe6a89d0e1c4137b3a1b17bf4b520d8: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-03a87bdd56034cbaa09fbc461a7bd313 on tablet 03a87bdd56034cbaa09fbc461a7bd313 with peer 1d6516ff61104bdda54bde95e92fe579
W20260709 12:59:20.695165  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 48004.4us
W20260709 12:59:20.757323  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 45244.8us
I20260709 12:59:20.763695  2301 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 15 LEARNER]: Advancing to term 16
W20260709 12:59:20.771555  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 69504.6us
W20260709 12:59:20.775233  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 128700us
I20260709 12:59:20.775585  1608 raft_consensus.cc:1275] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:59:20.779022  1538 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:59:20.778918  7075 log.cc:927] Time spent T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:59:20.796904  2301 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEARNER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:59:20.872011  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 161441us
W20260709 12:59:20.930414  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 245959us
W20260709 12:59:20.980176  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 48223.5us
I20260709 12:59:20.981662  7088 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:59:20.986292  7059 consensus_queue.cc:237] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:20.987841  7048 raft_consensus.cc:993] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:20.988392  7048 raft_consensus.cc:1081] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 20 LEADER]: Signalling peer dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:20.986124  7071 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
W20260709 12:59:21.002280  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 171712us
W20260709 12:59:21.047961  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 44894.9us
I20260709 12:59:21.048652  6837 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:21.072082  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54360
I20260709 12:59:21.072782  1616 raft_consensus.cc:606] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Received request to transfer leadership
W20260709 12:59:21.081063  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 74005.4us
W20260709 12:59:21.093974  1508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.019s	sys 0.043s
W20260709 12:59:21.094437  1508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.020s	sys 0.044s
W20260709 12:59:21.094689  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 622505us
I20260709 12:59:21.121568  1612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54360
I20260709 12:59:21.122229  1612 raft_consensus.cc:606] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Received request to transfer leadership
W20260709 12:59:21.135273  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 131839us
I20260709 12:59:21.179648  7092 raft_consensus.cc:1064] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:59:21.188612  1438 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54582 (request call id 203) took 1149 ms. Trace:
I20260709 12:59:21.097995   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:21.190861  7079 raft_consensus.cc:1064] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
W20260709 12:59:21.191390  7079 raft_consensus.cc:1068] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f: Unable to promote non-voter 1d6516ff61104bdda54bde95e92fe579: Service unavailable: leader transfer in progress
W20260709 12:59:21.172354  1424 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 42248b4b3b744072a3581db8c3874c55 already in progress [suppressed 16 similar messages]
I20260709 12:59:21.208986  7092 consensus_queue.cc:237] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:59:21.234160  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 132539us
I20260709 12:59:21.242513  1614 raft_consensus.cc:1275] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:59:21.247229  7063 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:21.255681  1537 raft_consensus.cc:1275] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:59:21.270236  1538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:51500
I20260709 12:59:21.273387  1691 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:59:21.270812  1538 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:21.285710  1538 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:59:21.279735  1437 catalog_manager.cc:5697] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 17 to 18, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 18 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:21.189102  1438 rpcz_store.cc:276] 0709 12:59:20.039670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.039819 (+   149us) service_pool.cc:224] Handling call
0709 12:59:21.188517 (+1148698us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:20.362267 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:20.362944 (+   677us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:20.362996 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:59:20.363029 (+    33us) tablet.cc:662] Decoding operations
0709 12:59:20.363430 (+   401us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:20.363521 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:20.363568 (+    47us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:20.363805 (+   237us) tablet.cc:701] Row locks acquired
0709 12:59:20.363828 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:59:20.364014 (+   186us) write_op.cc:270] Start()
0709 12:59:20.364157 (+   143us) write_op.cc:276] Timestamp: P: 1783601960363945 usec, L: 0
0709 12:59:20.364187 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:59:20.437048 (+ 72861us) log.cc:844] Serialized 541 byte log entry
0709 12:59:20.783534 (+346486us) op_driver.cc:464] REPLICATION: finished
0709 12:59:20.915616 (+132082us) write_op.cc:301] APPLY: starting
0709 12:59:20.915825 (+   209us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:20.975862 (+ 60037us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:20.990723 (+ 14861us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:21.073300 (+ 82577us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:21.073509 (+   209us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:59:21.073558 (+    49us) write_op.cc:312] APPLY: finished
0709 12:59:21.073749 (+   191us) log.cc:844] Serialized 25 byte log entry
0709 12:59:21.073956 (+   207us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:21.074046 (+    90us) write_op.cc:454] Released schema lock
0709 12:59:21.074085 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:21.074506 (+   421us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:21.074532 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":18793,"reported_tablets":2,"spinlock_wait_cycles":33024,"child_traces":[["op",{"apply.queue_time_us":128650,"apply.run_cpu_time_us":4550,"apply.run_wall_time_us":158867,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8309,"mutex_wait_us":503,"num_ops":1,"prepare.queue_time_us":192259,"prepare.run_cpu_time_us":15122,"prepare.run_wall_time_us":202487,"raft.queue_time_us":147412,"raft.run_cpu_time_us":7038,"raft.run_wall_time_us":178994,"replication_time_us":404912,"thread_start_us":389317,"threads_started":4,"wal-append.queue_time_us":129008}]]}
I20260709 12:59:21.282577  7089 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
W20260709 12:59:21.302450  1424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 130149us
I20260709 12:59:21.348605  1538 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:59:21.349857  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 46353us
I20260709 12:59:21.364784  1538 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:21.376385  1538 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 20. Current term is 21. Ops: []
I20260709 12:59:21.386610  2300 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 11 LEARNER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:59:21.389310  7104 log.cc:927] Time spent T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 12:59:21.394876  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 52322.4us
I20260709 12:59:21.405949  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:21.406579  1608 raft_consensus.cc:3055] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:59:21.406858  1608 raft_consensus.cc:740] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:21.407640  1608 consensus_queue.cc:260] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:21.324331  7047 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:59:21.411563  1613 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:59:21.422499  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:54360
I20260709 12:59:21.423565  1616 raft_consensus.cc:606] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Received request to transfer leadership
I20260709 12:59:21.429445  1608 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:59:21.426332  7050 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:59:21.438105  1682 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:59:21.444514  1608 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 12:59:21.460918  7100 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:59:21.468542  1686 raft_consensus.cc:1275] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:59:21.490003  1687 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:59:21.498078  7077 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:21.507068  7062 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:21.508199  7107 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:21.513537  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:21.514149  1690 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:59:21.546613  2301 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEARNER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:59:21.559064  1505 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:21.564536  2301 raft_consensus.cc:1217] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.9->[14.10-14.10]   Dedup: 14.10->[]
I20260709 12:59:21.582082  7057 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:59:21.582444  7006 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.583884  7006 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:21.585318  7062 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:21.588238  7006 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:21.590483  7103 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:21.591406  7103 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:21.594259  7103 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:21.594362  1541 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:59:21.625547  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:21.629514  1690 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 12:59:21.630698  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:21.635862  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:21.633857  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:21.628768  7057 raft_consensus.cc:697] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:21.655184  7085 raft_consensus.cc:993] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
W20260709 12:59:21.686877  1488 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:59:21.687388  1488 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 42248b4b3b744072a3581db8c3874c55 already in progress
W20260709 12:59:21.687726  1488 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 42248b4b3b744072a3581db8c3874c55 already in progress
I20260709 12:59:21.694734  7020 raft_consensus.cc:1081] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Signalling peer dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
W20260709 12:59:21.713197  7120 log.cc:927] Time spent T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 12:59:21.753060  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 71993.8us
I20260709 12:59:21.758302  1542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:51500
I20260709 12:59:21.770841  7124 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:59:21.793855  7057 consensus_queue.cc:237] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:21.815456  1542 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:21.816334  1542 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:59:21.833308  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 170070us
I20260709 12:59:21.840107  7106 raft_consensus.cc:2955] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 12:59:21.849804  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 53105.4us
I20260709 12:59:21.874768  7041 raft_consensus.cc:1064] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
W20260709 12:59:21.915302  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 82144.3us
W20260709 12:59:21.915448  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 62967.2us
W20260709 12:59:21.917213  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 44620.4us
I20260709 12:59:21.925820  1542 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:21.927119  1541 raft_consensus.cc:1240] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 16. Current term is 17. Ops: []
W20260709 12:59:21.928795  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 93620.8us
I20260709 12:59:21.929832  1654 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:21.930961  1654 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:21.931500  7041 consensus_queue.cc:237] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:59:21.932933  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 56309.7us
I20260709 12:59:21.933843  7091 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:21.938921  1683 raft_consensus.cc:2955] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:21.965147  1542 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:59:21.976616  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 57242.2us
W20260709 12:59:21.989818  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 71276.4us
I20260709 12:59:21.993584  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:21.981400  7052 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:22.024444  2301 raft_consensus.cc:2955] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 12:59:22.044332  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 51935.7us
W20260709 12:59:22.057264  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 79828.2us
I20260709 12:59:22.070497  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:59:22.078423  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 98003.9us
I20260709 12:59:22.071156  7083 raft_consensus.cc:1064] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:59:22.084235  1614 raft_consensus.cc:2955] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 12:59:22.124958  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 132783us
I20260709 12:59:22.072654  7127 consensus_queue.cc:1059] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.049s
W20260709 12:59:22.160457  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 44599.6us
W20260709 12:59:22.178105  7134 log.cc:927] Time spent T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
W20260709 12:59:22.225847  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 64459.6us
I20260709 12:59:22.266188  1616 raft_consensus.cc:3055] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:22.266649  1616 raft_consensus.cc:740] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:22.267557  1616 consensus_queue.cc:260] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:22.274322  7050 raft_consensus.cc:2955] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:22.287029  1616 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:22.319101  1616 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 17.
W20260709 12:59:22.330435  7099 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 12:59:22.332962  1683 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:59:22.334590  2301 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 14 LEARNER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:59:22.336105  7041 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:22.343057  1505 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:22.344774  1537 raft_consensus.cc:2955] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:22.352635  7148 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:22.353068  1615 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:59:22.353703  7145 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:59:22.358296  7145 raft_consensus.cc:697] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:22.374583  1439 catalog_manager.cc:5697] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 11 to 12, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:22.359354  7145 consensus_queue.cc:237] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:22.398983  2301 raft_consensus.cc:2955] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:22.419281  1687 raft_consensus.cc:2955] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:22.427059   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:59:22.463150  7083 raft_consensus.cc:1068] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f: Unable to promote non-voter 1d6516ff61104bdda54bde95e92fe579: Illegal state: Replica c262eac7fc904ae9bb91e450f6532e3f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:22.489229  7108 raft_consensus.cc:2955] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:22.513238  1688 raft_consensus.cc:2955] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:22.534173  1614 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:59:22.553124  1687 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:59:22.562958  7065 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:22.564435  7143 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:59:22.580909  7107 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:59:22.592886  1438 catalog_manager.cc:5697] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 20 to 21, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 21 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:22.611044  2297 raft_consensus.cc:2955] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:22.652606  1612 raft_consensus.cc:2955] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:22.793815  1437 catalog_manager.cc:5697] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: config changed from index 8 to 9, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:22.835460  1437 catalog_manager.cc:5697] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:22.839635  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:22.840343  1614 raft_consensus.cc:606] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:22.845409  1686 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:54400
I20260709 12:59:22.846021  1686 raft_consensus.cc:606] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:22.896337  1615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7634482da3645aeb7462251e5df3726"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:22.896978  1615 raft_consensus.cc:606] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 21 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:22.908022  1533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:47506
I20260709 12:59:22.908682  1533 raft_consensus.cc:606] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Received request to transfer leadership to TS c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:22.910089   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:59:22.911785   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:22.921938  1439 catalog_manager.cc:5697] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 16 to 17, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 17 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:22.931216  1424 catalog_manager.cc:4755] TS c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): ChangeConfig:REMOVE_PEER RPC failed for tablet 499cf87d55ba434fa03c7cf6c1bb54c8: Remote error: Service unavailable: leader transfer in progress
I20260709 12:59:22.946960  6837 raft_consensus.cc:993] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:22.947499  6837 raft_consensus.cc:1081] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 21 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:22.948549  1533 consensus_queue.cc:237] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:22.949185  1688 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7634482da3645aeb7462251e5df3726"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50708
I20260709 12:59:22.949779  1688 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:22.950138  1688 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:59:22.958827  1616 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:59:22.956225  2297 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:59:22.962052  7139 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:59:22.966787  7106 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:59:22.969025  1612 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:59:22.969617  7108 raft_consensus.cc:2955] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:22.970994  7057 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:59:22.978801  2297 raft_consensus.cc:2955] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:23.001624  1688 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:23.008172  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7d92e33e89814e86abdebb8b54a3a5c5 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:23.009497  1686 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:23.015836  1437 catalog_manager.cc:5697] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 12 to 13, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New cstate: current_term: 16 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:23.037122  2297 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEARNER]: Advancing to term 17
I20260709 12:59:23.039351  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:23.039968  1539 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:59:23.044142  2297 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEARNER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:59:23.048492  7057 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:59:23.053896  1672 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d92e33e89814e86abdebb8b54a3a5c5 with delete_type TABLET_DATA_TOMBSTONED (TS 4487a53c51be4634bf1ef29c5248353d not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:50688
I20260709 12:59:23.067214  1539 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 22.
I20260709 12:59:23.068804  7165 tablet_replica.cc:333] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 12:59:23.069209  1655 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:23.069900  7165 raft_consensus.cc:2243] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:23.070009  7103 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:59:23.070601  7103 raft_consensus.cc:697] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 22 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:23.070849  7165 raft_consensus.cc:2272] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:23.071496  7103 consensus_queue.cc:237] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:23.085202  7057 raft_consensus.cc:1064] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:59:23.088696  7057 consensus_queue.cc:237] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 12, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:23.095214  1688 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:23.110726  1686 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:59:23.134900  7089 raft_consensus.cc:993] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d: : Instructing follower dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:23.135392  7089 raft_consensus.cc:1081] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Signalling peer dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:23.144222  7165 ts_tablet_manager.cc:1916] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:23.151661  2301 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEARNER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:59:23.144335  1533 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:51512
I20260709 12:59:23.166756  7139 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:59:23.166878  1533 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:23.169605  1533 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:23.172519  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:23.173251  1616 raft_consensus.cc:3055] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:59:23.173612  1616 raft_consensus.cc:740] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:23.174412  1616 consensus_queue.cc:260] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:23.175702  1616 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:59:23.175784  7048 raft_consensus.cc:993] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:23.194847  1614 raft_consensus.cc:2955] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:23.195871  7048 raft_consensus.cc:1081] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Signalling peer dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:23.151976  1682 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:59:23.200125  1542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:51500
I20260709 12:59:23.200757  1542 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:23.201128  1542 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:23.204156  7108 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:23.181967  1533 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:59:23.190469  1439 catalog_manager.cc:5697] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 21 to 22, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 22 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:23.194260  1617 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:59:23.215390  1533 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:23.217406  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:23.218142  1686 raft_consensus.cc:3055] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:59:23.218557  1686 raft_consensus.cc:740] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:23.218838  1539 consensus_queue.cc:237] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:23.219400  1686 consensus_queue.cc:260] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:59:23.220917  1686 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:23.235077  1542 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:23.233927  7108 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:59:23.240242  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:23.240906  1617 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:23.246764  2301 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:59:23.250852  1617 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 18.
I20260709 12:59:23.252677  7108 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:59:23.255506  7107 raft_consensus.cc:2955] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 11 to 14, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:23.262125  7065 raft_consensus.cc:2955] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:23.268778  2301 raft_consensus.cc:2955] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:23.270861  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:23.271467  2297 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:23.281785  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:23.282436  1688 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:23.284121  2297 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 12:59:23.286782  1616 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 22.
I20260709 12:59:23.291677  1688 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 12:59:23.296327  1542 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:23.301460  1683 raft_consensus.cc:2955] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 11 to 14, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:23.339329  1682 raft_consensus.cc:1240] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:23.342306  7048 consensus_queue.cc:1059] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:23.343441  7050 raft_consensus.cc:3055] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:23.343804  7050 raft_consensus.cc:740] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:23.344676  7050 consensus_queue.cc:260] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:23.346014  7050 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:23.346738  1508 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:23.347769  7108 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:23.349345  7108 raft_consensus.cc:697] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:23.349148  2297 raft_consensus.cc:2955] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 11 to 14, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:23.352025  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 03a87bdd56034cbaa09fbc461a7bd313 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:23.324205  1437 catalog_manager.cc:5697] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 11 to 12, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New cstate: current_term: 14 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:23.325198  1505 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:23.324862  1609 raft_consensus.cc:2955] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 11 to 14, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:23.325920  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:23.354166  7057 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:59:23.355285  7057 raft_consensus.cc:697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:23.356215  7057 consensus_queue.cc:237] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } }
I20260709 12:59:23.351411  1686 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 18.
I20260709 12:59:23.322971  1616 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:59:23.330137  7165 ts_tablet_manager.cc:1929] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.12
I20260709 12:59:23.361647  7165 log.cc:1199] T 7d92e33e89814e86abdebb8b54a3a5c5 P 4487a53c51be4634bf1ef29c5248353d: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-2-root/wals/7d92e33e89814e86abdebb8b54a3a5c5
I20260709 12:59:23.373117  1672 tablet_service.cc:1558] Processing DeleteTablet for tablet 03a87bdd56034cbaa09fbc461a7bd313 with delete_type TABLET_DATA_TOMBSTONED (TS 4487a53c51be4634bf1ef29c5248353d not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:50688
I20260709 12:59:23.377048  7165 tablet_replica.cc:333] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 12:59:23.350373  7108 consensus_queue.cc:237] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:23.378780  1427 catalog_manager.cc:5028] TS 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): tablet 7d92e33e89814e86abdebb8b54a3a5c5 (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:59:23.381531  1439 catalog_manager.cc:5697] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index 11 to 14, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:23.387754  7106 raft_consensus.cc:993] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8: : Instructing follower c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:23.388339  7106 raft_consensus.cc:1081] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Signalling peer c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:23.401769  7165 raft_consensus.cc:2243] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:23.402801  7165 raft_consensus.cc:2272] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:23.407491  7165 ts_tablet_manager.cc:1916] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:23.416352  7065 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:23.425695  1617 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 12:59:23.521055  1617 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:49296
I20260709 12:59:23.521705  1617 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:23.522101  1617 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:23.527036  1612 raft_consensus.cc:2955] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:23.537348  1539 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:59:23.540588  7103 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:59:23.545012  1424 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 499cf87d55ba434fa03c7cf6c1bb54c8 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER failed with leader c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica c262eac7fc904ae9bb91e450f6532e3f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:23.556427  7165 ts_tablet_manager.cc:1929] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.11
I20260709 12:59:23.557181  7165 log.cc:1199] T 03a87bdd56034cbaa09fbc461a7bd313 P 4487a53c51be4634bf1ef29c5248353d: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-2-root/wals/03a87bdd56034cbaa09fbc461a7bd313
I20260709 12:59:23.551151  1617 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:23.558802  1427 catalog_manager.cc:5028] TS 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): tablet 03a87bdd56034cbaa09fbc461a7bd313 (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:59:23.566665  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:23.567341  1542 raft_consensus.cc:3055] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:23.567631  1542 raft_consensus.cc:740] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:23.568377  1542 consensus_queue.cc:260] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:23.569468  1542 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:23.576538  1616 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:59:23.581003  1617 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:23.582062  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:23.582732  1688 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:23.587047  1439 catalog_manager.cc:5697] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 11 to 12, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:23.590498  1439 catalog_manager.cc:5697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 17 to 18, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 18 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:23.594324  1688 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 12:59:23.597720  1583 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:23.586978  1542 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 12:59:23.599810  7048 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:59:23.600488  7048 raft_consensus.cc:697] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:23.601557  7055 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:59:23.601677  7048 consensus_queue.cc:237] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:23.682353  1438 catalog_manager.cc:5697] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 16 to 17, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 17 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:23.705022  7157 log.cc:927] Time spent T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.082s	user 0.008s	sys 0.006s
W20260709 12:59:23.704674  7171 log.cc:927] Time spent T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.093s	user 0.000s	sys 0.003s
I20260709 12:59:23.717020  1539 consensus_queue.cc:237] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:23.720180  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51498
I20260709 12:59:23.720847  1541 raft_consensus.cc:606] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 LEADER]: Received request to transfer leadership
I20260709 12:59:23.727978  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51498
I20260709 12:59:23.728749  1541 raft_consensus.cc:606] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 LEADER]: Received request to transfer leadership
I20260709 12:59:23.728116  2297 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:59:23.731990  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51498
I20260709 12:59:23.732628  7107 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:59:23.733382  1541 raft_consensus.cc:606] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 LEADER]: Received request to transfer leadership
I20260709 12:59:23.742694  7108 raft_consensus.cc:2955] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Committing config change with OpId 17.15: config changed from index 14 to 15, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:23.765097  2297 raft_consensus.cc:2955] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Committing config change with OpId 17.15: config changed from index 14 to 15, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:23.771754  1682 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 12:59:23.773335  1488 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:59:23.773747  1488 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 499cf87d55ba434fa03c7cf6c1bb54c8 already in progress
W20260709 12:59:23.774051  1488 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 499cf87d55ba434fa03c7cf6c1bb54c8 already in progress
I20260709 12:59:23.774955  7057 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:59:23.782145  1682 raft_consensus.cc:2955] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Committing config change with OpId 17.15: config changed from index 14 to 15, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 12:59:23.740568  7170 log.cc:927] Time spent T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.153s	user 0.003s	sys 0.005s
I20260709 12:59:23.827399  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 42248b4b3b744072a3581db8c3874c55 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:23.838073  1438 catalog_manager.cc:5697] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index 14 to 15, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New cstate: current_term: 17 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:23.856683  1603 tablet_service.cc:1558] Processing DeleteTablet for tablet 42248b4b3b744072a3581db8c3874c55 with delete_type TABLET_DATA_TOMBSTONED (TS c262eac7fc904ae9bb91e450f6532e3f not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:54360
I20260709 12:59:23.868585  7179 tablet_replica.cc:333] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 12:59:23.878245  1617 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:59:23.881031  7108 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:23.885648  7179 raft_consensus.cc:2243] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:23.886708  7179 raft_consensus.cc:2272] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:23.893100  7179 ts_tablet_manager.cc:1916] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:23.917436  7179 ts_tablet_manager.cc:1929] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.14
I20260709 12:59:23.917918  7179 log.cc:1199] T 42248b4b3b744072a3581db8c3874c55 P c262eac7fc904ae9bb91e450f6532e3f: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-1-root/wals/42248b4b3b744072a3581db8c3874c55
I20260709 12:59:23.940181   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:24.064525  1688 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:59:24.071825  2297 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:59:24.077054  7145 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:24.082374  7012 raft_consensus.cc:993] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8: : Instructing follower c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:24.083467  7185 raft_consensus.cc:1081] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 LEADER]: Signalling peer c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:24.091244  1688 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:59:24.093559  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 53419us
I20260709 12:59:24.101117  1424 catalog_manager.cc:5028] TS c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): tablet 42248b4b3b744072a3581db8c3874c55 (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:59:24.116096  7012 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:24.122298  7012 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:24.135149  1542 raft_consensus.cc:1275] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:59:24.135458  1612 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:59:24.147854  7183 consensus_queue.cc:1048] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:24.149075  1612 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:49296
I20260709 12:59:24.150183  1612 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:24.160944  1612 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:24.299892  1612 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:24.315774  1613 raft_consensus.cc:1240] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:24.321028  7190 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:24.375150  1688 raft_consensus.cc:1275] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:59:24.382355  7050 consensus_queue.cc:1048] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:24.388257  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:24.388693  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:24.389202  1539 raft_consensus.cc:3055] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:24.389686  1539 raft_consensus.cc:740] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:24.389324  2301 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:24.390852  1539 consensus_queue.cc:260] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:24.392599  1539 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:24.400137  2301 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:59:24.403016  1612 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:24.427315  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:24.428007  1682 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:24.432576  1425 catalog_manager.cc:4755] TS dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): ChangeConfig:REMOVE_PEER RPC failed for tablet 499cf87d55ba434fa03c7cf6c1bb54c8: Remote error: Service unavailable: leader transfer in progress
I20260709 12:59:24.498883  1682 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:59:24.502673  1539 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:59:24.504421  1581 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:24.505491  7069 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:24.506076  7069 raft_consensus.cc:697] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:24.509661  7069 consensus_queue.cc:237] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:24.560686  1438 catalog_manager.cc:5697] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 12 to 13, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 13 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:24.953712  1541 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:59:24.962545  1614 consensus_queue.cc:237] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:24.965101  7050 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:59:24.971233  1424 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 499cf87d55ba434fa03c7cf6c1bb54c8 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER failed with leader c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:59:25.008046  1688 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:25.010315  7181 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:25.013161  1688 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:59:25.018290  7181 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:59:25.027946  1582 consensus_peers.cc:597] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: db011c2c8016405d968fe57a093fc111. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:25.043334  1533 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:25.050855  2301 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:59:25.055964  7183 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:25.065680  7181 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:59:25.173373  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 63276.3us
I20260709 12:59:25.185261  7048 raft_consensus.cc:2955] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:25.199642  1541 raft_consensus.cc:2955] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:25.206920  1688 raft_consensus.cc:2955] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:25.241039  1439 catalog_manager.cc:5697] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index -1 to 9, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 14 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:25.266073  1688 consensus_queue.cc:237] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:25.323596  1613 raft_consensus.cc:1275] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:59:25.323915  1541 raft_consensus.cc:1275] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 12:59:25.323928  1656 consensus_peers.cc:597] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa984c8881704e97b0d6a6eb60605021. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:25.325944  7218 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:25.329005  7213 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:25.431931  7103 raft_consensus.cc:2955] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:25.449152  1613 raft_consensus.cc:2955] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:25.482424  1541 raft_consensus.cc:2955] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Committing config change with OpId 15.8: config changed from index -1 to 8, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:25.485852  1542 consensus_queue.cc:237] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:25.509840  1439 catalog_manager.cc:5697] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index -1 to 8, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 15 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:25.552615  1613 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 12:59:25.554678  1507 consensus_peers.cc:597] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eabf19413eea44dd86511e07a036166b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:25.558801  7145 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:25.570077  1688 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:59:25.593454  7198 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:25.620620   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:59:25.657912  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 65404.5us
I20260709 12:59:25.662990  7190 raft_consensus.cc:2955] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:25.738785  1615 raft_consensus.cc:2955] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:25.769322  7232 ts_tablet_manager.cc:933] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:59:25.769915  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 100998us
I20260709 12:59:25.796025  1439 catalog_manager.cc:5697] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: config changed from index -1 to 12, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 17 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:25.809585  7237 ts_tablet_manager.cc:933] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:59:25.815110  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 69587.3us
I20260709 12:59:25.834544  1688 consensus_queue.cc:237] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:25.887354  1534 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:47506
I20260709 12:59:25.888113  1534 raft_consensus.cc:606] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Received request to transfer leadership to TS c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:25.893764  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:54400
I20260709 12:59:25.894515  1683 raft_consensus.cc:606] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Received request to transfer leadership to TS c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:59:25.895066  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 45165.8us
I20260709 12:59:25.900192  7232 tablet_copy_client.cc:323] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:41953
I20260709 12:59:25.915503  1613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:25.916276  1613 raft_consensus.cc:606] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:25.926741  1683 raft_consensus.cc:2955] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:25.939900  7218 raft_consensus.cc:993] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d: : Instructing follower c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:25.940524  7242 raft_consensus.cc:1081] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Signalling peer c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:25.942806  1613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:49312
I20260709 12:59:25.943409  1613 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:25.943776  1613 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:25.942349  1687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:54400
I20260709 12:59:25.947090  1687 raft_consensus.cc:606] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Received request to transfer leadership to TS c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:25.942490  7237 tablet_copy_client.cc:323] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45275
I20260709 12:59:25.954702  1701 tablet_copy_service.cc:140] P 4487a53c51be4634bf1ef29c5248353d: Received BeginTabletCopySession request for tablet aa984c8881704e97b0d6a6eb60605021 from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:33206)
I20260709 12:59:25.955384  1701 tablet_copy_service.cc:161] P 4487a53c51be4634bf1ef29c5248353d: Beginning new tablet copy session on tablet aa984c8881704e97b0d6a6eb60605021 from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:33206: session id = 1d6516ff61104bdda54bde95e92fe579-aa984c8881704e97b0d6a6eb60605021
I20260709 12:59:25.960409   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:59:25.967721   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:25.970460  1701 tablet_copy_source_session.cc:215] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:25.994884  7183 raft_consensus.cc:993] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:25.995420  7183 raft_consensus.cc:1081] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:26.003711  7237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa984c8881704e97b0d6a6eb60605021. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:59:26.016518  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 62930.7us
I20260709 12:59:26.018369  1627 tablet_copy_service.cc:140] P c262eac7fc904ae9bb91e450f6532e3f: Received BeginTabletCopySession request for tablet db011c2c8016405d968fe57a093fc111 from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:58006)
I20260709 12:59:26.018983  1627 tablet_copy_service.cc:161] P c262eac7fc904ae9bb91e450f6532e3f: Beginning new tablet copy session on tablet db011c2c8016405d968fe57a093fc111 from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:58006: session id = 1d6516ff61104bdda54bde95e92fe579-db011c2c8016405d968fe57a093fc111
I20260709 12:59:26.028116  1613 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:26.035940  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:26.035925  1682 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50708
I20260709 12:59:26.036695  1534 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:59:26.036979  1656 consensus_peers.cc:597] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3c62b87395ba4c3a9a99163b300d7ddf. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:26.036906  1682 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:26.043313  1682 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:26.049809  1615 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:59:26.048753  1616 consensus_queue.cc:237] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:26.050869  1534 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 12:59:26.052176  7236 raft_consensus.cc:993] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8: : Instructing follower c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:26.052354  1581 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:26.053205  7048 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:59:26.053438  7235 raft_consensus.cc:1081] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Signalling peer c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:26.054051  1613 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:26.056576  7217 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:26.060811  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:26.061546  1683 raft_consensus.cc:3055] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:26.061921  1683 raft_consensus.cc:740] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:26.053757  7048 raft_consensus.cc:697] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:26.063725  7048 consensus_queue.cc:237] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:26.064658  7218 raft_consensus.cc:993] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d: : Instructing follower c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:26.065167  7218 raft_consensus.cc:1081] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Signalling peer c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:26.067696  1615 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:49296
I20260709 12:59:26.068320  1615 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:26.068677  1615 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:26.070655  1617 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:49312
I20260709 12:59:26.071260  1617 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:26.071614  1617 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:26.076448  1541 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:59:26.062714  1683 consensus_queue.cc:260] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:26.080691  1683 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:26.081183  7189 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:26.084929  1688 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:59:26.087460  7183 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:26.095583  1615 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:26.096304  1627 tablet_copy_source_session.cc:215] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:26.098012  1615 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:26.099159  1682 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:26.102375  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:26.105955  1534 raft_consensus.cc:3055] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:26.106302  1534 raft_consensus.cc:740] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:26.106628  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:26.107290  2301 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:26.109294  1683 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 12:59:26.112604  1682 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:26.113757  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:26.114547  1615 raft_consensus.cc:3055] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:26.114921  1615 raft_consensus.cc:740] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:26.113853  1617 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:26.116505  1534 consensus_queue.cc:260] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:26.132028  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:26.134020  1617 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:26.128271  1615 consensus_queue.cc:260] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:26.137838  1539 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:26.139434  1534 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:26.139546  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:26.140146  1682 raft_consensus.cc:3055] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:59:26.140435  1682 raft_consensus.cc:740] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:26.145292  1682 consensus_queue.cc:260] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:26.145821  7232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db011c2c8016405d968fe57a093fc111. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:26.147265  1615 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:26.150156  1534 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:59:26.152730  2298 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:59:26.156858  1581 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:26.157856  7227 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:26.159497  1615 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 12:59:26.159890  7227 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:26.162164  7248 ts_tablet_manager.cc:933] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903)
I20260709 12:59:26.165952  1654 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:26.167795  7213 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:26.168331  7213 raft_consensus.cc:697] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:26.178570  2301 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:59:26.181213  1682 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:26.183928  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:26.184710  1535 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:26.160421  7227 raft_consensus.cc:697] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:26.189275  1539 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 12:59:26.195327  1535 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 12:59:26.222088  1682 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 12:59:26.234885  1439 catalog_manager.cc:5697] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 16 to 17, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 17 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:26.211004  7213 consensus_queue.cc:237] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:26.240104  1581 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:26.268765  7227 consensus_queue.cc:237] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:26.197515  7217 raft_consensus.cc:2955] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
W20260709 12:59:26.325600  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 58468.6us
I20260709 12:59:26.326213  7069 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:59:26.326773  7069 raft_consensus.cc:697] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:59:26.327458  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 92475.1us
I20260709 12:59:26.327800  7069 consensus_queue.cc:237] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:59:26.337476  7247 log.cc:927] Time spent T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:59:26.224010  7048 raft_consensus.cc:2955] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 9 to 12, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 12:59:26.342937  7246 log.cc:927] Time spent T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:59:26.342259  1541 raft_consensus.cc:2955] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:26.305931  7248 tablet_copy_client.cc:323] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43903
I20260709 12:59:26.354744  1688 raft_consensus.cc:2955] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 9 to 12, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 12:59:26.384011  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 144010us
W20260709 12:59:26.464605  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 94181.4us
W20260709 12:59:26.526199  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 101771us
I20260709 12:59:26.539716  7237 tablet_copy_client.cc:806] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:26.540514  7237 tablet_copy_client.cc:670] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:26.562635  7232 tablet_copy_client.cc:806] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:26.563405  7232 tablet_copy_client.cc:670] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
W20260709 12:59:26.530625  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 162799us
I20260709 12:59:26.587337  1439 catalog_manager.cc:5697] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 15 to 16, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 16 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:26.601362  1550 tablet_copy_service.cc:140] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Received BeginTabletCopySession request for tablet eabf19413eea44dd86511e07a036166b from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:42356)
I20260709 12:59:26.602029  1550 tablet_copy_service.cc:161] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Beginning new tablet copy session on tablet eabf19413eea44dd86511e07a036166b from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:42356: session id = 1d6516ff61104bdda54bde95e92fe579-eabf19413eea44dd86511e07a036166b
I20260709 12:59:26.610086  1438 catalog_manager.cc:5697] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 11 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:26.615047  1550 tablet_copy_source_session.cc:215] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:26.643760  1614 raft_consensus.cc:2955] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:26.644958  7248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eabf19413eea44dd86511e07a036166b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:26.649621  1424 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 499cf87d55ba434fa03c7cf6c1bb54c8 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 8)
I20260709 12:59:26.651100  2300 raft_consensus.cc:2955] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 9 to 12, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:26.672812  1439 catalog_manager.cc:5697] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 9 to 12, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New cstate: current_term: 13 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:26.675808  7232 tablet_copy_client.cc:538] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:59:26.682683  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 46653.6us
I20260709 12:59:26.688376  1532 tablet_service.cc:1558] Processing DeleteTablet for tablet 499cf87d55ba434fa03c7cf6c1bb54c8 with delete_type TABLET_DATA_TOMBSTONED (TS dbe6a89d0e1c4137b3a1b17bf4b520d8 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:51498
I20260709 12:59:26.705868  7237 tablet_copy_client.cc:538] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:26.715873  7232 tablet_bootstrap.cc:492] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:59:26.725610  1534 raft_consensus.cc:1275] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:59:26.736742  1688 raft_consensus.cc:1275] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:59:26.738981  7254 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:26.741091  7254 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:26.743106  7237 tablet_bootstrap.cc:492] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:59:26.744297  1438 catalog_manager.cc:5697] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 14 to 15, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 15 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:26.754820  1438 catalog_manager.cc:5697] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 18 to 19, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 19 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:26.762394  7275 tablet_replica.cc:333] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 12:59:26.763877  7275 raft_consensus.cc:2243] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:26.764994  7275 raft_consensus.cc:2272] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:26.768283  7275 ts_tablet_manager.cc:1916] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:26.788820  7276 ts_tablet_manager.cc:933] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:26.803901  1539 raft_consensus.cc:1275] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:59:26.819079  1613 raft_consensus.cc:1275] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:59:26.820755  7217 consensus_queue.cc:1048] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:26.834376  7252 consensus_queue.cc:1048] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:26.835687  1535 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:59:26.839509  2300 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:59:26.855644  1688 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:59:26.864768  7276 tablet_copy_client.cc:323] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45275
I20260709 12:59:26.868839  1701 tablet_copy_service.cc:140] P 4487a53c51be4634bf1ef29c5248353d: Received BeginTabletCopySession request for tablet 3c62b87395ba4c3a9a99163b300d7ddf from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:33206)
I20260709 12:59:26.869586  1701 tablet_copy_service.cc:161] P 4487a53c51be4634bf1ef29c5248353d: Beginning new tablet copy session on tablet 3c62b87395ba4c3a9a99163b300d7ddf from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:33206: session id = 1d6516ff61104bdda54bde95e92fe579-3c62b87395ba4c3a9a99163b300d7ddf
I20260709 12:59:26.872997  7214 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 12:59:26.874015  7227 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 12:59:26.887280  7048 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 12:59:26.937942  1541 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:59:26.941504  7048 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:59:26.968933   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:27.031188  1701 tablet_copy_source_session.cc:215] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:27.022930  7248 tablet_copy_client.cc:806] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:27.076393  7248 tablet_copy_client.cc:670] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:27.105432  7248 tablet_copy_client.cc:538] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:27.117053  7276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c62b87395ba4c3a9a99163b300d7ddf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:59:27.146337  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 51357.8us
W20260709 12:59:27.156667  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 69698.2us
W20260709 12:59:27.156569  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 59612.2us
I20260709 12:59:27.190224  7275 ts_tablet_manager.cc:1929] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.11
I20260709 12:59:27.205654  7248 tablet_bootstrap.cc:492] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:59:27.238792  7275 log.cc:1199] T 499cf87d55ba434fa03c7cf6c1bb54c8 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-0-root/wals/499cf87d55ba434fa03c7cf6c1bb54c8
I20260709 12:59:27.287708  1425 catalog_manager.cc:5028] TS dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): tablet 499cf87d55ba434fa03c7cf6c1bb54c8 (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:59:27.306849  7276 tablet_copy_client.cc:806] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:27.318032  7276 tablet_copy_client.cc:670] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:27.326152  7276 tablet_copy_client.cc:538] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:27.393563  7276 tablet_bootstrap.cc:492] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:59:27.412384  7232 tablet_bootstrap.cc:492] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:27.448737  7232 tablet_bootstrap.cc:492] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:59:27.453493  7232 ts_tablet_manager.cc:1403] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 0.738s	user 0.038s	sys 0.011s
I20260709 12:59:27.475329  7237 tablet_bootstrap.cc:492] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=1 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:27.478314  7237 tablet_bootstrap.cc:492] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:59:27.479314  7237 ts_tablet_manager.cc:1403] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 0.736s	user 0.050s	sys 0.062s
I20260709 12:59:27.487660  7232 raft_consensus.cc:359] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:27.488627  7232 raft_consensus.cc:740] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:59:27.504827  7237 raft_consensus.cc:359] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:27.489867  7232 consensus_queue.cc:260] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:27.505803  7237 raft_consensus.cc:740] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:59:27.515589  7232 ts_tablet_manager.cc:1434] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.048s	user 0.004s	sys 0.004s
I20260709 12:59:27.517683  1627 tablet_copy_service.cc:342] P c262eac7fc904ae9bb91e450f6532e3f: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-db011c2c8016405d968fe57a093fc111 received from {username='slave'} at 127.0.0.1:58006
I20260709 12:59:27.518185  1627 tablet_copy_service.cc:434] P c262eac7fc904ae9bb91e450f6532e3f: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-db011c2c8016405d968fe57a093fc111 on tablet db011c2c8016405d968fe57a093fc111 with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:27.506527  7237 consensus_queue.cc:260] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:27.578015  7237 ts_tablet_manager.cc:1434] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.098s	user 0.001s	sys 0.005s
I20260709 12:59:27.579985  1701 tablet_copy_service.cc:342] P 4487a53c51be4634bf1ef29c5248353d: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-aa984c8881704e97b0d6a6eb60605021 received from {username='slave'} at 127.0.0.1:33206
I20260709 12:59:27.580452  1701 tablet_copy_service.cc:434] P 4487a53c51be4634bf1ef29c5248353d: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-aa984c8881704e97b0d6a6eb60605021 on tablet aa984c8881704e97b0d6a6eb60605021 with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:27.597745  7248 tablet_bootstrap.cc:492] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:27.598827  7248 tablet_bootstrap.cc:492] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:59:27.599608  7248 ts_tablet_manager.cc:1403] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 0.395s	user 0.036s	sys 0.018s
I20260709 12:59:27.622853  7248 raft_consensus.cc:359] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:27.623713  7248 raft_consensus.cc:740] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:59:27.624336  7248 consensus_queue.cc:260] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:27.626804  7248 ts_tablet_manager.cc:1434] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260709 12:59:27.637717  1550 tablet_copy_service.cc:342] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-eabf19413eea44dd86511e07a036166b received from {username='slave'} at 127.0.0.1:42356
I20260709 12:59:27.638199  1550 tablet_copy_service.cc:434] P dbe6a89d0e1c4137b3a1b17bf4b520d8: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-eabf19413eea44dd86511e07a036166b on tablet eabf19413eea44dd86511e07a036166b with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:27.671027  7276 tablet_bootstrap.cc:492] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:27.672112  7276 tablet_bootstrap.cc:492] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:59:27.674181  7276 ts_tablet_manager.cc:1403] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 0.281s	user 0.034s	sys 0.011s
I20260709 12:59:27.680892  7276 raft_consensus.cc:359] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:27.688161  7276 raft_consensus.cc:740] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:59:27.689107  7276 consensus_queue.cc:260] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:27.696970  7276 ts_tablet_manager.cc:1434] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 12:59:27.698824  1701 tablet_copy_service.cc:342] P 4487a53c51be4634bf1ef29c5248353d: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-3c62b87395ba4c3a9a99163b300d7ddf received from {username='slave'} at 127.0.0.1:33206
I20260709 12:59:27.699282  1701 tablet_copy_service.cc:434] P 4487a53c51be4634bf1ef29c5248353d: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-3c62b87395ba4c3a9a99163b300d7ddf on tablet 3c62b87395ba4c3a9a99163b300d7ddf with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:27.805423  2301 raft_consensus.cc:1217] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.11->[17.12-17.12]   Dedup: 17.12->[]
I20260709 12:59:27.978555  2301 raft_consensus.cc:1217] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.7->[15.8-15.8]   Dedup: 15.8->[]
I20260709 12:59:28.093462  2301 raft_consensus.cc:1217] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.8->[14.9-14.9]   Dedup: 14.9->[]
I20260709 12:59:28.230388  2301 raft_consensus.cc:1217] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.9->[11.10-11.10]   Dedup: 11.10->[]
I20260709 12:59:28.293990   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:28.351307  7219 raft_consensus.cc:1064] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:59:28.354068  7219 consensus_queue.cc:237] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:28.375937  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22060ec6ef664a749065c3f00807b450"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:28.376854  1614 raft_consensus.cc:606] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:28.379968  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:47506
I20260709 12:59:28.380735  1541 raft_consensus.cc:606] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Received request to transfer leadership to TS c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:28.380961  2301 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEARNER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:59:28.383716  7236 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:59:28.385411  1685 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:59:28.387182  1614 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:59:28.387921  7272 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:59:28.392231  7236 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:59:28.395239  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:54400
I20260709 12:59:28.395910  1682 raft_consensus.cc:606] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:28.398993  1615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:28.399602  1615 raft_consensus.cc:606] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:28.409094  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:47506
I20260709 12:59:28.409752  1541 raft_consensus.cc:606] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 LEADER]: Received request to transfer leadership to TS c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:28.414780   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:28.419088   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:28.434556  7272 raft_consensus.cc:2955] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:28.440589  2301 raft_consensus.cc:2955] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:28.442883  1685 raft_consensus.cc:2955] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:28.485096  1614 raft_consensus.cc:2955] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:28.484153  1437 catalog_manager.cc:5697] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index 12 to 13, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:28.533376  7103 raft_consensus.cc:993] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d: : Instructing follower dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:28.533892  7273 raft_consensus.cc:1081] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Signalling peer dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:28.539117  1539 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:51512
I20260709 12:59:28.539737  1539 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:28.549943  1539 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:28.566766  7290 raft_consensus.cc:1064] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:59:28.569815  7290 consensus_queue.cc:237] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 7, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:28.572016  7213 raft_consensus.cc:1064] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:59:28.577380  7213 consensus_queue.cc:237] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 6, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:28.581126  1539 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:28.594684  1541 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:59:28.595947  2301 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 14 LEARNER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:59:28.597043  1685 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:59:28.601209  7297 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:28.603780  1539 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:28.605429  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:28.606112  1685 raft_consensus.cc:3055] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:28.606400  1685 raft_consensus.cc:740] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:28.607250  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:28.607899  1614 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:28.612227  1685 consensus_queue.cc:260] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:28.621243  1685 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:28.614791  1614 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:59:28.613139  7290 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:59:28.628283  1505 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:28.632793  7219 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:28.633353  7219 raft_consensus.cc:697] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:28.634223  7219 consensus_queue.cc:237] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:28.648177  1685 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:59:28.638366  7227 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:59:28.653764  1533 raft_consensus.cc:1275] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:59:28.654594  2301 raft_consensus.cc:1275] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 15 LEARNER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:59:28.657822  1614 raft_consensus.cc:1275] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:59:28.664232  7103 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:59:28.675676  7273 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:28.671837  1541 consensus_queue.cc:237] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:28.746168  7236 raft_consensus.cc:993] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8: : Instructing follower c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:28.747344  7236 raft_consensus.cc:1081] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Signalling peer c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:28.749861  1614 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:59:28.750718  1616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:49296
I20260709 12:59:28.751196  2300 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:59:28.751328  1616 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:28.752872  1616 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:28.683828  7258 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 12:59:28.776932  7268 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.099s
W20260709 12:59:28.883183  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 80602.5us
I20260709 12:59:28.935047  1616 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:28.941582  1616 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:59:29.036543  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 91308.3us
I20260709 12:59:29.102052  7334 raft_consensus.cc:993] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8: : Instructing follower c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:29.103823  7272 raft_consensus.cc:1081] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 LEADER]: Signalling peer c262eac7fc904ae9bb91e450f6532e3f to start an election
W20260709 12:59:29.112883  7317 log.cc:927] Time spent T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:59:28.944707  7320 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.159s
W20260709 12:59:29.148432  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 208937us
I20260709 12:59:29.152781  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:29.153416  1688 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:59:29.176898  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 238567us
W20260709 12:59:29.179075  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 128477us
I20260709 12:59:29.151222  7227 raft_consensus.cc:2955] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:29.213402  1688 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
W20260709 12:59:29.219036  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 169468us
W20260709 12:59:29.220016  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 250477us
I20260709 12:59:29.222913  1688 raft_consensus.cc:1240] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:59:29.236553  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:29.237165  1539 raft_consensus.cc:3055] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:29.237480  1539 raft_consensus.cc:740] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:29.238144  1539 consensus_queue.cc:260] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:29.239138  1539 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:29.251680  7332 raft_consensus.cc:993] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:29.252288  7332 raft_consensus.cc:1081] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:29.270680  1583 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:59:29.270949  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 332135us
I20260709 12:59:29.273878  7290 raft_consensus.cc:993] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:29.272135  1615 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:49296
I20260709 12:59:29.275142  1615 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:29.275520  1615 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:29.285226  1685 raft_consensus.cc:2955] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:29.290059  1682 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50708
I20260709 12:59:29.290767  1682 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:29.291261  1682 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:59:29.297638  7290 raft_consensus.cc:1081] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:29.291093  7256 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:59:29.316015  1539 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 12:59:29.319408  1687 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:59:29.323927  1686 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22060ec6ef664a749065c3f00807b450"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50708
I20260709 12:59:29.327503  7256 raft_consensus.cc:697] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:29.289328  1615 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:29.329156  2300 raft_consensus.cc:2955] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:29.368446  1686 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:29.372962  1686 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:29.374332  1615 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:29.374619  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:29.378685  7256 consensus_queue.cc:237] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:29.327602  1434 catalog_manager.cc:5697] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 13 to 14, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:29.379523  1687 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:29.399130  1687 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:59:29.411047  1583 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:29.373991  1682 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:29.404443  7236 raft_consensus.cc:2955] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:29.417642  7308 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:29.418355  7308 raft_consensus.cc:697] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:29.419284  7308 consensus_queue.cc:237] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:29.405239  7326 raft_consensus.cc:2955] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Committing config change with OpId 15.9: config changed from index 8 to 9, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:29.416258  1682 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:29.425298   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:29.412303  1688 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 22. Current term is 23. Ops: []
I20260709 12:59:29.435514  7342 consensus_queue.cc:1059] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 22.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:29.436664  7297 raft_consensus.cc:3055] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:59:29.437076  7297 raft_consensus.cc:740] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:29.437409  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:29.438055  7297 consensus_queue.cc:260] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.10, Last appended by leader: 10, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:29.439319  7297 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:59:29.438839  1439 catalog_manager.cc:5697] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 9 to 10, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 12:59:29.446944  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 46331.9us
I20260709 12:59:29.448180  2300 raft_consensus.cc:2955] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:29.465495  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:29.466171  1542 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:59:29.449694  1535 raft_consensus.cc:2955] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:29.452978  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:29.468629  1539 raft_consensus.cc:3055] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:29.469027  1539 raft_consensus.cc:740] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:29.469766  1539 consensus_queue.cc:260] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:29.470718  1539 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:29.480456  1542 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 23.
I20260709 12:59:29.492149  1539 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:59:29.498227  1686 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:29.500515  1686 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:29.501684  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:29.502493  1612 raft_consensus.cc:3055] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:29.502877  1612 raft_consensus.cc:740] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:29.503692  1612 consensus_queue.cc:260] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:59:29.507982  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 57775.4us
I20260709 12:59:29.513578  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet eabf19413eea44dd86511e07a036166b with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:29.514169  7320 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:29.517547  1682 raft_consensus.cc:1240] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:29.508008  1612 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:29.529155  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.533867  1608 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:59:29.547344  7337 raft_consensus.cc:1064] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:59:29.549126  2300 raft_consensus.cc:2955] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:29.564350  1613 raft_consensus.cc:2955] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:29.573599  7337 consensus_queue.cc:237] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:29.592417  7268 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:59:29.595059  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 68383.8us
I20260709 12:59:29.583344  1612 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:59:29.597553  1617 raft_consensus.cc:2955] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:29.601531  1614 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 23.
I20260709 12:59:29.611577  1654 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:29.621984  1655 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:59:29.626200  7351 log.cc:927] Time spent T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:59:29.623857  7258 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:29.632154  7258 raft_consensus.cc:697] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:29.633196  7258 consensus_queue.cc:237] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:29.656935  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:29.657545  1535 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:29.659843  1539 raft_consensus.cc:2955] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index 8 to 9, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:29.664839  7354 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:59:29.665418  7354 raft_consensus.cc:697] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 23 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:29.666275  7354 consensus_queue.cc:237] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.10, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:29.678452  1535 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:59:29.681538  1614 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:59:29.690128  7103 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:29.694573  1535 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:59:29.694981  2298 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 11 LEARNER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:59:29.712754  7326 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:29.715097  7326 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:29.802536  1613 consensus_queue.cc:237] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:29.804924  1539 raft_consensus.cc:1275] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:59:29.815394  7227 consensus_queue.cc:1048] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:29.828346  2298 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:59:29.828357  7337 raft_consensus.cc:2955] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Committing config change with OpId 11.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:29.834065  1437 catalog_manager.cc:5697] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index 8 to 9, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:29.834892  7308 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:29.837555  1535 raft_consensus.cc:2955] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:29.841590  1683 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:59:29.842494  1613 raft_consensus.cc:2955] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:29.845027  7308 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:29.851104  7227 raft_consensus.cc:2955] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:29.859340  2300 raft_consensus.cc:2955] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:29.865579  2298 raft_consensus.cc:2955] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:29.873965  1424 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet db011c2c8016405d968fe57a093fc111 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:29.905666  1686 raft_consensus.cc:2955] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:29.930955  1434 catalog_manager.cc:5697] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 13 to 14, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New cstate: current_term: 17 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:29.943315  1688 raft_consensus.cc:1275] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:59:29.945209  7337 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:29.944083  1686 consensus_queue.cc:237] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:29.945807  7311 consensus_queue.cc:1048] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:29.945976  7337 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:29.949445  1535 raft_consensus.cc:1275] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:29.951093  7297 consensus_queue.cc:1048] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:29.952430  2298 raft_consensus.cc:1275] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:29.952720  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:29.958321  1672 tablet_service.cc:1558] Processing DeleteTablet for tablet eabf19413eea44dd86511e07a036166b with delete_type TABLET_DATA_TOMBSTONED (TS 4487a53c51be4634bf1ef29c5248353d not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:50688
I20260709 12:59:29.959429  7258 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:29.961498  1437 catalog_manager.cc:5697] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:29.968408  7273 raft_consensus.cc:2955] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index 9 to 10, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:29.973467  7337 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:29.974429  1542 raft_consensus.cc:1275] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:29.975083  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:29.957312  1438 catalog_manager.cc:5697] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 12 to 13, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 13 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:29.976500  7319 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:29.977725  1438 catalog_manager.cc:5697] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 16 to 17, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 17 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:29.981667  1654 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:29.982537  7319 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:29.982692  1541 raft_consensus.cc:2955] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:29.990437  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:29.995564  2298 raft_consensus.cc:2955] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:29.968822  1437 catalog_manager.cc:5697] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 10 to 11, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New cstate: current_term: 14 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:30.040340  1686 raft_consensus.cc:1275] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:30.049055  7227 consensus_queue.cc:1048] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:59:30.117465  1613 raft_consensus.cc:1275] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:59:30.123505  7326 consensus_queue.cc:1048] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:30.124715  1434 catalog_manager.cc:5697] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 22 to 23, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 23 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:30.126930  1434 catalog_manager.cc:5697] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 12 to 13, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 13 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:30.155725  1532 tablet_service.cc:1558] Processing DeleteTablet for tablet db011c2c8016405d968fe57a093fc111 with delete_type TABLET_DATA_TOMBSTONED (TS dbe6a89d0e1c4137b3a1b17bf4b520d8 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:51498
I20260709 12:59:30.168495  7370 tablet_replica.cc:333] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 12:59:30.169699  7370 raft_consensus.cc:2243] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:30.170625  7370 raft_consensus.cc:2272] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.183885  1539 raft_consensus.cc:1275] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:59:30.186233  1427 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet aa984c8881704e97b0d6a6eb60605021 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:30.186273  7258 consensus_queue.cc:1048] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:30.195785  7373 tablet_replica.cc:333] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 12:59:30.197341  7373 raft_consensus.cc:2243] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:30.197728  1613 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 22 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 12:59:30.212793  7373 raft_consensus.cc:2272] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.214600  7370 ts_tablet_manager.cc:1916] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:30.216009  1439 catalog_manager.cc:5697] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index 9 to 10, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New cstate: current_term: 15 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:30.224220  1688 consensus_queue.cc:237] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:30.228912  7326 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:30.232740  2298 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:59:30.234700  7258 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:30.242365  1608 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:59:30.242894  1542 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 22 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 12:59:30.252978  7354 raft_consensus.cc:2955] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Committing config change with OpId 11.12: config changed from index 11 to 12, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:30.253835  7103 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:30.269960  2298 raft_consensus.cc:2955] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Committing config change with OpId 11.12: config changed from index 11 to 12, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:30.270787  1603 tablet_service.cc:1558] Processing DeleteTablet for tablet aa984c8881704e97b0d6a6eb60605021 with delete_type TABLET_DATA_TOMBSTONED (TS c262eac7fc904ae9bb91e450f6532e3f not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:54360
I20260709 12:59:30.295606  1438 catalog_manager.cc:5697] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 11 to 12, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New cstate: current_term: 11 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:30.318240  7326 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:59:30.319964  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 52559.3us
I20260709 12:59:30.332856  1608 raft_consensus.cc:2955] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Committing config change with OpId 11.12: config changed from index 11 to 12, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:30.338915  1532 tablet_service.cc:1558] Processing DeleteTablet for tablet 3c62b87395ba4c3a9a99163b300d7ddf with delete_type TABLET_DATA_TOMBSTONED (TS dbe6a89d0e1c4137b3a1b17bf4b520d8 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:51498
I20260709 12:59:30.390226  7373 ts_tablet_manager.cc:1916] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:30.405429  7377 tablet_replica.cc:333] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 12:59:30.406592  7377 raft_consensus.cc:2243] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:30.407516  7377 raft_consensus.cc:2272] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.412431  7377 ts_tablet_manager.cc:1916] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:30.435608  7377 ts_tablet_manager.cc:1929] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.9
I20260709 12:59:30.436125  7377 log.cc:1199] T aa984c8881704e97b0d6a6eb60605021 P c262eac7fc904ae9bb91e450f6532e3f: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-1-root/wals/aa984c8881704e97b0d6a6eb60605021
I20260709 12:59:30.439671  1424 catalog_manager.cc:5028] TS c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): tablet aa984c8881704e97b0d6a6eb60605021 (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:59:30.436326  1427 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3c62b87395ba4c3a9a99163b300d7ddf with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:30.494813  7370 ts_tablet_manager.cc:1929] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.13
I20260709 12:59:30.495293  7370 log.cc:1199] T eabf19413eea44dd86511e07a036166b P 4487a53c51be4634bf1ef29c5248353d: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-2-root/wals/eabf19413eea44dd86511e07a036166b
I20260709 12:59:30.497386  1427 catalog_manager.cc:5028] TS 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): tablet eabf19413eea44dd86511e07a036166b (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:59:30.592348  7373 ts_tablet_manager.cc:1929] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.10
I20260709 12:59:30.618320  7373 log.cc:1199] T db011c2c8016405d968fe57a093fc111 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-0-root/wals/db011c2c8016405d968fe57a093fc111
I20260709 12:59:30.620114  1425 catalog_manager.cc:5028] TS dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): tablet db011c2c8016405d968fe57a093fc111 (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:59:30.631570  7373 tablet_replica.cc:333] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 12:59:30.653384  7373 raft_consensus.cc:2243] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:30.654495  7373 raft_consensus.cc:2272] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:30.658679  7373 ts_tablet_manager.cc:1916] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:30.723809  7373 ts_tablet_manager.cc:1929] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.11
I20260709 12:59:30.724226  7373 log.cc:1199] T 3c62b87395ba4c3a9a99163b300d7ddf P dbe6a89d0e1c4137b3a1b17bf4b520d8: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-0-root/wals/3c62b87395ba4c3a9a99163b300d7ddf
I20260709 12:59:30.725726  1425 catalog_manager.cc:5028] TS dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): tablet 3c62b87395ba4c3a9a99163b300d7ddf (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:59:30.747430   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:30.946911  1615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:30.947666  1615 raft_consensus.cc:606] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:30.952329  1535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "480b368f643b4d85a5daa23529132504"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:47506
I20260709 12:59:30.953061  1535 raft_consensus.cc:606] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 LEADER]: Received request to transfer leadership to TS c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:30.956101  1615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:30.956830  1615 raft_consensus.cc:606] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:30.959568  1688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97c958beecec40918b63217135840ff6"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "1d6516ff61104bdda54bde95e92fe579"
 from {username='slave'} at 127.0.0.1:54400
I20260709 12:59:30.960172  1688 raft_consensus.cc:606] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Received request to transfer leadership to TS 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:30.963008  1688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:54400
I20260709 12:59:30.963598  1688 raft_consensus.cc:606] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 14 LEADER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:30.964936   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:30.967548   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:31.174510  7227 raft_consensus.cc:993] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:31.175078  7227 raft_consensus.cc:1081] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:31.177467  1688 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50708
I20260709 12:59:31.178081  1688 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:31.178404  1688 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:31.197330  1688 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:31.204720  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:31.205402  1542 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:31.234014  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:31.234668  1615 raft_consensus.cc:3055] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:31.234985  1615 raft_consensus.cc:740] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:31.235291  1542 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:59:31.235760  1615 consensus_queue.cc:260] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:31.236578  1688 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:31.236932  1615 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:31.242051  1655 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:31.243289  7273 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:59:31.243979  7273 raft_consensus.cc:697] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:31.244151  1615 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:59:31.245041  7273 consensus_queue.cc:237] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:31.263264  7308 raft_consensus.cc:993] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:31.263931  7308 raft_consensus.cc:1081] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:31.265695  1688 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50708
I20260709 12:59:31.266245  1688 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:31.266649  1688 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:31.272297  1688 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:31.275039  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:31.275655  1615 raft_consensus.cc:3055] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:31.275971  1615 raft_consensus.cc:740] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:31.276741  1615 consensus_queue.cc:260] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:31.277848  1615 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:31.278666  1688 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:31.279971  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:31.280553  1542 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:31.285022  1615 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:59:31.286268  1654 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:31.287194  7319 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:59:31.287863  7319 raft_consensus.cc:697] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:31.288981  7319 consensus_queue.cc:237] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:31.292829  1542 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:59:31.318246  1439 catalog_manager.cc:5697] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 16 to 17, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 17 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:31.342914  7335 raft_consensus.cc:993] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8: : Instructing follower c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:31.343519  7236 raft_consensus.cc:1081] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 LEADER]: Signalling peer c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:31.349673  1613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "480b368f643b4d85a5daa23529132504"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:49296
I20260709 12:59:31.350288  1613 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:31.351701  1613 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:31.362427  7354 raft_consensus.cc:993] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d: : Instructing follower dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:31.362975  7354 raft_consensus.cc:1081] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 14 LEADER]: Signalling peer dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:31.369730  1535 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:51512
I20260709 12:59:31.370402  1535 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:31.370748  1535 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:31.393770  1535 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:31.397787  1613 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:31.400686  1613 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:31.401016  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:31.401631  1688 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:31.401919  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:31.402509  1542 raft_consensus.cc:3055] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:31.402817  1542 raft_consensus.cc:740] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:31.403501  1542 consensus_queue.cc:260] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:31.404633  1542 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:31.408094  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:31.408742  1613 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:31.409109  1535 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:31.409430  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:31.409873  1688 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:59:31.411116  1583 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:31.412187  7227 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:31.412667  7227 raft_consensus.cc:697] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:31.413455  7227 consensus_queue.cc:237] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:31.410025  1683 raft_consensus.cc:3055] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:31.416277  1542 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:59:31.416692  1683 raft_consensus.cc:740] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:31.417615  1683 consensus_queue.cc:260] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:31.418871  1683 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:31.425853  1683 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
I20260709 12:59:31.427129  1508 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:31.428038  7236 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:31.428555  7236 raft_consensus.cc:697] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:31.429212  1613 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
I20260709 12:59:31.429383  7236 consensus_queue.cc:237] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:31.458246  1438 catalog_manager.cc:5697] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 13 to 14, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 14 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:31.454366  1437 catalog_manager.cc:5697] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 14 to 15, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:31.532611  7319 raft_consensus.cc:993] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d: : Instructing follower 1d6516ff61104bdda54bde95e92fe579 to start an election
I20260709 12:59:31.534071  7319 raft_consensus.cc:1081] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Signalling peer 1d6516ff61104bdda54bde95e92fe579 to start an election
I20260709 12:59:31.591856  2298 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97c958beecec40918b63217135840ff6"
dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
 from {username='slave'} at 127.0.0.1:32802
I20260709 12:59:31.592600  2298 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:31.592974  2298 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:31.614364  1613 consensus_queue.cc:237] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:31.646490  2298 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:31.660699  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:31.661448  1615 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:31.664868  2298 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 11 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:31.664894  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:31.665871  1688 raft_consensus.cc:3055] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:31.666234  1688 raft_consensus.cc:740] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:31.682041  1688 consensus_queue.cc:260] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:31.683175  1688 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:31.693750  1615 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 11.
I20260709 12:59:31.695230  2266 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:31.696108  7331 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:31.696717  7331 raft_consensus.cc:697] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 11 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:59:31.697651  7331 consensus_queue.cc:237] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:31.696738  1688 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 11.
I20260709 12:59:31.705216  1535 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:59:31.708552  7273 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:59:31.724061  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 170355us
W20260709 12:59:31.855237  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 136472us
W20260709 12:59:31.999162  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 81520.9us
I20260709 12:59:31.999619  1542 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 12:59:32.025012  7401 log.cc:927] Time spent T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 12:59:32.027290  1688 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 12:59:32.072758  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 72818.7us
I20260709 12:59:32.103863  1541 raft_consensus.cc:1275] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:59:32.112931  1617 raft_consensus.cc:1275] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:59:32.123119  1688 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:59:32.128822  1582 consensus_peers.cc:597] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9b4de1379d73445699a2babbca8fce44. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:32.129410  7420 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:32.107388   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:32.139031  1683 raft_consensus.cc:1275] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:59:32.136706  7402 consensus_queue.cc:1048] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:59:32.146898  1534 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:32.152714  7319 consensus_queue.cc:1048] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:32.154860  1688 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:59:32.156311  7403 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:32.157198  1434 catalog_manager.cc:5697] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 10 to 11, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:32.168247  1615 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:59:32.181696  7227 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:32.183940  7409 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:32.188067  1612 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:59:32.208029  7415 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:59:32.219918  1608 raft_consensus.cc:1275] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:59:32.237666  1438 catalog_manager.cc:5697] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 16 to 17, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 17 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:32.221357  7394 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:59:32.240121  7380 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 12:59:32.260870  7402 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:59:32.297262  7335 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
W20260709 12:59:32.373773  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 139501us
W20260709 12:59:32.418812  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 164743us
W20260709 12:59:32.457511  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 202467us
W20260709 12:59:32.476056  7426 log.cc:927] Time spent T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.109s	user 0.002s	sys 0.000s
I20260709 12:59:32.532748  1685 raft_consensus.cc:2955] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
W20260709 12:59:32.555874  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 341985us
W20260709 12:59:32.613087  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 87902.1us
W20260709 12:59:32.614135  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 55059.8us
I20260709 12:59:32.371716  7393 raft_consensus.cc:2955] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
W20260709 12:59:32.703270  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 87988.2us
W20260709 12:59:32.751497  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 43619.4us
W20260709 12:59:32.781147  7439 log.cc:927] Time spent T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 12:59:32.842722  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 158226us
I20260709 12:59:32.934373  7393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:39748 (request call id 5) took 1322 ms. Trace:
I20260709 12:59:32.934862  7393 rpcz_store.cc:276] 0709 12:59:31.611787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.611976 (+   189us) service_pool.cc:224] Handling call
0709 12:59:31.618949 (+  6973us) log.cc:844] Serialized 506 byte log entry
0709 12:59:31.883891 (+264942us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b18000c6820. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f61455 00007fc85cfaab0b 00007fc85d02fb63 00007fc85d057752 00007fc862017d29
0709 12:59:31.902116 (+ 18225us) spinlock_profiling.cc:243] Waited 7.66 ms on lock 0x7b18000c6820. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f322a6 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85cfca142 00007fc85cfaaeaa 00007fc85cfb1d53
0709 12:59:31.946885 (+ 44769us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b540033e3a0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85cfca142 00007fc85cfaaeaa 00007fc85cfb1d53 00007fc85cfb1cd9 00007fc85cfb1c69 00007fc85cfb1c31 00007fc85cfb0dfd 000000000038f354 000000000038f199 00007fc859f64475
0709 12:59:31.978074 (+ 31189us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b540033e3a0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85cfca142 00007fc85cfaaeaa 00007fc85cfb1d53 00007fc85cfb1cd9 00007fc85cfb1c69 00007fc85cfb1c31 00007fc85cfb0dfd 000000000038f354 000000000038f199 00007fc859f64475
0709 12:59:32.001478 (+ 23404us) spinlock_profiling.cc:243] Waited 6.81 ms on lock 0x7b18000c6820. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f643f3 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd 000000000038f354 000000000038f199 00007fc859f4783a
0709 12:59:32.006334 (+  4856us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b18000c6820. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f322a6 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85cfd1b26 00007fc85cfcb49a 00007fc85cfca714
0709 12:59:32.006848 (+   514us) spinlock_profiling.cc:243] Waited 9.48 ms on lock 0x7b540033e3a0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85cfd1b26 00007fc85cfcb49a 00007fc85cfca714 00007fc85cfaaeaa 00007fc85cfb1d53 00007fc85cfb1cd9 00007fc85cfb1c69 00007fc85cfb1c31 00007fc85cfb0dfd 000000000038f354
0709 12:59:32.934272 (+927424us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35146,"raft.queue_time_us":10078,"raft.run_cpu_time_us":52750,"raft.run_wall_time_us":796501,"spinlock_wait_cycles":390662016,"thread_start_us":239463,"threads_started":2,"wal-append.queue_time_us":232377}
W20260709 12:59:32.948884  7427 log.cc:927] Time spent T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:59:33.031843  1535 raft_consensus.cc:2955] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
W20260709 12:59:33.100932  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 62163.8us
I20260709 12:59:33.142382  7482 ts_tablet_manager.cc:933] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:33.191903  1434 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38804 (request call id 117) took 1282 ms. Trace:
I20260709 12:59:33.228533  1533 consensus_queue.cc:237] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:33.192329  1434 rpcz_store.cc:276] 0709 12:59:31.909279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.909405 (+   126us) service_pool.cc:224] Handling call
0709 12:59:32.061793 (+152388us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54001b99d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfbb090 00007fc85d059f3a 00007fc862e101cc 00007fc862f0e37e 00007fc8613cf2a4 00007fc8613cf232 00007fc8613cf161 00007fc8613cf0dc 00007fc8613ce392 00007fc85b38c48c 00007fc85b38b8c6
0709 12:59:33.191798 (+1130005us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:32.564539 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:32.565117 (+   578us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:32.565151 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:59:32.565168 (+    17us) tablet.cc:662] Decoding operations
0709 12:59:32.614019 (+ 48851us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:32.632555 (+ 18536us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:32.656455 (+ 23900us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:32.681672 (+ 25217us) tablet.cc:701] Row locks acquired
0709 12:59:32.683832 (+  2160us) write_op.cc:260] PREPARE: finished
0709 12:59:32.691236 (+  7404us) write_op.cc:270] Start()
0709 12:59:32.696277 (+  5041us) write_op.cc:276] Timestamp: P: 1783601972689688 usec, L: 0
0709 12:59:32.699097 (+  2820us) op_driver.cc:348] REPLICATION: starting
0709 12:59:32.758707 (+ 59610us) log.cc:844] Serialized 536 byte log entry
0709 12:59:32.850277 (+ 91570us) op_driver.cc:464] REPLICATION: finished
0709 12:59:33.135442 (+285165us) write_op.cc:301] APPLY: starting
0709 12:59:33.135537 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:33.136688 (+  1151us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:33.136784 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:33.137584 (+   800us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:33.137774 (+   190us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:59:33.137819 (+    45us) write_op.cc:312] APPLY: finished
0709 12:59:33.138028 (+   209us) log.cc:844] Serialized 25 byte log entry
0709 12:59:33.141621 (+  3593us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:33.141695 (+    74us) write_op.cc:454] Released schema lock
0709 12:59:33.143584 (+  1889us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:33.188575 (+ 44991us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:33.188605 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":76106,"reported_tablets":1,"spinlock_wait_cycles":250433280,"child_traces":[["op",{"apply.queue_time_us":284891,"apply.run_cpu_time_us":3436,"apply.run_wall_time_us":30520,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8309,"num_ops":1,"prepare.queue_time_us":354117,"prepare.run_cpu_time_us":3964,"prepare.run_wall_time_us":216041,"replication_time_us":151006,"thread_start_us":450257,"threads_started":2}]]}
I20260709 12:59:33.250617  1438 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54582 (request call id 242) took 1045 ms. Trace:
I20260709 12:59:33.251056  1438 rpcz_store.cc:276] 0709 12:59:32.204834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.205035 (+   201us) service_pool.cc:224] Handling call
0709 12:59:33.250545 (+1045510us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:32.774259 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:32.774774 (+   515us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:32.774802 (+    28us) write_op.cc:435] Acquired schema lock
0709 12:59:32.774821 (+    19us) tablet.cc:662] Decoding operations
0709 12:59:32.775150 (+   329us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:32.775194 (+    44us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:32.775223 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:32.775406 (+   183us) tablet.cc:701] Row locks acquired
0709 12:59:32.775423 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:59:32.775560 (+   137us) write_op.cc:270] Start()
0709 12:59:32.775668 (+   108us) write_op.cc:276] Timestamp: P: 1783601972775506 usec, L: 0
0709 12:59:32.775689 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:59:32.776284 (+   595us) log.cc:844] Serialized 541 byte log entry
0709 12:59:33.038203 (+261919us) op_driver.cc:464] REPLICATION: finished
0709 12:59:33.188952 (+150749us) write_op.cc:301] APPLY: starting
0709 12:59:33.189024 (+    72us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:33.189894 (+   870us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:33.190001 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:33.190710 (+   709us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:33.190881 (+   171us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:59:33.190931 (+    50us) write_op.cc:312] APPLY: finished
0709 12:59:33.191147 (+   216us) log.cc:844] Serialized 25 byte log entry
0709 12:59:33.234914 (+ 43767us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:33.235584 (+   670us) write_op.cc:454] Released schema lock
0709 12:59:33.241132 (+  5548us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":28,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":85513,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4182,"num_ops":1,"prepare.queue_time_us":533357,"prepare.run_cpu_time_us":2287,"prepare.run_wall_time_us":2286,"replication_time_us":251453,"thread_start_us":89151,"threads_started":1}]]}
I20260709 12:59:33.308528  7482 tablet_copy_client.cc:323] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:41953
I20260709 12:59:33.320960   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:33.322546  1627 tablet_copy_service.cc:140] P c262eac7fc904ae9bb91e450f6532e3f: Received BeginTabletCopySession request for tablet 9b4de1379d73445699a2babbca8fce44 from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:58006)
I20260709 12:59:33.323287  1627 tablet_copy_service.cc:161] P c262eac7fc904ae9bb91e450f6532e3f: Beginning new tablet copy session on tablet 9b4de1379d73445699a2babbca8fce44 from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:58006: session id = 1d6516ff61104bdda54bde95e92fe579-9b4de1379d73445699a2babbca8fce44
I20260709 12:59:33.335894  1686 raft_consensus.cc:1275] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:59:33.354009  1613 raft_consensus.cc:1275] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:59:33.344234  7335 consensus_queue.cc:1048] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:59:33.355563  1438 catalog_manager.cc:5697] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index -1 to 12, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 17 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:33.362298  7394 consensus_queue.cc:1048] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:33.370445  1627 tablet_copy_source_session.cc:215] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:59:33.372290  1507 consensus_peers.cc:597] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 940b60c7fb3744a68751996b8bb198ca. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:33.382721  7482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b4de1379d73445699a2babbca8fce44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:33.429452  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:54400
I20260709 12:59:33.430151  1683 raft_consensus.cc:606] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Received request to transfer leadership to TS c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:33.434598  1534 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:47506
I20260709 12:59:33.435112  1534 raft_consensus.cc:606] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Received request to transfer leadership to TS c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:33.441438  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:54400
I20260709 12:59:33.442085  1683 raft_consensus.cc:606] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:33.445084  1608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:33.445647  1608 raft_consensus.cc:606] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:33.452641  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:33.453226  1614 raft_consensus.cc:606] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:33.455169   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:33.457023  7335 raft_consensus.cc:2955] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Committing config change with OpId 14.8: config changed from index -1 to 8, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:33.458915  1683 raft_consensus.cc:2955] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Committing config change with OpId 14.8: config changed from index -1 to 8, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:33.454684  7482 tablet_copy_client.cc:806] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:33.468542   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:33.476732  7482 tablet_copy_client.cc:670] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:33.481242  1613 raft_consensus.cc:2955] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Committing config change with OpId 14.8: config changed from index -1 to 8, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:33.482298  1686 consensus_queue.cc:237] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:33.490232  7482 tablet_copy_client.cc:538] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:33.513243  1438 catalog_manager.cc:5697] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index -1 to 8, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 14 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:33.516270  1613 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:59:33.521230  7432 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:33.522482  1534 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:59:33.523952  7462 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:59:33.529019  1656 consensus_peers.cc:597] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d2eccdddaa724fed8954f5e5bc110b80. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:33.533505  7482 tablet_bootstrap.cc:492] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:59:33.576100  7462 raft_consensus.cc:2955] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:33.578120  1542 raft_consensus.cc:2955] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:33.592648  1534 consensus_queue.cc:237] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:33.602743  1438 catalog_manager.cc:5697] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index -1 to 11, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 18 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:33.609477  7432 raft_consensus.cc:993] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d: : Instructing follower c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:33.610697  7402 raft_consensus.cc:1081] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Signalling peer c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:33.616575  1613 raft_consensus.cc:2955] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:33.621291  1614 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:49312
I20260709 12:59:33.624758  1614 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:33.625269  1614 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:33.624825  7391 raft_consensus.cc:993] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:33.628141  7391 raft_consensus.cc:1081] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:33.634621  1686 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50708
I20260709 12:59:33.635213  1686 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:33.635576  1686 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:33.650718  1686 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:33.651561  7391 raft_consensus.cc:993] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:33.652034  7227 raft_consensus.cc:1081] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:33.654028  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:33.654621  1535 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:33.653231  1686 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:33.663647  1535 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:59:33.667793  1655 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:33.668978  7389 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:33.669531  7389 raft_consensus.cc:697] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:33.670325  7388 raft_consensus.cc:993] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d: : Instructing follower dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:33.670862  7388 raft_consensus.cc:1081] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Signalling peer dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:33.671427  1686 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50708
I20260709 12:59:33.671985  1686 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:33.670341  7389 consensus_queue.cc:237] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:33.672403  1686 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:33.676399  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:33.677038  1612 raft_consensus.cc:3055] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:33.677331  1612 raft_consensus.cc:740] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:33.677987  1612 consensus_queue.cc:260] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:33.678632  1542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:51512
I20260709 12:59:33.679167  1542 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:33.679663  1542 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:33.695233  1686 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:33.679116  1612 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:33.694917  1438 catalog_manager.cc:5697] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 12 to 13, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 13 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:33.696539  1614 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:33.693413  1542 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:33.703788  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:33.704452  1683 raft_consensus.cc:3055] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:33.704766  1683 raft_consensus.cc:740] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:33.705487  1683 consensus_queue.cc:260] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:33.706465  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:33.706588  1683 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:33.707137  1535 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:33.712899  1542 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:33.713017  1686 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:33.716231  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:33.716921  1542 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:33.717501  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:33.718086  1608 raft_consensus.cc:3055] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:59:33.718586  1608 raft_consensus.cc:740] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:33.715021  1683 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 17.
I20260709 12:59:33.718837  1614 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:33.718040  1612 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:59:33.703809  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:33.721596  1613 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:33.720228  1608 consensus_queue.cc:260] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:33.721014  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:33.722632  1686 raft_consensus.cc:3055] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:59:33.723004  1686 raft_consensus.cc:740] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:33.716986  1535 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 12:59:33.724309  1655 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:33.724802  1508 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:33.725906  1608 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:33.725808  7432 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:59:33.730196  7432 raft_consensus.cc:697] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:33.731043  7432 consensus_queue.cc:237] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:33.734678  1608 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 12:59:33.723759  1686 consensus_queue.cc:260] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:33.737650  1686 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:33.740844  1542 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 12:59:33.743100  1581 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:33.743476  1613 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 17.
I20260709 12:59:33.740849  7395 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:59:33.747891  7391 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:59:33.750121  1683 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:59:33.751350  1686 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 12:59:33.749742  7391 raft_consensus.cc:697] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:33.753835  7395 raft_consensus.cc:697] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:33.755362  7463 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
W20260709 12:59:33.780252  1507 consensus_peers.cc:597] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b3e4ab7be234d07aa27f18779c01c0d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:33.786235  7395 consensus_queue.cc:237] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:33.798681  1608 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:59:33.801292  1438 catalog_manager.cc:5697] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 17 to 18, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 18 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:33.784932  7391 consensus_queue.cc:237] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:33.820369  7394 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:33.838572  1438 catalog_manager.cc:5697] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 17 to 18, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 18 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:33.852865  7497 ts_tablet_manager.cc:933] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903)
I20260709 12:59:33.859115  7394 raft_consensus.cc:993] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8: : Instructing follower c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:33.860693  7236 raft_consensus.cc:1081] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Signalling peer c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:33.868923  1439 catalog_manager.cc:5697] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 16 to 17, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 17 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:33.874130  1613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:49296
I20260709 12:59:33.874884  1613 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:33.875295  1613 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:33.891069  1613 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:33.897315  7395 raft_consensus.cc:2955] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:33.902792  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:33.903563  1534 raft_consensus.cc:3055] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:33.903867  1534 raft_consensus.cc:740] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:33.904690  1534 consensus_queue.cc:260] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:33.905836  1534 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:33.907681  1613 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:33.908744  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:33.909381  1682 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:33.917570  1613 raft_consensus.cc:2955] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:33.927711  1534 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:59:33.931037  1581 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:33.932282  7497 tablet_copy_client.cc:323] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43903
I20260709 12:59:33.934085  1550 tablet_copy_service.cc:140] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Received BeginTabletCopySession request for tablet 940b60c7fb3744a68751996b8bb198ca from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:42356)
I20260709 12:59:33.934671  1550 tablet_copy_service.cc:161] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Beginning new tablet copy session on tablet 940b60c7fb3744a68751996b8bb198ca from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:42356: session id = 1d6516ff61104bdda54bde95e92fe579-940b60c7fb3744a68751996b8bb198ca
I20260709 12:59:33.939571  7227 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:33.949075  1682 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:59:33.951980  7227 raft_consensus.cc:697] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:33.966123  1682 raft_consensus.cc:2955] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:33.956173  7227 consensus_queue.cc:237] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:59:34.020912  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 81818.8us
I20260709 12:59:34.033625  1550 tablet_copy_source_session.cc:215] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:34.037433  7497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 940b60c7fb3744a68751996b8bb198ca. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:59:34.041419  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 103371us
W20260709 12:59:34.048867  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 117919us
I20260709 12:59:34.062371  1439 catalog_manager.cc:5697] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 16 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:34.125672  7506 ts_tablet_manager.cc:933] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:59:34.126371  7508 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 12:59:34.155757  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 52468.7us
I20260709 12:59:34.156131  7506 tablet_copy_client.cc:323] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45275
I20260709 12:59:34.197724  1701 tablet_copy_service.cc:140] P 4487a53c51be4634bf1ef29c5248353d: Received BeginTabletCopySession request for tablet d2eccdddaa724fed8954f5e5bc110b80 from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:33206)
I20260709 12:59:34.199270  1701 tablet_copy_service.cc:161] P 4487a53c51be4634bf1ef29c5248353d: Beginning new tablet copy session on tablet d2eccdddaa724fed8954f5e5bc110b80 from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:33206: session id = 1d6516ff61104bdda54bde95e92fe579-d2eccdddaa724fed8954f5e5bc110b80
I20260709 12:59:34.253863  1534 raft_consensus.cc:1275] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:34.278733  1701 tablet_copy_source_session.cc:215] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:34.280694  7482 tablet_bootstrap.cc:492] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:34.282166  7482 tablet_bootstrap.cc:492] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:59:34.283612  7482 ts_tablet_manager.cc:1403] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 0.750s	user 0.063s	sys 0.029s
I20260709 12:59:34.288064  7506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2eccdddaa724fed8954f5e5bc110b80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:34.314168  1434 catalog_manager.cc:5697] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 14 to 15, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 15 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:34.330933  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 48007.1us
I20260709 12:59:34.331422  1535 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:59:34.336803  7445 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:59:34.338924  7389 consensus_queue.cc:1048] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:34.342921  1683 raft_consensus.cc:1275] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:59:34.351857  7395 consensus_queue.cc:1048] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:34.354261  1612 raft_consensus.cc:1275] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:59:34.357488  1615 raft_consensus.cc:1275] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:59:34.368134  1533 raft_consensus.cc:1275] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:59:34.370999  1610 raft_consensus.cc:1275] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:59:34.435305  7482 raft_consensus.cc:359] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:34.436386  7482 raft_consensus.cc:740] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:59:34.437280  7482 consensus_queue.cc:260] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:34.438903  7514 ts_tablet_manager.cc:933] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903)
I20260709 12:59:34.450107  1683 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:59:34.453909  7409 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:59:34.458818  7432 consensus_queue.cc:1048] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:34.470651   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:34.516774  7482 ts_tablet_manager.cc:1434] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.233s	user 0.007s	sys 0.007s
W20260709 12:59:34.548564  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 51514.8us
I20260709 12:59:34.548357  1627 tablet_copy_service.cc:342] P c262eac7fc904ae9bb91e450f6532e3f: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-9b4de1379d73445699a2babbca8fce44 received from {username='slave'} at 127.0.0.1:58006
I20260709 12:59:34.549854  1627 tablet_copy_service.cc:434] P c262eac7fc904ae9bb91e450f6532e3f: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-9b4de1379d73445699a2babbca8fce44 on tablet 9b4de1379d73445699a2babbca8fce44 with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:34.552461  7236 consensus_queue.cc:1048] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:34.553488  7432 consensus_queue.cc:1048] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:34.557246  7388 consensus_queue.cc:1048] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:34.565613  7497 tablet_copy_client.cc:806] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:34.566470  7497 tablet_copy_client.cc:670] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:34.591846  1534 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:59:34.592931  7497 tablet_copy_client.cc:538] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:34.617967  7514 tablet_copy_client.cc:323] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43903
I20260709 12:59:34.622941  7506 tablet_copy_client.cc:806] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:34.623636  7506 tablet_copy_client.cc:670] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:34.652850  1550 tablet_copy_service.cc:140] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Received BeginTabletCopySession request for tablet 8b3e4ab7be234d07aa27f18779c01c0d from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:42356)
I20260709 12:59:34.653658  1550 tablet_copy_service.cc:161] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Beginning new tablet copy session on tablet 8b3e4ab7be234d07aa27f18779c01c0d from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:42356: session id = 1d6516ff61104bdda54bde95e92fe579-8b3e4ab7be234d07aa27f18779c01c0d
I20260709 12:59:34.689863  7391 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.087s
I20260709 12:59:34.743187  7506 tablet_copy_client.cc:538] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:59:34.781859  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 66778.6us
W20260709 12:59:34.784387  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 46550.3us
I20260709 12:59:34.788702  1550 tablet_copy_source_session.cc:215] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:59:34.807636  7521 log.cc:927] Time spent T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:59:34.818194  7497 tablet_bootstrap.cc:492] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
W20260709 12:59:34.862696  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 76992.7us
I20260709 12:59:34.876605  2297 raft_consensus.cc:1217] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.11->[17.12-17.12]   Dedup: 17.12->[]
W20260709 12:59:34.878805  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 56308.1us
W20260709 12:59:34.924516  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 82146.5us
I20260709 12:59:34.930063  7514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b3e4ab7be234d07aa27f18779c01c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:34.968357  7506 tablet_bootstrap.cc:492] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
W20260709 12:59:34.976267  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 210348us
I20260709 12:59:34.984836  1687 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:59:35.003659  7535 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:35.208418  7514 tablet_copy_client.cc:806] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:35.209020  7514 tablet_copy_client.cc:670] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:35.225526  7514 tablet_copy_client.cc:538] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:59:35.261858  7552 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:59:35.280296  7514 tablet_bootstrap.cc:492] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:59:35.447480  7497 tablet_bootstrap.cc:492] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:35.453246  7497 tablet_bootstrap.cc:492] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:59:35.455448  7497 ts_tablet_manager.cc:1403] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 0.638s	user 0.032s	sys 0.015s
I20260709 12:59:35.459530  7497 raft_consensus.cc:359] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:35.480676  7497 raft_consensus.cc:740] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:59:35.460178  7506 tablet_bootstrap.cc:492] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=3 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:35.482024  7506 tablet_bootstrap.cc:492] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:59:35.481568  7497 consensus_queue.cc:260] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:35.482823  7506 ts_tablet_manager.cc:1403] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 0.515s	user 0.051s	sys 0.010s
I20260709 12:59:35.486147  7506 raft_consensus.cc:359] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:35.487035  7506 raft_consensus.cc:740] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:59:35.487705  7506 consensus_queue.cc:260] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:35.499384  7506 ts_tablet_manager.cc:1434] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.004s
I20260709 12:59:35.510433  1701 tablet_copy_service.cc:342] P 4487a53c51be4634bf1ef29c5248353d: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-d2eccdddaa724fed8954f5e5bc110b80 received from {username='slave'} at 127.0.0.1:33206
I20260709 12:59:35.510921  1701 tablet_copy_service.cc:434] P 4487a53c51be4634bf1ef29c5248353d: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-d2eccdddaa724fed8954f5e5bc110b80 on tablet d2eccdddaa724fed8954f5e5bc110b80 with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:35.522858  2297 raft_consensus.cc:1217] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.7->[14.8-14.8]   Dedup: 14.8->[]
I20260709 12:59:35.552105  7391 raft_consensus.cc:1064] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:59:35.556162  7391 consensus_queue.cc:237] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:35.567050  2297 raft_consensus.cc:1217] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.10->[18.11-18.11]   Dedup: 18.11->[]
I20260709 12:59:35.620935  7497 ts_tablet_manager.cc:1434] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.164s	user 0.006s	sys 0.002s
I20260709 12:59:35.634507  1550 tablet_copy_service.cc:342] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-940b60c7fb3744a68751996b8bb198ca received from {username='slave'} at 127.0.0.1:42356
I20260709 12:59:35.635032  1550 tablet_copy_service.cc:434] P dbe6a89d0e1c4137b3a1b17bf4b520d8: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-940b60c7fb3744a68751996b8bb198ca on tablet 940b60c7fb3744a68751996b8bb198ca with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:35.671236  2297 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEARNER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:59:35.673789  7532 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:59:35.668349  1683 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:59:35.676697  7445 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:59:35.706954  1533 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:59:35.721691  7445 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:59:35.754302  7227 raft_consensus.cc:2955] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:35.761174  1539 raft_consensus.cc:2955] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:35.802974  1437 catalog_manager.cc:5697] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index 12 to 13, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:35.812367  1683 raft_consensus.cc:2955] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:35.837764  2297 raft_consensus.cc:2955] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:35.882315  7514 tablet_bootstrap.cc:492] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:35.921453  7514 tablet_bootstrap.cc:492] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:59:35.922536  7514 ts_tablet_manager.cc:1403] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 0.643s	user 0.032s	sys 0.027s
I20260709 12:59:35.932066  7514 raft_consensus.cc:359] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:35.933009  7514 raft_consensus.cc:740] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:59:35.933699  7514 consensus_queue.cc:260] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:35.964178  1612 consensus_queue.cc:237] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:35.972535  7514 ts_tablet_manager.cc:1434] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 12:59:35.973106  2297 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:59:35.974943  1550 tablet_copy_service.cc:342] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-8b3e4ab7be234d07aa27f18779c01c0d received from {username='slave'} at 127.0.0.1:42356
I20260709 12:59:35.975389  1550 tablet_copy_service.cc:434] P dbe6a89d0e1c4137b3a1b17bf4b520d8: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-8b3e4ab7be234d07aa27f18779c01c0d on tablet 8b3e4ab7be234d07aa27f18779c01c0d with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:35.975281  7445 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:59:35.983700  7532 raft_consensus.cc:2955] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:35.992197  1539 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:59:35.995661  7227 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:59:36.002157  1533 raft_consensus.cc:2955] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:36.003876  7546 raft_consensus.cc:1064] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:59:36.017571  7546 consensus_queue.cc:237] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 9, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:36.002703  2297 raft_consensus.cc:2955] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:36.049714  1436 catalog_manager.cc:5697] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index 13 to 14, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New cstate: current_term: 17 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:36.089864  1672 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b4de1379d73445699a2babbca8fce44 with delete_type TABLET_DATA_TOMBSTONED (TS 4487a53c51be4634bf1ef29c5248353d not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:50688
I20260709 12:59:36.145640  1424 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9b4de1379d73445699a2babbca8fce44 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:36.194083  7566 tablet_replica.cc:333] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 12:59:36.198987  7566 raft_consensus.cc:2243] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:36.200289  7566 raft_consensus.cc:2272] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:36.215019  1613 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:59:36.223825  7566 ts_tablet_manager.cc:1916] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:36.234200  2298 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEARNER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:59:36.242838  7533 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:36.267058  7389 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:36.273079  7538 raft_consensus.cc:1064] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:59:36.273613   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:36.284289  7538 consensus_queue.cc:237] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 6, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:59:36.269774  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 61966.3us
I20260709 12:59:36.298961  1539 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:59:36.326565  7546 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 12:59:36.370190  7572 raft_consensus.cc:2955] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:36.384766  2297 raft_consensus.cc:1217] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.9->[16.10-16.10]   Dedup: 16.10->[]
W20260709 12:59:36.404104  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 45308.4us
I20260709 12:59:36.418272  2297 raft_consensus.cc:1275] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [term 14 LEARNER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:36.402287  1615 raft_consensus.cc:2955] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 12:59:36.428627  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 69838.9us
I20260709 12:59:36.420228  7571 consensus_queue.cc:1048] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:59:36.409766  2298 raft_consensus.cc:2955] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:36.429657  1436 catalog_manager.cc:5697] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index 11 to 12, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:36.447058  1539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:47506
I20260709 12:59:36.447829  1539 raft_consensus.cc:606] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:36.466359  1682 raft_consensus.cc:1275] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:36.472710  7566 ts_tablet_manager.cc:1929] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.13
I20260709 12:59:36.473347  7566 log.cc:1199] T 9b4de1379d73445699a2babbca8fce44 P 4487a53c51be4634bf1ef29c5248353d: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-2-root/wals/9b4de1379d73445699a2babbca8fce44
I20260709 12:59:36.477391  7569 consensus_queue.cc:1048] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:59:36.499934  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 76416.3us
I20260709 12:59:36.501673  1427 catalog_manager.cc:5028] TS 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): tablet 9b4de1379d73445699a2babbca8fce44 (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:59:36.519712  1615 raft_consensus.cc:1275] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:36.523905  1682 consensus_queue.cc:237] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:36.531236  2298 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:59:36.532727  7574 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:59:36.533560  1613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "480b368f643b4d85a5daa23529132504"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:36.534152  1613 raft_consensus.cc:606] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:36.531679  1615 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:59:36.550781  1534 raft_consensus.cc:2955] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:36.554967  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:54400
I20260709 12:59:36.555608  1682 raft_consensus.cc:606] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 23 LEADER]: Received request to transfer leadership to TS c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:36.543998  7533 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 12:59:36.558018  7536 consensus_queue.cc:1048] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:36.564117  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7634482da3645aeb7462251e5df3726"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:54400
I20260709 12:59:36.564764  1682 raft_consensus.cc:606] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 22 LEADER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:36.570912  7573 raft_consensus.cc:2955] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:36.573024  2300 raft_consensus.cc:2955] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:36.591055  1612 raft_consensus.cc:2955] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 12:59:36.637822  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 44185.4us
I20260709 12:59:36.651933  1427 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d2eccdddaa724fed8954f5e5bc110b80 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:36.662425  1438 catalog_manager.cc:5697] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index 12 to 13, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New cstate: current_term: 18 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:36.704645   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:59:36.706578   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 12:59:36.725327  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 86656.3us
I20260709 12:59:36.774974  1532 tablet_service.cc:1558] Processing DeleteTablet for tablet d2eccdddaa724fed8954f5e5bc110b80 with delete_type TABLET_DATA_TOMBSTONED (TS dbe6a89d0e1c4137b3a1b17bf4b520d8 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:51498
I20260709 12:59:36.775180  7532 raft_consensus.cc:993] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:36.775765  7532 raft_consensus.cc:1081] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:36.785418  7571 raft_consensus.cc:2955] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index 8 to 9, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:36.788645  7533 raft_consensus.cc:993] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d: : Instructing follower c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:36.806938  1686 raft_consensus.cc:2955] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index 8 to 9, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:36.808858  7533 raft_consensus.cc:1081] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 23 LEADER]: Signalling peer c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:36.810281  7548 raft_consensus.cc:993] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:36.810842  7548 raft_consensus.cc:1081] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
W20260709 12:59:36.840512  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 80770.2us
I20260709 12:59:36.843590  7548 raft_consensus.cc:1064] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:59:36.830945  2297 raft_consensus.cc:2955] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index 8 to 9, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 12:59:36.850793  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 101086us
I20260709 12:59:36.837747  1683 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50694
I20260709 12:59:36.858803  1683 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:59:36.856726  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 92541us
I20260709 12:59:36.859218  1683 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:36.865969  7548 consensus_queue.cc:237] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 8, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:36.867022  1609 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:49312
I20260709 12:59:36.867576  1609 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:36.867933  1609 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:59:36.872083  1686 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "480b368f643b4d85a5daa23529132504"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50708
I20260709 12:59:36.872794  1686 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:36.878794  1686 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:36.881873  7397 raft_consensus.cc:993] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d: : Instructing follower dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:36.882465  7397 raft_consensus.cc:1081] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 22 LEADER]: Signalling peer dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:36.877694  1683 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:36.886723  1683 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:36.889688  1686 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:36.890381  1533 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7634482da3645aeb7462251e5df3726"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:51512
I20260709 12:59:36.915489  1533 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:36.915892  1533 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:59:36.916553  7596 tablet_replica.cc:333] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 12:59:36.921064  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:36.924268  1534 raft_consensus.cc:3055] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:59:36.924839  1534 raft_consensus.cc:740] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:36.928463  1534 consensus_queue.cc:260] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:36.931869  1534 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:36.903863  1437 catalog_manager.cc:5697] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index 8 to 9, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:36.939603  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: true dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:36.933578  1609 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:36.940199  2300 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:36.946220  1609 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:36.947206  1612 raft_consensus.cc:2955] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index 8 to 9, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:36.966296  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:36.967139  1682 raft_consensus.cc:3055] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:59:36.967525  1682 raft_consensus.cc:740] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:36.965752  1534 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 12:59:36.972978  7596 raft_consensus.cc:2243] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:36.973942  7596 raft_consensus.cc:2272] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:36.968376  1682 consensus_queue.cc:260] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:36.979501  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:36.982723  1686 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:36.983644  1682 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:59:36.984877  1533 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:36.986419  2297 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEARNER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:59:36.986959  2300 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 12:59:36.987500  1539 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:36.992719  1535 consensus_queue.cc:237] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:37.001180  1688 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:59:37.005290  1539 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 12:59:37.010474  7596 ts_tablet_manager.cc:1916] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:37.027174  1682 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 24.
I20260709 12:59:37.035625  7569 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:37.039451  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:37.043982  7571 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:37.040282  1609 raft_consensus.cc:3055] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:37.051199  1609 raft_consensus.cc:740] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:37.052217  1609 consensus_queue.cc:260] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:37.022121  1655 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:37.053887  1609 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:37.060590  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:37.061087  2300 raft_consensus.cc:1275] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:59:37.061471  1539 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:59:37.067481  1533 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:59:37.068387  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 46420.6us
I20260709 12:59:37.069705  1655 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:37.074877  7573 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:59:37.075657  7573 raft_consensus.cc:697] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:37.079922  7570 consensus_queue.cc:1048] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:37.082330  7573 consensus_queue.cc:237] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:59:37.087819  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 60493.3us
W20260709 12:59:37.097240  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 63179.9us
I20260709 12:59:37.099094  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:37.099747  1613 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:59:37.101052  7577 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:37.101776  7577 raft_consensus.cc:697] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:37.102810  7577 consensus_queue.cc:237] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:37.107478  1613 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 23.
I20260709 12:59:37.115568  1609 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 12:59:37.125996  1686 raft_consensus.cc:1275] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:59:37.127832  1539 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 24.
I20260709 12:59:37.117466  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:37.129834  1688 raft_consensus.cc:3055] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:59:37.130126  1688 raft_consensus.cc:740] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:37.152000  1612 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:59:37.148249  1583 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:37.169556  7586 consensus_queue.cc:1048] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:59:37.175974  7570 raft_consensus.cc:2955] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 9 to 10, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:37.161278  1688 consensus_queue.cc:260] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:37.181411  1688 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:59:37.186321  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 43662us
I20260709 12:59:37.187165  7227 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:59:37.187693  7227 raft_consensus.cc:697] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 24 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:37.189723  7227 consensus_queue.cc:237] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:37.192642  1439 catalog_manager.cc:5697] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 17 to 18, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 18 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:37.193193  1686 raft_consensus.cc:2955] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:37.210413  2300 raft_consensus.cc:2955] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:37.214931  1688 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 23.
I20260709 12:59:37.247015  1508 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:37.248389  7569 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:59:37.248955  7569 raft_consensus.cc:697] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:37.249903  7569 consensus_queue.cc:237] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:37.256016  7587 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:37.276955  1439 catalog_manager.cc:5697] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 9 to 10, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New cstate: current_term: 14 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:37.305016  1603 tablet_service.cc:1558] Processing DeleteTablet for tablet 940b60c7fb3744a68751996b8bb198ca with delete_type TABLET_DATA_TOMBSTONED (TS c262eac7fc904ae9bb91e450f6532e3f not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:54360
I20260709 12:59:37.305543  7548 raft_consensus.cc:2955] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:37.321914  1682 raft_consensus.cc:2955] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:37.347160  2300 raft_consensus.cc:2955] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:37.375186  7608 tablet_replica.cc:333] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 12:59:37.376644  7608 raft_consensus.cc:2243] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:37.380292  1439 catalog_manager.cc:5697] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 14 to 15, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 15 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:37.387094  1438 catalog_manager.cc:5697] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:37.395979  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 940b60c7fb3744a68751996b8bb198ca with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:37.387769  1437 catalog_manager.cc:5697] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 23 to 24, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 24 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:37.453816  7608 raft_consensus.cc:2272] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:37.457595  7608 ts_tablet_manager.cc:1916] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:37.459376  7596 ts_tablet_manager.cc:1929] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.12
I20260709 12:59:37.472563  7596 log.cc:1199] T d2eccdddaa724fed8954f5e5bc110b80 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-0-root/wals/d2eccdddaa724fed8954f5e5bc110b80
I20260709 12:59:37.514483  1425 catalog_manager.cc:5028] TS dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): tablet d2eccdddaa724fed8954f5e5bc110b80 (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:59:37.519937  1439 catalog_manager.cc:5697] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 22 to 23, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 23 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:37.537938  1608 raft_consensus.cc:2955] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:37.574199  2297 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:59:37.576123  1542 consensus_queue.cc:237] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:37.580865  7595 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:59:37.583752  1533 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:37.586022  7605 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:37.594696  2300 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:59:37.595050  1682 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:59:37.596814  7570 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:37.598883  7571 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:37.604871  7608 ts_tablet_manager.cc:1929] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.9
I20260709 12:59:37.605461  7608 log.cc:1199] T 940b60c7fb3744a68751996b8bb198ca P c262eac7fc904ae9bb91e450f6532e3f: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-1-root/wals/940b60c7fb3744a68751996b8bb198ca
I20260709 12:59:37.608274  1424 catalog_manager.cc:5028] TS c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): tablet 940b60c7fb3744a68751996b8bb198ca (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:59:37.608431  7610 raft_consensus.cc:2955] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:37.623735  1682 raft_consensus.cc:2955] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:37.625166  2300 raft_consensus.cc:2955] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:37.641342  1533 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:59:37.645393  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8b3e4ab7be234d07aa27f18779c01c0d with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:37.669363  1439 catalog_manager.cc:5697] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index 11 to 12, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New cstate: current_term: 16 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:37.687702  1603 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b3e4ab7be234d07aa27f18779c01c0d with delete_type TABLET_DATA_TOMBSTONED (TS c262eac7fc904ae9bb91e450f6532e3f not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:54360
I20260709 12:59:37.688762  7608 tablet_replica.cc:333] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 12:59:37.696914  1683 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:59:37.700340  7610 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:59:37.707661   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:37.725911  7533 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:59:37.732816  1612 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:37.768141  1541 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 12:59:37.769973  7227 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:37.770516  7608 raft_consensus.cc:2243] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:37.771364  7608 raft_consensus.cc:2272] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:37.775095  7608 ts_tablet_manager.cc:1916] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:37.793807  1682 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 12:59:37.796216  7391 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:37.823982  7608 ts_tablet_manager.cc:1929] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.11
I20260709 12:59:37.824656  7608 log.cc:1199] T 8b3e4ab7be234d07aa27f18779c01c0d P c262eac7fc904ae9bb91e450f6532e3f: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-1-root/wals/8b3e4ab7be234d07aa27f18779c01c0d
I20260709 12:59:37.917439  1424 catalog_manager.cc:5028] TS c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): tablet 8b3e4ab7be234d07aa27f18779c01c0d (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:59:37.917743  7605 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:38.014570  1609 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:59:38.197551  7610 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
W20260709 12:59:38.257676  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 56837.7us
W20260709 12:59:38.270325  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 68831.4us
W20260709 12:59:38.293570  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 69555.8us
I20260709 12:59:38.856382   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:38.971606  1613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:38.972222  1613 raft_consensus.cc:606] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:38.981372  1539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:47506
I20260709 12:59:38.982117  1539 raft_consensus.cc:606] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Received request to transfer leadership to TS c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:38.992995  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "1d6516ff61104bdda54bde95e92fe579"
 from {username='slave'} at 127.0.0.1:54400
I20260709 12:59:38.993594  1683 raft_consensus.cc:606] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Received request to transfer leadership to TS 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:39.006057  1688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:54400
I20260709 12:59:39.006702  1688 raft_consensus.cc:606] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:39.015280   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:59:39.017140   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:39.033594  1541 consensus_queue.cc:237] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:39.070700  1688 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 12:59:39.070842  1507 consensus_peers.cc:597] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d7727fcb0cf9452fbbc077ab7987b596. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:39.071882  1613 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:59:39.072379  7624 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:39.076771  7629 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:39.092058  7227 raft_consensus.cc:993] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:39.092697  7227 raft_consensus.cc:1081] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:39.094703  1688 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50708
I20260709 12:59:39.095340  7629 raft_consensus.cc:2955] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:39.095335  1688 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:39.098621  1688 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:39.092124  7605 raft_consensus.cc:993] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d: : Instructing follower dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:39.097304  1683 raft_consensus.cc:2955] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:39.100970  7605 raft_consensus.cc:1081] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Signalling peer dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:39.103324  1541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:51512
I20260709 12:59:39.104389  1541 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:39.104836  1541 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:39.119932  1688 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:39.129434  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:39.130103  1539 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:39.130889  1439 catalog_manager.cc:5697] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 17 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:39.135377  1688 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:39.137764  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:39.138437  1612 raft_consensus.cc:3055] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:39.138757  1612 raft_consensus.cc:740] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:39.139489  1612 consensus_queue.cc:260] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:39.144981  1615 consensus_queue.cc:237] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:39.145674  1541 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:39.146682  1613 raft_consensus.cc:2955] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:39.148308  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:39.148924  1609 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:39.155200  1612 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:39.163710  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:39.164376  1688 raft_consensus.cc:3055] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:59:39.164706  1688 raft_consensus.cc:740] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:39.165444  1688 consensus_queue.cc:260] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:39.167209  1688 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:39.175529  1541 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:39.194448  1688 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 19.
I20260709 12:59:39.195811  1508 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:39.199874  7637 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:59:39.202786  7637 raft_consensus.cc:697] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:39.204550  7637 consensus_queue.cc:237] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:39.238304  1683 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:59:39.241371  7632 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:59:39.248637  1533 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
W20260709 12:59:39.250454  1582 consensus_peers.cc:597] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ac600187e28f4d0fa948e0d053317e88. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:39.252332  7632 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:59:39.193667  1609 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 19.
I20260709 12:59:39.263043  1612 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 12:59:39.264827  1654 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:39.266412  7605 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:39.266963  7605 raft_consensus.cc:697] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:39.267840  7605 consensus_queue.cc:237] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:39.280062  1539 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 12:59:39.335521  7227 raft_consensus.cc:2955] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 24 LEADER]: Committing config change with OpId 24.13: config changed from index -1 to 13, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
W20260709 12:59:39.373937  7635 log.cc:927] Time spent T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:59:39.435791  1683 raft_consensus.cc:2955] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Committing config change with OpId 24.13: config changed from index -1 to 13, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:39.514513  7637 raft_consensus.cc:993] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8: : Instructing follower c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:39.515084  7637 raft_consensus.cc:1081] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Signalling peer c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:39.523217  1533 consensus_queue.cc:237] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:39.538583  7595 raft_consensus.cc:993] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d: : Instructing follower 1d6516ff61104bdda54bde95e92fe579 to start an election
I20260709 12:59:39.539214  7595 raft_consensus.cc:1081] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Signalling peer 1d6516ff61104bdda54bde95e92fe579 to start an election
I20260709 12:59:39.559024  2300 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5"
dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
 from {username='slave'} at 127.0.0.1:32802
I20260709 12:59:39.559587  2300 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:39.559942  2300 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:39.567133  2300 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:39.583065  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:39.583213  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:39.584009  1683 raft_consensus.cc:3055] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:59:39.584412  1683 raft_consensus.cc:740] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:39.583804  1612 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:39.585486  2300 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:39.593425  1612 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 18.
I20260709 12:59:39.585271  1683 consensus_queue.cc:260] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:39.595005  2266 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:59:39.596045  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 88661.1us
I20260709 12:59:39.598664  1683 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:39.599118  1613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:49296
I20260709 12:59:39.599686  1613 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:39.600103  1613 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:59:39.606819  1683 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 18.
I20260709 12:59:39.605223  7625 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:59:39.611652  7625 raft_consensus.cc:697] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:59:39.612596  7625 consensus_queue.cc:237] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:39.612807  1613 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:39.615036  1613 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:59:39.625989  1507 consensus_peers.cc:597] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9a7bc646e9bf4d2e9952c8b5d4a5be14. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:39.626296  1541 raft_consensus.cc:2955] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Committing config change with OpId 24.13: config changed from index -1 to 13, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:39.629904  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:39.630576  1682 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:59:39.651602  1682 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 22.
I20260709 12:59:39.653834  1583 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:39.654387  1688 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:59:39.654579  1613 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:59:39.656091  7650 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:59:39.655985  7657 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:39.656795  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:39.657354  1533 raft_consensus.cc:3055] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:59:39.657649  1533 raft_consensus.cc:740] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:39.658303  1533 consensus_queue.cc:260] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:39.659359  1533 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:59:39.662166  7629 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:39.665723  7650 raft_consensus.cc:697] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:39.666851  7650 consensus_queue.cc:237] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:39.681288  1436 catalog_manager.cc:5697] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 17 to 18, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 18 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:39.685268  1683 raft_consensus.cc:1275] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:59:39.686870  7657 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:39.688123  7664 ts_tablet_manager.cc:933] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903)
I20260709 12:59:39.689237  1533 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 22.
I20260709 12:59:39.714148  7664 tablet_copy_client.cc:323] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43903
I20260709 12:59:39.716692  1550 tablet_copy_service.cc:140] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Received BeginTabletCopySession request for tablet d7727fcb0cf9452fbbc077ab7987b596 from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:42356)
I20260709 12:59:39.717298  1550 tablet_copy_service.cc:161] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Beginning new tablet copy session on tablet d7727fcb0cf9452fbbc077ab7987b596 from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:42356: session id = 1d6516ff61104bdda54bde95e92fe579-d7727fcb0cf9452fbbc077ab7987b596
I20260709 12:59:39.723362  1609 raft_consensus.cc:1275] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:59:39.725210  7654 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:39.726065  1550 tablet_copy_source_session.cc:215] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:39.732151  7664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7727fcb0cf9452fbbc077ab7987b596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:39.743232  1613 raft_consensus.cc:2955] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Committing config change with OpId 18.10: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:39.741683  7657 raft_consensus.cc:2955] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 LEADER]: Committing config change with OpId 18.10: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:39.750669  1612 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:59:39.758662  7653 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:59:39.805191  1608 consensus_queue.cc:237] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:39.816962  1437 catalog_manager.cc:5697] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 18 to 19, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 19 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:39.819024  1437 catalog_manager.cc:5697] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index -1 to 13, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 24 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:39.853008  1533 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:59:39.853571  1582 consensus_peers.cc:597] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 62a133aa1e234c489eaeb6341dc87b49. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:39.855899  1683 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:59:39.864570  7632 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 12:59:39.874773  1533 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:59:39.875020  7648 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:59:39.883579  7653 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:59:39.887828  7661 log.cc:927] Time spent T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:59:39.899789  1686 raft_consensus.cc:2955] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Committing config change with OpId 18.10: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:39.915395  1438 catalog_manager.cc:5697] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 21 to 22, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 22 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:39.918946  1438 catalog_manager.cc:5697] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 15 to 16, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 16 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:39.919680  7674 ts_tablet_manager.cc:933] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:59:39.929159  7669 log.cc:927] Time spent T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:59:39.960412  7674 tablet_copy_client.cc:323] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:41953
I20260709 12:59:39.965162  7632 raft_consensus.cc:2955] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index -1 to 14, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:39.966717  1627 tablet_copy_service.cc:140] P c262eac7fc904ae9bb91e450f6532e3f: Received BeginTabletCopySession request for tablet ac600187e28f4d0fa948e0d053317e88 from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:58006)
I20260709 12:59:39.967971  1627 tablet_copy_service.cc:161] P c262eac7fc904ae9bb91e450f6532e3f: Beginning new tablet copy session on tablet ac600187e28f4d0fa948e0d053317e88 from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:58006: session id = 1d6516ff61104bdda54bde95e92fe579-ac600187e28f4d0fa948e0d053317e88
I20260709 12:59:39.969245  1686 raft_consensus.cc:2955] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index -1 to 14, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:39.984616  1627 tablet_copy_source_session.cc:215] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:40.006345  7664 tablet_copy_client.cc:806] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:40.006964  7664 tablet_copy_client.cc:670] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:40.015415  7664 tablet_copy_client.cc:538] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:40.025643  7664 tablet_bootstrap.cc:492] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:59:40.029606  7674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac600187e28f4d0fa948e0d053317e88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.038653  1437 catalog_manager.cc:5697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 18 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:40.018036   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:40.072233  1533 raft_consensus.cc:2955] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index -1 to 14, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:40.082140  1436 catalog_manager.cc:5697] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index -1 to 14, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 18 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:40.139715  1683 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:59:40.143198  7331 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 12:59:40.152100  7674 tablet_copy_client.cc:806] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:40.152737  7674 tablet_copy_client.cc:670] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:40.161274  1612 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:59:40.162998  7331 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:59:40.196043  7674 tablet_copy_client.cc:538] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:40.218847  7674 tablet_bootstrap.cc:492] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:59:40.263581  7683 ts_tablet_manager.cc:933] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903)
I20260709 12:59:40.268464  1533 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:59:40.271131  7647 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:59:40.337387  1683 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:59:40.338137  7664 tablet_bootstrap.cc:492] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=2 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:40.339257  7664 tablet_bootstrap.cc:492] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:59:40.339623  7632 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:59:40.340106  7664 ts_tablet_manager.cc:1403] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 0.315s	user 0.075s	sys 0.041s
I20260709 12:59:40.344167  7683 tablet_copy_client.cc:323] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43903
I20260709 12:59:40.420229  1550 tablet_copy_service.cc:140] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Received BeginTabletCopySession request for tablet 9a7bc646e9bf4d2e9952c8b5d4a5be14 from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:42356)
I20260709 12:59:40.420920  1550 tablet_copy_service.cc:161] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Beginning new tablet copy session on tablet 9a7bc646e9bf4d2e9952c8b5d4a5be14 from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:42356: session id = 1d6516ff61104bdda54bde95e92fe579-9a7bc646e9bf4d2e9952c8b5d4a5be14
W20260709 12:59:40.416199  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 125227us
I20260709 12:59:40.478652  7664 raft_consensus.cc:359] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:40.489068  1550 tablet_copy_source_session.cc:215] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:40.496605  7664 raft_consensus.cc:740] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:59:40.556962  7664 consensus_queue.cc:260] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:40.559527  7664 ts_tablet_manager.cc:1434] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.219s	user 0.007s	sys 0.000s
I20260709 12:59:40.572615  7692 ts_tablet_manager.cc:933] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:40.582126  7683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a7bc646e9bf4d2e9952c8b5d4a5be14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.611596  7692 tablet_copy_client.cc:323] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:41953
I20260709 12:59:40.636749  1627 tablet_copy_service.cc:140] P c262eac7fc904ae9bb91e450f6532e3f: Received BeginTabletCopySession request for tablet 62a133aa1e234c489eaeb6341dc87b49 from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:58006)
I20260709 12:59:40.637378  1627 tablet_copy_service.cc:161] P c262eac7fc904ae9bb91e450f6532e3f: Beginning new tablet copy session on tablet 62a133aa1e234c489eaeb6341dc87b49 from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:58006: session id = 1d6516ff61104bdda54bde95e92fe579-62a133aa1e234c489eaeb6341dc87b49
W20260709 12:59:40.643245  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 143521us
I20260709 12:59:40.658874  1627 tablet_copy_source_session.cc:215] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:40.660938  1550 tablet_copy_service.cc:342] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-d7727fcb0cf9452fbbc077ab7987b596 received from {username='slave'} at 127.0.0.1:42356
I20260709 12:59:40.661463  1550 tablet_copy_service.cc:434] P dbe6a89d0e1c4137b3a1b17bf4b520d8: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-d7727fcb0cf9452fbbc077ab7987b596 on tablet d7727fcb0cf9452fbbc077ab7987b596 with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:40.673851  7692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62a133aa1e234c489eaeb6341dc87b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:40.715837  2301 raft_consensus.cc:1217] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.9->[17.10-17.10]   Dedup: 17.10->[]
I20260709 12:59:40.744212  7683 tablet_copy_client.cc:806] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:40.744865  7683 tablet_copy_client.cc:670] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:40.860599  7683 tablet_copy_client.cc:538] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:59:40.869760  7674 log.cc:927] Time spent T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.117s	user 0.004s	sys 0.000s
I20260709 12:59:40.923615  7683 tablet_bootstrap.cc:492] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:59:40.939778  7692 tablet_copy_client.cc:806] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:40.942503  7674 tablet_bootstrap.cc:492] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=3 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:40.961133  7674 tablet_bootstrap.cc:492] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:59:40.961898  7674 ts_tablet_manager.cc:1403] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 0.750s	user 0.045s	sys 0.022s
I20260709 12:59:40.976253  7692 tablet_copy_client.cc:670] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:40.997262  7692 tablet_copy_client.cc:538] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:41.003095  7674 raft_consensus.cc:359] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 24 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:41.004233  7674 raft_consensus.cc:740] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 24 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:59:41.040674  7674 consensus_queue.cc:260] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:41.053656  7674 ts_tablet_manager.cc:1434] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.091s	user 0.005s	sys 0.004s
I20260709 12:59:41.056808  1627 tablet_copy_service.cc:342] P c262eac7fc904ae9bb91e450f6532e3f: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-ac600187e28f4d0fa948e0d053317e88 received from {username='slave'} at 127.0.0.1:58006
I20260709 12:59:41.057260  1627 tablet_copy_service.cc:434] P c262eac7fc904ae9bb91e450f6532e3f: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-ac600187e28f4d0fa948e0d053317e88 on tablet ac600187e28f4d0fa948e0d053317e88 with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:41.059451  7692 tablet_bootstrap.cc:492] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:59:41.178951  7683 tablet_bootstrap.cc:492] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:41.179920  7683 tablet_bootstrap.cc:492] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:59:41.194242  7683 ts_tablet_manager.cc:1403] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 0.271s	user 0.044s	sys 0.001s
I20260709 12:59:41.217492   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:41.225287  7683 raft_consensus.cc:359] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:41.226258  7683 raft_consensus.cc:740] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:59:41.226951  7683 consensus_queue.cc:260] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
W20260709 12:59:41.248791  7692 log.cc:927] Time spent T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.058s	user 0.003s	sys 0.000s
I20260709 12:59:41.265086  7683 ts_tablet_manager.cc:1434] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.070s	user 0.003s	sys 0.003s
I20260709 12:59:41.267336  1550 tablet_copy_service.cc:342] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-9a7bc646e9bf4d2e9952c8b5d4a5be14 received from {username='slave'} at 127.0.0.1:42356
I20260709 12:59:41.267848  1550 tablet_copy_service.cc:434] P dbe6a89d0e1c4137b3a1b17bf4b520d8: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-9a7bc646e9bf4d2e9952c8b5d4a5be14 on tablet 9a7bc646e9bf4d2e9952c8b5d4a5be14 with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:41.312132  7610 raft_consensus.cc:1064] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:59:41.319330  7610 consensus_queue.cc:237] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 8, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:41.369429  7692 tablet_bootstrap.cc:492] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:41.370548  7692 tablet_bootstrap.cc:492] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:59:41.371402  7692 ts_tablet_manager.cc:1403] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 0.312s	user 0.048s	sys 0.009s
I20260709 12:59:41.387341  7692 raft_consensus.cc:359] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:41.392388  7692 raft_consensus.cc:740] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:59:41.394424  7692 consensus_queue.cc:260] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:41.415112  7692 ts_tablet_manager.cc:1434] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 12:59:41.432672  2301 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEARNER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:59:41.435216  7657 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:41.436997  1627 tablet_copy_service.cc:342] P c262eac7fc904ae9bb91e450f6532e3f: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-62a133aa1e234c489eaeb6341dc87b49 received from {username='slave'} at 127.0.0.1:58006
I20260709 12:59:41.437480  1627 tablet_copy_service.cc:434] P c262eac7fc904ae9bb91e450f6532e3f: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-62a133aa1e234c489eaeb6341dc87b49 on tablet 62a133aa1e234c489eaeb6341dc87b49 with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:41.433774  1688 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:59:41.449620  2301 raft_consensus.cc:1217] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.13->[18.14-18.14]   Dedup: 18.14->[]
I20260709 12:59:41.440243  1612 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:59:41.453961  7624 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:41.459757  7624 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:41.497892  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "480b368f643b4d85a5daa23529132504"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:54400
I20260709 12:59:41.498528  1682 raft_consensus.cc:606] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:41.505556  1539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:47506
I20260709 12:59:41.506384  1539 raft_consensus.cc:606] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:41.509895  1608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db702b262c1644109366a56f6f0d805a"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:41.510515  1608 raft_consensus.cc:606] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:41.515435  7610 raft_consensus.cc:2955] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:41.518185  1608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:41.518831  1608 raft_consensus.cc:606] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:41.518319  1682 raft_consensus.cc:2955] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:41.524641   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:59:41.526305   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:41.538772  1608 raft_consensus.cc:2955] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:41.544713  2297 raft_consensus.cc:2955] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:41.546813  2301 raft_consensus.cc:1217] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 24 LEARNER]: Deduplicated request from leader. Original: 24.12->[24.13-24.13]   Dedup: 24.13->[]
I20260709 12:59:41.556458  1437 catalog_manager.cc:5697] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:41.592270  7657 raft_consensus.cc:993] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:41.593467  7698 raft_consensus.cc:1081] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:41.595561  1688 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50694
I20260709 12:59:41.596119  1688 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:41.596485  1688 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:41.604148  2297 raft_consensus.cc:1217] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.9->[18.10-18.10]   Dedup: 18.10->[]
I20260709 12:59:41.610203  1688 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:41.614473  1688 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:41.615201  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:41.615578  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:41.615893  1539 raft_consensus.cc:3055] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:41.616291  1539 raft_consensus.cc:740] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:41.616309  2297 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:41.617058  1539 consensus_queue.cc:260] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:41.618204  1539 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:41.626480  1539 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:59:41.628018  1655 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:41.628955  7656 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:59:41.629683  7656 raft_consensus.cc:697] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:41.630575  7656 consensus_queue.cc:237] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:41.656267  2297 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:59:41.693143  7647 raft_consensus.cc:993] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:41.693666  7647 raft_consensus.cc:1081] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Signalling peer dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:41.695772  1533 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:51500
I20260709 12:59:41.696400  1533 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:41.696799  1533 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:41.718825  1533 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:41.722306  1533 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:41.723662  7647 raft_consensus.cc:993] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:41.724216  7647 raft_consensus.cc:1081] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:41.729979  1688 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db702b262c1644109366a56f6f0d805a"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50708
I20260709 12:59:41.734817  1688 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:41.731383  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:41.735301  1688 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:41.735610  1612 raft_consensus.cc:3055] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:41.735965  1612 raft_consensus.cc:740] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:41.736766  1612 consensus_queue.cc:260] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:41.737982  1612 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:41.732090  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: true dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:41.740756  2297 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:41.743940  1688 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:41.747344  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:41.748080  1533 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:41.753676  2297 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:59:41.765355  1507 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:41.766469  7657 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:59:41.767220  7657 raft_consensus.cc:697] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:41.768093  7657 consensus_queue.cc:237] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:41.766484  1612 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 12:59:41.772838  1542 consensus_queue.cc:237] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:41.788012  1436 catalog_manager.cc:5697] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 16 to 17, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 17 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:41.818495  1612 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:59:41.822489  7698 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:41.837539  7624 raft_consensus.cc:2955] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:41.877516  7644 raft_consensus.cc:993] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d: : Instructing follower dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:41.878082  7644 raft_consensus.cc:1081] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Signalling peer dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:41.881680  1608 raft_consensus.cc:2955] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:41.889798  1541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "480b368f643b4d85a5daa23529132504"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:51512
I20260709 12:59:41.890532  1541 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:41.891010  1541 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:41.901643  2300 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:59:41.905920  1688 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:41.911166  1436 catalog_manager.cc:5697] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: config changed from index 11 to 12, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New cstate: current_term: 17 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:41.912797  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:41.913507  1608 raft_consensus.cc:3055] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:41.913849  1608 raft_consensus.cc:740] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:41.914649  1608 consensus_queue.cc:260] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:41.917062  7610 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:41.922148  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d7727fcb0cf9452fbbc077ab7987b596 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:41.924389  1608 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:41.927412  1533 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 12:59:41.928176  1539 raft_consensus.cc:1240] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:41.937122  1672 tablet_service.cc:1558] Processing DeleteTablet for tablet d7727fcb0cf9452fbbc077ab7987b596 with delete_type TABLET_DATA_TOMBSTONED (TS 4487a53c51be4634bf1ef29c5248353d not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:50688
I20260709 12:59:41.964763  2301 raft_consensus.cc:2955] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:41.990408  1436 catalog_manager.cc:5697] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 10 to 11, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:41.994086  1655 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:41.995932  7644 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:41.997625  7712 tablet_replica.cc:333] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 12:59:42.002401  7712 raft_consensus.cc:2243] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:42.003247  7712 raft_consensus.cc:2272] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:42.018220  7644 raft_consensus.cc:697] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:42.019366  7644 consensus_queue.cc:237] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:42.028126  7629 raft_consensus.cc:1064] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:59:42.031106  7629 consensus_queue.cc:237] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 8, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:41.965699  1541 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:42.037212  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:42.037824  1612 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:42.041503  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:42.041929  1541 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:42.047395  1608 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 12:59:42.054994  1682 raft_consensus.cc:3055] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:42.055471  1682 raft_consensus.cc:740] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:42.056387  1682 consensus_queue.cc:260] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:42.057662  1682 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:42.065230  1438 catalog_manager.cc:5697] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 14 to 15, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 15 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:42.068567  7647 raft_consensus.cc:1064] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:59:42.071285  7647 consensus_queue.cc:237] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 12, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:42.108852  7712 ts_tablet_manager.cc:1916] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:42.129325  1533 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:59:42.131376  7644 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:59:42.088367  1612 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 12:59:42.151351  1505 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:42.152360  7657 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:42.152866  7657 raft_consensus.cc:697] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:42.153689  7657 consensus_queue.cc:237] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:42.202704  1682 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
W20260709 12:59:42.214419  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 141490us
I20260709 12:59:42.236964  1612 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:59:42.250331  7610 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:42.309912  7712 ts_tablet_manager.cc:1929] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.11
I20260709 12:59:42.310442  7712 log.cc:1199] T d7727fcb0cf9452fbbc077ab7987b596 P 4487a53c51be4634bf1ef29c5248353d: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-2-root/wals/d7727fcb0cf9452fbbc077ab7987b596
I20260709 12:59:42.312320  1427 catalog_manager.cc:5028] TS 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): tablet d7727fcb0cf9452fbbc077ab7987b596 (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
W20260709 12:59:42.314821  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 86617.9us
W20260709 12:59:42.316045  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 80788.2us
I20260709 12:59:42.316326  2301 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEARNER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:59:42.324748  2301 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEARNER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:59:42.334285  2301 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:59:42.339547  1436 catalog_manager.cc:5697] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 15 to 16, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:42.330265  7632 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 12:59:42.351758  7726 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:42.352886  7713 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:59:42.369601  7716 raft_consensus.cc:1064] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
W20260709 12:59:42.443244  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 45307us
W20260709 12:59:42.444597  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 121490us
I20260709 12:59:42.454115  1682 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 12:59:42.524355  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 65785us
I20260709 12:59:42.528829   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:59:42.544970  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 65894.8us
I20260709 12:59:42.551234  2303 raft_consensus.cc:1275] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 11 index: 13. (index mismatch)
W20260709 12:59:42.565474  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 49900.8us
I20260709 12:59:42.606293  1682 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:59:42.615188  7624 consensus_queue.cc:1048] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:59:42.592514  7716 consensus_queue.cc:237] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 11, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:59:42.659672  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 143237us
W20260709 12:59:42.788379  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 115109us
I20260709 12:59:42.794143  7725 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:59:42.804848  1608 raft_consensus.cc:1275] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 11 index: 13. (index mismatch)
I20260709 12:59:42.807909  1613 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:59:42.809290  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 155481us
I20260709 12:59:42.819828  1609 raft_consensus.cc:1275] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:59:42.863695  7747 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:42.865115  1539 raft_consensus.cc:1275] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:59:42.838589  7624 consensus_queue.cc:1048] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 12:59:42.833807  7629 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:59:42.905690  1533 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 12:59:42.956934  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 105965us
I20260709 12:59:42.973138  7644 consensus_queue.cc:1048] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:42.981148  1687 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 12:59:42.963750  7757 log.cc:927] Time spent T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:59:42.998266  7734 consensus_queue.cc:1048] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:59:43.018666  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 51319.8us
I20260709 12:59:43.029623  2298 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 24 LEARNER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:59:43.036291  7651 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:59:43.044159  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 79135.1us
I20260709 12:59:43.127386  7749 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:43.127964  7749 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:43.130128  7749 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:43.134151  7610 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:43.144658  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:59:43.159547  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 46511.8us
W20260709 12:59:43.161520  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 69685.8us
I20260709 12:59:43.204460  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:59:43.207677  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 360986us
I20260709 12:59:43.211279  1505 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:59:43.236406  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 114269us
W20260709 12:59:43.242723  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 75136.9us
I20260709 12:59:43.247143  1535 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 12:59:43.222390  7629 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:59:43.222108  7737 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 12:59:43.282301  7721 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:59:43.286432  7749 raft_consensus.cc:2955] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 LEADER]: Committing config change with OpId 18.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:43.300899  1682 raft_consensus.cc:2955] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 12:59:43.302690  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 97044.4us
W20260709 12:59:43.329294  7773 log.cc:927] Time spent T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:59:43.385800  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 53522.7us
I20260709 12:59:43.400347  1682 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
W20260709 12:59:43.402786  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 61957.9us
W20260709 12:59:43.465986  7781 log.cc:927] Time spent T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:59:43.469139  1535 raft_consensus.cc:2955] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:43.509337  7772 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.066s
I20260709 12:59:43.510596  7728 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:43.511193  7728 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:43.513427  7728 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:43.548311  2303 raft_consensus.cc:2955] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 12:59:43.554136  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 45291.5us
I20260709 12:59:43.612815  2303 raft_consensus.cc:2955] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:43.632682  7721 raft_consensus.cc:2955] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 24 LEADER]: Committing config change with OpId 24.14: config changed from index 13 to 14, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:43.643567  1682 raft_consensus.cc:2955] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:43.622514  7725 raft_consensus.cc:2955] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Committing config change with OpId 18.15: config changed from index 14 to 15, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:43.650374   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:43.651686  1542 raft_consensus.cc:2955] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Committing config change with OpId 24.14: config changed from index 13 to 14, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 12:59:43.716645  7792 log.cc:927] Time spent T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.057s	user 0.002s	sys 0.002s
I20260709 12:59:43.717736  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:43.729965  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:43.738479  1438 catalog_manager.cc:5697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:43.743499  2301 raft_consensus.cc:2955] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Committing config change with OpId 24.14: config changed from index 13 to 14, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:43.765079  1654 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:43.764319  1436 catalog_manager.cc:5697] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index 14 to 15, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:43.768062  1436 catalog_manager.cc:5697] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index 13 to 14, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 24 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:43.771385  1616 raft_consensus.cc:2955] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:43.792274  7771 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:43.792886  7771 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:43.813381  1690 raft_consensus.cc:2955] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Committing config change with OpId 24.14: config changed from index 13 to 14, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:43.821980  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:43.827181  7771 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:43.828711  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:43.830305  1583 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:43.831297  7717 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:59:43.844601  7733 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:59:43.848412  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:43.966470  1612 consensus_queue.cc:237] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:43.991220  1608 consensus_queue.cc:237] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:44.011893  1542 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:59:44.017616  7725 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:59:44.023433  2301 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:59:44.046078  2301 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:59:44.054544  7725 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:59:44.059159  7632 raft_consensus.cc:2955] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 24 LEADER]: Committing config change with OpId 24.15: config changed from index 14 to 15, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:44.059705  1542 raft_consensus.cc:2955] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Committing config change with OpId 24.15: config changed from index 14 to 15, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:44.065701  2301 raft_consensus.cc:2955] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Committing config change with OpId 24.15: config changed from index 14 to 15, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:44.069721  1535 consensus_queue.cc:237] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:44.052227  7746 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.019s
I20260709 12:59:44.072154  1690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:54400
I20260709 12:59:44.072783  1690 raft_consensus.cc:606] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Received request to transfer leadership to TS c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:44.074631  1684 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:59:44.076727  7746 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:59:44.079553  1684 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:54400
I20260709 12:59:44.080159  1684 raft_consensus.cc:606] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Received request to transfer leadership to TS c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:44.092885  1690 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:59:44.094543  7749 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:44.095651  7771 raft_consensus.cc:2955] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Committing config change with OpId 18.16: config changed from index 15 to 16, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:44.097860  1438 catalog_manager.cc:5697] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index 14 to 15, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New cstate: current_term: 24 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:44.102490  2300 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:59:44.112098  7738 raft_consensus.cc:2955] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index 11 to 12, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:44.115688  1684 raft_consensus.cc:2955] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Committing config change with OpId 18.16: config changed from index 15 to 16, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:44.118124  7740 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:44.121083  2300 raft_consensus.cc:2955] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Committing config change with OpId 18.16: config changed from index 15 to 16, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:44.115147  1690 raft_consensus.cc:2955] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:44.126941  1542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7634482da3645aeb7462251e5df3726"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:47506
I20260709 12:59:44.127650  1542 raft_consensus.cc:606] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:44.141633  2303 raft_consensus.cc:2955] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:44.156625   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:59:44.158303   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:44.168010  1424 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ac600187e28f4d0fa948e0d053317e88 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:44.192829  1672 tablet_service.cc:1558] Processing DeleteTablet for tablet ac600187e28f4d0fa948e0d053317e88 with delete_type TABLET_DATA_TOMBSTONED (TS 4487a53c51be4634bf1ef29c5248353d not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:50688
I20260709 12:59:44.194564  1437 catalog_manager.cc:5697] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 15 to 16, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New cstate: current_term: 18 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:44.202881  1424 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 62a133aa1e234c489eaeb6341dc87b49 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:44.235193  7805 tablet_replica.cc:333] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 12:59:44.243829  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9a7bc646e9bf4d2e9952c8b5d4a5be14 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:44.258074  1532 tablet_service.cc:1558] Processing DeleteTablet for tablet 62a133aa1e234c489eaeb6341dc87b49 with delete_type TABLET_DATA_TOMBSTONED (TS dbe6a89d0e1c4137b3a1b17bf4b520d8 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:51498
I20260709 12:59:44.273684  1438 catalog_manager.cc:5697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index 11 to 12, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New cstate: current_term: 18 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:44.273056  7805 raft_consensus.cc:2243] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:44.329051  7805 raft_consensus.cc:2272] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:44.345155  7805 ts_tablet_manager.cc:1916] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:44.356990  7807 tablet_replica.cc:333] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 12:59:44.365415  7807 raft_consensus.cc:2243] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:44.366250  7807 raft_consensus.cc:2272] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:44.370870  7807 ts_tablet_manager.cc:1916] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:44.370980  7805 ts_tablet_manager.cc:1929] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 24.14
I20260709 12:59:44.371518  7805 log.cc:1199] T ac600187e28f4d0fa948e0d053317e88 P 4487a53c51be4634bf1ef29c5248353d: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-2-root/wals/ac600187e28f4d0fa948e0d053317e88
I20260709 12:59:44.417137  1603 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a7bc646e9bf4d2e9952c8b5d4a5be14 with delete_type TABLET_DATA_TOMBSTONED (TS c262eac7fc904ae9bb91e450f6532e3f not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:54360
I20260709 12:59:44.445107  7809 tablet_replica.cc:333] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 12:59:44.448150  7809 raft_consensus.cc:2243] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:44.477412  7809 raft_consensus.cc:2272] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:44.493999  7809 ts_tablet_manager.cc:1916] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:44.498240  1427 catalog_manager.cc:5028] TS 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): tablet ac600187e28f4d0fa948e0d053317e88 (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:59:44.524510  7738 raft_consensus.cc:993] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:44.528570  7738 raft_consensus.cc:1081] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:44.535616  1691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7634482da3645aeb7462251e5df3726"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50694
I20260709 12:59:44.536675  1691 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:44.538618  1691 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:59:44.540742  7759 raft_consensus.cc:993] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d: : Instructing follower c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:44.541560  7759 raft_consensus.cc:1081] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Signalling peer c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:44.568984  1616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:49312
I20260709 12:59:44.569639  1616 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:44.569994  1616 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:44.565476  1691 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:44.591073  1691 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:44.604630  7808 raft_consensus.cc:993] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d: : Instructing follower c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:44.605476  7811 raft_consensus.cc:1081] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Signalling peer c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:44.614300  1616 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:44.616106  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:44.617007  1612 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:59:44.617683  1616 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:44.621021  1614 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:49312
I20260709 12:59:44.621833  1614 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:44.622239  1614 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:44.623957  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:44.624675  1539 raft_consensus.cc:3055] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:59:44.624981  1539 raft_consensus.cc:740] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:44.626027  1539 consensus_queue.cc:260] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:44.627468  1539 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:59:44.632370  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:44.636504  1691 raft_consensus.cc:3055] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:44.636901  1691 raft_consensus.cc:740] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:44.640139  1691 consensus_queue.cc:260] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:44.669293  1691 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:44.691077  1612 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 24.
I20260709 12:59:44.704007  1614 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:44.707388  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:44.717628  1541 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:44.726478  1614 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:44.728855  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:44.743685  1682 raft_consensus.cc:3055] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:44.744024  1682 raft_consensus.cc:740] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:44.746212  1682 consensus_queue.cc:260] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:44.747589  1682 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:44.753331  7807 ts_tablet_manager.cc:1929] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.15
I20260709 12:59:44.732056  1541 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 12:59:44.736644  1654 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:44.741566  1539 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 24.
I20260709 12:59:44.760020  1691 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 12:59:44.762771  7814 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:59:44.763528  7814 raft_consensus.cc:697] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 24 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:44.764783  7814 consensus_queue.cc:237] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:44.763825  7807 log.cc:1199] T 62a133aa1e234c489eaeb6341dc87b49 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-0-root/wals/62a133aa1e234c489eaeb6341dc87b49
I20260709 12:59:44.771229  1425 catalog_manager.cc:5028] TS dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): tablet 62a133aa1e234c489eaeb6341dc87b49 (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:59:44.773306  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:44.773981  1535 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:44.787032  1581 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:44.788615  7725 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:59:44.789160  7725 raft_consensus.cc:697] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:44.790135  7725 consensus_queue.cc:237] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:44.798054  7809 ts_tablet_manager.cc:1929] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.11
I20260709 12:59:44.798947  7809 log.cc:1199] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P c262eac7fc904ae9bb91e450f6532e3f: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-1-root/wals/9a7bc646e9bf4d2e9952c8b5d4a5be14
I20260709 12:59:44.801434  1424 catalog_manager.cc:5028] TS c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): tablet 9a7bc646e9bf4d2e9952c8b5d4a5be14 (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:59:44.809274  1682 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 12:59:44.811038  1583 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:44.812108  7744 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:44.812664  7744 raft_consensus.cc:697] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:44.813633  7744 consensus_queue.cc:237] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:44.808533  1535 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 12:59:44.836706  1437 catalog_manager.cc:5697] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 23 to 24, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 24 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:44.856719  1439 catalog_manager.cc:5697] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 16 to 17, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 17 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:44.981534  1439 catalog_manager.cc:5697] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 15 to 16, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 16 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:45.159639   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:45.220796  1690 raft_consensus.cc:1275] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:59:45.222605  7746 consensus_queue.cc:1048] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:45.244203  1690 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:59:45.245927  7725 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:59:45.287009  1541 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:59:45.288817  1535 raft_consensus.cc:1275] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:59:45.294972  7632 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:59:45.295492  7744 consensus_queue.cc:1048] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:45.307860  1542 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:59:45.310037  7811 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:59:45.330231  1612 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:59:45.342955  7733 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:59:45.750576  1541 consensus_queue.cc:237] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
W20260709 12:59:45.793176  1507 consensus_peers.cc:597] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d36fee36a84e4cf98ad42f287d4f317f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:45.794883  1612 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:45.797050  1690 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:59:45.799384  7738 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:59:45.806831  7747 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:45.834333  7747 raft_consensus.cc:2955] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:45.847687  1690 raft_consensus.cc:2955] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:45.874521  1609 raft_consensus.cc:2955] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:45.876963  1439 catalog_manager.cc:5697] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index -1 to 10, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 15 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:45.954248  1541 consensus_queue.cc:237] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
W20260709 12:59:45.968465  1507 consensus_peers.cc:597] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 480b368f643b4d85a5daa23529132504. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:45.971351  1682 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:59:45.976336  7738 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:45.991163  1608 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:59:45.992650  7815 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:59:46.019973  7844 log.cc:927] Time spent T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.055s	user 0.003s	sys 0.000s
I20260709 12:59:46.030541  7815 raft_consensus.cc:2955] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:46.041992  1608 raft_consensus.cc:2955] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:46.067289  1608 consensus_queue.cc:237] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:46.096845  1691 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 12:59:46.098605  1582 consensus_peers.cc:597] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 147199196d114d4c90fd8fba442ab7d8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:46.098227  1438 catalog_manager.cc:5697] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index -1 to 12, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 16 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:46.099010  7744 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:59:46.101431  1535 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:59:46.103060  1690 raft_consensus.cc:2955] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:46.106603  7746 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:59:46.171304  7725 raft_consensus.cc:2955] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 20 LEADER]: Committing config change with OpId 20.13: config changed from index -1 to 13, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:46.183841  1541 raft_consensus.cc:2955] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index -1 to 13, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:46.194240  1682 raft_consensus.cc:2955] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index -1 to 13, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:46.215895  1439 catalog_manager.cc:5697] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index -1 to 13, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 20 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:46.229676  1690 consensus_queue.cc:237] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:46.263337  1612 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:59:46.265053  7733 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:59:46.269037  1656 consensus_peers.cc:597] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba9da8e67563442eaf10dbb50de09eb5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:46.280217  1541 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:59:46.286128  7842 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:59:46.298739  7811 raft_consensus.cc:2955] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 22 LEADER]: Committing config change with OpId 22.13: config changed from index -1 to 13, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:46.305189  1612 raft_consensus.cc:2955] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Committing config change with OpId 22.13: config changed from index -1 to 13, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:46.348380  1439 catalog_manager.cc:5697] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: config changed from index -1 to 13, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 22 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:46.359019  1541 raft_consensus.cc:2955] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Committing config change with OpId 22.13: config changed from index -1 to 13, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:46.432099  7854 ts_tablet_manager.cc:933] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903)
I20260709 12:59:46.450426  7854 tablet_copy_client.cc:323] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43903
I20260709 12:59:46.469023  1550 tablet_copy_service.cc:140] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Received BeginTabletCopySession request for tablet d36fee36a84e4cf98ad42f287d4f317f from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:42356)
I20260709 12:59:46.469789  1550 tablet_copy_service.cc:161] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Beginning new tablet copy session on tablet d36fee36a84e4cf98ad42f287d4f317f from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:42356: session id = 1d6516ff61104bdda54bde95e92fe579-d36fee36a84e4cf98ad42f287d4f317f
I20260709 12:59:46.485523   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:46.504180  1550 tablet_copy_source_session.cc:215] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:46.509042  7854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d36fee36a84e4cf98ad42f287d4f317f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:46.556988  7854 tablet_copy_client.cc:806] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:46.572338  7854 tablet_copy_client.cc:670] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:46.578739  7854 tablet_copy_client.cc:538] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:46.580808  7856 ts_tablet_manager.cc:933] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903)
I20260709 12:59:46.591400  7854 tablet_bootstrap.cc:492] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:59:46.620285  7856 tablet_copy_client.cc:323] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:43903
I20260709 12:59:46.622112  1550 tablet_copy_service.cc:140] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Received BeginTabletCopySession request for tablet 480b368f643b4d85a5daa23529132504 from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:42356)
I20260709 12:59:46.622685  1550 tablet_copy_service.cc:161] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Beginning new tablet copy session on tablet 480b368f643b4d85a5daa23529132504 from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:42356: session id = 1d6516ff61104bdda54bde95e92fe579-480b368f643b4d85a5daa23529132504
I20260709 12:59:46.630429  1550 tablet_copy_source_session.cc:215] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:46.633544  7856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 480b368f643b4d85a5daa23529132504. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:46.641202  1608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "1d6516ff61104bdda54bde95e92fe579"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:46.641942  1608 raft_consensus.cc:606] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Received request to transfer leadership to TS 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:46.652567  1690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:54400
I20260709 12:59:46.653198  1690 raft_consensus.cc:606] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:46.656126  1690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "1d6516ff61104bdda54bde95e92fe579"
 from {username='slave'} at 127.0.0.1:54400
I20260709 12:59:46.656781  1690 raft_consensus.cc:606] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Received request to transfer leadership to TS 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:46.659952  1608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:46.675500  1608 raft_consensus.cc:606] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:46.680160  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:47506
I20260709 12:59:46.680788  1541 raft_consensus.cc:606] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:46.683148   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:59:46.684865   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:46.764205  7859 ts_tablet_manager.cc:933] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:59:46.846515  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 90674.4us
I20260709 12:59:46.851423  7860 ts_tablet_manager.cc:933] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:46.867163  7808 raft_consensus.cc:993] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d: : Instructing follower 1d6516ff61104bdda54bde95e92fe579 to start an election
I20260709 12:59:46.849380  7856 tablet_copy_client.cc:806] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:46.871924  7856 tablet_copy_client.cc:670] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:46.867673  7808 raft_consensus.cc:1081] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Signalling peer 1d6516ff61104bdda54bde95e92fe579 to start an election
I20260709 12:59:46.884919  7860 tablet_copy_client.cc:323] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45275
I20260709 12:59:46.887498  1701 tablet_copy_service.cc:140] P 4487a53c51be4634bf1ef29c5248353d: Received BeginTabletCopySession request for tablet ba9da8e67563442eaf10dbb50de09eb5 from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:33206)
I20260709 12:59:46.888115  1701 tablet_copy_service.cc:161] P 4487a53c51be4634bf1ef29c5248353d: Beginning new tablet copy session on tablet ba9da8e67563442eaf10dbb50de09eb5 from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:33206: session id = 1d6516ff61104bdda54bde95e92fe579-ba9da8e67563442eaf10dbb50de09eb5
I20260709 12:59:46.889046  7856 tablet_copy_client.cc:538] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:46.899907  7859 tablet_copy_client.cc:323] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:41953
I20260709 12:59:46.903085  1627 tablet_copy_service.cc:140] P c262eac7fc904ae9bb91e450f6532e3f: Received BeginTabletCopySession request for tablet 147199196d114d4c90fd8fba442ab7d8 from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:58006)
I20260709 12:59:46.903684  1627 tablet_copy_service.cc:161] P c262eac7fc904ae9bb91e450f6532e3f: Beginning new tablet copy session on tablet 147199196d114d4c90fd8fba442ab7d8 from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:58006: session id = 1d6516ff61104bdda54bde95e92fe579-147199196d114d4c90fd8fba442ab7d8
I20260709 12:59:46.906095  7856 tablet_bootstrap.cc:492] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:59:46.932633  2300 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf"
dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
 from {username='slave'} at 127.0.0.1:32802
I20260709 12:59:46.933228  7746 raft_consensus.cc:993] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:46.936756  2300 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:46.936791  7746 raft_consensus.cc:1081] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:46.937450  2300 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:46.935040  1701 tablet_copy_source_session.cc:215] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:46.957491  7860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba9da8e67563442eaf10dbb50de09eb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:46.943749  1682 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50708
I20260709 12:59:46.969738  1682 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:46.970142  1682 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:46.971393  2300 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:46.989614  7860 tablet_copy_client.cc:806] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:46.990242  7860 tablet_copy_client.cc:670] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:46.991585  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:46.992285  1690 raft_consensus.cc:3055] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:46.992695  1690 raft_consensus.cc:740] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:46.994115  1690 consensus_queue.cc:260] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:46.995121  1690 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:47.003015  7860 tablet_copy_client.cc:538] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:47.005899  2300 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:47.009603  7747 raft_consensus.cc:993] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:47.010124  7747 raft_consensus.cc:1081] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:47.013022  7860 tablet_bootstrap.cc:492] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:59:47.015784  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:47.016458  1612 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:47.018711  1690 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 12.
I20260709 12:59:46.945286  1627 tablet_copy_source_session.cc:215] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:47.043111  7854 tablet_bootstrap.cc:492] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:47.044184  7854 tablet_bootstrap.cc:492] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:59:47.040378  1612 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 12.
I20260709 12:59:47.052508  1609 raft_consensus.cc:1240] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:47.026566  1688 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50694
I20260709 12:59:47.030165  2269 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 12:59:47.035008  1682 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:47.064999  1682 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:47.066435  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:47.055152  1688 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:47.068179  1688 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:47.067829  1542 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:47.069344  7854 ts_tablet_manager.cc:1403] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 0.478s	user 0.054s	sys 0.054s
I20260709 12:59:47.069249  7688 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:47.079468  7688 raft_consensus.cc:697] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 12 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:59:47.080422  7688 consensus_queue.cc:237] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:47.092794  7854 raft_consensus.cc:359] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:47.090466  1688 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:47.102501  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:47.111231  7733 raft_consensus.cc:993] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d: : Instructing follower dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:47.128626  1609 raft_consensus.cc:3055] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:47.131011  1609 raft_consensus.cc:740] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:47.138514  1542 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:59:47.142796  1609 consensus_queue.cc:260] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:47.152417  7859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 147199196d114d4c90fd8fba442ab7d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:47.125983  7854 raft_consensus.cc:740] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:59:47.142037  7808 raft_consensus.cc:1081] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Signalling peer dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:47.162177  1688 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:47.164292  1655 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:59:47.189157  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 48599.1us
I20260709 12:59:47.191054  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:47.191820  1542 raft_consensus.cc:3055] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:47.192142  1542 raft_consensus.cc:740] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 12:59:47.207206  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 63201.5us
I20260709 12:59:47.209748  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:47.210407  2298 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:47.217592  2298 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 12:59:47.199620  7854 consensus_queue.cc:260] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:47.224997  1542 consensus_queue.cc:260] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:47.226465  1542 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:47.234473  1542 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
W20260709 12:59:47.237789  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 65485.9us
W20260709 12:59:47.246722  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 49098.9us
I20260709 12:59:47.250134  7854 ts_tablet_manager.cc:1434] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.180s	user 0.009s	sys 0.009s
I20260709 12:59:47.264572  7811 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:59:47.303563  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 84681.3us
I20260709 12:59:47.314267  1656 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 12:59:47.329698  1550 tablet_copy_service.cc:342] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-d36fee36a84e4cf98ad42f287d4f317f received from {username='slave'} at 127.0.0.1:42356
I20260709 12:59:47.338640  1550 tablet_copy_service.cc:434] P dbe6a89d0e1c4137b3a1b17bf4b520d8: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-d36fee36a84e4cf98ad42f287d4f317f on tablet d36fee36a84e4cf98ad42f287d4f317f with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:47.368186  1542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:51512
I20260709 12:59:47.368845  1542 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:47.369220  1542 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:47.413364  7746 raft_consensus.cc:993] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower 1d6516ff61104bdda54bde95e92fe579 to start an election
I20260709 12:59:47.411746  7886 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:47.445915  1542 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:47.448206  1542 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:47.435544  7811 raft_consensus.cc:697] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:47.436810  7886 raft_consensus.cc:697] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:47.463147  7886 consensus_queue.cc:237] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:47.467495  7884 raft_consensus.cc:1081] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Signalling peer 1d6516ff61104bdda54bde95e92fe579 to start an election
I20260709 12:59:47.496621  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:47.502113  1688 raft_consensus.cc:3055] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:59:47.502532  1688 raft_consensus.cc:740] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:47.524238  2300 raft_consensus.cc:1217] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.9->[15.10-15.10]   Dedup: 15.10->[]
W20260709 12:59:47.533236  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 72839.1us
I20260709 12:59:47.538595  1688 consensus_queue.cc:260] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:47.548552  1688 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:47.571365  1688 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 18.
I20260709 12:59:47.575990  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:47.576601  1608 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:47.584986  2303 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313"
dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
 from {username='slave'} at 127.0.0.1:32788
I20260709 12:59:47.588421  2303 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:47.588938  2303 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:47.554080  7811 consensus_queue.cc:237] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:47.587296  7859 tablet_copy_client.cc:806] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:47.615460  1608 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 18.
I20260709 12:59:47.616456  1437 catalog_manager.cc:5697] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 11 to 12, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:47.605985  7859 tablet_copy_client.cc:670] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:47.654958  2303 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:59:47.661772  7856 log.cc:927] Time spent T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.057s	user 0.002s	sys 0.000s
I20260709 12:59:47.663266  1505 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:47.665762  7747 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:59:47.666297  7747 raft_consensus.cc:697] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:47.666949  1609 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:47.667161  7747 consensus_queue.cc:237] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:47.694468  1609 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
W20260709 12:59:47.689252  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 153076us
I20260709 12:59:47.696112  2298 raft_consensus.cc:1240] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: []
I20260709 12:59:47.695699   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:47.697947  1534 raft_consensus.cc:1240] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 16. Current term is 17. Ops: []
I20260709 12:59:47.699123  2303 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:47.716933  7859 tablet_copy_client.cc:538] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:47.717650  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:47.725169  1613 raft_consensus.cc:3055] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:47.725500  1613 raft_consensus.cc:740] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:47.731575  1613 consensus_queue.cc:260] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:47.732041  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:47.732700  1534 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:59:47.736697  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.736783  1682 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:59:47.738401  1613 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:47.745138  1612 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:59:47.746956  7880 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:59:47.748670  7823 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:59:47.762372  1613 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 16.
I20260709 12:59:47.772198  2266 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:47.877061  1534 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 16.
W20260709 12:59:48.047012  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 45889.9us
I20260709 12:59:48.056641  1534 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:59:48.072676  7888 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:48.105643  7859 tablet_bootstrap.cc:492] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 12:59:48.118671  7856 tablet_bootstrap.cc:492] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:48.119676  7856 tablet_bootstrap.cc:492] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
W20260709 12:59:48.122022  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 349924us
I20260709 12:59:48.128739  7688 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:48.120376  7856 ts_tablet_manager.cc:1403] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 1.215s	user 0.058s	sys 0.031s
I20260709 12:59:48.181242  7688 raft_consensus.cc:697] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:59:48.189414  7688 consensus_queue.cc:237] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:48.191987  1609 raft_consensus.cc:1275] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 12:59:48.193734  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 49194us
W20260709 12:59:48.201498  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 127228us
W20260709 12:59:48.202366  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 157728us
I20260709 12:59:48.206490  7918 raft_consensus.cc:1064] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:59:48.211177  7856 raft_consensus.cc:359] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:48.212188  7856 raft_consensus.cc:740] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
W20260709 12:59:48.238561  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 59705.8us
I20260709 12:59:48.252810  7856 consensus_queue.cc:260] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:48.273329  7877 consensus_queue.cc:1048] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 12:59:48.325960  7856 ts_tablet_manager.cc:1434] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.171s	user 0.005s	sys 0.010s
W20260709 12:59:48.330936  7910 log.cc:927] Time spent T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.456s	user 0.002s	sys 0.000s
I20260709 12:59:48.336265  2301 raft_consensus.cc:1217] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.11->[16.12-16.12]   Dedup: 16.12->[]
I20260709 12:59:48.401487  1541 raft_consensus.cc:1275] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:59:48.436801  7808 consensus_queue.cc:1048] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:48.449738  1608 raft_consensus.cc:1275] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:59:48.476747  7860 tablet_bootstrap.cc:492] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=2 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:48.477787  7893 consensus_queue.cc:1048] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:48.477010  1438 catalog_manager.cc:5697] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 17 to 18, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 18 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:48.477849  7860 tablet_bootstrap.cc:492] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:59:48.513674  1691 raft_consensus.cc:1275] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:59:48.518898  7918 consensus_queue.cc:237] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:48.531883  1439 catalog_manager.cc:5697] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 16 to 17, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 17 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:48.541453  2297 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:59:48.543319  1550 tablet_copy_service.cc:342] P dbe6a89d0e1c4137b3a1b17bf4b520d8: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-480b368f643b4d85a5daa23529132504 received from {username='slave'} at 127.0.0.1:42356
I20260709 12:59:48.512637  7860 ts_tablet_manager.cc:1403] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 1.500s	user 0.055s	sys 0.067s
I20260709 12:59:48.544693  1550 tablet_copy_service.cc:434] P dbe6a89d0e1c4137b3a1b17bf4b520d8: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-480b368f643b4d85a5daa23529132504 on tablet 480b368f643b4d85a5daa23529132504 with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:48.574400  7738 consensus_queue.cc:1048] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:59:48.581681  7842 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:59:48.623412  7860 raft_consensus.cc:359] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:48.624395  7860 raft_consensus.cc:740] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:59:48.689806  1534 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:59:48.694624  7866 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:59:48.708066  1437 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38804 (request call id 169) took 1283 ms. Trace:
I20260709 12:59:48.736698  2301 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 15 LEARNER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:59:48.733750  1437 rpcz_store.cc:276] 0709 12:59:47.419207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.424222 (+  5015us) service_pool.cc:224] Handling call
0709 12:59:48.702573 (+1278351us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:48.060988 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:48.061606 (+   618us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:48.061644 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:59:48.061662 (+    18us) tablet.cc:662] Decoding operations
0709 12:59:48.062002 (+   340us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:48.062057 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:48.062085 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:48.062270 (+   185us) tablet.cc:701] Row locks acquired
0709 12:59:48.062286 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:59:48.062421 (+   135us) write_op.cc:270] Start()
0709 12:59:48.062544 (+   123us) write_op.cc:276] Timestamp: P: 1783601988062375 usec, L: 0
0709 12:59:48.062564 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:59:48.063287 (+   723us) log.cc:844] Serialized 536 byte log entry
0709 12:59:48.427303 (+364016us) op_driver.cc:464] REPLICATION: finished
0709 12:59:48.541239 (+113936us) write_op.cc:301] APPLY: starting
0709 12:59:48.541328 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:48.542661 (+  1333us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:48.542773 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:48.543542 (+   769us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:48.543753 (+   211us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:59:48.543801 (+    48us) write_op.cc:312] APPLY: finished
0709 12:59:48.544093 (+   292us) log.cc:844] Serialized 25 byte log entry
0709 12:59:48.586364 (+ 42271us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:48.592585 (+  6221us) write_op.cc:454] Released schema lock
0709 12:59:48.609248 (+ 16663us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:48.668550 (+ 59302us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:48.675021 (+  6471us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":113660,"apply.run_cpu_time_us":5300,"apply.run_wall_time_us":91115,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8309,"num_ops":1,"prepare.queue_time_us":434828,"prepare.run_cpu_time_us":8369,"prepare.run_wall_time_us":171394,"raft.queue_time_us":160941,"raft.run_cpu_time_us":77315,"raft.run_wall_time_us":191978,"replication_time_us":364579,"thread_start_us":480183,"threads_started":4,"wal-append.queue_time_us":168843}]]}
W20260709 12:59:48.780851  7941 log.cc:927] Time spent T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 12:59:48.822283  7931 log.cc:927] Time spent T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:59:48.823153  1612 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:59:48.823562  7905 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:59:48.825431  7880 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:59:48.736790  7860 consensus_queue.cc:260] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:48.833997  7860 ts_tablet_manager.cc:1434] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.276s	user 0.004s	sys 0.004s
I20260709 12:59:48.855512  1701 tablet_copy_service.cc:342] P 4487a53c51be4634bf1ef29c5248353d: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-ba9da8e67563442eaf10dbb50de09eb5 received from {username='slave'} at 127.0.0.1:33206
I20260709 12:59:48.856058  1701 tablet_copy_service.cc:434] P 4487a53c51be4634bf1ef29c5248353d: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-ba9da8e67563442eaf10dbb50de09eb5 on tablet ba9da8e67563442eaf10dbb50de09eb5 with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:48.867823  1683 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:59:48.871953  7919 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:48.955916  7896 raft_consensus.cc:1064] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:59:49.004580  1615 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:59:49.043722  7738 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:59:49.046344  7950 log.cc:927] Time spent T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:59:48.984431  7896 consensus_queue.cc:237] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:49.050151   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:49.087611  1438 catalog_manager.cc:5697] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 15 to 16, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 16 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:49.091244  2301 raft_consensus.cc:1217] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 LEARNER]: Deduplicated request from leader. Original: 22.12->[22.13-22.13]   Dedup: 22.13->[]
I20260709 12:59:49.092135  1438 catalog_manager.cc:5697] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 15 to 16, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 16 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:49.233938  7905 raft_consensus.cc:2955] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:49.250131  1616 raft_consensus.cc:2955] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:49.273766  2301 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEARNER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:59:49.275950  1613 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:59:49.278668  1683 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:59:49.278291  7896 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:59:49.286123  7914 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:59:49.289120  7738 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:59:49.316792  2298 raft_consensus.cc:2955] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:49.322609  1683 raft_consensus.cc:2955] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:49.353300  1438 catalog_manager.cc:5697] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index 10 to 11, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:49.367265  1690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:54400
I20260709 12:59:49.368037  1690 raft_consensus.cc:606] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Received request to transfer leadership to TS c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:49.372301  1534 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:47506
I20260709 12:59:49.373080  1534 raft_consensus.cc:606] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:49.377193  1690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db702b262c1644109366a56f6f0d805a"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:54400
I20260709 12:59:49.377936  1690 raft_consensus.cc:606] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Received request to transfer leadership to TS c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:49.409930  7808 raft_consensus.cc:993] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d: : Instructing follower c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:49.410439  7808 raft_consensus.cc:1081] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Signalling peer c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:49.416006  1614 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db702b262c1644109366a56f6f0d805a"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:49312
I20260709 12:59:49.416622  1614 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:49.417011  1614 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:49.421736  7859 tablet_bootstrap.cc:492] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:49.422737  7859 tablet_bootstrap.cc:492] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 12:59:49.423457  7859 ts_tablet_manager.cc:1403] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 1.318s	user 0.054s	sys 0.018s
I20260709 12:59:49.431504   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:59:49.437685   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:49.440068  1614 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:49.445852  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:49.446484  1534 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:49.448092  2301 raft_consensus.cc:2955] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:49.450280  1533 consensus_queue.cc:237] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:49.464708  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:49.465365  1683 raft_consensus.cc:3055] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:49.465664  1683 raft_consensus.cc:740] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:49.466552  1683 consensus_queue.cc:260] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:49.467648  1683 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:49.469220  1435 catalog_manager.cc:5697] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 12 to 13, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:49.471006  1614 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:49.465039  1534 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 12:59:49.474951  1683 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 12:59:49.475363  1581 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:49.476263  7884 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:49.476785  7884 raft_consensus.cc:697] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:49.477614  7884 consensus_queue.cc:237] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:49.481191  7885 raft_consensus.cc:2955] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:49.485968  7859 raft_consensus.cc:359] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:49.486967  7859 raft_consensus.cc:740] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 12:59:49.489387  2301 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:59:49.493899  7916 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:49.500458  1616 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:59:49.500737  1691 raft_consensus.cc:2955] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:49.500737  1613 raft_consensus.cc:2955] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:49.516561  7894 raft_consensus.cc:1064] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:59:49.519229  7894 consensus_queue.cc:237] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 11, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:49.537690  7893 raft_consensus.cc:993] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d: : Instructing follower c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:49.538259  7893 raft_consensus.cc:1081] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Signalling peer c262eac7fc904ae9bb91e450f6532e3f to start an election
I20260709 12:59:49.540232  1616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
 from {username='slave'} at 127.0.0.1:49312
I20260709 12:59:49.540875  1616 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:49.541214  1616 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:49.487696  7859 consensus_queue.cc:260] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:49.548189  1616 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:49.548763  7859 ts_tablet_manager.cc:1434] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.125s	user 0.007s	sys 0.003s
I20260709 12:59:49.550247  1616 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:49.557255  1533 consensus_queue.cc:237] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:49.584401  2298 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 LEARNER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:59:49.587857  1534 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:59:49.591004  1691 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:59:49.586455  7893 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 12:59:49.593175  7894 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:59:49.593647  7877 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:59:49.587867  1439 catalog_manager.cc:5697] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 15 to 16, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 16 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:49.599341  2298 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:59:49.600137  1613 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:59:49.550851  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:49.603547  1683 raft_consensus.cc:3055] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:49.603864  1683 raft_consensus.cc:740] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:49.568080  1627 tablet_copy_service.cc:342] P c262eac7fc904ae9bb91e450f6532e3f: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-147199196d114d4c90fd8fba442ab7d8 received from {username='slave'} at 127.0.0.1:58006
I20260709 12:59:49.605299  1627 tablet_copy_service.cc:434] P c262eac7fc904ae9bb91e450f6532e3f: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-147199196d114d4c90fd8fba442ab7d8 on tablet 147199196d114d4c90fd8fba442ab7d8 with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:49.571130  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:49.606281  2301 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:49.609205  1683 consensus_queue.cc:260] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:49.610574  1683 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:49.601912  7877 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:59:49.624765  1683 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:59:49.625957  1583 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:49.509799  7885 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:59:49.630131  7884 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:49.628715  7914 raft_consensus.cc:2955] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:49.632417  2301 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:59:49.653538  2297 raft_consensus.cc:2955] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:49.655251  7916 raft_consensus.cc:993] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:49.655838  7738 raft_consensus.cc:1081] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:49.656553  7924 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:59:49.657821  7738 raft_consensus.cc:2955] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:49.662889  1691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50694
I20260709 12:59:49.663900  1691 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:49.667142  1691 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:49.665117  2298 raft_consensus.cc:2955] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:49.648280  7884 raft_consensus.cc:697] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:49.689870  1683 raft_consensus.cc:2955] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:49.685992  1439 catalog_manager.cc:5697] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 11 to 12, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New cstate: current_term: 15 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:49.712984  7884 consensus_queue.cc:237] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:49.723491  1691 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:49.732596  1614 raft_consensus.cc:2955] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:49.756052  1672 tablet_service.cc:1558] Processing DeleteTablet for tablet d36fee36a84e4cf98ad42f287d4f317f with delete_type TABLET_DATA_TOMBSTONED (TS 4487a53c51be4634bf1ef29c5248353d not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:50688
W20260709 12:59:49.770253  7965 log.cc:927] Time spent T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:59:49.804553  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 480b368f643b4d85a5daa23529132504 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:49.806560  1425 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d36fee36a84e4cf98ad42f287d4f317f with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:49.880666  1439 catalog_manager.cc:5697] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 13 to 14, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New cstate: current_term: 16 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:49.930048  2303 raft_consensus.cc:1217] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEARNER]: Deduplicated request from leader. Original: 20.12->[20.13-20.13]   Dedup: 20.13->[]
I20260709 12:59:49.930806  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:49.931475  1541 raft_consensus.cc:3055] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:49.931761  1541 raft_consensus.cc:740] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:49.932500  1541 consensus_queue.cc:260] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:49.944809  1541 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:49.957508  7969 tablet_replica.cc:333] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 12:59:49.958695  7969 raft_consensus.cc:2243] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:49.959616  7969 raft_consensus.cc:2272] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:49.973618  1690 raft_consensus.cc:1275] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:59:49.977095  1691 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:49.997110  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:50.000062  2303 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:59:50.006662  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 53722.5us
I20260709 12:59:50.007475  1541 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:59:50.008661  1655 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:50.011230  7894 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:59:50.011786  7894 raft_consensus.cc:697] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:50.012734  7894 consensus_queue.cc:237] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:50.016574  2303 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:59:50.019088  7969 ts_tablet_manager.cc:1916] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:49.982975  7875 consensus_queue.cc:1048] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
W20260709 12:59:50.031922  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 45830.9us
I20260709 12:59:50.059898  7973 raft_consensus.cc:2955] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 22 LEADER]: Committing config change with OpId 22.14: config changed from index 13 to 14, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:50.079254  1541 raft_consensus.cc:1275] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:59:50.086719  2298 raft_consensus.cc:2955] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index 13 to 14, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:50.106478  1603 tablet_service.cc:1558] Processing DeleteTablet for tablet 480b368f643b4d85a5daa23529132504 with delete_type TABLET_DATA_TOMBSTONED (TS c262eac7fc904ae9bb91e450f6532e3f not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:54360
I20260709 12:59:50.110575  7971 consensus_queue.cc:1048] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:50.114948  1533 raft_consensus.cc:2955] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index 13 to 14, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:50.137494  2297 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:59:50.160995  1438 catalog_manager.cc:5697] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 13 to 14, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 14 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:50.209940  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 177051us
W20260709 12:59:50.228592  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 89188.5us
I20260709 12:59:50.230783  7979 tablet_replica.cc:333] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 12:59:50.233182  7883 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:59:50.282390  1435 catalog_manager.cc:5697] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 13 to 14, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:50.285889  7979 raft_consensus.cc:2243] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:50.286777  7979 raft_consensus.cc:2272] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:50.307966  7979 ts_tablet_manager.cc:1916] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:59:50.317425  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 78315.4us
I20260709 12:59:50.335531  1690 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:59:50.394848  7969 ts_tablet_manager.cc:1929] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.11
I20260709 12:59:50.395402  7969 log.cc:1199] T d36fee36a84e4cf98ad42f287d4f317f P 4487a53c51be4634bf1ef29c5248353d: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-2-root/wals/d36fee36a84e4cf98ad42f287d4f317f
I20260709 12:59:50.405457  7875 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:50.410765  1613 raft_consensus.cc:2955] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index 13 to 14, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } attrs { replace: true } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 12:59:50.429028  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 93518.9us
I20260709 12:59:50.436714  1427 catalog_manager.cc:5028] TS 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): tablet d36fee36a84e4cf98ad42f287d4f317f (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:59:50.461503  7971 raft_consensus.cc:1064] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 12:59:50.466260  7979 ts_tablet_manager.cc:1929] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.13
I20260709 12:59:50.466750  7979 log.cc:1199] T 480b368f643b4d85a5daa23529132504 P c262eac7fc904ae9bb91e450f6532e3f: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-1-root/wals/480b368f643b4d85a5daa23529132504
I20260709 12:59:50.469795  1424 catalog_manager.cc:5028] TS c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): tablet 480b368f643b4d85a5daa23529132504 (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:59:50.606317  2301 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:59:50.622677  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 142658us
I20260709 12:59:50.668049  7978 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:59:50.673450   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:50.675218  1541 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:59:50.682850  1435 catalog_manager.cc:5697] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 16 to 17, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 17 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:50.683784  7894 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:59:50.464257  7971 consensus_queue.cc:237] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 11, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:50.739336  1691 consensus_queue.cc:237] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:50.764111  1541 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:59:50.765556  7894 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:59:50.777722  7978 raft_consensus.cc:2955] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index 14 to 15, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:50.781400  2297 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:59:50.785847  7893 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:59:50.799595  2297 raft_consensus.cc:2955] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:50.799849  1534 raft_consensus.cc:2955] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:50.819986  1427 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ba9da8e67563442eaf10dbb50de09eb5 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:50.822912  1691 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:59:50.832140  7975 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:59:50.833469  2301 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEARNER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:59:50.841699  1534 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:59:50.855741  1439 catalog_manager.cc:5697] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 14 to 15, VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) evicted. New cstate: current_term: 22 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:50.871996  7971 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:59:50.874148  7971 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:59:50.932366  1603 tablet_service.cc:1558] Processing DeleteTablet for tablet ba9da8e67563442eaf10dbb50de09eb5 with delete_type TABLET_DATA_TOMBSTONED (TS c262eac7fc904ae9bb91e450f6532e3f not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:54360
I20260709 12:59:50.933463  7979 tablet_replica.cc:333] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 12:59:50.934538  7979 raft_consensus.cc:2243] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:50.935415  7979 raft_consensus.cc:2272] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:50.961951  7979 ts_tablet_manager.cc:1916] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:50.980103  7884 raft_consensus.cc:2955] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 20 LEADER]: Committing config change with OpId 20.14: config changed from index 13 to 14, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:50.982015  1534 raft_consensus.cc:2955] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:51.000933  2301 raft_consensus.cc:2955] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:51.035365  1691 raft_consensus.cc:2955] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index 13 to 14, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:51.028712  1435 catalog_manager.cc:5697] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index 13 to 14, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:51.025890  7979 ts_tablet_manager.cc:1929] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 22.14
I20260709 12:59:51.043413  7979 log.cc:1199] T ba9da8e67563442eaf10dbb50de09eb5 P c262eac7fc904ae9bb91e450f6532e3f: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-1-root/wals/ba9da8e67563442eaf10dbb50de09eb5
I20260709 12:59:51.048779  1424 catalog_manager.cc:5028] TS c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): tablet ba9da8e67563442eaf10dbb50de09eb5 (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
W20260709 12:59:51.105221  7995 log.cc:927] Time spent T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.085s	user 0.003s	sys 0.011s
I20260709 12:59:51.232759  1614 consensus_queue.cc:237] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:51.239830  1688 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:59:51.241909  2301 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:59:51.243582  7884 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:59:51.252677  7975 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 12:59:51.267161  7884 raft_consensus.cc:2955] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index 14 to 15, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:51.268798  1688 raft_consensus.cc:2955] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:51.321381  2301 raft_consensus.cc:2955] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:51.326463  1438 catalog_manager.cc:5697] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index 14 to 15, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New cstate: current_term: 20 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 12:59:51.343681  1532 tablet_service.cc:1558] Processing DeleteTablet for tablet 147199196d114d4c90fd8fba442ab7d8 with delete_type TABLET_DATA_TOMBSTONED (TS dbe6a89d0e1c4137b3a1b17bf4b520d8 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:51498
I20260709 12:59:51.353529  1424 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 147199196d114d4c90fd8fba442ab7d8 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:51.432720  8000 tablet_replica.cc:333] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 12:59:51.441478  8000 raft_consensus.cc:2243] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:51.442813  8000 raft_consensus.cc:2272] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:51.459836  8000 ts_tablet_manager.cc:1916] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:51.484634  8000 ts_tablet_manager.cc:1929] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.14
I20260709 12:59:51.485388  8000 log.cc:1199] T 147199196d114d4c90fd8fba442ab7d8 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Deleting WAL directory at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0/minicluster-data/ts-0-root/wals/147199196d114d4c90fd8fba442ab7d8
I20260709 12:59:51.488158  1425 catalog_manager.cc:5028] TS dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): tablet 147199196d114d4c90fd8fba442ab7d8 (table test-workload [id=272e6f12e54643de81b83540c6afa8d4]) successfully deleted
I20260709 12:59:51.899185   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:59:53.025064  1638 debug-util.cc:398] Leaking SignalData structure 0x7b08003b17a0 after lost signal to thread 434
I20260709 12:59:53.094713  8005 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.095350  8005 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.099129  8008 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:53.099821  8008 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.102231  8008 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.102890  8008 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.103487  8008 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.112659  8008 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.115406  8005 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.128598  8006 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.135524  8005 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.135851  8008 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.124114  8004 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.135937  7884 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:53.136456  8008 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.146157  7884 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.147516  8008 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:53.136242  8005 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.137177  8009 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.150563  8007 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 12:59:53.172811  2269 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.247s	user 0.008s	sys 0.016s
I20260709 12:59:53.173534  8010 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.180117  7894 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.153100  8004 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.164753  7884 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.136804  8006 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:59:53.184504   436 debug-util.cc:398] Leaking SignalData structure 0x7b080000f7a0 after lost signal to thread 2267
I20260709 12:59:53.184669  8007 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:59:53.185621  2269 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.260s	user 0.008s	sys 0.017s
W20260709 12:59:53.189040  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 1.26369e+06us
I20260709 12:59:53.194376  8019 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:53.194813  8018 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.195078  8019 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.195375  8018 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.197393  8019 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.197981  8019 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.198976  8013 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 12:59:53.189652   436 kernel_stack_watchdog.cc:198] Thread 2267 stuck at /apache/dev/git/kudu/src/kudu/util/thread.cc:642 for 256ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 12:59:53.190021  7884 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:53.206634  8005 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.200981  8015 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.208602  8015 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.211059  8015 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.215775  7884 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.218370  8016 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:53.218828  7884 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.218961  8016 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.220214  7884 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:53.220741  7884 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.221745  8007 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.188148  7894 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.222657  7884 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.223168  7884 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:53.223790  7894 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:53.187021  8010 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.226289  8010 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.228650  8004 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.187691  8009 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.231899  8009 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.200194  8012 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:53.232816  8012 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.235258  8012 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.223649  7884 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.225100  8017 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.199680  8013 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.197393  8018 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.218542  8006 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.270705  8014 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.212442  8019 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.250349  8009 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.281491  7884 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.266817  7906 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:53.267184  7894 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.265983  8008 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.270308  8005 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:53.305583  8024 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.283056  8013 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.274791  8023 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.276353  8006 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:53.334750  8032 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.246651  8017 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.351979  8017 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.277091  8025 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:53.353255  8025 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.355847  8025 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.357861  8019 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.335829  8012 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:53.359040  8012 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.361526  8012 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.303543  7733 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:53.364871  7733 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.367156  7733 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.367713  7733 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.373397  8026 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:53.374151  8026 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.322310  7894 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.379295  7894 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:53.379894  7894 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.307273  7906 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.383178  7906 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:53.319870  8024 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:59:53.384210  2266 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.449s	user 0.014s	sys 0.009s
W20260709 12:59:53.384898  2266 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.450s	user 0.015s	sys 0.009s
W20260709 12:59:53.374735  2267 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.447s	user 0.016s	sys 0.008s
W20260709 12:59:53.386243  2267 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.458s	user 0.017s	sys 0.008s
I20260709 12:59:53.386516  8024 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:53.387197  8024 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:53.388960  8021 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:53.389638  8021 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.390213  7984 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.390724  7984 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.391399  7884 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:53.391925  7884 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.394582  7884 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.395133  7884 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:53.396324  8032 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.335997  8008 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.398656  8032 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.399856  8008 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.288815  8014 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.402323  8021 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.402884  8021 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.403333  8021 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.403812  8014 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.404747  8013 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.395750  7884 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.405426  8013 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.408339  8027 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.302011  8020 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.304574  8009 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.346360  8033 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:53.348090  8023 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.349051  8006 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.405329  8019 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 12:59:53.410667  1638 debug-util.cc:398] Leaking SignalData structure 0x7b08003575a0 after lost signal to thread 1474
I20260709 12:59:53.411455  8018 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.368186  7733 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.283842  8016 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:53.414270  1613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:53.407459  7738 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.408102  8013 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.387800  8024 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.429920  8041 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.435106  7738 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.412292  7975 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:53.448776  7975 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.450977  7975 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.434695  1613 raft_consensus.cc:606] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:53.431509  8026 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.438239  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.452653  8018 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.453464  7738 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.438416  7733 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:53.454680  8018 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.317361  8005 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.456871  8005 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.457276  8041 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.438594  8023 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.439353  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.425419  7884 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.440500  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.431136  8020 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.441249  8029 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.441625  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.444351  8009 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.447219  8024 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.460624  8016 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.460798  8028 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:53.461203  7733 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:53.461684  8014 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:53.465070  8018 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.467377  8007 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.445313  8019 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.494248  8007 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.494748  7733 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.468163  8032 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.469231  1608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 12:59:53.470068  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.471207  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.496443  8009 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.496773  8018 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.497121  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.497490  8009 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.497974  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.498611  1613 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 17.
I20260709 12:59:53.494403  8014 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.499433  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.499963  8009 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.436424  8033 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.496877  1608 raft_consensus.cc:606] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:53.488194  8036 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.501305  7896 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.501044  8023 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.472873  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.473762  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.501400  8013 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.501865  7896 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.502585  8013 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.503520  8033 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.503953  7896 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.474541  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.480943  8042 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:53.481920  8005 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.502031  8032 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.504683  7896 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.505118  8005 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.506019  7896 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.506743  8032 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.498950  8018 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.482472  7906 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.473258  8038 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.502130  8023 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.508447  7738 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:53.508332  8038 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.508992  7738 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.507463  7906 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.510456  8038 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:53.510823  7738 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.508347  8004 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.511655  7906 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.511533  8004 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.512676  8018 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.513247  8018 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.513708  8004 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.501914  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.515156  1608 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 12:59:53.515357  8018 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.500537  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.501729  8036 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.509994  8023 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.505024  8042 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.504544  8013 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.517491  8028 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.501046  8007 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.508056  7896 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.507401  8005 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.519510  7733 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:53.519685  8028 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.498243  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.500620  8014 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:53.521011  8036 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:53.494249  8029 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.521852  8016 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.518567  8042 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:53.523577  8029 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.523927  8016 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.380375  7894 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.526414  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.527458  8021 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.528249  8006 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:59:53.529035  1488 auto_rebalancer.cc:629] Failed to schedule move for tablet 0e84698abe8e46788d46c9bf8a4c74c7: Remote error: Service unavailable: leader transfer in progress
W20260709 12:59:53.533257  1638 debug-util.cc:398] Leaking SignalData structure 0x7b08000d8240 after lost signal to thread 1566
I20260709 12:59:53.500753  8019 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:59:53.534441  1638 debug-util.cc:398] Leaking SignalData structure 0x7b08001a14e0 after lost signal to thread 1641
I20260709 12:59:53.534719  1614 consensus_queue.cc:237] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
W20260709 12:59:53.535563  1638 debug-util.cc:398] Leaking SignalData structure 0x7b080031f700 after lost signal to thread 1715
W20260709 12:59:53.538952  1638 debug-util.cc:398] Leaking SignalData structure 0x7b080016f140 after lost signal to thread 2327
I20260709 12:59:53.538723  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.541911  1691 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 18.
I20260709 12:59:53.539063  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.539273  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.543269  1688 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 14.
W20260709 12:59:53.543977  1638 debug-util.cc:398] Leaking SignalData structure 0x7b08003b89e0 after lost signal to thread 7902
I20260709 12:59:53.552204  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.552944  1688 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 13.
I20260709 12:59:53.472801  8037 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.558118  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.525233  7984 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:53.427191  8027 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.565809  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.555449  8024 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:53.570727  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.555454  8043 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:53.574997  8043 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.575779  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.576408  1533 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 17.
I20260709 12:59:53.577152  8043 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.558125  8016 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.575814  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.577980  8046 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:53.578202  1610 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:59:53.578495  8046 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.580191  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.580669  8046 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.580848  1533 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 17.
I20260709 12:59:53.581434  8016 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.582062  7894 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:53.583036  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.583465  8027 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.583631  1533 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 18.
I20260709 12:59:53.574183  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.574389  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.584649  8041 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.632884  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.632778  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.589908  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.583417  8016 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.627518  8043 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:53.585104  8024 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.585099  7733 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:53.586717  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.587567  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.629009  7894 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:53.629282  8046 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.630640  1505 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:53.646235  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:53.647687  8044 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:53.648602  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.631786  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.649344  8008 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:53.649893  8008 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.652086  8008 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.573649  8013 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.635120  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:53.660127  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.633757  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.636238  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.637315  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:53.580899  8020 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.661913  1505 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:53.573808  8012 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.564687  8006 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.648339  8044 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.656865  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.658293  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.658783  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.635824  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.581159  8014 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.661123  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.587536  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.564301  8011 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.662999  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.663256  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.664290  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.664896  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.664997  8016 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:53.657132  8043 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.665603  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.627952  7884 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:53.701025  1617 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 12:59:53.701117  7884 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.703788  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:53.666100  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.667237  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.704639  8016 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.705875  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.706795  8016 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.706964  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.707599  1684 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:59:53.707736  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.707989  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:53.668087  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.668390  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.708907  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.668624  7906 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:53.709475  1683 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 20.
I20260709 12:59:53.709793  7906 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.668898  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.710281  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.669101  8009 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:53.710712  1537 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 15.
I20260709 12:59:53.711006  8009 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.711515  8043 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.710884  1683 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 12:59:53.669255  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.670387  7984 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.652192  8042 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.712769  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.712859  7984 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.712931  8042 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.564632  8037 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.673432  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.654196  8046 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.726248  8046 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:53.642037  8025 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:53.726919  8025 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.729076  8025 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:53.674516  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.729328  1583 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:53.729802  1608 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 12:59:53.674997  8013 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.731964  8013 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.660390  7894 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.733455  7984 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.733918  7894 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:53.713810  8011 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.738195  8014 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.698179  8012 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.742225  8037 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.742937  8011 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.740411  8014 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:53.745873  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:53.676419  7733 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.749517  2302 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 22.
I20260709 12:59:53.750543  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:53.750816  7733 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.751370  8012 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.677404  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.677646  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.680553  8044 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:53.682236  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.682907  7896 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:53.752216  1686 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 22.
I20260709 12:59:53.752450  7896 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:53.752938  7896 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:53.753836  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.755059  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.756054  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.684885  2269 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 12:59:53.757532  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.757759  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.758239  8041 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:59:53.758663  8041 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.759087  8041 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:53.686707  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:53.693699  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.758700  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.693262  8024 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.696596  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:53.802940  2296 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:59:53.803073  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.804061  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:53.804241  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.805274  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:53.696806  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:53.692134  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:53.698426  1541 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 24.
I20260709 12:59:53.791821  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.586876  8038 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.809185  1685 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:59:53.809659  8038 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.810133  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.810714  1689 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 19.
I20260709 12:59:53.810747  1685 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 17.
I20260709 12:59:53.811728  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.698977  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:53.713299  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.812799  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.671511  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.811870  8038 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:53.815006  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.815428  1583 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:53.713910  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.662317  8023 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:59:53.715405  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.795735  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:53.816282  1684 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 14.
I20260709 12:59:53.816959  1685 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 12:59:53.711984  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.715970  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:59:53.721061  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 65464.5us
I20260709 12:59:53.722319  7906 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:53.819010  1583 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:53.722571  8042 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.722987  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.724368  8009 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:53.797065  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:53.709056  7884 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.821408  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.794657  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:53.695611  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:53.822750  8041 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.823082  2303 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 12:59:53.822784  2295 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
I20260709 12:59:53.799976  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.825125  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:59:53.825902  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.826294  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.827356  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.827876  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.822794  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.828715  8026 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:53.828510  1536 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 12:59:53.829187  8026 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:53.829632  8026 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:53.830299  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.830889  1537 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:59:53.586776  8028 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:53.832911  8028 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.835042  8028 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:53.819380  8023 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.835875  8023 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:53.829818  1688 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
W20260709 12:59:53.756879  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 72080.5us
I20260709 12:59:53.838651  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.802135  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.813946  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.840286  1691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:54400
I20260709 12:59:53.840930  1691 raft_consensus.cc:606] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:53.845255  8041 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.845721  1537 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:59:53.818631  8006 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.848860  8006 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.817899  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.817199  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.846213  1581 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:53.850627  8023 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.819378  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.856001  1582 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:53.821229  8012 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:59:53.856776  8012 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:53.857225  8012 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:59:53.828358  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.730252  8020 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:53.860707  8020 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:53.861148  8020 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:53.863189  1683 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:59:53.758999  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.838668  2269 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
W20260709 12:59:53.864065  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 45675.2us
I20260709 12:59:53.865090  7975 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:53.866051  2267 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:53.866353  7984 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:53.866745  7984 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:53.866990  2267 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:53.867166  7984 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:53.820591  1686 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 10.
I20260709 12:59:53.867848  2267 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:53.870028  8025 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:59:53.870432  8025 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.870710  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.871169  8008 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:59:53.851224  8019 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:53.871703  8008 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.872114  8008 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:53.871275  8045 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:59:53.872568  8045 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.872529  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.873179  8045 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:53.874687  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.801510  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:53.875938  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.878134  8012 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.879088  2267 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:53.879355  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.880362  8012 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.881053  1581 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:53.882050  8020 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.866761  7896 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.865279  2269 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 12:59:53.870786  8025 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:53.884874  7906 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:53.885033  7896 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.885345  7906 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.885685   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:59:53.885854  8012 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:53.885787  7906 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:53.885710  1581 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:53.887450   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:53.888029  1581 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:53.888789  8019 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:59:53.889518  8019 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:59:53.889850  8019 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.890189  8019 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:53.888935  1581 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:53.884907  1583 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:53.893733  1583 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:53.893916  7884 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:53.894428  7884 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.894769  7884 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:53.884224  8020 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.895766  1583 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:53.896984  8042 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:53.897338  8042 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:53.897670  8042 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:53.897786  8039 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:53.898622  8039 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:53.899766  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:53.901079  2267 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:53.901625  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:53.901788  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:53.904677  8009 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:59:53.905139  8009 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:53.905491  8009 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:59:53.908361  8021 raft_consensus.cc:993] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:53.908916  8021 raft_consensus.cc:1081] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:53.909109  8030 raft_consensus.cc:993] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:53.909677  8030 raft_consensus.cc:1081] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 12:59:53.911373  7884 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:59:53.912588  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 215104us
I20260709 12:59:53.915431  8035 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:59:53.918740  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 53545.5us
I20260709 12:59:53.918622  8042 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.919902  7884 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.922408  8008 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.923625  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.923846  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.924773  8008 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.924980  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.925222  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.925796  1582 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:53.926270  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:53.927740  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.928579  7984 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.930827  7984 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.931619  8019 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:53.932267  1654 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:53.933101  8038 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:53.933506  8038 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:53.933602  8045 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.933917  8038 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:53.935950  8045 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:53.938019  8025 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:53.938863  8012 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:53.940171  8025 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:53.895864  8020 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:59:53.855793  8026 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:54.007598  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:54.037487  1507 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:54.038077  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:54.038691  8026 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:54.039103  2266 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.039294  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:54.039817  8006 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:54.040513  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:53.954195  8038 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:54.042475  8038 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:53.942397  1654 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:54.043260  1507 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:59:54.043699  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 101372us
I20260709 12:59:54.044063  8006 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:59:54.044520  8006 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:54.044628  1654 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:54.044917  8006 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:59:54.046686  8051 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:54.047106  8051 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:54.047439  8051 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:54.052695  8028 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:59:54.053203  8028 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:54.053582  8028 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:54.055646  8006 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:54.056828  2266 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.057595  8025 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:54.059648  1507 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:53.962845  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:53.944530  1537 raft_consensus.cc:1240] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 17. Current term is 18. Ops: []
I20260709 12:59:54.008713  2299 raft_consensus.cc:1240] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 15. Current term is 16. Ops: []
I20260709 12:59:54.062072  1507 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:53.941483  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:54.062855  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:54.063270  8006 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:54.063426  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.964395  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:54.063781  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:54.063989  7896 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:54.064417  7896 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:54.001187  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:54.064885  7896 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:53.933130  8009 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:54.067366  8009 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:54.007231  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:54.052767  8045 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:54.068691  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:54.069146  8038 consensus_queue.cc:1059] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:54.069401  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:54.070235  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:53.980093  8042 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:54.010905  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.985216  8019 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:54.002089  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.959347  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:54.064687  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:54.073547  1656 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:53.960153  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:54.074075  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:54.074630  8036 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:53.941244  8039 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:59:54.075155  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:54.065690  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:54.076418  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.961874  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:54.077369  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:54.077519  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:54.077647  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:54.078488  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:54.078588  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:54.078750  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:54.076190  1508 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:54.065590  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:54.079942  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:53.942664  7906 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:54.080310  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:54.080698  8013 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:54.081389  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:54.082208  7906 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:54.000718  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:53.954877  1582 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:53.945160  2269 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.026160  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:54.026342  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:54.027334  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:54.028388  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:54.084803  7906 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:59:54.083801  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 129028us
I20260709 12:59:54.086108  8020 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:59:54.084491  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 139382us
I20260709 12:59:54.076251  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:54.087193  2269 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:53.941613  1583 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.030360  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:54.087512  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:54.030678  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:54.031330  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:53.994647  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:54.089068  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:54.060702  8018 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:54.090009  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:54.074777  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:59:54.091218  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 149680us
I20260709 12:59:54.060659  1538 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:54.091920  1583 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:54.070786  8024 raft_consensus.cc:3055] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:54.092577  8024 raft_consensus.cc:740] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:54.024958  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:54.029124  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:54.093477  8024 consensus_queue.cc:260] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:54.091398  8012 raft_consensus.cc:2955] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Committing config change with OpId 17.15: config changed from index -1 to 15, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:54.094545  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:54.088378  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:54.090147  8018 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:54.096259  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:54.096599  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:54.096872  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:54.097615  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:54.098088  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:53.963156  8023 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:54.098881  2269 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.092731  8039 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:54.093012  8047 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:59:54.100870  8045 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:54.086537  8020 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:54.100615  8042 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:59:54.096381  8018 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:54.102039  8042 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:54.102461  8042 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:59:54.102761  8036 raft_consensus.cc:993] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d: : Instructing follower dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:54.103219  8036 raft_consensus.cc:1081] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Signalling peer dbe6a89d0e1c4137b3a1b17bf4b520d8 to start an election
I20260709 12:59:54.092799  1583 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.104964  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:54.107520  1682 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50708
I20260709 12:59:54.108155  1682 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:54.108551  1682 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:54.109113  8030 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:59:54.111367  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:54.111440  1655 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:53.994472  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:54.112617  8044 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:59:54.113263  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:54.101836  8047 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:54.113896  8047 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:54.114512  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:54.094726  8024 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:54.116757  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:54.117127  1655 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.118407  8044 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:54.101594  8020 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:54.119961  8044 consensus_queue.cc:1059] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:54.112713  1686 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50708
I20260709 12:59:54.121013  8044 raft_consensus.cc:3055] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:59:54.121423  8044 raft_consensus.cc:740] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:54.122224  8044 consensus_queue.cc:260] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:54.123489  8044 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:54.121024  1686 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:54.124214  1686 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:54.124949  1656 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:54.125789  8038 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:59:54.126729  2266 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.128960  7906 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:54.100082  2269 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.130540  2269 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.131286  1686 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:54.131623  2269 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:54.132443  8009 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:59:54.083791  1508 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:54.132861  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:54.133277  8009 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:54.133677  8009 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:54.134089  8009 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:54.135936  8023 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:59:54.086359  2302 raft_consensus.cc:1240] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 18. Current term is 19. Ops: []
W20260709 12:59:54.136991  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 53298.6us
I20260709 12:59:54.137903  1508 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:54.157312  1508 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:54.139261  2269 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:59:54.174944  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 112951us
I20260709 12:59:54.132722  8045 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:54.175606  1507 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:54.143020  1655 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.147732  2266 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.135421  1537 raft_consensus.cc:2955] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Committing config change with OpId 17.15: config changed from index -1 to 15, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:54.150120  8042 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:54.141817  8047 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:54.176927  1689 raft_consensus.cc:1240] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 17. Current term is 18. Ops: []
I20260709 12:59:54.151485  1682 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:54.153777  1540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:51512
I20260709 12:59:54.178762  1540 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:54.179195  1540 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:54.155014  8051 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:54.157570  8018 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:54.157960  8023 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:54.133507  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:54.158941  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:54.161139  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:54.161860  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:54.162190  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:54.162943  1583 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.163636  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:54.163890  1538 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 19.
I20260709 12:59:54.187433  1541 raft_consensus.cc:1240] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 18. Current term is 19. Ops: []
I20260709 12:59:54.165269  7896 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:54.141817  8009 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:54.182199  1655 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.183147  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:54.183171  1686 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:54.188462  2266 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.188925  1508 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:54.189425  1583 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.190099  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:54.194268  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:54.194914  8027 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:54.195017  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:54.196408  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:54.198285  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:54.199457  8028 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:54.200417  8040 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:54.192091  7984 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:54.201639  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:54.202713  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:54.203686  2302 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 20. Current term is 21. Ops: []
I20260709 12:59:54.203984  8042 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:54.190276  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:54.190867  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:54.204012  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:54.191119  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:54.191285  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:54.206622  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:54.191586  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:54.191532  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:54.206720  2269 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.206775  1655 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.209563  2302 raft_consensus.cc:1240] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 17. Current term is 18. Ops: []
I20260709 12:59:54.209463  1682 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:54.210798  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:54.211874  2267 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.213197  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:54.200964  8047 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:54.214745  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:54.215791  1533 raft_consensus.cc:1240] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 16. Current term is 17. Ops: []
I20260709 12:59:54.215903  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:54.216153  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:54.216014  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:54.217875  1682 raft_consensus.cc:1240] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:54.219408  2267 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.182472  8025 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:59:54.221056  1655 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.222043  2269 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.223650  1508 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:54.225780  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:54.187875  8044 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:54.225994  8018 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:54.227592  2267 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:54.227489  1688 raft_consensus.cc:1240] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 18. Current term is 19. Ops: []
I20260709 12:59:54.222645  1582 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.228621  1612 raft_consensus.cc:1240] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:54.191562  8006 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:54.229684  1611 raft_consensus.cc:1240] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:54.211726  8021 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:54.232409  7733 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:59:54.234331  1617 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 19. Current term is 20. Ops: []
I20260709 12:59:54.215251  8019 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:59:54.233866  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:54.232401  1655 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.232812  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:54.233618  1508 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:54.233855  2269 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:54.218077  8042 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:59:54.218164  8013 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:59:54.244299  1508 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:54.248694  1655 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.229630  8050 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:59:54.229362  8045 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:54.232167  8036 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:54.257997  1655 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.258693  7733 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:54.236595  8029 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:59:54.232784  8046 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:54.216516  8038 consensus_queue.cc:1059] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.026s
I20260709 12:59:54.236853  7984 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:59:54.238066  8005 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:59:54.246580  8018 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:59:54.281939  8018 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:54.282346  8018 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:59:54.284901  1687 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 18.
I20260709 12:59:54.285415  8038 raft_consensus.cc:3055] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:59:54.285877  8038 raft_consensus.cc:740] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:54.262079  8044 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:54.286801  8011 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:54.246315  8013 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:54.287706  8013 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:59:54.289892  8020 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:54.292934  7896 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:54.297365  1613 raft_consensus.cc:1240] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:54.229753  8049 consensus_queue.cc:1059] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 12:59:54.299362  8049 raft_consensus.cc:3055] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:59:54.274827  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 52262.3us
W20260709 12:59:54.275398  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 46622.6us
I20260709 12:59:54.299554  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:54.300235  1582 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:54.301410  1582 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:54.302373  7977 consensus_queue.cc:1059] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:54.302693  7884 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:54.277685  1508 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:54.264433  8029 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:54.305405  1508 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:54.305498  8029 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:54.306545  1508 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:54.302539  8009 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:54.307444  1508 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:54.307586  7896 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:59:54.308387  7896 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:54.243052  8030 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:54.309047  7896 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:54.309432  7896 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:54.277261  8024 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:59:54.309725  8023 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:54.310175  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:54.311829  8049 raft_consensus.cc:740] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:54.309489  8047 raft_consensus.cc:3055] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:59:54.312696  8049 consensus_queue.cc:260] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:54.313352  8047 raft_consensus.cc:740] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:54.314035  8049 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:54.314184  8047 consensus_queue.cc:260] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:54.304373  7977 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:59:54.318595  1508 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:54.279017  8057 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:54.319787  8023 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:54.320135  8028 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:54.278450  1689 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 16.
I20260709 12:59:54.280712  7984 raft_consensus.cc:697] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 19 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:59:54.302525  1582 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
W20260709 12:59:54.339421  1582 consensus_peers.cc:597] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a2233a4e08d4138b4eb687a0440be86. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:54.320405  1508 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:54.340155  1582 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:54.337574  1540 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:54.322960  8038 consensus_queue.cc:260] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:54.310422  8020 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:59:54.331424  8053 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:59:54.332649  8018 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:54.235316  8006 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:54.276325  1655 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.315580  8047 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:54.365871  8006 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:54.367605  1540 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:54.353077  8021 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:54.354575  1541 raft_consensus.cc:1240] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 16. Current term is 17. Ops: []
I20260709 12:59:54.353138  8027 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:54.337450  7896 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:54.359233  1438 catalog_manager.cc:5697] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: config changed from index -1 to 15, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 17 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:54.352994  2267 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:59:54.393175  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 50469.3us
I20260709 12:59:54.393858  1654 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.394893  8057 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:59:54.395293  1654 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:54.396080  8024 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:54.396772  8057 consensus_queue.cc:1059] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:59:54.397204  8024 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:59:54.397863  8057 raft_consensus.cc:3055] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:54.398239  8057 raft_consensus.cc:740] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:59:54.393467  8020 consensus_queue.cc:1059] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.005s
I20260709 12:59:54.399128  8057 consensus_queue.cc:260] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:54.393121  1505 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:54.340652  7977 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:54.359673  8011 consensus_queue.cc:1059] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 12:59:54.401675  7896 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:54.376808  8028 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:54.369096  8018 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:54.399503  8026 raft_consensus.cc:3055] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 20 LEADER]: Stepping down as leader of term 20
W20260709 12:59:54.367625  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 91418.7us
I20260709 12:59:54.403237  8026 raft_consensus.cc:740] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:54.403829  7896 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:54.404126  8026 consensus_queue.cc:260] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:54.405107  1688 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 16. Current term is 17. Ops: []
I20260709 12:59:54.353510  1508 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:54.405719  8026 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:59:54.402185  8011 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:59:54.407274  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 53845.7us
I20260709 12:59:54.407852  8011 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:59:54.408305  8011 raft_consensus.cc:697] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:54.409515  1505 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:54.409838  8020 consensus_queue.cc:1059] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:54.410118  1655 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.376927  7984 consensus_queue.cc:237] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:54.411589  1655 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.412369  8036 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:54.413180  8036 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:54.403004  8058 raft_consensus.cc:3055] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:59:54.417086  8058 raft_consensus.cc:740] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:54.418036  8058 consensus_queue.cc:260] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:54.417027  8028 consensus_queue.cc:1059] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.003s
I20260709 12:59:54.419389  8058 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:54.422065  1540 raft_consensus.cc:1240] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 16. Current term is 17. Ops: []
I20260709 12:59:54.423177  8028 consensus_queue.cc:1059] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:54.425521  1505 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:54.425844  8057 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:54.426730  1505 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:54.431833  1505 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:54.427989  8027 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:54.425675  8018 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:59:54.430369  7896 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:59:54.427913  8012 consensus_queue.cc:1059] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:54.424363  8028 raft_consensus.cc:3055] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:54.431177  1684 raft_consensus.cc:2955] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Committing config change with OpId 17.15: config changed from index -1 to 15, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 12:59:54.432723  8011 consensus_queue.cc:237] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:54.433405  8028 raft_consensus.cc:740] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:54.398427  1654 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.439469  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:54.440212  1540 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:54.441264  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:54.443390  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:54.410948  8020 raft_consensus.cc:3055] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:54.447602  1654 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.448241  1505 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:54.454509  1505 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:54.455406  1507 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:54.457449  1654 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.458624  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:54.461347  8018 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:54.461747  8023 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:59:54.462180  8018 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:54.462895  1505 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:54.463573  8014 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:54.451776  8027 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:54.451953  8024 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:59:54.466671  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.469930  1505 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:54.470719  8023 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:54.472280  1505 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:54.472909  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:54.473567  1654 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.477632  2295 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 24. Current term is 25. Ops: []
I20260709 12:59:54.478459  2294 raft_consensus.cc:1240] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:54.479337  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:54.480325  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:54.483618  1535 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 19. Current term is 20. Ops: []
I20260709 12:59:54.485458  8035 consensus_queue.cc:1059] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:59:54.486543  8035 raft_consensus.cc:3055] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:59:54.486862  8035 raft_consensus.cc:740] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:54.487712  8035 consensus_queue.cc:260] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:54.489379  2294 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 17. Current term is 18. Ops: []
I20260709 12:59:54.490990  8035 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:59:54.493325  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:54.493673  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:54.494115  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:54.499086  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:54.507251  1615 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 12:59:54.509382  1611 raft_consensus.cc:1240] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 17. Current term is 18. Ops: []
I20260709 12:59:54.509495  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:54.512699  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:54.516183  2266 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:54.515933  8009 consensus_queue.cc:1059] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:59:54.521243  8009 raft_consensus.cc:3055] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:54.521682  8009 raft_consensus.cc:740] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:59:54.522820  8009 consensus_queue.cc:260] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:54.523692  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:54.516836  8025 consensus_queue.cc:1059] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:54.524423  1609 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:54.525125  8025 raft_consensus.cc:3055] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:54.525476  8025 raft_consensus.cc:740] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:59:54.526224  8025 consensus_queue.cc:260] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:54.527355  8025 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:54.524277  8009 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:54.531775  1609 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 19.
I20260709 12:59:54.536978  8042 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:59:54.539850  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:54.540892  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:54.543094  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:54.544545  1617 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 12:59:54.548039  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:54.548848  2299 raft_consensus.cc:2393] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 16: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:59:54.555318  1610 raft_consensus.cc:1240] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 10. Current term is 11. Ops: []
I20260709 12:59:54.557826  2298 raft_consensus.cc:1240] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:54.559947  2302 raft_consensus.cc:1240] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:54.560565  2299 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 18. Current term is 19. Ops: []
I20260709 12:59:54.562269  1540 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
W20260709 12:59:54.566895  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 333091us
I20260709 12:59:54.450961  8020 raft_consensus.cc:740] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:54.383713  8006 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:54.550107  8037 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:59:54.554718  8044 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:54.570209  8009 consensus_queue.cc:1059] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:59:54.563687  8018 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:59:54.589915  1488 auto_rebalancer.cc:629] Failed to schedule move for tablet 0507fcc8f9794c668a81d8519fc995be: Illegal state: Replica dbe6a89d0e1c4137b3a1b17bf4b520d8 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 12:59:54.593699  1582 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
W20260709 12:59:54.603397  2267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:54.612751  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 44890.2us
I20260709 12:59:54.635354  1536 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 12:59:54.637002  2269 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:54.629328  1582 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.641216  1537 raft_consensus.cc:2393] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 17: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:59:54.571213  8038 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:54.578701  8051 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:54.590407  8009 raft_consensus.cc:3055] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:59:54.654155  8009 raft_consensus.cc:740] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:59:54.655198  8009 consensus_queue.cc:260] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:59:54.657503  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 184024us
I20260709 12:59:54.658265  1654 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:54.575326  8046 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:54.662470  1654 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:59:54.667286  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 105358us
I20260709 12:59:54.607054  8013 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:54.670169  2269 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.670163  1654 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:54.644802  8035 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:59:54.674911  8036 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:54.675199  8059 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:54.571542  8023 consensus_queue.cc:1059] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.090s
I20260709 12:59:54.593621  8055 consensus_queue.cc:1059] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 12:59:54.677683  1654 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.573645  8021 consensus_queue.cc:1059] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.093s
I20260709 12:59:54.661440  8009 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:59:54.680086  2269 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:54.685746  2269 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:54.687609  8050 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:54.688288  8050 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:54.688805  8050 raft_consensus.cc:697] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:59:54.662003  7975 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:59:54.667522  8051 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:59:54.662295  8041 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:59:54.580741  8020 consensus_queue.cc:260] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:54.683800  8067 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:59:54.599129  8028 consensus_queue.cc:260] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:54.689651  8050 consensus_queue.cc:237] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:54.661303  8039 consensus_queue.cc:1059] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 12:59:54.694578  8035 consensus_queue.cc:1059] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:59:54.678400  8033 consensus_queue.cc:1059] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:59:54.696995  8030 raft_consensus.cc:3055] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:59:54.677984  8047 raft_consensus.cc:3055] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:54.669324  8029 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:54.699193  8039 raft_consensus.cc:3055] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:59:54.699573  8039 raft_consensus.cc:740] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:54.699491  8061 consensus_queue.cc:1059] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 12:59:54.680630  8042 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:59:54.691535  8013 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:54.699143  8047 raft_consensus.cc:740] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:54.700490  8039 consensus_queue.cc:260] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:54.702129  8029 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:54.702564  8006 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:54.706390  8047 consensus_queue.cc:260] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:54.707655  8047 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:54.697342  8030 raft_consensus.cc:740] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:54.708459  8011 raft_consensus.cc:3055] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:59:54.708984  8011 raft_consensus.cc:740] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:54.709132  8030 consensus_queue.cc:260] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:54.698436  7975 raft_consensus.cc:3055] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:54.710157  7975 raft_consensus.cc:740] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:54.709897  8011 consensus_queue.cc:260] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:54.710995  7975 consensus_queue.cc:260] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:54.711966  7975 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:54.698628  8055 raft_consensus.cc:3055] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:54.712127  8019 raft_consensus.cc:3055] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:59:54.712505  8055 raft_consensus.cc:740] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:54.713371  8055 consensus_queue.cc:260] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:54.715001  8019 raft_consensus.cc:740] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 24 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:54.715140  8055 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:54.715863  8019 consensus_queue.cc:260] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:54.700596  8061 raft_consensus.cc:3055] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:54.717094  8019 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:59:54.714018  8020 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:54.717190  8061 raft_consensus.cc:740] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:59:54.731549  8061 consensus_queue.cc:260] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:54.733035  8061 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:54.739948  8039 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:54.743058  8028 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:59:54.786278  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 226569us
I20260709 12:59:54.791460  1505 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:54.806282  1535 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 22. Current term is 23. Ops: []
I20260709 12:59:54.807188  1533 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 22. Current term is 23. Ops: []
I20260709 12:59:54.809825  1534 raft_consensus.cc:1240] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 18. Current term is 19. Ops: []
W20260709 12:59:54.811676  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 256267us
I20260709 12:59:54.818766  1540 raft_consensus.cc:1240] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 17. Current term is 18. Ops: []
I20260709 12:59:54.827152  1542 raft_consensus.cc:1240] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 16. Current term is 17. Ops: []
I20260709 12:59:54.831545  8076 consensus_queue.cc:1059] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 11.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:59:54.844791  8077 consensus_queue.cc:1059] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:59:54.847714  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 180173us
I20260709 12:59:54.879972  7975 consensus_queue.cc:1059] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:54.884420  8013 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:59:54.902767  8013 raft_consensus.cc:697] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:54.902594  1655 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:54.894222  7975 raft_consensus.cc:3055] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:59:54.899367  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.885315  1654 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:59:54.904940  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.891192  8027 consensus_queue.cc:1059] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:59:54.922453  7975 raft_consensus.cc:740] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:54.904898  8013 consensus_queue.cc:237] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:54.936836  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:54.937989  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:54.938189  7975 consensus_queue.cc:260] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:59:54.939760  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 257399us
I20260709 12:59:54.941897  7733 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:59:54.950327  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.958645  1612 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:59:54.961144  7975 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:54.964902  8011 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:59:54.970747  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:54.977526  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:59:54.998740  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 53168.6us
I20260709 12:59:55.000566  8059 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:59:55.001490  8059 raft_consensus.cc:697] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:55.002841  8059 consensus_queue.cc:237] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:59:54.998842  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 96672.3us
I20260709 12:59:55.007220  8014 consensus_queue.cc:1059] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:59:55.011211  8049 raft_consensus.cc:3055] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:59:55.011723  8049 raft_consensus.cc:740] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:55.013199  8049 consensus_queue.cc:260] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:55.014757  8049 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:59:55.008224  1655 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:55.634725  8077 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:55.635612  8077 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:55.639351  8077 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:55.976027  8077 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:55.976886  8077 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:55.979508  8077 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:56.014396  8077 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:56.015266  8077 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:59:56.036952  1508 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 1.624s (SENT) [suppressed 5 similar messages]
I20260709 12:59:56.043629  8078 raft_consensus.cc:3055] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:56.044186  8078 raft_consensus.cc:740] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 12:59:56.210148  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 173334us
I20260709 12:59:56.230324  8082 ts_tablet_manager.cc:933] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:56.234419  8077 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.235222  8077 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.235929  8077 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.240444  8013 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:56.246577  8087 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:56.245189  8077 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:56.247617  8087 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.045421  8078 consensus_queue.cc:260] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:59:56.257550  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:56.261286  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.257179  8013 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.258219  8082 tablet_copy_client.cc:323] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:41953
I20260709 12:59:56.261866  8078 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:56.259625  8089 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:56.262881  8089 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.263520  8013 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:56.261133  8087 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:56.264214  8013 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:56.257997  8088 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:56.265434  8089 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.264839  8087 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:56.266305  8087 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.265659  8088 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.269711  8089 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:56.270557  8089 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.264950  8013 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.273072  8089 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:56.273800  8013 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.256006  8077 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:56.277302  8088 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.283061  8037 raft_consensus.cc:3055] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:56.283738  8037 raft_consensus.cc:740] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:56.284169  8089 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.285118  8037 consensus_queue.cc:260] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 11.13, Last appended by leader: 13, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.286306  8088 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.287177  8088 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.291193  8050 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:56.291751  8050 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.285087  8089 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.296073  8050 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 12:59:56.296828  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 1.30124e+06us
I20260709 12:59:56.297358  8089 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.297982  8089 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:56.298341  8050 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:56.298635  8089 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.299093  8050 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.284993  8091 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:56.300413  8091 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.301224  8089 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:59:56.299717  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.304576  8077 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.304576  8091 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:56.306270  8091 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:56.306882  8091 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.308970  8091 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:56.309499  8091 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.310132  8091 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.312305  8091 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.312906  8091 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.313460  8091 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.301977  8050 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.317051  8013 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:56.318195  8013 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.320693  8050 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:56.321524  8050 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:59:56.322793  1471 debug-util.cc:398] Leaking SignalData structure 0x7b08003094c0 after lost signal to thread 434
I20260709 12:59:56.324738  8089 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.325675  8089 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.329816  8013 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:56.310851  8092 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:56.337076  8092 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.325558  8050 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:56.339056  8050 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:56.339754  8050 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.340281  8092 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:56.341945  8050 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:59:55.052162  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 45993.1us
I20260709 12:59:56.345319  8050 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.298341  8088 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:56.348784  1438 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54582 (request call id 318) took 2010 ms. Trace:
I20260709 12:59:56.345054  8091 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:56.349968  8091 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.306900  8077 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.345999  8050 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.354094  8077 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.349310  1438 rpcz_store.cc:276] 0709 12:59:54.338439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.338611 (+   172us) service_pool.cc:224] Handling call
0709 12:59:56.348519 (+2009908us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:54.647545 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:54.647932 (+   387us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:54.647955 (+    23us) write_op.cc:435] Acquired schema lock
0709 12:59:54.647966 (+    11us) tablet.cc:662] Decoding operations
0709 12:59:54.648222 (+   256us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:54.648293 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:54.648316 (+    23us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:54.649208 (+   892us) tablet.cc:701] Row locks acquired
0709 12:59:54.656771 (+  7563us) write_op.cc:260] PREPARE: finished
0709 12:59:54.670629 (+ 13858us) write_op.cc:270] Start()
0709 12:59:54.679204 (+  8575us) write_op.cc:276] Timestamp: P: 1783601994667366 usec, L: 0
0709 12:59:54.681004 (+  1800us) op_driver.cc:348] REPLICATION: starting
0709 12:59:54.703949 (+ 22945us) log.cc:844] Serialized 599 byte log entry
0709 12:59:54.761979 (+ 58030us) op_driver.cc:464] REPLICATION: finished
0709 12:59:55.059100 (+297121us) write_op.cc:301] APPLY: starting
0709 12:59:55.059261 (+   161us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:55.075951 (+ 16690us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:55.076104 (+   153us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:55.076940 (+   836us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:55.077312 (+   372us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:59:55.077388 (+    76us) write_op.cc:312] APPLY: finished
0709 12:59:55.084819 (+  7431us) log.cc:844] Serialized 25 byte log entry
0709 12:59:55.085110 (+   291us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:55.085280 (+   170us) write_op.cc:454] Released schema lock
0709 12:59:55.085348 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:55.088742 (+  3394us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:55.088777 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":296690,"apply.run_cpu_time_us":5787,"apply.run_wall_time_us":29674,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8309,"num_ops":1,"prepare.queue_time_us":253157,"prepare.run_cpu_time_us":15185,"prepare.run_wall_time_us":107364,"raft.queue_time_us":4584,"raft.run_cpu_time_us":11693,"raft.run_wall_time_us":307219,"replication_time_us":80817,"thread_start_us":751790,"threads_started":4,"wal-append.queue_time_us":51475}]]}
I20260709 12:59:56.354830  8077 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.357822  8077 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.353065  8088 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.361220  8088 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:59:56.362226  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:56.363229  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.364648  8091 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.367064  8088 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:56.369252  1684 raft_consensus.cc:1275] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:59:56.370505  8091 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.374349  8013 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:56.367169  8050 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.377959  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.377964  8006 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:56.380362  8006 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.380879  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.377928  8078 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:56.382316  8078 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.382771  8006 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:56.383406  8006 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:56.384465  8078 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.378170  8027 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:56.384004  8006 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.380396  1684 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 12.
I20260709 12:59:56.385746  8064 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:56.385484  8027 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.386477  8064 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.387217  2269 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:56.375298  8013 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:56.389745  8027 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.390918  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.392204  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.405248  1539 raft_consensus.cc:2393] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 17: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 12:59:56.407231  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.409865  8061 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:56.410279  8094 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.410960  8094 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.412287  8005 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.412889  8005 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.413461  8094 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:56.414803  8093 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.410555  8092 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:56.414999  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:56.417102  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.417682  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:56.417168  8092 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.418053  8093 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.417728  1615 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 18.
I20260709 12:59:56.420182  8092 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.420396  8093 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.421205  8005 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.417876  1539 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 12:59:56.421873  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:56.422679  2296 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:59:56.424563  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:56.424988  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:56.425411  2296 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 21.
I20260709 12:59:56.426558  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:56.427292  2299 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 12:59:56.427630  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:56.428308  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:56.428894  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:56.429026  2296 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:59:56.429495  2298 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 12:59:56.430038  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:56.431264  1582 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:56.432421  8013 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.432507  8035 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:56.433092  8035 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:56.433475  8035 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:56.434273  1687 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:59:56.434628  1609 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 17.
I20260709 12:59:56.435743  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:56.436410  2299 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 25.
I20260709 12:59:56.440430  8030 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:56.441159  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:56.441802  1611 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 14.
I20260709 12:59:56.441946  1582 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:56.442896  8088 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:59:56.443272  8088 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.392835  8050 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:59:56.443729  8088 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:59:56.405467  8064 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:56.443986  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:59:56.434222  8011 consensus_meta.cc:287] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 1.469s	user 0.019s	sys 0.001s
I20260709 12:59:56.444980  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:59:56.445472  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 58573us
I20260709 12:59:56.413779  8061 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.449451  2294 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 12:59:56.451879  8061 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:56.452785  8088 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.454313  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.455039  1537 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 24.
I20260709 12:59:56.455436  1582 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:56.456327  8091 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:56.456736  8091 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:56.457098  8091 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:56.458065  1533 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 22. Current term is 23. Ops: []
I20260709 12:59:56.407374  8006 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:56.459939  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.463024  1533 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:59:56.463547  8050 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:56.464265  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.464178  8050 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.465346  1537 raft_consensus.cc:2393] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 19: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:59:56.463200  8092 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:56.465765  8091 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.466830  8050 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.466599  8092 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.467384  8050 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:56.467960  8050 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.469426  8005 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.470147  8050 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.470008  8005 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.472250  8035 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.473609  8092 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.473610  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.474459  1615 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 19.
W20260709 12:59:56.475378  1507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.605s	user 0.007s	sys 0.012s
I20260709 12:59:56.474459  1539 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:59:56.472191  8005 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.476835  8088 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:59:56.477948  1507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.607s	user 0.007s	sys 0.012s
W20260709 12:59:56.482863  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 1.61253e+06us
W20260709 12:59:56.440451  7975 consensus_meta.cc:287] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 1.444s	user 0.014s	sys 0.017s
I20260709 12:59:56.478886  8035 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:56.478835  8088 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.477169  8091 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:56.485682  8088 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.488152  8088 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:56.489233  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.490567  8094 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:56.491621  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.492220  1537 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:59:56.493374  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.494135  1537 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 20.
I20260709 12:59:56.495115  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.495921  1539 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 24.
I20260709 12:59:56.498379  1617 consensus_queue.cc:237] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:56.499281  8011 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:56.499622  8061 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:56.499966  1582 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:56.500015  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.499572  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.500115  8005 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:56.501693  1613 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 18.
I20260709 12:59:56.493319  2269 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 12:59:56.504572  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.504635  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:56.512265  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.507789  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:59:56.516144  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.548280  1581 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:56.549751  1609 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 16.
W20260709 12:59:56.519878  1471 debug-util.cc:398] Leaking SignalData structure 0x7b08003801c0 after lost signal to thread 1474
W20260709 12:59:56.548458  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 55231.2us
I20260709 12:59:56.549031  1540 raft_consensus.cc:2393] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 17: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:59:56.509737  1582 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:56.551345  2300 raft_consensus.cc:1240] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:56.552294  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:56.556555  8013 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.556726  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:56.557308  8011 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.558233  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:56.559007  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:56.560810  8035 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.522679  8060 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:56.579676  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:56.579533  8060 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.580837  8011 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:56.581315  1610 raft_consensus.cc:2393] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 12: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:59:56.582580  1581 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:56.565946  8094 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:59:56.585136  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:56.588163  2302 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:59:56.589047  8087 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:56.589224  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:56.589748  8087 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:56.589979  2297 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 12:59:56.590178  8087 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:56.509479  7975 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:56.524384  8039 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:56.517731  8047 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.505445  8006 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.556490  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:56.567960  8030 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:56.568449  8096 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:56.607743  1627 tablet_copy_service.cc:140] P c262eac7fc904ae9bb91e450f6532e3f: Received BeginTabletCopySession request for tablet 8a2233a4e08d4138b4eb687a0440be86 from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:58006)
I20260709 12:59:56.608311  8096 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:56.608641  1627 tablet_copy_service.cc:161] P c262eac7fc904ae9bb91e450f6532e3f: Beginning new tablet copy session on tablet 8a2233a4e08d4138b4eb687a0440be86 from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:58006: session id = 1d6516ff61104bdda54bde95e92fe579-8a2233a4e08d4138b4eb687a0440be86
I20260709 12:59:56.608789  8049 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:56.609083  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.609503  8049 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.610244  8096 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:56.611486  8070 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.611724  8049 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:56.612028  8070 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.611392  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.613188  1690 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 17.
W20260709 12:59:56.613929  2295 thread.cc:641] tablet-copy [worker] (thread pool) Time spent creating pthread: real 1.673s	user 0.020s	sys 0.030s
W20260709 12:59:56.614312  2295 thread.cc:608] tablet-copy [worker] (thread pool) Time spent starting thread: real 1.674s	user 0.020s	sys 0.030s
I20260709 12:59:56.614440  8070 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:56.615013  8070 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:56.614722  8030 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.615554  8070 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.573460  8037 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:56.616972  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.617749  1684 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 14.
I20260709 12:59:56.618781  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.619498  1689 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 18.
I20260709 12:59:56.620702  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.620896  8047 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.621356  1688 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 10.
I20260709 12:59:56.622471  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.623144  1686 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 18.
I20260709 12:59:56.623274  8047 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:56.621852  1627 tablet_copy_source_session.cc:215] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:56.624679  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.606940  8006 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.584167  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:56.522450  7884 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:56.579000  8035 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.585177  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:56.561743  8005 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.590653  8087 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:56.562018  1537 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 12:59:56.636945  8005 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:56.592303  8060 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.593290  8014 consensus_queue.cc:1059] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:59:56.638013  7884 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.638639  8014 raft_consensus.cc:3055] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:59:56.639051  8014 raft_consensus.cc:740] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:56.640250  7884 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.639897  8014 consensus_queue.cc:260] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.640828  7884 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:59:56.641232  7884 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:56.640946  8072 raft_consensus.cc:3055] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:59:56.641861  8072 raft_consensus.cc:740] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:56.642711  8072 consensus_queue.cc:260] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:56.597828  1538 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:59:56.599040  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.600800  1536 raft_consensus.cc:1275] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:59:56.600646  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:56.523006  8077 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:56.603979  2266 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
W20260709 12:59:56.604949  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 95321.7us
I20260709 12:59:56.507683  8064 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:59:56.606726  1471 debug-util.cc:398] Leaking SignalData structure 0x7b0800315ae0 after lost signal to thread 1488
I20260709 12:59:56.602820  8039 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.606773  8094 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:56.607688  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 1.59973e+06us
I20260709 12:59:56.609813  1687 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 13.
I20260709 12:59:56.567543  8013 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.549409  8091 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:56.655376  8005 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:59:56.664985  8005 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:56.656773  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.665406  8005 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:59:56.665810  1612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 3500) took 2157 ms (client timeout 1594 ms). Trace:
I20260709 12:59:56.666401  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.667590  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.668165  1537 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 15.
I20260709 12:59:56.657862  8091 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.669327  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.443495   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:56.658090  8013 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.658533  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.659433  8014 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:56.671108  8077 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.628583  2300 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:59:56.625314  1691 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 14.
I20260709 12:59:56.603075  7975 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.673442  7975 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:56.672945  1439 catalog_manager.cc:5697] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 18 to 19, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 19 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:56.566099  8088 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:56.674839  8088 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.607990  8059 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:59:56.624156  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.635063  8035 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:59:56.643328  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:56.601372  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 258416us
W20260709 12:59:56.644587  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 62110.2us
I20260709 12:59:56.510011  8061 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.644555  1616 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 18.
I20260709 12:59:56.617019  8030 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:56.652868  2269 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 12:59:56.652741  1582 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:56.641587  7884 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:59:56.652263  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 48893.7us
I20260709 12:59:56.662075  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.661355  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.661470  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.661813  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.688905  8059 raft_consensus.cc:697] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:56.657356  8064 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.697552  1535 raft_consensus.cc:2393] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 17: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:59:56.698120  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:56.699141  8093 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.676596  1683 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 16.
I20260709 12:59:56.699721  8093 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.660940  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.700335  8009 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:59:56.700608  1539 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 12:59:56.701858  8009 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:59:56.701614  8059 consensus_queue.cc:237] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.702219  8098 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:59:56.658197  8094 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:59:56.703222  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 46299.7us
I20260709 12:59:56.660977  8039 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.666067  8096 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:59:56.676658  1612 rpcz_store.cc:269] 0709 12:59:54.508346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.509222 (+   876us) service_pool.cc:224] Handling call
0709 12:59:56.665599 (+2156377us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b54000663d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:59:56.665733 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":796950784}
I20260709 12:59:56.669153  1436 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54590 (request call id 309) took 2213 ms. Trace:
I20260709 12:59:56.695098  2266 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:56.699290  1654 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:59:56.704186  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 51545.7us
I20260709 12:59:56.707926  2267 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:56.709227  8094 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.709491  8089 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:56.728267  1436 rpcz_store.cc:276] 0709 12:59:54.455580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.455960 (+   380us) service_pool.cc:224] Handling call
0709 12:59:56.668962 (+2213002us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35045,"reported_tablets":1}
I20260709 12:59:56.736799  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:59:56.737385  1471 debug-util.cc:398] Leaking SignalData structure 0x7b0800008600 after lost signal to thread 1566
I20260709 12:59:56.737594  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.737799  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.738509  1683 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 12:59:56.739619  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.740459  1688 raft_consensus.cc:2393] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 13: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:59:56.741475  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.742090  8070 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:56.742272  1687 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:59:56.742693  8070 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:56.743335  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.743647  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:56.743793  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:56.744375  1612 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 12:59:56.745182  8092 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:56.709890  2294 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 17.
I20260709 12:59:56.745740  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.711270  7733 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:56.747002  7733 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.711504  8069 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:56.748171  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:56.749030  1609 raft_consensus.cc:2393] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 18: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:59:56.748775  8069 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.749850  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:56.751039  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:56.711011  8061 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.713158  8030 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:59:56.713798  8093 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.752787  8030 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.699160  8064 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:56.753234  8030 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:59:56.753948  1691 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 20.
I20260709 12:59:56.752988  8091 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.717311  8044 consensus_queue.cc:1059] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:59:56.722124  1613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 3602) took 1752 ms (client timeout 2044 ms). Trace:
I20260709 12:59:56.723677  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:56.724781  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.705506  1581 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:56.726083  8067 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.727001  8046 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:56.730028  2303 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 12:59:56.736073  1610 raft_consensus.cc:1275] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:59:56.736632  8049 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:56.744340  1615 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
I20260709 12:59:56.751147  8069 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:56.771006  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.771795  1533 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 17.
I20260709 12:59:56.745435  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:56.713896  8077 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.721217  8088 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.745519  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:59:56.749071  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 49926.1us
W20260709 12:59:56.756189  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 103949us
I20260709 12:59:56.803898  2269 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 12:59:56.757990  2301 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
W20260709 12:59:56.762584  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 67606.1us
I20260709 12:59:56.805576  2266 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:56.807726  8059 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:59:56.764333  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 58916.5us
W20260709 12:59:56.761847  1613 rpcz_store.cc:269] 0709 12:59:54.969615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.977100 (+  7485us) service_pool.cc:224] Handling call
0709 12:59:56.721913 (+1744813us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b540008cfd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:59:56.722037 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3464264448}
I20260709 12:59:56.704111  8047 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.762714  1608 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 15.
I20260709 12:59:56.810355  8047 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.810803  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:56.745647  8092 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.812736  8092 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:56.813699  1534 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 12.
I20260709 12:59:56.817760  8096 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.743273  8070 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.818068  1438 catalog_manager.cc:5697] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 17 to 18, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 18 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:56.819926  8070 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:56.820533  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:56.821130  1615 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:56.805717  8061 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:56.821661  8061 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:56.822031  8061 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:56.808269  8094 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:56.823508  8094 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.823917  8094 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:56.824795  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:56.825436  1609 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 18.
I20260709 12:59:56.826941  8046 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.828665  1615 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:59:56.829349  1617 raft_consensus.cc:1240] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:59:56.830219  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.830936  8072 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:59:56.809480  1581 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:56.834867  2269 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 12:59:56.812266  7733 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:56.836799  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:56.835772  2269 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
W20260709 12:59:56.842170  1471 debug-util.cc:398] Leaking SignalData structure 0x7b080039b6a0 after lost signal to thread 1641
I20260709 12:59:56.843545  2267 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:56.742316  8098 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.767134  8093 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:56.849071  1581 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:56.768365  8091 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:56.766963  8050 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:59:56.848831  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.851341  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.857527  2267 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:56.857761  8109 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:56.858328  8109 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.858672  8109 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:56.859495  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:56.860666  2300 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 22.
I20260709 12:59:56.805563  7975 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.863358  7975 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:56.801602  8089 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:56.854887  1538 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 17.
I20260709 12:59:56.866300  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.866658  1581 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:56.870716  1688 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 12:59:56.866977  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.852231  1505 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:56.829267  8046 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:56.872282  1581 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:59:56.872712  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.868605  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.835471  8059 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:59:56.880081  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 44375.5us
I20260709 12:59:56.881233  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:56.847162  8098 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:56.819478  8005 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.847605  8060 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:56.849541  8093 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:56.854460  8091 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.895486  8093 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:56.847843  8037 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:56.896238  8037 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.897029  8101 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:59:56.897552  8101 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.897953  8101 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:59:56.898460  8037 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:56.888861  8006 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:56.887398  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.899727  1537 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:59:56.841784  8049 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.829630  8067 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.900872  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:56.901333  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.902078  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:56.890641  8018 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:56.875486  8088 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:56.902860  8018 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:56.903290  8018 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:56.865068  8050 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:56.904372  8050 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:56.895545  8091 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:56.886803  8077 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:59:56.905541  8077 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.905898  8077 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:56.907303  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.908025  1540 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 12:59:56.886493  8089 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:56.910403  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.911191  1689 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 12:59:56.889120  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.902792  1684 raft_consensus.cc:2393] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 13: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:59:56.889689  8060 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.902457  1691 raft_consensus.cc:2393] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 18: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:59:56.896498  8055 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:56.901503  1685 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:59:56.903227  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.918712  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.902527  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.912256  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.900733  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.883735  2269 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:56.864974  8096 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:59:56.914883  1682 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:59:56.923559  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.917590  1505 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:56.924511  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.897298  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:59:56.926998  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:56.927485  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:56.927899  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.925868  1690 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
W20260709 12:59:56.930204  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 122623us
I20260709 12:59:56.885879  8059 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:59:56.934688  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.941720  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.856065  8087 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.914129  8088 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:56.922331  8096 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:56.922662  8055 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:56.937511  1687 raft_consensus.cc:2393] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 17: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:59:56.868275  7884 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:56.945245  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.952593  1683 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:59:56.950034  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.940162  8006 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:56.958036  1614 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 11.
I20260709 12:59:56.958731  1534 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:59:56.938899  1581 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:56.962775  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.964825  1581 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:56.942632  7975 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.966027  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:56.967897  1582 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:56.968427  1613 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 17.
I20260709 12:59:56.968513  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:56.970969  1684 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 12:59:56.971649  1611 raft_consensus.cc:1240] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 11. Current term is 12. Ops: []
I20260709 12:59:56.971987  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.962502  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.951345  8099 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:56.973209  1535 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 12:59:56.955376  8088 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:56.957298  8055 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:56.957607  8096 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:59:56.976264  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.977839  1610 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 24. Current term is 25. Ops: []
I20260709 12:59:56.975345  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.981634  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:59:56.982445  1471 debug-util.cc:398] Leaking SignalData structure 0x7b08003a9060 after lost signal to thread 1715
I20260709 12:59:56.983049  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:56.992158  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:59:56.999176  1471 debug-util.cc:398] Leaking SignalData structure 0x7b08002d7640 after lost signal to thread 2327
W20260709 12:59:57.002243  1471 debug-util.cc:398] Leaking SignalData structure 0x7b080029dee0 after lost signal to thread 2328
W20260709 12:59:56.989028  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.999823  1682 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 15
W20260709 12:59:57.002802  1471 debug-util.cc:398] Leaking SignalData structure 0x7b080003e880 after lost signal to thread 8026
W20260709 12:59:57.003983  1471 debug-util.cc:398] Leaking SignalData structure 0x7b0800307f60 after lost signal to thread 8045
I20260709 12:59:56.970074  8035 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:56.967694  8006 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:56.995363  1505 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:56.991912  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:57.018208  1534 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 12:59:56.962033  8046 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:59:57.025802  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 58016.9us
W20260709 12:59:57.027874  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.030397  1582 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:57.030282  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:57.031659  8114 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:59:57.031646  1533 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 12:59:57.024029  1617 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 12.
I20260709 12:59:56.984784  8019 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:59:56.985656  8039 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:56.996217  8049 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:56.973960  7975 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:57.045717  1536 raft_consensus.cc:2393] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 18: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:59:56.969465  8092 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.040580  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:56.985260  8060 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:57.028625  8006 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:57.019765  8035 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:56.983067  8110 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:59:57.033254  1654 connection.cc:256] RPC call timeout handler was delayed by -1.1589279610000176s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15940000000000001s for a response
I20260709 12:59:57.035461  8047 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:57.038376  8019 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.035902  8013 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:59:57.040315  8039 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 12:59:57.059211  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 177918us
I20260709 12:59:57.038422  8070 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.028537  8067 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:56.997725  8030 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.058149  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:57.032279  8114 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:57.062316  1655 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:57.057651  8038 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:56.982715  8099 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.076996  8105 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.067220  8019 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:57.080672  2269 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:57.036248  8064 consensus_queue.cc:1048] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:59:57.062551  8110 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:57.040154  8046 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.063019  8035 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:57.065863  8011 consensus_queue.cc:1059] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:59:57.067517  8013 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.087049  1655 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:57.150082  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.149773  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:57.150121  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:59:57.121194  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 100739us
W20260709 12:59:57.126305  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:57.084009  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 53694.6us
W20260709 12:59:57.151754  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 66405.2us
I20260709 12:59:57.151880  1582 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:57.149461  1535 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 20.
I20260709 12:59:57.090071  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.156021  8121 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:57.151003  1688 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:57.074961  8039 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:57.156590  8121 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.157074  8121 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:57.149652  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.162864  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.164265  8107 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:59:57.164850  8107 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:57.165238  8107 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:57.087764  8037 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.084918  8114 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:57.090590  8067 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:57.089959  8005 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:59:57.180864  8108 log.cc:927] Time spent T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:59:57.094374  8110 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:57.180536  8087 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:57.185497  8092 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:57.189785  8037 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.225386  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:57.226006  8037 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:57.190656  8112 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:59:57.227017  8112 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:57.191263  8046 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:57.192912  7975 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:57.196422  7884 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:57.227563  8112 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:59:57.086747  8094 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.229574  8094 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:57.191329  7896 raft_consensus.cc:3055] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:57.232092  7896 raft_consensus.cc:740] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:57.165989  8013 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:59:57.199753  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.233099  7896 consensus_queue.cc:260] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:57.234359  7896 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:57.148159  8038 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.196780  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.245262  1689 raft_consensus.cc:3055] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:59:57.175246  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:59:57.182548  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 89122.4us
I20260709 12:59:57.092885  8116 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:57.201022  1684 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 11.
I20260709 12:59:57.189663  8113 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:59:57.245662  1689 raft_consensus.cc:740] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:57.269102  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:57.181915  8067 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:57.083244  8070 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.215263  1535 raft_consensus.cc:1275] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 12:59:57.215611  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 63823.3us
I20260709 12:59:57.196095  8109 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.220904  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:57.221060  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:57.148101  8105 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:57.222437  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:57.223572  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:57.226184  2302 raft_consensus.cc:2393] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 18: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:59:57.149672  8101 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:57.296805  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:57.280223  8067 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:57.257083  8055 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.248335  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:57.248531  8099 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:57.248973  8116 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:57.317440  8116 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:57.250393  8038 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:57.251430  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.257521  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.259251  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.259470  8096 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.209210  1685 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 22.
I20260709 12:59:57.276116  1688 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 13.
I20260709 12:59:57.319765  2267 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:57.213090  1686 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 17.
I20260709 12:59:57.321008  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.189671  8030 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:57.280865  1582 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:57.217615  2301 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 18. Current term is 19. Ops: []
I20260709 12:59:57.322341  1582 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:59:57.283515  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 128836us
I20260709 12:59:57.288115  8061 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.260435  8113 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.295325  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:57.339517  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.297741  8006 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:57.285117  1689 consensus_queue.cc:260] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:57.208644  1682 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:59:57.298156  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:57.246443  1583 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:57.299930  1683 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 18.
I20260709 12:59:57.304680  2297 raft_consensus.cc:2393] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 14: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:59:57.341054  2303 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:59:57.309500  8019 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:57.298202  8070 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:57.354904  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.355598  1683 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:59:57.313431  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:57.357220  1535 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:59:57.316354  8035 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:57.358228  1689 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:57.358021  8077 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:57.360000  8035 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:57.316922  2296 raft_consensus.cc:2393] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 18: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:59:57.319145  1691 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:57.321326  2266 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:59:57.324535  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.361166  1655 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:57.362150  8038 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:59:57.362561  8038 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.362912  8038 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:57.363382  1507 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:57.324841  1582 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:57.365326  8063 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:57.299209  8018 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.365880  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:57.366940  8112 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:57.325345  8072 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:57.367614  8018 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:57.368657  8047 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:59:57.375705  8047 raft_consensus.cc:697] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:57.343573  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:57.377023  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.376866  8047 consensus_queue.cc:237] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.327199  1654 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:57.371179  8091 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:57.367842  8009 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:59:57.377799  8114 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.298264  8101 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:57.307253  8050 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.378576  8009 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.312243  8089 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:57.379189  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:57.379446  1609 raft_consensus.cc:1240] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 13. Current term is 15. Ops: []
I20260709 12:59:57.379755  1614 raft_consensus.cc:2376] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 18. Re-sending same reply.
I20260709 12:59:57.380383  8050 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:57.380563  2302 raft_consensus.cc:1240] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:57.335359  8099 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:59:57.342797  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:57.343645  8059 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:57.344800  8096 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:57.345472  2269 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 12:59:57.346314  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 12:59:57.393291  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 47888.6us
I20260709 12:59:57.346939  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:57.348748  1537 raft_consensus.cc:1240] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:57.348839  2295 raft_consensus.cc:2393] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 15: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:59:57.345415  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.349852  8121 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.350343  8055 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:59:57.351257  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 104905us
I20260709 12:59:57.379014  8009 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:57.351871  8030 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:59:57.305307  8093 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.354631  8019 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:57.369026  8039 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.369467  1610 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:57.312076  8098 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.369728  8105 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:57.326890  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:57.371147  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 12:59:57.371321  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 50119.2us
I20260709 12:59:57.371548  8109 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:57.371973  8125 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:57.372664  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:57.368134  8072 raft_consensus.cc:697] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:57.410079  1611 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
I20260709 12:59:57.410851  2266 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:57.373464  1507 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:57.360280  8077 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:57.374899  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:57.373320  8107 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.335671  1684 raft_consensus.cc:2393] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 17: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:59:57.378144  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.333505  8116 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.391454  1581 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:57.394555  1691 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 18.
I20260709 12:59:57.393548  1688 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 4.
I20260709 12:59:57.394575  2269 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:57.396150  1685 raft_consensus.cc:2376] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 17. Re-sending same reply.
I20260709 12:59:57.324213  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:57.351421  8014 consensus_queue.cc:1048] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:59:57.340245  8113 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:57.350018  8006 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:57.402773  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:57.397745  8005 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:57.404357  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.405529  1583 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:57.433228  1581 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:57.406292  1505 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:57.409080  1690 raft_consensus.cc:2393] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 20: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 12:59:57.378296  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 51198.9us
I20260709 12:59:57.412277  1613 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 12:59:57.435940  1610 raft_consensus.cc:1275] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:59:57.413635  1535 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:59:57.406859  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:57.414544  8096 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:59:57.413769  8072 consensus_queue.cc:237] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.404039  8030 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:57.438834  8030 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:59:57.438933  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.440047  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.415784  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:57.416368  8093 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:57.404770  8099 raft_consensus.cc:697] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:57.437829  1583 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:57.419683  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:57.445817  1534 raft_consensus.cc:3060] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:57.420027  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:57.420456  1612 raft_consensus.cc:1240] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:59:57.420683  1608 raft_consensus.cc:2368] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 18. Current term is 19.
I20260709 12:59:57.420771  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:57.414994  8125 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:57.422926  8088 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.429119  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.428807  1435 catalog_manager.cc:5697] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 17 to 18, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 18 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:57.451146  1685 raft_consensus.cc:2376] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 18. Re-sending same reply.
I20260709 12:59:57.431223  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:57.433531  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:57.398947  8013 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:57.412628  2266 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:57.414939  8018 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:59:57.433830  8077 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:57.435957  8005 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.456825  8077 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:57.457342  8077 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:57.458022  8099 consensus_queue.cc:237] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.444903  8101 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:57.460834  8101 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:57.452797  2294 raft_consensus.cc:2393] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 19: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:59:57.461380  8109 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:57.454735  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:57.463037  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:57.464699  8101 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:57.465386  8013 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:59:57.461054  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 48508.8us
I20260709 12:59:57.468845  2266 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:57.468330  8082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a2233a4e08d4138b4eb687a0440be86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:57.456904  8005 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:57.469435  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.461792  8109 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:57.472972  8109 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:57.472723  1686 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:59:57.474682  8121 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:57.436226  1581 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:59:57.475379  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.428205  8061 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:57.445181  1689 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 19.
I20260709 12:59:57.447434  1583 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:57.419059  1538 raft_consensus.cc:1240] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:57.449620  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.430207  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:57.454813  1655 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:57.498780  1688 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 18.
W20260709 12:59:57.498957  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 44216.8us
I20260709 12:59:57.448827  8125 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:57.441287  8094 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:57.511053  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:59:57.511686  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 64328.2us
I20260709 12:59:57.453105  8006 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:59:57.447124  8019 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:59:57.453903  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:57.516459  1616 raft_consensus.cc:1240] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:57.452894  1540 raft_consensus.cc:2393] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 17: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:59:57.455489  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:57.436404  8049 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:59:57.432372  1683 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 16.
I20260709 12:59:57.479251  1536 raft_consensus.cc:1240] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 19. Current term is 20. Ops: []
I20260709 12:59:57.479969  1534 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 16.
I20260709 12:59:57.440645  8096 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.452963  1654 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:57.472784  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.495952  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:57.520112  1685 raft_consensus.cc:2393] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 15: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:59:57.505228  1507 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:57.507339  1656 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:59:57.509071  8051 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 12:59:57.510281  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.512800  1582 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:57.512920  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:57.513634  1583 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:57.515331  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:57.517899  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:57.534022  2303 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 18. Current term is 19. Ops: []
I20260709 12:59:57.535576  2302 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:59:57.537499  1686 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 12.
I20260709 12:59:57.535036  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:57.538722  1534 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:59:57.504513  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:57.522383  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:57.522661  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:57.495797  8035 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:57.534891  1688 raft_consensus.cc:2393] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 17: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:59:57.540115  2298 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 17.
I20260709 12:59:57.535246  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:57.546335  1539 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Advancing to term 26
I20260709 12:59:57.512154  8093 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:59:57.533214  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:57.514222  8055 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:59:57.549029  2297 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:59:57.548743  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:57.550308  1613 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:57.550938  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:57.551083  1582 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:57.542655  1686 raft_consensus.cc:1240] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:57.547816  1583 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:57.550264  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:57.542646  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:57.552420  1439 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38804 (request call id 191) took 2765 ms. Trace:
I20260709 12:59:57.552428  1435 catalog_manager.cc:5697] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 18 to 19, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 19 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:57.554615  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:57.558430  1610 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:59:57.556793  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:57.555208  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:57.560971  1691 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 23.
I20260709 12:59:57.554013  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:57.557641  2269 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 12:59:57.556015  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:57.564117  1537 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 12:59:57.565255  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:57.565713  1534 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 12:59:57.566541  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:57.567052  1534 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:59:57.567591  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:57.567873  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:57.568336  1542 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:59:57.517980  8094 raft_consensus.cc:697] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 13 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:59:57.524021  8096 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:57.523422  8121 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:59:57.518765  8019 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:57.555137  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:57.580421  1540 raft_consensus.cc:2393] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 14: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:59:57.581717  1583 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:57.579592  1505 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:57.541962  8105 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:57.585819  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:59:57.588409  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 135551us
I20260709 12:59:57.544940  8114 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:57.545260  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:57.585328  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:57.542383  8006 raft_consensus.cc:697] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:57.549512  8011 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:59:57.512375  8038 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.586679  1505 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:57.574530  2269 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 12:59:57.587870  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:57.591150  1583 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:57.573715  7884 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:59:57.585881  8019 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:57.602707  1684 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 19. Current term is 20. Ops: []
I20260709 12:59:57.590360  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:57.548740  8093 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:57.556036  8055 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.607172  1654 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:57.610718  2302 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 26.
I20260709 12:59:57.584786  8072 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:57.577972  8070 consensus_queue.cc:1059] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 12:59:57.562441  8049 raft_consensus.cc:697] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:57.621445  1610 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 20.
I20260709 12:59:57.571628  8091 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:57.622290  1539 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 26.
I20260709 12:59:57.612814  8112 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:57.586047  7975 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:57.623142  1611 raft_consensus.cc:2393] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 15: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:59:57.624248  1688 raft_consensus.cc:1240] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 16. Ops: []
I20260709 12:59:57.625597  1583 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:57.588621  8018 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:57.562307  8067 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.552840  1439 rpcz_store.cc:276] 0709 12:59:54.787264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.790247 (+  2983us) service_pool.cc:224] Handling call
0709 12:59:56.234866 (+1444619us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54001b99d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfbb090 00007fc85d059f3a 00007fc862e101cc 00007fc862f0e37e 00007fc8613cf2a4 00007fc8613cf232 00007fc8613cf161 00007fc8613cf0dc 00007fc8613ce392 00007fc85b38c48c 00007fc85b38b8c6
0709 12:59:57.552355 (+1317489us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:56.808242 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:56.808932 (+   690us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:56.808978 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:59:56.808996 (+    18us) tablet.cc:662] Decoding operations
0709 12:59:56.809383 (+   387us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:56.809487 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:56.809526 (+    39us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:56.809767 (+   241us) tablet.cc:701] Row locks acquired
0709 12:59:56.809834 (+    67us) write_op.cc:260] PREPARE: finished
0709 12:59:56.810007 (+   173us) write_op.cc:270] Start()
0709 12:59:56.810148 (+   141us) write_op.cc:276] Timestamp: P: 1783601996809947 usec, L: 0
0709 12:59:56.810168 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:59:56.810866 (+   698us) log.cc:844] Serialized 536 byte log entry
0709 12:59:57.063253 (+252387us) op_driver.cc:464] REPLICATION: finished
0709 12:59:57.286369 (+223116us) write_op.cc:301] APPLY: starting
0709 12:59:57.286457 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:57.287688 (+  1231us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:57.287785 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:57.288603 (+   818us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:57.288794 (+   191us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:59:57.288839 (+    45us) write_op.cc:312] APPLY: finished
0709 12:59:57.317598 (+ 28759us) log.cc:844] Serialized 25 byte log entry
0709 12:59:57.338148 (+ 20550us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:57.338918 (+   770us) write_op.cc:454] Released schema lock
0709 12:59:57.392115 (+ 53197us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:57.410563 (+ 18448us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:57.412740 (+  2177us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":286759,"reported_tablets":1,"spinlock_wait_cycles":641615616,"child_traces":[["op",{"apply.queue_time_us":221102,"apply.run_cpu_time_us":5993,"apply.run_wall_time_us":117284,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8309,"num_ops":1,"prepare.queue_time_us":132026,"prepare.run_cpu_time_us":12780,"prepare.run_wall_time_us":68374,"raft.queue_time_us":189192,"raft.run_cpu_time_us":38571,"raft.run_wall_time_us":356787,"replication_time_us":247524,"thread_start_us":440773,"threads_started":4,"wal-append.queue_time_us":65469}]]}
I20260709 12:59:57.631819  8093 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:57.563526  8077 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:57.641396  1654 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:57.630595  8114 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:57.613109  8087 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:59:57.631479  1685 raft_consensus.cc:1275] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:59:57.617089  8011 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:57.670903  1505 leader_election.cc:400] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 18. Current term is 19.
I20260709 12:59:57.699349  1505 leader_election.cc:403] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:59:57.674075  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 99602.5us
I20260709 12:59:57.628955  8106 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:59:57.622646  8120 raft_consensus.cc:2804] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:59:57.682766  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 57237.5us
I20260709 12:59:57.643937  1686 raft_consensus.cc:1275] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:59:57.639065  8055 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:59:57.627468  7896 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:59:57.688513  1613 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 12.
I20260709 12:59:57.638638  1687 raft_consensus.cc:2368] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 18. Current term is 19.
I20260709 12:59:57.648578  8105 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:59:57.696633  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 55346.5us
I20260709 12:59:57.672652  8059 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:57.641322  8121 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:57.701689  1688 raft_consensus.cc:1240] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 16. Current term is 17. Ops: []
I20260709 12:59:57.631776  8005 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.700822  8011 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:57.713618  8118 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:57.624687  8046 consensus_queue.cc:1059] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 12:59:57.623337  8113 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.683429  8018 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 12:59:57.704948  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 76864.5us
I20260709 12:59:57.626726  8101 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:57.696826  7884 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:57.631101  8013 consensus_queue.cc:1048] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 12:59:57.699697  8112 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:57.698487  8087 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:57.713819  8120 raft_consensus.cc:697] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
W20260709 12:59:57.718292  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.688704  8110 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.710042  8107 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:57.729564  8005 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 13 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:57.698994  8122 consensus_queue.cc:1059] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.140s
I20260709 12:59:57.730212  8070 consensus_queue.cc:1059] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:57.730939  8059 consensus_queue.cc:1059] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:59:57.729605  8113 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:57.702216  8114 raft_consensus.cc:697] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 12 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:59:57.736186  8124 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:59:57.736606  8118 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.737047  8063 consensus_queue.cc:1059] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:59:57.737829  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:57.738508  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:57.777479  1533 raft_consensus.cc:2393] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 20: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:59:57.739216  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:57.740710  8098 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:57.778043  1538 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:59:57.705879  7896 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:57.721314  8038 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:57.754909  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.707738  8006 consensus_queue.cc:237] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:57.743583  8018 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:57.762557  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:57.828121  2266 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:57.771832  2299 raft_consensus.cc:1240] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 17. Current term is 18. Ops: []
I20260709 12:59:57.772022  1616 raft_consensus.cc:1240] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:57.830897  1611 raft_consensus.cc:2393] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 18: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:59:57.770879  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:57.766064  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:57.750377  8087 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:57.699831  8094 consensus_queue.cc:237] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.756515  7884 raft_consensus.cc:697] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:57.733085  8055 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:57.789137  1685 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:59:57.752733  1581 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:59:57.796182  8135 log.cc:927] Time spent T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:59:57.834858  8051 consensus_queue.cc:1059] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
W20260709 12:59:57.895104  8133 log.cc:927] Time spent T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:59:57.850705  8038 raft_consensus.cc:3055] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:59:57.896771  8038 raft_consensus.cc:740] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:57.897682  8038 consensus_queue.cc:260] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:57.898036  8019 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:57.901338  1608 raft_consensus.cc:1240] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:59:57.895160  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:57.905231  1612 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:59:57.906159  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:57.906757  1612 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 12:59:57.907336  8030 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:57.907744  8109 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.908051  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:57.804283  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:57.823063  1656 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:57.734022  8049 consensus_queue.cc:237] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:57.826128  2298 raft_consensus.cc:1240] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:59:57.826454  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:57.826337  1538 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 12:59:57.829003  1582 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:59:57.926481  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 97545.4us
I20260709 12:59:57.836794  8106 raft_consensus.cc:697] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:57.926028  2302 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:57.839135  8148 raft_consensus.cc:3055] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:59:57.842085  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 55462.3us
I20260709 12:59:57.842759  2266 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:57.846397  1438 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54606 (request call id 312) took 1355 ms. Trace:
I20260709 12:59:57.849334  8088 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:57.850211  1535 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 12.
I20260709 12:59:57.850929  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:57.851823  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:57.932945  1615 raft_consensus.cc:2368] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 14. Current term is 15.
I20260709 12:59:57.789698  7896 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:59:57.828876  8108 log.cc:927] Time spent T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 12:59:57.898102  8137 log.cc:927] Time spent T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:59:57.886906  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.900333  8019 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:57.889024  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.780685  8118 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:57.909543  8030 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:57.912274  8093 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.909886  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:57.908672  1614 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 19. Current term is 20. Ops: []
I20260709 12:59:57.961855  1615 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 16. Current term is 17. Ops: []
I20260709 12:59:57.913175  8101 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 12:59:57.918696  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 166039us
I20260709 12:59:57.965651  1581 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:57.921983  1609 raft_consensus.cc:2368] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21.
W20260709 12:59:57.965169  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 190094us
I20260709 12:59:57.920809  1687 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 20.
I20260709 12:59:57.920806  1542 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 21.
I20260709 12:59:57.931700  1582 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:57.936250  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.851424  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:57.892701  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:59:57.954547  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 111880us
I20260709 12:59:57.936887  2267 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:57.938911  2303 raft_consensus.cc:1240] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:59:57.890794  8005 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:59:57.972396  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.931252  1438 rpcz_store.cc:276] 0709 12:59:56.491295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.491447 (+   152us) service_pool.cc:224] Handling call
0709 12:59:57.846338 (+1354891us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:56.877248 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:56.877872 (+   624us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:56.877907 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:59:56.877927 (+    20us) tablet.cc:662] Decoding operations
0709 12:59:56.878308 (+   381us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:56.878360 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:56.878556 (+   196us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:56.878756 (+   200us) tablet.cc:701] Row locks acquired
0709 12:59:56.878778 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:59:56.878987 (+   209us) write_op.cc:270] Start()
0709 12:59:56.879123 (+   136us) write_op.cc:276] Timestamp: P: 1783601996878912 usec, L: 0
0709 12:59:56.879152 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:59:56.879915 (+   763us) log.cc:844] Serialized 541 byte log entry
0709 12:59:57.317434 (+437519us) op_driver.cc:464] REPLICATION: finished
0709 12:59:57.447524 (+130090us) write_op.cc:301] APPLY: starting
0709 12:59:57.450749 (+  3225us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:57.678201 (+227452us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:57.695249 (+ 17048us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:57.732350 (+ 37101us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:57.732535 (+   185us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:59:57.732589 (+    54us) write_op.cc:312] APPLY: finished
0709 12:59:57.732779 (+   190us) log.cc:844] Serialized 25 byte log entry
0709 12:59:57.732941 (+   162us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:57.733024 (+    83us) write_op.cc:454] Released schema lock
0709 12:59:57.733069 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:57.733446 (+   377us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:57.733499 (+    53us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":182269,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":114163,"apply.run_cpu_time_us":3903,"apply.run_wall_time_us":290993,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4182,"num_ops":1,"prepare.queue_time_us":45910,"prepare.run_cpu_time_us":2856,"prepare.run_wall_time_us":3152,"replication_time_us":413287,"thread_start_us":81223,"threads_started":1}]]}
I20260709 12:59:57.891639  8098 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.936455  8011 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:57.936754  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:57.969177  2266 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:59:57.964798  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.885973  8061 consensus_queue.cc:1059] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 12:59:57.971318  1611 raft_consensus.cc:2368] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21.
I20260709 12:59:57.925174  8089 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:59:57.976189  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.977002  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.978014  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:57.979933  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:59:57.981876  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 50233.3us
I20260709 12:59:57.958664  8148 raft_consensus.cc:740] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:57.958475  8092 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:59:57.986730  1581 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:58.024613  1581 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:58.027005  1581 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:57.976751  8077 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:57.966662  8046 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:57.993171  1682 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:59:57.990631  8037 consensus_queue.cc:1059] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:59:57.997294  8088 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.993021  8089 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.998546  8019 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:59:57.991532  7884 consensus_queue.cc:237] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:59:58.013882  8009 consensus_meta.cc:287] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.605s	user 0.005s	sys 0.005s
I20260709 12:59:58.003705  8145 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.956926  8096 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.001194  1685 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 13.
I20260709 12:59:58.058270  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:59:57.994657  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.015202  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:58.040910  8107 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:59:58.004256  8143 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:58.017537  8109 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:57.998323  8098 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:58.073720  8098 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:58.019076  8093 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:58.076262  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:58.077183  2294 raft_consensus.cc:2393] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 19: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:59:58.064174  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:58.078245  8011 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:58.063463  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:58.072026  8143 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.079294  8143 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:58.046788  8005 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:59:58.072237  1436 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54590 (request call id 310) took 1099 ms. Trace:
I20260709 12:59:58.021739  8055 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:57.989606  1508 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:57.976425  8067 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 12:59:58.035560  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 212626us
W20260709 12:59:58.037971  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 101183us
I20260709 12:59:58.101128  1540 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:59:58.105108  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:57.984316  1507 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 12:59:58.112165  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 127968us
I20260709 12:59:58.113060  1507 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:57.936760  2302 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:59:57.998849  2296 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:57.997584  8101 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:59:57.936151  8114 consensus_queue.cc:237] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.007754  8140 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:58.028350  8030 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:59:58.057502  8019 raft_consensus.cc:697] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 26 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 12:59:58.054695  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:58.151444  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 161980us
I20260709 12:59:58.152297  1508 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:58.152855  1583 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:57.925534  8120 consensus_queue.cc:237] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.011971  8125 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.059401  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:58.059768  1690 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:58.062525  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:58.062675  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:58.066509  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:58.101253  8110 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:58.067284  8145 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.067833  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:58.066437  8096 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:58.068675  8151 raft_consensus.cc:3055] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:59:58.067288  8070 raft_consensus.cc:3055] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:59:58.046631  8089 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:58.071336  8113 raft_consensus.cc:3055] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:59:58.080766  1436 rpcz_store.cc:276] 0709 12:59:56.973083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.979558 (+  6475us) service_pool.cc:224] Handling call
0709 12:59:58.072167 (+1092609us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 12:59:58.076776  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:58.086599  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:58.053459  8088 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:58.105712  2267 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:58.124455  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:58.125854  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:58.116781  1581 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:58.130581  2269 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 12:59:58.135886  1682 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 12:59:58.139714  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:58.028124  8122 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:58.145628  1612 raft_consensus.cc:1240] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 18. Current term is 19. Ops: []
W20260709 12:59:58.145990  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:58.154376  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:58.179864  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 74240.7us
I20260709 12:59:58.160238  8055 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:58.066812  8105 raft_consensus.cc:3055] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:58.169070  1583 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:58.169260  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:58.054664  8091 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:59:58.056550  8009 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:59:58.177150  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 60471.8us
I20260709 12:59:58.181118  1654 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:58.153576  8101 raft_consensus.cc:697] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:58.193001  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:58.129549  8018 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:58.194022  1691 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:59:58.194202  8146 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:59:58.195093  8150 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:58.195425  8018 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:58.190737  8019 consensus_queue.cc:237] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.126310  8037 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:59:58.196650  8037 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.197049  8037 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:58.194196  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:58.198356  1533 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:59:58.170373  8070 raft_consensus.cc:740] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:58.191046  1538 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
W20260709 12:59:58.199126  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 68674.3us
I20260709 12:59:58.048650  8106 consensus_queue.cc:237] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:59:58.182389  8035 consensus_meta.cc:287] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.631s	user 0.010s	sys 0.000s
I20260709 12:59:58.199604  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:58.204658  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:58.205190  8096 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:58.185596  8050 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:59:58.206058  8030 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:59:58.207123  1611 raft_consensus.cc:1240] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:58.203357  2267 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:58.207428  8070 consensus_queue.cc:260] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:58.172565  8113 raft_consensus.cc:740] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:58.204017  1581 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:58.212857  1654 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:58.190855  8009 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:58.214131  8069 consensus_queue.cc:1059] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:59:58.218199  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:59:58.195598  8102 log.cc:927] Time spent T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 12:59:58.178201  8151 raft_consensus.cc:740] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 12:59:58.223476  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 254390us
I20260709 12:59:58.181324  8006 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:59:58.226410  8117 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:59:58.226984  2295 raft_consensus.cc:2393] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 19: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:59:58.227635  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:58.246110  1581 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:58.246603  1654 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:58.231793  1533 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 21.
I20260709 12:59:58.192705  8098 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:59:58.233465  1542 raft_consensus.cc:2393] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 13: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:59:58.191226  8105 raft_consensus.cc:740] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:58.234472  1684 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:59:58.206238  8141 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:58.235337  1691 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 21.
I20260709 12:59:58.235806  8069 raft_consensus.cc:3055] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:58.237219  7896 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:58.200227  8091 raft_consensus.cc:697] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 21 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:58.240111  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:58.243893  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:58.246886  1690 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 12:59:58.242837  2266 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:58.248672  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:58.229970  8035 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:59:58.260702  8157 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:59:58.283190  1617 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:59:58.257772  8152 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:59:58.257799  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:58.258716  8153 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:58.259155  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:58.286939  1538 raft_consensus.cc:2393] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 19: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:59:58.239380  8096 raft_consensus.cc:697] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 13 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:59:58.257076  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:58.172169  8140 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.267185  1581 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:58.269451  8101 consensus_queue.cc:237] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:58.267207  8069 raft_consensus.cc:740] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:58.269227  1613 raft_consensus.cc:1240] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 18. Current term is 19. Ops: []
W20260709 12:59:58.270299  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.272374  8088 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:58.272387  8154 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:59:58.274923  8158 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:59:58.249105  8110 consensus_queue.cc:1059] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:59:58.304502  8110 raft_consensus.cc:3055] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:58.295572  8157 raft_consensus.cc:697] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 12 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:59:58.305032  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:58.276698  8124 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 18. Current term is 19.
I20260709 12:59:58.277357  8151 consensus_queue.cc:260] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.306130  8038 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:59:58.305759  1541 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 23.
I20260709 12:59:58.309193  8070 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:59:58.277560  8105 consensus_queue.cc:260] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:58.279027  8116 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:58.304724  8142 raft_consensus.cc:3055] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:58.307845  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:58.310705  8142 raft_consensus.cc:740] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:58.310963  1688 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 22.
I20260709 12:59:58.305787  8157 consensus_queue.cc:237] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 11.13, Last appended by leader: 13, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.295257  8113 consensus_queue.cc:260] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.305788  8091 consensus_queue.cc:237] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:58.313553  8113 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:59:58.308667  8110 raft_consensus.cc:740] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:59:58.315882  8110 consensus_queue.cc:260] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.311417  8096 consensus_queue.cc:237] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.320724  8161 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:59:58.321245  8161 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.321646  8161 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:59:58.281437  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 129210us
I20260709 12:59:58.283367  1685 raft_consensus.cc:2393] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 19: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 12:59:58.255781  8030 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:58.285295  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:58.287070  1683 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 12:59:58.287763  8153 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:58.288441  2267 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:58.279006  8087 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:59:58.290266  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 47736.1us
I20260709 12:59:58.267639  1654 leader_election.cc:400] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 14. Current term is 15.
I20260709 12:59:58.293632  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:58.294117  8125 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:58.341310  8116 consensus_queue.cc:1059] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:59:58.341387  8142 consensus_queue.cc:260] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:58.343233  2266 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:58.344129  8116 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:59:58.325139  1581 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:58.325729  1583 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:58.326368  1508 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:58.327757  1617 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 12:59:58.307746  1435 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54582 (request call id 319) took 1233 ms. Trace:
I20260709 12:59:58.346599  1583 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:59:58.333528  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 45166.3us
I20260709 12:59:58.349812  1508 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:58.291949  8152 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.352715  8152 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:58.353317  8124 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:59:58.354450  2296 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 12:59:58.357293  8089 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:58.346961  1435 rpcz_store.cc:276] 0709 12:59:57.074057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.083101 (+  9044us) service_pool.cc:224] Handling call
0709 12:59:57.345428 (+262327us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54001b99d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfbb090 00007fc85d059f3a 00007fc862e101cc 00007fc862f0e37e 00007fc8613cf2a4 00007fc8613cf232 00007fc8613cf161 00007fc8613cf0dc 00007fc8613ce392 00007fc85b38c48c 00007fc85b38b8c6
0709 12:59:58.307684 (+962256us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:57.736424 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:57.738780 (+  2356us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:57.738818 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:59:57.738835 (+    17us) tablet.cc:662] Decoding operations
0709 12:59:57.739249 (+   414us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:57.739306 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:57.739335 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:59:57.739644 (+   309us) tablet.cc:701] Row locks acquired
0709 12:59:57.739662 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:59:57.739814 (+   152us) write_op.cc:270] Start()
0709 12:59:57.739920 (+   106us) write_op.cc:276] Timestamp: P: 1783601997739764 usec, L: 0
0709 12:59:57.739940 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:59:57.740631 (+   691us) log.cc:844] Serialized 929 byte log entry
0709 12:59:58.225066 (+484435us) op_driver.cc:464] REPLICATION: finished
0709 12:59:58.225445 (+   379us) write_op.cc:301] APPLY: starting
0709 12:59:58.228539 (+  3094us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:58.272105 (+ 43566us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:58.272212 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:58.273882 (+  1670us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:58.274045 (+   163us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 12:59:58.274089 (+    44us) write_op.cc:312] APPLY: finished
0709 12:59:58.274305 (+   216us) log.cc:844] Serialized 33 byte log entry
0709 12:59:58.274493 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:58.274584 (+    91us) write_op.cc:454] Released schema lock
0709 12:59:58.274635 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:58.288850 (+ 14215us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:58.288873 (+    23us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":91497,"reported_tablets":2,"spinlock_wait_cycles":257492352,"child_traces":[["op",{"apply.queue_time_us":113,"apply.run_cpu_time_us":5108,"apply.run_wall_time_us":59213,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8364,"num_ops":2,"prepare.queue_time_us":131695,"prepare.run_cpu_time_us":2747,"prepare.run_wall_time_us":4506,"replication_time_us":484948,"thread_start_us":79640,"threads_started":1}]]}
I20260709 12:59:58.311499  8148 consensus_queue.cc:260] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.359534  8089 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:58.359925  8063 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:59:58.361124  1609 raft_consensus.cc:1240] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 17. Current term is 18. Ops: []
I20260709 12:59:58.362183  8087 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:58.360437  1508 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:58.362790  7975 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:59:58.301803  8061 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:59:58.365890  1508 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:58.337795  1654 leader_election.cc:403] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:59:58.367298  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 99819.5us
I20260709 12:59:58.368678  1654 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:58.370234  1654 leader_election.cc:400] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21.
I20260709 12:59:58.370556  1654 leader_election.cc:403] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:59:58.373958  1536 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 12:59:58.366727  1583 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:59:58.377236  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 52188.4us
I20260709 12:59:58.377583  1654 leader_election.cc:400] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21.
I20260709 12:59:58.377912  1654 leader_election.cc:403] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:59:58.332706  8105 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:58.321046  8069 consensus_queue.cc:260] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:58.383776  1583 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:58.375834  8030 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:59:58.388923  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:58.389019  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:58.397660  1542 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:58.389379  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:59:58.392300  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 49142.3us
I20260709 12:59:58.339488  8050 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:59:58.359575  8148 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:58.357193  7896 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:58.409094  1542 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 12:59:58.401759  2269 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:58.381966  8051 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:59:58.380626  8063 raft_consensus.cc:2804] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:58.417876  1689 raft_consensus.cc:1240] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:59:58.340651  8143 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.381703  8154 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 14. Current term is 15.
I20260709 12:59:58.452647  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:58.389511  8061 raft_consensus.cc:697] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:59:58.402215  8117 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:59:58.439756  1611 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 24. Current term is 25. Ops: []
I20260709 12:59:58.394541  8145 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:58.385581  8088 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:59:58.385617  8087 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:59:58.330355  8118 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.395418  8044 raft_consensus.cc:3055] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:59:58.385792  8059 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21.
I20260709 12:59:58.382170  8067 consensus_queue.cc:1059] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 12:59:58.396225  8112 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 12:59:58.498708  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 84622.7us
I20260709 12:59:58.502588  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:58.432704  8030 raft_consensus.cc:697] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:58.502854  1608 raft_consensus.cc:2368] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for earlier term 12. Current term is 13.
W20260709 12:59:58.504376  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 138578us
I20260709 12:59:58.445820  8063 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:58.500569  8069 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:58.525952  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:58.503495  8087 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.518975  1582 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:58.532789  1508 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:58.449467  8165 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:59:58.535283  2299 raft_consensus.cc:1240] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 14. Current term is 15. Ops: []
I20260709 12:59:58.521353  1610 raft_consensus.cc:2393] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 13: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:59:58.496181  8106 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:58.523777  1686 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
I20260709 12:59:58.533915  1582 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:58.524343  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:58.500154  8117 raft_consensus.cc:697] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 21 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:58.529846  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:58.493937  8098 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 12:59:58.533428  8122 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:58.515956  1684 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 21.
I20260709 12:59:58.534036  2294 raft_consensus.cc:1240] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 13 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:58.534288  2297 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:59:58.534426  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:58.528848  8063 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:58.535130  8159 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:59:58.535665  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:58.535851  2303 raft_consensus.cc:1240] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 17. Current term is 18. Ops: []
I20260709 12:59:58.538086  2302 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 12:59:58.504527  8044 raft_consensus.cc:740] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 12:59:58.550879  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 465642us
I20260709 12:59:58.539881  8089 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:59:58.502767  8094 consensus_queue.cc:1059] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:59:58.546561  2300 raft_consensus.cc:2393] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 18: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:59:58.534775  2301 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 18. Current term is 19. Ops: []
I20260709 12:59:58.547709  1508 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:59:58.548629  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.570384  1656 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 12:59:58.538756  8087 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:59:58.509466  8082 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:32788 (request call id 524) took 3578 ms. Trace:
I20260709 12:59:58.552328  2299 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 12:59:58.552114  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 12:59:58.552116  8166 log.cc:927] Time spent T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:59:58.567669  8153 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:58.543700  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:58.554364  2266 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:58.568248  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:58.546062  8141 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21.
I20260709 12:59:58.533116  8145 consensus_queue.cc:1059] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 12:59:58.530812  8112 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.573248  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:58.608435  1684 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 23.
I20260709 12:59:58.549381  8064 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:59:58.542207  8106 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:58.606015  1611 raft_consensus.cc:2393] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 19: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:59:58.606150  1614 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 17: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 12:59:58.607355  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 53086.4us
I20260709 12:59:58.609462  2269 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 12:59:58.602566  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:58.632560  1534 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:59:58.573093  8072 consensus_meta.cc:287] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.902s	user 0.009s	sys 0.003s
I20260709 12:59:58.554482  8165 raft_consensus.cc:697] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 12:59:58.613363  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.613956  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:58.615015  1535 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 16. Current term is 17. Ops: []
I20260709 12:59:58.601435  8143 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:58.574208  8067 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:59:58.569914  8150 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 12:59:58.657536  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 109894us
I20260709 12:59:58.665375  1655 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:58.573508  8089 raft_consensus.cc:697] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:58.669245  8089 consensus_queue.cc:237] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.633284  2266 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:58.573967  8140 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:58.611325  8093 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:59:58.608014  8146 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:58.660274  8116 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:59:58.664114  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:58.665992  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:58.668336  1508 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:58.664399  1535 raft_consensus.cc:1240] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 13. Current term is 14. Ops: []
I20260709 12:59:58.615154  8018 consensus_queue.cc:1059] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 12:59:58.610994  8035 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.063s
I20260709 12:59:58.661789  8072 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:59:58.663275  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:58.674576  8146 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:58.676635  8064 consensus_queue.cc:1059] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:59:58.677352  8098 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:59:58.663955  8067 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.602221  8061 consensus_queue.cc:237] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.701293  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
W20260709 12:59:58.666194  8168 log.cc:927] Time spent T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:59:58.683286  1541 raft_consensus.cc:1240] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 17. Current term is 18. Ops: []
I20260709 12:59:58.606072  8037 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.662104  8011 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:59:58.654450  8153 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 12:59:58.688918  1614 raft_consensus.cc:2393] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 14: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:59:58.670616  8051 consensus_queue.cc:1059] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 12:59:58.692382  1612 raft_consensus.cc:2393] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 17: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:59:58.668378  8038 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:59:58.571879  8030 consensus_queue.cc:237] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.697791  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:58.699474  1534 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 12:59:58.722687  1684 raft_consensus.cc:2393] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 13: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:59:58.700877  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:58.701382  8064 raft_consensus.cc:3055] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:59:58.701814  8165 consensus_queue.cc:237] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:59:58.702770  8171 log.cc:927] Time spent T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:59:58.678998  8145 consensus_queue.cc:1059] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:59:58.706265  1691 raft_consensus.cc:1275] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:59:58.737574  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 56224.3us
I20260709 12:59:58.707748  1508 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:58.663309  8117 consensus_queue.cc:237] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:58.709760  2303 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:59:58.685500  8116 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:58.739161  8116 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:59:58.741081  8060 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:58.741967  1508 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:58.742624  8060 raft_consensus.cc:2764] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:59:58.743479  1508 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:58.744351  8060 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:59:58.744774  8060 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.745172  8060 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:59:58.685890  8157 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:59:58.719859  1537 raft_consensus.cc:1240] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 12:59:58.694895  8118 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:58.704320  8067 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:58.699900  2301 raft_consensus.cc:1275] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:59:58.727099  1684 raft_consensus.cc:1275] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:59:58.690356  8150 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.710312  8018 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:59:58.764426  8051 raft_consensus.cc:3055] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:59:58.765785  8051 raft_consensus.cc:740] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:58.766968  8051 consensus_queue.cc:260] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:58.768131  8051 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:59:58.768239  8063 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.770530  8063 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:58.726238  8064 raft_consensus.cc:740] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:58.574069  8082 rpcz_store.cc:276] 0709 12:59:54.926321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.928607 (+  2286us) service_pool.cc:224] Handling call
0709 12:59:56.230778 (+1302171us) ts_tablet_manager.cc:934] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
0709 12:59:57.466968 (+1236190us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:59:58.139893 (+672925us) tablet_metadata.cc:665] Metadata flushed
0709 12:59:58.156351 (+ 16458us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:59:58.332430 (+176079us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:59:58.376067 (+ 43637us) tablet_replica.cc:206] Creating consensus instance
0709 12:59:58.497741 (+121674us) ts_tablet_manager.cc:989] Replica registered.
0709 12:59:58.499700 (+  1959us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":3405,"tablet-copy.queue_time_us":1287026,"thread_start_us":1701373,"threads_started":2}
I20260709 12:59:58.757633  8112 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:58.773712  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:58.786015  8087 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:58.789713  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:58.790313  1683 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Advancing to term 24
I20260709 12:59:58.790390  1614 raft_consensus.cc:1240] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:59:58.762395  8092 raft_consensus.cc:3055] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:58.792256  8087 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:58.734054  8153 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.748329  8116 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.799592  8106 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:58.806051  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:58.806867  1541 raft_consensus.cc:2393] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 17: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 12:59:58.807101  1614 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 18. Current term is 19. Ops: []
I20260709 12:59:58.765733  8178 consensus_queue.cc:1059] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:59:58.764909  8177 consensus_queue.cc:1059] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 12:59:58.808245  1683 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 24.
I20260709 12:59:58.738057  8175 consensus_queue.cc:1059] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 12:59:58.793390  8092 raft_consensus.cc:740] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:59:58.825536  1683 raft_consensus.cc:1275] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:59:58.811323  8082 tablet_copy_client.cc:806] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
W20260709 12:59:58.830689  8113 consensus_meta.cc:287] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.517s	user 0.005s	sys 0.005s
I20260709 12:59:58.830910  7733 raft_consensus.cc:3055] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:59:58.831385  7733 raft_consensus.cc:740] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:58.830977  8060 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.832114  7733 consensus_queue.cc:260] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.833312  7733 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:58.836882  8178 consensus_queue.cc:1048] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:58.837678  8067 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.844851  8082 tablet_copy_client.cc:670] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
W20260709 12:59:58.846180  8170 log.cc:927] Time spent T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.336s	user 0.015s	sys 0.028s
I20260709 12:59:58.847337  2295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32802 (request call id 615) took 1344 ms. Trace:
I20260709 12:59:58.848690  8006 consensus_queue.cc:1048] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:59:58.813247  8064 consensus_queue.cc:260] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:58.853057  1685 raft_consensus.cc:1240] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 13. Current term is 14. Ops: [13.14-13.14]
I20260709 12:59:58.859793  1540 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 12:59:58.860486  1508 leader_election.cc:400] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 18. Current term is 19.
I20260709 12:59:58.860867  1508 leader_election.cc:403] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:58.867904  8067 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:58.868180  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:58.869200  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:58.869907  8153 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:58.870409  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:58.838274  8038 raft_consensus.cc:697] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:58.878646  8038 consensus_queue.cc:237] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.847831  2295 rpcz_store.cc:276] 0709 12:59:57.503357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.510473 (+  7116us) service_pool.cc:224] Handling call
0709 12:59:58.847085 (+1336612us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b54005e9054. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:59:58.847237 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1328243456}
I20260709 12:59:58.854485  8044 consensus_queue.cc:260] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.888804  1610 raft_consensus.cc:1275] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:59:58.888949  8044 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:58.890059  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:58.890766  1610 raft_consensus.cc:2368] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 19. Current term is 20.
I20260709 12:59:58.891989  8018 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 18. Current term is 19.
I20260709 12:59:58.843503  8146 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:58.898484  1683 raft_consensus.cc:1275] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:59:58.852190  8152 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:58.852074  8092 consensus_queue.cc:260] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.902197  8092 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:58.898658  1508 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 12:59:58.898272  8161 consensus_meta.cc:287] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.576s	user 0.006s	sys 0.003s
I20260709 12:59:58.918963  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:58.908767  8179 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:58.921137  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:58.928696  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:58.920876  8069 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.931145  1688 raft_consensus.cc:1275] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:59:58.932444  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:59:58.936532  8176 log.cc:927] Time spent T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:59:58.936753  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:58.938186  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:58.939553  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:58.933713  8069 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.940104  1690 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:59:58.930008  8180 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:58.935659  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:58.945581  8070 raft_consensus.cc:3055] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:58.946060  8070 raft_consensus.cc:740] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:58.952008  1683 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 12:59:58.941982  8039 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:58.955507  8069 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:58.956822  8035 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.957607  8030 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:58.957361  8035 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:58.957823  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:58.958171  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:58.909355  8161 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:58.960415  2298 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 17: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:59:58.961706  8030 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.941562  8180 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:58.962423  1541 raft_consensus.cc:1275] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:59:58.964607  1508 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:58.966089  8030 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:58.969259  8179 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:59:58.969707  8035 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:58.969835  8179 raft_consensus.cc:697] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:58.972536  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:58.974411  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:58.978695  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:58.981509  8152 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 12:59:58.977281  8070 consensus_queue.cc:260] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:58.971712  8165 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:59:58.997424  1616 raft_consensus.cc:1240] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:58.971840  8178 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:58.997466  1614 raft_consensus.cc:2368] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 17. Current term is 18.
I20260709 12:59:58.959131  8116 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:59.001021  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:59.002987  1690 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 24.
I20260709 12:59:59.003647  1691 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 18.
I20260709 12:59:58.965787  8180 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:59.008997  1691 raft_consensus.cc:1240] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:59:59.010274  8070 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:59:59.007222  1683 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
W20260709 12:59:59.020982  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:59.039958  8161 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:59.009709  1508 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:58.989290  8179 consensus_queue.cc:237] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:59:59.055119  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 45503.2us
I20260709 12:59:59.056995  1505 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:59.061462  8190 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:59:59.062026  8190 raft_consensus.cc:697] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:59.021591  8178 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:59.056272  1654 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:59:59.060212  8184 log.cc:927] Time spent T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:59:59.058704  8155 raft_consensus.cc:3055] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:59.062903  8190 consensus_queue.cc:237] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:59.066188  8152 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:59:59.066967  8063 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 12:59:59.060489  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 12:59:59.049099  8186 log.cc:927] Time spent T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:59:59.064579  1683 raft_consensus.cc:1275] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:59:59.064126  1508 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:59.068001  1690 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:59:59.068729  8063 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:59.075444  8178 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:59.088644  1690 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 12:59:59.089761  1581 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:59.080763  8013 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:59:59.065613  8146 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:59:59.066215  8155 raft_consensus.cc:740] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 12:59:59.091651  8077 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:59:59.085924  1683 raft_consensus.cc:1275] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:59:59.077262  1654 leader_election.cc:400] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 19. Current term is 20.
I20260709 12:59:59.093179  1654 leader_election.cc:403] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:59.091115  1581 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:59.094503  1581 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:59.095805  8013 raft_consensus.cc:697] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:59.096822  8013 consensus_queue.cc:237] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:59.097577  8077 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:59:59.098130  8077 raft_consensus.cc:697] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:59.098959  8077 consensus_queue.cc:237] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:59.101305  1581 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:59.090575  8152 consensus_queue.cc:1048] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:59:59.106140  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:59.104161  8039 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:59:59.103355  8019 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:59:59.106182  8188 log.cc:927] Time spent T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:59:59.110052  8070 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:59:59.118148  8039 raft_consensus.cc:697] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:59.109161  8124 consensus_queue.cc:1059] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:59:59.119057  1583 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:59.096262  8155 consensus_queue.cc:260] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:59.118217  8161 consensus_queue.cc:1048] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:59:59.120836  8151 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:59.127164  7975 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:59:59.126214  1583 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:59.134575  1583 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 12:59:59.135093  8123 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:59:59.139348  8113 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:59:59.141283  8113 raft_consensus.cc:697] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:59.142164  8113 consensus_queue.cc:237] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:59.140718  8123 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:59.130749  7975 raft_consensus.cc:697] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 24 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:59.156643  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 4313) took 1070 ms. Trace:
I20260709 12:59:59.157179  1533 rpcz_store.cc:276] 0709 12:59:58.086133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.086275 (+   142us) service_pool.cc:224] Handling call
0709 12:59:59.156326 (+1070051us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b5400313dd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:59:59.156530 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62688128}
W20260709 12:59:59.165058  8189 log.cc:927] Time spent T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.120s	user 0.003s	sys 0.000s
I20260709 12:59:59.136875  8117 consensus_queue.cc:1048] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:59:59.166005  7975 consensus_queue.cc:237] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 12:59:59.171594  8148 raft_consensus.cc:3055] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:59:59.172096  8148 raft_consensus.cc:740] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:59.173066  8148 consensus_queue.cc:260] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:59.174427  8148 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:59.145047  8155 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:59.144572  8123 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:59:59.178383  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:59.183257  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:59.143563  8019 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
W20260709 12:59:59.189949  1686 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 4435) took 1297 ms (client timeout 1599 ms). Trace:
I20260709 12:59:59.190084  8044 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 12:59:59.190415  1686 rpcz_store.cc:269] 0709 12:59:57.890622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.890755 (+   133us) service_pool.cc:224] Handling call
0709 12:59:59.188114 (+1297359us) spinlock_profiling.cc:243] Waited 526 ms on lock 0x7b54002701d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:59:59.188256 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1209065856}
I20260709 12:59:59.190766  8044 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:59.133188  8039 consensus_queue.cc:237] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 11.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:59.192276  1583 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 12:59:59.204566  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 71922.4us
W20260709 12:59:59.204758  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 80030.2us
I20260709 12:59:59.210224  1533 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 17. Current term is 18. Ops: []
I20260709 12:59:59.204432  8019 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:59:59.212766  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:59.223436  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3526) took 1061 ms. Trace:
I20260709 12:59:59.223904  1613 rpcz_store.cc:276] 0709 12:59:58.162270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.166169 (+  3899us) service_pool.cc:224] Handling call
0709 12:59:58.202305 (+ 36136us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:58.296796 (+ 94491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.223139 (+926343us) spinlock_profiling.cc:243] Waited 66.7 ms on lock 0x7b54002ffb54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:59:59.223338 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153492352}
I20260709 12:59:59.224751  8063 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:59.226177  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 895) took 1121 ms. Trace:
I20260709 12:59:59.227206  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 3637) took 1059 ms. Trace:
I20260709 12:59:59.214668  8060 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:59.216637  8059 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:59.220881  8191 log.cc:927] Time spent T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:59:59.227591  1609 rpcz_store.cc:276] 0709 12:59:58.168078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.168217 (+   139us) service_pool.cc:224] Handling call
0709 12:59:58.168565 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:58.361578 (+193013us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.226992 (+865414us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b540032b754. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:59:59.227149 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":442430208}
I20260709 12:59:59.226567  1608 rpcz_store.cc:276] 0709 12:59:58.104685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.104829 (+   144us) service_pool.cc:224] Handling call
0709 12:59:59.225974 (+1121145us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b54002567d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:59:59.226118 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":912867584}
I20260709 12:59:59.239372  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:59.226725  8194 consensus_queue.cc:1059] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:59:59.238349  8059 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:59.243978  8064 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:59:59.245302  8167 log.cc:927] Time spent T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.730s	user 0.017s	sys 0.023s
I20260709 12:59:59.247629  8037 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:59.235474  8030 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:59.251178  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3692) took 2032 ms. Trace:
I20260709 12:59:59.257870  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:59.258082  1655 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:59.260282  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:59.266716  1538 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 12:59:59.265579  1608 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 12:59:59.261771  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:59.263899  1689 rpcz_store.cc:276] 0709 12:59:57.218460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.578257 (+359797us) service_pool.cc:224] Handling call
0709 12:59:57.600840 (+ 22583us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:58.446080 (+845240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.250902 (+804822us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b54002c01d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 12:59:59.251082 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1878747520}
W20260709 12:59:59.269948  2269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:59.269948  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:59.257269  8030 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:59.272244  7896 raft_consensus.cc:3055] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:59:59.271028  1654 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 12:59:59.277923  1617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 3633) took 1780 ms (client timeout 1646 ms). Trace:
I20260709 12:59:59.278285  1615 raft_consensus.cc:1240] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 19. Current term is 20. Ops: []
I20260709 12:59:59.278995  1608 raft_consensus.cc:2393] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 19: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:59:59.280189  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 12:59:59.280946  1608 raft_consensus.cc:2376] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20. Re-sending same reply.
I20260709 12:59:59.281936  1505 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:59.235898  8019 raft_consensus.cc:697] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:59.292177  1505 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:59.298081  8013 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:59:59.298722  8013 raft_consensus.cc:697] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:59.300856  8190 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.301491  8190 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:59.244046  8059 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:59.276844  7896 raft_consensus.cc:740] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:59.314560  8030 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:59.277019  8117 consensus_queue.cc:1059] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 12:59:59.315827  8117 raft_consensus.cc:3055] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:59:59.316177  8117 raft_consensus.cc:740] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:59.316989  8117 consensus_queue.cc:260] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.14, Last appended by leader: 14, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:59.318284  8117 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:59:59.272921  8158 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 12:59:59.320458  8158 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:59.322669  8158 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:59.305174  8121 consensus_queue.cc:1059] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 12:59:59.324304  8121 raft_consensus.cc:3055] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:59:59.324728  8121 raft_consensus.cc:740] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 12:59:59.325547  8121 consensus_queue.cc:260] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:59.325816  8123 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:59.326838  8121 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:59.330502  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 12:59:59.305544  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:59.323403  8154 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:59:59.307214   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:59.330834  1534 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
W20260709 12:59:59.278476  1617 rpcz_store.cc:269] 0709 12:59:57.497645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.497800 (+   155us) service_pool.cc:224] Handling call
0709 12:59:59.277696 (+1779896us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b5400445054. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:59:59.277833 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1715843968}
I20260709 12:59:59.329684  8019 consensus_queue.cc:237] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:59.347493  1612 raft_consensus.cc:1240] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 18. Current term is 19. Ops: []
I20260709 12:59:59.338804  1655 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 12:59:59.296327  8174 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:59:59.381999  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 12:59:59.309628  7896 consensus_queue.cc:260] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:59.290082  8037 consensus_queue.cc:1059] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 12:59:59.333223  8154 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:59.350574  8123 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 12:59:59.380822  8059 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:59:59.306738  8194 consensus_queue.cc:1048] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 12:59:59.400033  1689 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:59:59.308516  8049 consensus_queue.cc:1059] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 12:59:59.402714  8049 raft_consensus.cc:3055] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:59:59.403083  8049 raft_consensus.cc:740] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 12:59:59.403918  8049 consensus_queue.cc:260] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 12:59:59.405228  8049 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:59.410976  1689 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:59:59.432972  1537 raft_consensus.cc:1275] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:59:59.398993  8154 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:59:59.300367  8013 consensus_queue.cc:237] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:59:59.487285  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:59.412230  8011 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:59.491520  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:59.492234  1538 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:59:59.464962  8150 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:59.500914  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:59.401494  8059 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 12:59:59.487385  8181 log.cc:927] Time spent T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:59:59.515810  2266 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:59.524712  1617 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:59:59.489336  7896 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:59:59.529026  1582 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:59.530478  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:59.533670  2266 leader_election.cc:400] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for earlier term 12. Current term is 13.
I20260709 12:59:59.535069  1538 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 24.
I20260709 12:59:59.552393  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:59.562747  1533 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:59:59.563331  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:59.563997  1541 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:59.522773  8059 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:59:59.569638  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 12:59:59.572117  1536 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 4306) took 1511 ms (client timeout 1988 ms). Trace:
W20260709 12:59:59.593114  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:59.607692  2298 raft_consensus.cc:2393] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 18: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:59:59.538182  8155 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:59:59.612053  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:59.549885  8089 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:59:59.572796  1536 rpcz_store.cc:269] 0709 12:59:58.060878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.063210 (+  2332us) service_pool.cc:224] Handling call
0709 12:59:59.571929 (+1508719us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b5400246154. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:59:59.572049 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":522769792}
I20260709 12:59:59.566860  8070 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 19. Current term is 20.
I20260709 12:59:59.623728  1611 raft_consensus.cc:1240] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 12. Current term is 13. Ops: []
I20260709 12:59:59.530602  8077 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.081s
W20260709 12:59:59.617532  8145 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.880s	user 0.006s	sys 0.042s
I20260709 12:59:59.538990  8030 consensus_queue.cc:1048] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 12:59:59.630877  1613 raft_consensus.cc:1275] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:59:59.635629  1690 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:59:59.635988  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:59.639724  2298 raft_consensus.cc:2368] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 15. Current term is 16.
W20260709 12:59:59.633669  8145 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.006s	sys 0.042s
I20260709 12:59:59.648902  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 4316) took 1355 ms. Trace:
I20260709 12:59:59.653828  1656 leader_election.cc:400] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Vote denied by peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437) with higher term. Message: Invalid argument: T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 15. Current term is 16.
I20260709 12:59:59.654284  1656 leader_election.cc:403] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:59.649430  1540 rpcz_store.cc:276] 0709 12:59:58.293258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.293382 (+   124us) service_pool.cc:224] Handling call
0709 12:59:59.648690 (+1355308us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b5400247054. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 12:59:59.648828 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1113121664}
I20260709 12:59:59.656334  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
W20260709 12:59:59.657802  8202 log.cc:927] Time spent T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:59:59.659225  8011 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:59:59.663959  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 12:59:59.671123  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:59.671592  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:59.642774  8146 raft_consensus.cc:3055] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:59:59.677419  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:59.678332  1536 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 17: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 12:59:59.677667  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:59.678807  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:59.680775  2298 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 12:59:59.682189  1535 raft_consensus.cc:1240] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 12. Current term is 13. Ops: []
W20260709 12:59:59.689402  8205 log.cc:927] Time spent T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
W20260709 12:59:59.690919  8203 log.cc:927] Time spent T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:59:59.692891  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 12:59:59.657718  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 12:59:59.680699  8201 log.cc:927] Time spent T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.149s	user 0.000s	sys 0.002s
I20260709 12:59:59.672309  8014 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437) with higher term. Message: Invalid argument: T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 15. Current term is 16.
I20260709 12:59:59.740603  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:59.752705  2297 raft_consensus.cc:2393] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 19: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:59:59.740960  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:59.741180  1656 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:59.755539  1656 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:59.741371  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 12:59:59.676627  8146 raft_consensus.cc:740] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:59.761983  2298 raft_consensus.cc:2393] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 19: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 12:59:59.686201  8178 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 12:59:59.759127  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:59.764132  2301 raft_consensus.cc:1240] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 17. Current term is 18. Ops: []
I20260709 12:59:59.683759  8005 consensus_queue.cc:1048] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 12:59:59.676213  8155 consensus_queue.cc:1048] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 12:59:59.771721  1617 raft_consensus.cc:1275] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:59:59.793128  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:59.686947  8126 consensus_queue.cc:1048] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 12:59:59.759608  8070 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.773200  1537 raft_consensus.cc:1240] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:59.773627  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 211277us
I20260709 12:59:59.762837  8194 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:59:59.801221  1617 raft_consensus.cc:1275] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:59:59.760711  8174 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:59:59.801164  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:59.741726  8060 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.805231  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 12:59:59.806747  2301 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:59:59.804361  1507 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
W20260709 12:59:59.808012  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 119638us
I20260709 12:59:59.812017  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:59.824772  2301 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 24.
W20260709 12:59:59.825618  2269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:59.825928  1541 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
W20260709 12:59:59.826195  2269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:59.778369  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 12:59:59.805475  8174 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:59.772367  8178 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:59:59.835062  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:59.801002  8150 consensus_queue.cc:1059] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 12:59:59.801115  8037 consensus_queue.cc:1059] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:59:59.826897  8148 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:59.810909  8060 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:59.808179  8165 consensus_queue.cc:1059] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 12:59:59.839844  1581 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 12:59:59.808845  8125 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.026s
I20260709 12:59:59.805933  8070 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:59:59.849104  8210 log.cc:927] Time spent T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:59:59.841459  8082 tablet_copy_client.cc:538] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:59:59.850248  8212 log.cc:927] Time spent T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:59:59.854002  1535 raft_consensus.cc:1275] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:59:59.832720  8174 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:59.813895  8039 consensus_queue.cc:1048] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:59:59.865932  1581 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:59.900156  1581 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 12:59:59.866575  1541 raft_consensus.cc:1275] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
W20260709 12:59:59.871806  8214 log.cc:927] Time spent T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 12:59:59.873145  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:59.905391  1534 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
W20260709 12:59:59.863375  8199 log.cc:927] Time spent T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.618s	user 0.002s	sys 0.005s
W20260709 12:59:59.883702  8117 consensus_meta.cc:287] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.565s	user 0.005s	sys 0.002s
I20260709 12:59:59.887630  8154 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 12:59:59.913667  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 109394us
I20260709 12:59:59.889395  8044 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:59.889747  8178 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:59.863616  8077 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:59:59.892522  8142 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:59:59.894654  1655 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
W20260709 12:59:59.895571  8209 log.cc:927] Time spent T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 12:59:59.895951  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 12:59:59.916668  1539 raft_consensus.cc:1275] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:59:59.924600  1507 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 12:59:59.907258  8126 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.830427  8146 consensus_queue.cc:260] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 12:59:59.939718  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 45151.3us
I20260709 12:59:59.910181  8123 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:59:59.910841  8158 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:59:59.938447  1507 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 12:59:59.941161  1687 raft_consensus.cc:1240] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:59:59.915465  8064 raft_consensus.cc:3055] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:59:59.898240  7975 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 12:59:59.922823  8148 raft_consensus.cc:3055] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:00:00.038010  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:00.052196  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 114159us
I20260709 12:59:59.943804  8060 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 12:59:59.953516  8146 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:59:59.943554  8064 raft_consensus.cc:740] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:59.918251  1537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:47506
I20260709 12:59:59.951332  8049 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:59:59.939733  8089 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.089s
I20260709 12:59:59.951787  8148 raft_consensus.cc:740] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 12:59:59.942026  8126 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 12:59:59.939888  8178 consensus_queue.cc:1059] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.119s
I20260709 13:00:00.091859  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3521) took 2322 ms. Trace:
I20260709 12:59:59.946419  8217 consensus_queue.cc:1048] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.134s
I20260709 13:00:00.092314  1615 rpcz_store.cc:276] 0709 12:59:57.757482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:57.966097 (+208615us) service_pool.cc:224] Handling call
0709 12:59:59.278115 (+1312018us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.279424 (+  1309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.078395 (+798971us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b5400445050. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:00.079364 (+   969us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2956283136}
I20260709 12:59:59.958897  7884 consensus_queue.cc:1048] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.126s
W20260709 13:00:00.098901  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:00.099479  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.100919  8014 raft_consensus.cc:3055] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:00.101353  8014 raft_consensus.cc:740] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:00.102195  8014 consensus_queue.cc:260] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:00.103443  8014 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:00.077600  8049 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:00.104782  8049 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:00.077970  8060 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:00:00.108040  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.108896  8194 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.109426  8194 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:00.111373  8151 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:00.113340  8220 log.cc:927] Time spent T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
W20260709 13:00:00.115103  8223 log.cc:927] Time spent T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:00:00.121199  8070 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:00.121938  8194 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:00.124104  8121 consensus_meta.cc:287] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.797s	user 0.007s	sys 0.004s
I20260709 13:00:00.125267  8179 raft_consensus.cc:3055] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:00.125540  1615 raft_consensus.cc:1240] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:00.126590  8228 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.127115  8228 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:00.129982  8228 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:00.065663  8224 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:00.109699  8141 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:00.134249  8141 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:00.108650  8044 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:00.135246  8044 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:00.135913  8150 raft_consensus.cc:3055] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:00.136313  8150 raft_consensus.cc:740] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:00.137494  8154 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:00.137250  8150 consensus_queue.cc:260] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:00.137791  8114 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.138482  8150 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:00.138334  8114 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:00.134604  8126 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:00.109072  8219 log.cc:927] Time spent T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:00:00.141155  1539 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:00.111959  8151 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:00.141199  8179 raft_consensus.cc:740] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:00.096340  8113 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.151160  8179 consensus_queue.cc:260] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:00.151578  8113 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:00.137414  8157 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.152870  8157 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:00.153916  8113 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:00.154971  8157 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:00.154700  8064 consensus_queue.cc:260] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:00.156005  8064 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:00:00.108371  7896 consensus_meta.cc:287] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.571s	user 0.006s	sys 0.000s
I20260709 13:00:00.129855  8110 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:00.161913  1539 raft_consensus.cc:1275] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:00.163990  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 3532) took 1306 ms. Trace:
I20260709 13:00:00.168730  8113 consensus_queue.cc:1048] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:00.097261  8125 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.164429  1614 rpcz_store.cc:276] 0709 12:59:58.857168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.857316 (+   148us) service_pool.cc:224] Handling call
0709 13:00:00.163792 (+1306476us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b540008cad4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:00.163929 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251331456}
I20260709 13:00:00.174721  1685 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:00:00.152297  8179 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:00:00.181391  8059 consensus_meta.cc:287] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.568s	user 0.005s	sys 0.005s
I20260709 13:00:00.157089  8140 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.027s
I20260709 13:00:00.231576  1689 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:00:00.233136  1684 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:00:00.235513  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:00.239610  1617 raft_consensus.cc:2393] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 20: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:00.180873  8044 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:00.241887  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:00.145218  8148 consensus_queue.cc:260] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:00.246897  8070 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:00.247501  8070 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:00.249817  8070 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:00.251996  1533 raft_consensus.cc:1275] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:00:00.252816  8194 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.253304  8194 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:00.254101  8077 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:00:00.254855  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.255419  8151 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:00.226898  8229 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.256273  8229 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:00.256857  8141 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:00.261005  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:00.262600  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:00.263273  1616 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 25.
I20260709 13:00:00.264743  1686 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
W20260709 13:00:00.265436  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 156249us
I20260709 13:00:00.267078  1614 raft_consensus.cc:1240] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:00:00.179818  8125 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:00.255327  8194 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:00.273846  1583 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:00.264400  8154 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.270148  8070 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.237172  8059 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:00.300822  1537 raft_consensus.cc:606] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:00.258495  8229 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:00.269347  8113 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.301570  1505 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:00.282394  8082 tablet_bootstrap.cc:492] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 13:00:00.309976  7884 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:00.278452  8121 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:00.310647  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 354947us
I20260709 13:00:00.287732  8145 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.289479  8158 raft_consensus.cc:697] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:00.306200  8064 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:00.303131  8161 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:00:00.333666  1654 leader_election.cc:400] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 17. Current term is 18.
I20260709 13:00:00.327904  2267 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:00.328796  8194 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.329546  8044 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.281591  8157 consensus_queue.cc:1059] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:00:00.278798  8230 consensus_queue.cc:1048] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:00:00.332050  7884 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:00.275246  8049 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:00.326859  8140 consensus_queue.cc:1059] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:00.338557  8126 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:00.342270  1654 leader_election.cc:403] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:00.312860  8077 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:00.339035  2267 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:00.365491  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 54259.2us
I20260709 13:00:00.314025  8070 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:00.377358  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.309847  8154 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:00.323868  8121 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:00.322221  8113 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:00.336400  8064 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:00.367167  8114 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:00.325592  8145 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:00.401722  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 62827.5us
I20260709 13:00:00.402724  2267 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:00.383136  8236 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.364547  8044 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:00.347714  8194 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:00.406332  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 72914.4us
I20260709 13:00:00.425271  1687 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:00:00.425201  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:00.427874  1684 raft_consensus.cc:1275] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:00:00.430131  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:00.430461  1688 raft_consensus.cc:1240] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:00:00.381579  8077 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:00.420984  8222 consensus_queue.cc:1059] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:00:00.407125  8114 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:00:00.445022  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.418677  8242 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.442577  8125 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:00.418190  8140 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.418648  8157 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:00:00.429597  8014 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.429582  8117 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.468909  8014 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:00.469910  8243 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:00.470743  8243 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:00.472692  8117 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:00.473780  8070 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:00.475127  8117 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:00.475567  8049 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:00.476302  8014 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:00.477211  8154 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:00.479508  8125 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.480156  8125 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:00.482574  8125 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:00.485270  1583 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:00.430928  8039 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:00:00.498164  1436 catalog_manager.cc:5697] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 15 to 16, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 16 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:00.499599  1436 catalog_manager.cc:5697] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 17 to 18, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 18 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:00.402241  8158 consensus_queue.cc:237] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:00.460040  8190 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:00.443013  8161 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.046s
I20260709 13:00:00.460109  8248 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.445554  8245 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 17. Current term is 18.
I20260709 13:00:00.468636  8249 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:00.509888  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:00.505378  8206 log.cc:927] Time spent T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.884s	user 0.005s	sys 0.000s
I20260709 13:00:00.419520  8236 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:00.506836  8174 consensus_meta.cc:287] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.582s	user 0.010s	sys 0.000s
W20260709 13:00:00.506014  8238 log.cc:927] Time spent T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:00:00.504456  8114 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.518151  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:00.518977  8237 log.cc:927] Time spent T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:00:00.520798  8121 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:00.521090  8077 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:00.521592  8194 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:00.521759  1690 raft_consensus.cc:1275] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:00:00.522943  8148 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:00.505862  8117 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:00.523423  8113 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:00.465126  8140 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:00.524003  1683 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 13:00:00.512758  8059 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:00.536862  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4475) took 1345 ms. Trace:
I20260709 13:00:00.530059  1690 pending_rounds.cc:85] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 11
I20260709 13:00:00.461841  8242 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:00.514525  8249 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:00.535624  8208 log.cc:927] Time spent T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.719s	user 0.003s	sys 0.007s
I20260709 13:00:00.512740  8248 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:00.528025  8114 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:00.537351  1691 rpcz_store.cc:276] 0709 12:59:59.191672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.240158 (+ 48486us) service_pool.cc:224] Handling call
0709 12:59:59.240421 (+   263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:59.240803 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:59.240821 (+    18us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:59.245801 (+  4980us) log.cc:844] Serialized 26 byte log entry
0709 12:59:59.390165 (+144364us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:59:59.390215 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.390294 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:00.383543 (+993249us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 13:00:00.536558 (+153015us) raft_consensus.cc:1685] finished
0709 13:00:00.536585 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:00.536801 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":747,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":109,"spinlock_wait_cycles":5803392,"thread_start_us":142347,"threads_started":1,"wal-append.queue_time_us":282754}
I20260709 13:00:00.547144  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:00.547778  1691 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 20.
I20260709 13:00:00.539726  1690 pending_rounds.cc:107] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 17.12
W20260709 13:00:00.537434  8239 log.cc:927] Time spent T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:00:00.554092  1690 raft_consensus.cc:2889] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:00.557224  8044 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:00.557380  8059 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:00.557986  8059 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:00.536583  8064 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:00.531365  8117 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.558316  8242 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:00.554642  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:00.545257  8157 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.569247  1683 raft_consensus.cc:2410] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:00:00.549830  8254 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.572564  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 907) took 1048 ms. Trace:
I20260709 13:00:00.572961  1613 rpcz_store.cc:276] 0709 12:59:59.524166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.524282 (+   116us) service_pool.cc:224] Handling call
0709 12:59:59.561927 (+ 37645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.634184 (+ 72257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.572343 (+938159us) spinlock_profiling.cc:243] Waited 68.6 ms on lock 0x7b54000677d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:00.572503 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157769600}
I20260709 13:00:00.570467  8242 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:00.569885  8256 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:00:00.585861  8249 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:00.575132  8254 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:00.588461  8254 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:00.526614  8174 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:00.573364  8157 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:00.576491  8060 raft_consensus.cc:3055] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:00.575799  8242 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:00.567248  8117 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:00.578481  8243 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:00.590973  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.594528  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:00.598464  8174 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:00.598793  8242 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:00.599300  8059 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:00.600669  8236 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:00.602248  1682 raft_consensus.cc:1240] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:00.604425  1684 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 13:00:00.585783  8140 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:00.596370  8060 raft_consensus.cc:740] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:00.613647  8060 consensus_queue.cc:260] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:00.614413  8248 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:00.614939  8060 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:00:00.605453  8250 log.cc:927] Time spent T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:00:00.600800  8114 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:00.601809  8157 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:00.620445  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:00.621718  8240 log.cc:927] Time spent T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.376s	user 0.003s	sys 0.000s
I20260709 13:00:00.624652  8116 raft_consensus.cc:3055] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:00.625089  8116 raft_consensus.cc:740] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:00.625967  8116 consensus_queue.cc:260] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:00.627142  8116 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:00.628243  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:47506
I20260709 13:00:00.628880  1541 raft_consensus.cc:606] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:00.629190  1541 raft_consensus.cc:614] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:00:00.631856  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 324785us
I20260709 13:00:00.635962  8232 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:00:00.636678  8006 consensus_queue.cc:1048] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:00:00.637878  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 336405us
I20260709 13:00:00.638195  8006 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:00.638550  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.641496  1507 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:00.650417  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:00.651297  1534 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 13:00:00.659191  1612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db702b262c1644109366a56f6f0d805a"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 13:00:00.659920  1612 raft_consensus.cc:606] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:00.661338  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:00.661834  8123 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.001s	sys 0.009s
W20260709 13:00:00.662231  8123 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.001s	sys 0.009s
I20260709 13:00:00.662478  8123 raft_consensus.cc:697] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:00.667372  1534 raft_consensus.cc:1275] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:00:00.667233  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:00.667517  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:00.667791  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:00.668800  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:00.669281  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:00.669903  1539 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 19.
I20260709 13:00:00.670135  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:00.670341  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:00.670819  1534 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 13.
I20260709 13:00:00.670984  1542 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 16.
I20260709 13:00:00.664746  8005 consensus_queue.cc:1048] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:00:00.672973  2296 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 13:00:00.673662  8107 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.674146  8107 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:00.679188  1535 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 18.
I20260709 13:00:00.674386  8233 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:00.684504  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:00.686794  2267 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:00.688686  1505 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:00.688660  2267 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:00.689934  2267 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:00.644114  8174 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.693467  8123 consensus_queue.cc:237] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:00.696792  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:00.719723  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:00.721074  1689 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 19.
I20260709 13:00:00.694993  1541 raft_consensus.cc:1275] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:00:00.697358  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:00.724208  1538 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 19.
I20260709 13:00:00.700325  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:00.702271  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:00.719018  7896 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:00.694904  8005 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:00.698203  8140 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:00.725595  1537 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 20.
I20260709 13:00:00.733923  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:00.733976  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:00.734241  1534 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:00:00.737737  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:00.738003  1508 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:00.739248  1539 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 13:00:00.696918  8126 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:00.740005  8233 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:00.740250  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:00.739099  1540 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 24.
I20260709 13:00:00.740729  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:00.741820  1539 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 14.
I20260709 13:00:00.740403  8126 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.740576  8233 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.699801  8249 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.744513  2267 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:00.744712  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:00.682271  8117 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:00.749740  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:00.690488  8157 consensus_queue.cc:1048] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:00:00.756747  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:00.760166  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:00.741986  8140 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.757936  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:00.763535  1654 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:00.732643  8005 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.761001  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:00.694896  8234 consensus_queue.cc:1059] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:00:00.765952  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:00.766223  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:00.766459  2269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.767742  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:00.772217  1689 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 25.
W20260709 13:00:00.773073  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.700381  8174 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:00.727373  8060 consensus_queue.cc:1048] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:00:00.754050  8126 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:00.775425  1617 raft_consensus.cc:2393] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 16: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:00.781790  2298 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:00:00.781750  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:00.757987  8148 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:00.785926  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:00.784726  1537 raft_consensus.cc:2393] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 5: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:00.817587  2299 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:00:00.786113  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:00.821707  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:00.920840  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:00.763742  8114 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:00.753943  8233 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:00.919629  1534 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:00:00.771938  8125 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.919759  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:00.772195  8140 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:00.921523  2303 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 13:00:00.985178  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:00.784334  8059 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:00:00.784533  8263 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.986989  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:00.987001  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:00.926968  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 139620us
I20260709 13:00:00.988343  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:00.987213  1691 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 13:00:00.987916  1616 raft_consensus.cc:2393] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 16: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:00.774920  8005 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:00.821146  7896 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.994405  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:00.767215  8249 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:00.986692  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:00.788736  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:00.925675  8243 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:00.922690  8266 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.068424  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:01.056918  8263 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:01.076838  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:01.079525  1611 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:01.060156  1608 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 13:00:01.081089  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:00.924172  8114 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:00.987072  8089 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.085534  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:01.079468  1616 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:00:01.060551  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:00.918257  8148 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:01.060343  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:01.038146  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:01.080530  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:01.081907  1581 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:01.038393  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:01.087218  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:01.088364  1686 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 19.
I20260709 13:00:01.088735  1608 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
I20260709 13:00:01.089617  1537 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 13:00:01.088162  1685 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 14.
I20260709 13:00:01.095858  2300 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:00:01.087338  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:00.920176  8217 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.099522  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:01.100649  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:01.073880  8121 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:01.106266  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:01.103587  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:01.107744  1609 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 14.
I20260709 13:00:01.101158  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:01.104357  2298 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:00:00.987622  8125 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:01.101210  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:01.081086  8230 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.091550  8114 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:01.111968  1615 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:01.113294  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:01.117074  1686 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 18.
I20260709 13:00:01.113384  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:01.111002  2303 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:00:01.081776  7896 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:01.124807  1539 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 13:00:01.115901  8030 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:01.125880  8030 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:01.126081  8268 log.cc:927] Time spent T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.371s	user 0.001s	sys 0.000s
I20260709 13:00:01.126801  8174 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:01.127514  8270 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:00:01.112413  8121 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:01.130564  8121 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:01.132889  8262 log.cc:927] Time spent T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.368s	user 0.001s	sys 0.000s
I20260709 13:00:01.134407  8148 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:01.134886  8249 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:01.136212  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:01.141083  8030 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:01.100732  8260 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.152807  1615 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 13:00:01.163803  8275 consensus_queue.cc:1048] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:01.075126  8243 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:01.077824  8266 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:01.172323  1682 raft_consensus.cc:1275] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:00:01.183365  8030 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:01.190436  8114 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:01.167465  8272 log.cc:927] Time spent T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:00:01.152623  8249 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:01.099738  8089 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:01.167655  8261 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:01.113135  8217 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:01.242031  8161 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.244812  8148 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.119072  8230 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:01.167896  8222 consensus_queue.cc:1059] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.144s
I20260709 13:00:01.172149  8050 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.145s
I20260709 13:00:01.256737  8060 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:01.373945  8030 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:01.331073  8226 raft_consensus.cc:3055] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:00:01.388383  1436 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.024s	sys 0.038s
W20260709 13:00:01.389029  1436 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.025s	sys 0.038s
I20260709 13:00:01.396056  1655 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:01.396755  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 314951us
I20260709 13:00:01.406356  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:01.407212  1615 raft_consensus.cc:2393] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 25: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:01.359400  8222 consensus_queue.cc:1243] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer c262eac7fc904ae9bb91e450f6532e3f log is divergent from this leader: its last log entry 13.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:00:01.325685  8249 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:01.387178  8145 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:01.417793  1581 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:01.348443  8148 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:01.171218  8260 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:01.424834  8253 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:01.328433  8261 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:01.414948  8125 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:01.408438  8141 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:00:01.432240  8267 log.cc:927] Time spent T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.365s	user 0.001s	sys 0.000s
I20260709 13:00:01.390787  8226 raft_consensus.cc:740] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:01.350437  8161 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:01.408974  8030 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.377991  8060 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:01.437767  8092 raft_consensus.cc:3055] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:01.435205  8174 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:00:01.447950  1689 raft_consensus.cc:1240] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:01.405653  8117 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:01.442487  8141 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 13:00:01.441049  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 48626.3us
I20260709 13:00:01.443517  8121 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:01.466285  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:01.480988  1687 raft_consensus.cc:2393] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 19: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:01.515656  1505 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:01.482172  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:01.538749  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:01.538895  1687 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:01.539389  1689 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:00:01.536899  1536 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.002s	sys 0.013s
W20260709 13:00:01.540747  1536 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.003s	sys 0.013s
I20260709 13:00:01.464389  8039 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:00:01.468747  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 316496us
I20260709 13:00:01.463928  8092 raft_consensus.cc:740] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:01.468464  8263 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:01.563555  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:01.471812  8141 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:01.457448  8030 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:01.532810  7896 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:01.578428  8260 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:01.578488  8261 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:01.604453  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:01.605647  1691 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
W20260709 13:00:01.591563  8116 consensus_meta.cc:287] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.964s	user 0.010s	sys 0.001s
I20260709 13:00:01.592840  8114 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:01.593358  8060 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:01.593770  8230 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:01.535748  8243 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:01.598946  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:01.600257  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:01.600524  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:01.601114  1689 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 13:00:01.602561  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:01.608666  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4497) took 1021 ms. Trace:
I20260709 13:00:01.569140   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:00:01.549415  8039 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:01.652415  1609 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 13:00:01.660326  1690 rpcz_store.cc:276] 0709 13:00:00.587117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.587583 (+   466us) service_pool.cc:224] Handling call
0709 13:00:00.587913 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:00.588139 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:00.588165 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:00.588663 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:00:00.720321 (+131658us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:00.720384 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.720645 (+   261us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:01.431608 (+710963us) spinlock_profiling.cc:243] Waited 5.41 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 13:00:01.566895 (+135287us) raft_consensus.cc:1685] finished
0709 13:00:01.566915 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:01.608582 (+ 41667us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12444544,"thread_start_us":131152,"threads_started":1,"wal-append.queue_time_us":226948}
I20260709 13:00:01.609915  1687 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 13:00:01.566644  8117 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:01.645781  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:01.535874  8121 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:01.650321  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:01.663028   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:00:01.547391  8110 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.010s	sys 0.005s
I20260709 13:00:01.678504  1691 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 13:00:01.679423  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:01.612845  8217 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:01.610869  8158 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.682657  2303 raft_consensus.cc:2393] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 15: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
W20260709 13:00:01.616109  2296 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32802 (request call id 617) took 3092 ms (client timeout 1977 ms). Trace:
I20260709 13:00:01.613066  1654 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 13:00:01.665489  8233 consensus_meta.cc:287] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.657s	user 0.005s	sys 0.005s
I20260709 13:00:01.612169  7896 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:00:01.685809  8276 log.cc:927] Time spent T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:00:01.681038  8092 consensus_queue.cc:260] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.14, Last appended by leader: 14, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:01.689720  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 74048us
I20260709 13:00:01.548858  8226 consensus_queue.cc:260] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:01.693626  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 85878.1us
I20260709 13:00:01.676445  8039 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:00:01.681166  8005 consensus_meta.cc:287] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.621s	user 0.010s	sys 0.001s
I20260709 13:00:01.682622  8117 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:01.681613  8110 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.994s	user 0.011s	sys 0.006s
I20260709 13:00:01.734234  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42356 (request call id 991) took 1066 ms. Trace:
I20260709 13:00:01.739327  1690 raft_consensus.cc:1275] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 13:00:01.785398  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:01.824419  1690 pending_rounds.cc:85] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 12
I20260709 13:00:01.824829  2303 raft_consensus.cc:2376] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17. Re-sending same reply.
W20260709 13:00:01.771606  1582 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:33437 timed out after 1.628s (SENT) [suppressed 12 similar messages]
I20260709 13:00:01.784650  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:01.778635  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:01.839164  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.823832  1535 rpcz_store.cc:276] 0709 13:00:00.667453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.667582 (+   129us) service_pool.cc:224] Handling call
0709 13:00:01.734002 (+1066420us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b5400219dd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:01.734155 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24850688}
I20260709 13:00:01.845327  1537 raft_consensus.cc:2410] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:00:01.843325  1534 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 13:00:01.825102  1690 pending_rounds.cc:107] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 13:00:01.689213  8148 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:01.778512  8289 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 13:00:01.705751  8243 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:01.821091  1583 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:01.863166  1690 raft_consensus.cc:2889] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:01.844081  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:01.820514  1654 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:01.862049  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:01.946437  1535 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
W20260709 13:00:01.844854  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 429474us
I20260709 13:00:01.826313  8249 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:01.821638  8157 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:01.854933  8113 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.020s	sys 0.012s
I20260709 13:00:01.759258  8107 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:01.859397  8290 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:01.902222  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 81202.2us
I20260709 13:00:01.865243  8092 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:01.939517  2303 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:01.953071  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4362) took 1252 ms. Trace:
W20260709 13:00:01.938268  1610 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.007s	sys 0.010s
I20260709 13:00:01.707672  8233 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:01.845120  8005 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:01.782124  8266 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:01.765919  8121 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:01.904078  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:01.945566  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3752) took 1297 ms. Trace:
I20260709 13:00:01.707206  8158 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:01.948596  1655 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:01.987795  1690 rpcz_store.cc:276] 0709 13:00:00.647754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.711006 (+1063252us) service_pool.cc:224] Handling call
0709 13:00:01.738902 (+ 27896us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:01.875748 (+136846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:01.945500 (+ 69752us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:01.988708  1655 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:01.987474  1537 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 13:00:01.991058  1655 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:01.952409  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:01.954473  1610 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.007s	sys 0.010s
I20260709 13:00:01.901417  8243 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:01.856990  8226 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:01.939872  2294 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.010s	sys 0.020s
I20260709 13:00:01.937734  8287 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:01.953512  1542 rpcz_store.cc:276] 0709 13:00:00.697682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.697823 (+   141us) service_pool.cc:224] Handling call
0709 13:00:00.721114 (+ 23291us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:00.724391 (+  3277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:00.724422 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:00.728966 (+  4544us) log.cc:844] Serialized 532 byte log entry
0709 13:00:00.992787 (+263821us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:00:00.992858 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.992936 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:01.950202 (+957266us) raft_consensus.cc:1685] finished
0709 13:00:01.950228 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:01.950432 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2761,"raft.queue_time_us":2871,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":12015,"thread_start_us":222986,"threads_started":1,"wal-append.queue_time_us":707377}
W20260709 13:00:01.950748  8113 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.020s	sys 0.016s
W20260709 13:00:01.955843  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 135447us
W20260709 13:00:01.696082  2296 rpcz_store.cc:269] 0709 12:59:58.523449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.525294 (+  1845us) service_pool.cc:224] Handling call
0709 13:00:01.595705 (+3070411us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b5400129dd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:01.610308 (+ 14603us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4541914880}
I20260709 13:00:01.992039  1583 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:01.950024  8126 consensus_meta.cc:287] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 1.126s	user 0.009s	sys 0.002s
I20260709 13:00:01.945782  8161 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:01.966885  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.000121  8145 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:01.993536  1535 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
W20260709 13:00:01.997458  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 481931us
I20260709 13:00:01.999122  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3546) took 1211 ms. Trace:
W20260709 13:00:02.000005  1682 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.025s	sys 0.029s
I20260709 13:00:02.006603  2299 raft_consensus.cc:1240] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 19. Current term is 20. Ops: []
W20260709 13:00:02.029150  1682 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.025s	sys 0.029s
I20260709 13:00:01.991286  8249 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:02.009663  1612 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 13:00:02.028980  1610 rpcz_store.cc:276] 0709 13:00:00.787947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.788165 (+   218us) service_pool.cc:224] Handling call
0709 13:00:00.991275 (+203110us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:00.991505 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:00:01.388070 (+396565us) log.cc:844] Serialized 14 byte log entry
0709 13:00:01.998724 (+610654us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:01.998785 (+    61us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:01.998838 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:01.998914 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:01.999057 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4507,"prepare.queue_time_us":543050,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":5437,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":6206,"thread_start_us":936937,"threads_started":2}
W20260709 13:00:01.998118  2294 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.010s	sys 0.021s
I20260709 13:00:02.011968  8030 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:01.989012  8148 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:01.992609  2295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32788 (request call id 569) took 1223 ms. Trace:
I20260709 13:00:01.955447  8290 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:01.995671  8243 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:02.000790  8287 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:02.025753  8145 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:02.030857  1505 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:02.034406  2303 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 13:00:02.030927  1583 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:01.959651  7896 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:01.954389  8157 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:02.036921  1654 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:01.995903  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:02.026646  8266 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.116044  8266 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:02.041690  2295 rpcz_store.cc:276] 0709 13:00:00.766715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.769450 (+  2735us) service_pool.cc:224] Handling call
0709 13:00:00.921263 (+151813us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:01.081513 (+160250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:01.084972 (+  3459us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:01.164197 (+ 79225us) log.cc:844] Serialized 26 byte log entry
0709 13:00:01.446748 (+282551us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:01.455204 (+  8456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:01.460110 (+  4906us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:01.951815 (+491705us) raft_consensus.cc:1685] finished
0709 13:00:01.951836 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:01.989821 (+ 37985us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3658,"raft.queue_time_us":3502,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":8018,"thread_start_us":274373,"threads_started":1,"wal-append.queue_time_us":423728}
I20260709 13:00:02.118242  8266 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:02.054409  8060 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:02.053308  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:02.053622  1583 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:02.035841  8249 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:02.119025  8060 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:02.024899  8126 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:02.028534  8217 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:02.119861  1542 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 13:00:02.119349  8249 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:02.063817  1537 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:02.124289  7896 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:02.129408  8279 log.cc:927] Time spent T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.358s	user 0.001s	sys 0.000s
I20260709 13:00:02.129940  8013 raft_consensus.cc:3055] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:02.130479  8013 raft_consensus.cc:740] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:02.130779  2302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32788 (request call id 572) took 1352 ms. Trace:
I20260709 13:00:02.131211  2302 rpcz_store.cc:276] 0709 13:00:00.778702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.778871 (+   169us) service_pool.cc:224] Handling call
0709 13:00:00.779244 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:00.779514 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:00.779541 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:00.918111 (+138570us) log.cc:844] Serialized 26 byte log entry
0709 13:00:01.159876 (+241765us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:00:01.159923 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:01.160004 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:02.130529 (+970525us) raft_consensus.cc:1685] finished
0709 13:00:02.130554 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.130716 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":85770,"threads_started":1,"wal-append.queue_time_us":540125}
I20260709 13:00:02.119451  8060 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:02.132929  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:02.133635  2302 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 13:00:02.134999  2300 raft_consensus.cc:2393] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 14: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:02.132792  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3749) took 1485 ms. Trace:
I20260709 13:00:02.137436  1688 rpcz_store.cc:276] 0709 13:00:00.646975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.137882 (+490907us) service_pool.cc:224] Handling call
0709 13:00:01.138165 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:01.138491 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:01.138518 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:01.399795 (+261277us) log.cc:844] Serialized 26 byte log entry
0709 13:00:01.862432 (+462637us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:01.862483 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:01.862555 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:02.132553 (+269998us) raft_consensus.cc:1685] finished
0709 13:00:02.132575 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.132731 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10085,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":15086,"thread_start_us":437881,"threads_started":1,"wal-append.queue_time_us":626390}
I20260709 13:00:02.101612  8252 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:02.102977  8158 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:02.048694  8287 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:00:02.049254  8140 consensus_meta.cc:287] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 1.020s	user 0.012s	sys 0.001s
I20260709 13:00:02.104694  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:02.105713  8005 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:02.105597  8280 consensus_queue.cc:1048] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.110s
I20260709 13:00:02.108024  8157 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:02.108596  8288 log.cc:927] Time spent T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.203s	user 0.000s	sys 0.009s
I20260709 13:00:02.043186  8148 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:02.118460  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:02.054077  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:02.249504  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:02.250208  2303 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:00:02.140950  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 87438.8us
W20260709 13:00:02.142551  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.143349  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:02.253012  2302 raft_consensus.cc:2368] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 19. Current term is 20.
I20260709 13:00:02.253964  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:02.255095  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:02.052120  8145 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:02.147367  8286 log.cc:927] Time spent T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:00:02.211830  1536 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.027s	sys 0.048s
W20260709 13:00:02.281504  1536 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.027s	sys 0.049s
I20260709 13:00:02.139744  8252 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:02.054994  8292 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:02.055670  8269 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.016s	sys 0.017s
W20260709 13:00:02.277879  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.148947  8217 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:02.210264  8117 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:02.207603  8151 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 13:00:02.310808  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 539258us
I20260709 13:00:02.242516  2296 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 13:00:02.320223  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:02.212845  8140 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:02.320223  1582 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:02.297991  8252 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:02.295094  2295 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:00:02.131302  8013 consensus_queue.cc:260] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:02.334178  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 3363) took 1548 ms. Trace:
I20260709 13:00:02.335853  2300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32794 (request call id 912) took 1235 ms. Trace:
I20260709 13:00:02.310524  8217 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:02.339824  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:02.365268  1610 raft_consensus.cc:2368] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15.
W20260709 13:00:02.341264  8141 consensus_meta.cc:287] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.694s	user 0.010s	sys 0.000s
W20260709 13:00:02.344359  1685 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.030s	sys 0.015s
I20260709 13:00:02.346204  2300 rpcz_store.cc:276] 0709 13:00:01.100192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.100378 (+   186us) service_pool.cc:224] Handling call
0709 13:00:02.335617 (+1235239us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54007706d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:02.335783 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2370500992}
I20260709 13:00:02.366659  2297 raft_consensus.cc:2368] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 16. Current term is 17.
I20260709 13:00:02.324740  8292 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:02.213680  8039 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:02.329398  8233 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:02.331768  8126 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:02.336341  8157 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:02.372684  1685 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.030s	sys 0.015s
I20260709 13:00:02.331679  7896 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:02.368109  8217 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:02.363593  8290 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:02.323580  8151 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:02.363903  8050 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:02.372056  8107 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.371526  8300 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:02.399387  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 408403us
I20260709 13:00:02.385792  8013 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:02.384370  8292 raft_consensus.cc:697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:02.413365  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:02.414134  1609 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 19.
I20260709 13:00:02.405779  1655 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:02.422562  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:02.417013  1609 raft_consensus.cc:1240] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:00:02.423579  1608 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 18.
I20260709 13:00:02.426694  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 998) took 1739 ms. Trace:
I20260709 13:00:02.376169  8141 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:02.431869  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:02.428313  1537 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 13:00:02.434109  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:02.433446  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 4368) took 1001 ms. Trace:
I20260709 13:00:02.400660  8280 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:02.438449  1610 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 13.
I20260709 13:00:02.437621  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:02.394675  8157 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:02.443342  1614 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 15.
I20260709 13:00:02.438359  1537 rpcz_store.cc:276] 0709 13:00:01.432325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.995622 (+563297us) service_pool.cc:224] Handling call
0709 13:00:02.433368 (+437746us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:02.448566  1538 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.013s	sys 0.022s
W20260709 13:00:02.449208  1538 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.014s	sys 0.022s
I20260709 13:00:02.345468  1539 rpcz_store.cc:276] 0709 13:00:00.785498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.785655 (+   157us) service_pool.cc:224] Handling call
0709 13:00:02.333890 (+1548235us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b54000735d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:02.334019 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":706167040}
I20260709 13:00:02.427227  1536 rpcz_store.cc:276] 0709 13:00:00.687235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.687381 (+   146us) service_pool.cc:224] Handling call
0709 13:00:00.687698 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:00.696000 (+  8302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:00.696029 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:00.708681 (+ 12652us) log.cc:844] Serialized 26 byte log entry
0709 13:00:01.541281 (+832600us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:02.292930 (+751649us) log.cc:844] Serialized 14 byte log entry
0709 13:00:02.426391 (+133461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.426465 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:02.426506 (+    41us) raft_consensus.cc:1685] finished
0709 13:00:02.426518 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.426636 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11134,"prepare.queue_time_us":768496,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":9426,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":19227,"thread_start_us":1635368,"threads_started":3,"wal-append.queue_time_us":1095791}
I20260709 13:00:02.409435  8050 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:02.460546  2303 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
W20260709 13:00:02.439694  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 119567us
I20260709 13:00:02.412304  8107 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:02.469794  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4363) took 1042 ms. Trace:
I20260709 13:00:02.469725  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4364) took 1040 ms. Trace:
I20260709 13:00:02.476743  1540 rpcz_store.cc:276] 0709 13:00:01.427476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.427666 (+   190us) service_pool.cc:224] Handling call
0709 13:00:01.428052 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:01.428290 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:01.865066 (+436776us) log.cc:844] Serialized 14 byte log entry
0709 13:00:02.467712 (+602646us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:02.467775 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:02.467857 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.467962 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.468137 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":720770,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"thread_start_us":1036649,"threads_started":3,"wal-append.queue_time_us":572008}
I20260709 13:00:02.488309  8269 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:02.423321  8243 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:02.542037  8299 log.cc:927] Time spent T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:00:02.542897  8157 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:02.543567  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:02.559120  1610 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 17.
I20260709 13:00:02.560518  8243 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:02.561683  8301 log.cc:927] Time spent T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:00:02.566226  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:02.548180  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 56781us
I20260709 13:00:02.569664  1582 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:02.552551  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.414358  8300 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:02.544296  8126 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:02.600749  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.547063  8148 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:02.620675  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:02.621331  1608 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:02.617807  2301 raft_consensus.cc:1275] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 12 index: 14. Preceding OpId from leader: term: 13 index: 14. (term mismatch)
W20260709 13:00:02.568820  8226 consensus_meta.cc:287] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.566s	user 0.003s	sys 0.007s
W20260709 13:00:02.582082  8308 log.cc:927] Time spent T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:00:02.567180  8304 log.cc:927] Time spent T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:00:02.622079  2301 pending_rounds.cc:85] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579: Aborting all ops after (but not including) 13
I20260709 13:00:02.626351  2301 pending_rounds.cc:107] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579: Aborting uncommitted NO_OP operation due to leader change: 12.14
I20260709 13:00:02.626701  2301 raft_consensus.cc:2889] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:02.599375  8293 log.cc:927] Time spent T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
W20260709 13:00:02.585309  8305 log.cc:927] Time spent T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:00:02.627441  2301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32788 (request call id 571) took 1857 ms. Trace:
W20260709 13:00:02.622483  1654 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.005s	sys 0.039s
I20260709 13:00:02.586023  8243 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:02.585884  8260 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:02.654122  1654 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.005s	sys 0.039s
W20260709 13:00:02.654729  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 617919us
I20260709 13:00:02.547763  8280 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.108s
I20260709 13:00:02.628171  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3751) took 1980 ms. Trace:
W20260709 13:00:02.629029  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 58050.8us
I20260709 13:00:02.629981  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 931) took 1705 ms. Trace:
I20260709 13:00:02.656730  1691 rpcz_store.cc:276] 0709 13:00:00.924169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.601956 (+1677787us) service_pool.cc:224] Handling call
0709 13:00:02.629447 (+ 27491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.629646 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:02.629683 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:02.629728 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:02.629766 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.629816 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.629927 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:02.632925  2298 raft_consensus.cc:2410] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:00:02.655442  1654 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:02.655853  1682 rpcz_store.cc:276] 0709 13:00:00.647489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.386117 (+738628us) service_pool.cc:224] Handling call
0709 13:00:01.386376 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:01.386576 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:00:02.029649 (+643073us) log.cc:844] Serialized 14 byte log entry
0709 13:00:02.627806 (+598157us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:02.627872 (+    66us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:02.627922 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.627983 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.628118 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":931643,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":2381,"thread_start_us":1240379,"threads_started":3,"wal-append.queue_time_us":527557}
I20260709 13:00:02.585614  8310 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 13:00:02.664539  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 258868us
I20260709 13:00:02.665505  1655 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:02.653419  2301 rpcz_store.cc:276] 0709 13:00:00.772525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.772670 (+   145us) service_pool.cc:224] Handling call
0709 13:00:02.617054 (+1844384us) spinlock_profiling.cc:243] Waited 30 ms on lock 0x7b5800003c98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc86202afc0 00007fc862015929 00007fc8620153d2 00007fc85b58cbd4
0709 13:00:02.617423 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.627165 (+  9742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.627383 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68949376}
W20260709 13:00:02.662901  1582 consensus_peers.cc:597] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9324141fa1ba48aca59e97123ca5742e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:02.615522  8140 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:02.660983  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4504) took 1203 ms. Trace:
I20260709 13:00:02.671135  1682 rpcz_store.cc:276] 0709 13:00:01.457499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.660154 (+1202655us) service_pool.cc:224] Handling call
0709 13:00:02.660458 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.660664 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:02.660692 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:02.660730 (+    38us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:00:02.660764 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.660815 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.660929 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:02.669170  1582 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:02.680390  8300 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:02.685451  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4496) took 2098 ms. Trace:
I20260709 13:00:02.685911  1683 rpcz_store.cc:276] 0709 13:00:00.586789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.589236 (+  2447us) service_pool.cc:224] Handling call
0709 13:00:00.603685 (+ 14449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:00.606948 (+  3263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:00.606971 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:00.612106 (+  5135us) log.cc:844] Serialized 26 byte log entry
0709 13:00:01.820999 (+1208893us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b1800247480. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf10d1 00007fc85d00ca0f
0709 13:00:02.292776 (+471777us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:02.292818 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.292889 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:02.685140 (+392251us) raft_consensus.cc:1685] finished
0709 13:00:02.685159 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.685387 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":169,"raft.queue_time_us":1839,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":3704,"spinlock_wait_cycles":64743168,"thread_start_us":471542,"threads_started":1,"wal-append.queue_time_us":1769684}
W20260709 13:00:02.689231  8309 log.cc:927] Time spent T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:00:02.692214  8317 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:02.693049  8317 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:02.693562  8317 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:02.695871  8317 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:02.696998  8141 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:02.697651  8141 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:02.698074  8141 raft_consensus.cc:697] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:02.698930  8141 consensus_queue.cc:237] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:02.705960  1691 raft_consensus.cc:1275] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:02.706672  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4503) took 1249 ms. Trace:
I20260709 13:00:02.706707  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:02.707078  1691 rpcz_store.cc:276] 0709 13:00:01.457195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.657708 (+1200513us) service_pool.cc:224] Handling call
0709 13:00:02.676109 (+ 18401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.706393 (+ 30284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.706619 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:02.712695  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 47295.7us
I20260709 13:00:02.713762  1655 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:02.716872  1655 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:02.719817  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 3663) took 1321 ms. Trace:
I20260709 13:00:02.720255  1613 rpcz_store.cc:276] 0709 13:00:01.399018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.399217 (+   199us) service_pool.cc:224] Handling call
0709 13:00:01.417514 (+ 18297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:01.417902 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:01.417932 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:01.438769 (+ 20837us) log.cc:844] Serialized 26 byte log entry
0709 13:00:01.873426 (+434657us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:01.873474 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:01.873556 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:02.719602 (+846046us) raft_consensus.cc:1685] finished
0709 13:00:02.719623 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.719757 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19568,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":16736,"thread_start_us":411021,"threads_started":1,"wal-append.queue_time_us":884716}
I20260709 13:00:02.703810  8252 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:02.728027  2297 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32788 (request call id 566) took 1962 ms (client timeout 1628 ms). Trace:
W20260709 13:00:02.728631  2297 rpcz_store.cc:269] 0709 13:00:00.765884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.765996 (+   112us) service_pool.cc:224] Handling call
0709 13:00:02.727802 (+1961806us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b54005852d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:02.727938 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3660509056}
I20260709 13:00:02.731997  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:02.733632  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:02.734274  1682 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 13:00:02.735180  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:02.735913  1682 raft_consensus.cc:2393] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 17: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 13:00:02.697039  8298 log.cc:927] Time spent T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.324s	user 0.001s	sys 0.000s
W20260709 13:00:02.676965  8291 log.cc:927] Time spent T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.313s	user 0.000s	sys 0.001s
I20260709 13:00:02.737814  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:02.751073  1683 raft_consensus.cc:2368] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15.
I20260709 13:00:02.664423  8039 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:02.619237  8126 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:02.738571  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:02.753284  1682 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:02.741932  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:02.754446  1539 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 13:00:02.754935  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:02.755568  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:02.742763  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:02.756628  1617 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:00:02.696411  8317 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:02.715660  8243 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:02.740646   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:02.737478  8269 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:02.746367  1691 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 13:00:02.737071  8060 consensus_meta.cc:287] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.604s	user 0.005s	sys 0.006s
I20260709 13:00:02.745846  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:02.759922  1539 raft_consensus.cc:2393] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 21: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:02.749224  1608 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 14.
I20260709 13:00:02.760744  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:02.758379  1508 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:02.755712  1613 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 14.
I20260709 13:00:02.760293  8290 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.781953  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 919) took 2160 ms. Trace:
I20260709 13:00:02.746570  8151 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:02.784327  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 213604us
W20260709 13:00:02.779589  8319 log.cc:927] Time spent T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:00:02.757527  8226 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.670248  8310 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:02.789143  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:02.780730  8311 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:02.763268  8316 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:02.624722  8292 consensus_queue.cc:237] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:02.792737  2269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.792894  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:02.789382  7896 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:02.760442  8148 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.808493  1539 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 13:00:02.788086  1611 raft_consensus.cc:2368] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21.
I20260709 13:00:02.792161  8269 raft_consensus.cc:697] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:02.780207  8233 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.788342  1686 rpcz_store.cc:276] 0709 13:00:00.621441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.128543 (+507102us) service_pool.cc:224] Handling call
0709 13:00:01.365248 (+236705us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:01.395718 (+ 30470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:01.395754 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:01.410776 (+ 15022us) log.cc:844] Serialized 26 byte log entry
0709 13:00:01.938366 (+527590us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:01.938407 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:01.938474 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:02.781690 (+843216us) raft_consensus.cc:1685] finished
0709 13:00:02.781754 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.781895 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29940,"raft.queue_time_us":32850,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":8628,"thread_start_us":431792,"threads_started":1,"wal-append.queue_time_us":878188}
I20260709 13:00:02.783816  8321 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.821468  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:02.825700  1682 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 13:00:02.783212  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4502) took 2100 ms. Trace:
I20260709 13:00:02.828502  2299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32802 (request call id 630) took 1177 ms. Trace:
I20260709 13:00:02.786309  8322 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.831794  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4367) took 1400 ms. Trace:
W20260709 13:00:02.832101  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:02.817327  8287 consensus_meta.cc:287] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.601s	user 0.011s	sys 0.000s
I20260709 13:00:02.814515  1617 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 17.
I20260709 13:00:02.782742  8317 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:02.798045  8315 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:02.787016  8243 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:02.891714  8243 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:02.892432  8243 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:02.893237  8243 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:02.894637  8317 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:02.895226  8317 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:02.895687  8317 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:02.895982  8243 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:02.883419  1683 raft_consensus.cc:2410] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:00:02.897697  8252 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:02.898315  8312 log.cc:927] Time spent T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
I20260709 13:00:02.898159  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:02.882965  1542 rpcz_store.cc:276] 0709 13:00:01.431638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.121771 (+690133us) service_pool.cc:224] Handling call
0709 13:00:02.122045 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.141788 (+ 19743us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:02.141822 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:02.141864 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:02.141896 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.831542 (+689646us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b54002e7a54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:02.831594 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.831735 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44953472}
I20260709 13:00:02.881076  2299 rpcz_store.cc:276] 0709 13:00:01.651325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.651483 (+   158us) service_pool.cc:224] Handling call
0709 13:00:01.683277 (+ 31794us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.029444 (+346167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.828237 (+798793us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b54005e9054. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:02.828416 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":743193856}
I20260709 13:00:02.880800  1690 rpcz_store.cc:276] 0709 13:00:00.683158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.997351 (+1314193us) service_pool.cc:224] Handling call
0709 13:00:02.014079 (+ 16728us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:02.328337 (+314258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:02.328371 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:02.339340 (+ 10969us) log.cc:844] Serialized 26 byte log entry
0709 13:00:02.681556 (+342216us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:02.681603 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.681681 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:02.782965 (+101284us) raft_consensus.cc:1685] finished
0709 13:00:02.782988 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.783136 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13557,"raft.queue_time_us":481591,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":45638,"thread_start_us":592436,"threads_started":2,"wal-append.queue_time_us":396685}
I20260709 13:00:02.793412  8060 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:02.797319  8290 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:02.838622  7896 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:02.820919  8311 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:02.896741  2294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32788 (request call id 570) took 2129 ms. Trace:
I20260709 13:00:02.896899  8315 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.898933  1683 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 13:00:02.843437  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:02.887784  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:02.938907  1682 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 13:00:02.829922  8324 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:02.845453  8320 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.837222  8151 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:00:02.910910  8089 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:02.913048  8060 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:02.922504  8059 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:02.923309  8317 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:02.844580  8148 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:02.924433  2298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32802 (request call id 629) took 1275 ms. Trace:
I20260709 13:00:02.935278  8311 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:02.888240  8233 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:02.929152  7884 consensus_queue.cc:1048] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:02.877758  8325 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:02.933230  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.004205  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:03.007037  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:03.007835  2303 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 13:00:02.936127  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:02.936686  7896 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:02.943903  2269 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:02.947956  1656 connection.cc:256] RPC call timeout handler was delayed by -1.156969944000025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
W20260709 13:00:02.952473  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 194194us
I20260709 13:00:03.010450  1686 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 13:00:02.941581  1581 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:03.011704  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 70194.1us
I20260709 13:00:03.012501  1581 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:02.816829  8226 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:02.935756  8217 consensus_meta.cc:287] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.002s
I20260709 13:00:02.906420  8329 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:02.831370  8316 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:02.966576  8271 log.cc:927] Time spent T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 1.894s	user 0.000s	sys 0.026s
I20260709 13:00:02.984373  8269 consensus_queue.cc:237] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:02.969370  8145 consensus_meta.cc:287] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.668s	user 0.005s	sys 0.006s
I20260709 13:00:02.925998  8243 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:02.988655  8059 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:02.971386  8050 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:03.005028  2297 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 13:00:03.020015  8339 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.031456  2302 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:00:03.010716  1656 connection.cc:256] RPC call timeout handler was delayed by -1.1074182539999811s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2162s for a response
I20260709 13:00:02.900076  8287 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:02.971834  8151 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:02.887073  8322 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:03.020200  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:03.002265  8249 consensus_meta.cc:287] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.879s	user 0.010s	sys 0.002s
I20260709 13:00:02.990598  2298 rpcz_store.cc:276] 0709 13:00:01.648985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.649214 (+   229us) service_pool.cc:224] Handling call
0709 13:00:02.924209 (+1274995us) spinlock_profiling.cc:243] Waited 954 ms on lock 0x7b54005d02d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:02.924370 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2193873280}
I20260709 13:00:03.022779  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:03.041000  2299 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 13:00:03.006215  2266 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:03.022128  1581 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:03.024456  7896 consensus_queue.cc:1048] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:00:03.055526  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 49418.3us
W20260709 13:00:03.040096  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 223816us
I20260709 13:00:03.016147  8140 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.002151  8326 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:03.027896  1508 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:03.067106  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 47168.8us
I20260709 13:00:03.067816  1581 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:03.068132  1508 leader_election.cc:400] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15.
I20260709 13:00:03.069067  1508 leader_election.cc:403] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:03.069402  1614 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:03.054949  2301 raft_consensus.cc:2393] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 18: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:03.026916  7884 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:03.068948  1581 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:03.056573  2266 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:03.026823  8336 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:02.885982  8321 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:03.059805  1654 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:03.070818  7896 raft_consensus.cc:2804] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:03.071964  2266 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 13:00:03.040354  8013 consensus_meta.cc:287] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.630s	user 0.010s	sys 0.000s
W20260709 13:00:03.078194  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 132753us
I20260709 13:00:03.080099  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:03.078368  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:03.080739  7896 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:02.969859  8315 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:03.070160  7884 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:03.090361  7884 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:03.026311  8344 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:02.973135  8320 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:03.079432  1507 connection.cc:256] RPC call timeout handler was delayed by -1.5300673790000019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17800000000000002s for a response
I20260709 13:00:03.079324  2267 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:03.083621  7896 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:03.104072  1507 connection.cc:256] RPC call timeout handler was delayed by -1.3356673789999718s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
I20260709 13:00:03.029114  8060 consensus_queue.cc:1059] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:00:03.088573  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:03.040225  8050 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:03.023200  8217 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:03.073262  8096 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:03.107460  2269 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:03.058748  8126 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:03.041311  8151 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:03.061669  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:03.105656  1611 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:00:03.027513  8145 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:03.060992  8249 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:03.105831  1540 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 13:00:03.099911  1656 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:03.076898  8158 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:03.073987  8336 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.108561  8125 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:03.073369  8140 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:03.100145  1654 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:03.103509  8013 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:00:03.031015  8243 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:03.054467  8339 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:03.113731  8310 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:03.129827  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 61832us
I20260709 13:00:03.134262  1656 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:03.018322  8325 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:03.076926  8280 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:03.102648  8247 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:03.111405  8096 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:03.119095  8331 log.cc:927] Time spent T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 13:00:03.138859  8336 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:03.105320  8070 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:03.025811  8329 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:03.146998  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:03.136396  8050 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:03.148592  1656 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:03.128814  8126 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:03.135341  8158 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.150095  8280 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:03.137503  8125 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:03.145385  2296 raft_consensus.cc:2368] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 16. Current term is 17.
I20260709 13:00:03.140950  1654 leader_election.cc:400] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21.
I20260709 13:00:03.225215  1654 leader_election.cc:403] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:00:03.151852  8247 raft_consensus.cc:697] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 13:00:03.168781  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 96892.5us
I20260709 13:00:03.082834  8326 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:03.169967  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.146389  8292 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:00:03.181624  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 66766.4us
I20260709 13:00:03.106199  8344 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:03.185945  7884 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:03.186038  8334 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:03.145939  8252 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 13:00:03.199679  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 51177us
I20260709 13:00:03.202178  8126 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.250450  1656 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:03.187749  8070 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:03.158932  8096 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:00:03.223644  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 77042.8us
I20260709 13:00:03.231874  8280 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:03.202986  8050 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:03.233857  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 93045.8us
I20260709 13:00:03.238798  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:03.269943  2297 raft_consensus.cc:2393] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 17: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:03.223244  8158 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:03.158615  8290 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:03.245810  1581 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:03.251775  1656 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:03.200839  1690 raft_consensus.cc:2393] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 20: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:03.186724  8335 raft_consensus.cc:2955] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 24 LEADER]: Committing config change with OpId 22.16: config changed from index -1 to 16, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 13:00:03.252405  8324 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:03.253175  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:03.275031  1654 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:03.253412  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:03.254583  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:03.222424  8310 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:03.253206  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:03.256590  7884 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:03.137218  7896 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:03.225658  8226 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:03.258039  1508 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:03.261106  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 153728us
I20260709 13:00:03.231108  8125 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:03.232970  8233 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:03.271230  1582 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:03.248283  8292 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.277321  1656 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:03.277755  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 926) took 2580 ms. Trace:
I20260709 13:00:03.306734  1688 rpcz_store.cc:276] 0709 13:00:00.697675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.138982 (+1441307us) service_pool.cc:224] Handling call
0709 13:00:02.139378 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:02.454366 (+314988us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:02.454397 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:02.540293 (+ 85896us) log.cc:844] Serialized 26 byte log entry
0709 13:00:02.718809 (+178516us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:00:02.718861 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.718944 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:03.277350 (+558406us) raft_consensus.cc:1685] finished
0709 13:00:03.277386 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.277636 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":475793,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":7905,"thread_start_us":470127,"threads_started":2,"wal-append.queue_time_us":257812}
I20260709 13:00:03.260257  8126 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:03.244220  8342 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21.
I20260709 13:00:03.278789  2299 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 19.
I20260709 13:00:03.284799  7896 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:03.286597  2269 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:03.301606  1682 raft_consensus.cc:1240] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:00:03.258373  8070 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:03.311697  1656 leader_election.cc:400] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Vote denied by peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437) with higher term. Message: Invalid argument: T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 19. Current term is 20.
I20260709 13:00:03.260996  8353 raft_consensus.cc:2764] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 13:00:03.301174  8274 log.cc:927] Time spent T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 1.847s	user 0.008s	sys 0.017s
W20260709 13:00:03.315718  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 46462.5us
I20260709 13:00:03.316370  7884 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:03.346738  7884 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.347203  1582 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:03.347172  7884 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:03.276801  8050 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:03.349089  1582 leader_election.cc:400] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Vote denied by peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437) with higher term. Message: Invalid argument: T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 16. Current term is 17.
I20260709 13:00:03.314944  1581 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:03.255389  8316 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:03.354399  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:03.339288  1656 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:03.280557  1689 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 4.
I20260709 13:00:03.345381  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:03.349453  1582 leader_election.cc:403] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:03.309366  8287 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:03.312958  8292 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:03.366715  7884 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:03.328234  8141 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:03.275676  8363 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:02.931349  2294 rpcz_store.cc:276] 0709 13:00:00.767070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.768656 (+  1586us) service_pool.cc:224] Handling call
0709 13:00:00.781336 (+ 12680us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:01.003329 (+221993us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:01.059163 (+ 55834us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:01.132219 (+ 73056us) log.cc:844] Serialized 26 byte log entry
0709 13:00:02.048052 (+915833us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:00:02.466417 (+418365us) log.cc:844] Serialized 14 byte log entry
0709 13:00:02.540565 (+ 74148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.546270 (+  5705us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:02.877931 (+331661us) raft_consensus.cc:1685] finished
0709 13:00:02.877955 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.896668 (+ 18713us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":643717,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":2782,"raft.run_cpu_time_us":465,"raft.run_wall_time_us":65493,"thread_start_us":1244769,"threads_started":2,"wal-append.queue_time_us":1165222}
I20260709 13:00:03.262498  8252 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:03.326980  8352 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:03.380223  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:03.382932  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3750) took 2735 ms. Trace:
I20260709 13:00:03.369356  8310 raft_consensus.cc:697] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:03.341084  8322 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:03.349615  8333 log.cc:927] Time spent T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 13:00:03.382926  8355 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:03.349407  8354 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:00:03.404685  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 146736us
I20260709 13:00:03.409358  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:03.483464  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.428426  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:03.344689  8334 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:03.387926  8353 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:00:03.340739  8290 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:00:03.385151  8273 log.cc:927] Time spent T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 2.034s	user 0.018s	sys 0.026s
I20260709 13:00:03.406605  8287 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437) with higher term. Message: Invalid argument: T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 16. Current term is 17.
I20260709 13:00:03.361307  8259 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:03.375597  8338 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:03.362319  8342 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:00:03.462090  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 187172us
I20260709 13:00:03.466421  7884 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:03.362223  8247 consensus_queue.cc:237] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:03.462735  1685 rpcz_store.cc:276] 0709 13:00:00.647236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.367586 (+720350us) service_pool.cc:224] Handling call
0709 13:00:01.570563 (+202977us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:01.570954 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:01.570982 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:01.571445 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:00:02.926915 (+1355470us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b240024cf98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859dea9c4 00007fc859de8acb 00007fc859fa3dc9 00007fc859fa3a55 00007fc859fa2fb0 00007fc85cc19488 00007fc85cc19be8 00007fc85cbf1398 00007fc85cbec76a 00007fc85cbebbb6
0709 13:00:02.992136 (+ 65221us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b18002774e0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc85cbf94bc 00007fc859f4748b 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf10d1
0709 13:00:02.992313 (+   177us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:02.992352 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.992424 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:02.992486 (+    62us) raft_consensus.cc:1685] finished
0709 13:00:02.992498 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.382756 (+390258us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b5400229cd0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:03.382866 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6655,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":108,"spinlock_wait_cycles":504447872,"thread_start_us":705458,"threads_started":1,"wal-append.queue_time_us":728272}
I20260709 13:00:03.370914  8217 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:03.408694  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:03.651731  2296 raft_consensus.cc:2393] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 17: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:03.651403  8364 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:03.375456  8141 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 13:00:03.455597  8337 log.cc:927] Time spent T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.338s	user 0.000s	sys 0.001s
I20260709 13:00:03.556411  8140 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:03.667032  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 926) took 1001 ms. Trace:
I20260709 13:00:03.508610  8334 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:03.667412  1609 rpcz_store.cc:276] 0709 13:00:02.665830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.665977 (+   147us) service_pool.cc:224] Handling call
0709 13:00:02.666360 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:02.666725 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:02.666758 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:02.676130 (+  9372us) log.cc:844] Serialized 26 byte log entry
0709 13:00:02.931809 (+255679us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:02.931847 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.931908 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:03.666769 (+734861us) raft_consensus.cc:1685] finished
0709 13:00:03.666790 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.666969 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23525,"raft.queue_time_us":509,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":22432,"thread_start_us":177428,"threads_started":1,"wal-append.queue_time_us":333635}
I20260709 13:00:03.455045  8320 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:03.635474  8290 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.458367  8249 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:03.673787  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 329914us
I20260709 13:00:03.674674  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:03.675803  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:03.444281  8317 raft_consensus.cc:2804] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:00:03.588883  8343 log.cc:927] Time spent T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.400s	user 0.001s	sys 0.000s
I20260709 13:00:03.464243  8363 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:03.636670  8325 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:03.590251  8354 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:03.595054  8059 consensus_meta.cc:287] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.557s	user 0.008s	sys 0.000s
I20260709 13:00:03.596299  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:03.704535  2303 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 24.
I20260709 13:00:03.644681  8338 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:03.601408  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 286556us
W20260709 13:00:03.605710  1507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.009s	sys 0.013s
W20260709 13:00:03.710323  1507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.009s	sys 0.013s
W20260709 13:00:03.607913  8349 log.cc:927] Time spent T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.376s	user 0.001s	sys 0.000s
I20260709 13:00:03.431037  8327 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.184s
I20260709 13:00:03.614017  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:03.457525  8316 consensus_queue.cc:1059] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.144s
I20260709 13:00:03.601689  8355 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.597002  8315 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:03.628711  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 279761us
I20260709 13:00:03.635700  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4499) took 2999 ms. Trace:
W20260709 13:00:03.634192  8347 log.cc:927] Time spent T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.386s	user 0.000s	sys 0.001s
I20260709 13:00:03.454419  8352 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:03.739030  8352 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:03.611658  8324 raft_consensus.cc:697] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:03.739638  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:03.740224  8324 consensus_queue.cc:237] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:03.740969  8355 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:03.611402  8369 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:03.651397  8360 consensus_queue.cc:1059] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 19.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:00:03.388892  8321 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:03.615049  8339 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:03.608045  8292 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:03.663587  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:03.613493  8322 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:03.679770  7896 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:03.680936  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:03.673666  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:03.663753  8372 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:03.724249  8338 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:03.684527  2267 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.007s	sys 0.012s
I20260709 13:00:03.681751  2269 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:03.677335  8290 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:03.702768  8148 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:03.664337  8141 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:03.457252  8243 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:03.705569  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:03.798125  2303 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 22.
I20260709 13:00:03.799175  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:03.705569  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:03.800930  1685 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 16.
I20260709 13:00:03.707298  8354 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:03.707546  8329 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:03.714548  8145 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:03.719516  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:03.720047  2266 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:03.800331  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:03.646641  8310 consensus_queue.cc:237] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:03.721589  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:03.723265  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:03.723672  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:03.724864  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.726280  1689 raft_consensus.cc:2393] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 14: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:03.668516  8334 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:03.729729  8325 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:03.745340  8316 raft_consensus.cc:3055] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:00:03.746542  8359 log.cc:927] Time spent T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:00:03.730850  1684 rpcz_store.cc:276] 0709 13:00:00.619706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.650318 (+ 30612us) service_pool.cc:224] Handling call
0709 13:00:00.650871 (+   553us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:00.657175 (+  6304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:00.657207 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:00.690660 (+ 33453us) log.cc:844] Serialized 532 byte log entry
0709 13:00:00.923344 (+232684us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:00:00.923384 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.923469 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:03.089071 (+2165602us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 13:00:03.613149 (+524078us) raft_consensus.cc:1685] finished
0709 13:00:03.613175 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.619503 (+  6328us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5657,"raft.queue_time_us":5764,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":24201,"spinlock_wait_cycles":71044352,"thread_start_us":194884,"threads_started":1,"wal-append.queue_time_us":631283}
I20260709 13:00:03.678445  8317 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 13:00:03.589902  8357 log.cc:927] Time spent T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:00:03.779732  7896 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:03.782404  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4355) took 3130 ms. Trace:
I20260709 13:00:03.784390  8372 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:03.819125  8316 raft_consensus.cc:740] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:03.785519  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:03.786638  2296 raft_consensus.cc:2393] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 17: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:03.787277  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 999) took 2725 ms. Trace:
W20260709 13:00:03.789175  2267 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.008s	sys 0.012s
W20260709 13:00:03.793712  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 112037us
I20260709 13:00:03.828577  1507 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:03.872747  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 764907us
I20260709 13:00:03.873255  2269 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:03.795336  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:03.803548  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:03.872438  1541 rpcz_store.cc:276] 0709 13:00:01.061959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.062135 (+   176us) service_pool.cc:224] Handling call
0709 13:00:02.334643 (+1272508us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:02.631953 (+297310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:02.631988 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:02.632526 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 13:00:02.832641 (+200115us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:02.832676 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.832738 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:03.596541 (+763803us) raft_consensus.cc:1685] finished
0709 13:00:03.596561 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.786961 (+190400us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54000735d0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:03.787206 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":209307,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"spinlock_wait_cycles":2885091584,"thread_start_us":405965,"threads_started":2,"wal-append.queue_time_us":355038}
I20260709 13:00:03.720342  8363 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:03.805456  1505 leader_election.cc:400] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15.
I20260709 13:00:03.802340  2298 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 13:00:03.758001  8326 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:03.797544  8321 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.724680  8059 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:03.826818  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:03.863515  1533 rpcz_store.cc:276] 0709 13:00:00.648892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.649463 (+   571us) service_pool.cc:224] Handling call
0709 13:00:00.649823 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:00.665697 (+ 15874us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:00.665732 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:00.689078 (+ 23346us) log.cc:844] Serialized 26 byte log entry
0709 13:00:00.920391 (+231313us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:00.920428 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:00.920518 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:03.152506 (+2231988us) spinlock_profiling.cc:243] Waited 61.2 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 13:00:03.756445 (+603939us) raft_consensus.cc:1685] finished
0709 13:00:03.756486 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.779268 (+ 22782us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15425,"raft.queue_time_us":32998,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":9171,"spinlock_wait_cycles":140828416,"thread_start_us":192278,"threads_started":1,"wal-append.queue_time_us":463559}
I20260709 13:00:03.679986  8364 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:03.872670  2300 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.034s	sys 0.042s
I20260709 13:00:03.827315  8344 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:03.895938  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:03.946101  1617 raft_consensus.cc:2393] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 21: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:03.871587  8317 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:03.867689  8316 consensus_queue.cc:260] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:03.827659  8352 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:03.888357  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:03.909372  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:03.932638  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
W20260709 13:00:03.932842  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 127535us
W20260709 13:00:03.934613  8125 consensus_meta.cc:287] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.648s	user 0.010s	sys 0.003s
I20260709 13:00:03.765069  8369 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:03.935997  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:03.936107  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:03.936115  1684 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:03.937114  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:03.937542  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:03.938118  7896 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:03.875888  8082 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:00:03.885471  8050 consensus_meta.cc:287] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.510s	user 0.006s	sys 0.002s
I20260709 13:00:03.798323  8322 raft_consensus.cc:697] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:03.925647  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:03.868629  8252 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:03.934932  8373 raft_consensus.cc:2804] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:03.825531  8325 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:03.828902  8070 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:03.949208  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:04.086413  8371 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.111519  8125 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:04.112737  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:04.112353  8371 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:04.113870  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:04.114295  8125 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:04.106529  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.115023  7896 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:03.967734  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:04.150791  1533 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 17.
I20260709 13:00:03.949430  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:04.057381  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 337415us
W20260709 13:00:04.152583  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 324136us
I20260709 13:00:04.150863  1608 raft_consensus.cc:2393] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 17: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:04.151070  1616 raft_consensus.cc:2393] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 14: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:04.153820  1507 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:04.155431  7896 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:04.152920  2266 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:04.171881  7896 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:04.160773  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:04.171689  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:04.173617  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:04.176115  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:04.177507  1534 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 5.
I20260709 13:00:04.178478  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:04.180500  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:04.181277  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:04.173513  2266 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:04.179275  1533 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 13:00:04.187225  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:04.188242  1534 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 13:00:04.190251  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:04.190456  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:04.188660  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:04.191365  1608 raft_consensus.cc:2393] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 19: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:04.191532  1685 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 18.
I20260709 13:00:04.193886  1507 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:04.114522  8372 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:04.192394  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:03.979158  8344 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.075160  8353 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:04.204228  1533 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:04.114755  8371 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:03.942339  8363 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.206154  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:04.206779  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:04.114787  8373 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:04.219808  8373 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:03.948809  8287 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.220920  8287 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:04.223280  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:03.948650  8217 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.225459  8217 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:04.209750  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:03.950583  8269 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.213132  1507 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:04.227805  8217 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:04.227514  8269 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:04.229663  1613 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 18.
I20260709 13:00:04.228843  1541 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 16.
I20260709 13:00:04.232020  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:04.232784  8269 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:04.001044  8379 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.223241  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:04.229636  8287 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:04.236817  1534 raft_consensus.cc:2393] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 14: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:04.236163  1685 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 13:00:04.160959  8326 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:03.944149  8321 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:04.244113  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:04.212203  8316 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:04.281193  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:04.172120  8050 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:04.279219  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 105790us
I20260709 13:00:04.281930  1655 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:04.284970  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:04.210740  8390 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:04.171701  8352 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:04.290603  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:04.293203  1608 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:04.276656  8059 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 26 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:04.290562  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:04.299590  1610 raft_consensus.cc:2393] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 15: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 13:00:04.284379  8096 consensus_meta.cc:287] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 1.012s	user 0.011s	sys 0.000s
I20260709 13:00:04.295872  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4373) took 2605 ms. Trace:
I20260709 13:00:04.297142  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:04.304548  1537 rpcz_store.cc:276] 0709 13:00:01.690564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.445543 (+754979us) service_pool.cc:224] Handling call
0709 13:00:02.445842 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.446014 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:00:02.463218 (+ 17204us) log.cc:844] Serialized 14 byte log entry
0709 13:00:03.722891 (+1259673us) spinlock_profiling.cc:243] Waited 5.34 ms on lock 0x7b180020d760. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf123a 00007fc85d05ba2a
0709 13:00:04.295287 (+572396us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:04.295402 (+   115us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:00:04.295487 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.295580 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:04.295762 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17011,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":44782,"raft.queue_time_us":213794,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":249702016,"thread_start_us":571889,"threads_started":2,"wal-append.queue_time_us":1592980}
I20260709 13:00:04.288702  1685 raft_consensus.cc:2393] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 21: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:04.238992  8363 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:04.311740  8383 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:04.272981  8372 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.041s
I20260709 13:00:04.216638  8344 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:04.287112  8353 raft_consensus.cc:697] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 14 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:04.314571  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:04.353704  1537 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 13:00:04.354830  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:04.356045  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:04.289248  8371 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:04.304101  1534 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:00:04.316869  1655 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:04.313572  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:04.286518  8389 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:04.249370  8326 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:04.351044  8248 raft_consensus.cc:993] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f: : Instructing follower 4487a53c51be4634bf1ef29c5248353d to start an election
W20260709 13:00:04.391921  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 75213.1us
I20260709 13:00:04.392809  1655 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:04.398794  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.389999  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:04.393947  1655 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:04.419560  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:02.479552  1538 rpcz_store.cc:276] 0709 13:00:01.429687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.429828 (+   141us) service_pool.cc:224] Handling call
0709 13:00:01.430123 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:01.430329 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:00:01.859741 (+429412us) log.cc:844] Serialized 14 byte log entry
0709 13:00:02.469226 (+609485us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:02.469304 (+    78us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:02.469374 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.469455 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.469618 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16772,"prepare.queue_time_us":863015,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"thread_start_us":1021293,"threads_started":2,"wal-append.queue_time_us":612722}
I20260709 13:00:04.305109  8387 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:04.422596  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:04.423607  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:04.424147  1685 raft_consensus.cc:2393] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 20: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:04.425086  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:04.421178  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:04.416338  8059 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:04.429435  8377 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:04.442468  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:04.443138  1538 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:00:04.443938  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:04.431296  1534 raft_consensus.cc:2468] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 5.
I20260709 13:00:04.446003  1538 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 13.
I20260709 13:00:04.411152  8383 raft_consensus.cc:697] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:04.450340  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:04.452100  1685 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:04.452344  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:04.286738  8322 consensus_queue.cc:237] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:04.390954  8372 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:04.440534  8377 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:04.415759  8370 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:04.458810  8377 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:04.459348  8370 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:04.439863  8059 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:04.458145  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:04.307909  8096 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:04.473822  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:04.475558  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:04.492121  1537 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 13:00:04.485846  1608 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 13:00:04.429719  8248 raft_consensus.cc:1081] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Signalling peer 4487a53c51be4634bf1ef29c5248353d to start an election
I20260709 13:00:04.443534  8387 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:04.504258  1685 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 13:00:04.498037  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:04.505477  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:04.505585  1608 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:00:04.466876  8059 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:04.459767  8370 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:04.456766  8070 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:04.521023  2303 raft_consensus.cc:2393] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 20: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:04.524258  1533 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
W20260709 13:00:04.527412  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.529796  1581 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:04.499351  8364 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:04.511145  8338 consensus_meta.cc:287] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.707s	user 0.013s	sys 0.013s
I20260709 13:00:04.500787  8387 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:04.533139  8151 consensus_meta.cc:287] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 1.405s	user 0.022s	sys 0.005s
I20260709 13:00:04.234925  8379 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:04.536888  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:04.511571  8141 consensus_meta.cc:287] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.700s	user 0.012s	sys 0.012s
I20260709 13:00:04.537781  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:04.532727  8401 ts_tablet_manager.cc:933] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:04.558192  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:04.529331  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:04.551254  1533 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:04.560176  1608 raft_consensus.cc:2410] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:00:04.511551  8398 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:04.526757  8325 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:04.518909  8389 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:04.534561  8370 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:04.561390  8236 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:04.568775  1533 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 17.
I20260709 13:00:04.517854  8392 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:04.537551  8125 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:04.574416  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:04.575151  1533 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 18.
I20260709 13:00:04.577347  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:04.580385  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:04.581074  1534 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:04.583806  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:04.585697  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 169169us
I20260709 13:00:04.592121  2298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32788 (request call id 589) took 1349 ms. Trace:
I20260709 13:00:04.595784  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:04.596874  8321 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:04.594388  1655 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:04.610423  1655 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:04.592620  2298 rpcz_store.cc:276] 0709 13:00:03.242869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.932361 (+689492us) service_pool.cc:224] Handling call
0709 13:00:03.948781 (+ 16420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:03.949009 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:00:04.282614 (+333605us) log.cc:844] Serialized 14 byte log entry
0709 13:00:04.591768 (+309154us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:04.591830 (+    62us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:04.591882 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.591954 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:04.592067 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":469169,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":8007,"thread_start_us":534362,"threads_started":2}
W20260709 13:00:04.611788  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 301584us
I20260709 13:00:04.554792  1541 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 13:00:04.604960  1684 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
I20260709 13:00:04.606001  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:04.613708  1581 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:04.614785  1656 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:04.616232  1655 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:04.614466  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:04.617219  1616 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 17.
I20260709 13:00:04.561304  8151 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:04.597990  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:04.618120  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:04.575436  8050 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:04.550484  8338 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:04.619534  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:04.619053  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:04.616106  1656 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:04.573906  8236 raft_consensus.cc:697] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:04.518788  8353 consensus_queue.cc:237] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:04.607923  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 394879us
I20260709 13:00:04.627491  1533 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:04.614495  8019 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:04.628968  1616 raft_consensus.cc:2368] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for earlier term 18. Current term is 19.
I20260709 13:00:04.632619  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:04.637115  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:04.638401  1656 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:04.562094  8141 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:04.654218  1538 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:04.641860  1507 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:04.642625  1611 raft_consensus.cc:1240] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:04.655925  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:04.656662  1611 raft_consensus.cc:2393] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 20: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:04.645627  8236 consensus_queue.cc:237] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:04.628604  8070 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:00:04.644680  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:04.661612  2295 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:00:04.663313  8355 consensus_meta.cc:287] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.922s	user 0.009s	sys 0.000s
I20260709 13:00:04.663774  8355 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:04.665102  8348 log.cc:927] Time spent T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 1.506s	user 0.003s	sys 0.000s
I20260709 13:00:04.644816  8321 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:04.665962  8355 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:04.665863  8321 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:04.666920  8141 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:04.667868  8321 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:04.650602  2298 raft_consensus.cc:2410] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:00:04.625113  8371 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:04.657907  1690 raft_consensus.cc:2410] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for term 20 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:00:04.672775  1609 raft_consensus.cc:2368] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for earlier term 14. Current term is 15.
I20260709 13:00:04.644268  8310 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:04.676203  8310 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:04.676704  8310 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:04.680310  2295 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
W20260709 13:00:04.682585  8336 consensus_meta.cc:287] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 1.482s	user 0.011s	sys 0.000s
I20260709 13:00:04.683077  8336 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:04.661108  8070 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:04.627542  8325 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:04.669075  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:04.706925  2298 raft_consensus.cc:2393] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 19: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:04.707990  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:04.669624  1686 raft_consensus.cc:2393] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 16: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:04.579473  8125 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:04.571184  8389 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:04.608922  8113 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:04.675674  8403 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:04.682264  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:04.717665  8403 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:04.717896  2295 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 17.
I20260709 13:00:04.718381  8125 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:04.719029  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:04.719537  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:04.694981  2269 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.004s	sys 0.033s
I20260709 13:00:04.686944  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:04.639376  8369 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:04.691944  1533 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 20.
W20260709 13:00:04.720907  2269 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.005s	sys 0.034s
W20260709 13:00:04.705443  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 89280.5us
I20260709 13:00:04.685225  1538 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 26.
I20260709 13:00:04.564596  8383 consensus_queue.cc:237] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:04.709854  2298 raft_consensus.cc:2393] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 19: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:04.574177  8398 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:04.719694  2295 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 17.
I20260709 13:00:04.720742  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42356 (request call id 1002) took 1009 ms. Trace:
W20260709 13:00:04.700030  8311 consensus_meta.cc:287] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 1.672s	user 0.013s	sys 0.000s
I20260709 13:00:04.659060  1534 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 20.
I20260709 13:00:04.670048  8019 raft_consensus.cc:697] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:04.721271  1582 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:04.612743  8392 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:04.669728  8374 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.083s
I20260709 13:00:04.722203  1655 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:04.721493  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 848325us
I20260709 13:00:04.839099  8361 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:04.839867  8361 raft_consensus.cc:697] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:04.787268  1654 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:04.708395  8013 consensus_meta.cc:287] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 1.565s	user 0.017s	sys 0.000s
I20260709 13:00:04.842767  2269 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:04.843267  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:04.686169  8316 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:04.773797  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:04.844101  2269 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
W20260709 13:00:04.844619  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 123417us
I20260709 13:00:04.705390  8070 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:04.840909  8361 consensus_queue.cc:237] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:04.809082  8410 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
W20260709 13:00:04.896173  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 174050us
W20260709 13:00:04.897507  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 110343us
I20260709 13:00:04.912038  1541 raft_consensus.cc:1240] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:00:04.913311  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42356 (request call id 1005) took 1201 ms. Trace:
I20260709 13:00:04.685303  8141 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:04.896119  8378 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:04.913970  1654 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:04.917601  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 73560.3us
I20260709 13:00:04.783254  8336 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:04.849706  8373 consensus_meta.cc:287] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.629s	user 0.009s	sys 0.001s
I20260709 13:00:04.792112  8174 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:04.841645  8013 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15.
I20260709 13:00:04.722380  8325 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:04.782811  8371 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:04.784732  8389 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:04.814270  8326 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:04.909037  8082 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:00:04.908591  1533 rpcz_store.cc:276] 0709 13:00:03.711587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.591911 (+880324us) service_pool.cc:224] Handling call
0709 13:00:04.720687 (+128776us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:04.718192  8403 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:04.847249  8316 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:04.923596  8378 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:00:04.927911  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 289570us
I20260709 13:00:04.790956  8310 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:04.929656  8174 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:04.736222  8113 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:04.931834  1539 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 13:00:04.909933  8369 raft_consensus.cc:2804] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:04.899148  8334 consensus_meta.cc:287] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 1.081s	user 0.010s	sys 0.001s
I20260709 13:00:04.736636  8096 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:04.934828  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 169348us
I20260709 13:00:04.938279  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:04.929412  8379 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:04.915298  8414 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:04.913962  1534 rpcz_store.cc:276] 0709 13:00:03.712317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.564021 (+851704us) service_pool.cc:224] Handling call
0709 13:00:04.913211 (+349190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:04.706377  8344 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:04.743400  8059 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:04.926811  8325 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:04.944427  1656 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:04.956718  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.942689  8316 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:04.958659  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:04.968046  1533 raft_consensus.cc:2410] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for term 14 because replica has last-logged OpId of term: 13 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 13.
I20260709 13:00:04.946323  1654 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:04.938212  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:04.957733  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:04.929507  8371 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:04.948757  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:04.947348  8369 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:04.983238  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:04.934237  8141 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:04.945843  8378 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:04.971745  1534 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 17.
I20260709 13:00:04.991176  8378 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:04.992051  1534 raft_consensus.cc:1217] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 11.13->[12.14-12.14]   Dedup: 12.14->[]
I20260709 13:00:04.992583  1534 raft_consensus.cc:1240] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 12. Current term is 13. Ops: [12.14-12.14]
I20260709 13:00:04.993192  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1000) took 1282 ms. Trace:
I20260709 13:00:04.993505  1534 rpcz_store.cc:276] 0709 13:00:03.711017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.991609 (+1280592us) service_pool.cc:224] Handling call
0709 13:00:04.991957 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:04.992936 (+   979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.993136 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:04.995468  8352 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:04.940896  8370 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:04.996410  8370 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:04.996930  8370 raft_consensus.cc:697] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 13:00:04.998121  8158 consensus_meta.cc:287] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 1.684s	user 0.011s	sys 0.000s
I20260709 13:00:04.997781  8370 consensus_queue.cc:237] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:04.998572  8158 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:05.001003  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:04.963300  8125 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.001992  8125 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:05.002580  8354 consensus_meta.cc:287] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 1.184s	user 0.017s	sys 0.002s
I20260709 13:00:05.003068  8354 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:05.004094  8280 consensus_meta.cc:287] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 1.729s	user 0.006s	sys 0.006s
I20260709 13:00:04.974273  8059 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:04.975102  8414 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:05.004791  8414 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:05.005254  8414 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:04.976253  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:05.005726  8377 consensus_meta.cc:287] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.546s	user 0.001s	sys 0.008s
I20260709 13:00:05.005999  1615 raft_consensus.cc:2368] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 18. Current term is 19.
W20260709 13:00:05.006490  1615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 3561) took 1928 ms (client timeout 1992 ms). Trace:
W20260709 13:00:05.006847  1615 rpcz_store.cc:269] 0709 13:00:03.078304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.079412 (+  1108us) service_pool.cc:224] Handling call
0709 13:00:04.976151 (+1896739us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b5800091e98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cf8c 00007fc859f2cef6 0000000000375939 00007fc861fa01e0 00007fc8620690c4 00007fc862069131 00007fc8620170a0 00007fc862016984 00007fc85b5916d4 00007fc85b591662
0709 13:00:05.006426 (+ 30275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2442880}
I20260709 13:00:04.965741  8019 consensus_queue.cc:237] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:04.978178  1609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 929) took 1258 ms (client timeout 1524 ms). Trace:
W20260709 13:00:05.009150  1609 rpcz_store.cc:269] 0709 13:00:03.719661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.721329 (+  1668us) service_pool.cc:224] Handling call
0709 13:00:04.977885 (+1256556us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b5400122854. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:04.978101 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1978094336}
I20260709 13:00:04.926614  8373 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:05.011530  2298 raft_consensus.cc:2393] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 6: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:05.011797  8371 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:04.954360  8151 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:05.012495  8373 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:05.013790  2298 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:00:04.987455  8372 consensus_meta.cc:287] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.521s	user 0.006s	sys 0.003s
I20260709 13:00:05.014492  8372 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:05.026883  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4515) took 2203 ms. Trace:
I20260709 13:00:04.963336  8379 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:00:04.990674  8126 consensus_meta.cc:287] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 1.650s	user 0.012s	sys 0.000s
I20260709 13:00:05.022387  1583 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:05.027992  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1001) took 1307 ms. Trace:
I20260709 13:00:04.917322  8311 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:05.050926  1534 rpcz_store.cc:276] 0709 13:00:03.711317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.017863 (+1306546us) service_pool.cc:224] Handling call
0709 13:00:05.018181 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:05.018341 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:05.018378 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:05.018416 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:05.018446 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.018497 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:05.018610 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:04.992533  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 933) took 1959 ms. Trace:
I20260709 13:00:05.052357  1682 rpcz_store.cc:276] 0709 13:00:03.033593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.035539 (+  1946us) service_pool.cc:224] Handling call
0709 13:00:03.036340 (+   801us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:03.328932 (+292592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.992251 (+1663319us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b5400392454. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:04.992448 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":609241344}
I20260709 13:00:05.024168  1435 catalog_manager.cc:5697] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 16 to 17, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 17 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:05.029968  2267 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:05.050520  1687 rpcz_store.cc:276] 0709 13:00:02.823102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.930118 (+107016us) service_pool.cc:224] Handling call
0709 13:00:02.930452 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:03.054289 (+123837us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:03.054319 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:03.054356 (+    37us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:00:03.054385 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.026655 (+1972270us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54002297d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:05.026700 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:05.026817 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":284403456}
I20260709 13:00:05.016441  8384 raft_consensus.cc:3055] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:05.060909  8384 raft_consensus.cc:740] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:05.062209  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:05.085002  1682 raft_consensus.cc:2393] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 15: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 13:00:05.085264  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 62964us
W20260709 13:00:05.005364  8341 log.cc:927] Time spent T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 1.864s	user 0.004s	sys 0.000s
I20260709 13:00:05.025080  8113 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:05.088052  1583 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:05.262370  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 3372) took 1590 ms. Trace:
I20260709 13:00:05.273008  1539 rpcz_store.cc:276] 0709 13:00:03.671793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.675554 (+  3761us) service_pool.cc:224] Handling call
0709 13:00:05.261801 (+1586247us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54003f98d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:05.262081 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2887268736}
W20260709 13:00:05.260191  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 273849us
I20260709 13:00:05.263775  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 922) took 2815 ms. Trace:
I20260709 13:00:05.276737  1614 rpcz_store.cc:276] 0709 13:00:02.448304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.448772 (+   468us) service_pool.cc:224] Handling call
0709 13:00:02.449104 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:03.069997 (+620893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.262962 (+2192965us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b54002a62d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:05.263502 (+   540us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1426262784}
I20260709 13:00:05.276456  1436 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54582 (request call id 320) took 5575 ms. Trace:
W20260709 13:00:05.264335  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 176249us
I20260709 13:00:05.252329  1435 catalog_manager.cc:5697] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 16 to 17, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 17 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:05.269158  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 3676) took 1339 ms. Trace:
I20260709 13:00:05.257874  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4371) took 3686 ms. Trace:
W20260709 13:00:05.275184  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 330747us
I20260709 13:00:05.287887  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 3393) took 1007 ms. Trace:
I20260709 13:00:05.288690  1538 rpcz_store.cc:276] 0709 13:00:04.280753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.452117 (+171364us) service_pool.cc:224] Handling call
0709 13:00:05.287463 (+835346us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b5400312ed4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:05.287692 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":462928768}
I20260709 13:00:05.292698  1537 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:00:05.293376  1540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 4379) took 2552 ms (client timeout 2248 ms). Trace:
W20260709 13:00:05.272186  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 325820us
I20260709 13:00:05.294227  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:05.266767  1655 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:05.294672  1540 rpcz_store.cc:269] 0709 13:00:02.740774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.742417 (+  1643us) service_pool.cc:224] Handling call
0709 13:00:05.292899 (+2550482us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b540021a2d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:05.293131 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":733474176}
I20260709 13:00:05.295509  1654 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:05.296166  1655 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:05.296439  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:05.298607  1540 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:05.301048  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4392) took 1578 ms. Trace:
I20260709 13:00:05.302842  1537 rpcz_store.cc:276] 0709 13:00:03.722244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.290352 (+1568108us) service_pool.cc:224] Handling call
0709 13:00:05.290961 (+   609us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:05.300675 (+  9714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.300965 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:05.302305  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 3370) took 1631 ms. Trace:
I20260709 13:00:05.302188  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:05.294003  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 3382) took 1589 ms. Trace:
I20260709 13:00:05.287155  1613 rpcz_store.cc:276] 0709 13:00:03.931914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.113624 (+181710us) service_pool.cc:224] Handling call
0709 13:00:05.267903 (+1154279us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54004470d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:05.268171 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264931712}
I20260709 13:00:05.287230  1535 rpcz_store.cc:276] 0709 13:00:01.571634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.342770 (+771136us) service_pool.cc:224] Handling call
0709 13:00:02.343169 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:02.817656 (+474487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:02.817694 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:02.818236 (+   542us) log.cc:844] Serialized 26 byte log entry
0709 13:00:03.003849 (+185613us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:03.003886 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.003955 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:05.004724 (+2000769us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 13:00:05.256893 (+252169us) raft_consensus.cc:1685] finished
0709 13:00:05.256985 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:05.257576 (+   591us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":131231,"raft.queue_time_us":213161,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":113,"spinlock_wait_cycles":7762304,"thread_start_us":534471,"threads_started":2,"wal-append.queue_time_us":276173}
I20260709 13:00:05.117422  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:05.291472  1538 raft_consensus.cc:2955] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Committing config change with OpId 22.16: config changed from index -1 to 16, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
W20260709 13:00:05.313073  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.100355  2294 raft_consensus.cc:2393] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 19: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:05.144164  2296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32788 (request call id 590) took 1901 ms. Trace:
I20260709 13:00:05.307067  1541 rpcz_store.cc:276] 0709 13:00:03.706365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.613341 (+906976us) service_pool.cc:224] Handling call
0709 13:00:04.911779 (+298438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:04.912755 (+   976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.293523 (+380768us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b54003f93d0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:05.293765 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":668324224}
I20260709 13:00:05.317602  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4516) took 2494 ms. Trace:
I20260709 13:00:05.091997  1691 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 13:00:05.318356  1608 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 19.
I20260709 13:00:05.310596  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 13:00:05.320973  1686 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33206 (request call id 940) took 2260 ms (client timeout 2299 ms). Trace:
I20260709 13:00:05.317974  2296 rpcz_store.cc:276] 0709 13:00:03.243118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.013352 (+770234us) service_pool.cc:224] Handling call
0709 13:00:04.210839 (+197487us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:04.578518 (+367679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:04.580125 (+  1607us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:04.668505 (+ 88380us) log.cc:844] Serialized 26 byte log entry
0709 13:00:04.946352 (+277847us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:00:04.996653 (+ 50301us) log.cc:844] Serialized 14 byte log entry
0709 13:00:04.996935 (+   282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.997029 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:05.143886 (+146857us) raft_consensus.cc:1685] finished
0709 13:00:05.143917 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:05.144086 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18853,"prepare.queue_time_us":9461,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":177698,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":3608,"thread_start_us":531065,"threads_started":2,"wal-append.queue_time_us":426809}
W20260709 13:00:05.321461  1686 rpcz_store.cc:269] 0709 13:00:03.060263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.346230 (+285967us) service_pool.cc:224] Handling call
0709 13:00:05.320466 (+1974236us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400389354. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:05.320759 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2775278336}
I20260709 13:00:05.323170  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 13:00:05.324278  1688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33206 (request call id 936) took 2289 ms (client timeout 2051 ms). Trace:
I20260709 13:00:05.317543  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:05.306885  1536 rpcz_store.cc:276] 0709 13:00:03.671184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.673954 (+  2770us) service_pool.cc:224] Handling call
0709 13:00:03.674251 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:04.014234 (+339983us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:00:04.085752 (+ 71518us) log.cc:844] Serialized 14 byte log entry
0709 13:00:04.248198 (+162446us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:04.248262 (+    64us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:04.249894 (+  1632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.187761 (+937867us) spinlock_profiling.cc:243] Waited 8.64 ms on lock 0x7b180029d100. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f322a6 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db
0709 13:00:05.188295 (+   534us) spinlock_profiling.cc:243] Waited 30.8 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 13:00:05.301777 (+113482us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b540045d154. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:05.301847 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:05.302106 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33106,"prepare.queue_time_us":71731,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":99425,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":95740,"spinlock_wait_cycles":872074240,"thread_start_us":128872,"threads_started":1,"wal-append.queue_time_us":203056}
I20260709 13:00:05.325613  1541 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 26.
I20260709 13:00:05.325903  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:05.326930  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:05.328063  1541 raft_consensus.cc:2410] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:00:05.284058  1583 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:05.312353  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 4529) took 1198 ms. Trace:
I20260709 13:00:05.328933  1687 rpcz_store.cc:276] 0709 13:00:04.114184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.103004 (+988820us) service_pool.cc:224] Handling call
0709 13:00:05.312107 (+209103us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:05.325826  1690 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33206 (request call id 938) took 2290 ms (client timeout 3043 ms). Trace:
W20260709 13:00:05.329855  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 46188us
W20260709 13:00:05.319677  1691 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 4510) took 2499 ms (client timeout 1844 ms). Trace:
W20260709 13:00:05.330708  1691 rpcz_store.cc:269] 0709 13:00:02.820614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.820771 (+   157us) service_pool.cc:224] Handling call
0709 13:00:05.319286 (+2498515us) spinlock_profiling.cc:243] Waited 2.15 s on lock 0x7b540008edd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:05.319464 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4952749824}
I20260709 13:00:05.324285  1535 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:05.328239  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1009) took 1567 ms. Trace:
I20260709 13:00:05.329308  1682 raft_consensus.cc:2393] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 19: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 13:00:05.118414  8060 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.994s	user 0.009s	sys 0.013s
I20260709 13:00:04.991276  8107 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:05.058336  8141 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:05.061627  8126 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:05.023615  8236 consensus_queue.cc:1048] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:00:05.013808  8174 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:05.087059  8226 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:05.084625  8248 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.022773  8280 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:05.384932  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 85181.8us
I20260709 13:00:05.386029  1654 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:05.387076  8280 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:05.386970  8158 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:05.388788  8421 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:05.145733  8310 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:05.389453  8421 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:05.016348  8325 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:05.392786  8421 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:05.395308  8325 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:05.384289  8248 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:05.174636  8335 consensus_meta.cc:287] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 1.669s	user 0.016s	sys 0.003s
I20260709 13:00:04.956233  8334 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:05.154071  8354 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:05.278364  1436 rpcz_store.cc:276] 0709 12:59:59.683478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.688909 (+  5431us) service_pool.cc:224] Handling call
0709 13:00:05.258474 (+5569565us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:01.594297 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:01.594960 (+   663us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:01.595008 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:00:01.595029 (+    21us) tablet.cc:662] Decoding operations
0709 13:00:01.595512 (+   483us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:01.595578 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:01.595617 (+    39us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:00:01.675180 (+ 79563us) tablet.cc:701] Row locks acquired
0709 13:00:01.680209 (+  5029us) write_op.cc:260] PREPARE: finished
0709 13:00:01.695856 (+ 15647us) write_op.cc:270] Start()
0709 13:00:01.716176 (+ 20320us) write_op.cc:276] Timestamp: P: 1783602001691504 usec, L: 0
0709 13:00:01.718028 (+  1852us) op_driver.cc:348] REPLICATION: starting
0709 13:00:01.937116 (+219088us) log.cc:844] Serialized 924 byte log entry
0709 13:00:03.105817 (+1168701us) op_driver.cc:464] REPLICATION: finished
0709 13:00:03.304770 (+198953us) write_op.cc:301] APPLY: starting
0709 13:00:03.310195 (+  5425us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:03.665138 (+354943us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:03.665274 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:03.666773 (+  1499us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:03.666992 (+   219us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 13:00:03.667034 (+    42us) write_op.cc:312] APPLY: finished
0709 13:00:03.667240 (+   206us) log.cc:844] Serialized 33 byte log entry
0709 13:00:03.667418 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:03.667515 (+    97us) write_op.cc:454] Released schema lock
0709 13:00:03.667554 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:03.667980 (+   426us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:03.668010 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13642,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":152432,"apply.run_cpu_time_us":6222,"apply.run_wall_time_us":400109,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12491,"num_ops":2,"prepare.queue_time_us":1023308,"prepare.run_cpu_time_us":19231,"prepare.run_wall_time_us":773566,"raft.queue_time_us":348060,"raft.run_cpu_time_us":15935,"raft.run_wall_time_us":192480,"replication_time_us":1354523,"thread_start_us":1574902,"threads_started":4,"wal-append.queue_time_us":501484,"wal-append.run_cpu_time_us":34258,"wal-append.run_wall_time_us":2223037}]]}
I20260709 13:00:05.318086  1683 rpcz_store.cc:276] 0709 13:00:02.823351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.937566 (+114215us) service_pool.cc:224] Handling call
0709 13:00:02.937946 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:03.159948 (+222002us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:00:03.198357 (+ 38409us) log.cc:844] Serialized 14 byte log entry
0709 13:00:03.339728 (+141371us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:03.339780 (+    52us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:03.339826 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.316996 (+1977170us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b5400159854. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:05.317089 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:05.317377 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":42741,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":37176,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":39474,"spinlock_wait_cycles":509863296,"thread_start_us":141013,"threads_started":1,"wal-append.queue_time_us":262308,"wal-append.run_cpu_time_us":1134,"wal-append.run_wall_time_us":1120810}
I20260709 13:00:05.417889  8070 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:05.419601  8334 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:05.086594  8358 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:05.421092  1684 raft_consensus.cc:2393] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 25: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:05.179430  8363 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:05.176097  8368 log.cc:927] Time spent T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 1.579s	user 0.003s	sys 0.000s
W20260709 13:00:05.422928  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 71040.3us
I20260709 13:00:05.423511  8324 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:04.987901  8369 raft_consensus.cc:3060] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:05.056770  8377 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:05.021229  8378 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:05.332753  1536 rpcz_store.cc:276] 0709 13:00:03.761132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.327032 (+1565900us) service_pool.cc:224] Handling call
0709 13:00:05.327542 (+   510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:05.327900 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:05.327925 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:05.327982 (+    57us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:00:05.328014 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.328067 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:05.328170 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:05.431289  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:05.185506  8384 consensus_queue.cc:260] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:05.447923  8384 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:00:05.177459  8385 log.cc:927] Time spent T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 1.002s	user 0.000s	sys 0.002s
W20260709 13:00:05.448822  8356 log.cc:927] Time spent T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 2.135s	user 0.003s	sys 0.004s
W20260709 13:00:05.176864  8387 consensus_meta.cc:287] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.612s	user 0.011s	sys 0.000s
I20260709 13:00:05.155318  8392 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:05.188865  8396 log.cc:927] Time spent T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.868s	user 0.003s	sys 0.000s
I20260709 13:00:05.148896  8398 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:05.099745  8401 tablet_copy_client.cc:323] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:41953
I20260709 13:00:05.450604  8387 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:05.171502  8414 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:05.189657  8417 log.cc:927] Time spent T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:00:05.339644  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 4526) took 1224 ms. Trace:
I20260709 13:00:05.310695  2267 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:05.467965  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 157768us
I20260709 13:00:05.469425  2267 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:05.471302  2267 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:05.471776  8414 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:05.330235  1688 rpcz_store.cc:269] 0709 13:00:03.034414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.308726 (+274312us) service_pool.cc:224] Handling call
0709 13:00:05.323796 (+2015070us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540022abd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:05.324066 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2916991872}
I20260709 13:00:05.472975  8140 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:05.473603  8140 raft_consensus.cc:697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:05.474102  8050 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:05.474887  8050 raft_consensus.cc:697] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:05.330956  1583 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:05.332293  1690 rpcz_store.cc:269] 0709 13:00:03.034908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.364574 (+329666us) service_pool.cc:224] Handling call
0709 13:00:04.423447 (+1058873us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b5800190898. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc8620170a0 00007fc862016984 00007fc85b5916d4 00007fc85b591662
0709 13:00:05.325377 (+901930us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b5400299fd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:05.325659 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":531468928}
I20260709 13:00:05.475293  8353 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:05.475780  8353 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:05.476189  8353 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:05.476681  1690 raft_consensus.cc:1240] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:05.477502  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4521) took 1530 ms. Trace:
I20260709 13:00:05.477890  1690 rpcz_store.cc:276] 0709 13:00:03.946915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.475955 (+1529040us) service_pool.cc:224] Handling call
0709 13:00:05.476407 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:05.477161 (+   754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.477409 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:05.348989  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:05.480142  1608 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 19.
I20260709 13:00:05.481573  2302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32794 (request call id 918) took 2241 ms. Trace:
I20260709 13:00:05.482005  2302 rpcz_store.cc:276] 0709 13:00:03.240939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.932360 (+691421us) service_pool.cc:224] Handling call
0709 13:00:05.481227 (+1548867us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54007706d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:05.481398 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2738041216}
I20260709 13:00:05.350476  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:05.483950  1614 raft_consensus.cc:2368] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15.
I20260709 13:00:05.352517  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:05.484954  1612 raft_consensus.cc:2393] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 25: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:05.353469  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:05.353719  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:05.486001  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 155259us
I20260709 13:00:05.486544  2300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32788 (request call id 584) took 2481 ms. Trace:
I20260709 13:00:05.357296  1540 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 19.
I20260709 13:00:05.373054  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:05.487041  1583 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:05.487689  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33206 (request call id 935) took 2453 ms. Trace:
I20260709 13:00:05.475072  8140 consensus_queue.cc:237] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:05.488108  1686 rpcz_store.cc:276] 0709 13:00:03.034152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.322928 (+2288776us) service_pool.cc:224] Handling call
0709 13:00:05.487632 (+164704us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:05.489483  8280 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:05.490005  1686 raft_consensus.cc:1240] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 19. Current term is 20. Ops: []
W20260709 13:00:05.382289  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.383968  8226 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:05.491429  8226 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:05.493224  1583 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:05.495630  7884 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:05.384274  8247 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:05.028576  8338 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:05.486932  2300 rpcz_store.cc:276] 0709 13:00:03.004926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.005458 (+   532us) service_pool.cc:224] Handling call
0709 13:00:03.005830 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:03.016535 (+ 10705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:03.016573 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:03.026698 (+ 10125us) log.cc:844] Serialized 26 byte log entry
0709 13:00:03.145191 (+118493us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:03.341909 (+196718us) log.cc:844] Serialized 14 byte log entry
0709 13:00:03.940512 (+598603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.940582 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:05.448068 (+1507486us) spinlock_profiling.cc:243] Waited 4.31 ms on lock 0x7b24002d5108. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859dea9c4 00007fc859de8acb 00007fc859fa3dc9 00007fc859fa3a55 00007fc859fa309d 00007fc85cbd510e 00007fc85cbec88c 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221
0709 13:00:05.486018 (+ 37950us) raft_consensus.cc:1685] finished
0709 13:00:05.486125 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:05.486353 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23833,"prepare.queue_time_us":499026,"raft.queue_time_us":334430,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":8038,"spinlock_wait_cycles":15014528,"thread_start_us":835268,"threads_started":3,"wal-append.queue_time_us":172540}
W20260709 13:00:05.383991  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 92747.4us
W20260709 13:00:05.497395  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 87608.8us
I20260709 13:00:05.497852  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:05.499373  1505 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:05.368273  8141 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:05.405277  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:05.413462  8321 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.414453  8125 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:05.414621  8082 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:00:05.414902  8427 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:05.415262  1507 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:05.415391  8379 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.415838  8375 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:00:05.429826  8377 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:05.432943  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 45360.7us
I20260709 13:00:05.433063  1535 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 6.
I20260709 13:00:05.419970  1683 raft_consensus.cc:1240] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:05.439872  8378 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:05.406740  8370 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.147761  8403 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:05.457090  1691 raft_consensus.cc:1240] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:05.415098  8126 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:05.464598  8174 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:05.350034  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:05.356719  8060 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.238s	user 0.009s	sys 0.014s
I20260709 13:00:05.490214  8280 raft_consensus.cc:697] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:05.467341  8158 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:00:05.467139  1682 rpcz_store.cc:276] 0709 13:00:04.112066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.309710 (+1197644us) service_pool.cc:224] Handling call
0709 13:00:05.336216 (+ 26506us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:05.505759  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4524) took 1554 ms. Trace:
I20260709 13:00:05.507052  8379 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:05.486052  8260 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:00:05.512823  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:05.501725  8070 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:05.500844  8247 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:05.559880  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4519) took 1611 ms. Trace:
I20260709 13:00:05.560885  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:05.570386  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3765) took 1899 ms. Trace:
I20260709 13:00:05.576313  1686 rpcz_store.cc:276] 0709 13:00:03.947645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.489079 (+1541434us) service_pool.cc:224] Handling call
0709 13:00:05.489682 (+   603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:05.502241 (+ 12559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.502520 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:05.578125  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 66321.3us
I20260709 13:00:05.579873  1683 rpcz_store.cc:276] 0709 13:00:03.944906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.419056 (+1474150us) service_pool.cc:224] Handling call
0709 13:00:05.419610 (+   554us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:05.548978 (+129368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.556157 (+  7179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:05.579056  1654 leader_election.cc:400] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 18. Current term is 19.
I20260709 13:00:05.561025  8321 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:05.586311  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 250919us
I20260709 13:00:05.587682  1507 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:05.581673  8247 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:05.588778  8398 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:05.589257  8398 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:05.589665  8398 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:05.579010  8335 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:39748 (request call id 11) took 10746 ms. Trace:
I20260709 13:00:05.596611  8370 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:05.598501  8317 consensus_meta.cc:287] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 1.587s	user 0.014s	sys 0.014s
I20260709 13:00:05.599391  8370 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:05.588361  8321 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:05.603974  8316 consensus_meta.cc:287] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.621s	user 0.006s	sys 0.006s
I20260709 13:00:05.604621  2295 raft_consensus.cc:2393] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 15: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:05.605340  7896 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:05.605930  8361 consensus_queue.cc:1059] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:00:05.605618  8050 consensus_queue.cc:237] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:05.606758  8320 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:00:05.607452  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 49070us
W20260709 13:00:05.609795  2303 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32802 (request call id 648) took 2136 ms (client timeout 2083 ms). Trace:
W20260709 13:00:05.612622  8290 consensus_meta.cc:287] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 1.810s	user 0.013s	sys 0.019s
I20260709 13:00:05.644778  8290 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:05.620345  8403 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:05.647115  8290 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:05.648111  2298 raft_consensus.cc:1240] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:00:05.619956  1533 raft_consensus.cc:2393] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 20: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 13:00:05.620669  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 324739us
W20260709 13:00:05.617025  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 117792us
I20260709 13:00:05.622917  8379 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:05.624133  8280 consensus_queue.cc:237] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:05.624732  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:05.625458  1690 raft_consensus.cc:1240] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:05.654158  1541 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 13:00:05.654345  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4528) took 1540 ms. Trace:
I20260709 13:00:05.654740  1690 rpcz_store.cc:276] 0709 13:00:04.113585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.511685 (+1398100us) service_pool.cc:224] Handling call
0709 13:00:05.571019 (+ 59334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:05.654020 (+ 83001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.654274 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:05.655380  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:05.626117  1535 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
W20260709 13:00:05.640976  2303 rpcz_store.cc:269] 0709 13:00:03.473102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.800091 (+326989us) service_pool.cc:224] Handling call
0709 13:00:05.609332 (+1809241us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b54009b2654. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:05.609599 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1650155776}
I20260709 13:00:05.626340  8311 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:05.657081  8082 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:00:05.658084  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:05.656697  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:05.659554  1535 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:05.658813  8226 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:05.654805  8387 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:05.661857  8226 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:05.663630  1507 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:05.658751  1541 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:00:05.664865  8364 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:05.665378  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:05.666272  1541 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 13:00:05.666796  8387 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:05.652287  8421 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:05.667243  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:05.649878  8369 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:05.668855  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4387) took 1913 ms. Trace:
W20260709 13:00:05.656504  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 88445us
I20260709 13:00:05.599035  8317 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:05.580062  1687 rpcz_store.cc:276] 0709 13:00:03.670772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.330505 (+1659733us) service_pool.cc:224] Handling call
0709 13:00:05.331048 (+   543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:05.331590 (+   542us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:00:05.392185 (+ 60595us) log.cc:844] Serialized 14 byte log entry
0709 13:00:05.569975 (+177790us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:05.570037 (+    62us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:00:05.570096 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.570166 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:05.570309 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56150,"prepare.queue_time_us":156035,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":61998,"thread_start_us":129886,"threads_started":2}
I20260709 13:00:05.648612  8353 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:05.649060  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:05.640116  1540 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 13:00:05.669377  2299 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:05.625383  1682 raft_consensus.cc:1240] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:00:05.675760  1535 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 13:00:05.592624  8335 rpcz_store.cc:276] 0709 12:59:54.825974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.870107 (+ 44133us) service_pool.cc:224] Handling call
0709 12:59:56.494517 (+1624410us) spinlock_profiling.cc:243] Waited 75.8 ms on lock 0x7b540043a920. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85cfce520 00007fc85d057b42 00007fc85d056800 00007fc862017d29 00007fc85b5961d4 00007fc85b596162 00007fc85b596091 00007fc85b59600c 00007fc85b5952c2 00007fc85b38c48c
0709 12:59:56.586708 (+ 92191us) log.cc:844] Serialized 506 byte log entry
0709 13:00:05.566009 (+8979301us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":338,"raft.queue_time_us":190790,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":14369,"spinlock_wait_cycles":174409472,"thread_start_us":66125,"threads_started":2,"wal-append.queue_time_us":66877,"wal-append.run_cpu_time_us":1398,"wal-append.run_wall_time_us":1016884}
I20260709 13:00:05.686867  1536 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 13:00:05.669277  1539 rpcz_store.cc:276] 0709 13:00:03.720994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.277124 (+1556130us) service_pool.cc:224] Handling call
0709 13:00:05.284838 (+  7714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:05.285446 (+   608us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:00:05.346484 (+ 61038us) log.cc:844] Serialized 14 byte log entry
0709 13:00:05.594240 (+247756us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b18002d6160. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc85cbf94bc 00007fc859f4748b 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf123a
0709 13:00:05.634194 (+ 39954us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:05.634261 (+    67us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:05.634312 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.634381 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:05.634544 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":114560,"prepare.run_wall_time_us":2316,"raft.queue_time_us":47057,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":158,"spinlock_wait_cycles":24179328,"thread_start_us":101806,"threads_started":2,"wal-append.queue_time_us":81407}
I20260709 13:00:05.703471  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:05.702700  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:05.704696  1540 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:05.712785  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:05.707227  1505 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:05.718699  1541 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 13:00:05.720033  1685 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 5.
I20260709 13:00:05.721176  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:05.722029  8317 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:05.723961  2297 raft_consensus.cc:1240] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:00:05.715312  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:05.724815  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:05.727341  1540 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 13:00:05.708516  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
W20260709 13:00:05.729038  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 65522.2us
I20260709 13:00:05.675860  8369 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:05.721975  1539 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 21.
I20260709 13:00:05.667472  8387 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:05.737715  2303 raft_consensus.cc:1275] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:00:05.738315  2303 pending_rounds.cc:85] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579: Aborting all ops after (but not including) 10
I20260709 13:00:05.741281  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:05.741358  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:05.743558  1654 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:05.738562  2303 pending_rounds.cc:107] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:00:05.749121  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:05.749843  1539 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:05.684000  8316 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:05.746526  1536 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 13:00:05.746538  2303 raft_consensus.cc:2889] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:05.747931  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:05.752358  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:05.756281  1613 raft_consensus.cc:2368] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for earlier term 14. Current term is 15.
I20260709 13:00:05.757369  2267 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:05.758379  8226 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:00:05.758847  8226 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:05.752276  8375 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.759275  8226 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:00:05.752606  8321 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:00:05.761477  8353 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:05.763136  8421 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:05.764122  2298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32794 (request call id 926) took 1087 ms. Trace:
I20260709 13:00:05.772504  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:05.773448  1617 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:05.764586  2298 rpcz_store.cc:276] 0709 13:00:04.676741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.015498 (+338757us) service_pool.cc:224] Handling call
0709 13:00:05.015816 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:05.649759 (+633943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.763776 (+114017us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b54005ab254. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:05.764037 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1453322624}
I20260709 13:00:05.781435  1682 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:00:05.788364  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:05.790628  2267 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:05.791347  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:05.791260  1537 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:05.795709  1541 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:00:05.796233  1627 tablet_copy_service.cc:140] P c262eac7fc904ae9bb91e450f6532e3f: Received BeginTabletCopySession request for tablet 9324141fa1ba48aca59e97123ca5742e from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:58006)
I20260709 13:00:05.797580  1627 tablet_copy_service.cc:161] P c262eac7fc904ae9bb91e450f6532e3f: Beginning new tablet copy session on tablet 9324141fa1ba48aca59e97123ca5742e from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:58006: session id = 1d6516ff61104bdda54bde95e92fe579-9324141fa1ba48aca59e97123ca5742e
I20260709 13:00:05.790704  8375 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:05.802796  8375 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:05.803062  2300 raft_consensus.cc:2410] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 15 because replica has last-logged OpId of term: 13 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 13.
I20260709 13:00:05.803385  8421 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:05.804054  8421 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:05.879805  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 3388) took 1599 ms. Trace:
I20260709 13:00:05.880374  1537 rpcz_store.cc:276] 0709 13:00:04.209792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.790525 (+1580733us) service_pool.cc:224] Handling call
0709 13:00:05.790983 (+   458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:05.804934 (+ 13951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.808693 (+  3759us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:05.890689  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 238235us
W20260709 13:00:05.897725  2269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.892920  1541 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
W20260709 13:00:05.881853  8445 log.cc:927] Time spent T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:00:05.888849  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:05.910400  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:05.900012  8392 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:05.913689  1534 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 19. Current term is 20. Ops: []
W20260709 13:00:05.914139  8444 log.cc:927] Time spent T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:00:05.913569  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:05.916676  8439 log.cc:927] Time spent T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.336s	user 0.000s	sys 0.001s
W20260709 13:00:05.919991  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 214958us
I20260709 13:00:05.925576  2267 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:05.918360  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:05.920998  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42356 (request call id 1015) took 1237 ms. Trace:
I20260709 13:00:05.923393  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:05.927024  2298 raft_consensus.cc:2368] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 17. Current term is 18.
I20260709 13:00:05.907717  8353 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:05.940634  1613 raft_consensus.cc:1275] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:00:05.916245  8226 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:05.804625  8421 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:05.945112  2300 raft_consensus.cc:1240] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:05.919153  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:05.947769  1533 rpcz_store.cc:276] 0709 13:00:04.683194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.981194 (+298000us) service_pool.cc:224] Handling call
0709 13:00:05.900914 (+919720us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b5400246154. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:05.920798 (+ 19884us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1461319936}
I20260709 13:00:05.956398  1683 raft_consensus.cc:2393] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 14: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:05.956995  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1013) took 2152 ms. Trace:
I20260709 13:00:05.957420  1536 rpcz_store.cc:276] 0709 13:00:03.800704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.776159 (+1975455us) service_pool.cc:224] Handling call
0709 13:00:05.900948 (+124789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:05.948887 (+ 47939us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:05.948917 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:05.952763 (+  3846us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:05.952822 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.952898 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:05.953010 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:05.959331  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:05.962713  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 53814.2us
W20260709 13:00:05.966717  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 66261.6us
I20260709 13:00:05.930224  8247 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:05.970129  1686 raft_consensus.cc:2410] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:00:05.970870  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3761) took 2313 ms. Trace:
I20260709 13:00:05.954957  8353 raft_consensus.cc:697] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 19 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:05.974974  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:05.975621  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:05.977113  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:05.971930  1689 rpcz_store.cc:276] 0709 13:00:03.657794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.326678 (+1668884us) service_pool.cc:224] Handling call
0709 13:00:05.327249 (+   571us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:05.328136 (+   887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:05.328165 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:05.375539 (+ 47374us) log.cc:844] Serialized 26 byte log entry
0709 13:00:05.504792 (+129253us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:05.504849 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:05.506294 (+  1445us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:05.970521 (+464227us) raft_consensus.cc:1685] finished
0709 13:00:05.970541 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:05.970688 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37206,"raft.queue_time_us":31974,"raft.run_cpu_time_us":397,"raft.run_wall_time_us":44029,"thread_start_us":86399,"threads_started":1,"wal-append.queue_time_us":161272}
I20260709 13:00:05.979539  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:05.979841  8248 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:05.981324  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:05.982156  1540 raft_consensus.cc:2393] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 15: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:05.982637  8387 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:05.983124  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:05.990244  8233 raft_consensus.cc:3055] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:05.990779  8233 raft_consensus.cc:740] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 13:00:05.990939  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.992658  8290 raft_consensus.cc:2804] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:05.993402  8290 raft_consensus.cc:697] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 6 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:05.994626  8316 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:05.994411  8290 consensus_queue.cc:237] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:05.997246  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:05.997398  1537 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:06.008606  1505 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:05.996855  8421 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:06.012405  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:06.017417  1617 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 19.
I20260709 13:00:06.018080  1539 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
W20260709 13:00:05.992650  8443 log.cc:927] Time spent T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.417s	user 0.000s	sys 0.002s
I20260709 13:00:06.015010  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:06.027287  1533 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:06.028259  1540 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 13:00:06.028942  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:06.031800  1536 raft_consensus.cc:2393] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 26: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:06.033708  7896 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:00:06.037199  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 62388.8us
I20260709 13:00:06.039296  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:06.039445  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3768) took 2283 ms. Trace:
I20260709 13:00:06.038689  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:06.040082  1691 rpcz_store.cc:276] 0709 13:00:03.755962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.331862 (+1575900us) service_pool.cc:224] Handling call
0709 13:00:05.370644 (+ 38782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:05.574345 (+203701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.037585 (+463240us) spinlock_profiling.cc:243] Waited 56 ms on lock 0x7b54002891d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:06.039385 (+  1800us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128760064}
I20260709 13:00:06.042516  2300 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:06.040603  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:06.048306  1686 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:06.051766  1689 raft_consensus.cc:2393] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 16: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:06.052826  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:06.053933  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:06.054662  1689 raft_consensus.cc:2368] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 25. Current term is 26.
I20260709 13:00:06.056244  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:06.057361  1689 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 18.
I20260709 13:00:06.057844  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:06.058843  1617 raft_consensus.cc:2393] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 16: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:06.059190  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:06.060259  1689 raft_consensus.cc:2376] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13. Re-sending same reply.
I20260709 13:00:06.061127  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:06.062745  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
W20260709 13:00:06.056623  8449 log.cc:927] Time spent T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 13:00:06.051766  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:06.070806  2303 raft_consensus.cc:2368] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 18. Current term is 19.
I20260709 13:00:06.072458  8247 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:05.993427  8353 consensus_queue.cc:237] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:06.074440  1581 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:06.077594  8292 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:06.070834  2266 leader_election.cc:400] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for earlier term 18. Current term is 19.
I20260709 13:00:06.079407  2266 leader_election.cc:403] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:00:06.081967  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:06.082696  8247 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:06.083587  2266 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:06.084856  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:06.085659  1683 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:06.087256  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:06.082320  8280 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:06.088003  1689 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 17.
I20260709 13:00:06.088999  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:06.089736  1689 raft_consensus.cc:2393] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 19: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:06.090549  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:06.091130  1689 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 24.
I20260709 13:00:06.091917  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:06.094775  8373 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for earlier term 18. Current term is 19.
I20260709 13:00:06.082790  1691 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 13:00:06.096355  8373 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:00:06.106701  1686 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 13:00:06.109082  8233 consensus_queue.cc:260] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:06.110534  8233 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:00:06.110926  8398 consensus_meta.cc:287] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.521s	user 0.012s	sys 0.000s
I20260709 13:00:06.111415  8292 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.113013  2299 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 27 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 26. Current term is 27. Ops: []
I20260709 13:00:06.106451  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:06.118966  1540 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:06.040596  8140 consensus_queue.cc:1059] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 13:00:06.121899  8140 raft_consensus.cc:3055] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:06.122298  8140 raft_consensus.cc:740] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:06.123172  8140 consensus_queue.cc:260] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:06.082427  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:06.125084  2294 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:00:06.109620  8226 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 27 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:06.109108  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:06.144186  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:06.144973  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 153435us
I20260709 13:00:06.132371  7896 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:06.111141  1654 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:06.111783  8387 consensus_queue.cc:1059] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.025s
I20260709 13:00:06.138583  1541 raft_consensus.cc:1240] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:06.080778  8421 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:06.174381  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.184901  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:06.190989  1537 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 19.
W20260709 13:00:06.136467  8450 log.cc:927] Time spent T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.416s	user 0.001s	sys 0.001s
I20260709 13:00:06.124364  8140 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:06.184551  2301 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:00:06.189553  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:06.188663  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 46436us
I20260709 13:00:06.185756  1505 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:06.111366  8398 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:06.193435  1690 raft_consensus.cc:2393] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 26: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:06.147464  2267 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:06.201102  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 93800.3us
I20260709 13:00:06.207448  2300 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 13:00:06.188901  1691 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 13:00:06.112142  8292 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:06.209439  2303 raft_consensus.cc:1240] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:06.208485  1689 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 13:00:06.214957  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4390) took 2493 ms. Trace:
I20260709 13:00:06.215471  1538 rpcz_store.cc:276] 0709 13:00:03.721744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.289865 (+1568121us) service_pool.cc:224] Handling call
0709 13:00:05.290541 (+   676us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:05.291083 (+   542us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:00:05.402734 (+111651us) log.cc:844] Serialized 14 byte log entry
0709 13:00:06.203664 (+800930us) log.cc:844] Serialized 14 byte log entry
0709 13:00:06.214456 (+ 10792us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:06.214554 (+    98us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:00:06.214629 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.214719 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:06.214894 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9929,"prepare.queue_time_us":42410,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":5782,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":6738,"thread_start_us":725501,"threads_started":2,"wal-append.queue_time_us":772875}
I20260709 13:00:06.228245  1536 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 18: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:06.235561  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:06.237237  1686 raft_consensus.cc:2393] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 20: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:06.243973  2266 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:06.247542  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:06.249325  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:06.223928  8226 raft_consensus.cc:3055] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:06.255842  1690 raft_consensus.cc:2393] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 16: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:06.227402  8317 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:06.266261  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:06.224656  8316 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:00:06.271993  1686 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:06.245755  8373 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:00:06.274757  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 163740us
I20260709 13:00:06.274849  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:06.281996  1540 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 18.
I20260709 13:00:06.284535  1683 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 18.
I20260709 13:00:06.258312  8226 raft_consensus.cc:740] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:06.289727  1691 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:06.291282  1538 raft_consensus.cc:1240] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:06.266387  8321 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:06.295120  1540 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:00:06.287705  8317 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:06.240999  8421 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:06.271166  8126 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:06.296823  1540 raft_consensus.cc:1275] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:00:06.302085  2294 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 13:00:06.303149  1540 raft_consensus.cc:1275] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:00:06.305684  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 197090us
I20260709 13:00:06.312966  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:06.313832  1690 raft_consensus.cc:2393] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 18: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:06.317883  1533 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 18.
W20260709 13:00:06.319756  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 75857.7us
I20260709 13:00:06.324273  1686 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 13:00:06.325457  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:06.326280  1686 raft_consensus.cc:2393] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 20: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 13:00:06.330611  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 76341.2us
I20260709 13:00:06.337930  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:06.339162  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:06.331470  2269 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:06.342756  2266 leader_election.cc:400] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 pre-election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for earlier term 14. Current term is 15.
I20260709 13:00:06.343149  2266 leader_election.cc:403] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:06.344515  8125 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for earlier term 14. Current term is 15.
I20260709 13:00:06.345302  8125 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:06.347797  8421 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:06.306329  8375 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:06.344599  2266 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:06.348814  1683 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
I20260709 13:00:06.305392  8321 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:06.353029  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:06.352929  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:06.348186  8280 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:06.352955  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:06.356313  1690 raft_consensus.cc:2393] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 6: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:06.357528  1540 raft_consensus.cc:1275] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:00:06.357729  1686 raft_consensus.cc:2393] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 20: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:06.360196  2267 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:06.360203  1691 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 13:00:06.362713  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:06.339051  1627 tablet_copy_source_session.cc:215] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:00:06.352048  8321 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:06.376916  2269 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:06.379343  2267 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:06.348994  8375 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:06.352432  8320 consensus_queue.cc:1059] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:00:06.388706  8050 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:06.389430  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:06.387676  1540 raft_consensus.cc:1275] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:00:06.399605  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:06.396947  8126 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:00:06.380627  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:06.401757  8353 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:06.401101  8125 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:06.402661  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:06.403744  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 3402) took 1040 ms. Trace:
I20260709 13:00:06.404071  1683 raft_consensus.cc:2393] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 16: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:06.404114  1538 rpcz_store.cc:276] 0709 13:00:05.363639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.246317 (+882678us) service_pool.cc:224] Handling call
0709 13:00:06.282866 (+ 36549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:06.291715 (+  8849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.403550 (+111835us) spinlock_profiling.cc:243] Waited 36.2 ms on lock 0x7b540045d650. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:06.403678 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83267328}
I20260709 13:00:06.380568  8039 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.375924  8290 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:06.386770  8387 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:06.416211  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:06.419679  1540 raft_consensus.cc:1240] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:06.403081  8125 raft_consensus.cc:697] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:06.422609  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:06.429388  1505 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:06.430656  1686 raft_consensus.cc:2410] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for term 20 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:00:06.401028  8384 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:00:06.418118  8398 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:06.407086  8039 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:06.434793  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:06.410486  8050 raft_consensus.cc:697] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:06.441195  1540 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:00:06.420687  8290 raft_consensus.cc:697] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 19 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:06.444667  1683 raft_consensus.cc:1240] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:06.416299  8226 consensus_queue.cc:260] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:06.443183  8233 raft_consensus.cc:2764] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:00:06.463980  1686 raft_consensus.cc:1240] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:06.459726  8290 consensus_queue.cc:237] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:06.469704  1505 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:06.471535  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:06.472146  8375 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:06.472339  1615 raft_consensus.cc:2393] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 15: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:06.474733  8226 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:06.459457  8317 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:06.486720  1505 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:06.468953  8125 consensus_queue.cc:237] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:06.492163  1682 raft_consensus.cc:1240] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:06.492846  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 84932.4us
I20260709 13:00:06.501482  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:06.484946  8233 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:06.509366  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:06.513022  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:06.514302  1615 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:00:06.515265  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:06.515547  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 144051us
I20260709 13:00:06.517623  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:06.511552  8233 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.524824  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:06.526280  7896 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:06.529858  7896 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.530272  7896 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:00:06.532644  8462 log.cc:927] Time spent T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:00:06.529142  8468 consensus_queue.cc:1048] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
W20260709 13:00:06.534385  8461 log.cc:927] Time spent T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:00:06.471834  8050 consensus_queue.cc:237] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:06.517993  8387 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.521956  2294 raft_consensus.cc:1240] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:00:06.531637  8233 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:06.550455  1505 leader_election.cc:400] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15.
I20260709 13:00:06.551023  1505 leader_election.cc:403] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:00:06.557523  1684 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33206 (request call id 943) took 3178 ms (client timeout 2646 ms). Trace:
W20260709 13:00:06.558007  1684 rpcz_store.cc:269] 0709 13:00:03.378981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.618812 (+1239831us) service_pool.cc:224] Handling call
0709 13:00:06.557279 (+1938467us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b540029b3d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:06.557449 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1814115200}
I20260709 13:00:06.559590  1684 raft_consensus.cc:1240] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:06.560706  2295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32788 (request call id 599) took 1609 ms. Trace:
I20260709 13:00:06.561157  2295 rpcz_store.cc:276] 0709 13:00:04.951404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.000697 (+ 49293us) service_pool.cc:224] Handling call
0709 13:00:06.560458 (+1559761us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b54007201d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:06.560646 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1149606144}
I20260709 13:00:06.561753  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4520) took 2615 ms. Trace:
I20260709 13:00:06.562469  8322 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15.
I20260709 13:00:06.563753  1682 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 24. Current term is 25. Ops: [24.16-24.16]
W20260709 13:00:06.565030  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 44003.9us
I20260709 13:00:06.562155  1688 rpcz_store.cc:276] 0709 13:00:03.946552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.472911 (+1526359us) service_pool.cc:224] Handling call
0709 13:00:05.473453 (+   542us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:05.609357 (+135904us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:05.609396 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:05.610053 (+   657us) log.cc:844] Serialized 26 byte log entry
0709 13:00:05.928127 (+318074us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:05.928169 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.561338 (+633169us) spinlock_profiling.cc:243] Waited 84.3 ms on lock 0x7b5400158954. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:06.561387 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:06.561436 (+    49us) raft_consensus.cc:1685] finished
0709 13:00:06.561449 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:06.561673 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16054,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":8969,"spinlock_wait_cycles":193958272,"thread_start_us":317413,"threads_started":1,"wal-append.queue_time_us":455397}
I20260709 13:00:06.569828  1684 raft_consensus.cc:1240] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:06.572010  8373 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:06.572866  2300 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:00:06.550462  8464 log.cc:927] Time spent T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:00:06.519857  8317 consensus_queue.cc:1059] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
W20260709 13:00:06.577586  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 54515.7us
I20260709 13:00:06.581920  1690 raft_consensus.cc:2955] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Committing config change with OpId 22.16: config changed from index -1 to 16, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 13:00:06.583033  8260 raft_consensus.cc:3055] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:06.583488  8260 raft_consensus.cc:740] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:06.589587  2269 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:06.604493  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 225231us
I20260709 13:00:06.584426  8260 consensus_queue.cc:260] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:06.608867  8260 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:06.609347  8321 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:06.611514  8321 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:06.596060  1656 leader_election.cc:400] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Vote denied by peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437) with higher term. Message: Invalid argument: T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 17. Current term is 18.
I20260709 13:00:06.613070  1656 leader_election.cc:403] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:00:06.603572  7896 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:06.614960  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4385) took 2894 ms. Trace:
I20260709 13:00:06.549242  8387 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:06.584678  8317 consensus_queue.cc:1243] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer 1d6516ff61104bdda54bde95e92fe579 log is divergent from this leader: its last log entry 20.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 13:00:06.624711  2267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:06.622840  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 44467.8us
I20260709 13:00:06.617045  1534 rpcz_store.cc:276] 0709 13:00:03.720387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.070011 (+1349624us) service_pool.cc:224] Handling call
0709 13:00:05.913381 (+843370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:05.950552 (+ 37171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.613081 (+662529us) spinlock_profiling.cc:243] Waited 813 ms on lock 0x7b5400246150. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:06.614893 (+  1812us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1869598080}
I20260709 13:00:06.612540  8039 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:06.630227  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4408) took 1008 ms. Trace:
W20260709 13:00:06.632709  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 65543.9us
I20260709 13:00:06.633647  2269 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:06.627542  8468 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437) with higher term. Message: Invalid argument: T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 17. Current term is 18.
W20260709 13:00:06.635555  8451 log.cc:927] Time spent T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6: Append to log took a long time: real 0.912s	user 0.000s	sys 0.007s
I20260709 13:00:06.636417  1691 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:06.643025  1687 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 22. Current term is 23. Ops: []
I20260709 13:00:06.621625  8140 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:06.620029  8375 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.651206  8392 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.707546  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
W20260709 13:00:06.651988  1685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 3763) took 2993 ms (client timeout 2322 ms). Trace:
I20260709 13:00:06.652405  8282 consensus_queue.cc:1059] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:00:06.652534  8280 consensus_queue.cc:1059] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:06.653223  8039 consensus_queue.cc:1059] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:06.653258  1655 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:06.655979  8019 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:06.658532  1682 raft_consensus.cc:3055] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:06.659304  2297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32788 (request call id 601) took 1694 ms. Trace:
I20260709 13:00:06.660171  1533 raft_consensus.cc:1240] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 17. Current term is 18. Ops: [17.14-17.14]
W20260709 13:00:06.649904  1542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 3374) took 2977 ms (client timeout 1622 ms). Trace:
I20260709 13:00:06.652220  1583 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:06.661850  1581 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:06.663615  8292 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:06.652174  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:06.665807  1656 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:06.666494  8317 consensus_queue.cc:1059] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:06.670250  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:06.669298  8322 consensus_queue.cc:1059] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:00:06.675740  1507 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:06.676626  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:06.678417  1683 raft_consensus.cc:1275] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:00:06.651120  8353 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:06.692368  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:06.693775  7896 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:06.500802  1686 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db702b262c1644109366a56f6f0d805a"
dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:50708
I20260709 13:00:06.698688  8387 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:06.701460  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:06.701730  2266 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:06.687534  8470 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:06.705951  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:06.751412  8470 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:06.752637  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:06.753221  1687 raft_consensus.cc:1240] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:06.753495  2296 raft_consensus.cc:2393] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 20: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:06.753644  8470 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:06.755512  1687 raft_consensus.cc:1275] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:00:06.757721  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 91997.3us
I20260709 13:00:06.707394  8392 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:06.708384  2301 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 18: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
W20260709 13:00:06.708222  1685 rpcz_store.cc:269] 0709 13:00:03.658248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.505178 (+846930us) service_pool.cc:224] Handling call
0709 13:00:06.651770 (+2146592us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54002d00d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:06.651918 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2759938432}
W20260709 13:00:06.723704  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 90153us
I20260709 13:00:06.737228  1541 raft_consensus.cc:3055] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:00:06.738149  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 85030.9us
I20260709 13:00:06.733446  1682 raft_consensus.cc:740] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 13:00:06.735140  1542 rpcz_store.cc:269] 0709 13:00:03.672359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.680654 (+  8295us) service_pool.cc:224] Handling call
0709 13:00:06.649514 (+2968860us) spinlock_profiling.cc:243] Waited 2.51 s on lock 0x7b54003f9dd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:06.649690 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5765238528}
I20260709 13:00:06.733934  2297 rpcz_store.cc:276] 0709 13:00:04.965148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:05.483060 (+517912us) service_pool.cc:224] Handling call
0709 13:00:05.483545 (+   485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:05.724418 (+240873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.659040 (+934622us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b540097fc54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:06.659220 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":519245696}
I20260709 13:00:06.743013  1686 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:06.770279  1686 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:06.742228  1534 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
W20260709 13:00:06.770498  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 68880.9us
I20260709 13:00:06.750813  8322 raft_consensus.cc:3055] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:06.769549  1541 raft_consensus.cc:740] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:06.630966  1537 rpcz_store.cc:276] 0709 13:00:05.621948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.258129 (+636181us) service_pool.cc:224] Handling call
0709 13:00:06.282747 (+ 24618us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:06.358660 (+ 75913us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:00:06.405692 (+ 47032us) log.cc:844] Serialized 14 byte log entry
0709 13:00:06.624091 (+218399us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:06.624146 (+    55us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:06.629964 (+  5818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.630037 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:06.630162 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2421,"prepare.queue_time_us":33077,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":8334,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":4751,"thread_start_us":180340,"threads_started":1}
I20260709 13:00:06.771400  1688 raft_consensus.cc:1275] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:00:06.774202  7896 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:06.742286  8384 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:00:06.780041  2266 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:06.791498  8401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9324141fa1ba48aca59e97123ca5742e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:06.767554  8468 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:00:06.799218  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 123582us
I20260709 13:00:06.806774  1655 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:06.793686  1508 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 2.228s (SENT) [suppressed 26 similar messages]
I20260709 13:00:06.803169  1682 consensus_queue.cc:260] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:06.781224  8126 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:06.742954  8375 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:06.788573  8292 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:06.778122  8322 raft_consensus.cc:740] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:06.832146  1538 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:00:06.836284  1682 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:06.783234  8421 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 13:00:06.839794  1540 raft_consensus.cc:1275] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:06.842301  8369 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:06.850832  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1022) took 1559 ms. Trace:
I20260709 13:00:06.843547  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:06.814637  8125 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:06.851377  1539 rpcz_store.cc:276] 0709 13:00:05.291911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.114757 (+822846us) service_pool.cc:224] Handling call
0709 13:00:06.115051 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:06.115387 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:00:06.189032 (+ 73645us) log.cc:844] Serialized 14 byte log entry
0709 13:00:06.639095 (+450063us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b1800499180. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf123a 00007fc85d05ba2a
0709 13:00:06.850496 (+211401us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:06.850546 (+    50us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:06.850592 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.850651 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:06.850775 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":74540,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":10046,"spinlock_wait_cycles":9168640,"thread_start_us":189995,"threads_started":1}
I20260709 13:00:06.806253  8468 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:06.857975  8468 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:06.860085  1655 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:06.850871  1541 consensus_queue.cc:260] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:06.862531  1686 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:06.869457  8478 log.cc:927] Time spent T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:00:06.870265  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:06.872850  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:06.874752  8316 raft_consensus.cc:3055] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:06.875769  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:06.875624  8468 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:06.919368  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:06.879019  8233 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:06.883476  8082 tablet_bootstrap.cc:492] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:00:06.883929  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.856501  8292 raft_consensus.cc:697] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:06.829247  8353 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:00:06.852632  8369 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 13:00:06.896416  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:06.903981  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 54871.3us
I20260709 13:00:06.910418  2300 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:00:06.896351  8317 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:06.920774  7896 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.942873  2301 raft_consensus.cc:2368] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15.
I20260709 13:00:06.944353  1686 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:06.949779  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:06.967130  1689 raft_consensus.cc:2393] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 20: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:06.957216  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:06.976291  1691 raft_consensus.cc:1240] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:06.917415  8316 raft_consensus.cc:740] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 13:00:06.980211  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 328105us
I20260709 13:00:06.980063  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:06.986358  7896 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:06.986635  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:50708 (request call id 4534) took 1017 ms. Trace:
I20260709 13:00:06.990787  1686 rpcz_store.cc:276] 0709 13:00:05.952915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.468587 (+515672us) service_pool.cc:224] Handling call
0709 13:00:06.966412 (+497825us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:06.992848  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:06.994199  1507 leader_election.cc:400] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437) with higher term. Message: Invalid argument: T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15.
I20260709 13:00:06.994457  1583 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:06.944904  2294 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 13:00:06.966058  8369 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:06.965405  8317 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:07.000655  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:07.002519  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:06.997321  1582 leader_election.cc:400] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Vote denied by peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437) with higher term. Message: Invalid argument: T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 18. Current term is 19.
I20260709 13:00:07.007421  1582 leader_election.cc:403] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:00:07.009934  2267 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:07.007285  1683 raft_consensus.cc:2393] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 23: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:07.013234  1615 raft_consensus.cc:2393] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 17: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:07.013664  1684 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:07.007285  1688 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 20.
I20260709 13:00:07.028093  1613 raft_consensus.cc:1275] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:00:06.965613  8126 consensus_queue.cc:1059] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
W20260709 13:00:07.037045  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 375173us
I20260709 13:00:07.034476  1583 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:07.045825  7896 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:07.038954  8421 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:07.051529  8421 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:07.053874  8421 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:07.054049  8468 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:07.054474  8421 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:07.014739  8317 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:07.056797  8126 raft_consensus.cc:3055] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:07.057238  8126 raft_consensus.cc:740] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:07.061196  8082 tablet_bootstrap.cc:492] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 13:00:07.062079  8082 ts_tablet_manager.cc:1403] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 6.822s	user 0.090s	sys 0.084s
I20260709 13:00:07.065824  1685 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 13:00:07.066298  1685 pending_rounds.cc:85] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 13
I20260709 13:00:07.066550  1685 pending_rounds.cc:107] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 13:00:07.068795  1685 raft_consensus.cc:2889] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:07.066115  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 74133.2us
I20260709 13:00:07.073822  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:07.026269  8384 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:00:07.074672  1540 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 19.
W20260709 13:00:07.079411  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 45021.7us
I20260709 13:00:07.071837  8280 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:07.038681  8373 consensus_queue.cc:1048] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:00:07.084592  1583 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:07.085811  8489 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437) with higher term. Message: Invalid argument: T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 18. Current term is 19.
I20260709 13:00:07.086146  8487 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:07.032660  8290 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:00:07.089557  1682 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 13:00:07.118358  1682 pending_rounds.cc:85] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 12
I20260709 13:00:07.118633  1682 pending_rounds.cc:107] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 13:00:07.062974  8486 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:07.098052  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 253840us
I20260709 13:00:07.084463  1684 raft_consensus.cc:1275] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:07.089447  1581 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:07.099545  7896 consensus_queue.cc:1059] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:07.119915  1508 leader_election.cc:400] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 25. Current term is 26.
I20260709 13:00:07.124019  1508 leader_election.cc:403] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260709 13:00:07.084041  8488 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:07.120054  1682 raft_consensus.cc:2889] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:07.127319  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:07.128172  1536 raft_consensus.cc:2393] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 20: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:07.129706  8484 consensus_queue.cc:1059] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 26.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.033s
I20260709 13:00:07.131328  8233 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:07.090533  8316 consensus_queue.cc:260] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:07.133524  8316 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:07.134959  8392 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:07.137100  8481 log.cc:927] Time spent T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:00:07.139340  8476 log.cc:927] Time spent T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:00:07.141819  8469 consensus_queue.cc:1059] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.147s
I20260709 13:00:07.143045  8469 raft_consensus.cc:3055] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:07.143180  8369 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:07.146263  8317 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:07.146881  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4544) took 1018 ms. Trace:
I20260709 13:00:07.147943  8398 raft_consensus.cc:3055] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:07.148401  8398 raft_consensus.cc:740] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:07.149317  8398 consensus_queue.cc:260] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:07.150523  8398 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:00:07.118752  8474 log.cc:927] Time spent T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.256s	user 0.001s	sys 0.001s
I20260709 13:00:07.154217  8039 raft_consensus.cc:3055] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:07.154747  8039 raft_consensus.cc:740] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:07.155719  8039 consensus_queue.cc:260] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:07.156791  8174 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:00:07.157071  8039 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:07.158332  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:07.147333  1690 rpcz_store.cc:276] 0709 13:00:06.128217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.581198 (+452981us) service_pool.cc:224] Handling call
0709 13:00:06.581522 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:06.581766 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:00:06.674895 (+ 93129us) log.cc:844] Serialized 14 byte log entry
0709 13:00:07.145035 (+470140us) log.cc:844] Serialized 14 byte log entry
0709 13:00:07.146284 (+  1249us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:07.146338 (+    54us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:00:07.146420 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.146490 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.146667 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23480,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":9324,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":6201,"thread_start_us":394589,"threads_started":1,"wal-append.queue_time_us":440048}
W20260709 13:00:07.173655  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 75143.1us
I20260709 13:00:07.177126  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:07.177470  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:07.179065  1538 raft_consensus.cc:2368] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6.
W20260709 13:00:07.181505  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 92432.8us
I20260709 13:00:07.183218  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 13:00:07.184607  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 176967us
I20260709 13:00:07.186493  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:07.187358  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:07.160194  8469 raft_consensus.cc:740] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:07.188385  2269 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:07.185943  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:07.181048  1508 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:07.088845  8292 consensus_queue.cc:237] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:07.195457  1542 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:07.176770  8483 raft_consensus.cc:3055] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:00:07.195434  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 153639us
I20260709 13:00:07.201308  1539 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 13:00:07.202430  2267 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:07.183598  8233 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 25. Current term is 26.
W20260709 13:00:07.211820  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 48399.2us
I20260709 13:00:07.213842  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:07.183274  8468 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:07.182896  8140 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:07.158223  8126 consensus_queue.cc:260] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:07.186143  8488 raft_consensus.cc:697] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:07.195719  8260 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:07.217653  1508 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:07.198693  8483 raft_consensus.cc:740] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:07.231242  1533 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:00:07.195017  8050 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:07.211125  8321 raft_consensus.cc:2804] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:07.235265  1538 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:00:07.237216  8082 raft_consensus.cc:359] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:07.238310  8496 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.238917  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:07.239588  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:07.239935  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:07.182379  8486 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 13:00:07.240267  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:07.240865  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:07.215704  8384 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:00:07.273932  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:07.275854  1612 raft_consensus.cc:2393] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 19: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:07.276511  1541 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:07.252293  8487 raft_consensus.cc:697] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:07.253652  8082 raft_consensus.cc:740] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 13:00:07.281786  8375 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:07.281731  8082 consensus_queue.cc:260] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:07.284332  1655 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:07.285359  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 200885us
I20260709 13:00:07.286441  1583 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:07.288730  1536 raft_consensus.cc:1275] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:00:07.290565  8321 raft_consensus.cc:697] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:07.290853  8126 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:07.291579  8321 consensus_queue.cc:237] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:07.296737  8082 ts_tablet_manager.cc:1434] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.234s	user 0.011s	sys 0.006s
I20260709 13:00:07.195122  8226 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:00:07.273614  8496 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:07.280169  8487 consensus_queue.cc:237] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:07.225979  8492 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:00:07.308182  1541 raft_consensus.cc:1275] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:00:07.254365  1508 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:07.272871  1615 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:07.302160  1613 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:07.298072  8322 consensus_queue.cc:260] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:07.313005  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4418) took 1035 ms. Trace:
I20260709 13:00:07.212395  8470 consensus_queue.cc:1048] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:00:07.315562  1541 rpcz_store.cc:276] 0709 13:00:06.277586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.334344 (+ 56758us) service_pool.cc:224] Handling call
0709 13:00:06.343538 (+  9194us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:06.737128 (+393590us) spinlock_profiling.cc:243] Waited 45.9 ms on lock 0x7b5400212b20. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85cfc8dc0 00007fc85d0531c0 00007fc85d054231 00007fc85d050d8f 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c
0709 13:00:07.276084 (+538956us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b58009c05d0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85cfad0aa 00007fc85d02f447 00007fc85d047fe7 00007fc85d0497de 00007fc85d053b49 00007fc85d054416 00007fc85d050d8f 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4
0709 13:00:07.312692 (+ 36608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:07.312940 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":924028032}
W20260709 13:00:07.324949  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.246501  8050 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:07.286689  8421 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:07.253305  8233 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:07.329862  8483 consensus_queue.cc:260] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:07.226487  8468 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:07.337322  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 50944.9us
W20260709 13:00:07.325724  8320 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
W20260709 13:00:07.340713  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 87134us
I20260709 13:00:07.245149  8140 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:07.257367  8499 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.257979  8260 raft_consensus.cc:697] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:07.338003  1542 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:00:07.351749  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:07.345603  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 91341.1us
I20260709 13:00:07.380708  1655 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:07.380997  1508 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:07.347111  8233 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:07.340183  8050 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:07.366106  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:07.336158  8469 consensus_queue.cc:260] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:07.369083  8322 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:00:07.409231  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 187481us
I20260709 13:00:07.369954  8475 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:07.371016  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:07.371793  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:07.373032  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:07.376421  1505 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:07.377110  8500 log.cc:927] Time spent T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:00:07.336493  8369 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:07.352736  8421 raft_consensus.cc:697] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:07.419129  1541 raft_consensus.cc:1240] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 18. Current term is 19. Ops: []
W20260709 13:00:07.420619  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 348483us
W20260709 13:00:07.416807  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 61847.4us
I20260709 13:00:07.421509  1691 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:00:07.421411  1581 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:07.423142  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:07.382404  8233 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:07.429107  1611 raft_consensus.cc:2393] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 21: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:07.386423  8290 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.428879  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:07.430027  1655 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:07.438656  1612 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:07.433434  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:07.439560  1609 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:00:07.436045  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 55136.4us
I20260709 13:00:07.240885  8488 consensus_queue.cc:237] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:07.450239  1508 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:07.454730  8019 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:07.421319  8503 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:00:07.427011  8317 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:07.464763  1654 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:07.466377  7896 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:00:07.456598  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:07.487771  7896 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:07.383718  8499 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:07.492692  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.463999  8174 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:07.466768  8469 raft_consensus.cc:3060] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:07.467811  8483 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:07.470147  8503 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:07.500840  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:07.509469  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 44804.7us
I20260709 13:00:07.514838  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:07.516098  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:07.427054  8505 consensus_queue.cc:1059] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.079s
I20260709 13:00:07.517597  1654 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:07.539999  8506 consensus_queue.cc:1059] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:07.541249  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:07.523113  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:07.523916  2297 raft_consensus.cc:1240] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:00:07.524513  8353 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:07.533092  1656 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:07.533835  8282 raft_consensus.cc:3055] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:07.535377  8125 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:00:07.536747  8392 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:07.499377  8019 raft_consensus.cc:697] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:07.449536  8290 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:07.551126  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 103945us
I20260709 13:00:07.505502  8174 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:07.518885   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:07.582118  1655 leader_election.cc:400] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6.
I20260709 13:00:07.595774  1655 leader_election.cc:403] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:00:07.554342  8282 raft_consensus.cc:740] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:07.589502  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:07.539013  8503 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:07.554950  8316 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:07.590940  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:07.508613  8470 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.083s
I20260709 13:00:07.538458  8468 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:07.618409  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 168283us
I20260709 13:00:07.580348  8369 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:07.513222  8507 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:07.619611  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:07.619422  1684 raft_consensus.cc:1275] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:00:07.625797  1684 pending_rounds.cc:85] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 11
I20260709 13:00:07.597436  8174 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:07.542155  8513 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:00:07.623974  1508 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:07.626129  1684 pending_rounds.cc:107] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:00:07.633199  1684 raft_consensus.cc:2889] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:07.621295  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:07.628014  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 206694us
I20260709 13:00:07.507637  8260 consensus_queue.cc:237] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:07.637014  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 114651us
I20260709 13:00:07.627362  8507 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:07.647651  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 65681us
I20260709 13:00:07.541803  8510 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.128s
I20260709 13:00:07.644670  1508 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:07.635195  1581 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:07.613663  8514 raft_consensus.cc:2764] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260709 13:00:07.658207  1655 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:07.659246  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:07.661124  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:07.630393  8369 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:07.661021  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 162111us
I20260709 13:00:07.670912  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:07.674644  1610 raft_consensus.cc:2393] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 20: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:07.556840  8421 consensus_queue.cc:237] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:07.683930  1655 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:07.656873  8524 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:07.657189  8523 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:07.660571  8507 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:07.694975  1535 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:00:07.703258  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:07.698020  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 56851.5us
I20260709 13:00:07.693765  1613 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 26.
I20260709 13:00:07.699544  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:07.705972  1508 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:07.699910  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 64819.1us
I20260709 13:00:07.706923  1581 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:07.675777  8369 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:07.674814  8518 raft_consensus.cc:3055] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:00:07.703166  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 98108.8us
I20260709 13:00:07.716787  1613 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:00:07.687577  8484 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.009s	sys 0.032s
I20260709 13:00:07.714705  8529 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:07.715539  1617 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 21.
I20260709 13:00:07.710806  8523 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:07.724656  8525 consensus_queue.cc:1059] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.014s
I20260709 13:00:07.725785  8523 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:07.716081  8518 raft_consensus.cc:740] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:07.727272  1614 raft_consensus.cc:1240] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:07.727288  8518 consensus_queue.cc:260] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:07.728791  8518 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:07.729801  8375 consensus_queue.cc:1048] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:07.730509  8233 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:07.731221  8375 consensus_queue.cc:1048] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:07.732441  8487 consensus_queue.cc:1048] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:07.732806  8375 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:07.733492  8375 raft_consensus.cc:697] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:07.734494  8375 consensus_queue.cc:237] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:07.735615  1581 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:07.738474  8504 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:00:07.700575  8140 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:07.718904  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:07.741561  8233 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:07.742659  8525 raft_consensus.cc:3055] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:00:07.743121  8525 raft_consensus.cc:740] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:07.746502  8290 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:07.747179  8290 consensus_queue.cc:1059] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:00:07.711131  8398 consensus_meta.cc:287] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.560s	user 0.012s	sys 0.000s
I20260709 13:00:07.754070  1616 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:00:07.754210  1508 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:07.693694  8524 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:07.693586  8526 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:07.711846  8508 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:00:07.686379  8282 consensus_queue.cc:260] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:07.717923  8490 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:07.772109  1615 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:00:07.761618  1612 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 13:00:07.688577  8506 consensus_queue.cc:1059] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
W20260709 13:00:07.792755  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 108887us
I20260709 13:00:07.794595  1655 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:07.795071  1609 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:07.755733  8226 raft_consensus.cc:3055] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:00:07.764318  8515 log.cc:927] Time spent T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 13:00:07.765009  8522 log.cc:927] Time spent T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:00:07.769219  8398 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.763561  8517 raft_consensus.cc:3055] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:00:07.805449  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 68113.8us
W20260709 13:00:07.813457  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 90301us
I20260709 13:00:07.770242  8524 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:07.770737  8526 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:07.817718  1508 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:07.796224  8529 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:07.795275  8536 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:00:07.830106  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 453796us
W20260709 13:00:07.831773  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:07.832460  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.806440  8226 raft_consensus.cc:740] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:07.744068  8525 consensus_queue.cc:260] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:07.837484  8529 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.838555  1505 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:07.829631  8233 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:07.817003  8517 raft_consensus.cc:740] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:07.799190  8489 consensus_queue.cc:1059] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:00:07.757213  8019 consensus_queue.cc:237] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:07.828452  8526 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:07.800827  8050 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:07.864344  1540 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
W20260709 13:00:07.865785  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:07.869298  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.869925  1508 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:07.819401  8398 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:07.827870  8504 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:00:07.852133  8233 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:07.844269  8506 consensus_queue.cc:1048] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:00:07.874797  8392 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:00:07.895808  8484 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.006s
W20260709 13:00:07.905565  8538 log.cc:927] Time spent T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:00:07.908353  1581 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:07.956187  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 55183.3us
I20260709 13:00:07.877760  8292 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:00:07.900707  8525 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:07.959009  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:07.959767  1615 raft_consensus.cc:2368] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 19. Current term is 20.
I20260709 13:00:07.960732  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:07.893563  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 99043.5us
I20260709 13:00:07.958575  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:07.961830  1655 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:07.963653  7896 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 13:00:07.964763  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.844741  8532 consensus_queue.cc:1059] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.074s
W20260709 13:00:07.968094  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.869957  8541 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:07.906976  8280 raft_consensus.cc:3055] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:00:07.973769  7896 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:07.885385  8321 raft_consensus.cc:3060] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:07.892906  8547 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:00:07.970760  8496 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:07.897197  8233 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:07.957820  8320 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:07.974701  8387 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.976351  1505 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:08.019862  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 58113.8us
I20260709 13:00:07.962839  8468 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 5. Current term is 6.
I20260709 13:00:08.023705  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:08.022459  1655 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:08.027396  1655 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:08.026921  7896 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:07.977576  8541 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:08.031756  7896 consensus_queue.cc:1059] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:00:07.870172  8529 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:07.981150  8280 raft_consensus.cc:740] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 26 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:08.037860  8280 consensus_queue.cc:260] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:08.038988  8541 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:08.039296  8280 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:00:08.015362  8523 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.963099  8226 consensus_queue.cc:260] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:08.021885  8542 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.026526  8496 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:08.051031  8543 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:08.055249  8369 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:08.021315  8492 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:00:08.038636  8529 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:08.083323  8496 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:08.083873  8496 raft_consensus.cc:697] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:08.084760  8496 consensus_queue.cc:237] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:07.985301  8521 consensus_queue.cc:1048] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.165s
I20260709 13:00:08.026899  8320 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:08.033248  8387 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:08.061375  8392 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:08.106415  8549 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:00:08.113107  1688 raft_consensus.cc:1240] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 13. Current term is 14. Ops: []
W20260709 13:00:08.119333  8475 consensus_meta.cc:287] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.684s	user 0.005s	sys 0.000s
I20260709 13:00:08.119987  8555 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:08.081859  8529 raft_consensus.cc:3055] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 LEADER]: Stepping down as leader of term 24
W20260709 13:00:08.131655  1611 consensus_meta.cc:287] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.000s
I20260709 13:00:08.137063  1611 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 13:00:08.130782  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:08.126883  8019 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.150583  8019 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:08.153765  8019 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:08.130445  1582 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:08.064148  8523 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:07.978617  8517 consensus_queue.cc:260] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:08.180440  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 50095.8us
I20260709 13:00:08.122660  8140 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:08.127342  8545 log.cc:927] Time spent T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
W20260709 13:00:08.189807  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 281552us
W20260709 13:00:08.176013  8316 consensus_meta.cc:287] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.548s	user 0.007s	sys 0.004s
I20260709 13:00:08.193363  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:08.198935  2301 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 21.
I20260709 13:00:08.157946  8475 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:00:08.199596  2269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.200507  1582 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:08.157989  8398 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:08.157593  8529 raft_consensus.cc:740] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:08.101824  8174 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:08.124378  8392 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:08.066090  8542 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:08.181641  8555 raft_consensus.cc:697] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:08.218048  1581 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
W20260709 13:00:08.219498  8539 log.cc:927] Time spent T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.324s	user 0.000s	sys 0.001s
I20260709 13:00:08.221060  8375 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:08.224697  8554 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:08.224957  8375 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:08.220191  8550 log.cc:927] Time spent T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:00:08.225462  8375 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:08.218866  8521 consensus_queue.cc:1059] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:00:08.227136  8521 raft_consensus.cc:3055] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:08.227483  8521 raft_consensus.cc:740] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:08.228317  8521 consensus_queue.cc:260] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:08.221889  8557 consensus_queue.cc:1059] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 13:00:08.229686  8521 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:08.237099  8387 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:08.247805  8523 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:08.284811  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 66859.4us
I20260709 13:00:08.190114  8019 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:08.251154  8505 raft_consensus.cc:3055] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:08.301674  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:08.302836  1611 raft_consensus.cc:2376] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20. Re-sending same reply.
I20260709 13:00:08.308215  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:08.300155  1654 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:08.206027  8316 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:08.258417  8369 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:08.269806  8492 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:00:08.198774  8140 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:08.273804  8544 log.cc:927] Time spent T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.226s	user 0.002s	sys 0.000s
I20260709 13:00:08.275137  8512 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:08.274827  8526 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:08.198582  8540 log.cc:927] Time spent T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.304s	user 0.001s	sys 0.000s
I20260709 13:00:08.275856  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:08.274892  8551 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:08.277135  2300 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:08.277179  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:08.278787  8542 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:08.279520  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:08.307001  8505 raft_consensus.cc:740] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:08.239382  8320 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:08.286304  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:08.254599  8375 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:08.333841  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:08.334373  8321 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:08.339442  1541 raft_consensus.cc:1275] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:00:08.343127  2303 raft_consensus.cc:1275] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:00:08.225426  8554 raft_consensus.cc:697] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 13:00:08.277129  8322 consensus_meta.cc:287] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.860s	user 0.010s	sys 0.000s
I20260709 13:00:08.350250  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:08.289860  8317 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:08.305174  8484 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:08.392786  8484 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:08.392463  8554 consensus_queue.cc:237] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:08.393250  8484 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:08.386984  2298 raft_consensus.cc:2393] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 21: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:08.392504  1690 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 21.
I20260709 13:00:08.397436  8375 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:08.399717  2269 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:08.400651  8317 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:08.401883  8174 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:08.402907  8317 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:08.409252  8484 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:08.412456  8484 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:08.378185  1534 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:00:08.379184  1533 raft_consensus.cc:1275] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:00:08.381692  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.384864  8551 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:08.418555  8551 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:08.386052  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 13:00:08.386468  8518 consensus_meta.cc:287] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.657s	user 0.001s	sys 0.008s
I20260709 13:00:08.386894  8542 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:08.414117  8401 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:32788 (request call id 591) took 5170 ms. Trace:
I20260709 13:00:08.420396  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:08.419313  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:08.421041  2296 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:08.420159  8542 consensus_queue.cc:1048] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:00:08.422503  8392 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:08.419392  1683 raft_consensus.cc:2393] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 21: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:08.360436  1689 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 16.
I20260709 13:00:08.446533  1687 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 14.
I20260709 13:00:08.448072  1542 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 21. Current term is 22. Ops: []
W20260709 13:00:08.478765  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 502529us
I20260709 13:00:08.335942  8504 consensus_queue.cc:1048] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 13:00:08.354897  8050 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:08.496798  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:08.502766  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:08.503239  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:08.496836  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 469570us
W20260709 13:00:08.447098  8513 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.005s	sys 0.044s
I20260709 13:00:08.357726  8373 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:08.423264  8126 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:08.448896  8483 consensus_meta.cc:287] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.937s	user 0.010s	sys 0.000s
W20260709 13:00:08.509487  1684 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.000s	sys 0.027s
W20260709 13:00:08.481987  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.508914  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:08.537650  1612 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 27.
I20260709 13:00:08.518761  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:08.421170  8233 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:08.517267  1684 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.000s	sys 0.028s
W20260709 13:00:08.569213  1508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.003s	sys 0.037s
W20260709 13:00:08.496654  8537 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.004s	sys 0.022s
W20260709 13:00:08.571913  1508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.003s	sys 0.037s
W20260709 13:00:08.512179  8513 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.005s	sys 0.045s
W20260709 13:00:08.575229  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 578434us
I20260709 13:00:08.578786  1508 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:08.478295  8518 consensus_queue.cc:1059] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.064s
I20260709 13:00:08.587564  1535 raft_consensus.cc:1240] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 13. Current term is 14. Ops: []
W20260709 13:00:08.573206  8520 log.cc:927] Time spent T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:00:08.383239  8529 consensus_queue.cc:260] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:08.574618  8537 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.004s	sys 0.023s
I20260709 13:00:08.476207  8541 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:08.383985  8512 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
W20260709 13:00:08.589109  8503 consensus_meta.cc:287] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.968s	user 0.010s	sys 0.000s
I20260709 13:00:08.542486  8126 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:08.596086  8392 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:08.542703  8373 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:08.420708  8401 rpcz_store.cc:276] 0709 13:00:03.243423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.086572 (+843149us) service_pool.cc:224] Handling call
0709 13:00:04.570611 (+484039us) ts_tablet_manager.cc:934] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
0709 13:00:06.789995 (+2219384us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:07.598118 (+808123us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:07.610985 (+ 12867us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:08.119176 (+508191us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:08.124880 (+  5704us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:08.335238 (+210358us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:08.380869 (+ 45631us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":9556,"tablet-copy.queue_time_us":321616,"thread_start_us":462183,"threads_started":2}
W20260709 13:00:08.632314  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 204978us
I20260709 13:00:08.647425  8499 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:08.650784  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:08.660387  8552 raft_consensus.cc:3055] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:00:08.661906  8548 log.cc:927] Time spent T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.669s	user 0.001s	sys 0.001s
W20260709 13:00:08.730263  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 151488us
I20260709 13:00:08.882967  1508 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:08.703953  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:08.884128  1535 raft_consensus.cc:2368] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 18. Current term is 19.
I20260709 13:00:08.677829  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:08.730190  8282 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:08.616345  8529 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:00:08.625571  8469 consensus_meta.cc:287] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 1.114s	user 0.010s	sys 0.003s
I20260709 13:00:08.878135  8552 raft_consensus.cc:740] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:08.901883  8552 consensus_queue.cc:260] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:08.903537  8552 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:08.768510  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:08.906365  8562 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.906935  8562 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:08.909373  8562 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:08.909998  1435 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54606 (request call id 313) took 9256 ms. Trace:
I20260709 13:00:08.918004  8543 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.918578  8543 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:08.892804  8320 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:00:08.922427  1617 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:00:08.781208  8550 log.cc:927] Time spent T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:00:08.619468  8503 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:08.625481  8547 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:00:08.925166  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:08.925982  1615 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 23.
I20260709 13:00:08.619153  8421 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.927059  8526 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:08.927307  8421 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:08.928287  8140 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:08.860525  8487 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:08.929157  8487 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:08.929725  8421 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:08.697702  8039 raft_consensus.cc:3055] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:08.930377  8039 raft_consensus.cc:740] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:08.931329  8039 consensus_queue.cc:260] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:08.932587  8039 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:08.932796  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:08.933688  1540 raft_consensus.cc:2393] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 14: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:08.935226  8543 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:08.861660  8510 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:08.937989  8510 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:08.938473  1612 raft_consensus.cc:1240] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:08.873981  8290 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.940812  8226 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:08.941404  8512 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:08.942354  8487 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:08.943581  8541 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:08.576406  8505 consensus_queue.cc:260] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:08.861135  1608 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 13:00:08.945145  8401 tablet_copy_client.cc:806] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 13:00:08.945883  8401 tablet_copy_client.cc:670] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
W20260709 13:00:08.946761  1608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 3589) took 1575 ms (client timeout 1991 ms). Trace:
W20260709 13:00:08.947269  1608 rpcz_store.cc:269] 0709 13:00:07.370936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.371524 (+   588us) service_pool.cc:224] Handling call
0709 13:00:08.946583 (+1575059us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54000672d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:08.946698 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2674338560}
I20260709 13:00:08.948046  8505 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:08.570758  8555 consensus_queue.cc:237] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:08.870831  8507 consensus_meta.cc:287] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 1.151s	user 0.011s	sys 0.005s
I20260709 13:00:08.868790  2269 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:08.870695  1536 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
W20260709 13:00:08.874897  1537 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.005s	sys 0.023s
W20260709 13:00:08.984915  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 116197us
W20260709 13:00:08.985180  1537 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.005s	sys 0.023s
I20260709 13:00:08.781774  8392 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:08.985751  2269 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
W20260709 13:00:08.875837  8563 log.cc:927] Time spent T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:00:08.857157  8125 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.987666  8125 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:08.989313  8384 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:08.989806  8384 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:08.990149  8384 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:08.990420  8125 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:08.730736  1690 raft_consensus.cc:1240] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:08.992188  8502 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:08.992724  8502 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.993083  8502 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:08.995580  8588 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.940403  8510 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:08.940887  8290 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:08.998618  8469 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.999209  8469 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:09.001473  8469 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:09.001765  1542 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
W20260709 13:00:08.947762  8566 log.cc:927] Time spent T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:00:09.010371  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:09.011083  1688 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 15.
I20260709 13:00:09.012241  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:09.012810  2296 consensus_meta.cc:287] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.591s	user 0.005s	sys 0.005s
I20260709 13:00:09.005829  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:09.013190  2296 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 22.
I20260709 13:00:09.013545  1691 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 16.
I20260709 13:00:09.006814  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:09.014118  8050 raft_consensus.cc:2764] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:00:09.014483  1687 raft_consensus.cc:2468] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 6.
I20260709 13:00:09.008913  8507 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:09.015300  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:09.016573  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:09.016858  8507 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:09.019398  8140 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.020221  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4556) took 1050 ms. Trace:
I20260709 13:00:08.996182  8588 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:09.021744  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.023187  8588 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:09.027060  1535 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:09.020639  1684 rpcz_store.cc:276] 0709 13:00:07.969856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.970114 (+   258us) service_pool.cc:224] Handling call
0709 13:00:07.989952 (+ 19838us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:08.543611 (+553659us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:08.543644 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:08.573387 (+ 29743us) log.cc:844] Serialized 26 byte log entry
0709 13:00:08.719154 (+145767us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:08.719289 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:08.719523 (+   234us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:09.020008 (+300485us) raft_consensus.cc:1685] finished
0709 13:00:09.020029 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:09.020170 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":56003,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":43266,"spinlock_wait_cycles":26496,"thread_start_us":662109,"threads_started":2,"wal-append.queue_time_us":426027}
I20260709 13:00:09.027630  1608 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:00:09.029568  2269 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:09.031368  2269 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
W20260709 13:00:09.031497  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.032630  8290 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:09.035074  1541 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.031s	sys 0.021s
W20260709 13:00:09.035465  1541 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.031s	sys 0.021s
I20260709 13:00:08.910437  1435 rpcz_store.cc:276] 0709 12:59:59.653182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:59.653328 (+   146us) service_pool.cc:224] Handling call
0709 13:00:08.909910 (+9256582us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:05.348693 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:05.349488 (+   795us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:05.349547 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:00:05.349577 (+    30us) tablet.cc:662] Decoding operations
0709 13:00:05.350089 (+   512us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:05.350197 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:05.350226 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:00:05.350727 (+   501us) tablet.cc:701] Row locks acquired
0709 13:00:05.350781 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:00:05.350996 (+   215us) write_op.cc:270] Start()
0709 13:00:05.351174 (+   178us) write_op.cc:276] Timestamp: P: 1783602005350926 usec, L: 0
0709 13:00:05.351212 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:00:05.352364 (+  1152us) log.cc:844] Serialized 929 byte log entry
0709 13:00:06.634632 (+1282268us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 13:00:07.227225 (+592593us) op_driver.cc:464] REPLICATION: finished
0709 13:00:07.467082 (+239857us) write_op.cc:301] APPLY: starting
0709 13:00:07.489743 (+ 22661us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:07.840133 (+350390us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:07.840177 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:08.088076 (+247899us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:08.113705 (+ 25629us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 13:00:08.113750 (+    45us) write_op.cc:312] APPLY: finished
0709 13:00:08.114021 (+   271us) log.cc:844] Serialized 33 byte log entry
0709 13:00:08.114231 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:08.114321 (+    90us) write_op.cc:454] Released schema lock
0709 13:00:08.114383 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:08.114835 (+   452us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:08.114862 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1079644,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":190998,"apply.run_cpu_time_us":9125,"apply.run_wall_time_us":673454,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12491,"num_ops":2,"prepare.queue_time_us":42186,"prepare.run_cpu_time_us":15071,"prepare.run_wall_time_us":229540,"raft.queue_time_us":325889,"raft.run_cpu_time_us":8320,"raft.run_wall_time_us":148661,"replication_time_us":1875796,"spinlock_wait_cycles":7755392,"thread_start_us":607291,"threads_started":4,"wal-append.queue_time_us":370099}]]}
I20260709 13:00:09.019937  8140 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:09.042121  1616 raft_consensus.cc:1240] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
W20260709 13:00:09.040189  1539 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.005s	sys 0.007s
W20260709 13:00:09.043978  1539 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.006s	sys 0.007s
I20260709 13:00:09.046591  2269 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:09.047457  8387 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:09.047835  8387 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.048172  8387 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:09.048959  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:09.049696  1684 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 19.
I20260709 13:00:09.049993  8290 raft_consensus.cc:2804] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:09.050480  8290 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.050850  8290 raft_consensus.cc:3060] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:09.053489  2269 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:09.054893  8469 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:09.055711  8469 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.056143  8469 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:09.059402  8290 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:09.073412  8387 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:09.098665  8469 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:09.106276  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.207052  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 13:00:10.162022  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.484447  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1054) took 1007 ms. Trace:
W20260709 13:00:09.651099  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:09.203811  1657 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.016s	sys 0.019s
W20260709 13:00:10.164299  1657 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.815s	user 0.030s	sys 0.038s
W20260709 13:00:10.113976  2301 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.246s	user 0.017s	sys 0.013s
W20260709 13:00:10.165150  2301 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.298s	user 0.018s	sys 0.014s
I20260709 13:00:10.166041  2301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32802 (request call id 675) took 1883 ms. Trace:
I20260709 13:00:09.443717  1535 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 13:00:09.212536  7896 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:09.315651  8524 consensus_meta.cc:287] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 1.478s	user 0.007s	sys 0.006s
I20260709 13:00:10.190146  8524 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:09.465106  1654 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.125s	user 0.008s	sys 0.010s
W20260709 13:00:10.191589  1654 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.851s	user 0.021s	sys 0.020s
I20260709 13:00:10.191691  8606 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 13:00:10.192296  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 1.89221e+06us
I20260709 13:00:10.192595  8606 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:09.206043  1534 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.017s	sys 0.013s
W20260709 13:00:10.194060  1534 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.582s	user 0.021s	sys 0.042s
I20260709 13:00:10.174923  7896 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:10.195688  8606 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:09.040120  8510 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:00:09.298777  8560 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.003s	sys 0.030s
I20260709 13:00:09.319672  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:09.647984  8505 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.251711  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:09.350140  8125 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.322885  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:10.163107  1541 rpcz_store.cc:276] 0709 13:00:08.476741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.476874 (+   133us) service_pool.cc:224] Handling call
0709 13:00:08.499852 (+ 22978us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:08.500050 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:00:09.035838 (+535788us) log.cc:844] Serialized 14 byte log entry
0709 13:00:09.477546 (+441708us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:09.477613 (+    67us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:09.477686 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:09.484171 (+  6485us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:09.484367 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1671736,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":155,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":70450,"thread_start_us":958405,"threads_started":2}
I20260709 13:00:10.162377  1537 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 21
W20260709 13:00:10.168201  1535 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 3422) took 1588 ms (client timeout 1837 ms). Trace:
W20260709 13:00:09.944759  8492 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.890s	user 0.002s	sys 0.014s
W20260709 13:00:10.159014  8282 consensus_meta.cc:287] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 1.259s	user 0.009s	sys 0.002s
I20260709 13:00:10.170202  1610 raft_consensus.cc:1240] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 14. Current term is 15. Ops: []
W20260709 13:00:10.194518  1655 leader_election.cc:336] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.680s (SENT)
I20260709 13:00:10.196120  7896 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:10.306967  1655 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:10.307156  7896 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.355530  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:09.238409  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:09.350695  8523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.968s	user 0.003s	sys 0.012s
I20260709 13:00:10.299152  1612 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 13.
I20260709 13:00:10.314167  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 962) took 1013 ms. Trace:
I20260709 13:00:10.166540  2301 rpcz_store.cc:276] 0709 13:00:08.282610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.304587 (+ 21977us) service_pool.cc:224] Handling call
0709 13:00:08.315344 (+ 10757us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:08.315586 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:00:08.730420 (+414834us) log.cc:844] Serialized 14 byte log entry
0709 13:00:10.165619 (+1435199us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:10.165687 (+    68us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:00:10.165740 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.165831 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:10.165976 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24983,"prepare.queue_time_us":115144,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"thread_start_us":1563152,"threads_started":2}
W20260709 13:00:09.884673  8529 consensus_meta.cc:287] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.984s	user 0.002s	sys 0.008s
I20260709 13:00:10.302645  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 961) took 1051 ms. Trace:
I20260709 13:00:09.628057  8226 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:09.622872  8555 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.021s	sys 0.025s
W20260709 13:00:09.461751  8039 consensus_meta.cc:287] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.520s	user 0.003s	sys 0.007s
I20260709 13:00:10.306452  1617 raft_consensus.cc:2393] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 22: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:09.791730  8588 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:09.731994  8570 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 13:00:10.306689  8492 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.252s	user 0.002s	sys 0.014s
W20260709 13:00:10.329279  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 134793us
I20260709 13:00:10.297863  8510 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.272384  8573 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.117520  8398 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.726397  8533 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.327519  8226 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:10.311951  1609 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 13:00:10.307664  7896 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:09.337939  8384 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:10.314543  1612 rpcz_store.cc:276] 0709 13:00:09.300829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.300975 (+   146us) service_pool.cc:224] Handling call
0709 13:00:10.314085 (+1013110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:09.688289  8140 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:10.315444  1608 rpcz_store.cc:276] 0709 13:00:09.251188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.251430 (+   242us) service_pool.cc:224] Handling call
0709 13:00:10.302559 (+1051129us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:10.304436  1535 rpcz_store.cc:269] 0709 13:00:08.579631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.016283 (+436652us) service_pool.cc:224] Handling call
0709 13:00:10.168132 (+1151849us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.319080  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 960) took 1114 ms. Trace:
W20260709 13:00:10.298595  8560 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.619s	user 0.018s	sys 0.045s
W20260709 13:00:10.313555  8523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.952s	user 0.011s	sys 0.028s
I20260709 13:00:09.213882  1627 tablet_copy_service.cc:342] P c262eac7fc904ae9bb91e450f6532e3f: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-8a2233a4e08d4138b4eb687a0440be86 received from {username='slave'} at 127.0.0.1:58006
I20260709 13:00:09.458706  8320 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.332459  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 963) took 1011 ms. Trace:
I20260709 13:00:10.159592  8469 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:10.358134  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:10.320996  8601 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 13:00:10.320427  8555 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.369s	user 0.038s	sys 0.063s
I20260709 13:00:09.104666  8526 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.311121  8290 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:10.310837  8387 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:10.330140  8502 consensus_meta.cc:287] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 1.337s	user 0.012s	sys 0.000s
I20260709 13:00:10.350865  1616 rpcz_store.cc:276] 0709 13:00:09.204431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.204602 (+   171us) service_pool.cc:224] Handling call
0709 13:00:10.318988 (+1114386us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.334487  8529 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.340437  8570 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:10.342274  8039 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:10.333071  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:10.357016  1617 rpcz_store.cc:276] 0709 13:00:09.321355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.321581 (+   226us) service_pool.cc:224] Handling call
0709 13:00:10.332364 (+1010783us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.361260  1535 raft_consensus.cc:2393] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 22: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:10.310482  8282 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:10.378253  1535 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 3433) took 1795 ms (client timeout 1892 ms). Trace:
W20260709 13:00:10.378737  1535 rpcz_store.cc:269] 0709 13:00:08.582433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.357795 (+1775362us) service_pool.cc:224] Handling call
0709 13:00:10.378187 (+ 20392us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.342479  8510 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:10.361999  7896 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:10.360158  8560 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:10.310954  8505 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:10.317489  8125 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:10.367209  1627 tablet_copy_service.cc:434] P c262eac7fc904ae9bb91e450f6532e3f: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-8a2233a4e08d4138b4eb687a0440be86 on tablet 8a2233a4e08d4138b4eb687a0440be86 with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:10.376571  1541 raft_consensus.cc:2393] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 25: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:10.343505  8398 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:10.363925  8320 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:10.345378  8573 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:10.391476  1541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 3437) took 1509 ms (client timeout 1589 ms). Trace:
I20260709 13:00:10.389387  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:10.392416  1535 raft_consensus.cc:2393] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 18: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 13:00:10.392894  1535 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 3425) took 1812 ms (client timeout 1908 ms). Trace:
W20260709 13:00:10.393249  1535 rpcz_store.cc:269] 0709 13:00:08.580502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.379487 (+1798985us) service_pool.cc:224] Handling call
0709 13:00:10.392831 (+ 13344us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.343717  8588 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:10.343669  8533 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:10.379283  8555 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:00:10.391940  1541 rpcz_store.cc:269] 0709 13:00:08.882480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.312035 (+1429555us) service_pool.cc:224] Handling call
0709 13:00:10.391415 (+ 79380us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.369210  8526 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:10.378108  8529 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:10.402253  8588 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:10.402573  8529 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:10.402339  8533 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:10.404050  8573 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:10.393579  8505 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:10.405232  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4435) took 2066 ms. Trace:
I20260709 13:00:10.393567  8570 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:10.406129  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:10.406759  1535 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:10.405646  1539 rpcz_store.cc:276] 0709 13:00:08.338538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.338730 (+   192us) service_pool.cc:224] Handling call
0709 13:00:08.358855 (+ 20125us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:08.376988 (+ 18133us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:08.377021 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:08.428053 (+ 51032us) log.cc:844] Serialized 52 byte log entry
0709 13:00:09.044498 (+616445us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:00:09.044544 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:09.044616 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:10.405008 (+1360392us) raft_consensus.cc:1685] finished
0709 13:00:10.405028 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:10.405174 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20712,"raft.queue_time_us":18323,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":48734,"thread_start_us":538843,"threads_started":1,"wal-append.queue_time_us":1922191}
I20260709 13:00:10.373837  8502 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:10.368399  8601 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:10.415582  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 13:00:10.416576  1541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42356 (request call id 1057) took 1883 ms (client timeout 1967 ms). Trace:
W20260709 13:00:10.416962  1541 rpcz_store.cc:269] 0709 13:00:08.532777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.398583 (+1865806us) service_pool.cc:224] Handling call
0709 13:00:10.416503 (+ 17920us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.382401  8039 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:10.400391  8552 consensus_meta.cc:287] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 1.494s	user 0.010s	sys 0.003s
I20260709 13:00:10.382066  8282 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:10.422569  1537 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 21.
I20260709 13:00:10.382035  8560 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:10.427947  8604 log.cc:927] Time spent T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:00:10.428089  1535 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 21.
W20260709 13:00:10.431923  1535 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 3439) took 1487 ms (client timeout 1552 ms). Trace:
W20260709 13:00:10.432389  1535 rpcz_store.cc:269] 0709 13:00:08.944906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.393924 (+1449018us) service_pool.cc:224] Handling call
0709 13:00:10.431852 (+ 37928us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:10.425282  8595 log.cc:927] Time spent T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:00:10.433463  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:10.426745  1627 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.EndTabletCopySession from 127.0.0.1:58006 (request call id 959) took 1319 ms. Trace:
W20260709 13:00:10.434389  1539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 3424) took 1854 ms (client timeout 2035 ms). Trace:
W20260709 13:00:10.435504  1539 rpcz_store.cc:269] 0709 13:00:08.580253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.427141 (+1846888us) service_pool.cc:224] Handling call
0709 13:00:10.434322 (+  7181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.436578  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:10.434854  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:10.437599  1541 raft_consensus.cc:2468] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 6.
W20260709 13:00:10.438141  1541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42356 (request call id 1068) took 1391 ms (client timeout 1546 ms). Trace:
I20260709 13:00:10.412032  8524 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:10.440632  1537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 3431) took 1858 ms (client timeout 1872 ms). Trace:
I20260709 13:00:10.439177  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 13:00:10.441681  1535 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 3427) took 1860 ms (client timeout 2110 ms). Trace:
W20260709 13:00:10.442047  1535 rpcz_store.cc:269] 0709 13:00:08.580968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.438911 (+1857943us) service_pool.cc:224] Handling call
0709 13:00:10.441626 (+  2715us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.440083  1539 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 15.
I20260709 13:00:10.428058  8226 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:10.443001  1539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42356 (request call id 1069) took 1365 ms (client timeout 1603 ms). Trace:
I20260709 13:00:10.434898  1627 rpcz_store.cc:276] 0709 13:00:09.118963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.129564 (+ 10601us) service_pool.cc:224] Handling call
0709 13:00:10.419107 (+1289543us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:10.438506  1541 rpcz_store.cc:269] 0709 13:00:09.077509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.417712 (+1340203us) service_pool.cc:224] Handling call
0709 13:00:10.438077 (+ 20365us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.436880  8526 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:10.442478  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 248911us
I20260709 13:00:10.434291  8398 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:10.443769  1539 rpcz_store.cc:269] 0709 13:00:09.077908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.436231 (+1358323us) service_pool.cc:224] Handling call
0709 13:00:10.442943 (+  6712us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:10.441030  1537 rpcz_store.cc:269] 0709 13:00:08.581923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.121321 (+539398us) service_pool.cc:224] Handling call
0709 13:00:10.440565 (+1319244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.446820  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:10.449007  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:10.449662  1683 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 21.
I20260709 13:00:10.450734  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:10.451256  1683 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:10.448691  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:10.452443  1537 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 18.
W20260709 13:00:10.453075  1537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42356 (request call id 1066) took 1407 ms (client timeout 1736 ms). Trace:
W20260709 13:00:10.453478  1537 rpcz_store.cc:269] 0709 13:00:09.045917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.448340 (+1402423us) service_pool.cc:224] Handling call
0709 13:00:10.453013 (+  4673us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.454505  1687 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:10.455444  1689 raft_consensus.cc:1275] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:00:10.454380  1691 raft_consensus.cc:1275] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:00:10.455560  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:10.456131  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:10.457388  1535 raft_consensus.cc:2376] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 26. Re-sending same reply.
I20260709 13:00:10.458065  1687 raft_consensus.cc:2393] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 14: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:10.458464  1654 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:10.459515  1684 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:00:10.460362  1686 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:00:10.458480  1541 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
W20260709 13:00:10.470690  1541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 3436) took 1849 ms (client timeout 2124 ms). Trace:
W20260709 13:00:10.471073  1541 rpcz_store.cc:269] 0709 13:00:08.621665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.444923 (+1823258us) service_pool.cc:224] Handling call
0709 13:00:10.470624 (+ 25701us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.462330  8505 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.474086  1654 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:10.467653  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:10.460760  1691 raft_consensus.cc:1275] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:00:10.457834  1535 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 3420) took 1878 ms (client timeout 2123 ms). Trace:
W20260709 13:00:10.475795  1535 rpcz_store.cc:269] 0709 13:00:08.579186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.442722 (+1863536us) service_pool.cc:224] Handling call
0709 13:00:10.457782 (+ 15060us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.472875  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:10.477046  1539 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 21.
W20260709 13:00:10.477572  1539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 3434) took 1874 ms (client timeout 2153 ms). Trace:
W20260709 13:00:10.477932  1539 rpcz_store.cc:269] 0709 13:00:08.603780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.447783 (+1844003us) service_pool.cc:224] Handling call
0709 13:00:10.477508 (+ 29725us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:10.479139  1537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42356 (request call id 1059) took 1887 ms (client timeout 2203 ms). Trace:
W20260709 13:00:10.479595  1537 rpcz_store.cc:269] 0709 13:00:08.591447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.467334 (+1875887us) service_pool.cc:224] Handling call
0709 13:00:10.479073 (+ 11739us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.466735  1683 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 22.
I20260709 13:00:10.446623  8384 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:10.458684  8524 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.490906  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:10.487389  1654 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:10.492694  1541 raft_consensus.cc:2410] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:00:10.493724  1654 leader_election.cc:400] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 19. Current term is 20.
I20260709 13:00:10.494160  1654 leader_election.cc:403] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:00:10.505568  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:10.506444  1537 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 20.
I20260709 13:00:10.506968  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42356 (request call id 1064) took 1552 ms. Trace:
I20260709 13:00:10.507247  1537 rpcz_store.cc:276] 0709 13:00:08.984042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.480332 (+1496290us) service_pool.cc:224] Handling call
0709 13:00:10.506899 (+ 26567us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.508026  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:10.508646  1535 raft_consensus.cc:3060] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:10.530781  1541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 3432) took 1948 ms (client timeout 2478 ms). Trace:
W20260709 13:00:10.531301  1541 rpcz_store.cc:269] 0709 13:00:08.582205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.471766 (+1889561us) service_pool.cc:224] Handling call
0709 13:00:10.530692 (+ 58926us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.610898  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:10.611713  1539 raft_consensus.cc:2376] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 21. Re-sending same reply.
I20260709 13:00:10.612272  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 3415) took 2034 ms. Trace:
I20260709 13:00:10.612632  1539 rpcz_store.cc:276] 0709 13:00:08.577929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.478597 (+1900668us) service_pool.cc:224] Handling call
0709 13:00:10.612199 (+133602us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.487836  8555 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Leader election won for term 26
W20260709 13:00:10.646180  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 312066us
I20260709 13:00:10.488353  8573 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:10.654584  1655 leader_election.cc:336] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.684s (SENT)
I20260709 13:00:10.656046  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:10.658617  1655 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:10.658800  1541 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 13:00:10.659361  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 3438) took 1725 ms. Trace:
I20260709 13:00:10.659713  1541 rpcz_store.cc:276] 0709 13:00:08.933830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.532023 (+1598193us) service_pool.cc:224] Handling call
0709 13:00:10.659283 (+127260us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:10.665555  1580 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.006s	sys 0.016s
W20260709 13:00:10.666290  1580 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.007s	sys 0.016s
W20260709 13:00:10.670570  1656 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.025s	sys 0.017s
W20260709 13:00:10.671448  1656 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.026s	sys 0.017s
I20260709 13:00:10.672920  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:10.684919  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:10.686583  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:10.486881  8505 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:10.684229  1539 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 13:00:10.688619  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 3417) took 2110 ms. Trace:
I20260709 13:00:10.688982  1539 rpcz_store.cc:276] 0709 13:00:08.578472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.644576 (+2066104us) service_pool.cc:224] Handling call
0709 13:00:10.688549 (+ 43973us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.685669  1541 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 13:00:10.690232  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 3429) took 2108 ms. Trace:
I20260709 13:00:10.667747  8612 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.513120  8524 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:10.687501  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 3416) took 2109 ms. Trace:
I20260709 13:00:10.690661  1541 rpcz_store.cc:276] 0709 13:00:08.581442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.660416 (+2078974us) service_pool.cc:224] Handling call
0709 13:00:10.690163 (+ 29747us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.670583  8320 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:10.673347  8611 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:10.697726  1537 rpcz_store.cc:276] 0709 13:00:08.578229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.658554 (+2080325us) service_pool.cc:224] Handling call
0709 13:00:10.687429 (+ 28875us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.703907  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:10.705435  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 258113us
I20260709 13:00:10.672012  8573 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:10.693634  8615 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.678982  1535 raft_consensus.cc:2468] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 7.
W20260709 13:00:10.712066  1535 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42356 (request call id 1070) took 1633 ms (client timeout 2031 ms). Trace:
W20260709 13:00:10.712488  1535 rpcz_store.cc:269] 0709 13:00:09.078235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.476595 (+1398360us) service_pool.cc:224] Handling call
0709 13:00:10.711993 (+235398us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.718034  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:10.715498  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 54064.6us
I20260709 13:00:10.719400  1537 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
W20260709 13:00:10.717036  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 62497.6us
I20260709 13:00:10.722393  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:10.723279  1541 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:10.729035  8555 raft_consensus.cc:697] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 26 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:10.730178  8555 consensus_queue.cc:237] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:10.705904  8502 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:10.738148  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 244491us
I20260709 13:00:10.710445  8039 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:10.743424  1654 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:10.712745  8282 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:10.701766  8612 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:10.713464  8618 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:10.750511  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:10.736801  8611 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:10.707363  8613 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
W20260709 13:00:10.762187  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:10.761926  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 92903.7us
I20260709 13:00:10.714607  8620 consensus_queue.cc:1048] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:00:10.736697  8614 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:10.765239  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:10.766106  1683 raft_consensus.cc:2393] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 20: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:10.756229  8039 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:10.722898  8615 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:10.769052  8614 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.775439  8634 consensus_queue.cc:1059] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:00:10.760725  8601 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:10.760389  8560 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:10.780018  8624 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.788697  8624 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:10.781939  8622 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:10.789634  8622 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:10.791025  8624 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:10.792026  8622 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:10.794111  1541 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 13:00:10.782426  8573 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:10.784495  8613 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:10.794981  1535 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:00:10.787576  8510 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:10.794602  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1058) took 2253 ms. Trace:
I20260709 13:00:10.795463  1535 pending_rounds.cc:85] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 11
I20260709 13:00:10.798620  1535 pending_rounds.cc:107] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:00:10.799080  1535 raft_consensus.cc:2889] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:10.800148  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 3418) took 2221 ms. Trace:
I20260709 13:00:10.800750  8612 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:10.802145  8373 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:10.760448  8618 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:10.804797  8618 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:10.806917  8615 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:10.807262  8602 log.cc:927] Time spent T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.638s	user 0.009s	sys 0.004s
I20260709 13:00:10.779726  8614 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:10.808274  8524 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:10.768126  8626 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:00:10.802287  8505 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:10.761344  8282 consensus_queue.cc:1048] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
W20260709 13:00:10.816779  8609 log.cc:927] Time spent T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:00:10.779400  8039 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:10.819442  2267 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:10.819984  8039 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:10.800634  1535 rpcz_store.cc:276] 0709 13:00:08.578710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.771883 (+2193173us) service_pool.cc:224] Handling call
0709 13:00:10.794489 (+ 22606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:10.799730 (+  5241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.800045 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:10.826074  2267 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:10.830515  8617 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:00:10.836019  2267 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:10.820705  8492 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:10.839967  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:10.840772  1535 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 26.
I20260709 13:00:10.841672  2267 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:10.820835  8613 raft_consensus.cc:697] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:10.842984  2267 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:10.837926  8617 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:10.842593  8384 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:10.834765  8502 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:10.838169  8373 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:00:10.835355  2266 connection.cc:256] RPC call timeout handler was delayed by -1.9869064169999433s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2243s for a response
W20260709 13:00:10.842046  8599 log.cc:927] Time spent T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.675s	user 0.009s	sys 0.006s
I20260709 13:00:10.847755  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1052) took 2372 ms. Trace:
I20260709 13:00:10.850216  2267 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:10.849356  1533 rpcz_store.cc:276] 0709 13:00:08.475763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.475904 (+   141us) service_pool.cc:224] Handling call
0709 13:00:08.504342 (+ 28438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:08.542017 (+ 37675us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:08.542053 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:08.574550 (+ 32497us) log.cc:844] Serialized 26 byte log entry
0709 13:00:09.106000 (+531450us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:09.106039 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:09.106116 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:10.806540 (+1700424us) spinlock_profiling.cc:243] Waited 47.7 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 13:00:10.846506 (+ 39966us) raft_consensus.cc:1685] finished
0709 13:00:10.846534 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:10.847669 (+  1135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15590,"raft.queue_time_us":11226,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":52089,"spinlock_wait_cycles":109674240,"thread_start_us":496718,"threads_started":1,"wal-append.queue_time_us":1576130}
W20260709 13:00:10.848855  2266 connection.cc:256] RPC call timeout handler was delayed by -1.4801864139999452s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
W20260709 13:00:10.852167  2266 connection.cc:256] RPC call timeout handler was delayed by -1.3103952609999965s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17110000000000003s for a response
I20260709 13:00:10.853103  2266 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:10.845062  8617 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:10.858819  8617 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:10.846807  8384 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.869141  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:10.870086  1535 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 13.
I20260709 13:00:10.848783  8373 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:10.874101  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 133716us
I20260709 13:00:10.854262  8588 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:10.860743  8226 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:00:10.843166  8492 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:10.902128  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:10.907848  1533 raft_consensus.cc:2410] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:00:10.872540  8384 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:10.847723  8605 raft_consensus.cc:2804] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:00:10.903404  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 160288us
I20260709 13:00:10.869885  8533 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:10.848809  8502 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:10.916441  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1056) took 2417 ms. Trace:
I20260709 13:00:10.880263  8373 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:10.906678  8226 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.873945  8523 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:00:10.923588  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:10.874557  8614 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:10.909144  8588 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:10.822811  1537 rpcz_store.cc:276] 0709 13:00:08.541230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.720768 (+2179538us) service_pool.cc:224] Handling call
0709 13:00:10.721119 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:10.721335 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:10.738192 (+ 16857us) log.cc:844] Serialized 14 byte log entry
0709 13:00:10.794055 (+ 55863us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:10.794125 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:10.794179 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.794261 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:10.794506 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16421,"prepare.queue_time_us":47111,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":264,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":8535,"thread_start_us":71571,"threads_started":2}
I20260709 13:00:10.921599  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1053) took 2445 ms. Trace:
I20260709 13:00:10.989002  1541 raft_consensus.cc:1240] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 17. Current term is 18. Ops: []
W20260709 13:00:10.951023  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 170173us
W20260709 13:00:10.933693  1655 leader_election.cc:336] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.123s (SENT)
I20260709 13:00:11.010644  1581 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:11.012934  1581 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:11.019002  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 3435) took 2405 ms. Trace:
I20260709 13:00:11.019492  1535 rpcz_store.cc:276] 0709 13:00:08.613791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.018006 (+2404215us) service_pool.cc:224] Handling call
0709 13:00:11.018337 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.018650 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.018679 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:11.018722 (+    43us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:11.018759 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.018818 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:11.018938 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:10.945228  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 65588.7us
I20260709 13:00:11.021936  8523 consensus_queue.cc:1059] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:00:11.009434  1533 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 18.
I20260709 13:00:11.014490  8502 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:11.015645  8639 log.cc:927] Time spent T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:00:11.015941  8638 consensus_queue.cc:1048] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:00:11.017684  8492 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:11.020280  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 126631us
I20260709 13:00:10.916982  1539 rpcz_store.cc:276] 0709 13:00:08.499611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.723656 (+2224045us) service_pool.cc:224] Handling call
0709 13:00:10.748245 (+ 24589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:10.748507 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:00:10.827770 (+ 79263us) log.cc:844] Serialized 14 byte log entry
0709 13:00:10.915377 (+ 87607us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:10.915433 (+    56us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:10.916192 (+   759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.916268 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:10.916382 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":56339,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":109,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":6772,"thread_start_us":147670,"threads_started":2,"wal-append.queue_time_us":130900}
I20260709 13:00:10.965102  8510 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:10.917486  8533 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:11.024739  2266 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:11.025317  8646 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:11.007364  1534 rpcz_store.cc:276] 0709 13:00:08.476194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.476302 (+   108us) service_pool.cc:224] Handling call
0709 13:00:08.509926 (+ 33624us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:08.570164 (+ 60238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:08.570198 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:08.577568 (+  7370us) log.cc:844] Serialized 26 byte log entry
0709 13:00:10.194525 (+1616957us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:00:10.194570 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:10.194641 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:10.813073 (+618432us) spinlock_profiling.cc:243] Waited 49.2 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 13:00:10.916397 (+103324us) raft_consensus.cc:1685] finished
0709 13:00:10.916419 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:10.921526 (+  5107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8807,"raft.queue_time_us":65910,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":13295,"spinlock_wait_cycles":113114368,"thread_start_us":1582065,"threads_started":1,"wal-append.queue_time_us":1572700}
I20260709 13:00:10.941248  8290 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.089s
W20260709 13:00:11.030525  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 96889.6us
W20260709 13:00:11.033640  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:11.126231  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 101607us
I20260709 13:00:11.029939  8605 raft_consensus.cc:697] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 7 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:10.925810  8226 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:00:11.066704  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1060) took 2465 ms. Trace:
I20260709 13:00:10.986896  8392 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:10.977536  8617 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:11.023572  1654 connection.cc:256] RPC call timeout handler was delayed by -1.0296192100000212s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
I20260709 13:00:10.960769  8612 consensus_queue.cc:1048] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.131s
I20260709 13:00:11.026006  8601 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.126608  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:11.142220  1533 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 13:00:11.026153  8637 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:11.017825  8384 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:11.127763  2266 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:11.125283  8634 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:11.146871  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:11.128556  8646 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.093151  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1061) took 2475 ms. Trace:
I20260709 13:00:11.130390  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:11.134861  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:11.135627  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:11.139209  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:11.115726  8644 raft_consensus.cc:3055] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:10.918349  8613 consensus_queue.cc:237] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:11.158680  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:11.132051  8510 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:11.160763  2301 raft_consensus.cc:1240] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:11.125032  8533 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:11.147816  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:11.147758  1684 raft_consensus.cc:2410] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
W20260709 13:00:11.162943  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 58264.7us
I20260709 13:00:11.128376  1537 rpcz_store.cc:276] 0709 13:00:08.601025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.018225 (+2417200us) service_pool.cc:224] Handling call
0709 13:00:11.066109 (+ 47884us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.066338 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.066367 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:11.066411 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:11.066450 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.066507 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:11.066634 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.128005  8611 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 19. Current term is 20.
I20260709 13:00:11.149551  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:11.150482  1535 rpcz_store.cc:276] 0709 13:00:08.617761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.020441 (+2402680us) service_pool.cc:224] Handling call
0709 13:00:11.092572 (+ 72131us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.092781 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.092809 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:11.092855 (+    46us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:11.092894 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.092953 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:11.093081 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.155937  1689 raft_consensus.cc:2368] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 20. Current term is 21.
I20260709 13:00:11.151021  8637 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:11.159458  1683 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:11.163192  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:11.147778  8502 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:11.177227  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:11.190814  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:11.192168  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:11.193595  1684 raft_consensus.cc:2410] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:00:11.141813  8492 consensus_queue.cc:1059] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:00:11.196596  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:11.156252  8524 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:11.156451  8646 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:11.191481  1533 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 13:00:11.194697  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:11.195159  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:11.204918  1537 raft_consensus.cc:2393] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 20: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:11.198293  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:11.130089  8633 consensus_queue.cc:1059] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.051s
I20260709 13:00:11.155589  8644 raft_consensus.cc:740] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:11.202737  1686 raft_consensus.cc:2393] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 18: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 13:00:11.207960  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.227000  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:11.227989  1682 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 19.
I20260709 13:00:11.147306  8601 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:11.229619  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:11.232963  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:11.189217  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:11.234493  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:11.190339  8638 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.239405  1684 raft_consensus.cc:2393] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 22: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:11.256618  8617 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:11.251910  8384 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:11.251991  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:11.262041  1688 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:11.235363  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:11.268651  1686 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:11.270021  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:11.265396  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:11.272258  1684 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:11.270903  1686 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 13:00:11.273988  1683 raft_consensus.cc:2410] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:00:11.276405  8614 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:11.286902  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:11.296958  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:11.300371  8503 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:11.197862  8605 consensus_queue.cc:237] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:11.304494  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:11.305487  1683 raft_consensus.cc:2393] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 17: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:11.309986  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:11.311565  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 147787us
I20260709 13:00:11.310842  2299 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 24.
I20260709 13:00:11.326409  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:11.327142  2302 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 19.
I20260709 13:00:11.336508  8640 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:11.338838  8612 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.339792  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:11.311170  8601 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:11.225179  8524 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:11.349923  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:11.350817  1686 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 18.
I20260709 13:00:11.345192  1583 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:11.351890  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:11.353325  8551 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.353853  8551 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:11.355079  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:11.356081  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:11.357435  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:11.358035  1608 raft_consensus.cc:2376] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19. Re-sending same reply.
I20260709 13:00:11.281884  8638 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:11.331291  8651 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:11.367214  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:11.364372  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:11.368602  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:11.369335  1686 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 25.
I20260709 13:00:11.370661  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:11.371385  1686 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 13:00:11.339315  8640 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:11.372721  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:11.373515  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:11.374249  1686 raft_consensus.cc:2393] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 22: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:11.379419  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:11.357161  8588 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:11.384449  1612 raft_consensus.cc:2376] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19. Re-sending same reply.
I20260709 13:00:11.380368  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:11.381165  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:11.381518  1616 raft_consensus.cc:2410] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:00:11.382110  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:11.383610  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:11.382714  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:11.386233  1684 raft_consensus.cc:2376] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 22. Re-sending same reply.
I20260709 13:00:11.375665  8653 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.389417  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:11.390021  2302 raft_consensus.cc:2368] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 14. Current term is 15.
I20260709 13:00:11.390040  1683 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 18.
I20260709 13:00:11.339407  8612 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:11.374094  8532 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:11.361769  8634 raft_consensus.cc:697] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:11.357714  8039 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:00:11.393283  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:11.374473  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:11.396273  1617 raft_consensus.cc:1275] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:00:11.273032  8644 consensus_queue.cc:260] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:11.398895  1617 pending_rounds.cc:85] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f: Aborting all ops after (but not including) 9
I20260709 13:00:11.401401  1617 pending_rounds.cc:107] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:00:11.401682  1617 raft_consensus.cc:2889] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:11.398929  2302 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 13:00:11.388949  8640 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:11.404337  1610 raft_consensus.cc:1275] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:00:11.406002  1609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 3610) took 3104 ms (client timeout 1786 ms). Trace:
W20260709 13:00:11.406399  1609 rpcz_store.cc:269] 0709 13:00:08.301190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.307936 (+  6746us) service_pool.cc:224] Handling call
0709 13:00:11.405795 (+3097859us) spinlock_profiling.cc:243] Waited 2 s on lock 0x7b540011dad4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:11.405906 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4606934784}
I20260709 13:00:11.408283  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:11.409008  1614 raft_consensus.cc:1275] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:00:11.411207  8638 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:11.411414  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:11.413839  8226 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:11.388852  8653 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:11.378363  8651 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:11.422525  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:11.424592  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:11.430929  1610 raft_consensus.cc:1275] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:00:11.431656  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:11.432271  1616 raft_consensus.cc:2376] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16. Re-sending same reply.
I20260709 13:00:11.400724  8532 raft_consensus.cc:697] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:11.436117  2298 raft_consensus.cc:2368] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 27. Current term is 28.
I20260709 13:00:11.435914  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:11.441516  1582 leader_election.cc:400] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Vote denied by peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437) with higher term. Message: Invalid argument: T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 14. Current term is 15.
I20260709 13:00:11.427050  8601 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:11.447252  8637 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:11.446897  1542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 3428) took 2865 ms (client timeout 1682 ms). Trace:
I20260709 13:00:11.450809  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:11.457505  8612 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:11.463263  1608 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 23.
W20260709 13:00:11.468003  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 162702us
W20260709 13:00:11.465497  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.434409  8644 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:11.471067  1582 leader_election.cc:403] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:00:11.473495  1542 rpcz_store.cc:269] 0709 13:00:08.581221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.677504 (+ 96283us) service_pool.cc:224] Handling call
0709 13:00:11.446695 (+2769191us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b5400246654. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:11.446824 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":256631168}
W20260709 13:00:11.486346  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 44971.1us
I20260709 13:00:11.489818  1582 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:11.486869  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1065) took 2441 ms. Trace:
W20260709 13:00:11.494671  1508 leader_election.cc:336] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 2.183s (SENT)
I20260709 13:00:11.495589  1582 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:11.495155  1508 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:11.494211  1533 rpcz_store.cc:276] 0709 13:00:09.045638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.266765 (+2221127us) service_pool.cc:224] Handling call
0709 13:00:11.267119 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.267330 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:00:11.267650 (+   320us) log.cc:844] Serialized 14 byte log entry
0709 13:00:11.486494 (+218844us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:11.486555 (+    61us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:11.486611 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.486676 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:11.486812 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":641,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":5095,"thread_start_us":215865,"threads_started":1}
I20260709 13:00:11.505045  1542 raft_consensus.cc:1240] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:11.505784  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1067) took 2459 ms. Trace:
I20260709 13:00:11.506105  1542 rpcz_store.cc:276] 0709 13:00:09.046225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.485849 (+2439624us) service_pool.cc:224] Handling call
0709 13:00:11.504858 (+ 19009us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.505511 (+   653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.505723 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:11.495199  8612 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:00:11.488418  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:11.497352  8652 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:11.534278  1654 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:11.517494  1508 leader_election.cc:336] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 2.228s (SENT)
I20260709 13:00:11.529399  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:11.535135  1508 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:11.507386  8039 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:11.533313  8652 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.540138  8652 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:11.540548  8503 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:00:11.540261  1508 leader_election.cc:336] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 2.322s (SENT)
I20260709 13:00:11.541535  8524 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:11.541599  1508 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:11.512118  8532 consensus_queue.cc:237] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:11.543833  1508 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:11.544685  8503 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:11.545836  8503 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:11.546062  8637 raft_consensus.cc:2764] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260709 13:00:11.546412  8651 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:11.546908  8524 consensus_queue.cc:1059] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:00:11.475106  8601 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:11.548319  1508 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:11.547204  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:11.549968  1508 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:11.553778  1615 raft_consensus.cc:1275] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:00:11.554747  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:11.555326  1615 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 13:00:11.559259  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:11.559715  1542 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 24. Current term is 25. Ops: []
I20260709 13:00:11.511328  8126 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:11.504662  8533 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:11.532569  8547 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:11.559540  1540 raft_consensus.cc:1240] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:11.560204  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:11.565037  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:11.566599  1609 raft_consensus.cc:2376] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20. Re-sending same reply.
I20260709 13:00:11.567194  1617 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:11.547297  8226 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 28 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:11.572738  1542 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:00:11.573532  1654 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:11.560675  8392 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:11.548873  8503 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:11.584535  8503 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:11.578671  8392 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.590647  8392 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:11.565551  8626 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:00:11.593108  8653 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:11.583981  1542 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:00:11.563297  8637 consensus_queue.cc:1048] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:00:11.497001  8634 consensus_queue.cc:237] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:11.603780  2302 raft_consensus.cc:2410] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:00:11.608246  8533 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:11.610049  8601 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:11.610512  2296 raft_consensus.cc:2410] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:00:11.611495  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:11.612360  2296 raft_consensus.cc:2393] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 20: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:11.613309  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:11.613945  2296 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 13:00:11.611836  8652 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:11.618086  1582 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:11.618795  8547 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:00:11.577665  8611 consensus_queue.cc:1048] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
W20260709 13:00:11.577306  8373 consensus_meta.cc:287] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.646s	user 0.011s	sys 0.000s
I20260709 13:00:11.629343  8630 raft_consensus.cc:2804] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:11.616344  2296 raft_consensus.cc:1240] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:11.644032  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:11.621516  8547 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.646588  1617 raft_consensus.cc:2410] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:00:11.642253  8630 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.649888  8630 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:11.631606  8651 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.618049  8621 consensus_queue.cc:1048] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:00:11.654137  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:11.654247  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:11.654960  1616 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 20.
I20260709 13:00:11.661625  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:11.647779  8547 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:11.631371  8373 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:11.678913  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:11.680837  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:11.679775  1687 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 13:00:11.682984  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:11.683856  1687 raft_consensus.cc:2393] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 23: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:11.651010  8503 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:11.681834  8508 consensus_queue.cc:1059] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:00:11.688560  8508 raft_consensus.cc:3055] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:11.688931  8508 raft_consensus.cc:740] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:11.689033  8652 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:11.691859  8125 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:11.696259  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:11.698118  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.698616  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:11.699360  1687 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:11.696954  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:11.648772  8392 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:11.672922  8290 raft_consensus.cc:3055] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:11.764899  2300 raft_consensus.cc:2393] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 16: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:11.765055  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 981) took 3486 ms. Trace:
I20260709 13:00:11.769552  1690 rpcz_store.cc:276] 0709 13:00:08.278586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.398490 (+119904us) service_pool.cc:224] Handling call
0709 13:00:08.398765 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:09.003322 (+604557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.764817 (+2761495us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b5400299fd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:11.764995 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":534249344}
I20260709 13:00:11.696105  8508 consensus_queue.cc:260] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:11.656121  8651 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:11.797271  8508 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:11.798678  8651 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:11.774940  8373 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:11.778851  2296 raft_consensus.cc:1240] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:11.779460  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:11.781919  8503 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:11.784081  8603 log.cc:927] Time spent T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 1.416s	user 0.001s	sys 0.002s
I20260709 13:00:11.785290  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:11.786458  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:11.789156  8612 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437) with higher term. Message: Invalid argument: T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 14. Current term is 15.
I20260709 13:00:11.792567  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:11.768416  8290 raft_consensus.cc:740] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:11.795073  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 3423) took 3215 ms. Trace:
I20260709 13:00:11.795603  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:11.796284  8392 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:11.737339  8646 consensus_meta.cc:287] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.501s	user 0.008s	sys 0.002s
I20260709 13:00:11.797360  1683 raft_consensus.cc:1275] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:00:11.810561  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:11.829087  2303 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:00:11.829545  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:11.830255  1691 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:11.820436  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:11.822981  1541 rpcz_store.cc:276] 0709 13:00:08.580012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.795178 (+2215166us) service_pool.cc:224] Handling call
0709 13:00:10.834412 (+ 39234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.007991 (+173579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.794841 (+786850us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b540045d154. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:11.795015 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":355051392}
I20260709 13:00:11.831846  1687 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 16.
I20260709 13:00:11.833115  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 13:00:11.815445  8656 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.051s	user 0.002s	sys 0.000s
I20260709 13:00:11.836277  1656 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:11.837891  2269 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:11.838639  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:11.841790  1688 raft_consensus.cc:2393] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 25: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:11.839502  1687 raft_consensus.cc:3060] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:11.794499  8605 consensus_queue.cc:1059] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:00:11.813781  2294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32788 (request call id 618) took 4396 ms. Trace:
I20260709 13:00:11.843478  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:11.839097  1581 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:11.851248  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:11.853717  1541 raft_consensus.cc:2393] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 18: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:11.850324  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:11.869340  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:11.869521  8533 raft_consensus.cc:3055] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:11.870126  8533 raft_consensus.cc:740] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:11.869407  1686 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:11.858295  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:11.871095  8533 consensus_queue.cc:260] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:11.871764  1541 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:11.858520  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:11.861285  2266 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:11.864319  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1062) took 3238 ms. Trace:
I20260709 13:00:11.865157  8401 tablet_copy_client.cc:538] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:00:11.865526  8589 log.cc:927] Time spent T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 2.391s	user 0.005s	sys 0.006s
I20260709 13:00:11.870713  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:11.840366  8039 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.881456  2267 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:11.890690  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:11.878293  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:11.877856  1535 rpcz_store.cc:276] 0709 13:00:08.626321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.206373 (+2580052us) service_pool.cc:224] Handling call
0709 13:00:11.237303 (+ 30930us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.374771 (+137468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.374801 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:11.374852 (+    51us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:11.374882 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.864054 (+489172us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54000735d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:11.864106 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:11.864254 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":315764096}
I20260709 13:00:11.879767  1541 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 13:00:11.884306  1507 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:11.842151  8651 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.857241  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:11.843885  8621 raft_consensus.cc:2764] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
W20260709 13:00:11.891618  1505 connection.cc:256] RPC call timeout handler was delayed by -1.8178016379999917s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17190000000000003s for a response
W20260709 13:00:11.897114  1505 connection.cc:256] RPC call timeout handler was delayed by -1.7566016380000065s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
W20260709 13:00:11.897503  1505 connection.cc:256] RPC call timeout handler was delayed by -1.6012560059999714s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16080000000000003s for a response
W20260709 13:00:11.897956  1505 connection.cc:256] RPC call timeout handler was delayed by -1.1563016380000022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24540000000000003s for a response
I20260709 13:00:11.899034  1505 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:11.895859  2267 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:11.839102  8646 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:11.840418  8630 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:11.855439  8373 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:00:11.920608  2269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.200973  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:11.921376  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:11.986766  1691 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 20.
I20260709 13:00:11.873970  8517 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:00:12.029448  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 456005us
W20260709 13:00:11.897420  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 347588us
W20260709 13:00:11.915550  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:11.905793  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:12.168387  1583 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.005s	sys 0.018s
I20260709 13:00:12.043006  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4428) took 3742 ms. Trace:
I20260709 13:00:12.022418  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:12.019232  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:11.912034  1582 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:12.353981  1682 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 23.
I20260709 13:00:12.363308  1538 rpcz_store.cc:276] 0709 13:00:08.300659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.300870 (+   211us) service_pool.cc:224] Handling call
0709 13:00:08.345599 (+ 44729us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:08.354561 (+  8962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:08.354590 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:08.373789 (+ 19199us) log.cc:844] Serialized 26 byte log entry
0709 13:00:08.866805 (+493016us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:08.866845 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:08.866913 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:11.864915 (+2998002us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 13:00:12.039549 (+174634us) raft_consensus.cc:1685] finished
0709 13:00:12.039574 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.042922 (+  3348us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":125,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":23220,"spinlock_wait_cycles":579693824,"thread_start_us":369630,"threads_started":1,"wal-append.queue_time_us":881664}
I20260709 13:00:11.899526  1687 raft_consensus.cc:2468] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 7.
W20260709 13:00:12.365458  1583 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.006s	sys 0.023s
I20260709 13:00:11.872439  8533 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:12.261085  2300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32794 (request call id 944) took 1094 ms. Trace:
I20260709 13:00:12.366410  2300 rpcz_store.cc:276] 0709 13:00:11.168297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.168608 (+   311us) service_pool.cc:224] Handling call
0709 13:00:12.260805 (+1092197us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b54007201d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:12.260999 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1171801472}
I20260709 13:00:12.367470  1535 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 20.
W20260709 13:00:12.281998  1655 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.560s (SENT) [suppressed 43 similar messages]
I20260709 13:00:12.108140  2266 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:12.359769  1690 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 19.
I20260709 13:00:12.362401  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 13:00:12.358381  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:12.365805  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 791886us
I20260709 13:00:12.269894  2299 raft_consensus.cc:1240] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: []
W20260709 13:00:12.201306  8664 log.cc:927] Time spent T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:00:12.374321  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:11.887094  8612 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:12.203047  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4437) took 1546 ms. Trace:
I20260709 13:00:11.896034  8641 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:00:12.234930  8547 consensus_meta.cc:287] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.000s
W20260709 13:00:12.358372  8508 consensus_meta.cc:287] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.560s	user 0.010s	sys 0.002s
W20260709 13:00:12.367713  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 471964us
I20260709 13:00:12.368580  1508 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:12.375555  1533 rpcz_store.cc:276] 0709 13:00:10.656192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.503997 (+847805us) service_pool.cc:224] Handling call
0709 13:00:11.504370 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.506537 (+  2167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.506564 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.511284 (+  4720us) log.cc:844] Serialized 26 byte log entry
0709 13:00:12.002406 (+491122us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:12.002455 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.002538 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:12.202812 (+200274us) raft_consensus.cc:1685] finished
0709 13:00:12.202833 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.202983 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1742,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":11672,"thread_start_us":441046,"threads_started":1,"wal-append.queue_time_us":651358}
I20260709 13:00:12.378279  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:12.205003  8503 raft_consensus.cc:3055] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:12.395653  8503 raft_consensus.cc:740] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:12.396536  8503 consensus_queue.cc:260] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:12.397804  8503 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:12.201296  8620 raft_consensus.cc:3055] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:12.383692  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:11.901284  8653 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:12.395121  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:12.019989  8392 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.008513  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:12.040835  8233 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:12.007943  8588 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.010102  8614 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:12.432123  1536 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.061s	sys 0.091s
W20260709 13:00:12.466073  1536 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.062s	sys 0.091s
I20260709 13:00:12.404019  1538 raft_consensus.cc:1275] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:00:12.420547  1533 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 21. Current term is 22. Ops: []
W20260709 13:00:12.213034  8668 log.cc:927] Time spent T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:00:12.472527  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4586) took 1069 ms. Trace:
I20260709 13:00:12.431830  8620 raft_consensus.cc:740] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:12.435822  1682 raft_consensus.cc:2376] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20. Re-sending same reply.
I20260709 13:00:12.474102  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1063) took 3673 ms. Trace:
I20260709 13:00:11.901146  8605 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:12.444936  1616 raft_consensus.cc:2410] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for term 16 because replica has last-logged OpId of term: 15 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 14.
I20260709 13:00:11.890491  8611 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.511s
I20260709 13:00:12.446599  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:12.010301  8290 consensus_queue.cc:260] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:12.376556  8373 raft_consensus.cc:697] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
W20260709 13:00:12.448891  8676 log.cc:927] Time spent T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 13:00:12.426855  8547 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:12.450295  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 3618) took 1079 ms. Trace:
I20260709 13:00:12.451994  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 3707) took 3970 ms. Trace:
I20260709 13:00:12.521782  1614 rpcz_store.cc:276] 0709 13:00:08.481835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.483437 (+  1602us) service_pool.cc:224] Handling call
0709 13:00:11.408657 (+2925220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.409428 (+   771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.451787 (+1042359us) spinlock_profiling.cc:243] Waited 2.91 s on lock 0x7b540011dad0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:12.451932 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6683086208}
I20260709 13:00:12.007855  8626 consensus_queue.cc:1059] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.464s
I20260709 13:00:11.972332  8651 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:11.900113  8039 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:12.380359  8612 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.381822  8050 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:12.456827  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:12.540132  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:12.541481  1615 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 19: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:12.482703  8605 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:12.537314  2296 raft_consensus.cc:2410] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 26 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 13:00:12.469774  8588 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:12.469532  2301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32802 (request call id 680) took 1323 ms. Trace:
I20260709 13:00:12.548161  2301 rpcz_store.cc:276] 0709 13:00:11.145899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.146699 (+   800us) service_pool.cc:224] Handling call
0709 13:00:11.146953 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.161159 (+ 14206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.469289 (+1308130us) spinlock_profiling.cc:243] Waited 9.57 ms on lock 0x7b54006a6654. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:12.469472 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22007168}
I20260709 13:00:12.470752  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4456) took 1437 ms. Trace:
I20260709 13:00:12.473631  8614 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:12.551023  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:12.551605  2301 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:00:12.552930  1654 leader_election.cc:336] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 1.631s (SENT)
I20260709 13:00:12.553463  1654 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:12.555289  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:12.549002  1536 rpcz_store.cc:276] 0709 13:00:11.033366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.661313 (+627947us) service_pool.cc:224] Handling call
0709 13:00:11.682334 (+ 21021us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.682582 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:00:11.738095 (+ 55513us) log.cc:844] Serialized 14 byte log entry
0709 13:00:12.470439 (+732344us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:12.470485 (+    46us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:12.470531 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.470593 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.470699 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3923,"prepare.queue_time_us":55345,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":3548,"raft.queue_time_us":65509,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":97,"thread_start_us":728061,"threads_started":1,"wal-append.queue_time_us":803594}
I20260709 13:00:12.541131  8637 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:12.541528  8050 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.561385  8050 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:12.561223  8675 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:00:12.183584  8524 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:00:12.565403  8551 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:12.472908  1684 rpcz_store.cc:276] 0709 13:00:11.403217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.405363 (+  2146us) service_pool.cc:224] Handling call
0709 13:00:11.405717 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.406056 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.406081 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.406500 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 13:00:11.626590 (+220090us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:11.626631 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.626710 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:12.472327 (+845617us) raft_consensus.cc:1685] finished
0709 13:00:12.472345 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.472447 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3734,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":116,"thread_start_us":219693,"threads_started":1,"wal-append.queue_time_us":448561}
I20260709 13:00:12.566226  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:12.566617  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:12.567951  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:12.568850  2269 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:12.565837  8524 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:12.570366  2269 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:12.480748  1537 rpcz_store.cc:276] 0709 13:00:08.801178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.211004 (+2409826us) service_pool.cc:224] Handling call
0709 13:00:11.249544 (+ 38540us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.307015 (+ 57471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.307048 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.322122 (+ 15074us) log.cc:844] Serialized 26 byte log entry
0709 13:00:11.700825 (+378703us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:11.700864 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.700929 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:12.473895 (+772966us) raft_consensus.cc:1685] finished
0709 13:00:12.473915 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.474044 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":57607,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":10083,"thread_start_us":339904,"threads_started":1,"wal-append.queue_time_us":679818}
W20260709 13:00:12.480969  1505 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.025s	sys 0.034s
W20260709 13:00:12.572207  1505 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.025s	sys 0.034s
W20260709 13:00:12.572541  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 658331us
I20260709 13:00:12.575078  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:12.576450  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 13:00:12.576903  8677 log.cc:927] Time spent T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.272s	user 0.000s	sys 0.000s
I20260709 13:00:12.541664  8612 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:12.577244  1535 raft_consensus.cc:2393] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 14: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:12.578225  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:12.578758  1535 raft_consensus.cc:2376] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 21. Re-sending same reply.
I20260709 13:00:12.578886  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:12.579609  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:12.580035  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:11.852658  2294 rpcz_store.cc:276] 0709 13:00:07.407613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.410792 (+  3179us) service_pool.cc:224] Handling call
0709 13:00:08.016060 (+605268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:08.340938 (+324878us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:00:08.344610 (+  3672us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:08.410176 (+ 65566us) log.cc:844] Serialized 26 byte log entry
0709 13:00:08.780705 (+370529us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:00:08.780749 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.677913 (+2897164us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b5400277754. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:11.682809 (+  4896us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:11.696975 (+ 14166us) raft_consensus.cc:1685] finished
0709 13:00:11.696995 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:11.799129 (+102134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13348,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":13547,"spinlock_wait_cycles":420653568,"thread_start_us":232306,"threads_started":1,"wal-append.queue_time_us":517761,"wal-append.run_cpu_time_us":1661,"wal-append.run_wall_time_us":1001688}
I20260709 13:00:11.972963  8282 consensus_queue.cc:1059] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.496s
I20260709 13:00:12.493321  1610 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:12.365726  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:12.521620  1608 rpcz_store.cc:276] 0709 13:00:11.370833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.380135 (+  9302us) service_pool.cc:224] Handling call
0709 13:00:12.450108 (+1069973us) spinlock_profiling.cc:243] Waited 52.6 ms on lock 0x7b5400065ed4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:12.450231 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120921472}
I20260709 13:00:12.594301  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:12.474766  8670 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:12.525894  8626 raft_consensus.cc:3055] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:12.591554  8637 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:12.528301  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4454) took 1496 ms. Trace:
W20260709 13:00:12.530967  2298 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32794 (request call id 940) took 1384 ms (client timeout 1787 ms). Trace:
I20260709 13:00:12.531646  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:12.521304  8125 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:12.532670  8290 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:12.536507  8671 log.cc:927] Time spent T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:00:12.536800  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:12.455346  8392 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:12.519522  8633 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:00:12.546137  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:12.225102  8678 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:12.547134  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:12.547338  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:12.609336  2297 raft_consensus.cc:2393] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 21: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:12.609061  1682 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
I20260709 13:00:12.609431  1615 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:12.569128  1684 raft_consensus.cc:2410] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:00:12.580348  1535 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 13:00:12.581202  8524 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:00:12.581470  2299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32788 (request call id 625) took 1252 ms. Trace:
I20260709 13:00:12.582121  1689 raft_consensus.cc:2393] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 22: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:12.583688  8651 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:12.565481  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:12.586310  1688 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 13:00:12.544982  8605 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:12.710350  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3812) took 1313 ms. Trace:
I20260709 13:00:12.590854  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:12.711694  1533 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 13:00:12.596181  8670 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:12.591450  1691 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:12.555912  8606 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.449120  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:12.722108  1615 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 21.
W20260709 13:00:12.723268  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.594590  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:12.595171  1608 raft_consensus.cc:2393] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 20: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 13:00:12.582144  8679 log.cc:927] Time spent T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.228s	user 0.000s	sys 0.000s
I20260709 13:00:12.596896  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:12.464605  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 356559us
W20260709 13:00:12.725328  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.528445  8373 consensus_queue.cc:237] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:12.599483  2298 rpcz_store.cc:269] 0709 13:00:11.146527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.147908 (+  1381us) service_pool.cc:224] Handling call
0709 13:00:12.530759 (+1382851us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b54002d82d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:12.530906 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":598680448}
W20260709 13:00:12.483436  1686 consensus_meta.cc:287] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.598s	user 0.007s	sys 0.000s
I20260709 13:00:12.729450  1686 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 17.
I20260709 13:00:12.729794  1537 raft_consensus.cc:2393] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 19: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:12.730116  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33206 (request call id 998) took 1195 ms. Trace:
I20260709 13:00:12.730489  1686 rpcz_store.cc:276] 0709 13:00:11.535032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.850049 (+315017us) service_pool.cc:224] Handling call
0709 13:00:12.730051 (+880002us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:12.731575  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:12.732131  1686 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:12.600423  1542 rpcz_store.cc:276] 0709 13:00:11.032175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.594724 (+562549us) service_pool.cc:224] Handling call
0709 13:00:11.595070 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.896457 (+301387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.896510 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.972639 (+ 76129us) log.cc:844] Serialized 26 byte log entry
0709 13:00:12.254492 (+281853us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:12.254536 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.254613 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:12.527946 (+273333us) raft_consensus.cc:1685] finished
0709 13:00:12.527970 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.528169 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24347,"raft.queue_time_us":299450,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":109831,"thread_start_us":493033,"threads_started":2,"wal-append.queue_time_us":508722}
I20260709 13:00:12.735204  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:12.735796  1542 raft_consensus.cc:2376] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 21. Re-sending same reply.
I20260709 13:00:12.736693  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:12.737387  1542 raft_consensus.cc:2393] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 22: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:12.737727  8503 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.738149  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:12.738370  8503 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:12.601678  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:12.739567  1690 raft_consensus.cc:2393] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 14: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:12.740391  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:12.741163  1690 raft_consensus.cc:2393] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 18: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 13:00:12.601660  1507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.007s	sys 0.006s
I20260709 13:00:12.741918  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:12.743089  1690 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 13:00:12.743882  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:12.744645  1690 raft_consensus.cc:2410] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:00:12.745033  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33206 (request call id 1001) took 1182 ms. Trace:
I20260709 13:00:12.745311  1690 rpcz_store.cc:276] 0709 13:00:11.562761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.743672 (+1180911us) service_pool.cc:224] Handling call
0709 13:00:12.744985 (+  1313us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:12.742556  1507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.007s	sys 0.006s
W20260709 13:00:12.747540  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 863322us
W20260709 13:00:12.754437  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.754021  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:12.764807  1686 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 13:00:12.766028  1686 raft_consensus.cc:1240] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:12.768599  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3813) took 1360 ms. Trace:
I20260709 13:00:12.769138  1686 rpcz_store.cc:276] 0709 13:00:11.408026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.765576 (+1357550us) service_pool.cc:224] Handling call
0709 13:00:12.765865 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.766393 (+   528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.768449 (+  2056us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:12.773643  8401 tablet_bootstrap.cc:492] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 13:00:12.775673  1615 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 15.
I20260709 13:00:12.776638  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 978) took 1016 ms. Trace:
I20260709 13:00:12.776737  8682 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:12.777655  8682 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:12.780853  8684 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:12.781774  8684 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:12.598866  8626 raft_consensus.cc:740] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:12.598965  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:12.637362  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:12.597832  8641 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:12.827165  1536 raft_consensus.cc:2393] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 25: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:12.827874  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:12.828832  1682 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:00:12.577322  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:12.710395  2297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32794 (request call id 942) took 1553 ms. Trace:
I20260709 13:00:12.712744  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:12.588136  8620 consensus_queue.cc:260] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:12.709818  8646 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:12.713812  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:12.589709  2269 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:12.710825  1683 rpcz_store.cc:276] 0709 13:00:11.396739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.396879 (+   140us) service_pool.cc:224] Handling call
0709 13:00:11.797050 (+400171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.828247 (+ 31197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.710141 (+881894us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b540008e8d0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:12.710285 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":919614336}
I20260709 13:00:12.674355  2299 rpcz_store.cc:276] 0709 13:00:11.329202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.329590 (+   388us) service_pool.cc:224] Handling call
0709 13:00:12.262513 (+932923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.370553 (+108040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.581256 (+210703us) spinlock_profiling.cc:243] Waited 933 ms on lock 0x7b54007201d0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:12.581393 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2144953088}
I20260709 13:00:12.716977  1541 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 13:00:12.738929  1542 raft_consensus.cc:2393] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 18: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:12.602479  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:12.846843  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 4593) took 1335 ms. Trace:
I20260709 13:00:12.847227  1687 rpcz_store.cc:276] 0709 13:00:11.511885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.602226 (+1090341us) service_pool.cc:224] Handling call
0709 13:00:12.846776 (+244550us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:12.848803  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4592) took 1360 ms. Trace:
I20260709 13:00:12.849164  1687 rpcz_store.cc:276] 0709 13:00:11.488685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.847940 (+1359255us) service_pool.cc:224] Handling call
0709 13:00:12.848240 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.848429 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:12.848454 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:12.848525 (+    71us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:12.848566 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.848620 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.848746 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:12.850656  1687 raft_consensus.cc:1240] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: [13.14-15.15]
I20260709 13:00:12.851269  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4594) took 1311 ms. Trace:
I20260709 13:00:12.851608  1687 rpcz_store.cc:276] 0709 13:00:11.540031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.850081 (+1310050us) service_pool.cc:224] Handling call
0709 13:00:12.850412 (+   331us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:12.851005 (+   593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.851212 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:12.742456  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4452) took 1711 ms. Trace:
W20260709 13:00:12.792587  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 64129.6us
I20260709 13:00:12.723006  8670 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:12.741210  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:12.859979  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.854058  1540 rpcz_store.cc:276] 0709 13:00:11.030984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.578473 (+547489us) service_pool.cc:224] Handling call
0709 13:00:11.589830 (+ 11357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.618906 (+ 29076us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.618941 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.619548 (+   607us) log.cc:844] Serialized 26 byte log entry
0709 13:00:12.142254 (+522706us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:12.142309 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.142401 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:12.742207 (+599806us) raft_consensus.cc:1685] finished
0709 13:00:12.742229 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.742391 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41284,"raft.queue_time_us":253771,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":5092,"thread_start_us":498677,"threads_started":1,"wal-append.queue_time_us":591410}
I20260709 13:00:12.804924  2301 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:12.777101  1615 rpcz_store.cc:276] 0709 13:00:11.760281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.753762 (+993481us) service_pool.cc:224] Handling call
0709 13:00:12.776530 (+ 22768us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:12.807545  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 525543us
I20260709 13:00:12.822355  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:12.831583  2297 rpcz_store.cc:276] 0709 13:00:11.156853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.157004 (+   151us) service_pool.cc:224] Handling call
0709 13:00:12.531495 (+1374491us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b5800003c98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc8620170a0 00007fc862016984 00007fc85b5916d4 00007fc85b591662
0709 13:00:12.710314 (+178819us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7764352}
I20260709 13:00:12.831897  1533 raft_consensus.cc:2376] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20. Re-sending same reply.
I20260709 13:00:12.713070  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:12.608340  1583 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:12.837966  1691 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 15.
W20260709 13:00:12.794680  1654 leader_election.cc:336] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 1.874s (SENT)
I20260709 13:00:12.866221  1654 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:12.860273  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 985) took 1098 ms. Trace:
W20260709 13:00:12.723697  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 290652us
I20260709 13:00:12.867103  1608 rpcz_store.cc:276] 0709 13:00:11.762105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.740930 (+978825us) service_pool.cc:224] Handling call
0709 13:00:12.860204 (+119274us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:12.863883  1655 leader_election.cc:336] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.682s (SENT)
I20260709 13:00:12.869774  1655 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:12.868263  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4595) took 1327 ms. Trace:
I20260709 13:00:12.873144  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 3714) took 1026 ms. Trace:
I20260709 13:00:12.870538  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:12.875025  1608 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 27.
I20260709 13:00:12.875594  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 977) took 1115 ms. Trace:
I20260709 13:00:12.876044  1608 rpcz_store.cc:276] 0709 13:00:11.759998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.870236 (+1110238us) service_pool.cc:224] Handling call
0709 13:00:12.875515 (+  5279us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:12.868600  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:12.807694  8678 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:12.712119  8282 consensus_queue.cc:1048] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.144s
W20260709 13:00:12.901901  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 107346us
I20260709 13:00:12.877072  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:12.904079  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 13:00:12.875583  1582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.015s	sys 0.036s
I20260709 13:00:12.919082  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:12.968030  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:13.016613  1535 raft_consensus.cc:2393] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 26: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:12.873631  1610 rpcz_store.cc:276] 0709 13:00:11.846799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.811580 (+964781us) service_pool.cc:224] Handling call
0709 13:00:12.873053 (+ 61473us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:12.871496  1687 rpcz_store.cc:276] 0709 13:00:11.540352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.852358 (+1312006us) service_pool.cc:224] Handling call
0709 13:00:12.867738 (+ 15380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.867930 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:12.867956 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:12.867998 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:12.868035 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.868088 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.868205 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:12.819841  8125 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:12.971002  1533 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:12.979192  8547 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:13.018405  8547 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:13.018893  8547 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:12.817785  8601 consensus_queue.cc:1059] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.087s
W20260709 13:00:12.972642  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 364371us
I20260709 13:00:12.968055  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:12.974658  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:12.975792  1537 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:12.876784  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:13.025965  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 3720) took 1172 ms. Trace:
I20260709 13:00:13.026306  1615 rpcz_store.cc:276] 0709 13:00:11.853085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.876508 (+1023423us) service_pool.cc:224] Handling call
0709 13:00:13.025903 (+149395us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:12.877630  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:12.981679  8651 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:00:12.978927  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 389285us
W20260709 13:00:13.032292  2269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.992744  8613 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:12.979911  8588 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:13.036087  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:13.040928  8588 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:13.041344  8588 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.041679  8588 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:00:13.043882  8517 consensus_meta.cc:287] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.671s	user 0.004s	sys 0.003s
I20260709 13:00:12.807847  8606 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:13.044413  8552 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.044919  8552 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:13.046177  8606 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:13.048043  1617 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 16.
I20260709 13:00:12.858866  8633 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.054149  1542 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 13:00:12.831569  8630 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:12.991348  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:12.918955  8682 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:12.965904  8551 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:00:13.056708  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:13.057462  1540 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 19.
W20260709 13:00:13.058128  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 1.1462e+06us
I20260709 13:00:13.035893  8050 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:13.030320  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:12.978542  8675 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:12.903748  8503 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:13.033483  2269 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:13.034832  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:13.035454  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:13.068763  1536 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 13:00:13.069792  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:13.068288  1538 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:13.066234  1610 raft_consensus.cc:2393] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 21: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:13.077237  2269 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:13.035204  8614 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:13.037134  8392 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:13.046347  8669 log.cc:927] Time spent T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 1.007s	user 0.000s	sys 0.008s
I20260709 13:00:12.989274  1682 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:13.080688  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1010) took 1434 ms. Trace:
I20260709 13:00:13.081032  1682 rpcz_store.cc:276] 0709 13:00:11.645887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.079847 (+1433960us) service_pool.cc:224] Handling call
0709 13:00:13.080175 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:13.080353 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:13.080375 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:13.080415 (+    40us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:13.080452 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.080527 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.080633 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:13.082448  8533 consensus_meta.cc:287] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.706s	user 0.008s	sys 0.000s
I20260709 13:00:13.082621  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1013) took 1199 ms. Trace:
I20260709 13:00:13.082933  1682 rpcz_store.cc:276] 0709 13:00:11.883133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.081855 (+1198722us) service_pool.cc:224] Handling call
0709 13:00:13.082159 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:13.082335 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:13.082358 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:13.082396 (+    38us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:13.082423 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.082476 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.082572 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:13.084137  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:13.085412  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3625) took 1672 ms. Trace:
I20260709 13:00:13.085812  1611 rpcz_store.cc:276] 0709 13:00:11.414261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.414714 (+   453us) service_pool.cc:224] Handling call
0709 13:00:11.415087 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.417842 (+  2755us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.417873 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.418340 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:00:11.652379 (+234039us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:00:11.678438 (+ 26059us) log.cc:844] Serialized 14 byte log entry
0709 13:00:11.678690 (+   252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.678770 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:13.045760 (+1366990us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 13:00:13.085133 (+ 39373us) raft_consensus.cc:1685] finished
0709 13:00:13.085223 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.085336 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2376,"prepare.queue_time_us":29362,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":7034,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":4524,"spinlock_wait_cycles":3638016,"thread_start_us":233646,"threads_started":1,"wal-append.queue_time_us":555022}
I20260709 13:00:13.084394  1682 raft_consensus.cc:1275] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:13.088802  1682 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:13.089327  8547 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:13.059540  8613 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:13.091993  8613 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:13.092731  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:13.093134  8637 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:13.093441  1682 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 22.
I20260709 13:00:13.033495  8039 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:13.095120  8687 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:13.096081  8687 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:13.097970  8050 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:13.098745  8050 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:13.099197  8050 raft_consensus.cc:697] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:13.031118  1583 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:13.061626  1612 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 16.
I20260709 13:00:13.065599  8684 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:13.060599  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:13.104346  1535 raft_consensus.cc:2393] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 7: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:12.998775  8685 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.095024  1537 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 19.
I20260709 13:00:13.099429  2303 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 21.
I20260709 13:00:13.065171  1615 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:00:13.029771  1533 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 16.
I20260709 13:00:13.107617  1536 raft_consensus.cc:2410] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:00:13.108292  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:13.110716  1533 raft_consensus.cc:2376] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 21. Re-sending same reply.
I20260709 13:00:13.112344  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:13.112713  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:13.115273  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 86848.4us
I20260709 13:00:13.119511  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:13.122893  2301 raft_consensus.cc:2393] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 15: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:13.019268  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1009) took 1382 ms. Trace:
I20260709 13:00:12.966224  8678 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:13.062180  8700 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:13.130800  1655 leader_election.cc:336] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.552s (SENT)
I20260709 13:00:13.125000  1687 rpcz_store.cc:276] 0709 13:00:11.636509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.018030 (+1381521us) service_pool.cc:224] Handling call
0709 13:00:13.018498 (+   468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:13.018766 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:13.018808 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:13.018869 (+    61us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:13.018925 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.018998 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.019182 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:13.112301  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 3717) took 1263 ms. Trace:
I20260709 13:00:13.104417  1538 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 21.
I20260709 13:00:13.134330  1610 rpcz_store.cc:276] 0709 13:00:11.848760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.017332 (+1168572us) service_pool.cc:224] Handling call
0709 13:00:13.112224 (+ 94892us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:13.127498  1615 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 28.
I20260709 13:00:13.135509  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 987) took 1372 ms. Trace:
I20260709 13:00:12.972502  8626 consensus_queue.cc:260] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:13.131981  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:13.117704  1583 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:13.135824  1615 rpcz_store.cc:276] 0709 13:00:11.762589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.030045 (+1267456us) service_pool.cc:224] Handling call
0709 13:00:13.135453 (+105408us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:13.136593  1542 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:00:13.136030  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:13.139710  1535 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 13.
I20260709 13:00:13.138949  2297 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 22.
I20260709 13:00:13.143177  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4588) took 1732 ms. Trace:
W20260709 13:00:13.134223  8612 consensus_meta.cc:287] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.557s	user 0.006s	sys 0.003s
I20260709 13:00:13.133194  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4587) took 1725 ms. Trace:
I20260709 13:00:13.106292  8699 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.123826  8282 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:13.146471  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:13.100091  8050 consensus_queue.cc:237] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:13.105175  8685 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:13.064546  8633 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:13.150316  1690 rpcz_store.cc:276] 0709 13:00:11.407572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.745913 (+1338341us) service_pool.cc:224] Handling call
0709 13:00:12.746201 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.746398 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:00:12.871115 (+124717us) log.cc:844] Serialized 14 byte log entry
0709 13:00:13.132686 (+261571us) log.cc:844] Serialized 14 byte log entry
0709 13:00:13.132866 (+   180us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:13.132908 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:13.132955 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.133016 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.133139 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":269787,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":180,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":6167,"spinlock_wait_cycles":17873664,"thread_start_us":384907,"threads_started":2}
I20260709 13:00:13.171383  1615 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 19: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:13.184273  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 974) took 1485 ms. Trace:
I20260709 13:00:13.184687  1615 rpcz_store.cc:276] 0709 13:00:11.699291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.146226 (+1446935us) service_pool.cc:224] Handling call
0709 13:00:13.184204 (+ 37978us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:13.185930  1615 raft_consensus.cc:1240] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:00:13.186612  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 982) took 1425 ms. Trace:
I20260709 13:00:13.186928  1615 rpcz_store.cc:276] 0709 13:00:11.761368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.185336 (+1423968us) service_pool.cc:224] Handling call
0709 13:00:13.185697 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:13.186287 (+   590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.186554 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:13.141752  2295 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 19: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
W20260709 13:00:13.136955  1655 leader_election.cc:336] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.589s (SENT)
I20260709 13:00:13.191040  1655 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:13.191972  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 55047us
I20260709 13:00:13.195242  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 983) took 1428 ms. Trace:
I20260709 13:00:13.195293  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 981) took 1434 ms. Trace:
W20260709 13:00:13.192997  1655 leader_election.cc:336] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.754s (SENT)
I20260709 13:00:13.142396  8692 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:13.195992  1612 rpcz_store.cc:276] 0709 13:00:11.761094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.870033 (+1108939us) service_pool.cc:224] Handling call
0709 13:00:13.195122 (+325089us) spinlock_profiling.cc:243] Waited 36.4 ms on lock 0x7b54002576d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:13.195236 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83815808}
I20260709 13:00:13.196830  1655 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:13.257604  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 64641.1us
I20260709 13:00:13.195880  1615 rpcz_store.cc:276] 0709 13:00:11.761620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.187740 (+1426120us) service_pool.cc:224] Handling call
0709 13:00:13.189289 (+  1549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:13.189621 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:13.189672 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:13.189717 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:13.189755 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.189814 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.189950 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:13.173933  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 268786us
W20260709 13:00:13.227304  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.259467  1508 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:13.266258  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:13.267015  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.170939  8282 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.271943  1608 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 26.
I20260709 13:00:13.151544  8691 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:13.274282  1508 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:13.191354  8626 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:00:13.269886  1655 leader_election.cc:336] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.786s (SENT)
I20260709 13:00:13.276175  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:13.282691  1655 leader_election.cc:336] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.837s (SENT)
I20260709 13:00:13.283182  1655 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:13.283110  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:13.196619  8646 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.286296  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:13.173103  8612 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:13.287091  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:13.256762  8690 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.256179  8613 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:13.290208  1684 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:00:13.288897  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 141261us
I20260709 13:00:13.275733  8282 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:13.270776  8630 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:13.139904  8700 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:13.293787  8614 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:00:13.294067  1655 leader_election.cc:336] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.872s (SENT)
W20260709 13:00:13.299180  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:13.297060  2302 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32802 (request call id 689) took 1503 ms (client timeout 1754 ms). Trace:
I20260709 13:00:13.276329  8691 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.269593  8125 raft_consensus.cc:697] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:13.275214  8503 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:00:13.268854  8682 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:13.350819  1609 raft_consensus.cc:2368] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15.
I20260709 13:00:13.350119  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:13.289103  8710 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:13.311193  2302 rpcz_store.cc:269] 0709 13:00:11.793639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.265259 (+1471620us) service_pool.cc:224] Handling call
0709 13:00:13.296995 (+ 31736us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:13.272881  8492 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.292925  1508 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:13.318799  2269 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:13.296268  8373 consensus_queue.cc:1059] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:00:13.322978  1611 raft_consensus.cc:1275] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:00:13.402115  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 969) took 1752 ms. Trace:
I20260709 13:00:13.402627  1617 rpcz_store.cc:276] 0709 13:00:11.649551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.654047 (+  4496us) service_pool.cc:224] Handling call
0709 13:00:13.401912 (+1747865us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54002a67d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:13.402041 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3198135040}
W20260709 13:00:13.404076  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 103889us
I20260709 13:00:13.307999  8690 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:13.177398  8699 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:13.319731  1684 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 26.
I20260709 13:00:13.411376  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:13.298416  8715 consensus_queue.cc:1048] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:00:13.407691  8710 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:13.331920  8670 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:13.414223  8710 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:13.346721  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:13.326838  8687 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:13.358667  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:13.361419  1687 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:00:13.391170  8628 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.326192  8691 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:13.327929  8633 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:13.382121  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:13.392081  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 132815us
W20260709 13:00:13.348460  8524 consensus_meta.cc:287] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.634s	user 0.006s	sys 0.001s
I20260709 13:00:13.299275  8684 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:13.395349  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:13.451110  1542 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 13:00:13.396207  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:13.452700  1535 raft_consensus.cc:2410] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
W20260709 13:00:13.399814  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 106981us
I20260709 13:00:13.453953  1508 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:13.330155  8700 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:13.415220  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 3715) took 1553 ms. Trace:
I20260709 13:00:13.348637  8685 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:13.455989  1611 rpcz_store.cc:276] 0709 13:00:11.847996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.322166 (+1474170us) service_pool.cc:224] Handling call
0709 13:00:13.322563 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:13.400569 (+ 78006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.400845 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:13.416280  1684 raft_consensus.cc:2393] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 17: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:13.299875  8646 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:13.423434  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3628) took 2007 ms. Trace:
W20260709 13:00:13.460657  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 490243us
I20260709 13:00:13.461993  2267 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:13.463970  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.466765  1507 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:13.311272  1655 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:13.427413  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:13.469774  1538 raft_consensus.cc:2410] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
W20260709 13:00:13.430047  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 93963.2us
W20260709 13:00:13.472261  1691 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33206 (request call id 1003) took 1899 ms (client timeout 2077 ms). Trace:
W20260709 13:00:13.472666  1691 rpcz_store.cc:269] 0709 13:00:11.572593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.362164 (+789571us) service_pool.cc:224] Handling call
0709 13:00:13.472100 (+1109936us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b5400389d54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:13.472206 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":510310784}
W20260709 13:00:13.474927  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 180890us
I20260709 13:00:13.475513  2269 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:13.431818  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:13.440423  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:13.441282  1536 raft_consensus.cc:1240] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:13.428434  8714 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:00:13.425871  8605 consensus_meta.cc:287] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.703s	user 0.010s	sys 0.000s
I20260709 13:00:13.443967  8716 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:13.480122  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:13.480865  1537 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 19: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 13:00:13.475706  1655 leader_election.cc:336] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.892s (SENT)
I20260709 13:00:13.459329  1613 rpcz_store.cc:276] 0709 13:00:11.416229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.423028 (+  6799us) service_pool.cc:224] Handling call
0709 13:00:11.423292 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:11.440135 (+ 16843us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:00:11.449894 (+  9759us) log.cc:844] Serialized 14 byte log entry
0709 13:00:11.583050 (+133156us) spinlock_profiling.cc:243] Waited 8.03 ms on lock 0x7b18002d75a0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf123a 00007fc85d05ba2a
0709 13:00:11.895491 (+312441us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:11.895542 (+    51us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:11.895589 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.423140 (+1527551us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b5400444b54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:13.423201 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.423346 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5021,"prepare.queue_time_us":9574,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"raft.queue_time_us":5456,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":107440,"spinlock_wait_cycles":56691456,"thread_start_us":307137,"threads_started":1,"wal-append.queue_time_us":737916}
I20260709 13:00:13.484108  1655 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:13.408881  8492 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:13.389633  8682 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:13.443539  8601 raft_consensus.cc:3055] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:13.490160  8601 raft_consensus.cc:740] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:13.490459  1533 raft_consensus.cc:2410] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
W20260709 13:00:13.488063  1655 leader_election.cc:336] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.908s (SENT)
I20260709 13:00:13.486361  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:13.493448  1655 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:13.482596  1656 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:13.494473  1690 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:13.484608  8710 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:13.491223  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
W20260709 13:00:13.536684  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 61254.4us
I20260709 13:00:13.491530  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:13.491568  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:13.491943  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:13.484840  8605 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:13.441777  8628 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:13.479717  8716 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.449818  8524 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:13.607359  1540 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:00:13.496305  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:13.506247  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:13.610491  2297 raft_consensus.cc:2393] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 17: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:13.476620  8503 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.538064  1505 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:13.538390  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 55847.9us
I20260709 13:00:13.538422  1538 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 17.
W20260709 13:00:13.539258  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 51230.6us
I20260709 13:00:13.501399  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:13.544834  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:13.551390  8614 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:00:13.497941  8708 log.cc:927] Time spent T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:00:13.555825  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:13.477252  8714 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:13.507282  8630 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:00:13.471628  8125 consensus_queue.cc:237] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:13.640412  8699 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:13.641127  8699 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:13.590246  8612 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:13.556104  2298 raft_consensus.cc:2393] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 28: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:13.488219  8697 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:00:13.590854  8290 consensus_meta.cc:287] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.973s	user 0.010s	sys 0.001s
I20260709 13:00:13.591276  8282 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:13.592207  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4589) took 2178 ms. Trace:
I20260709 13:00:13.592331  8605 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:13.592724  8644 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:13.506454  8601 consensus_queue.cc:260] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:13.627801  8614 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.492654  8687 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:13.592818  2299 raft_consensus.cc:1240] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:13.459290  8633 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.056s
I20260709 13:00:13.495210  8702 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:00:13.597441  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 135518us
I20260709 13:00:13.603384  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:13.676791  1687 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:13.621583  1656 leader_election.cc:336] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Timed out: RequestConsensusVote RPC to 127.0.107.196:33437 timed out after 1.552s (SENT)
W20260709 13:00:13.625121  1655 leader_election.cc:336] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.035s (SENT)
I20260709 13:00:13.679785  1655 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:13.680810  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 55727.5us
W20260709 13:00:13.629142  8704 log.cc:927] Time spent T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.134s	user 0.002s	sys 0.000s
W20260709 13:00:13.681438  8588 consensus_meta.cc:287] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.639s	user 0.011s	sys 0.001s
I20260709 13:00:13.628409  1537 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:00:13.681906  8588 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:13.682613  8637 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:13.651573  8697 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:13.636425  2296 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 23.
I20260709 13:00:13.639355  8714 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:13.601367  8715 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:13.690182  8715 raft_consensus.cc:697] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 15 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:13.690732  8601 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:13.691097  8715 consensus_queue.cc:237] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:13.628389  1540 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 28.
I20260709 13:00:13.611333  8713 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:00:13.652304  1535 raft_consensus.cc:1240] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:00:13.694320  8492 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:13.657446  1683 rpcz_store.cc:276] 0709 13:00:11.413663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.844954 (+1431291us) service_pool.cc:224] Handling call
0709 13:00:12.845289 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:12.845655 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:12.845697 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:12.858895 (+ 13198us) log.cc:844] Serialized 26 byte log entry
0709 13:00:13.391557 (+532662us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:13.391599 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.391674 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:13.592001 (+200327us) raft_consensus.cc:1685] finished
0709 13:00:13.592031 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.592150 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8121,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":47034,"thread_start_us":396989,"threads_started":1,"wal-append.queue_time_us":546624}
I20260709 13:00:13.593258  8684 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.694964  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 984) took 1933 ms. Trace:
I20260709 13:00:13.695433  1612 rpcz_store.cc:276] 0709 13:00:11.761869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.269966 (+1508097us) service_pool.cc:224] Handling call
0709 13:00:13.290419 (+ 20453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:13.290783 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:13.290813 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:13.313534 (+ 22721us) log.cc:844] Serialized 26 byte log entry
0709 13:00:13.484936 (+171402us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:00:13.484974 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.485041 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:13.694760 (+209719us) raft_consensus.cc:1685] finished
0709 13:00:13.694783 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.694904 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":431,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":15726,"thread_start_us":74005,"threads_started":1,"wal-append.queue_time_us":235022}
I20260709 13:00:13.659899  1438 catalog_manager.cc:5697] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:13.652943  8682 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:13.679659  1656 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:13.683944  8282 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:13.610984  8716 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:13.639108  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:13.714183  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:13.681407  1655 leader_election.cc:336] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.110s (SENT)
W20260709 13:00:13.715806  1655 leader_election.cc:336] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.124s (SENT)
I20260709 13:00:13.682614  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:13.627526  8503 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:13.673004  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:13.717666  2298 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 18.
I20260709 13:00:13.700296  2267 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:13.716261  1655 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:13.720753  2267 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:13.673162  8678 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:13.671068  8614 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:13.660125  8646 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:13.711325  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:13.712987  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 91426.7us
I20260709 13:00:13.684424  8697 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:13.709954  1438 catalog_manager.cc:5697] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 12 to 13, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:13.708336  8492 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.731838  1683 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:00:13.727842  8290 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:13.732896  8290 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.733269  8290 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:13.735420  8628 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:13.675484  8687 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:13.739256  1690 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:13.714063  8702 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:00:13.725804  1655 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:13.744108  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.739385  8492 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:13.738067  1615 raft_consensus.cc:1240] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:13.741370  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:13.742458  1533 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 21.
I20260709 13:00:13.706087  1687 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 13:00:13.725168  8713 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:13.767827  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:13.776178  1683 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 21.
I20260709 13:00:13.777037  8617 consensus_queue.cc:1059] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:00:13.778465  8290 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:13.781549  8290 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:13.789995  8687 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:13.794982  8644 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:13.726500  8718 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:13.731058  2294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32802 (request call id 685) took 1938 ms. Trace:
I20260709 13:00:13.798198  8703 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:00:13.770213  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 44489.6us
I20260709 13:00:13.900177  1655 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:13.900765  2302 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:13.901453  1655 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:13.902892  1655 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:13.821964  8503 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:13.773989  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:13.773355  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 988) took 2010 ms. Trace:
I20260709 13:00:13.905975  1615 rpcz_store.cc:276] 0709 13:00:11.762852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.269108 (+1506256us) service_pool.cc:224] Handling call
0709 13:00:13.269413 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:13.737869 (+468456us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b5400438620. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85cfc8dc0 00007fc85d0531c0 00007fc85d054231 00007fc85d050d8f 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c
0709 13:00:13.773108 (+ 35239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.773299 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8519424}
I20260709 13:00:13.828675  2269 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
W20260709 13:00:13.907217  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 78656.8us
I20260709 13:00:13.815711  8714 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:13.708662  8684 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:13.868629  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.772936  8630 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:00:13.894898  1616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 980) took 2134 ms (client timeout 1723 ms). Trace:
W20260709 13:00:13.913321  1616 rpcz_store.cc:269] 0709 13:00:11.760834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.841137 (+ 80303us) service_pool.cc:224] Handling call
0709 13:00:13.894637 (+2053500us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b5400122854. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:13.894807 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1269649664}
W20260709 13:00:13.896328  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 358361us
I20260709 13:00:13.916220  1505 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:13.908039  1655 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:13.919145  1505 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:13.888356  8653 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:13.911368  8626 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:00:13.910398  8637 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:00:13.936221  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 333236us
I20260709 13:00:13.910591  8718 raft_consensus.cc:697] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:13.921954  1505 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:13.916646  8290 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:13.947041  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:13.923326  8678 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:13.927175  8653 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:13.964390  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:13.925714  8682 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:00:13.968847  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 46970.2us
I20260709 13:00:13.915704  8611 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.034s
I20260709 13:00:13.910693  8691 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:14.016973  1508 leader_election.cc:336] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 1.608s (SENT)
I20260709 13:00:14.035465  1508 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:13.920909  8503 consensus_queue.cc:1048] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:00:13.970965  8290 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.924888  8710 raft_consensus.cc:697] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:14.037284  8290 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:14.037917  8710 consensus_queue.cc:237] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:14.040424  8681 log.cc:927] Time spent T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 1.566s	user 0.004s	sys 0.008s
I20260709 13:00:14.036981  8691 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:14.040169  1608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 3722) took 2184 ms (client timeout 2662 ms). Trace:
W20260709 13:00:14.043826  1608 rpcz_store.cc:269] 0709 13:00:11.855781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.876834 (+1021053us) service_pool.cc:224] Handling call
0709 13:00:14.039981 (+1163147us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b54002fe254. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:14.040106 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":842373376}
I20260709 13:00:13.143563  1686 rpcz_store.cc:276] 0709 13:00:11.410573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.770121 (+1359548us) service_pool.cc:224] Handling call
0709 13:00:12.770681 (+   560us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.771003 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:00:13.008654 (+237651us) log.cc:844] Serialized 14 byte log entry
0709 13:00:13.142827 (+134173us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:13.142888 (+    61us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:13.142941 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.143003 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.143125 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":307948,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":96,"thread_start_us":370896,"threads_started":2}
I20260709 13:00:13.949729  8626 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.032586  2302 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 26.
W20260709 13:00:14.033071  8727 log.cc:927] Time spent T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:00:13.944257  8699 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.033363  2300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32802 (request call id 690) took 2239 ms. Trace:
I20260709 13:00:13.994874  1683 raft_consensus.cc:2393] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 20: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:13.944939  8630 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:13.973242  8678 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:14.025336  1505 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:14.055441  2300 rpcz_store.cc:276] 0709 13:00:11.793888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.615312 (+821424us) service_pool.cc:224] Handling call
0709 13:00:12.615571 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.903305 (+287734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:12.903337 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:12.903377 (+    40us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:12.903417 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.033122 (+1129705us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b54005d02d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:14.033168 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.033308 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":661303680}
W20260709 13:00:14.023138  1581 connection.cc:256] RPC call timeout handler was delayed by -1.5544171669999969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
W20260709 13:00:14.061509  1581 connection.cc:256] RPC call timeout handler was delayed by -1.4977171670000189s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1666s for a response
W20260709 13:00:14.062402  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.971980  8716 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:14.017104  8729 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:00:14.071764  1581 connection.cc:256] RPC call timeout handler was delayed by -1.1548171669999761s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20470000000000002s for a response
I20260709 13:00:14.072762  1583 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 13:00:14.072942  1508 leader_election.cc:336] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 1.681s (SENT)
I20260709 13:00:14.077013  1508 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:14.078361  1581 connection.cc:256] RPC call timeout handler was delayed by -1.056717166999988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2156s for a response
I20260709 13:00:14.079291  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 13:00:14.073668  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 48441.5us
I20260709 13:00:14.057258  8713 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:14.090485  1686 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:00:14.065258  8678 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:14.058568  8503 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:00:14.068944  8673 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:14.054589  8626 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:14.105983  2301 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 22. Current term is 23. Ops: []
I20260709 13:00:14.097818  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:14.063709  8630 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:14.076208  8588 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:14.125069  1684 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 16.
I20260709 13:00:14.086894  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:14.132086  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:14.133706  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 225762us
I20260709 13:00:14.092126  8282 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:14.134537  1535 raft_consensus.cc:2376] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 19. Re-sending same reply.
I20260709 13:00:14.134613  1655 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:14.136127  1655 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:14.137250  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:14.138455  1655 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:14.140002  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:14.167364  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:14.148952  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:14.149858  8621 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:14.204491  1683 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:00:14.204851  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 131953us
W20260709 13:00:14.205947  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.137259  8611 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:14.206813  1614 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 19: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:14.206746  1535 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 19
W20260709 13:00:14.208261  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 69892.6us
I20260709 13:00:14.242779  1612 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 16 index: 15. (term mismatch)
I20260709 13:00:14.127319  8492 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:14.215368  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:14.215549  1508 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:14.243199  1655 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:14.243259  1612 pending_rounds.cc:85] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f: Aborting all ops after (but not including) 14
I20260709 13:00:14.248678  1612 pending_rounds.cc:107] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 15.15
I20260709 13:00:14.248973  1612 raft_consensus.cc:2889] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:14.248337  1655 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:14.063910  8699 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:14.247510  1616 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 18.
I20260709 13:00:14.135627  8630 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:14.110131  8703 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.107s
I20260709 13:00:14.215370  8637 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:00:14.244179  8728 log.cc:927] Time spent T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.187s	user 0.004s	sys 0.000s
I20260709 13:00:14.093135  8718 consensus_queue.cc:237] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:14.204463  1581 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:14.257094  8611 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:14.217150  8621 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 13:00:14.264075  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 48628.8us
I20260709 13:00:14.244590  8735 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.273530  8503 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.274024  8552 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:14.263617  8637 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:00:14.274395  8734 log.cc:927] Time spent T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
W20260709 13:00:14.275467  1541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 4466) took 2419 ms (client timeout 1807 ms). Trace:
I20260709 13:00:14.277261  1539 raft_consensus.cc:1275] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 13:00:14.283615  8726 log.cc:927] Time spent T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 13:00:13.896431  2294 rpcz_store.cc:276] 0709 13:00:11.792697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.607989 (+815292us) service_pool.cc:224] Handling call
0709 13:00:12.809229 (+201240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.859757 (+ 50528us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:00:13.275565 (+415808us) log.cc:844] Serialized 14 byte log entry
0709 13:00:13.687006 (+411441us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:13.706805 (+ 19799us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:13.708660 (+  1855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.721797 (+ 13137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.728663 (+  6866us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":128898,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":8504,"raft.queue_time_us":207,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":2968,"thread_start_us":644995,"threads_started":2,"wal-append.queue_time_us":438356}
I20260709 13:00:14.309815  8735 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:14.332122  8642 raft_consensus.cc:3055] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:14.332603  8642 raft_consensus.cc:740] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:14.333348  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42356 (request call id 1079) took 1582 ms. Trace:
I20260709 13:00:14.333448  8642 consensus_queue.cc:260] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:14.335759  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.284161  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:14.336592  1684 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 13:00:14.288125  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:14.289911  8716 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:14.290381  8697 consensus_meta.cc:287] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.000s
I20260709 13:00:14.290757  8692 raft_consensus.cc:3055] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:14.272742  8710 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:00:14.264849  8601 consensus_meta.cc:287] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.574s	user 0.011s	sys 0.000s
I20260709 13:00:14.300086  1508 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:14.301501  1683 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 20.
W20260709 13:00:14.294221  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 153136us
I20260709 13:00:14.358235  1581 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:14.304162  1690 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 21. Current term is 22. Ops: []
W20260709 13:00:14.339730  8614 consensus_meta.cc:287] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.599s	user 0.008s	sys 0.002s
I20260709 13:00:14.301381  8621 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:14.204602  8731 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:14.317365  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 13:00:14.318084  1541 rpcz_store.cc:269] 0709 13:00:11.855793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.921090 (+ 65297us) service_pool.cc:224] Handling call
0709 13:00:14.275241 (+2354151us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b540017eb54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:14.275394 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":833519488}
I20260709 13:00:14.264345  8282 raft_consensus.cc:697] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:14.265817  8714 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:14.325730  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:14.373751  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.327852  1535 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 19.
W20260709 13:00:14.373936  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 125678us
I20260709 13:00:14.374909  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:14.333804  1540 rpcz_store.cc:276] 0709 13:00:12.751022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.058763 (+307741us) service_pool.cc:224] Handling call
0709 13:00:14.333162 (+1274399us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b540010b3d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:14.333287 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1134452096}
I20260709 13:00:14.375519  1535 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:14.376935  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:14.339099  1533 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 13:00:14.293159  8611 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:14.303354  8691 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:14.356410  1583 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:14.303431  8744 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:14.367944  1682 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:14.367936  1581 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:14.369746  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 69741us
I20260709 13:00:14.386337  1508 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:14.369457  8646 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:14.353725  8692 raft_consensus.cc:740] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:14.381486  8673 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:00:14.395144  8626 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:14.403574  8621 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:14.393612  8710 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:14.405051  8710 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:14.405537  8710 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:14.406466  8621 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:14.415396  2269 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:14.417052  8644 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:14.417431  8735 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:14.417701  8644 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:14.418838  8699 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:14.419898  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:14.420727  1537 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 13:00:14.422497  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:14.423184  1541 raft_consensus.cc:2393] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 26: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:14.423916  1691 raft_consensus.cc:1240] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:14.420046  8644 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:14.394035  8633 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:14.428095  8633 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.428164  8533 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:14.428737  8533 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:14.429217  8533 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:14.431340  8633 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:14.433519  1688 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:14.382475  8642 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:14.310488  8503 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:14.354588  8697 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:14.387537  1508 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:14.390786  1535 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 20.
W20260709 13:00:14.420969  8741 log.cc:927] Time spent T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:00:14.370249  8614 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:14.383813  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 82600.2us
I20260709 13:00:14.411770  8290 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:14.384634  8611 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:00:14.477977  1609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 3712) took 2631 ms (client timeout 1860 ms). Trace:
I20260709 13:00:14.439078  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:14.478746  1540 raft_consensus.cc:2376] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 21. Re-sending same reply.
I20260709 13:00:14.445062  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:14.392202  1581 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:14.443951  1688 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:00:14.438803  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:14.445936  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:14.451709  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 64253.9us
I20260709 13:00:14.394115  8637 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.453615  1682 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 24.
I20260709 13:00:14.427577  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:14.456656  2303 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32802 (request call id 686) took 2650 ms (client timeout 1552 ms). Trace:
W20260709 13:00:14.488296  2303 rpcz_store.cc:269] 0709 13:00:11.792932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.844805 (+ 51873us) service_pool.cc:224] Handling call
0709 13:00:14.443496 (+2598691us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54005e9054. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:14.443644 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2728553344}
I20260709 13:00:14.457345  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:14.459252  1655 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:14.490669  1655 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:14.461647  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4462) took 2619 ms. Trace:
I20260709 13:00:14.424635  8039 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:14.465673  1507 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:14.473716  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:14.474542  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:14.503222  1615 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:14.475740  1611 raft_consensus.cc:1275] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:00:14.503770  1507 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:14.480225  1535 raft_consensus.cc:2368] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 19. Current term is 20.
W20260709 13:00:14.478439  1609 rpcz_store.cc:269] 0709 13:00:11.846311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.536514 (+690203us) service_pool.cc:224] Handling call
0709 13:00:14.456225 (+1919711us) spinlock_profiling.cc:243] Waited 744 ms on lock 0x7b54002a58d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:14.477890 (+ 21665us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1710296832}
I20260709 13:00:14.505482  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:14.485123  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 92976.6us
I20260709 13:00:14.506570  1581 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:14.499680  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:14.501641  1614 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:00:14.501896  1689 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 22. Current term is 23. Ops: [22.18-22.18]
I20260709 13:00:14.503295  1613 raft_consensus.cc:2393] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 15: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:14.450775  8503 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:14.491633  1534 rpcz_store.cc:276] 0709 13:00:11.842208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.386795 (+544587us) service_pool.cc:224] Handling call
0709 13:00:12.442866 (+ 56071us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.443093 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:00:12.852592 (+409499us) log.cc:844] Serialized 14 byte log entry
0709 13:00:14.034422 (+1181830us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b18004781e0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f322a6 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f322a6 00007fc859f32240
0709 13:00:14.035077 (+   655us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b18004781e0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f322a6 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f643f3 00007fc859f667c1
0709 13:00:14.035557 (+   480us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b18004781e0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f643f3 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd 000000000038f354 000000000038f199 00007fc859f4783a
0709 13:00:14.334520 (+298963us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b18004781e0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f322a6 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f322a6 00007fc859f32240
0709 13:00:14.460690 (+126170us) spinlock_profiling.cc:243] Waited 7.45 ms on lock 0x7b18004781e0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc85cbf94bc 00007fc859f4748b 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f61455 00007fc85d049060 00007fc85d05b716 00007fc85d06c287
0709 13:00:14.461077 (+   387us) log.cc:844] Serialized 14 byte log entry
0709 13:00:14.461259 (+   182us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:14.461307 (+    48us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:00:14.461359 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.461434 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.461580 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":682532,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":55827,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":30623,"spinlock_wait_cycles":53709952,"thread_start_us":637375,"threads_started":3,"wal-append.queue_time_us":215473}
I20260709 13:00:14.514721  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:14.538508  1540 raft_consensus.cc:2393] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 28: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:14.519146  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:14.523332  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:14.462909  8699 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:14.528559  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:14.548398  1537 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:14.530241  2301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32788 (request call id 641) took 1058 ms. Trace:
I20260709 13:00:14.469064  8233 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:14.441867  8492 consensus_queue.cc:1059] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:00:14.483820  8729 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:14.540771  1609 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
W20260709 13:00:14.553095  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 46613us
I20260709 13:00:14.502528  8735 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:14.513677  8621 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:14.548910  2301 rpcz_store.cc:276] 0709 13:00:13.471960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.473364 (+  1404us) service_pool.cc:224] Handling call
0709 13:00:13.473618 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.123787 (+650169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.530021 (+406234us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b54004db7d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:14.530177 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1453925632}
I20260709 13:00:14.550235  1615 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 14.
I20260709 13:00:14.516722  8626 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:00:14.432989  8744 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:14.559535  1505 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:14.568557  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:14.572605  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:14.586079  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:14.530205  8503 raft_consensus.cc:2764] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:00:14.594913  1540 raft_consensus.cc:2410] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 21 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
W20260709 13:00:14.595094  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 123658us
W20260709 13:00:14.598850  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 116953us
W20260709 13:00:14.600838  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 97142.7us
I20260709 13:00:14.509369  8714 consensus_queue.cc:1059] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:00:14.502677  8637 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:14.601176  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:14.547848  8670 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:14.607327  1541 raft_consensus.cc:2393] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 20: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:14.476399  8282 consensus_queue.cc:237] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:14.570582  8699 raft_consensus.cc:697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:14.600297  2266 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:14.532684  8644 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.067s
I20260709 13:00:14.570009  8039 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:14.548072  8646 consensus_queue.cc:1059] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:00:14.569199  8702 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.609458  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:14.570430  8621 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:14.615319  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:14.623382  1541 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 6.
I20260709 13:00:14.519851  8692 consensus_queue.cc:260] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:14.568023  8233 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:14.624414  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:14.617540  1537 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 13:00:14.637315  1541 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 26.
I20260709 13:00:14.613981  8503 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:00:14.647989  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1084) took 1182 ms. Trace:
I20260709 13:00:14.649158  1541 raft_consensus.cc:1275] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:00:14.689990  1617 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 13:00:14.690533  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 3475) took 1212 ms. Trace:
I20260709 13:00:14.690961  1541 rpcz_store.cc:276] 0709 13:00:13.477983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.648428 (+1170445us) service_pool.cc:224] Handling call
0709 13:00:14.648794 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.690248 (+ 41454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.690475 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.689788  1537 rpcz_store.cc:276] 0709 13:00:13.465487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.647032 (+1181545us) service_pool.cc:224] Handling call
0709 13:00:14.647407 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.647609 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:14.647637 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:14.647683 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:14.647716 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.647774 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.647917 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.692575  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:14.689829  8503 raft_consensus.cc:697] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:14.685518  8714 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:00:14.694412  8503 consensus_queue.cc:237] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:14.695117  1535 raft_consensus.cc:1275] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:14.669760  8744 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:14.670302  8620 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:14.670663  8290 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:14.672149  8637 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:14.676671  8682 consensus_meta.cc:287] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.659s	user 0.011s	sys 0.000s
I20260709 13:00:14.682293  8630 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:14.682734  8684 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:14.685600  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1088) took 1007 ms. Trace:
I20260709 13:00:14.746376  1533 rpcz_store.cc:276] 0709 13:00:13.678626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.684638 (+1006012us) service_pool.cc:224] Handling call
0709 13:00:14.685007 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.685208 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:14.685238 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:14.685286 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:14.685355 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.685413 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.685536 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:14.686143  8660 raft_consensus.cc:3055] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:14.665970  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1075) took 1916 ms. Trace:
I20260709 13:00:14.748004  1536 rpcz_store.cc:276] 0709 13:00:12.750035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.114567 (+364532us) service_pool.cc:224] Handling call
0709 13:00:13.334802 (+220235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:13.477209 (+142407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.665714 (+1188505us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400186ad4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:14.665901 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":244456704}
I20260709 13:00:14.692703  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:14.668733  8742 log.cc:927] Time spent T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.393s	user 0.003s	sys 0.000s
I20260709 13:00:14.616048  8492 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.696707  1583 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:14.696117  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 13:00:14.750488  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 53870.6us
I20260709 13:00:14.750542  1535 raft_consensus.cc:2376] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 28. Re-sending same reply.
I20260709 13:00:14.693406  1690 raft_consensus.cc:2393] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 14: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:14.570178  8729 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:14.704844  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 151133us
I20260709 13:00:14.625648  8621 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:14.619457  8125 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 28 FOLLOWER]: Leader election won for term 28
W20260709 13:00:14.635737  8732 log.cc:927] Time spent T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
W20260709 13:00:14.720121  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.696146  8670 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:14.765857  1540 raft_consensus.cc:1275] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:00:14.766454  1615 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:14.767025  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:14.767678  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:14.767810  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:14.766623  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:14.768867  1609 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:14.770314  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 3455) took 2166 ms. Trace:
I20260709 13:00:14.770789  1539 rpcz_store.cc:276] 0709 13:00:12.604187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.085077 (+480890us) service_pool.cc:224] Handling call
0709 13:00:14.276903 (+1191826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:14.317512 (+ 40609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.770083 (+452571us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540017eb50. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:14.770244 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2740532992}
I20260709 13:00:14.755738  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 13:00:14.738497  8745 log.cc:927] Time spent T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:00:14.621459  8588 consensus_queue.cc:1059] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.117s
I20260709 13:00:14.622234  8748 consensus_queue.cc:1059] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.132s
I20260709 13:00:14.731114  8744 raft_consensus.cc:3055] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:14.729651  8601 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.772190  1536 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:14.745909  8682 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:00:14.775549  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 216106us
I20260709 13:00:14.777262  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:14.626255  8702 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:14.758515  8653 consensus_meta.cc:287] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.741s	user 0.009s	sys 0.001s
I20260709 13:00:14.779628  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:14.753320  8660 raft_consensus.cc:740] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 13:00:14.796653  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 196785us
I20260709 13:00:14.785787  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:14.706139  8533 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:14.787024  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:14.787412  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:14.696910  8705 consensus_queue.cc:1059] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.115s
I20260709 13:00:14.755468  8642 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:00:14.782162  8646 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.793396  1613 raft_consensus.cc:1240] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:00:14.794420  1611 raft_consensus.cc:2368] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 27. Current term is 28.
I20260709 13:00:14.795918  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:14.817894  1539 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 13:00:14.777594  8125 raft_consensus.cc:697] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 28 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:14.798053  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:14.798444  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 181125us
I20260709 13:00:14.800683  1534 raft_consensus.cc:2410] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:00:14.802080  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:14.805812  1505 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:14.821976  1614 raft_consensus.cc:2393] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 18: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:14.822294  1617 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 17.
I20260709 13:00:14.811365  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:14.823101  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:14.791620  1655 leader_election.cc:400] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 19. Current term is 20.
I20260709 13:00:14.823203  1505 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:14.818324  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:14.810635  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 185755us
I20260709 13:00:14.823675  1617 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 22.
I20260709 13:00:14.824182  1611 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 13:00:14.824717  1655 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:14.795806  1540 raft_consensus.cc:1240] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:14.826228  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:14.841892  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.827003  2303 raft_consensus.cc:2393] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 20: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:14.788916  8744 raft_consensus.cc:740] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:14.758114  8492 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:14.867245  1505 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:14.789083  8614 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:14.896770  1682 raft_consensus.cc:1240] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:14.898546  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 3472) took 1456 ms. Trace:
I20260709 13:00:14.868734  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:14.899343  2302 raft_consensus.cc:2393] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 23: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:14.796916  8290 raft_consensus.cc:3055] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:14.872756  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:14.873317  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:14.761009  8730 consensus_queue.cc:1059] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.052s
I20260709 13:00:14.872756  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:14.800501  8601 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:14.872344  8745 log.cc:927] Time spent T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:00:14.808740  2295 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32794 (request call id 941) took 3654 ms (client timeout 1885 ms). Trace:
I20260709 13:00:14.892540  1536 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 22.
I20260709 13:00:14.791240  8627 consensus_queue.cc:1059] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.100s
I20260709 13:00:14.896641  1505 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:14.894872  8533 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:14.867663  2269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.901825  1690 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:00:14.874096  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 49400.8us
I20260709 13:00:14.952072  1655 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:14.811831  8670 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:00:14.810701  8653 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:14.980883  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:14.981427  2301 raft_consensus.cc:1275] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:00:14.989894  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:14.990679  2301 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
I20260709 13:00:14.868813  8684 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:14.893105  8682 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:00:14.878338  8727 log.cc:927] Time spent T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:00:14.902457  1542 rpcz_store.cc:276] 0709 13:00:13.442166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.608667 (+166501us) service_pool.cc:224] Handling call
0709 13:00:13.608975 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:13.609217 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:13.609242 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:13.609691 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 13:00:14.061120 (+451429us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:14.061159 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.061223 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:14.898304 (+837081us) raft_consensus.cc:1685] finished
0709 13:00:14.898326 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:14.898489 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":451061,"threads_started":1,"wal-append.queue_time_us":685047}
I20260709 13:00:14.949435  2267 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:14.778375  8699 consensus_queue.cc:237] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:14.869756  8637 raft_consensus.cc:2804] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:14.957814  1541 raft_consensus.cc:1240] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 19. Current term is 20. Ops: []
W20260709 13:00:14.960057  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 63560.9us
I20260709 13:00:14.961392  1656 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:15.201085  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 239796us
I20260709 13:00:14.995352  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:14.900695  8290 raft_consensus.cc:740] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:14.903164  8752 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:15.002650  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:15.004223  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:14.870963  8633 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:14.939640  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:14.958266  8524 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:14.902009  8710 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:14.869618  8646 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:14.980137  8626 consensus_queue.cc:1048] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.213s
I20260709 13:00:15.011204  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:15.202065  1505 leader_election.cc:400] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 27. Current term is 28.
I20260709 13:00:15.202702  2298 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 13:00:15.252853  1505 leader_election.cc:403] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 election: Cancelling election due to peer responding with higher term
I20260709 13:00:15.202225  1656 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:15.252854  2303 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:15.204023  2302 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 19: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:15.177803  1690 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 22.
I20260709 13:00:15.018589  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:14.995452  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
W20260709 13:00:15.211987  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 216519us
I20260709 13:00:15.240851  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:15.258975  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 56835us
I20260709 13:00:14.998080  8754 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:14.891755  8660 consensus_queue.cc:260] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:15.257268  1507 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:15.246433  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:15.262193  2299 raft_consensus.cc:2393] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 22: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:15.003541  8682 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:15.268621  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 66733.8us
I20260709 13:00:15.200189  8637 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:15.299166  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:15.300798  1505 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:15.305882  8769 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:15.306527  8769 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.306985  8769 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:15.307682  1505 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:15.149142  8744 consensus_queue.cc:260] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:15.313814  8744 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:15.313045  1505 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:15.317018  8761 log.cc:927] Time spent T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.379s	user 0.000s	sys 0.000s
I20260709 13:00:15.251140  8690 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:15.324050  8684 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Leader election lost for term 27. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 27. Current term is 28.
I20260709 13:00:15.337527  8684 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:00:15.337777  8764 log.cc:927] Time spent T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.433s	user 0.001s	sys 0.000s
I20260709 13:00:15.323841  8637 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:15.338981  8767 log.cc:927] Time spent T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:00:15.258869  8630 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:15.347774  2303 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 24.
I20260709 13:00:15.349576  2269 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:15.272516  8682 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:15.303730  8752 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:15.324389  8614 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:15.333676  8660 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:00:15.403074  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 451081us
I20260709 13:00:14.996551  8125 consensus_queue.cc:237] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:15.349053  8684 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.365172  8690 raft_consensus.cc:2804] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:15.444104  1655 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:15.367810  8630 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:00:15.444028  8735 consensus_meta.cc:287] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.857s	user 0.007s	sys 0.003s
I20260709 13:00:15.456156  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:15.474012  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:15.479729  2298 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
W20260709 13:00:15.482192  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 212992us
I20260709 13:00:15.483547  1654 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:15.445441  8684 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:15.485324  1654 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:14.939256  2295 rpcz_store.cc:269] 0709 13:00:11.154331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.156096 (+  1765us) service_pool.cc:224] Handling call
0709 13:00:12.448918 (+1292822us) spinlock_profiling.cc:243] Waited 9.22 ms on lock 0x7b5800003c98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc8620170a0 00007fc862016984 00007fc85b5916d4 00007fc85b591662
0709 13:00:14.782156 (+2333238us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b540097fc54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:14.796800 (+ 14644us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":787261056}
I20260709 13:00:15.455423  8690 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:15.350584  8290 consensus_queue.cc:260] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:15.454702  8774 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:15.367934  8752 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.364812  8713 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:15.442221  8702 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:15.478289  8735 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:15.477568  8777 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 13:00:15.502445  8718 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.013s	sys 0.000s
W20260709 13:00:15.508390  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 559062us
I20260709 13:00:15.487521  8492 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:15.490402  8715 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:15.488123  8601 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:15.500679  8690 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:15.483973  8626 consensus_queue.cc:1048] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.029s
W20260709 13:00:15.545825  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 196347us
I20260709 13:00:15.491705  8630 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:00:15.547644  1609 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:15.544065  8290 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:00:15.542582  8718 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.014s	sys 0.000s
W20260709 13:00:15.507783  8703 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.030s	sys 0.059s
I20260709 13:00:15.552991  2267 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:15.508607  8774 raft_consensus.cc:697] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 19 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:15.516325  8653 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:15.506809  8752 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:00:15.549494  8773 log.cc:927] Time spent T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
W20260709 13:00:15.562393  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 118381us
I20260709 13:00:15.562520  2269 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:15.548384  8702 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:15.568275  2267 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:15.557232  8771 log.cc:927] Time spent T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.293s	user 0.000s	sys 0.001s
W20260709 13:00:15.568902  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 75194.6us
I20260709 13:00:15.552631  8713 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:15.555383  8633 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:15.564673  8703 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.031s	sys 0.059s
I20260709 13:00:15.557713  8601 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:00:15.571180  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 131378us
I20260709 13:00:15.559801  8710 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:15.565080  8646 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:15.561772  8715 raft_consensus.cc:697] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:15.558058  8780 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:15.580751  8781 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.023s
W20260709 13:00:15.575449  8620 consensus_meta.cc:287] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.844s	user 0.011s	sys 0.000s
I20260709 13:00:15.574049  8702 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:15.595867  8233 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:15.596586  8678 consensus_meta.cc:287] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 1.473s	user 0.011s	sys 0.001s
I20260709 13:00:15.597050  8678 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:15.597671  8702 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:15.576997  8713 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.599257  8678 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:15.587455  8739 log.cc:927] Time spent T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 1.325s	user 0.001s	sys 0.001s
W20260709 13:00:15.599189  8772 log.cc:927] Time spent T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:00:15.599342  8715 consensus_queue.cc:237] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:15.598521  8713 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:15.602488  8729 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:15.545224  8777 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:15.595854  8508 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.711434  8508 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:15.586891  8611 consensus_meta.cc:287] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 1.086s	user 0.006s	sys 0.003s
I20260709 13:00:15.663686  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 3484) took 1197 ms. Trace:
I20260709 13:00:15.665275  1535 raft_consensus.cc:1240] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:00:15.713393  1533 rpcz_store.cc:276] 0709 13:00:14.465750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.752438 (+286688us) service_pool.cc:224] Handling call
0709 13:00:14.752845 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:14.759104 (+  6259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:14.759139 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:14.773855 (+ 14716us) log.cc:844] Serialized 26 byte log entry
0709 13:00:15.169032 (+395177us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:00:15.169076 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.169145 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:15.662744 (+493599us) raft_consensus.cc:1685] finished
0709 13:00:15.662818 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:15.663313 (+   495us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21231,"raft.queue_time_us":7779,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":24027,"thread_start_us":354329,"threads_started":1,"wal-append.queue_time_us":530701}
W20260709 13:00:15.550684  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 237746us
I20260709 13:00:15.677080  1507 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:15.701870  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 133530us
I20260709 13:00:15.713665  8611 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:15.727174  1686 raft_consensus.cc:1240] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:15.727594  8492 consensus_queue.cc:1048] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:00:15.692348  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 877538us
I20260709 13:00:15.729432  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4619) took 1432 ms. Trace:
I20260709 13:00:15.729986  1686 rpcz_store.cc:276] 0709 13:00:14.296530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.296638 (+   108us) service_pool.cc:224] Handling call
0709 13:00:14.296918 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.727709 (+1430791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.728975 (+  1266us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54003b6ad4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:15.729325 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3288604416}
I20260709 13:00:15.730792  8524 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:15.731443  8524 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.731904  8524 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:15.701783  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:15.734949  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 3483) took 1269 ms. Trace:
I20260709 13:00:15.735337  1691 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 16.
I20260709 13:00:15.735456  1535 rpcz_store.cc:276] 0709 13:00:14.465493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.751542 (+286049us) service_pool.cc:224] Handling call
0709 13:00:14.754468 (+  2926us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:15.714233 (+959765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.716375 (+  2142us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b5400314cd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:15.734878 (+ 18503us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2092843392}
I20260709 13:00:15.704509  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:15.737254  1682 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:00:15.721316  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 162640us
I20260709 13:00:15.706542  1687 raft_consensus.cc:1275] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:00:15.709344  8125 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:15.741219  8125 raft_consensus.cc:697] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 21 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:15.741320  1507 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:15.588354  2294 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:00:15.591270  8373 raft_consensus.cc:3055] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:15.745078  8508 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:15.744194  8373 raft_consensus.cc:740] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:15.674831  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1090) took 1995 ms. Trace:
I20260709 13:00:15.692124  1654 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:15.747623  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 55947.4us
I20260709 13:00:15.747174  8373 consensus_queue.cc:260] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:15.748697  1541 rpcz_store.cc:276] 0709 13:00:13.679142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.691699 (+1012557us) service_pool.cc:224] Handling call
0709 13:00:14.957633 (+265934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.212089 (+254456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.674289 (+462200us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b5400219dd0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:15.674608 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":610886400}
W20260709 13:00:15.705397  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.761862  8673 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.762840  8673 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:15.750316  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 13:00:15.765313  2328 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:34735 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:34735 timed out after 15.000s (SENT)
I20260709 13:00:15.765901  8684 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:15.770680  8630 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.770946  8684 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:15.771775  8684 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:15.771629  8630 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:15.737157  8611 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:15.774709  8611 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.752462  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:15.778561  8630 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:15.753379  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:15.780614  1534 raft_consensus.cc:2393] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 19: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:15.755218  1656 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:15.756783  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:15.618952  8637 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:15.782033  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 81980.4us
I20260709 13:00:15.768884  1654 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:15.760134  8678 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:15.785805  8678 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:15.786595  8601 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.775682  8611 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:15.787421  1690 raft_consensus.cc:1240] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:15.787534  8601 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:15.789628  8611 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:15.784322  8637 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:15.789921  8678 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:15.790407  8601 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:15.789899  1687 raft_consensus.cc:1240] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:15.791260  8601 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:15.791697  8601 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.792068  8601 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:15.792961  8637 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:15.796386  8637 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.796878  8637 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:15.797993  8630 raft_consensus.cc:2804] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:15.745329  8125 consensus_queue.cc:237] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:15.767942  8626 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:15.768448  8673 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:15.621637  8682 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:15.811154  8626 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:15.813681  8626 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:15.814222  1542 raft_consensus.cc:1240] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:00:15.815101  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:15.732139  1508 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:15.814255  8626 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.813709  8682 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:15.824172  8626 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:15.611975  8712 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:15.765470  1533 raft_consensus.cc:2393] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 14: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:15.750169  8373 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:15.805240  8684 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:15.589501  8718 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:00:15.598599  8762 log.cc:927] Time spent T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.351s	user 0.000s	sys 0.001s
W20260709 13:00:15.617980  8768 log.cc:927] Time spent T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:00:15.631799  8769 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:15.599639  8774 consensus_queue.cc:237] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:15.616338  8777 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:15.582109  8787 consensus_queue.cc:1059] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:00:15.799726  1654 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:15.633502  8752 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:15.901166  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1033) took 1483 ms. Trace:
I20260709 13:00:15.901574  8752 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:15.834510  1682 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 17.
I20260709 13:00:15.837320  8702 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:15.902580  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:15.811144  8630 raft_consensus.cc:697] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 14 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:15.903498  1533 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:00:15.904388  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3635) took 1436 ms. Trace:
I20260709 13:00:15.904202  8630 consensus_queue.cc:237] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:15.904755  1610 rpcz_store.cc:276] 0709 13:00:14.468084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.485588 (+ 17504us) service_pool.cc:224] Handling call
0709 13:00:14.485940 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:14.493391 (+  7451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:14.493425 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:14.494070 (+   645us) log.cc:844] Serialized 26 byte log entry
0709 13:00:15.698312 (+1204242us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b18000e3740. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf10d1 00007fc85d00ca0f
0709 13:00:15.831355 (+133043us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:15.841735 (+ 10380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.857016 (+ 15281us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:15.903892 (+ 46876us) raft_consensus.cc:1685] finished
0709 13:00:15.903907 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:15.904191 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6882,"raft.queue_time_us":24511,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":7544,"spinlock_wait_cycles":3278592,"thread_start_us":132569,"threads_started":1,"wal-append.queue_time_us":1331474}
I20260709 13:00:15.905781  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:15.847060  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:15.906852  1534 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:00:15.854311  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 122459us
I20260709 13:00:15.848628  1537 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:15.858645  8744 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:15.848453  8697 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:15.854301  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:15.871830  8769 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:15.897553  8692 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:15.902956  8702 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:15.901636  1685 rpcz_store.cc:276] 0709 13:00:14.418127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.429487 (+ 11360us) service_pool.cc:224] Handling call
0709 13:00:14.429889 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:14.430331 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:00:14.535924 (+105593us) log.cc:844] Serialized 14 byte log entry
0709 13:00:14.773163 (+237239us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:14.777742 (+  4579us) log.cc:844] Serialized 26 byte log entry
0709 13:00:14.777906 (+   164us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:14.777943 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:14.778009 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:15.598029 (+820020us) spinlock_profiling.cc:243] Waited 3.32 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 13:00:15.900607 (+302578us) raft_consensus.cc:1685] finished
0709 13:00:15.900756 (+   149us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:15.901001 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4197,"prepare.queue_time_us":205782,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":869,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":6906,"spinlock_wait_cycles":7643904,"thread_start_us":277825,"threads_started":2,"wal-append.queue_time_us":374612}
I20260709 13:00:15.928920  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:15.929848  1542 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 22.
I20260709 13:00:15.946301  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:15.913363  8744 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:15.959823  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 1.09073e+06us
I20260709 13:00:15.931768  8702 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:15.934455  8712 raft_consensus.cc:697] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 22 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:15.950012  8626 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:15.955096  8744 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:15.974110  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 3730) took 1072 ms. Trace:
I20260709 13:00:15.975055  8552 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 13:00:15.976634  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 1.1548e+06us
I20260709 13:00:15.977658  8524 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:15.978346  8787 raft_consensus.cc:3055] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:15.978801  1581 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:15.979630  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 180084us
I20260709 13:00:15.981201  8712 consensus_queue.cc:237] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:15.984635  8781 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:15.985173  8781 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:15.985612  8781 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:15.988920  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:15.990720  8492 consensus_queue.cc:1059] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:15.976164  8552 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:15.995728  8621 consensus_meta.cc:287] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 1.173s	user 0.009s	sys 0.012s
I20260709 13:00:15.996158  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3639) took 1523 ms. Trace:
W20260709 13:00:16.005959  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.996304  8621 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:15.997216  8646 raft_consensus.cc:3055] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:00:16.001336  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1092) took 2267 ms. Trace:
I20260709 13:00:15.994719  2294 raft_consensus.cc:2393] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 14: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:15.974198  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:16.007083  8718 raft_consensus.cc:697] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 19 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:16.007422  8642 raft_consensus.cc:697] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 24 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:16.009011  8730 raft_consensus.cc:3055] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:00:16.010282  8508 consensus_queue.cc:1059] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:00:16.009006  2269 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:16.010695  8748 raft_consensus.cc:3055] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:15.974731  1609 rpcz_store.cc:276] 0709 13:00:14.768033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.769305 (+  1272us) service_pool.cc:224] Handling call
0709 13:00:15.686307 (+917002us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b540008cad4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:15.840727 (+154420us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1694252800}
I20260709 13:00:16.016355  1534 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 13:00:16.017841  1537 rpcz_store.cc:276] 0709 13:00:13.733428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.692806 (+959378us) service_pool.cc:224] Handling call
0709 13:00:14.693094 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:15.952904 (+1259810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.000986 (+ 48082us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54001865d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:16.001241 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2656564608}
I20260709 13:00:16.011435  1608 rpcz_store.cc:276] 0709 13:00:14.472728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.472820 (+    92us) service_pool.cc:224] Handling call
0709 13:00:14.473148 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:14.479988 (+  6840us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:14.480019 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:14.488503 (+  8484us) log.cc:844] Serialized 26 byte log entry
0709 13:00:14.749036 (+260533us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:14.774083 (+ 25047us) log.cc:844] Serialized 14 byte log entry
0709 13:00:15.706177 (+932094us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b18003f6820. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859edec0a 00007fc86361e219 00007fc859f66a40 00007fc859f614e4 00007fc859f61455 00007fc85d049060 00007fc85d05b716 00007fc85d06c287 00007fc85d06c208
0709 13:00:15.951987 (+245810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:15.964114 (+ 12127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:15.967066 (+  2952us) raft_consensus.cc:1685] finished
0709 13:00:15.970822 (+  3756us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:15.995975 (+ 25153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48376,"prepare.queue_time_us":27780,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":1166273,"raft.run_cpu_time_us":377,"raft.run_wall_time_us":13714,"spinlock_wait_cycles":3406592,"thread_start_us":197663,"threads_started":1,"wal-append.queue_time_us":586165}
I20260709 13:00:15.990943  8627 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:16.186551  1683 raft_consensus.cc:1240] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:16.208094  2300 raft_consensus.cc:1240] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:00:16.159615  1581 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
W20260709 13:00:16.120165  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 124835us
W20260709 13:00:16.163045  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 173040us
W20260709 13:00:16.138967  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 46094.8us
I20260709 13:00:15.984665  8794 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 13:00:16.138733  8689 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.666s	user 0.011s	sys 0.035s
W20260709 13:00:16.172564  8401 log.cc:927] Time spent T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:00:15.978933  8787 raft_consensus.cc:740] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:16.199981  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:16.133279  1539 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 13:00:16.017575  8646 raft_consensus.cc:740] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 24 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:16.034905  8621 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:16.139065  8808 log.cc:927] Time spent T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:00:16.016796  8524 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:16.135061  8552 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:16.222416  8689 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.947s	user 0.016s	sys 0.039s
I20260709 13:00:16.039508  8730 raft_consensus.cc:740] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:16.235301  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
W20260709 13:00:16.238408  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 229662us
I20260709 13:00:16.143656  8050 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.213241  8748 raft_consensus.cc:740] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:16.034648  8690 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:16.192811  8637 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:16.240665  2300 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:16.219708  8601 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:16.192453  8718 consensus_queue.cc:237] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:16.118806  8611 consensus_queue.cc:1059] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.123s
I20260709 13:00:16.239512  2294 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:16.193218  1533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "480b368f643b4d85a5daa23529132504"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:47506
I20260709 13:00:16.269757  1537 raft_consensus.cc:1240] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:16.287711  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 49987.6us
I20260709 13:00:16.290627  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:16.291796  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 149650us
I20260709 13:00:16.289328  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:16.297045  8730 consensus_queue.cc:260] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:16.265679  8630 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:16.277561  8626 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:16.289021  8746 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:16.277225  8692 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.289799  8691 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:16.319420  8714 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:16.320721  1536 raft_consensus.cc:2393] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 22: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 13:00:16.320411  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 49840.9us
I20260709 13:00:16.284591  1533 raft_consensus.cc:606] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:16.335073  1533 raft_consensus.cc:614] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:16.338783  1542 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:00:16.343454  8290 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:16.247982  8050 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:16.347880  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:16.349058  8637 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:16.274768  8642 consensus_queue.cc:237] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:16.349983  8646 consensus_queue.cc:260] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:16.351575  8691 raft_consensus.cc:697] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:16.347620  8692 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:16.354477  2269 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:16.355005  8692 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:16.355361  8125 consensus_queue.cc:1059] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:16.356710  8125 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:16.357216  8125 raft_consensus.cc:697] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:16.357740  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:16.248613  8794 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:16.358266  8125 consensus_queue.cc:237] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:16.360572  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:16.361384  2299 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 21.
I20260709 13:00:16.361810  8794 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:16.336695  1505 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:16.368134  2300 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 13:00:16.372360  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:16.359721  8775 raft_consensus.cc:3055] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:16.373483  8775 raft_consensus.cc:740] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:16.374657  8678 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:16.375345  8678 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:16.375932  8774 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.046s
W20260709 13:00:16.376847  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 57877.7us
W20260709 13:00:16.377388  8812 log.cc:927] Time spent T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:00:16.379415  8524 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:16.380455  8524 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:16.380630  8713 consensus_meta.cc:287] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.743s	user 0.007s	sys 0.008s
I20260709 13:00:16.330487  8744 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:16.355443  1655 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:16.345314  8626 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:16.362509  8794 consensus_queue.cc:1059] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:16.364509  8290 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.420696  1535 raft_consensus.cc:2393] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 21: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:16.423012  1581 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:16.406080  8769 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.421093  8794 raft_consensus.cc:3055] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:16.431704  8794 raft_consensus.cc:740] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:16.432809  8794 consensus_queue.cc:260] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:16.381183  8713 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:16.434017  8621 raft_consensus.cc:3055] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:00:16.434434  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.422617  8744 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:16.420531  8678 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:16.435581  8689 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:16.436269  8689 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:16.438146  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 82770.9us
I20260709 13:00:16.438712  8689 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:16.438944  1655 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:16.439838  1655 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:16.405769  8611 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.441141  8611 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:16.423099  8718 consensus_queue.cc:1059] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:00:16.442565  8718 raft_consensus.cc:3055] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:16.381213  8524 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:16.443341  8611 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:16.443923  8611 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:16.444779  8796 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:16.440169  8702 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:16.445255  8769 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:16.424826  1682 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:00:16.441618  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4623) took 1757 ms. Trace:
I20260709 13:00:16.442903  8718 raft_consensus.cc:740] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:16.370276  8787 consensus_queue.cc:260] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:16.419370  8815 log.cc:927] Time spent T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:00:16.448645  1683 rpcz_store.cc:276] 0709 13:00:14.684654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.688744 (+  4090us) service_pool.cc:224] Handling call
0709 13:00:14.689067 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:16.228681 (+1539614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:16.441330 (+212649us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b540008edd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:16.441542 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3100572928}
I20260709 13:00:16.367996  8630 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:16.381083  8746 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:16.402712  8290 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:16.444320  8611 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.434197  8794 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:16.465911  8524 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:16.470875  8630 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:16.471470  8630 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:16.472671  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:16.465502  8718 consensus_queue.cc:260] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:16.467181  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:16.473230  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:16.473587  1687 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 26.
I20260709 13:00:16.473821  1690 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 13:00:16.467301  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:16.474990  8689 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.475612  8689 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:16.434461  8621 raft_consensus.cc:740] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:16.477121  8735 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:16.477735  8735 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:16.479249  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:16.480078  8735 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:16.467737  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:16.481240  1685 raft_consensus.cc:2393] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 19: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:16.481070  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:16.468425  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:16.481770  1613 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 22.
I20260709 13:00:16.482184  1691 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
I20260709 13:00:16.468755  8803 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:16.482987  8803 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:16.483166  8713 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:16.475426  1682 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:16.474031  8718 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:16.484830  8803 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:16.486398  8689 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:16.397709  8714 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:16.488672  8714 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:16.476225  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:16.492640  1609 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 26.
I20260709 13:00:16.469861  8401 tablet_bootstrap.cc:492] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=0 applied=17 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:00:16.484108  1686 raft_consensus.cc:2393] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 22: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:16.484020  1541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862"
dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:47506
I20260709 13:00:16.445250  8796 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.471998  8630 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:16.406270  8691 consensus_queue.cc:237] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:16.517028  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 73705.1us
I20260709 13:00:16.503485  1682 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 19.
W20260709 13:00:16.481066  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 58228.9us
W20260709 13:00:16.515331  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 53926.8us
I20260709 13:00:16.505954  1541 raft_consensus.cc:606] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:16.519183  1541 raft_consensus.cc:614] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:16.462072  8744 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.518077  1655 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:16.493333  8611 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:16.422040  8748 consensus_queue.cc:260] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 13.14, Last appended by leader: 14, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:16.528707  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:16.529233  1655 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:16.496143  8690 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:16.532488  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:16.515065  8796 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:16.538357  1690 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 22.
I20260709 13:00:16.532488  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:16.533439  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:16.541524  1682 raft_consensus.cc:2393] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 19: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:16.528589  8713 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:16.542965  8702 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:16.543777  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:16.548425  8702 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:16.549526  8702 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:16.549649  8401 tablet_bootstrap.cc:492] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 13:00:16.550753  8401 ts_tablet_manager.cc:1403] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 3.778s	user 0.078s	sys 0.082s
I20260709 13:00:16.542637  1655 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:16.544982  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:16.564971  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:16.540208  8779 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:16.569063  8779 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:16.573341  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 45691.4us
I20260709 13:00:16.576377  8779 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:16.576797  1683 raft_consensus.cc:2393] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 14: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:16.578833  1540 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 13:00:16.580365  1615 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:16.542035  8601 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:16.584846  8039 consensus_queue.cc:1059] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:00:16.587159  8552 consensus_queue.cc:1048] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:16.589057  8642 raft_consensus.cc:3055] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:16.589499  8642 raft_consensus.cc:740] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:16.590404  8642 consensus_queue.cc:260] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:16.591747  8642 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:16.592971  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:16.593293  8769 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:16.594414  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:16.595059  1688 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:16.595201  8630 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:16.596908  1533 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:00:16.598169  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:16.599987  8050 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:16.571417  8744 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:16.584322  1686 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:00:16.601326  8626 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:16.602741  8744 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:16.571003  8781 consensus_meta.cc:287] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.585s	user 0.005s	sys 0.005s
I20260709 13:00:16.613175  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:16.484578  8621 consensus_queue.cc:260] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:16.615702  1615 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 23.
I20260709 13:00:16.621259  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:16.624195  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:16.624971  1682 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:16.637396  1616 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:16.651012  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:16.652102  1686 raft_consensus.cc:2410] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:00:16.615938  8630 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:16.700609  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:16.703997  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.656567  8621 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:16.616385  8781 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:16.713208  2266 leader_election.cc:336] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 1.723s (SENT)
I20260709 13:00:16.714488  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:16.657259  8630 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:16.715328  1686 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:16.709870  1581 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:16.654064  8746 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:16.736174  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 193636us
I20260709 13:00:16.730114  8713 raft_consensus.cc:697] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:16.738322  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:16.741194  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:16.751735  1683 raft_consensus.cc:2393] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 19: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:16.717752  8630 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:16.757573  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:16.741325  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:16.757575  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:16.761950  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:16.761474  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:16.735805  8744 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.765276  1539 raft_consensus.cc:2393] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 25: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:16.761430  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:16.757813  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:16.768936  1536 raft_consensus.cc:1240] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:00:16.770026  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:16.773622  8713 consensus_queue.cc:237] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:16.750941  8039 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:16.778290  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:16.789330  1533 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:16.785894  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:16.798619  1542 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 13:00:16.796308  1689 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 13:00:16.801494  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:16.802764  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:16.803344  1689 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:16.803938  2294 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 13:00:16.805982  8744 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:16.810889  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.811470  1686 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 22.
I20260709 13:00:16.653194  8689 consensus_queue.cc:1059] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.115s
I20260709 13:00:16.820228  1534 raft_consensus.cc:2393] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 19: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:16.820088  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 13:00:16.820008  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 167197us
I20260709 13:00:16.828153  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:16.829002  1613 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:16.829936  1686 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:16.839434  1686 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 13:00:16.839267  8401 raft_consensus.cc:359] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [term 24 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:16.783746  8039 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:16.844884  8039 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:16.760298  8702 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:16.851725  8702 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:16.852025  8787 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:16.856194  1688 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 23.
W20260709 13:00:16.857766  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 144648us
I20260709 13:00:16.840220  8401 raft_consensus.cc:740] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [term 24 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 13:00:16.869158  1686 raft_consensus.cc:1240] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:16.869720  1683 raft_consensus.cc:1240] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:00:16.872614  1682 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 17.
I20260709 13:00:16.878273  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:16.882958  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:16.879184  1542 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 12.
I20260709 13:00:16.887012  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:16.887149  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:16.887805  1613 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:16.888178  1535 raft_consensus.cc:2393] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 17: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 13:00:16.858433  8627 consensus_meta.cc:287] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.636s	user 0.011s	sys 0.000s
I20260709 13:00:16.888994  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:16.895563  1686 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:00:16.904749  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:16.905920  1535 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 13:00:16.907684  8692 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.908804  8692 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:16.909552  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:16.912796  8692 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:16.915666  8611 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:16.917956  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:16.919283  1534 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:00:16.919656  1540 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:00:16.921061  1541 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:00:16.921555  8781 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:16.925297  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.933059  8125 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:00:16.936311  8774 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:00:16.938208  8796 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:16.860852  8290 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:16.940320  2266 leader_election.cc:336] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 1.899s (SENT)
I20260709 13:00:16.965862  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:16.952273  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:16.966621  1612 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:16.967171  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:16.958370  1616 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 13:00:16.968361  1688 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:16.961045  1533 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 13:00:16.961474  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:16.951897  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:16.900601  8744 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:16.962888  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:16.946369  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:16.897962  8627 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:16.970366  1687 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 13:00:16.973953  1686 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:16.977150  1689 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 22.
I20260709 13:00:16.979844  1542 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 20.
I20260709 13:00:16.981871  1685 raft_consensus.cc:2393] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 23: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:16.944345  8803 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:16.988824  1536 raft_consensus.cc:2393] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 22: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:16.988952  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:16.990990  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 98845us
I20260709 13:00:16.993707  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:16.994398  1686 raft_consensus.cc:2393] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 19: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:16.996315  8611 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:17.002549  1614 raft_consensus.cc:2393] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 21: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 13:00:16.996651  8718 consensus_meta.cc:287] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.512s	user 0.008s	sys 0.004s
I20260709 13:00:17.007700  1609 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:17.008198  8641 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 13:00:17.008802  1611 raft_consensus.cc:2393] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 19: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:17.005802  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:17.009363  1655 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:17.009702  1536 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:16.944991  8401 consensus_queue.cc:260] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:17.011857  1690 raft_consensus.cc:2410] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:00:17.013015  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:17.018062  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:17.018805  1542 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:16.996743  8803 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:17.008004  8718 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 13:00:17.016178  1616 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 18.
W20260709 13:00:17.024643  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.028543  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:17.036340  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:17.037976  1581 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:17.042303  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:17.043358  1610 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 13:00:17.045774  1610 raft_consensus.cc:1240] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21. Ops: [18.11-20.12]
I20260709 13:00:17.047201  1655 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:17.048049  8290 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:17.048873  1655 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:17.047226  1508 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:17.050016  1655 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:17.050582  1508 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:17.051440  8769 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:17.052882  8690 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:17.053320  8690 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:17.053681  8690 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:17.056264  8830 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:17.056777  8830 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:17.057123  8830 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:17.048977  8781 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:17.058912  8781 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:17.059306  8781 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:17.060890  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:17.047324  1691 raft_consensus.cc:1240] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:17.064289  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:17.065299  1689 raft_consensus.cc:2410] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 21 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:00:17.057144  8611 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:17.067188  8611 raft_consensus.cc:697] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:17.068365  8611 consensus_queue.cc:237] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:17.070727  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:17.076660  1508 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
W20260709 13:00:17.078619  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 138388us
I20260709 13:00:17.080403  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:17.081939  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:17.082639  1686 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 24.
I20260709 13:00:17.031455  8621 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:17.089221  8830 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:17.092970  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 81181.5us
I20260709 13:00:17.093374  8401 ts_tablet_manager.cc:1434] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.542s	user 0.005s	sys 0.005s
W20260709 13:00:17.093758  8401 ts_tablet_manager.cc:1467] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579: Tablet startup took 542ms
I20260709 13:00:17.114538  1688 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
W20260709 13:00:17.118503  2266 leader_election.cc:336] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 1.976s (SENT)
I20260709 13:00:17.093043  8830 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:17.122733  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:17.098421  8621 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 13:00:17.131783  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 161185us
W20260709 13:00:17.132812  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 69026.8us
I20260709 13:00:17.134084  1536 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 13:00:17.119468  8744 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:17.137739  1581 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:17.136041  1655 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:17.135396  2267 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:17.138245  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:17.139720  1613 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 13:00:17.141021  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:17.141742  1613 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 22.
I20260709 13:00:17.142922  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:17.126466  8621 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:17.121132  8803 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:17.155007  1611 raft_consensus.cc:1240] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:17.154098  1508 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:17.154348  1612 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 13:00:17.154979  8796 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:17.155172  8828 log.cc:927] Time spent T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:00:17.156170  8837 log.cc:927] Time spent T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:00:17.157478  1686 raft_consensus.cc:1275] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:00:17.159260  8039 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:17.155172  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:17.173600  1536 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:17.168665  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:17.150164  8830 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:17.147923  8641 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:00:17.178997  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 49754.9us
I20260709 13:00:17.181084  8039 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:17.170913  8627 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:00:17.181284  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:17.181851  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 65489.7us
W20260709 13:00:17.094100  8401 ts_tablet_manager.cc:1469] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579: Trace:
0709 13:00:03.243423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.086572 (+843149us) service_pool.cc:224] Handling call
0709 13:00:04.570611 (+484039us) ts_tablet_manager.cc:934] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
0709 13:00:06.789995 (+2219384us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:00:07.598118 (+808123us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:07.610985 (+ 12867us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:00:08.119176 (+508191us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:00:08.124880 (+  5704us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:08.335238 (+210358us) ts_tablet_manager.cc:989] Replica registered.
0709 13:00:08.380869 (+ 45631us) inbound_call.cc:177] Queueing success response
0709 13:00:08.945041 (+564172us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b4c003d6840. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85b31da20 00007fc85b32ea29 00007fc85b2d35e6 00007fc85b2e8b13 00007fc85b2e8945 00007fc85b35b7ad 00007fc86202f198 00007fc86202f137 00007fc86202f09c 00007fc86202f038 00007fc86202e300
0709 13:00:12.773036 (+3827995us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:00:16.551221 (+3778185us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:00:16.836703 (+285482us) tablet_replica.cc:261] Starting instrumentation
0709 13:00:16.837327 (+   624us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":9556,"raft.queue_time_us":25467,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":115,"spinlock_wait_cycles":38058880,"tablet-copy.queue_time_us":321616,"tablet-download-pool.queue_time_us":203,"tablet-download-pool.run_cpu_time_us":1337,"tablet-download-pool.run_wall_time_us":2918472,"thread_start_us":462183,"threads_started":2}
W20260709 13:00:17.189163  2266 leader_election.cc:336] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 2.077s (SENT)
I20260709 13:00:17.190456  1581 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:17.184418  8641 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.192870  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:17.193127  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:17.193779  2295 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:17.194252  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:17.195098  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:17.195386  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:17.196574  1685 raft_consensus.cc:1240] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:17.197022  8627 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:17.144306  8290 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:00:17.195667  1540 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:17.197278  2294 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:00:17.212766  1685 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:00:17.213611  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:17.213937  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:17.214704  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:17.214838  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:17.215148  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:17.216004  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.216121  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:17.216569  1507 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:17.222921  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:17.197575  8744 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:17.199653  8803 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.231313  1536 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 23.
I20260709 13:00:17.231316  1609 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 19.
I20260709 13:00:17.204226  8641 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:17.232977  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:17.235977  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:17.236238  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.206777  8830 raft_consensus.cc:697] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:17.245754  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:17.245630  1655 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:17.249384  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:17.249709  1581 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:17.251191  2303 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:00:17.258620  1613 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 13:00:17.259865  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:17.267237  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:17.267019  8690 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:17.196434  8775 consensus_queue.cc:260] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:17.212651  8781 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:17.278779  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 145406us
I20260709 13:00:17.304899  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:17.306986  2298 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
W20260709 13:00:17.307767  2266 leader_election.cc:336] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 1.933s (SENT)
I20260709 13:00:17.309680  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:17.311333  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:17.314090  1582 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:17.315258  8689 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:00:17.323740  2266 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 2.125s (SENT) [suppressed 32 similar messages]
I20260709 13:00:17.330365  8841 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:17.330744  2266 leader_election.cc:336] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 2.388s (SENT)
I20260709 13:00:17.331565  1508 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:17.319972  8833 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:00:17.331213  8841 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:17.275869  8796 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.242162  8803 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:17.341184  1582 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:17.341859  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:17.342463  1613 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:17.342648  8039 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:17.344110  8282 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:17.343001  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:17.315395  8781 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:17.351133  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 125518us
I20260709 13:00:17.351665  1583 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:17.344347  1582 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:17.328892  8627 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:00:17.334355  8775 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:17.337651  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 121219us
I20260709 13:00:17.363006  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:17.270118  8630 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:17.368173  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.333763  8833 raft_consensus.cc:697] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 23 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:17.362129  8690 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:17.378739  8690 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:17.379259  8690 raft_consensus.cc:697] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:17.380327  8690 consensus_queue.cc:237] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:17.383934  1438 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38804 (request call id 192) took 16786 ms (client timeout 15000 ms). Trace:
I20260709 13:00:17.390159   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:00:17.392596   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:00:17.403510  8834 log.cc:927] Time spent T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.421s	user 0.001s	sys 0.002s
I20260709 13:00:17.405741  8730 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:17.409845  8646 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:17.413571  8810 raft_consensus.cc:3055] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:17.414167  8810 raft_consensus.cc:740] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:17.415217  8810 consensus_queue.cc:260] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:17.367311  8781 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:17.417689  8781 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:17.418654  1684 raft_consensus.cc:1240] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 19. Current term is 20. Ops: []
W20260709 13:00:17.369031  8642 consensus_meta.cc:287] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.774s	user 0.010s	sys 0.005s
I20260709 13:00:17.362653  8769 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:00:17.418069  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.418836  1541 raft_consensus.cc:1275] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:00:17.424564  1542 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 13:00:17.433085  1581 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:17.431110  1541 pending_rounds.cc:85] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 8
I20260709 13:00:17.358371  8796 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:17.441824  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 206528us
I20260709 13:00:17.420092  8689 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:17.437062  1541 pending_rounds.cc:107] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 13.9
W20260709 13:00:17.446561  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 110621us
I20260709 13:00:17.445362  1541 raft_consensus.cc:2889] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:17.463204  8689 raft_consensus.cc:697] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:17.444952  8039 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:17.447968  8718 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.481412  8651 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.112s
I20260709 13:00:17.481778  8689 consensus_queue.cc:237] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:17.482499  8748 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:17.483647  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 50689.3us
I20260709 13:00:17.484673  8718 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:17.486950  8718 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:17.490206  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.492199  8850 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:17.493099  8627 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:17.493620  8627 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:00:17.498294  1608 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 13:00:17.500378  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 3742) took 1024 ms. Trace:
I20260709 13:00:17.500837  1608 rpcz_store.cc:276] 0709 13:00:16.475677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.509943 (+ 34266us) service_pool.cc:224] Handling call
0709 13:00:17.500149 (+990206us) spinlock_profiling.cc:243] Waited 957 ms on lock 0x7b54002567d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:17.500274 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2200957184}
I20260709 13:00:17.502157  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:17.503356  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:17.371155  8830 consensus_queue.cc:237] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:17.512288  1613 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 23.
I20260709 13:00:17.513890  1613 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:17.514870  1608 raft_consensus.cc:1275] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:00:17.515801  2269 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:17.546056  1583 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:17.459514  8810 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:17.465700  2295 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 22.
I20260709 13:00:17.469861  8805 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:00:17.573582  8846 log.cc:927] Time spent T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:00:17.574795  8796 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:17.575968  8796 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:17.422425  1438 rpcz_store.cc:269] 0709 13:00:00.597264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.597398 (+   134us) service_pool.cc:224] Handling call
0709 13:00:17.383646 (+16786248us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:14.135913 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:14.276050 (+140137us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:14.276090 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:00:14.276104 (+    14us) tablet.cc:662] Decoding operations
0709 13:00:14.299222 (+ 23118us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:14.303720 (+  4498us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:14.313833 (+ 10113us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:00:14.377772 (+ 63939us) tablet.cc:701] Row locks acquired
0709 13:00:14.381760 (+  3988us) write_op.cc:260] PREPARE: finished
0709 13:00:14.393468 (+ 11708us) write_op.cc:270] Start()
0709 13:00:14.438221 (+ 44753us) write_op.cc:276] Timestamp: P: 1783602014390194 usec, L: 0
0709 13:00:14.441476 (+  3255us) op_driver.cc:348] REPLICATION: starting
0709 13:00:14.604441 (+162965us) log.cc:844] Serialized 919 byte log entry
0709 13:00:16.035938 (+1431497us) op_driver.cc:464] REPLICATION: finished
0709 13:00:16.378069 (+342131us) write_op.cc:301] APPLY: starting
0709 13:00:16.378241 (+   172us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:16.537677 (+159436us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:16.548061 (+ 10384us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:16.549678 (+  1617us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:16.549962 (+   284us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 13:00:16.550005 (+    43us) write_op.cc:312] APPLY: finished
0709 13:00:16.550407 (+   402us) log.cc:844] Serialized 33 byte log entry
0709 13:00:16.550626 (+   219us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:16.550768 (+   142us) write_op.cc:454] Released schema lock
0709 13:00:16.550853 (+    85us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:16.551418 (+   565us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:16.551442 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":292114,"apply.run_cpu_time_us":7616,"apply.run_wall_time_us":187173,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12491,"num_ops":2,"prepare.queue_time_us":317381,"prepare.run_cpu_time_us":17170,"prepare.run_wall_time_us":684093,"raft.queue_time_us":172785,"raft.run_cpu_time_us":16132,"raft.run_wall_time_us":202703,"replication_time_us":1594136,"thread_start_us":654219,"threads_started":4,"wal-append.queue_time_us":872438,"wal-append.run_cpu_time_us":22276,"wal-append.run_wall_time_us":2061682}]]}
I20260709 13:00:17.457141  8833 consensus_queue.cc:237] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:17.555720  8841 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:17.556782  8705 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:00:17.516985  8630 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:17.564729  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:17.597764  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.567662  8627 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:17.585314  1540 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
W20260709 13:00:17.592048  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 119203us
W20260709 13:00:17.594272  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.521129  1615 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 13:00:17.583487  8621 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:17.598166  1616 raft_consensus.cc:2410] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 23 because replica has last-logged OpId of term: 22 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 17.
I20260709 13:00:17.594105  8705 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.576447  8796 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:17.550899  8769 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.598734  8282 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:17.612223  8769 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:17.613555  8796 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:17.614419  8769 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:17.548802  8718 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 13:00:17.615768  8627 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 27 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:17.620064  1611 raft_consensus.cc:1240] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:17.620389  1617 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 25.
I20260709 13:00:17.621744  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:17.622502  1608 raft_consensus.cc:2376] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 15. Re-sending same reply.
I20260709 13:00:17.624488  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:17.625128  1613 raft_consensus.cc:2376] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 21. Re-sending same reply.
I20260709 13:00:17.578712  8641 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:17.627992  8641 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:17.629176  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:17.629436  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:17.629900  1609 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 14.
I20260709 13:00:17.598377  8039 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:17.631151  8039 raft_consensus.cc:697] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:17.632182  8039 consensus_queue.cc:237] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:17.577481  8803 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:17.619992  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 3746) took 1142 ms. Trace:
I20260709 13:00:17.620755  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 3845) took 1037 ms. Trace:
I20260709 13:00:17.637667  1690 rpcz_store.cc:276] 0709 13:00:16.583122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.609619 (+ 26497us) service_pool.cc:224] Handling call
0709 13:00:17.620520 (+1010901us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b54002891d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:17.620685 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":891077888}
I20260709 13:00:17.636982  1614 rpcz_store.cc:276] 0709 13:00:16.477198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.535292 (+ 58094us) service_pool.cc:224] Handling call
0709 13:00:17.619756 (+1084464us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b54002ff654. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:17.619921 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":546986880}
W20260709 13:00:17.644285  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.611706  8705 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:00:17.650575  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:17.651216  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 316274us
I20260709 13:00:17.651312  1609 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 17.
I20260709 13:00:17.638500  8744 raft_consensus.cc:697] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:17.656052  1655 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:17.657328  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 291429us
I20260709 13:00:17.663924  1614 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:00:17.664503  1505 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:17.664769  2266 leader_election.cc:336] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 2.079s (SENT)
I20260709 13:00:17.665223  2266 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:17.665943  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.641853  8646 consensus_queue.cc:1059] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:00:17.669795  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:17.667948  1655 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:17.669795  1505 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:17.674252  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:17.675666  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:17.676369  1609 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:17.676611  1540 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:17.677496  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:17.671952  1507 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:17.648244  8691 consensus_queue.cc:1048] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:00:17.678118  1611 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 13:00:17.647876  8282 consensus_queue.cc:1059] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:00:17.661269  8642 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.686406  1608 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 16.
I20260709 13:00:17.688599  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:17.687346  1507 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:17.677114  8690 raft_consensus.cc:2764] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:00:17.655143  8748 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.023s
I20260709 13:00:17.694522  1542 raft_consensus.cc:1275] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:00:17.694664  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:17.695562  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:17.703125  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:17.695819  1533 raft_consensus.cc:1240] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 19. Current term is 20. Ops: [18.12-19.13]
I20260709 13:00:17.654361  8627 consensus_queue.cc:1059] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:00:17.672199  8796 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:17.701632  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:17.703320  1538 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 13:00:17.671677  8851 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.683729  8641 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:17.705536  1654 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:17.677510  8793 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:17.663395  8730 consensus_queue.cc:1059] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:00:17.717829  1609 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 19.
I20260709 13:00:17.704842  1540 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 13:00:17.727545  8796 raft_consensus.cc:697] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:17.735267  8796 consensus_queue.cc:237] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:17.735857  8730 raft_consensus.cc:3055] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:17.735127  1541 raft_consensus.cc:2393] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 23: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:17.671988  8769 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.043s
I20260709 13:00:17.672104  8630 consensus_queue.cc:1048] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
W20260709 13:00:17.737534  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.749830  1540 raft_consensus.cc:1240] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 19. Current term is 20. Ops: []
W20260709 13:00:17.774490  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 109734us
I20260709 13:00:17.758922  8713 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:17.760226  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:17.777652  1534 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 19.
I20260709 13:00:17.762121  8841 consensus_queue.cc:1059] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:17.744781  8646 raft_consensus.cc:3055] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:17.764941  8858 raft_consensus.cc:2804] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:17.765781  1538 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:00:17.757849  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:17.692641  8642 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:17.791678  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 121960us
I20260709 13:00:17.794153  2267 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:17.795476  1505 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:17.749173  8730 raft_consensus.cc:740] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:17.796973  8588 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.797698  8290 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:17.805564  8290 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:17.807387  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:17.808104  8290 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:17.785537  8646 raft_consensus.cc:740] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:17.793908  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:17.799307  8588 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:17.800432  1616 raft_consensus.cc:1275] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:00:17.800523  8858 raft_consensus.cc:697] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:17.751649  8690 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:00:17.797322  8730 consensus_queue.cc:260] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:17.801537  8621 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:17.804840  1542 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 14.
I20260709 13:00:17.811322  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:17.815357  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:17.819556  8803 raft_consensus.cc:3055] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:17.746219  8851 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:17.798717  8841 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:17.829437  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:17.782232  8713 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:17.765833  8849 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:17.815672  1435 catalog_manager.cc:5697] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 16 to 19, leader changed from 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 19 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:17.746501  8714 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.082s
I20260709 13:00:17.843688  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 13:00:17.845168  2266 leader_election.cc:336] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 2.147s (SENT)
W20260709 13:00:17.846287  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 50915.2us
W20260709 13:00:17.777101  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 445608us
I20260709 13:00:17.875087  1656 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:17.881138  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:17.874506  1540 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:00:17.883270  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.908435  2266 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:17.884094  1536 raft_consensus.cc:2393] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 21: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:17.799270  8705 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:17.782792  8744 consensus_queue.cc:237] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:17.891073  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:17.894840  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:17.912882  1609 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 16.
I20260709 13:00:17.890419  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:17.902567  1617 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:00:17.892620  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:17.914294  1613 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 17.
I20260709 13:00:17.891817  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:17.914399  1614 raft_consensus.cc:2410] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:00:17.893479  1541 raft_consensus.cc:1240] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:17.902465  1612 raft_consensus.cc:2410] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for term 23 because replica has last-logged OpId of term: 22 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 17.
I20260709 13:00:17.891382  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:17.911276  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 205872us
I20260709 13:00:17.910055  1508 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:17.913576  1656 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:17.917272  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:17.906917  1505 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:17.874094  8796 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:17.928925  1611 raft_consensus.cc:2376] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 28. Re-sending same reply.
I20260709 13:00:17.889521  8730 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:17.884617  8690 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:17.956765  8690 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:00:17.881608  8805 raft_consensus.cc:3055] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:17.960706  8805 raft_consensus.cc:740] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:17.961917  8805 consensus_queue.cc:260] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:17.963325  8805 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:17.929697  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:17.965080  1686 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 23.
I20260709 13:00:17.930171  8621 raft_consensus.cc:2764] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:00:17.930574  8777 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:17.966711  8777 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:17.874114  8855 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:17.969251  8777 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:17.902051  8803 raft_consensus.cc:740] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:17.965143  1684 raft_consensus.cc:1240] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:17.970974  8803 consensus_queue.cc:260] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:17.903095  8841 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.890287  8646 consensus_queue.cc:260] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:17.974684  8855 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:17.975111  8855 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:17.975446  8855 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:17.919190  8849 raft_consensus.cc:697] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:17.976890  8849 consensus_queue.cc:237] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:17.933239  1537 raft_consensus.cc:1240] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:17.980558  8841 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:17.934304  1534 raft_consensus.cc:1240] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:00:17.972836  1654 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:17.935225  1435 catalog_manager.cc:5697] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 18 to 19, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 19 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:17.937722  8705 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 27 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:17.982872  1537 raft_consensus.cc:1240] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:17.983163  1654 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:17.911202  8848 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.027s
I20260709 13:00:17.938795  1615 raft_consensus.cc:1240] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:17.939774  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:17.940572  8874 log.cc:927] Time spent T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.053s	user 0.000s	sys 0.002s
I20260709 13:00:17.940421  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:17.997854  1613 raft_consensus.cc:2410] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for term 23 because replica has last-logged OpId of term: 22 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 17.
I20260709 13:00:17.941152  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:17.998646  1612 raft_consensus.cc:2376] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 19. Re-sending same reply.
I20260709 13:00:17.941828  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:17.999285  1537 raft_consensus.cc:1240] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: [15.11-15.11]
W20260709 13:00:17.945076  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 113337us
W20260709 13:00:18.000356  2266 leader_election.cc:336] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 1.829s (SENT)
I20260709 13:00:18.000782  2266 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:18.002024  2266 leader_election.cc:336] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 2.742s (SENT)
I20260709 13:00:17.945710  8718 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:17.946141  1656 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:17.948365  1505 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:17.948693  8833 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:17.949070  8856 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:00:17.953807  8796 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:17.905364  8713 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:17.969714  1583 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:17.891633  8642 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:17.893105  8588 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:17.973419  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 63444.5us
I20260709 13:00:18.019670  1508 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:17.934775  1536 raft_consensus.cc:1240] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:17.982342  1540 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 21.
I20260709 13:00:17.996097  1435 catalog_manager.cc:5697] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 16 to 17, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 17 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:18.004693  1534 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:00:17.972443  8803 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:00:18.007277  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 61264.8us
I20260709 13:00:17.983429  8793 raft_consensus.cc:697] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:18.008662  1654 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:18.011307  2299 raft_consensus.cc:1240] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 13. Current term is 14. Ops: []
W20260709 13:00:18.012496  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 64208.1us
I20260709 13:00:18.010707  1608 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:00:18.015245  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:18.017354  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:18.026209  1656 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:18.007288  8646 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:00:18.081425  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 55329.2us
I20260709 13:00:18.084097  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:18.018581  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:18.028892  1508 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:18.029680  8850 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:18.087644  2267 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:18.030174  8856 raft_consensus.cc:697] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:18.030697  8862 consensus_queue.cc:1059] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:00:18.031580  8714 consensus_queue.cc:1059] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:18.033922  1435 catalog_manager.cc:5697] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 13 to 15, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 15 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:18.006177  8777 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:18.040994  1686 raft_consensus.cc:1240] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:18.025152  8748 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:18.042434  2297 raft_consensus.cc:1240] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:00:18.043475  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:18.013680  8718 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:18.006444  8864 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:18.024931  8769 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:18.045462  2300 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:00:18.043443  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:18.046092  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:18.047366  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:18.047794  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:18.105803  1609 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 17.
I20260709 13:00:18.048563  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:18.106807  1614 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:18.049396  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:18.049446  1627 tablet_copy_service.cc:342] P c262eac7fc904ae9bb91e450f6532e3f: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-9324141fa1ba48aca59e97123ca5742e received from {username='slave'} at 127.0.0.1:58006
I20260709 13:00:18.049837  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:18.050493  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:18.112576  1612 raft_consensus.cc:2376] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 19. Re-sending same reply.
I20260709 13:00:18.052042  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:18.053084  2266 leader_election.cc:336] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 2.182s (SENT)
I20260709 13:00:18.060351  1688 raft_consensus.cc:1240] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:18.113652  1613 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 20.
W20260709 13:00:18.079366  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 70787.2us
I20260709 13:00:18.079914  1617 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 14.
I20260709 13:00:18.089722  8611 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:00:18.009711  8830 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:18.087502  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:18.096916  1686 raft_consensus.cc:1240] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:18.100337  2302 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 23.
I20260709 13:00:18.108043  1535 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:18.109305  1540 raft_consensus.cc:1240] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 19. Current term is 20. Ops: [18.12-19.13]
I20260709 13:00:18.051855  1684 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:18.088260  8833 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:18.080152  1505 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:18.104512  1435 catalog_manager.cc:5697] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 19 to 21, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 21 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:18.089545  2294 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 13:00:18.116250  1654 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:18.024878  8125 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.082s
I20260709 13:00:18.118618  1617 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 13:00:18.124639  1627 tablet_copy_service.cc:434] P c262eac7fc904ae9bb91e450f6532e3f: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-9324141fa1ba48aca59e97123ca5742e on tablet 9324141fa1ba48aca59e97123ca5742e with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:18.134536  2298 raft_consensus.cc:1240] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:18.125624  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:18.126945  8713 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:18.127923  2295 raft_consensus.cc:2368] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 17. Current term is 18.
I20260709 13:00:18.090685  8588 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:00:18.129009  1615 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:00:18.095611  8630 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:18.096464  8748 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.096657  8705 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:18.133730  1614 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 18.
W20260709 13:00:18.134945  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.136291  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:18.142366  1654 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:18.150678  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:18.147707  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:18.142829  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 114021us
W20260709 13:00:18.154798  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.195291  1608 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:18.240675  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:18.248332  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.134438  8769 raft_consensus.cc:697] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 13:00:18.261000  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:18.261673  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.253695  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:18.262953  1690 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 21.
I20260709 13:00:18.130322  8777 consensus_queue.cc:1059] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.114s
I20260709 13:00:18.193300  8705 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:18.196499  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 143447us
I20260709 13:00:17.929184  8858 consensus_queue.cc:237] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:18.192368  1435 catalog_manager.cc:5697] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:18.134644  8852 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:00:18.266769  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 124487us
I20260709 13:00:18.284813  1654 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:18.197649  8871 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:18.193674  8748 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:18.287802  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:18.270694  1616 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 17.
I20260709 13:00:18.308058  1615 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:00:18.236191  8850 raft_consensus.cc:697] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 13:00:18.310459  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.196573  8730 consensus_queue.cc:1059] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:00:18.314245  1435 catalog_manager.cc:5697] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 11 to 13, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 13 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:18.316346  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:18.288261  8705 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:18.289228  8860 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:18.280047  8621 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.355700  1608 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 21.
I20260709 13:00:18.358379  1691 raft_consensus.cc:1240] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:18.361826  1435 catalog_manager.cc:5697] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:18.320323  8852 raft_consensus.cc:697] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:18.280604  8630 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:18.335974  8781 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:18.381582  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 96845.4us
I20260709 13:00:18.383610  1654 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:18.356801  8714 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:18.361224  8869 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:18.357298  8886 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.391657  1691 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:00:18.391661  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 13:00:18.392285  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 127433us
W20260709 13:00:18.392452  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 131407us
I20260709 13:00:18.329627  8651 consensus_queue.cc:1059] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:00:18.195566  8793 consensus_queue.cc:237] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:18.398064  1508 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:18.396311  1435 catalog_manager.cc:5697] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:18.409376  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:18.250097  8856 consensus_queue.cc:237] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:18.395942  8714 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.420855  8714 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:18.421907  8713 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:18.404254  8796 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:18.424181  2294 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 27 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 26. Current term is 27. Ops: [26.17-26.17]
I20260709 13:00:18.360056  8621 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:18.414273  1682 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 14.
I20260709 13:00:18.415017  8852 consensus_queue.cc:237] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:18.418883  8873 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.300s	user 0.000s	sys 0.000s
W20260709 13:00:18.444404  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 46462.8us
I20260709 13:00:18.445446  1508 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:18.447409  1508 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:18.377120  8855 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:18.441884  1582 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
W20260709 13:00:18.429005  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 45483us
W20260709 13:00:18.439839  2266 leader_election.cc:336] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 2.173s (SENT)
I20260709 13:00:18.459638  1654 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:18.461437  8810 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:00:18.464754  8810 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:18.465396  8810 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:18.465891  8810 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:18.443367  8611 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:00:18.510139  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 50622.8us
I20260709 13:00:18.512596  1654 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:18.429535  8869 raft_consensus.cc:697] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:18.505775   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:18.515637  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:18.518373  1683 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 19.
I20260709 13:00:18.473621  1435 catalog_manager.cc:5697] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: config changed from index -1 to 16, term changed from 22 to 24, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 24 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:18.548569  1435 catalog_manager.cc:5697] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 16 to 18, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 18 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:18.572100  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 124742us
I20260709 13:00:18.412155  8886 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:18.456965  8805 consensus_queue.cc:1059] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:00:18.433646  8885 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.104s
I20260709 13:00:18.591513  8885 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:18.592228  8885 raft_consensus.cc:2764] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:00:18.592847  8885 consensus_queue.cc:1059] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:00:18.458002  8850 consensus_queue.cc:237] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:18.593676  8885 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:18.438922  8690 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:18.594331  8869 consensus_queue.cc:237] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:18.595379  1682 raft_consensus.cc:1240] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:18.595671  8886 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:18.596733  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:18.597484  1682 raft_consensus.cc:2393] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 21: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:18.585153  8777 consensus_queue.cc:1048] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:18.589826  8621 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:18.599412  1581 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:18.533390  8796 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:00:18.412362  8769 consensus_queue.cc:237] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:18.529969  8893 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:18.604374  2269 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:18.611889  8888 consensus_queue.cc:1059] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:00:18.603929  1508 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:18.610417  1435 catalog_manager.cc:5697] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 11 to 12, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 12 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:18.608600  1654 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:18.618785  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 178987us
I20260709 13:00:18.618559  1508 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
W20260709 13:00:18.622764  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 180957us
I20260709 13:00:18.594326  8885 raft_consensus.cc:3055] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:00:18.645265  1508 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:18.655741  1508 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:18.648258  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.646504  1435 catalog_manager.cc:5697] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:18.658161  1581 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:18.653955  1656 leader_election.cc:400] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Vote denied by peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437) with higher term. Message: Invalid argument: T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 17. Current term is 18.
W20260709 13:00:18.659184  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 43884.8us
I20260709 13:00:18.599108  8713 consensus_queue.cc:1059] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:00:18.625438  8888 consensus_queue.cc:1243] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 20.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:00:18.663012  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:18.647375  8886 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:18.668931  1435 catalog_manager.cc:5697] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:18.654831  8885 raft_consensus.cc:740] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 13:00:18.663791  8878 log.cc:927] Time spent T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.344s	user 0.000s	sys 0.001s
I20260709 13:00:18.646888  8887 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:18.660495  8805 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:18.663264  8860 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:00:18.682166  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:18.692087  1685 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:00:18.669361  1508 connection.cc:256] RPC call timeout handler was delayed by -1.0184126139999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1895s for a response
W20260709 13:00:18.696650  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:18.698606  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.674314  8651 raft_consensus.cc:2764] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:00:18.655330  8588 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:00:18.674086  8858 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:18.685886  1435 catalog_manager.cc:5697] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 12 to 15, leader changed from 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 15 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:18.661015  8905 consensus_queue.cc:1048] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:00:18.716826  8904 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:18.722059  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 58532.5us
I20260709 13:00:18.655042  8775 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.028s
I20260709 13:00:18.663393  8890 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:00:18.727677  1505 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.002s	sys 0.011s
W20260709 13:00:18.741832  1505 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.003s	sys 0.011s
I20260709 13:00:18.647372  8611 consensus_queue.cc:1059] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
W20260709 13:00:18.742544  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 662491us
I20260709 13:00:18.723724  2269 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:18.728024  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 119931us
I20260709 13:00:18.683000  8718 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.674532  8290 consensus_queue.cc:1059] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.050s
I20260709 13:00:18.754356  1505 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:18.750844  1435 catalog_manager.cc:5697] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 13:00:18.683558  8888 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 13:00:18.736228  8730 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.741297  8890 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.780123  2266 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:18.749131  8858 raft_consensus.cc:697] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:18.750412  8904 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:18.747560  8641 raft_consensus.cc:3055] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:18.785756  1435 catalog_manager.cc:5697] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 13 to 15, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 15 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:18.857784  1435 catalog_manager.cc:5697] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 13:00:18.772804  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 121019us
W20260709 13:00:18.788373  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:18.859539  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.789202  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:18.860575  1608 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 13:00:18.814747  1687 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:00:18.814556  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:18.828099  8858 consensus_queue.cc:237] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:18.861537  1614 raft_consensus.cc:2393] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 19: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:18.810943  1613 raft_consensus.cc:3055] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:18.809850  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:18.862522  1613 raft_consensus.cc:740] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:18.825882  8911 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:00:18.812141  1505 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:18.823812  8690 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:18.814213  8789 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:00:18.812193  8646 consensus_meta.cc:287] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.724s	user 0.008s	sys 0.003s
I20260709 13:00:18.788870  8855 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:18.814308  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:18.816763  8894 log.cc:927] Time spent T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:00:18.880117  8903 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:18.880770  8903 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:18.808930  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:18.817490  8889 log.cc:927] Time spent T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:00:18.819185  1609 raft_consensus.cc:1275] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:00:18.815670  1612 raft_consensus.cc:1275] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:00:18.816222  8290 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:18.862217  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:18.883718  1608 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 21.
I20260709 13:00:18.810446  8621 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:18.869390  1435 catalog_manager.cc:5697] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:18.830775  8841 consensus_meta.cc:287] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.850s	user 0.007s	sys 0.003s
I20260709 13:00:18.776607  8125 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.088s
I20260709 13:00:18.765897  8718 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:18.784819  8890 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:18.912573  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:18.913810  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:18.914513  1683 raft_consensus.cc:2393] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 13: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:18.915221  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:18.856796  8641 raft_consensus.cc:740] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
W20260709 13:00:18.874747  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 94735.5us
I20260709 13:00:18.874930  8810 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:18.876540  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 83041us
I20260709 13:00:18.919027  1505 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:18.810765  8769 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:18.787592  8895 raft_consensus.cc:3055] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:18.884747  8886 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:18.883038  8903 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:18.890636  1581 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:18.928026  1581 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:18.891016  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:18.888738  1435 catalog_manager.cc:5697] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 12 to 13, leader changed from 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 13 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:18.871562  1613 consensus_queue.cc:260] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:18.894037  1654 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 13:00:18.897861  8748 consensus_meta.cc:287] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.566s	user 0.010s	sys 0.000s
I20260709 13:00:18.887008  8914 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.895248  8869 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.939133  1505 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:18.939944  1654 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:18.899507  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:18.889671  8705 consensus_meta.cc:287] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.529s	user 0.011s	sys 0.000s
I20260709 13:00:18.811667  8730 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:18.906438  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:18.907498  8893 raft_consensus.cc:3055] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:18.911448  1614 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 26. Current term is 27. Ops: []
I20260709 13:00:18.919916  8769 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:18.933516  1686 raft_consensus.cc:2393] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 16: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 13:00:18.934188  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.929371  8642 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:18.935223  1613 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:18.964659  1508 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:18.936209  1435 catalog_manager.cc:5697] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 17 to 18, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 18 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:18.965466  1542 raft_consensus.cc:1275] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:00:18.896633  8841 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:18.948261  8914 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:18.949138  8869 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:18.949998  8921 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:00:18.952440  8876 log.cc:927] Time spent T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.701s	user 0.004s	sys 0.000s
I20260709 13:00:18.952553  8641 consensus_queue.cc:260] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:18.964236  8769 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:18.963924  8781 consensus_queue.cc:1048] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 13:00:18.962740  8903 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:18.976861  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1128) took 1278 ms. Trace:
I20260709 13:00:18.962399  8893 raft_consensus.cc:740] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:18.978147  8893 consensus_queue.cc:260] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:18.895808  8621 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:18.921609  8775 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.031s
I20260709 13:00:18.778982  8885 consensus_queue.cc:260] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:19.000240  8885 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:00:19.001421  8905 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.001987  8905 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:19.003743  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:18.953594  8871 consensus_meta.cc:287] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.631s	user 0.010s	sys 0.001s
I20260709 13:00:18.998270  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:19.004860  8871 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:18.956773  1610 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 13:00:19.005856  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:19.006702  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:19.006886  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:19.007321  1610 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 21.
I20260709 13:00:19.008051  8290 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:18.958945  8904 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:18.918584  8714 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:18.960575  1615 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:19.007967  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:18.953501  2266 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:18.934422  1581 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:18.921229  8895 raft_consensus.cc:740] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:18.931190  8690 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:00:18.946854  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:18.967480  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:19.014740  1608 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:18.970198  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:18.933035  8886 raft_consensus.cc:697] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:18.973533  1535 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:18.969892  8855 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:00:18.971994  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:18.975224  8810 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:18.962611  8793 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:18.980182  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:18.960309  8748 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:18.977295  1533 rpcz_store.cc:276] 0709 13:00:17.698348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.721977 (+ 23629us) service_pool.cc:224] Handling call
0709 13:00:17.733284 (+ 11307us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:17.768843 (+ 35559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:17.768875 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:17.769672 (+   797us) log.cc:844] Serialized 52 byte log entry
0709 13:00:17.985889 (+216217us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:00:17.985925 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:17.985989 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:18.951604 (+965615us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 13:00:18.976566 (+ 24962us) raft_consensus.cc:1685] finished
0709 13:00:18.976593 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:18.976799 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34918,"raft.queue_time_us":62941,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":144,"spinlock_wait_cycles":62032640,"thread_start_us":215785,"threads_started":1,"wal-append.queue_time_us":335850}
I20260709 13:00:18.975351  8921 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 13:00:19.036330  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 82928.5us
I20260709 13:00:18.984306  1613 raft_consensus.cc:1275] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:00:18.978967  8841 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:18.986380  8912 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:00:18.987962  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:18.991516  1685 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 27.
I20260709 13:00:18.992210  8919 raft_consensus.cc:2804] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:18.993672  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:18.996233  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:18.997712  8611 consensus_queue.cc:1048] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:00:19.004531  1612 raft_consensus.cc:2393] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 27: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:18.957742  8718 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:18.964447  8777 consensus_queue.cc:1048] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:00:18.962786  8705 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:19.008424  1610 raft_consensus.cc:1240] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:19.013337  1536 raft_consensus.cc:1240] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
W20260709 13:00:19.017686  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 83351.8us
I20260709 13:00:19.024449  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:19.055060  2269 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:18.981297  8641 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:19.030230  8642 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:19.035279  8886 consensus_queue.cc:237] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:19.036705  8895 consensus_queue.cc:260] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:19.011168  8730 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:19.044679  1611 raft_consensus.cc:2368] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for earlier term 23. Current term is 24.
I20260709 13:00:19.045253  1691 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:19.005913  8914 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:19.048969  1683 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 26. Current term is 27. Ops: [24.16-26.17]
I20260709 13:00:19.018384  8905 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:19.013396  8630 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:19.045361  1687 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 7.
I20260709 13:00:19.055751  1610 raft_consensus.cc:1240] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:19.055714  1608 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:19.042845  8921 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:19.032727  8793 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.012997  8890 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:19.059906  1685 raft_consensus.cc:1240] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:00:19.062279  8714 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:19.060961  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:19.064280  1581 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:19.066074  1537 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 21.
I20260709 13:00:19.065775  1614 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 17.
I20260709 13:00:19.066998  2266 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:19.029678  8775 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:19.028630  1615 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 21.
I20260709 13:00:19.089921  2269 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:19.065755  8718 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:00:19.090499  1581 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:19.096966  1608 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:19.085335  8793 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:00:19.105268  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.105683  2266 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:19.092931  8895 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:19.092667  8905 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:00:19.112563  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:19.102831  8730 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:00:19.100164  8841 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:19.101403  8919 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:19.101715  8718 raft_consensus.cc:697] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 27 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:19.118551  8039 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:19.125698  8775 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:19.103562  8651 consensus_queue.cc:1059] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:00:19.101131  8125 raft_consensus.cc:2804] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:19.137063  1691 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 20.
I20260709 13:00:19.118330  1581 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:19.163162  8890 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:19.157814  8125 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.165025  8125 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:19.165158  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:19.166002  1617 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:19.106106  8922 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.050s
I20260709 13:00:19.171291  8769 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:19.114449  8810 consensus_queue.cc:1059] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:00:19.174109  8810 raft_consensus.cc:3055] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:19.161768  1581 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:19.175236  1538 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 27 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 26. Current term is 27. Ops: []
I20260709 13:00:19.175544  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:19.177608  1617 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 26.
I20260709 13:00:19.177871  1608 raft_consensus.cc:2393] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 14: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:19.182631  1538 raft_consensus.cc:1275] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:00:19.184298  1538 raft_consensus.cc:1275] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:00:19.184566  8691 raft_consensus.cc:3055] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:19.185113  8691 raft_consensus.cc:740] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:19.186051  8039 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.186798  8039 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:19.187383  8718 consensus_queue.cc:237] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:19.141512  8919 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:19.195928  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 93886us
I20260709 13:00:19.195501  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:19.197250  1533 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 13:00:19.198833  2266 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:19.201010  2266 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:19.174522  8769 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:19.208684  1533 raft_consensus.cc:1275] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:00:19.212884  1655 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:19.214972  8907 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:19.215458  8907 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:19.215845  8907 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:19.216583  8833 consensus_queue.cc:1048] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:19.217092  8125 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:19.218041  8884 raft_consensus.cc:3055] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:19.218431  8884 raft_consensus.cc:740] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:19.219475  8125 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:19.219311  8884 consensus_queue.cc:260] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:19.213145  8893 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:19.220981  8888 raft_consensus.cc:3055] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:19.221478  8888 raft_consensus.cc:740] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:19.222522  8888 consensus_queue.cc:260] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:19.224087  8888 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:19.176637  8730 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:19.179981  8651 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:00:19.239182  2266 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:19.174535  8810 raft_consensus.cc:740] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:19.197901  8890 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:19.200217  8905 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.220403  8884 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:19.209893  8922 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:19.256950  1533 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:00:19.234558  8862 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.086s	user 0.012s	sys 0.008s
I20260709 13:00:19.203161  8781 consensus_queue.cc:1059] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 26.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.053s
I20260709 13:00:19.266114  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:19.266155  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:19.270093  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:19.271272  1608 raft_consensus.cc:2376] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 18. Re-sending same reply.
I20260709 13:00:19.247887  8125 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:19.269371  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:19.203012  8775 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:00:19.271735  2297 raft_consensus.cc:1240] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:19.209542  8611 consensus_queue.cc:1048] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:00:19.186127  8691 consensus_queue.cc:260] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:19.266853  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:19.265316  8862 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.153s	user 0.012s	sys 0.009s
I20260709 13:00:19.277426  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:19.289925  1690 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:19.278427  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.241019  8777 consensus_queue.cc:1048] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:00:19.275904  1614 pending_rounds.cc:85] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f: Aborting all ops after (but not including) 11
I20260709 13:00:19.299741  1614 pending_rounds.cc:107] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:00:19.281816  8923 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:19.283680  8851 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:19.274812  8860 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:00:19.296008  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:19.314694  1691 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:19.298889  1608 raft_consensus.cc:1240] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:00:19.300060  1614 raft_consensus.cc:2889] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:19.266700  8705 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:19.305223  1656 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:19.269773  8922 raft_consensus.cc:697] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:19.270560  8039 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:19.314018  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.255362  8890 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:19.257968  8918 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:00:19.258351  8905 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:19.320648  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.322088  1656 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:19.280263  8870 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.290211  8125 raft_consensus.cc:697] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 21 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:19.299773  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:19.340049  8777 consensus_queue.cc:1059] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:19.343660  1608 raft_consensus.cc:1240] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 19. Current term is 20. Ops: [17.13-19.14]
I20260709 13:00:19.351131  1691 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 15.
I20260709 13:00:19.323907  8691 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:19.342532  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:19.327275  8781 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:19.367646  1608 raft_consensus.cc:1275] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:19.336789  8833 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:19.315236  8810 consensus_queue.cc:260] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:19.379189  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 53079.1us
I20260709 13:00:19.398876  1656 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:19.338776  8870 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:19.408346  2295 raft_consensus.cc:2393] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 14: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:19.423190  1690 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 8.
I20260709 13:00:19.423590  1608 raft_consensus.cc:1275] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:00:19.404074  8833 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:19.431330  8870 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:19.433741  8890 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:19.442032  8921 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:19.443222  8907 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:19.421759  8810 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:19.445734  8793 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:19.446431  8748 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:19.406075  8125 consensus_queue.cc:237] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:19.452286  8793 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:19.455773  8869 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:19.457583  8908 log.cc:927] Time spent T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.642s	user 0.004s	sys 0.001s
I20260709 13:00:19.405813  8922 consensus_queue.cc:237] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:19.473467  2266 leader_election.cc:336] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 2.023s (SENT)
I20260709 13:00:19.481501  2266 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:19.485988  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:19.493633  1613 raft_consensus.cc:1275] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:00:19.444334  8921 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:19.483952  8691 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:19.487514  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:19.538151  1609 raft_consensus.cc:1275] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:00:19.541301  1609 pending_rounds.cc:85] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f: Aborting all ops after (but not including) 10
I20260709 13:00:19.541711  1609 pending_rounds.cc:107] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:00:19.542232  1609 raft_consensus.cc:2889] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:19.500711  8858 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:19.505195  8705 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:00:19.544965  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 71536.1us
W20260709 13:00:19.546980  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.547775  8858 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:19.537292  8848 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 13:00:19.553117  8879 log.cc:927] Time spent T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 1.428s	user 0.000s	sys 0.004s
W20260709 13:00:19.554844  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:19.555364  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:19.555891  8896 log.cc:927] Time spent T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.765s	user 0.002s	sys 0.004s
I20260709 13:00:19.560178  1505 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:19.557418  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:19.565464  1539 raft_consensus.cc:2393] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 16: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:19.565219  1505 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:19.566936  1505 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:19.569213  1505 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:19.569682  1616 raft_consensus.cc:3055] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:19.570576  1616 raft_consensus.cc:740] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 13:00:19.573273  8947 log.cc:927] Time spent T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:00:19.571384  1616 consensus_queue.cc:260] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:19.541503  8691 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:19.550209  2295 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 19.
I20260709 13:00:19.589075  1616 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:19.593546  8691 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:19.568783  8705 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.568379  8769 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:19.574834  8884 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:00:19.600853  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.596897  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:19.614708  1505 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:19.583113  8907 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:19.556435  8848 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:19.587829  8905 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:19.620992  1616 raft_consensus.cc:1275] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:00:19.597350  8851 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:00:19.625833  1507 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:19.626536  1505 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:19.616365  8952 log.cc:927] Time spent T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:00:19.627812  1505 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:19.628072  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:19.629586  1539 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:00:19.614311  8705 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:19.630726  8714 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:00:19.641042  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 69318.8us
W20260709 13:00:19.641834  8955 log.cc:927] Time spent T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:00:19.644239  8705 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:19.636349  8856 consensus_queue.cc:1048] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:00:19.645467  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:19.646057  1608 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 10.
I20260709 13:00:19.646173  8856 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:19.646674  8856 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:19.648173  8856 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:19.631188  8803 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 22 current term: 22 is higher.
I20260709 13:00:19.628886  8884 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:19.644835  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:19.630697  8885 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:19.653277  8885 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.653725  8885 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:19.654000  8864 raft_consensus.cc:3055] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:19.640182  8769 consensus_queue.cc:1048] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:00:19.654489  8864 raft_consensus.cc:740] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:19.668694  8864 consensus_queue.cc:260] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:19.669921  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:19.633255  8849 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:00:19.671213  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:19.671454  8849 raft_consensus.cc:697] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:19.672492  8849 consensus_queue.cc:237] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:19.672806  8919 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:19.676654  8919 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:19.677163  1684 raft_consensus.cc:1240] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:19.677325  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:19.677902  2297 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:19.656977  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4498) took 1392 ms. Trace:
I20260709 13:00:19.679302  1535 rpcz_store.cc:276] 0709 13:00:18.264266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.264423 (+   157us) service_pool.cc:224] Handling call
0709 13:00:18.310062 (+ 45639us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:19.026136 (+716074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:19.656717 (+630581us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b54002193d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:19.656914 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1525559168}
I20260709 13:00:19.680554  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:19.682145  2269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:19.685050  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.660962  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:19.664881  1683 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:00:19.665406  1690 raft_consensus.cc:1240] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:19.665931  1687 raft_consensus.cc:1240] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:19.711548  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:19.712033  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:19.716825  1611 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 1030) took 1667 ms (client timeout 2023 ms). Trace:
I20260709 13:00:19.718302  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:19.719229  1535 raft_consensus.cc:2410] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 29 because replica has last-logged OpId of term: 28 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 16.
W20260709 13:00:19.717762  1611 rpcz_store.cc:269] 0709 13:00:18.048978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.049171 (+   193us) service_pool.cc:224] Handling call
0709 13:00:19.712994 (+1663823us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b54002a62d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:19.716753 (+  3759us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2141085952}
I20260709 13:00:19.720651  1684 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:19.724146  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:19.725461  1686 raft_consensus.cc:1240] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:19.724730  1690 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:19.661832  8848 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:19.656153  8789 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:19.726322  2266 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:19.728428  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:19.669932  8864 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:19.662158  8858 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:19.687002  8884 raft_consensus.cc:697] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:19.665767  8621 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:19.731094  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:19.743849  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:19.744563  1535 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:19.730515  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:19.745173  1687 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 23.
I20260709 13:00:19.706275  8922 consensus_queue.cc:1059] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:00:19.734886  8789 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:00:19.758428  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 122105us
I20260709 13:00:19.759621  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:19.761144  2298 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:00:19.764170  1690 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 24.
I20260709 13:00:19.769971  1611 raft_consensus.cc:1275] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:00:19.770370  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:19.774633  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:19.777618  1613 raft_consensus.cc:1275] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:00:19.777980  1610 raft_consensus.cc:1275] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:00:19.779013  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:19.779753  1614 raft_consensus.cc:2393] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 20: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:19.781287  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:19.765944  8888 consensus_meta.cc:287] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.000s
I20260709 13:00:19.772145  1655 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:19.781359  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:19.786708  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.788833  2297 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 24.
I20260709 13:00:19.767385  8646 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.793552  8646 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:19.794361  8642 raft_consensus.cc:3055] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:19.794768  8642 raft_consensus.cc:740] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:19.795938  8621 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:19.796373  8621 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.796728  8621 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:19.796963  8691 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:00:19.778867  8884 consensus_queue.cc:237] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:19.799706  2295 raft_consensus.cc:1275] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:00:19.796643  8905 consensus_queue.cc:1059] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:00:19.802314  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:19.803728  1534 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 27 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 26. Current term is 27. Ops: []
I20260709 13:00:19.793802  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:19.806905  1535 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 13:00:19.808318  1535 raft_consensus.cc:1240] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:00:19.769753  8923 raft_consensus.cc:2804] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:19.817425  1583 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 13:00:19.817649  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 51098.6us
I20260709 13:00:19.819967  1583 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:19.766487  8848 consensus_queue.cc:1048] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:00:19.821290  2297 raft_consensus.cc:1275] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:19.822636  1582 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:19.825701  1582 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:19.826887  8810 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:19.823342  1583 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:19.769371  8849 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:00:19.769882  8769 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:00:19.811641  8858 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:19.835708  1583 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:19.822480  8905 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:19.829051  8903 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:00:19.824290  8886 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:19.828336  8923 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.836239  8748 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.835753  8810 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:19.827649  8950 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 13:00:19.837635  8039 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:19.840720  8858 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:19.850710  8903 raft_consensus.cc:697] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 24 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:19.870966  8858 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:19.870659  8903 consensus_queue.cc:237] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:19.848793  8923 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:19.849547  2295 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEARNER]: Advancing to term 19
I20260709 13:00:19.873670  8621 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:19.883682  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:19.884337  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:19.837764  8963 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:00:19.852129  8748 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:19.887476  8793 consensus_queue.cc:1059] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 26.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:00:19.887907  8748 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:19.861254  8871 raft_consensus.cc:3055] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:00:19.888999  8871 raft_consensus.cc:740] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:19.889874  8871 consensus_queue.cc:260] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:19.891033  8871 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:00:19.849668  8886 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:19.844687  8895 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:19.863942  2269 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:19.893044  8886 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:19.893214  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:19.893775  2269 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:19.893944  1542 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 13:00:19.894873  8918 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:19.895378  8918 raft_consensus.cc:697] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:19.896371  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1143) took 1448 ms. Trace:
I20260709 13:00:19.896849  2269 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:19.896443  8918 consensus_queue.cc:237] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:19.895412  1542 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:00:19.839968  8905 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.875016  1581 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:19.855732  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:19.877123  2299 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 13:00:19.925755  2299 pending_rounds.cc:85] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579: Aborting all ops after (but not including) 12
I20260709 13:00:19.926084  2299 pending_rounds.cc:107] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 13:00:19.926349  2299 raft_consensus.cc:2889] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:19.896799  1536 rpcz_store.cc:276] 0709 13:00:18.448550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.448724 (+   174us) service_pool.cc:224] Handling call
0709 13:00:18.449129 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:19.056186 (+607057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:19.896102 (+839916us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b5400073ad4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:19.896310 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1297151744}
I20260709 13:00:19.881088  2301 raft_consensus.cc:1240] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:00:19.882414  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:19.927856  1541 raft_consensus.cc:2393] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 13: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:19.883251  8744 raft_consensus.cc:3055] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:19.934377  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33206 (request call id 1060) took 1528 ms. Trace:
I20260709 13:00:19.896541  8917 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:19.934926  1689 rpcz_store.cc:276] 0709 13:00:18.391099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.391352 (+   253us) service_pool.cc:224] Handling call
0709 13:00:19.903913 (+1512561us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b5400159854. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:19.919541 (+ 15628us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":810224512}
I20260709 13:00:19.921168  1654 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:19.922565  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:19.867937  2303 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 21.
I20260709 13:00:19.923512  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:19.935809  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 82021us
W20260709 13:00:19.938064  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 63164.7us
I20260709 13:00:19.944890  1581 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:19.941351  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 105735us
I20260709 13:00:19.948233  1689 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
W20260709 13:00:19.993896  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 49085.6us
I20260709 13:00:19.933933  8905 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:19.992914  8895 consensus_queue.cc:1059] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:00:19.995396  1581 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:19.993309  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:19.997052  1617 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:00:19.997459  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 76404.5us
I20260709 13:00:19.998324  1654 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:19.925134  8705 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.950367  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:19.951474  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:20.002331  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:20.005837  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:19.933966  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:19.933939  8969 raft_consensus.cc:2804] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:20.072824  1682 raft_consensus.cc:1240] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:00:20.073246  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:20.076367  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 78146us
I20260709 13:00:20.008152  2301 raft_consensus.cc:1275] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:00:19.934700  8744 raft_consensus.cc:740] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:20.089882  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:20.090608  1533 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:20.075291  1537 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:00:20.096246  1688 raft_consensus.cc:1240] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:20.096285  1612 raft_consensus.cc:1240] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:19.940840  8691 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:00:20.112636  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:20.114513  1542 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:20.006778  8860 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:00:20.131968  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 188092us
I20260709 13:00:20.088680  8714 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:20.113716  8948 log.cc:927] Time spent T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:00:20.101893  8793 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:20.141762  1617 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 22.
W20260709 13:00:20.144069  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.071583  8705 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:20.112708  8921 consensus_queue.cc:1048] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:00:19.946076  8789 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:20.240625  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:20.253654  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 178792us
I20260709 13:00:20.244599  1533 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 15.
W20260709 13:00:20.208591  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 266423us
I20260709 13:00:20.180217  1542 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 20.
I20260709 13:00:20.108954  8981 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:00:20.217311  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 219764us
I20260709 13:00:20.139156  2296 raft_consensus.cc:1240] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 20. Current term is 21. Ops: []
W20260709 13:00:20.234246  8973 log.cc:927] Time spent T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:00:20.146773  8744 consensus_queue.cc:260] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:20.143069  8714 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:20.353776  2300 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:20.310482  2303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32802 (request call id 721) took 1058 ms. Trace:
I20260709 13:00:20.311805  8744 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:00:20.313048  8977 log.cc:927] Time spent T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:00:20.314512  1537 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 8.
I20260709 13:00:20.134097  8885 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:20.319404  8830 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:20.329892  8642 consensus_queue.cc:260] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:20.332720  8950 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.333652  8969 raft_consensus.cc:697] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 8 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:20.334184  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:20.189896  8748 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:20.249989  8895 consensus_queue.cc:1059] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.087s
W20260709 13:00:20.338754  8975 log.cc:927] Time spent T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
W20260709 13:00:20.342118  8978 log.cc:927] Time spent T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:00:20.341634  8923 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:20.188920  8691 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.297102  8886 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:20.140837  8793 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.353057  2299 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:00:20.354537  2303 rpcz_store.cc:276] 0709 13:00:19.251963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.252072 (+   109us) service_pool.cc:224] Handling call
0709 13:00:20.310237 (+1058165us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b54008f75d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:20.310384 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1214423808}
I20260709 13:00:20.224599  8621 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:20.359053  1533 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:00:20.358964  8641 raft_consensus.cc:3055] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:20.252157  8917 raft_consensus.cc:697] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 15 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:20.368798  8748 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.149020  8967 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.205s
I20260709 13:00:20.253922  8988 consensus_queue.cc:1059] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.110s
I20260709 13:00:20.147576  8907 consensus_queue.cc:1059] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.213s
I20260709 13:00:20.376178  1535 raft_consensus.cc:1240] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 19. Current term is 20. Ops: [17.14-19.15]
W20260709 13:00:20.371578  8864 consensus_meta.cc:287] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.000s
I20260709 13:00:20.371353  2294 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 19.
W20260709 13:00:20.406159  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 287020us
I20260709 13:00:20.382843  8793 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:20.422783  1691 raft_consensus.cc:1275] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:00:20.369616  8950 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:20.412619  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 272572us
I20260709 13:00:20.325277  8611 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:20.411242  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 298496us
I20260709 13:00:20.409332  8748 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:20.404633  8641 raft_consensus.cc:740] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:20.428615  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:20.426532  1654 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:20.436019  1507 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:20.382458  8691 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:20.460513  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.459816  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:20.460568  1688 raft_consensus.cc:3055] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:20.405771  8895 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.025s
I20260709 13:00:20.417343  2295 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [term 19 LEARNER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 13:00:20.507928  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 54589.7us
I20260709 13:00:20.511487  1688 raft_consensus.cc:740] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:20.513192  1689 raft_consensus.cc:1275] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:00:20.404223  8886 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:20.429018  8938 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.522612  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:20.525343  1685 raft_consensus.cc:2368] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8.
I20260709 13:00:20.523006  8641 consensus_queue.cc:260] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:20.526400  1689 raft_consensus.cc:1275] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:00:20.537839  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:20.546568  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:20.429200  8921 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:20.523921  8810 raft_consensus.cc:3055] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:20.435106  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:20.460068  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:20.473475  8963 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.506697  8907 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:20.434520  8860 raft_consensus.cc:697] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:20.641175  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:20.690310  1683 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 22.
I20260709 13:00:20.641930  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:20.691309  1682 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:20.651335  1685 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:00:20.663491  1684 raft_consensus.cc:1240] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:00:20.471290  8884 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:20.698824  8884 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:20.699986  1656 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:20.701620  8884 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:20.702450  8884 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.703002  8884 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:20.673041  2303 raft_consensus.cc:1240] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:20.434116  8611 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:20.514024  8848 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:20.704855  8848 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:20.705363  8848 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:20.678803  8641 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:20.699012  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:20.707098  1683 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:20.703346  8630 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:20.708406  1683 raft_consensus.cc:1275] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:00:20.709851  1683 raft_consensus.cc:1275] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:00:20.706372  8611 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:20.712296  8630 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:20.713150  8993 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:20.714593  8630 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:20.715027  1682 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 26.
I20260709 13:00:20.673301  8713 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.643114  8983 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.639835  8984 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.666414  8871 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.663595  2295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32788 (request call id 666) took 1087 ms. Trace:
I20260709 13:00:20.663993  8810 raft_consensus.cc:740] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:20.715950  8713 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:20.728910  1687 raft_consensus.cc:1275] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:00:20.767866  2297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32794 (request call id 986) took 1203 ms. Trace:
I20260709 13:00:20.769327  1533 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:00:20.769626  1688 consensus_queue.cc:260] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:20.771108  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:20.846877  1688 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:20.847154  1534 raft_consensus.cc:2393] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 16: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:20.771652  8646 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:20.771888  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:20.673547  8921 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:20.809088  1541 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.015s	sys 0.033s
I20260709 13:00:20.845762  2297 rpcz_store.cc:276] 0709 13:00:19.564292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.811232 (+246940us) service_pool.cc:224] Handling call
0709 13:00:19.811538 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:19.824847 (+ 13309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.767557 (+942710us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b540050c3d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:20.767793 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9497984}
W20260709 13:00:20.778396  1538 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.007s	sys 0.038s
W20260709 13:00:20.851773  2268 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.027s	sys 0.025s
I20260709 13:00:20.724643  8907 raft_consensus.cc:697] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 21 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 13:00:20.858538  1541 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.016s	sys 0.033s
W20260709 13:00:20.858927  1538 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.007s	sys 0.038s
W20260709 13:00:20.859123  2268 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.028s	sys 0.026s
I20260709 13:00:20.461369  8969 consensus_queue.cc:237] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:20.853597  8960 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.267s	user 0.040s	sys 0.083s
W20260709 13:00:20.879621  1542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.010s	sys 0.040s
W20260709 13:00:20.880185  1542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.010s	sys 0.040s
I20260709 13:00:20.530463  8917 consensus_queue.cc:237] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:20.862466  8905 consensus_meta.cc:287] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.867s	user 0.008s	sys 0.004s
I20260709 13:00:20.886672  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:20.887614  1533 raft_consensus.cc:2393] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 13: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:20.854272  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:20.696837  8963 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:20.808796  8630 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:20.882238  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.888825  1534 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:20.759786  8983 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:20.897022  1582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.023s	sys 0.061s
W20260709 13:00:20.909236  1582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.024s	sys 0.061s
I20260709 13:00:20.897500  1688 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:00:20.852321  8885 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:20.899554  1539 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.043s	sys 0.078s
W20260709 13:00:20.913156  1539 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.043s	sys 0.078s
I20260709 13:00:20.913137  1688 pending_rounds.cc:85] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 12
I20260709 13:00:20.914211  1688 pending_rounds.cc:107] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:00:20.914507  1688 raft_consensus.cc:2889] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:20.879823  8960 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.294s	user 0.041s	sys 0.083s
W20260709 13:00:20.910193  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 768863us
W20260709 13:00:20.883183  8887 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.037s	sys 0.058s
I20260709 13:00:20.830433  8984 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:20.661729  8938 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:20.999577  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:20.809544  2295 rpcz_store.cc:276] 0709 13:00:19.576425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.816219 (+239794us) service_pool.cc:224] Handling call
0709 13:00:19.841437 (+ 25218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:20.511421 (+669984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.640275 (+128854us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:20.859817  8871 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:21.004010  1617 raft_consensus.cc:2393] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 20: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:21.002883  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:20.989533  8887 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.037s	sys 0.058s
I20260709 13:00:21.004765  8994 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:21.015740  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.016434  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:20.976751  8864 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.943086  8885 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:20.979763  8627 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:21.067013  8627 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:21.069031  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4655) took 1409 ms. Trace:
I20260709 13:00:21.069303  8627 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:21.070075  8627 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:21.070569  8627 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:21.074501  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:21.075573  1691 rpcz_store.cc:276] 0709 13:00:19.660028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.672627 (+ 12599us) service_pool.cc:224] Handling call
0709 13:00:19.672917 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:20.423352 (+750435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.068812 (+645460us) spinlock_profiling.cc:243] Waited 749 ms on lock 0x7b5400392454. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:21.068972 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1723590528}
I20260709 13:00:21.077724  8984 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:20.901481  8905 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:21.050513  1581 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.030s	sys 0.033s
W20260709 13:00:21.061022  8992 log.cc:927] Time spent T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
W20260709 13:00:21.061913  8979 log.cc:927] Time spent T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.365s	user 0.000s	sys 0.001s
I20260709 13:00:21.064656  8646 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:21.065892  8713 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:21.032505  8980 log.cc:927] Time spent T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.603s	user 0.000s	sys 0.001s
I20260709 13:00:20.994997  8810 consensus_queue.cc:260] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:21.046789  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:21.094137  1581 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.030s	sys 0.033s
I20260709 13:00:21.012837  8897 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:20.916388  8630 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:21.119561  1609 raft_consensus.cc:1275] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:00:21.076014  8938 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:21.013896  8997 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.095103  1534 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 13:00:21.137884  8950 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:21.148605  1609 raft_consensus.cc:1240] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:21.149526  8630 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:21.150091  8630 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.130510  1508 leader_election.cc:400] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8.
W20260709 13:00:21.094497  8999 log.cc:927] Time spent T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.321s	user 0.000s	sys 0.001s
I20260709 13:00:21.121685  1612 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:00:20.979522  8903 consensus_queue.cc:1048] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:00:21.146025  1610 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 23. Current term is 24. Ops: []
I20260709 13:00:21.151670  1508 leader_election.cc:403] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:21.157637  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 3542) took 1826 ms. Trace:
I20260709 13:00:21.116611  8627 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:21.160737  2299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32794 (request call id 990) took 1326 ms. Trace:
I20260709 13:00:21.142690  8713 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:21.122531  8886 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:21.154353  8938 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:21.094636  8864 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:21.158583  1540 rpcz_store.cc:276] 0709 13:00:19.331154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.462976 (+131822us) service_pool.cc:224] Handling call
0709 13:00:19.463352 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:19.463735 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:19.463763 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:19.486994 (+ 23231us) log.cc:844] Serialized 26 byte log entry
0709 13:00:19.885927 (+398933us) spinlock_profiling.cc:243] Waited 6.52 ms on lock 0x7b18002bd1a0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf10d1 00007fc85d00ca0f
0709 13:00:20.187219 (+301292us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:20.187279 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.187401 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:21.151057 (+963656us) raft_consensus.cc:1685] finished
0709 13:00:21.151085 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:21.157556 (+  6471us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9590,"raft.queue_time_us":1565,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":10840,"spinlock_wait_cycles":14994304,"thread_start_us":300988,"threads_started":1,"wal-append.queue_time_us":890581}
I20260709 13:00:21.164753  2299 rpcz_store.cc:276] 0709 13:00:19.829938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.946513 (+116575us) service_pool.cc:224] Handling call
0709 13:00:20.001846 (+ 55333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:20.380667 (+378821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.151007 (+770340us) spinlock_profiling.cc:243] Waited 351 ms on lock 0x7b54005e9054. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:21.155907 (+  4900us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":806943104}
I20260709 13:00:21.146183  8884 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:20.919011  8860 consensus_queue.cc:237] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:21.173806  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3695) took 1293 ms. Trace:
W20260709 13:00:21.167166  1506 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.008s	sys 0.028s
I20260709 13:00:21.093955  8885 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:21.186044  1506 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.008s	sys 0.028s
I20260709 13:00:21.185024  1608 rpcz_store.cc:276] 0709 13:00:19.880464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.880738 (+   274us) service_pool.cc:224] Handling call
0709 13:00:19.881091 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:19.881503 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:19.881531 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:19.882047 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 13:00:20.191241 (+309194us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:20.191286 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.191363 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:21.173556 (+982193us) raft_consensus.cc:1685] finished
0709 13:00:21.173580 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:21.173723 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1179,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"thread_start_us":308740,"threads_started":1,"wal-append.queue_time_us":630571}
I20260709 13:00:21.080276  8994 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:21.161228  8691 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:21.138187  8646 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:21.254163  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.260303  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:21.261813  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:21.032196  8907 consensus_queue.cc:237] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:21.150553  8630 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:21.145269  8897 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:21.272565  1617 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:00:21.273026  1608 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:00:21.274499  1540 raft_consensus.cc:1240] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:00:21.272974  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:21.275683  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:21.250022  8627 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:21.276345  1540 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 13:00:21.150671  8997 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:21.291525  1581 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:21.292663  8903 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:21.293114  8903 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:21.293478  8903 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:21.302894  8903 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:21.305318  8903 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:21.250739  8713 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:21.278458  8921 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:21.277516  8884 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 7. Current term is 8.
W20260709 13:00:21.306008  2296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.009s	sys 0.028s
W20260709 13:00:21.312718  8793 consensus_meta.cc:287] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.880s	user 0.007s	sys 0.004s
W20260709 13:00:21.334347  2267 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.017s	sys 0.013s
I20260709 13:00:21.415313  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 13:00:21.415735  2267 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.017s	sys 0.013s
I20260709 13:00:21.416065  1537 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:00:21.416636  2267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.282872  8963 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:21.266702  8938 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:21.285533  1656 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.005s	sys 0.023s
W20260709 13:00:21.420497  1656 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.006s	sys 0.023s
W20260709 13:00:21.420818  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 714601us
I20260709 13:00:21.278065  8886 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:00:21.281009  8887 consensus_queue.cc:1048] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:00:21.355894  1505 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:21.356855  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1144) took 1458 ms. Trace:
W20260709 13:00:21.357527  2266 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.007s	sys 0.027s
W20260709 13:00:21.431804  2266 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.008s	sys 0.027s
W20260709 13:00:21.413339  2296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.009s	sys 0.028s
I20260709 13:00:21.281141  9006 consensus_queue.cc:1059] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.076s
I20260709 13:00:21.351758  8862 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:21.306233  8627 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:21.349705  8983 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:21.372485  1655 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.009s	sys 0.027s
I20260709 13:00:21.354720  8871 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:21.374394  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1145) took 1475 ms. Trace:
W20260709 13:00:21.433405  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 77627us
I20260709 13:00:21.393704  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:21.401746  1608 raft_consensus.cc:1240] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:21.371451  8905 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:21.409876  1612 raft_consensus.cc:1240] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 19. Current term is 20. Ops: [17.13-19.14]
I20260709 13:00:21.435814  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:21.415138  8921 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 13:00:21.433518  1655 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.010s	sys 0.027s
W20260709 13:00:21.439337  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 914893us
I20260709 13:00:21.440948  1534 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
W20260709 13:00:21.438166  1542 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.004s	sys 0.038s
W20260709 13:00:21.442224  1542 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.005s	sys 0.038s
I20260709 13:00:21.443647  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1151) took 1101 ms. Trace:
I20260709 13:00:21.433915  1539 rpcz_store.cc:276] 0709 13:00:19.898557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.131074 (+232517us) service_pool.cc:224] Handling call
0709 13:00:20.138386 (+  7312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:20.138593 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:00:20.380458 (+241865us) log.cc:844] Serialized 14 byte log entry
0709 13:00:21.362141 (+981683us) log.cc:844] Serialized 14 byte log entry
0709 13:00:21.374014 (+ 11873us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:21.374072 (+    58us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:00:21.374120 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.374189 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:21.374332 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16351,"prepare.queue_time_us":98011,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":74,"raft.queue_time_us":404997,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":11233,"thread_start_us":1170569,"threads_started":3,"wal-append.queue_time_us":807192}
I20260709 13:00:21.446894  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:21.436434  1536 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 23.
W20260709 13:00:21.445717  1654 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.016s	sys 0.036s
W20260709 13:00:21.447793  1654 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.016s	sys 0.036s
I20260709 13:00:21.449949  1581 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:21.431699  1541 rpcz_store.cc:276] 0709 13:00:19.898280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.099344 (+201064us) service_pool.cc:224] Handling call
0709 13:00:20.125334 (+ 25990us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:20.125577 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 13:00:20.860928 (+735351us) log.cc:844] Serialized 14 byte log entry
0709 13:00:21.356496 (+495568us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:21.356550 (+    54us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:00:21.356603 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.356680 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:21.356800 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2752,"prepare.queue_time_us":108808,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":62105,"thread_start_us":1211727,"threads_started":2}
W20260709 13:00:21.448093  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 510026us
I20260709 13:00:21.430747  8984 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.431818  8888 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:21.434599  8864 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:21.461782  1608 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:00:21.442914  8871 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.465031  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:21.461879  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 3538) took 2319 ms. Trace:
I20260709 13:00:21.464394  2299 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [term 24 LEARNER]: Advancing to term 26
I20260709 13:00:21.420076  8793 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:21.477206  2297 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:21.465296  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:21.483347  1683 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.013s	sys 0.019s
W20260709 13:00:21.483832  1683 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.013s	sys 0.019s
I20260709 13:00:21.458207  8630 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:21.474640  9008 log.cc:927] Time spent T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:00:21.456815  1537 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 13:00:21.464133  8905 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:00:21.466200  8718 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.015s	sys 0.015s
I20260709 13:00:21.490168  1581 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:21.482098  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:21.448362  8885 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:21.461382  8994 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:21.461278  8646 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:21.464175  8989 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.013s	sys 0.016s
I20260709 13:00:21.473346  8864 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:21.503963  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 74606.7us
I20260709 13:00:21.503180  2297 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:21.511739  1690 raft_consensus.cc:1240] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:21.481477  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:21.480983  8903 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.444553  9010 consensus_queue.cc:1048] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:00:21.445290  8921 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:21.477224  1538 rpcz_store.cc:276] 0709 13:00:19.138044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.185150 (+ 47106us) service_pool.cc:224] Handling call
0709 13:00:19.185489 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:19.190355 (+  4866us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:00:19.822164 (+631809us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b1800078640. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f61455 00007fc860a493c7 00007fc85d05b9a7 00007fc85d06b0bf 00007fc85d06b038
0709 13:00:19.949102 (+126938us) log.cc:844] Serialized 14 byte log entry
0709 13:00:21.316231 (+1367129us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:21.333775 (+ 17544us) log.cc:844] Serialized 26 byte log entry
0709 13:00:21.334019 (+   244us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:21.334119 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.334213 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:21.440465 (+106252us) raft_consensus.cc:1685] finished
0709 13:00:21.457555 (+ 17090us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:21.457730 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4408,"prepare.queue_time_us":925329,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":330058,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":75628,"spinlock_wait_cycles":3039360,"thread_start_us":1493405,"threads_started":3,"wal-append.queue_time_us":1123755}
I20260709 13:00:21.466513  8769 consensus_queue.cc:1048] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:00:21.468802  8984 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:21.446296  1542 rpcz_store.cc:276] 0709 13:00:20.341926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.343684 (+  1758us) service_pool.cc:224] Handling call
0709 13:00:20.344031 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:20.344246 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:00:20.361250 (+ 17004us) log.cc:844] Serialized 14 byte log entry
0709 13:00:21.443103 (+1081853us) log.cc:844] Serialized 14 byte log entry
0709 13:00:21.443278 (+   175us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:21.443319 (+    41us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:00:21.443379 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.443447 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:21.443591 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2357,"prepare.queue_time_us":13682,"prepare.run_cpu_time_us":148,"prepare.run_wall_time_us":3561,"raft.queue_time_us":370579,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":10892,"thread_start_us":1079808,"threads_started":2,"wal-append.queue_time_us":891726}
W20260709 13:00:21.607899  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 447547us
W20260709 13:00:21.540220  1616 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.000s	sys 0.027s
W20260709 13:00:21.578926  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.637547  1508 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:21.566048  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:21.473747  8888 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:21.508394  8718 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.016s	sys 0.016s
W20260709 13:00:21.637297  1616 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.005s	sys 0.033s
W20260709 13:00:21.633785  8989 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.015s	sys 0.033s
I20260709 13:00:21.493381  8884 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:00:21.639729  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 173254us
I20260709 13:00:21.662809  1508 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:21.510269  9003 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:21.665390  9007 log.cc:927] Time spent T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:00:21.665208  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:21.664976  9018 consensus_queue.cc:1048] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.120s
I20260709 13:00:21.667650  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:21.705384  1691 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 27.
I20260709 13:00:21.504689  8691 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.679080  9014 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.635325  8646 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.679456  1682 raft_consensus.cc:1240] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:00:21.682158  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:21.683337  1688 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:00:21.684037  2299 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [term 26 LEARNER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:00:21.642406  1654 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:21.495785  8905 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.545374  9011 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 13:00:21.665817  9009 log.cc:927] Time spent T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
W20260709 13:00:21.700827  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 52598.5us
I20260709 13:00:21.485880  8871 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:21.496392  8630 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 13:00:21.660313  9008 log.cc:927] Time spent T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:00:21.515727  8997 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:21.541172  8994 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.644410  8903 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:21.709524  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.281085  8938 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:22.281258  8646 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:22.275238  8886 consensus_queue.cc:1048] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:00:21.841615  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:22.284854  1684 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
W20260709 13:00:21.842545  1611 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.008s	sys 0.016s
W20260709 13:00:21.754173  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 315005us
W20260709 13:00:21.813764  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:22.233654  1616 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.006s	sys 0.011s
W20260709 13:00:22.079716  1683 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.007s	sys 0.032s
W20260709 13:00:22.288233  1683 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.009s	sys 0.033s
W20260709 13:00:22.080268  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 450685us
I20260709 13:00:21.867004  1656 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:22.204635  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:22.289971  1611 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.127s	user 0.013s	sys 0.033s
I20260709 13:00:21.841205  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 13:00:21.921005  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 235394us
I20260709 13:00:22.285979  1687 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
W20260709 13:00:22.296658  1583 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.005s	sys 0.008s
W20260709 13:00:22.297154  1583 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.005s	sys 0.008s
I20260709 13:00:22.290717  1691 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:00:21.813947  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 323892us
W20260709 13:00:22.299083  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.301342  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:22.287703  1616 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.008s	sys 0.012s
I20260709 13:00:22.302084  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:22.302795  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:22.312655  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:22.314337  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:22.316704  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:22.317978  2299 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
W20260709 13:00:22.282567  8748 consensus_meta.cc:287] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 1.819s	user 0.006s	sys 0.005s
I20260709 13:00:22.321216  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:22.321617  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:22.321957  1538 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 21.
I20260709 13:00:22.330425  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:21.679185  9043 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:22.062883  8627 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:22.330040  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:22.332810  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:21.998770  9039 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.083566  8769 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:00:22.292972  8860 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.000s	sys 0.013s
I20260709 13:00:22.001847  9021 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:22.335606  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:21.650447  8864 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:22.001158  9013 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.174616  8713 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:22.001535  9033 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:22.308149  8907 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.006s	sys 0.012s
I20260709 13:00:22.338037  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:22.002928  9028 consensus_queue.cc:1059] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.540s
I20260709 13:00:22.293329  8905 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:00:22.339592  1507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.007s	sys 0.012s
I20260709 13:00:22.251062  9024 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:22.344156  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:22.345367  9020 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:22.481240  1507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.007s	sys 0.012s
W20260709 13:00:22.484396  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 780340us
I20260709 13:00:22.306684  8691 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:22.346177  9037 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.310804  9011 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:22.350178  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:21.668972  9017 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.675s
I20260709 13:00:22.353024  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:22.308265  8793 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:22.314965  8718 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.545065  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:22.469792  8646 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:21.841852  9034 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:00:22.364698  1508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.008s	sys 0.008s
I20260709 13:00:22.366426  1691 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 24.
W20260709 13:00:22.552243  1508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.008s	sys 0.008s
I20260709 13:00:22.359905  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3708) took 1358 ms. Trace:
I20260709 13:00:21.999044  8917 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.351s
I20260709 13:00:22.332926  9018 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:22.350659  2295 raft_consensus.cc:1240] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 19. Current term is 20. Ops: [17.14-19.15]
W20260709 13:00:22.339178  2268 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.000s	sys 0.015s
I20260709 13:00:22.348758  8888 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:22.310237  9014 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:22.552608  1611 rpcz_store.cc:276] 0709 13:00:21.001120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.082607 (+ 81487us) service_pool.cc:224] Handling call
0709 13:00:21.083018 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:21.108415 (+ 25397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:21.108446 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:21.123592 (+ 15146us) log.cc:844] Serialized 26 byte log entry
0709 13:00:22.290449 (+1166857us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:22.290490 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:22.290557 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:22.359684 (+ 69127us) raft_consensus.cc:1685] finished
0709 13:00:22.359706 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:22.359838 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87358,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":81715,"thread_start_us":1126897,"threads_started":1,"wal-append.queue_time_us":1195971}
I20260709 13:00:22.452173  9023 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:22.453897  9029 log.cc:927] Time spent T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.500s	user 0.000s	sys 0.000s
I20260709 13:00:22.351876  8769 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:22.592974  8769 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:00:22.449921  8848 consensus_meta.cc:287] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 1.744s	user 0.015s	sys 0.000s
I20260709 13:00:22.332206  8630 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:22.596797  8848 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:22.598250  8630 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:22.456365  9013 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:22.598820  8848 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:22.519559  9024 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:22.600374  9013 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:22.473078  8885 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.000s	sys 0.023s
W20260709 13:00:22.601083  8885 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.892s	user 0.000s	sys 0.023s
I20260709 13:00:22.553191  8718 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:22.474478  1580 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.004s	sys 0.019s
W20260709 13:00:22.602273  1580 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.004s	sys 0.019s
I20260709 13:00:22.603106  8718 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:22.355430  8860 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.000s	sys 0.014s
I20260709 13:00:22.462675  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3698) took 2576 ms. Trace:
I20260709 13:00:22.462675  2300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32794 (request call id 985) took 2998 ms. Trace:
I20260709 13:00:22.309976  8994 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:22.482208  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:22.606799  8994 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:22.354121  9043 raft_consensus.cc:697] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:22.607024  9023 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:22.607968  9043 consensus_queue.cc:237] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:22.609483  9023 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:22.354279  9046 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:22.610983  9046 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:22.485586  1507 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:22.612385  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 126874us
I20260709 13:00:22.614703  8897 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:22.614928  1507 connection.cc:256] RPC call timeout handler was delayed by -1.1354705189999663s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19930000000000003s for a response
I20260709 13:00:22.615897  9034 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:22.357430  8627 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.116s
W20260709 13:00:22.456727  8907 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.007s	sys 0.012s
W20260709 13:00:22.469458  9031 log.cc:927] Time spent T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:00:21.703864  9003 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:22.618224  8642 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:22.618698  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:22.619107  9003 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:22.619617  9003 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:22.337083  8748 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:22.620007  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:22.621054  2295 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:22.621479  9061 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.622272  8748 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:22.621978  9061 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:22.622821  8748 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.623286  8748 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:22.624116  9061 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:22.529466  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3711) took 1513 ms. Trace:
I20260709 13:00:22.663897  1609 rpcz_store.cc:276] 0709 13:00:21.015961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.149453 (+133492us) service_pool.cc:224] Handling call
0709 13:00:21.149783 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:21.149990 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:21.577059 (+427069us) log.cc:844] Serialized 14 byte log entry
0709 13:00:22.529051 (+951992us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:22.529116 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:22.529172 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:22.529247 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:22.529396 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":183186,"prepare.queue_time_us":792245,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":489716,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":1195007,"threads_started":3,"wal-append.queue_time_us":767029}
I20260709 13:00:22.665943  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:22.666586  1609 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 27.
I20260709 13:00:22.667090  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 3717) took 1037 ms. Trace:
I20260709 13:00:22.667387  1609 rpcz_store.cc:276] 0709 13:00:21.629271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.665664 (+1036393us) service_pool.cc:224] Handling call
0709 13:00:22.667031 (+  1367us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:22.668073  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3697) took 2782 ms. Trace:
I20260709 13:00:22.456506  8864 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:22.464711  8803 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:22.459165  8744 consensus_meta.cc:287] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 2.098s	user 0.007s	sys 0.008s
I20260709 13:00:22.546455  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:22.357313  1539 raft_consensus.cc:2410] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:00:22.473932  8921 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:22.524217  9019 log.cc:927] Time spent T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.788s	user 0.001s	sys 0.000s
W20260709 13:00:22.552884  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 890241us
I20260709 13:00:22.481226  8969 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.557133  8646 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.456837  9044 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 13:00:22.558645  2268 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.073s	user 0.000s	sys 0.015s
I20260709 13:00:22.472533  9040 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:22.453001  9026 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.355122  9039 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:22.482105  8984 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:22.490365  8713 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:00:22.564721  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:22.567005  9014 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:22.568876  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:22.570144  9011 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:22.572363  9041 raft_consensus.cc:3055] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:22.518990  9020 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:22.446798  9021 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:22.523900  9037 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:22.545785  8950 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:22.579077  2301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32794 (request call id 992) took 2274 ms. Trace:
I20260709 13:00:22.578858  9018 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:22.586124  9054 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:22.472590  9033 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:22.589272  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:22.591575  9060 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:22.546499  8989 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.074s
I20260709 13:00:22.604079  2300 rpcz_store.cc:276] 0709 13:00:19.464064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.749143 (+285079us) service_pool.cc:224] Handling call
0709 13:00:19.751236 (+  2093us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:20.354238 (+603002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:22.462321 (+2108083us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b5400267fd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:22.462559 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1385391360}
I20260709 13:00:22.624825  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 3789) took 1626 ms. Trace:
I20260709 13:00:22.625424  1608 raft_consensus.cc:2393] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 15: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:22.480772  1655 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:22.620067  9003 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:22.626742  8748 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:22.604795  1533 raft_consensus.cc:1240] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:22.633605  2297 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 13:00:22.699992  2297 pending_rounds.cc:85] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579: Aborting all ops after (but not including) 13
I20260709 13:00:22.700330  2297 pending_rounds.cc:107] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 13:00:22.692587  1615 rpcz_store.cc:276] 0709 13:00:20.998768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.999250 (+   482us) service_pool.cc:224] Handling call
0709 13:00:21.016818 (+ 17568us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:21.045174 (+ 28356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:21.045209 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:21.045738 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:00:21.566658 (+520920us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:21.566701 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.566775 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:22.624593 (+1057818us) raft_consensus.cc:1685] finished
0709 13:00:22.624612 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:22.624764 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5059,"raft.queue_time_us":136160,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":5831,"thread_start_us":421287,"threads_started":1,"wal-append.queue_time_us":940281}
I20260709 13:00:22.700664  2297 raft_consensus.cc:2889] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:22.580142  8981 raft_consensus.cc:3055] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:22.618119  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:22.604020  1613 rpcz_store.cc:276] 0709 13:00:19.885909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.886295 (+   386us) service_pool.cc:224] Handling call
0709 13:00:19.886585 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:20.419093 (+532508us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:20.419142 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:20.419194 (+    52us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:00:20.419248 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:22.462351 (+2043103us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b5400257bd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:22.462409 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:22.462567 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1224082176}
I20260709 13:00:22.645263  8903 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:22.646641  8986 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:22.531157  8938 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.117s
I20260709 13:00:22.614475  8691 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:22.649919  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4503) took 3151 ms. Trace:
I20260709 13:00:22.654706  2295 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:22.559365  1581 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:22.661005  8897 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:22.458110  8871 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:22.668404  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:22.668579  1614 rpcz_store.cc:276] 0709 13:00:19.885581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.887967 (+  2386us) service_pool.cc:224] Handling call
0709 13:00:19.888299 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:19.918935 (+ 30636us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:19.918968 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:19.919475 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 13:00:20.377876 (+458401us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:20.377929 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:22.667628 (+2289699us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b540008d4d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:22.667687 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:22.667745 (+    58us) raft_consensus.cc:1685] finished
0709 13:00:22.667774 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:22.668011 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":125,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":15269,"spinlock_wait_cycles":27297536,"thread_start_us":457524,"threads_started":1,"wal-append.queue_time_us":798350,"wal-append.run_cpu_time_us":3102,"wal-append.run_wall_time_us":1531399}
I20260709 13:00:22.669961  2299 raft_consensus.cc:2410] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
W20260709 13:00:22.679306  1534 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 4512) took 1419 ms (client timeout 1539 ms). Trace:
I20260709 13:00:22.683792  1542 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 13:00:22.672623  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:22.677704  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 3715) took 1049 ms. Trace:
W20260709 13:00:22.691032  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 1.04884e+06us
I20260709 13:00:22.678203  1536 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 27.
W20260709 13:00:22.693995  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 213328us
I20260709 13:00:22.682603  2301 rpcz_store.cc:276] 0709 13:00:20.304544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.310237 (+  5693us) service_pool.cc:224] Handling call
0709 13:00:21.043106 (+732869us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b5800003c98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ceee 0000000000375939 00007fc861fa01e0 00007fc8620690c4 00007fc862069131 00007fc86202afc0 00007fc862015929 00007fc8620153d2 00007fc85b58cbd4
0709 13:00:21.043303 (+   197us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:21.500961 (+457658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:21.500997 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:21.511237 (+ 10240us) log.cc:844] Serialized 26 byte log entry
0709 13:00:22.110040 (+598803us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:22.110081 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:22.110180 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:22.578754 (+468574us) raft_consensus.cc:1685] finished
0709 13:00:22.578778 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:22.579014 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26263,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":35777920,"thread_start_us":916143,"threads_started":2,"wal-append.queue_time_us":897044}
I20260709 13:00:22.673357  9026 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:22.696973  9058 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:00:22.697665  9034 raft_consensus.cc:697] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:22.677692  9041 raft_consensus.cc:740] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:22.671305  8969 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:22.671329  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:22.675009  9039 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:22.853338  1655 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:22.699070  9056 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:22.715220  8885 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.699075  9014 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:00:22.838011  1534 rpcz_store.cc:269] 0709 13:00:21.259716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.261547 (+  1831us) service_pool.cc:224] Handling call
0709 13:00:22.679089 (+1417542us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54003d1dd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:22.679213 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410499456}
I20260709 13:00:22.757879  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:22.839358  1654 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:22.840333  1611 rpcz_store.cc:276] 0709 13:00:21.628747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.568583 (+939836us) service_pool.cc:224] Handling call
0709 13:00:22.677629 (+109046us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:22.840159  1612 raft_consensus.cc:2410] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:00:22.754854  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:22.737056  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 65692.3us
W20260709 13:00:22.841180  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 281928us
I20260709 13:00:22.839927  1535 rpcz_store.cc:276] 0709 13:00:19.498968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.809151 (+310183us) service_pool.cc:224] Handling call
0709 13:00:19.820329 (+ 11178us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:20.414766 (+594437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:22.649580 (+2234814us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b5400247054. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:22.649840 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1277496064}
I20260709 13:00:22.682178  9037 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:22.668923  9061 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.912294  9018 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:22.912911  1508 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:22.679283  9020 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:22.913785  9020 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:22.914136  9020 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:22.914474  9020 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:22.671343  8646 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:22.885391  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:22.818526  8744 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.908895  1615 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 13:00:22.920074  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 3714) took 1291 ms. Trace:
I20260709 13:00:22.920419  1615 rpcz_store.cc:276] 0709 13:00:21.628430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.737234 (+1108804us) service_pool.cc:224] Handling call
0709 13:00:22.920007 (+182773us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:22.887328  1655 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:22.911038  1581 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.539s (SENT) [suppressed 7 similar messages]
I20260709 13:00:22.669116  8803 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:22.912735  9061 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:22.916687  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 3716) took 1287 ms. Trace:
I20260709 13:00:22.923518  1614 rpcz_store.cc:276] 0709 13:00:21.629015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.849061 (+1220046us) service_pool.cc:224] Handling call
0709 13:00:22.916625 (+ 67564us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:22.923146  9041 consensus_queue.cc:260] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:22.924387  9041 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:22.912420  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 3712) took 1284 ms. Trace:
I20260709 13:00:22.716466  8981 raft_consensus.cc:740] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:22.929165  8803 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:22.928972  8981 consensus_queue.cc:260] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:22.923254  8646 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:22.682452  8950 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:22.755352  8748 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:22.778905  9038 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:22.917464  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 78188.9us
I20260709 13:00:22.886533  8921 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:00:22.818893  8848 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:22.694437  9060 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:22.851616  9025 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:00:22.924293  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 3880) took 2402 ms (client timeout 2097 ms). Trace:
I20260709 13:00:22.926971  1655 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:22.925194  1612 rpcz_store.cc:276] 0709 13:00:21.627762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.672312 (+1044550us) service_pool.cc:224] Handling call
0709 13:00:22.912357 (+240045us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:22.931504  1656 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.012s	sys 0.031s
I20260709 13:00:22.923079  8125 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 13:00:22.950897  1656 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.012s	sys 0.031s
W20260709 13:00:22.949910  1689 rpcz_store.cc:269] 0709 13:00:20.521554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.537532 (+ 15978us) service_pool.cc:224] Handling call
0709 13:00:22.924054 (+2386522us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b540029a9d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:22.924188 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4752713088}
I20260709 13:00:22.931686  9037 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:22.671566  9044 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:22.839447  9024 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:22.912945  9018 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.882431  8903 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:22.939744  1654 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:22.887300  9021 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:22.851914  9033 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:22.886816  9011 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 13:00:22.704815  8994 consensus_queue.cc:1048] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.210s
W20260709 13:00:22.951491  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 1.08461e+06us
I20260709 13:00:22.851902  8897 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:22.974434  8897 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:22.949913  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:22.976004  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:22.883474  8993 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.075s
I20260709 13:00:22.976686  1615 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:22.977468  8993 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:22.977610  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:22.978230  1615 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 19.
I20260709 13:00:22.978082  8993 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:22.979460  1615 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:00:22.979830  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:22.980914  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:22.981400  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 54521.6us
I20260709 13:00:22.683065  9054 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:22.947388  9061 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:22.991478  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 3787) took 1993 ms. Trace:
I20260709 13:00:22.931146  8651 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.957577  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:22.941061  8864 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:22.965519  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:22.944593  8830 consensus_queue.cc:1059] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:00:22.968336  9018 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:22.969020  8886 consensus_queue.cc:1048] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:22.969205  8903 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:22.922430  8885 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:22.982131  1655 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:22.983088  1689 raft_consensus.cc:1275] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:00:22.951918  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 321980us
I20260709 13:00:22.985214  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:22.986464  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:22.947024  8646 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:22.926210  9014 raft_consensus.cc:697] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 13:00:22.989125  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 49451.4us
I20260709 13:00:22.949795  9025 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:22.933295  8744 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:22.850795  8986 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:22.908293  8775 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:00:22.950637  9022 consensus_queue.cc:1048] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
W20260709 13:00:22.993417  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 82416.3us
I20260709 13:00:22.992141  1616 rpcz_store.cc:276] 0709 13:00:20.998140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.998306 (+   166us) service_pool.cc:224] Handling call
0709 13:00:20.998645 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:21.655415 (+656770us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:21.655449 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:21.656052 (+   603us) log.cc:844] Serialized 26 byte log entry
0709 13:00:22.302250 (+646198us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:22.302292 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:22.302360 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:22.978151 (+675791us) spinlock_profiling.cc:243] Waited 44.4 ms on lock 0x7b5400438120. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85cfc6dbe 00007fc85cfd1930 00007fc85cfd18d8 00007fc85cfd1858 00007fc85cfd1813 00007fc85cfd0a9c 00007fc862ebc626 00007fc862eb6dd8 00007fc85d00d7cb 00007fc85d0102c0
0709 13:00:22.980270 (+  2119us) raft_consensus.cc:1685] finished
0709 13:00:22.980292 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:22.991405 (+ 11113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":70888,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"spinlock_wait_cycles":102220672,"thread_start_us":1292349,"threads_started":2,"wal-append.queue_time_us":880280}
I20260709 13:00:22.995121  1688 raft_consensus.cc:1240] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 17. Current term is 18. Ops: []
W20260709 13:00:22.954675  2294 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32794 (request call id 996) took 1499 ms (client timeout 1762 ms). Trace:
I20260709 13:00:22.957062  8621 raft_consensus.cc:3055] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:22.998731  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:22.998906  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:23.034101  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:23.001858  8921 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:22.943557  8871 consensus_queue.cc:1048] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:00:22.940971  8748 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:23.090091  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:23.065784  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.950057  8848 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:23.164636  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:23.166908  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:23.103068  8923 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 11 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:23.105104  9025 raft_consensus.cc:3060] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:22.997668  1612 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 13:00:23.052153  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:23.102658  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 66472.4us
I20260709 13:00:23.174810  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:23.106748  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 191646us
I20260709 13:00:23.134968  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:23.210752   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:23.000790  1542 raft_consensus.cc:1240] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:23.217855  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:22.960990  8125 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:23.143908  1537 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 13:00:22.909233  9056 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:22.989625  9069 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:22.988534  8995 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 13:00:23.150720  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 112177us
I20260709 13:00:22.990803  8862 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:23.035198  2296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32802 (request call id 732) took 2570 ms. Trace:
I20260709 13:00:23.234588  2296 rpcz_store.cc:276] 0709 13:00:20.465205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.700817 (+235612us) service_pool.cc:224] Handling call
0709 13:00:20.701166 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:21.441842 (+740676us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:00:22.047413 (+605571us) log.cc:844] Serialized 14 byte log entry
0709 13:00:22.688016 (+640603us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:22.848928 (+160912us) log.cc:844] Serialized 26 byte log entry
0709 13:00:22.887124 (+ 38196us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:22.907912 (+ 20788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:22.926536 (+ 18624us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:22.981832 (+ 55296us) raft_consensus.cc:1685] finished
0709 13:00:22.989436 (+  7604us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:23.002558 (+ 13122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1037902,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":156133,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":9225,"thread_start_us":1689801,"threads_started":3,"wal-append.queue_time_us":529058}
I20260709 13:00:23.237110  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:23.156226  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:23.238260  1688 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 24.
W20260709 13:00:23.158783  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.163095  8986 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:22.966706  9055 consensus_queue.cc:1048] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.181s
W20260709 13:00:23.241052  8905 consensus_meta.cc:287] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.722s	user 0.004s	sys 0.006s
I20260709 13:00:22.991163  9037 raft_consensus.cc:697] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 22 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:23.242456  9054 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:23.242185  9037 consensus_queue.cc:237] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:23.165397  1691 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 21.
I20260709 13:00:23.243595  8918 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:00:23.245168  1691 raft_consensus.cc:1275] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:23.245445  8918 consensus_queue.cc:1059] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:00:23.246555  9070 log.cc:927] Time spent T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:00:23.010704  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:23.247196  1687 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 14.
W20260709 13:00:23.106438  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 124420us
I20260709 13:00:23.142364  8621 raft_consensus.cc:740] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:23.144804  8777 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:23.145273  8921 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:23.180523  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:23.253089  1682 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 24.
I20260709 13:00:23.213261  9022 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.050465  8646 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:22.993222  8651 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:23.196753  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:23.198501  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:23.152181  8993 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:23.262616  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:22.954252  9038 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:23.216696  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:23.266614  1616 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 20.
I20260709 13:00:23.215886  1534 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 21.
W20260709 13:00:23.204586  8769 consensus_meta.cc:287] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.611s	user 0.009s	sys 0.000s
I20260709 13:00:23.207511  8705 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:23.234414  8862 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:23.268271  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3876) took 2749 ms. Trace:
I20260709 13:00:23.230777  1582 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:23.228885  8796 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.232940  8748 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:23.255347  8921 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:23.204875  9003 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:23.225306  9046 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:23.100633  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:23.293929  1539 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:23.228443  1505 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:23.252179  2269 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:23.192085  1614 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 28.
W20260709 13:00:23.137593  2294 rpcz_store.cc:269] 0709 13:00:21.451650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.457538 (+  5888us) service_pool.cc:224] Handling call
0709 13:00:22.671164 (+1213626us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b5800003c98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc8620170a0 00007fc862016984 00007fc85b5916d4 00007fc85b591662
0709 13:00:22.950699 (+279535us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11694464}
I20260709 13:00:23.215533  9079 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.258702  1535 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 20.
I20260709 13:00:23.091428  9034 consensus_queue.cc:237] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:23.305253  8885 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:23.305989  8885 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:23.306481  8885 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:23.306954  9038 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:23.232832  8744 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:23.307508  9038 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.307904  8744 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:23.270219  8769 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:23.308286  8744 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:23.308701  8744 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:23.234403  8848 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:23.236210  9018 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:23.262908  1540 raft_consensus.cc:2410] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:00:23.310143  8769 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:23.211623  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:23.254868  8995 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:23.229244  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:23.269021  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:23.270879  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:23.314410  1616 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 13:00:23.270171  1686 rpcz_store.cc:276] 0709 13:00:20.513372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.513494 (+   122us) service_pool.cc:224] Handling call
0709 13:00:20.513776 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:20.880965 (+367189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:20.880993 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:20.881034 (+    41us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:20.881074 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:23.262480 (+2381406us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b5400260054. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:23.262527 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:23.262655 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":843964160}
I20260709 13:00:23.233815  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:23.315938  1537 raft_consensus.cc:2410] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 22 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:00:23.247758  9026 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:23.256076  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:23.315310  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 86646.4us
I20260709 13:00:23.272769  8895 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:23.272251  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:23.324858  1682 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 22.
I20260709 13:00:23.241482  8905 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:23.295949  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:23.266749  9075 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.224241  9014 consensus_queue.cc:237] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:23.340459  8905 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:23.332269  2295 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 24.
I20260709 13:00:23.342301  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:23.342535  8981 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:23.343653  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:23.345644  8885 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:23.303428  8621 consensus_queue.cc:260] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:23.353014  8862 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:23.354009  8621 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:23.362504  8810 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:23.299121  8718 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:00:23.304108  9078 log.cc:927] Time spent T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:00:23.304625  8969 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:23.305334  8646 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:23.237723  2296 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:23.315310  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:23.291934  1691 raft_consensus.cc:1275] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:00:23.320673  1654 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:23.378878  1616 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 27.
W20260709 13:00:23.379751  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 59176.2us
I20260709 13:00:23.325135  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:23.326081  1655 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:23.328655  2297 raft_consensus.cc:2410] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:00:23.383425  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:23.384426  2297 raft_consensus.cc:2410] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 21 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:00:23.297386  8777 raft_consensus.cc:697] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:23.333684  1582 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:23.291659  8796 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:23.273909  9022 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:23.334383  8714 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:23.334491  9075 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:23.307521  9056 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:23.388306  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 94668.1us
I20260709 13:00:23.381386  1654 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 13:00:23.396009  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:23.406025  9083 log.cc:927] Time spent T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:00:23.391419  8646 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:23.408622  8981 consensus_queue.cc:1059] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:23.409596  8895 raft_consensus.cc:3055] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:23.409968  8895 raft_consensus.cc:740] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:23.410748  8895 consensus_queue.cc:260] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:23.393250  9069 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:00:23.412088  9069 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:23.412575  9069 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:00:23.409119  2302 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32794 (request call id 989) took 3579 ms (client timeout 1993 ms). Trace:
W20260709 13:00:23.413333  2302 rpcz_store.cc:269] 0709 13:00:19.829640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.855430 (+ 25790us) service_pool.cc:224] Handling call
0709 13:00:23.393351 (+3537921us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b54001617d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:23.409028 (+ 15677us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4203318016}
I20260709 13:00:23.414407  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:23.415546  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:23.416736  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:23.411978  8895 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:23.418392  2302 raft_consensus.cc:1240] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:23.419895  2302 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:00:23.421433  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:23.422727  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:23.423322  1615 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 13:00:23.307957  9038 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:23.311753  9020 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:23.304529  9076 consensus_queue.cc:1059] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.091s
W20260709 13:00:23.445240  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 119279us
I20260709 13:00:23.455742  1655 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:23.457067  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 198489us
I20260709 13:00:23.457397  2297 raft_consensus.cc:1240] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:00:23.424292  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:23.450598  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 69289us
I20260709 13:00:23.373202  8718 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:23.460556  1654 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:23.313984  9079 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:23.463238  1655 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:23.466339  1508 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:23.395234  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:23.484177  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:23.486243  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:23.463529  8968 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.726s	user 0.007s	sys 0.040s
I20260709 13:00:23.491219  1508 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:23.449681  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:23.487522  1538 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 13:00:23.505117  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:23.503115  1508 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:23.491268  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:23.448864  8830 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:23.462112  8718 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:23.465062  9065 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:23.508406  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:23.461565  8895 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:23.480199  8864 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:23.523975  1539 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
W20260709 13:00:23.504858  8968 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.789s	user 0.008s	sys 0.041s
I20260709 13:00:23.504794  8938 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:00:23.530107  8938 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:23.530277  8862 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:23.532291  8938 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:00:23.536844  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:23.538265  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:23.539546  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:23.542147  8796 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:23.543687  8981 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:23.544270  8981 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:23.546464  8981 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:23.551891  1541 raft_consensus.cc:1240] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 22. Current term is 23. Ops: []
I20260709 13:00:23.553632  8995 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:23.557740  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:23.558439  1534 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 21.
I20260709 13:00:23.559538  8730 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.560029  8730 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:23.563141  9075 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:23.566246  1539 raft_consensus.cc:1275] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:00:23.570060  8938 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:23.577943  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3707) took 2577 ms. Trace:
I20260709 13:00:23.578372  1617 rpcz_store.cc:276] 0709 13:00:21.000876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.075503 (+ 74627us) service_pool.cc:224] Handling call
0709 13:00:21.075813 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:21.273002 (+197189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:23.577685 (+2304683us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b5400446bd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:23.577876 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448836992}
I20260709 13:00:23.579147  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:23.579805  2300 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 22.
I20260709 13:00:23.581377  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:23.581760  1539 raft_consensus.cc:1275] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:23.582552  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:23.583051  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.583137  2300 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:23.584146  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:23.585362  8998 log.cc:927] Time spent T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 2.575s	user 0.011s	sys 0.016s
I20260709 13:00:23.585956  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:23.587062  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:23.587195  2267 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:23.587978  8796 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.588595  8796 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:23.588778  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3874) took 3076 ms. Trace:
I20260709 13:00:23.589393  1690 rpcz_store.cc:276] 0709 13:00:20.512721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.512857 (+   136us) service_pool.cc:224] Handling call
0709 13:00:20.640054 (+127197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:21.643201 (+1003147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:23.588562 (+1945361us) spinlock_profiling.cc:243] Waited 871 ms on lock 0x7b54000efe54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:23.588724 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2004340608}
I20260709 13:00:23.588056  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:23.579694  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:23.592432  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:23.593047  1541 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 27. Current term is 28. Ops: []
I20260709 13:00:23.502566  8997 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:23.594360  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 3792) took 2594 ms. Trace:
I20260709 13:00:23.599483  1610 rpcz_store.cc:276] 0709 13:00:20.999657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.999768 (+   111us) service_pool.cc:224] Handling call
0709 13:00:21.000047 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:21.163197 (+163150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:23.594113 (+2430916us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54001f72d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:23.594298 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335308544}
I20260709 13:00:23.601094  1537 raft_consensus.cc:1275] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:00:23.597059  1535 raft_consensus.cc:1240] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:23.505026  8885 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:23.511459  8769 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:23.490496  9076 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.108s
I20260709 13:00:23.612273  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:23.612977  1682 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 20.
I20260709 13:00:23.616444  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:23.617362  1691 raft_consensus.cc:2393] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 21: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:23.514501  9065 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:23.588842  8969 consensus_queue.cc:1059] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 22.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.006s
I20260709 13:00:23.523671  8793 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:23.613940  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:23.658959  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.661556  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:23.663594  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:23.608179  8983 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:23.589629  8895 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:23.695187  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:23.749354  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.745502  9020 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:23.624392  9065 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:23.623929  8793 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:23.755719  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:23.760421  1691 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 26.
I20260709 13:00:23.757324  8803 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.763311  8803 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:23.620306  8981 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.075s
I20260709 13:00:23.769887  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:23.623250  9041 consensus_queue.cc:1048] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.131s
W20260709 13:00:23.764629  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 536285us
I20260709 13:00:23.623085  9017 consensus_queue.cc:1048] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.131s
I20260709 13:00:23.681206  8983 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:23.779626  1617 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 13:00:23.780843  1684 raft_consensus.cc:2393] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 18: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:23.750357  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:23.656857  8918 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.110s
I20260709 13:00:23.783470  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:23.605901  8777 consensus_queue.cc:237] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:23.766850  8793 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:23.805799  1505 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
W20260709 13:00:23.782218  9025 consensus_meta.cc:287] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.000s
I20260709 13:00:23.791460  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:23.812368  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:23.813455  1684 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 13:00:23.814445  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:23.815641  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:23.787086  8983 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:00:23.821465  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.854791  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:23.817003  8884 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:23.810730  8862 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.810541  9075 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.809808  8938 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 28 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:23.833438  8744 consensus_meta.cc:287] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.001s
I20260709 13:00:23.879841  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:23.880569  1691 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 22.
W20260709 13:00:23.881335  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 418181us
I20260709 13:00:23.883710  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:23.857789  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3887) took 3189 ms. Trace:
I20260709 13:00:23.820991  9025 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:23.859906  8884 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 13:00:23.858649  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 52949.2us
I20260709 13:00:23.891244  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:23.891840  1655 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:23.894484  1683 rpcz_store.cc:276] 0709 13:00:20.668244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.711041 (+ 42797us) service_pool.cc:224] Handling call
0709 13:00:20.711324 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:20.715917 (+  4593us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:00:21.484244 (+768327us) log.cc:844] Serialized 14 byte log entry
0709 13:00:22.719450 (+1235206us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:22.719504 (+    54us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:00:22.719550 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:23.857559 (+1138009us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b54000de654. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:23.857604 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:23.857727 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11826,"prepare.queue_time_us":1525436,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":162078,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":13122,"spinlock_wait_cycles":10028288,"thread_start_us":2002697,"threads_started":3,"wal-append.queue_time_us":984365,"wal-append.run_cpu_time_us":1292,"wal-append.run_wall_time_us":1011304}
W20260709 13:00:23.893573  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 433120us
I20260709 13:00:23.895035  1612 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 13:00:23.884292  9079 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:23.919170  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:23.883253  9038 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:23.874215  9075 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:23.949409  9075 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:23.923237  1505 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:23.919771  1612 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 17.
I20260709 13:00:23.952232  1505 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:23.952633  8714 consensus_queue.cc:1059] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:23.953138  1505 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:23.953733  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4509) took 2694 ms. Trace:
I20260709 13:00:23.954281  8938 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:23.954701  8938 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:23.954798  8848 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:00:23.955111  8938 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:23.955601  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:23.873996  8862 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:23.957604  2303 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:00:23.958137  8862 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:23.958698  8862 consensus_queue.cc:1059] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:00:23.924919  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:23.947362  8921 consensus_meta.cc:287] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.649s	user 0.007s	sys 0.000s
W20260709 13:00:23.925248  9095 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:00:23.879617  8744 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:23.918031  8884 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:23.927829  1613 raft_consensus.cc:2410] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:00:23.928891  9020 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:00:23.930016  9092 log.cc:927] Time spent T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 13:00:23.930867  9101 log.cc:927] Time spent T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:00:23.892776  8796 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:23.944159  8621 consensus_meta.cc:287] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.000s
I20260709 13:00:23.945220  8789 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:23.956386  1685 raft_consensus.cc:2393] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 22: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:23.959666  1683 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 13:00:23.926832  9025 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:23.954092  1533 rpcz_store.cc:276] 0709 13:00:21.258953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.262483 (+  3530us) service_pool.cc:224] Handling call
0709 13:00:21.274115 (+ 11632us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:22.699739 (+1425624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:23.953518 (+1253779us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540021a2d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:23.953679 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3060105984}
I20260709 13:00:23.966334  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:23.967001  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:23.964922  9034 raft_consensus.cc:3055] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:00:23.998941  9034 raft_consensus.cc:740] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:23.955250  8848 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:23.982573  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:24.024560  1610 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 18.
I20260709 13:00:23.943925  8718 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:23.953042  9038 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:23.983548  8895 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:23.998672  1612 raft_consensus.cc:2393] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 20: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:23.984699  1684 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 13:00:24.011492  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:24.057956  1691 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
W20260709 13:00:24.011793  2296 consensus_meta.cc:287] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.001s
I20260709 13:00:23.981231  8714 consensus_queue.cc:1243] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 20.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:00:24.021047  9034 consensus_queue.cc:260] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:24.041458  2297 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 24. Current term is 25. Ops: []
I20260709 13:00:24.070592  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:24.081140  2298 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32794 (request call id 998) took 2628 ms (client timeout 2893 ms). Trace:
I20260709 13:00:23.966833  8921 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:24.040416  8848 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:00:24.081622  2298 rpcz_store.cc:269] 0709 13:00:21.452318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.473606 (+ 21288us) service_pool.cc:224] Handling call
0709 13:00:24.070394 (+2596788us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b5800003c98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc8620170a0 00007fc862016984 00007fc85b5916d4 00007fc85b591662
0709 13:00:24.081063 (+ 10669us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7348608}
I20260709 13:00:24.038609  8803 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:24.101487  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 3802) took 1143 ms. Trace:
I20260709 13:00:24.041692  9038 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:24.075906  2296 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
W20260709 13:00:24.217448  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:24.769412  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:24.770129  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:24.548004  1539 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.007s	sys 0.009s
I20260709 13:00:24.634277  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1101) took 1469 ms. Trace:
I20260709 13:00:24.746418  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:24.748718  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 866653us
W20260709 13:00:24.664714  9102 log.cc:927] Time spent T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
W20260709 13:00:24.156859  9091 log.cc:927] Time spent T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:00:24.750149  1616 rpcz_store.cc:276] 0709 13:00:22.958405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.390002 (+431597us) service_pool.cc:224] Handling call
0709 13:00:23.390333 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:23.390706 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:23.390734 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:23.391167 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:00:23.883812 (+492645us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:23.884620 (+   808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:23.884697 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:24.101221 (+216524us) raft_consensus.cc:1685] finished
0709 13:00:24.101245 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.101412 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1162,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":15687,"thread_start_us":466717,"threads_started":1,"wal-append.queue_time_us":605769}
W20260709 13:00:24.773209  1539 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.007s	sys 0.014s
W20260709 13:00:24.707442  2295 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.003s	sys 0.016s
W20260709 13:00:24.620327  9105 log.cc:927] Time spent T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.218s	user 0.000s	sys 0.000s
W20260709 13:00:24.687906  9010 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.010s	sys 0.010s
I20260709 13:00:24.746315  2302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32788 (request call id 685) took 1530 ms. Trace:
I20260709 13:00:24.735215  8744 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:24.779572  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:24.796504  1683 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 13:00:24.771486  1688 rpcz_store.cc:276] 0709 13:00:23.164708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.238958 (+ 74250us) service_pool.cc:224] Handling call
0709 13:00:23.239317 (+   359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:23.318208 (+ 78891us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:23.318241 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:23.318908 (+   667us) log.cc:844] Serialized 52 byte log entry
0709 13:00:23.884491 (+565583us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:00:23.918920 (+ 34429us) log.cc:844] Serialized 14 byte log entry
0709 13:00:24.524847 (+605927us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b18002d4a80. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859edec0a 00007fc86361e219 00007fc859f66a40 00007fc859f614e4 00007fc859f61455 00007fc85d049060 00007fc85d05b716 00007fc85d06c287 00007fc85d06c208
0709 13:00:24.525108 (+   261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.525195 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:24.525234 (+    39us) raft_consensus.cc:1685] finished
0709 13:00:24.633989 (+108755us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.634198 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60957,"prepare.queue_time_us":34477,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":2521,"raft.queue_time_us":785463,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":12963,"spinlock_wait_cycles":4519168,"thread_start_us":440347,"threads_started":1,"wal-append.queue_time_us":475817}
W20260709 13:00:24.530714  8938 consensus_meta.cc:287] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.575s	user 0.008s	sys 0.000s
I20260709 13:00:24.794025  2302 rpcz_store.cc:276] 0709 13:00:23.216276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.420624 (+204348us) service_pool.cc:224] Handling call
0709 13:00:23.420977 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:23.421457 (+   480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:23.421490 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:23.421974 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 13:00:23.668886 (+246912us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:00:23.668941 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:23.669026 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:24.746021 (+1076995us) raft_consensus.cc:1685] finished
0709 13:00:24.746047 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.746234 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22998,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":13841,"spinlock_wait_cycles":38144,"thread_start_us":246390,"threads_started":1,"wal-append.queue_time_us":443291}
W20260709 13:00:24.176193  9069 consensus_meta.cc:287] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.763s	user 0.010s	sys 0.000s
I20260709 13:00:24.785542  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:24.777597  8803 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:24.664831  2294 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.000s	sys 0.011s
I20260709 13:00:24.750982  9038 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:24.401059  8968 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.618920  8775 raft_consensus.cc:3055] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:24.753223  9034 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:24.629829  9097 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:00:24.770722  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:24.799707  8769 consensus_meta.cc:287] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 1.181s	user 0.012s	sys 0.000s
I20260709 13:00:24.776815  8995 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:24.785719  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:24.825187  1616 raft_consensus.cc:2393] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 24: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 13:00:24.800240  1507 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.011s	sys 0.010s
W20260709 13:00:24.825855  1507 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.011s	sys 0.010s
I20260709 13:00:24.826050  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:24.777134  9040 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 13:00:24.774544  2296 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32788 (request call id 686) took 1548 ms (client timeout 2021 ms). Trace:
I20260709 13:00:24.802521  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:24.184221  8983 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:24.801419  8938 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:24.805167  9015 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 13:00:24.844919  9018 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.927s	user 0.017s	sys 0.046s
I20260709 13:00:24.814532  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 3713) took 3186 ms. Trace:
I20260709 13:00:24.815876  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 3723) took 1414 ms. Trace:
I20260709 13:00:24.850410  1617 rpcz_store.cc:276] 0709 13:00:23.401624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.579438 (+177814us) service_pool.cc:224] Handling call
0709 13:00:24.815690 (+1236252us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54000677d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:24.815809 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430362368}
I20260709 13:00:24.818619  8718 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:24.851806  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:24.796764  9010 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.010s	sys 0.012s
W20260709 13:00:24.788100  2295 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.903s	user 0.004s	sys 0.017s
I20260709 13:00:24.822625  1535 raft_consensus.cc:1240] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 22. Current term is 23. Ops: []
I20260709 13:00:24.819123  8775 raft_consensus.cc:740] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
W20260709 13:00:24.803597  2294 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.000s	sys 0.012s
I20260709 13:00:24.825485  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1105) took 1565 ms. Trace:
W20260709 13:00:24.850033  9018 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.018s	sys 0.046s
W20260709 13:00:24.826180  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 537353us
W20260709 13:00:24.802863  8884 consensus_meta.cc:287] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.824s	user 0.009s	sys 0.000s
W20260709 13:00:24.828073  1540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 4519) took 1843 ms (client timeout 2201 ms). Trace:
W20260709 13:00:24.760336  9086 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.101s	sys 0.105s
W20260709 13:00:24.828665  1505 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.874s	user 0.010s	sys 0.009s
I20260709 13:00:24.800091  1610 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 13:00:24.830092  1683 raft_consensus.cc:2393] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 21: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:24.830204  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:24.850095  9063 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.831601  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 3811) took 1053 ms. Trace:
I20260709 13:00:24.864394  1616 rpcz_store.cc:276] 0709 13:00:23.778241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.785439 (+1007198us) service_pool.cc:224] Handling call
0709 13:00:24.831534 (+ 46095us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:24.821179  8968 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:24.805203  8803 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:24.852845  1613 rpcz_store.cc:276] 0709 13:00:21.628137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.754537 (+1126400us) service_pool.cc:224] Handling call
0709 13:00:24.814272 (+2059735us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540008cfd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:24.814456 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2342996224}
I20260709 13:00:24.801266  9069 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:24.853963  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 3812) took 1075 ms. Trace:
I20260709 13:00:24.824553  8921 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:24.851720  9097 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
W20260709 13:00:24.831310  1655 connection.cc:256] RPC call timeout handler was delayed by -1.5844595600000275s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1942s for a response
W20260709 13:00:24.862319  1540 rpcz_store.cc:269] 0709 13:00:22.984753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.984895 (+   142us) service_pool.cc:224] Handling call
0709 13:00:24.827874 (+1842979us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54002bf054. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:24.828016 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515032448}
I20260709 13:00:24.829262  8995 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:24.866945  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:24.858644  1687 rpcz_store.cc:276] 0709 13:00:23.266876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.267036 (+   160us) service_pool.cc:224] Handling call
0709 13:00:23.267364 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:23.321690 (+ 54326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:23.321725 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:23.322250 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:00:23.346026 (+ 23776us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b48001c0158. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc861f7aaa1 00007fc861f71b37 00007fc861f719ca 00007fc86206926f 00007fc862068f37 00007fc86207d55c 00007fc86207d508 00007fc86207d488 00007fc86207d443 00007fc86207c6ec 00007fc860fa6a96
0709 13:00:23.780591 (+434565us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:23.780635 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:23.780703 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:24.823081 (+1042378us) raft_consensus.cc:1685] finished
0709 13:00:24.823102 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.825421 (+  2319us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53781,"raft.queue_time_us":57158,"raft.run_cpu_time_us":1667,"raft.run_wall_time_us":18018,"spinlock_wait_cycles":9602432,"thread_start_us":450128,"threads_started":1,"wal-append.queue_time_us":652896}
W20260709 13:00:24.863797  9086 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.101s	sys 0.105s
W20260709 13:00:24.831377  2296 rpcz_store.cc:269] 0709 13:00:23.227286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.236822 (+  9536us) service_pool.cc:224] Handling call
0709 13:00:24.772149 (+1535327us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:24.863422  1505 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.909s	user 0.010s	sys 0.009s
I20260709 13:00:24.845067  9040 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:24.833297  8769 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:00:24.867691  9014 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.915s	user 0.016s	sys 0.018s
I20260709 13:00:24.862813  8871 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.893977  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:24.851557  9015 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:24.897058  1690 raft_consensus.cc:2393] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 28: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:24.884575  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:24.885308  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:24.905293  1616 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
I20260709 13:00:24.905862  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 3820) took 1121 ms. Trace:
I20260709 13:00:24.906103  1616 rpcz_store.cc:276] 0709 13:00:23.784408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.865170 (+1080762us) service_pool.cc:224] Handling call
0709 13:00:24.905815 (+ 40645us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:24.887216  1613 raft_consensus.cc:2393] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 22: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 13:00:24.889663  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 935269us
I20260709 13:00:24.907428  1505 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:24.908430  1505 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:24.882767  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:24.870673  1617 rpcz_store.cc:276] 0709 13:00:23.778931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.851531 (+1072600us) service_pool.cc:224] Handling call
0709 13:00:24.853897 (+  2366us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:24.898917  2266 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.013s	sys 0.059s
I20260709 13:00:24.882477  8796 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:24.909463  2266 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.013s	sys 0.060s
W20260709 13:00:24.911224  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 603787us
I20260709 13:00:24.909570  1610 raft_consensus.cc:2410] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:00:24.912065  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 3810) took 1135 ms. Trace:
I20260709 13:00:24.912765  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 3813) took 1133 ms. Trace:
I20260709 13:00:24.912436  1610 rpcz_store.cc:276] 0709 13:00:23.776632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.862863 (+1086231us) service_pool.cc:224] Handling call
0709 13:00:24.912002 (+ 49139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:24.913182  1613 rpcz_store.cc:276] 0709 13:00:23.779568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.866645 (+1087077us) service_pool.cc:224] Handling call
0709 13:00:24.912701 (+ 46056us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:24.917577  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 1072) took 1780 ms. Trace:
I20260709 13:00:24.918031  1613 rpcz_store.cc:276] 0709 13:00:23.137432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.916757 (+1779325us) service_pool.cc:224] Handling call
0709 13:00:24.917063 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.917244 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:24.917268 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:24.917310 (+    42us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:00:24.917347 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.917411 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.917520 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:24.919585  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 1073) took 1781 ms. Trace:
I20260709 13:00:24.919836  1613 rpcz_store.cc:276] 0709 13:00:23.137725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.918964 (+1781239us) service_pool.cc:224] Handling call
0709 13:00:24.919204 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.919346 (+   142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:24.919360 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:24.919388 (+    28us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:00:24.919422 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.919456 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.919544 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:24.915107  1505 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:24.903395  9014 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.951s	user 0.016s	sys 0.018s
I20260709 13:00:24.892764  2295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32788 (request call id 695) took 1408 ms. Trace:
I20260709 13:00:24.883796  9060 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:24.924893  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:24.927256  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3719) took 1528 ms. Trace:
I20260709 13:00:24.929682  1613 rpcz_store.cc:276] 0709 13:00:23.398610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.926429 (+1527819us) service_pool.cc:224] Handling call
0709 13:00:24.926725 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.926920 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:24.926945 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:24.926987 (+    42us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:00:24.927023 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.927074 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.927194 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:24.865720  9075 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.012s	sys 0.033s
I20260709 13:00:24.934015  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 3816) took 1152 ms. Trace:
I20260709 13:00:24.934561  1613 rpcz_store.cc:276] 0709 13:00:23.782079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.930845 (+1148766us) service_pool.cc:224] Handling call
0709 13:00:24.931146 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.933678 (+  2532us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:24.933706 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:24.933752 (+    46us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:24.933782 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.933849 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.933957 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:24.934610  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 1071) took 1798 ms. Trace:
I20260709 13:00:24.936066  1610 rpcz_store.cc:276] 0709 13:00:23.136620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.917020 (+1780400us) service_pool.cc:224] Handling call
0709 13:00:24.934104 (+ 17084us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.934278 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:24.934300 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:24.934337 (+    37us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:00:24.934375 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.934448 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.934557 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:24.936757  1616 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:00:24.939388  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:24.939822  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 3808) took 1832 ms. Trace:
I20260709 13:00:24.940729  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:24.943150  9015 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:24.947459  1616 rpcz_store.cc:276] 0709 13:00:23.106468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.914199 (+1807731us) service_pool.cc:224] Handling call
0709 13:00:24.930561 (+ 16362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.938480 (+  7919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.939023 (+   543us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:24.868094  8884 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:24.928148  8744 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:24.951892  2296 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:00:24.923110  9020 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:24.912977  8871 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:24.955085  8803 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:24.957598  9038 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:24.933017  9075 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.982s	user 0.012s	sys 0.034s
I20260709 13:00:24.928066  8963 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:24.869547  9063 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:24.962486  2300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32794 (request call id 1010) took 1402 ms. Trace:
I20260709 13:00:24.930955  8718 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:24.983635  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:24.920692  8796 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:24.899506  8775 consensus_queue.cc:260] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:24.997219  1535 raft_consensus.cc:1240] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:24.998790  2300 rpcz_store.cc:276] 0709 13:00:23.560595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.605109 (+ 44514us) service_pool.cc:224] Handling call
0709 13:00:23.605452 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:23.615080 (+  9628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:23.615117 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:23.656407 (+ 41290us) log.cc:844] Serialized 26 byte log entry
0709 13:00:24.141641 (+485234us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:24.141683 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.141755 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:24.962251 (+820496us) raft_consensus.cc:1685] finished
0709 13:00:24.962270 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.962427 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9792,"raft.queue_time_us":9863,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":9363,"thread_start_us":366807,"threads_started":1,"wal-append.queue_time_us":1202897}
I20260709 13:00:24.981427  8744 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:25.004781  1540 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:25.005543  1542 raft_consensus.cc:1240] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:00:24.985169  9020 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.011564  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1170) took 1220 ms. Trace:
I20260709 13:00:25.012020  1537 rpcz_store.cc:276] 0709 13:00:23.790884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.791053 (+   169us) service_pool.cc:224] Handling call
0709 13:00:23.794257 (+  3204us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:23.794632 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:23.794666 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:23.795158 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 13:00:24.084074 (+288916us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:24.084122 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.084202 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:25.011337 (+927135us) raft_consensus.cc:1685] finished
0709 13:00:25.011359 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.011501 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":763,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":18870,"thread_start_us":224573,"threads_started":1,"wal-append.queue_time_us":1064593}
I20260709 13:00:24.996584  8963 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:25.017061  1683 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 13:00:25.014323  8744 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:00:25.028607  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 204207us
I20260709 13:00:25.014178  9020 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:25.030761  1654 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:25.031778  1540 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 22.
I20260709 13:00:25.031872  1654 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:25.018476  8963 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:25.019222  8983 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:25.033378  9065 consensus_meta.cc:287] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 1.257s	user 0.013s	sys 0.000s
I20260709 13:00:25.036769  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:25.034754  1654 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:25.022326  8775 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:25.009760  8718 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:25.037858  1537 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 17.
I20260709 13:00:25.042562  8968 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:24.928409  2295 rpcz_store.cc:276] 0709 13:00:23.480394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.516766 (+ 36372us) service_pool.cc:224] Handling call
0709 13:00:23.517127 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:23.517358 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:00:23.873826 (+356468us) log.cc:844] Serialized 14 byte log entry
0709 13:00:24.862038 (+988212us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:24.865976 (+  3938us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:24.868250 (+  2274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.882319 (+ 14069us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:24.889081 (+  6762us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":462465,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":40,"raft.queue_time_us":6631,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":14261,"thread_start_us":1312468,"threads_started":2,"wal-append.queue_time_us":1037120}
W20260709 13:00:25.052974  9109 log.cc:927] Time spent T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:00:25.041497  9065 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:25.049111  9116 log.cc:927] Time spent T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:00:25.050964  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1097) took 1995 ms. Trace:
W20260709 13:00:25.050146  1608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 1066) took 3601 ms (client timeout 2862 ms). Trace:
I20260709 13:00:25.049340  2297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32788 (request call id 688) took 1795 ms. Trace:
I20260709 13:00:25.043388  8903 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:25.042032  9089 log.cc:927] Time spent T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 1.711s	user 0.007s	sys 0.008s
I20260709 13:00:25.047317  8884 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:25.054175  2269 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:25.037417  9097 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:25.038190  8938 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:25.036854  8777 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:25.039004  9014 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:25.079247  9038 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:25.091485  1682 raft_consensus.cc:2393] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 21: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:25.087414  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:25.095324  2269 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:25.095989  9121 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:25.076835  9015 consensus_queue.cc:1048] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:00:25.076067  8995 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:25.102626  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 3797) took 2149 ms. Trace:
I20260709 13:00:25.121085  1611 rpcz_store.cc:276] 0709 13:00:22.952860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.953001 (+   141us) service_pool.cc:224] Handling call
0709 13:00:22.953354 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:22.953737 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:00:23.165681 (+211944us) log.cc:844] Serialized 14 byte log entry
0709 13:00:23.331117 (+165436us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:23.332099 (+   982us) log.cc:844] Serialized 26 byte log entry
0709 13:00:23.332259 (+   160us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:23.332293 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:23.332357 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:25.041418 (+1709061us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 13:00:25.102317 (+ 60899us) raft_consensus.cc:1685] finished
0709 13:00:25.102426 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.102566 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":357251,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":204,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":6044,"spinlock_wait_cycles":4224000,"thread_start_us":318057,"threads_started":2,"wal-append.queue_time_us":149925}
I20260709 13:00:25.123741  2269 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:25.091998  1608 rpcz_store.cc:269] 0709 13:00:21.448562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.514331 (+ 65769us) service_pool.cc:224] Handling call
0709 13:00:25.049868 (+3535537us) spinlock_profiling.cc:243] Waited 986 ms on lock 0x7b54002567d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:25.050037 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2267991296}
W20260709 13:00:25.084712  9122 log.cc:927] Time spent T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:00:25.072996  9069 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 28 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:25.091797  1689 rpcz_store.cc:276] 0709 13:00:23.055506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.098947 (+ 43441us) service_pool.cc:224] Handling call
0709 13:00:23.099262 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:23.331914 (+232652us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:23.331945 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:23.331983 (+    38us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:00:23.332014 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.050736 (+1718722us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b540022a6d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:25.050779 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.050908 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":534668544}
I20260709 13:00:25.092613  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1171) took 1197 ms. Trace:
W20260709 13:00:25.089165  9113 log.cc:927] Time spent T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 13:00:25.075553  8793 consensus_meta.cc:287] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 1.254s	user 0.010s	sys 0.000s
I20260709 13:00:25.145151  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:25.157636  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:25.076213  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:25.159427  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:25.160499  2295 raft_consensus.cc:2410] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:00:25.076859  8803 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:25.161552  8803 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:25.163936  8803 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:25.094480  8777 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:25.164687  8777 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:25.064172  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4687) took 1307 ms. Trace:
I20260709 13:00:25.092168  2297 rpcz_store.cc:276] 0709 13:00:23.253601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.458371 (+204770us) service_pool.cc:224] Handling call
0709 13:00:23.458665 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.075552 (+616887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.049082 (+973530us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b54005d2ad4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:25.049281 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1339985280}
I20260709 13:00:25.067499  8796 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:25.094069  9097 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.091172  9065 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:25.128319  1539 rpcz_store.cc:276] 0709 13:00:23.895244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.895417 (+   173us) service_pool.cc:224] Handling call
0709 13:00:23.922879 (+ 27462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:23.923208 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:23.923234 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:23.923710 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:00:24.783735 (+860025us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:24.783780 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.783858 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:25.092296 (+308438us) raft_consensus.cc:1685] finished
0709 13:00:25.092317 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.092532 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26932,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":122,"thread_start_us":817348,"threads_started":1,"wal-append.queue_time_us":959609}
I20260709 13:00:25.074254  8651 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:25.072942  9040 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:25.088012  8718 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:25.166817  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 263211us
I20260709 13:00:25.170063  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3726) took 1200 ms. Trace:
I20260709 13:00:25.166635  1685 rpcz_store.cc:276] 0709 13:00:23.756539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.001728 (+245189us) service_pool.cc:224] Handling call
0709 13:00:24.002079 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:24.749256 (+747177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:24.749287 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:24.749772 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:00:25.009318 (+259546us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:25.009364 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.009432 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:25.063913 (+ 54481us) raft_consensus.cc:1685] finished
0709 13:00:25.063938 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.064107 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":665293,"raft.queue_time_us":767635,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":13845,"thread_start_us":222518,"threads_started":1,"wal-append.queue_time_us":256502}
I20260709 13:00:25.158625  9020 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:25.124039  9121 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:25.117209  8744 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:25.126438  8968 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:00:25.168717  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:25.178815  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3727) took 1206 ms. Trace:
I20260709 13:00:25.078577  8848 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:25.168121  8983 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:25.181736  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:25.181967  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:25.174945  1614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 3794) took 2229 ms (client timeout 1934 ms). Trace:
I20260709 13:00:25.180125  1610 rpcz_store.cc:276] 0709 13:00:23.969550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.937140 (+967590us) service_pool.cc:224] Handling call
0709 13:00:24.981366 (+ 44226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.981780 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:00:25.115472 (+133692us) log.cc:844] Serialized 14 byte log entry
0709 13:00:25.169670 (+ 54198us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:25.169728 (+    58us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:00:25.169785 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.169855 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.169998 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":134291,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":2694,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":4783,"thread_start_us":168046,"threads_started":2}
I20260709 13:00:25.185588  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:25.146235  8963 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:25.221478  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:25.222092  1540 raft_consensus.cc:2393] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 22: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
W20260709 13:00:25.240054  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.247754  1539 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 21.
I20260709 13:00:25.176609  9055 raft_consensus.cc:3055] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:00:25.247356  1614 rpcz_store.cc:269] 0709 13:00:22.945509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.946630 (+  1121us) service_pool.cc:224] Handling call
0709 13:00:25.174764 (+2228134us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b540008bbd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:25.174875 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":457949952}
I20260709 13:00:25.246521  1608 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:00:25.249600  1685 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 13:00:25.252384  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:25.246433  1616 rpcz_store.cc:276] 0709 13:00:23.972220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.954046 (+981826us) service_pool.cc:224] Handling call
0709 13:00:24.986180 (+ 32134us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:24.986412 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:00:25.115082 (+128670us) log.cc:844] Serialized 14 byte log entry
0709 13:00:25.178329 (+ 63247us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:25.178421 (+    92us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:25.178495 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.178577 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.178746 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15792,"prepare.queue_time_us":129919,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":1284,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":3927,"thread_start_us":165444,"threads_started":2}
I20260709 13:00:25.253430  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:25.195675  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.241076  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 1069) took 2105 ms. Trace:
I20260709 13:00:25.174930  8803 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.251143  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:25.172673  8793 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:25.172083  9097 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:25.254732  1617 rpcz_store.cc:276] 0709 13:00:23.136114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.915597 (+1779483us) service_pool.cc:224] Handling call
0709 13:00:24.915968 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:24.923825 (+  7857us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:24.923856 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:24.932444 (+  8588us) log.cc:844] Serialized 26 byte log entry
0709 13:00:25.114547 (+182103us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:25.114591 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.114667 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:25.240788 (+126121us) raft_consensus.cc:1685] finished
0709 13:00:25.240810 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.240987 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":142,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":7417,"thread_start_us":151683,"threads_started":1,"wal-append.queue_time_us":282671}
I20260709 13:00:25.268887  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:25.268891  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:25.237601  2294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32794 (request call id 1011) took 1675 ms. Trace:
I20260709 13:00:25.256065  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:25.271874  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:25.272266  2301 raft_consensus.cc:2376] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15. Re-sending same reply.
I20260709 13:00:25.256697  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:25.272195  2303 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 13:00:25.273550  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:25.273574  1608 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 28.
I20260709 13:00:25.251695  8968 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.260417  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:25.275084  1614 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 13:00:25.261684  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:25.185453  9121 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:25.276244  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:25.265504  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:25.187219  2296 raft_consensus.cc:2393] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 11: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:25.221444  8983 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:25.282016  8983 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:25.283751  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3725) took 1319 ms. Trace:
I20260709 13:00:25.284201  1613 rpcz_store.cc:276] 0709 13:00:23.964659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.935757 (+971098us) service_pool.cc:224] Handling call
0709 13:00:24.936146 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:24.936528 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:24.936559 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:24.937131 (+   572us) log.cc:844] Serialized 26 byte log entry
0709 13:00:25.126536 (+189405us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:25.174463 (+ 47927us) log.cc:844] Serialized 14 byte log entry
0709 13:00:25.175224 (+   761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.175302 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:25.283523 (+108221us) raft_consensus.cc:1685] finished
0709 13:00:25.283545 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.283687 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":491,"prepare.queue_time_us":54667,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":1832,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":7237,"spinlock_wait_cycles":3756288,"thread_start_us":139711,"threads_started":1,"wal-append.queue_time_us":306256}
I20260709 13:00:25.286167  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:25.287387  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:25.287955  1683 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 13:00:25.288414  9020 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:25.251912  9055 raft_consensus.cc:740] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:25.294081  8963 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:25.295411  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:25.295739  8793 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:25.296202  8744 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:25.270040  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:25.298707  2267 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:25.258617  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.186955  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:25.276655  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:25.278777  1608 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 13:00:25.306095  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:25.277351  8968 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:25.307505  1540 raft_consensus.cc:1240] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:25.276036  2300 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 20.
I20260709 13:00:25.265118  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:25.309481  1537 raft_consensus.cc:1240] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:25.183883  8718 consensus_queue.cc:1048] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.081s
I20260709 13:00:25.314459  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3729) took 1331 ms. Trace:
I20260709 13:00:25.314942  1610 rpcz_store.cc:276] 0709 13:00:23.983393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.280661 (+1297268us) service_pool.cc:224] Handling call
0709 13:00:25.313867 (+ 33206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.314068 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:25.314096 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:25.314140 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:25.314181 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.314235 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.314397 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:25.317211  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.278059  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:25.276317  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3728) took 1299 ms. Trace:
I20260709 13:00:25.278371  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:25.320533  1617 raft_consensus.cc:2410] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 25 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:00:25.279006  1688 raft_consensus.cc:2393] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 17: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:25.271989  2294 rpcz_store.cc:276] 0709 13:00:23.562388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.875589 (+313201us) service_pool.cc:224] Handling call
0709 13:00:23.893398 (+ 17809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:23.923130 (+ 29732us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:00:24.868467 (+945337us) log.cc:844] Serialized 14 byte log entry
0709 13:00:25.237163 (+368696us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:25.237228 (+    65us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:25.237281 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.237386 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.237537 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":61907,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":16520,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":1205432,"threads_started":2}
I20260709 13:00:25.297052  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:25.259259  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:25.328939  1539 raft_consensus.cc:2468] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 7.
I20260709 13:00:25.294096  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1168) took 1755 ms. Trace:
I20260709 13:00:25.329795  1534 rpcz_store.cc:276] 0709 13:00:23.538311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.559908 (+ 21597us) service_pool.cc:224] Handling call
0709 13:00:23.560172 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.292725 (+1732553us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:25.292758 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:25.292800 (+    42us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:25.292831 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.293858 (+  1027us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b540045db54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:25.293906 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.294037 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3984311680}
I20260709 13:00:25.331444  1534 raft_consensus.cc:1240] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:25.300504  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:25.308900  8777 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:25.268416  8803 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:25.342139  9015 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:25.342815  9015 raft_consensus.cc:697] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 22 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
W20260709 13:00:25.344918  9137 log.cc:927] Time spent T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:00:25.335824  8848 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 28 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:25.332787  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:25.332261  1683 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
W20260709 13:00:25.353219  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 224317us
I20260709 13:00:25.363528  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:25.375950  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 77332us
W20260709 13:00:25.377148  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:25.413173  1536 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 3563) took 3056 ms (client timeout 1942 ms). Trace:
W20260709 13:00:25.413715  1536 rpcz_store.cc:269] 0709 13:00:22.307736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.314048 (+  6312us) service_pool.cc:224] Handling call
0709 13:00:25.364359 (+3050311us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b5400312ed4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:25.364497 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":835004160}
I20260709 13:00:25.414496  1617 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:00:25.414920  1536 raft_consensus.cc:1240] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:25.415403  2298 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:25.417759  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:25.418416  1507 leader_election.cc:336] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Timed out: RequestConsensusVote RPC to 127.0.107.196:33437 timed out after 1.762s (SENT)
I20260709 13:00:25.418620  1683 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 13:00:25.419878  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:25.420220  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:25.305330  8775 consensus_queue.cc:1059] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 22.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.057s
I20260709 13:00:25.414644  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:25.423218  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:25.424585  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:25.325901  1611 rpcz_store.cc:276] 0709 13:00:23.976902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.123133 (+1146231us) service_pool.cc:224] Handling call
0709 13:00:25.126698 (+  3565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.126915 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:00:25.181384 (+ 54469us) log.cc:844] Serialized 14 byte log entry
0709 13:00:25.275986 (+ 94602us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:25.276040 (+    54us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:25.276090 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.276154 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.276266 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47372,"prepare.queue_time_us":94066,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":5039,"raft.queue_time_us":921,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":97,"thread_start_us":89997,"threads_started":1}
I20260709 13:00:25.425532  1542 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 13:00:25.425576  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:25.425535  1534 raft_consensus.cc:2393] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 23: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:25.429454  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:25.430143  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:25.433604  1614 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 13:00:25.343724  9015 consensus_queue.cc:237] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:25.436064  1534 raft_consensus.cc:1240] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:25.436034  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:25.437765  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
W20260709 13:00:25.478122  9136 log.cc:927] Time spent T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:00:25.478892  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:25.486657  2298 raft_consensus.cc:2376] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20. Re-sending same reply.
W20260709 13:00:25.479972  9127 log.cc:927] Time spent T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:00:25.485388  8803 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:25.492579  8777 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:25.441789  1685 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 8.
I20260709 13:00:25.498646  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:25.499285  1685 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:00:25.500751  2267 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:25.511188  1540 raft_consensus.cc:1240] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:25.429186  9055 consensus_queue.cc:260] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:25.540103  9055 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:25.528013  8968 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:25.552829  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:25.549007  9143 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:25.555946  1537 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:25.554172  9143 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.558076  9143 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:25.565351  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:25.565718  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:25.566171  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:25.566777  1534 raft_consensus.cc:2410] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 25 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:00:25.567356  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:25.567620  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:25.567930  1536 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 13:00:25.568943  1540 raft_consensus.cc:2393] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 28: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:25.569042  1534 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:00:25.566885  1542 raft_consensus.cc:2393] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 17: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:25.570191  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:25.571486  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:25.565294  1537 raft_consensus.cc:1275] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:00:25.578975  8968 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:25.581255  1611 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 13:00:25.582072  1611 pending_rounds.cc:85] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f: Aborting all ops after (but not including) 13
I20260709 13:00:25.582512  1611 pending_rounds.cc:107] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:00:25.582966  1611 raft_consensus.cc:2889] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:25.583283  1611 pending_rounds.cc:107] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 13:00:25.584360  1611 raft_consensus.cc:2889] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:25.594856  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:25.595635  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:25.596968  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:25.597739  1613 raft_consensus.cc:2393] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 28: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:25.598542  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:25.595666  1614 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:25.601205  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:25.601946  1617 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:00:25.617671  1507 leader_election.cc:336] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Timed out: RequestConsensusVote RPC to 127.0.107.196:33437 timed out after 1.993s (SENT)
I20260709 13:00:25.626645  1614 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 17.
W20260709 13:00:25.622169  9148 log.cc:927] Time spent T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:00:25.550725  8983 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:25.634531  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:25.635972  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:25.637189  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:25.638310  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
W20260709 13:00:25.638396  1538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 4527) took 2499 ms (client timeout 2051 ms). Trace:
W20260709 13:00:25.640141  1538 rpcz_store.cc:269] 0709 13:00:23.138693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.214180 (+ 75487us) service_pool.cc:224] Handling call
0709 13:00:25.638224 (+2424044us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b540007dd54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:25.638328 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":398777600}
I20260709 13:00:25.641876  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 1064) took 4193 ms. Trace:
I20260709 13:00:25.642326  1609 rpcz_store.cc:276] 0709 13:00:21.448019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:22.850025 (+1402006us) service_pool.cc:224] Handling call
0709 13:00:22.850330 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:22.980506 (+130176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:22.980539 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:22.980583 (+    44us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:00:22.980622 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.641648 (+2661026us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54002a67d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:25.641693 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.641820 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298918144}
I20260709 13:00:25.643456  1685 raft_consensus.cc:2410] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 28 because replica has last-logged OpId of term: 27 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 17.
I20260709 13:00:25.643754  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:25.645443  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:25.646119  2298 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:25.647212  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:25.634490  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:25.651005  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:25.652623  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:25.653707  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:25.654719  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 3896) took 1027 ms. Trace:
I20260709 13:00:25.655069  1685 rpcz_store.cc:276] 0709 13:00:24.626846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.649586 (+1022740us) service_pool.cc:224] Handling call
0709 13:00:25.654660 (+  5074us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:25.656095  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:25.658017  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1164) took 2120 ms. Trace:
I20260709 13:00:25.658490  1541 rpcz_store.cc:276] 0709 13:00:23.537212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.552807 (+ 15595us) service_pool.cc:224] Handling call
0709 13:00:23.553092 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:23.593727 (+ 40635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.657747 (+2064020us) spinlock_profiling.cc:243] Waited 39.8 ms on lock 0x7b540010ccd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:25.657936 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91471744}
W20260709 13:00:25.661475  1583 leader_election.cc:336] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 2.159s (SENT)
I20260709 13:00:25.661983  1583 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:25.665450  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:25.666774  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 4697) took 1626 ms. Trace:
I20260709 13:00:25.667210  1685 rpcz_store.cc:276] 0709 13:00:24.040914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.665132 (+1624218us) service_pool.cc:224] Handling call
0709 13:00:25.666706 (+  1574us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:25.664340  1617 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 22.
I20260709 13:00:25.671140  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 4683) took 2042 ms. Trace:
I20260709 13:00:25.672672  8627 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:25.674217  9022 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:25.708860  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:25.706578  1684 rpcz_store.cc:276] 0709 13:00:23.629000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.815392 (+186392us) service_pool.cc:224] Handling call
0709 13:00:25.670942 (+1855550us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b54000df554. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:25.671071 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":387181312}
I20260709 13:00:25.674441  9143 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:25.676272  9121 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:25.677424  8871 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:25.715647  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:25.716256  1684 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:25.677984  9097 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:25.682705  1655 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:25.629256  9146 consensus_queue.cc:1059] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:00:25.686401  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:25.725605  2300 raft_consensus.cc:2393] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 25: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:25.671171  8125 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:25.689253  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:25.693640  1683 raft_consensus.cc:2376] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 24. Re-sending same reply.
I20260709 13:00:25.741091  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 4699) took 1686 ms. Trace:
I20260709 13:00:25.741504  1683 rpcz_store.cc:276] 0709 13:00:24.054653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.419575 (+1364922us) service_pool.cc:224] Handling call
0709 13:00:25.693504 (+273929us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b54000e1620. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85cfc8dc0 00007fc85d054e18 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:25.741019 (+ 47515us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2999552}
I20260709 13:00:25.693787  8983 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:25.697182  1508 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:25.743067  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 45964.2us
I20260709 13:00:25.699180  1609 raft_consensus.cc:1275] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:00:25.700691  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:25.746776  1614 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:25.704988  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:25.667341  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.745386  1508 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:25.710054  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:25.749631  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:25.750047  2298 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:00:25.750279  9056 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.748286  1505 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:25.750867  9056 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:25.750599  9022 raft_consensus.cc:2804] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:25.714717  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:25.757341  2297 raft_consensus.cc:2393] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 15: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:25.756649  9022 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:25.758670  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:25.759156  9022 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:25.760536  9143 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:25.762282  9121 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:25.764812  2298 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [term 19 LEARNER]: Advancing to term 20
W20260709 13:00:25.765455  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:25.767580  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.769157  1684 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 25.
I20260709 13:00:25.765646  1689 raft_consensus.cc:2368] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 20. Current term is 21.
W20260709 13:00:25.732399  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.774891  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:25.726612  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 44015.8us
I20260709 13:00:25.749663  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:25.706768  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:25.774395  2269 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:25.753587  1683 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
I20260709 13:00:25.713922  9037 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.778607  1655 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:25.728050  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.776117  2300 raft_consensus.cc:2393] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 18: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:25.740972  8871 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:00:25.779381  1508 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:25.781486  1685 raft_consensus.cc:2393] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 20: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:25.782650  1684 raft_consensus.cc:2468] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 7.
I20260709 13:00:25.782205  1614 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 13:00:25.783385  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 4701) took 1689 ms. Trace:
I20260709 13:00:25.752686  9038 raft_consensus.cc:2764] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:00:25.784056  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 3895) took 1156 ms. Trace:
I20260709 13:00:25.783782  1685 rpcz_store.cc:276] 0709 13:00:24.094170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.706461 (+1612291us) service_pool.cc:224] Handling call
0709 13:00:25.783323 (+ 76862us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:25.786288  1684 rpcz_store.cc:276] 0709 13:00:24.626554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.774636 (+1148082us) service_pool.cc:224] Handling call
0709 13:00:25.783280 (+  8644us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:25.788166  1541 raft_consensus.cc:1275] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:00:25.764271  9020 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:25.773217  9144 raft_consensus.cc:3055] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:25.793305  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:25.796327  2298 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEARNER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 16. (term mismatch)
I20260709 13:00:25.797204  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:25.794023  1683 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 21.
I20260709 13:00:25.799572  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:25.799723  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.801535  1538 raft_consensus.cc:2393] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 28: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:25.801714  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:25.806157  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:25.790678  8885 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:25.768926  9088 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:00:25.807000  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:25.813196  1691 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 22.
I20260709 13:00:25.808552  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:25.809090  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:25.814951  1683 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:25.797513  9044 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:25.796696  2298 pending_rounds.cc:85] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579: Aborting all ops after (but not including) 15
W20260709 13:00:25.805217  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 257367us
I20260709 13:00:25.818629  2298 pending_rounds.cc:107] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579: Aborting uncommitted NO_OP operation due to leader change: 19.16
W20260709 13:00:25.810144  1657 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:33206 dropped due to backpressure: service queue is full with 50 items
I20260709 13:00:25.791203  9020 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.798343  8871 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:25.792554  9144 raft_consensus.cc:740] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:25.823587  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:25.809084  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:25.802423  8968 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:00:25.820294  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:25.824431  1691 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 13:00:25.825042  1614 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 28.
I20260709 13:00:25.786011  9037 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:25.819069  2298 raft_consensus.cc:2889] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:25.819433  1657 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:33206 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 4714)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 3903)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 4715)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 4716)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 3901)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 3929)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 3927)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 4717)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 4718)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33206 (request call id 1122)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 3928)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 4706)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 4719)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 3924)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 3925)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 4720)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 3930)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 3917)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 4721)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 4722)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 4705)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 3926)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33206 (request call id 1124)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 3905)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33206 (request call id 1115)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33206 (request call id 1120)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4702)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3891)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3893)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3894)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3899)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3900)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3904)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3915)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3919)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1110)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1111)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1112)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1116)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1117)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1118)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1119)
I20260709 13:00:25.839880  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:25.842183  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:25.843209  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:25.889889  1534 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:25.844718  9153 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:25.892356  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:25.811146  8885 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:25.855577  9144 consensus_queue.cc:260] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:25.893141  8885 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:00:25.894027  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.864279  9077 raft_consensus.cc:3055] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:25.896680  9077 raft_consensus.cc:740] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 13:00:25.897166  1612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 3817) took 2114 ms (client timeout 1967 ms). Trace:
I20260709 13:00:25.897646  9077 consensus_queue.cc:260] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:25.898741  9077 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:00:25.899680  9110 log.cc:927] Time spent T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.948s	user 0.002s	sys 0.000s
I20260709 13:00:25.893994  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:25.901330  1691 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 13:00:25.902333  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:25.866660  1685 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 17.
I20260709 13:00:25.821292  9020 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:25.869236  9063 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:25.872820  8968 raft_consensus.cc:697] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 25 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:25.929488  8968 consensus_queue.cc:237] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:25.931371  2267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.873057  1505 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:25.932566  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 59613.2us
I20260709 13:00:25.933353  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 3901) took 1305 ms. Trace:
I20260709 13:00:25.933765  9087 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:00:25.935079  9011 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:25.935150  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:25.935982  1685 raft_consensus.cc:2393] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 28: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:25.935763  9011 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:25.937693  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:25.937958  9011 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:25.873466  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.873942  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:25.939965  1684 raft_consensus.cc:2410] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:00:25.939846  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:25.940429  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 3903) took 1312 ms. Trace:
I20260709 13:00:25.940567  2269 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:25.940798  1684 rpcz_store.cc:276] 0709 13:00:24.644258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.873661 (+1229403us) service_pool.cc:224] Handling call
0709 13:00:25.940372 (+ 66711us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:25.940186  1581 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:25.941725  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:25.942111  1682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 4680) took 2351 ms (client timeout 1703 ms). Trace:
I20260709 13:00:25.942269  1684 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 26.
W20260709 13:00:25.942533  1682 rpcz_store.cc:269] 0709 13:00:23.590934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.613657 (+ 22723us) service_pool.cc:224] Handling call
0709 13:00:25.941924 (+2328267us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b5400260054. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:25.942045 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3286702848}
I20260709 13:00:25.943219  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:25.943555  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:25.943768  1684 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 13:00:25.944144  9044 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:25.939199  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:25.944633  9044 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:25.945065  9044 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:25.939141  1505 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:25.945883  8125 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:25.877043  9022 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:25.948911  9022 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:25.878813  9106 log.cc:927] Time spent T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.926s	user 0.002s	sys 0.000s
I20260709 13:00:25.943806  1581 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:25.948783  9020 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:25.950263  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 3804) took 2982 ms. Trace:
I20260709 13:00:25.949160  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 3914) took 1144 ms. Trace:
W20260709 13:00:25.880646  1688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 4698) took 1839 ms (client timeout 2159 ms). Trace:
I20260709 13:00:25.882061  1540 raft_consensus.cc:1240] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 22. Current term is 23. Ops: []
I20260709 13:00:25.950874  1689 rpcz_store.cc:276] 0709 13:00:24.804797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.157369 (+352572us) service_pool.cc:224] Handling call
0709 13:00:25.948938 (+791569us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b5400032d54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:25.949093 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1396494208}
I20260709 13:00:25.883853  9056 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:25.843066  8983 consensus_queue.cc:1059] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.042s
I20260709 13:00:25.950647  1615 rpcz_store.cc:276] 0709 13:00:22.967701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.606301 (+638600us) service_pool.cc:224] Handling call
0709 13:00:23.606602 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:23.621489 (+ 14887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:23.621519 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:23.629658 (+  8139us) log.cc:844] Serialized 26 byte log entry
0709 13:00:24.141093 (+511435us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:24.141133 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.141221 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:25.878114 (+1736893us) spinlock_profiling.cc:243] Waited 28.2 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 13:00:25.950008 (+ 71894us) raft_consensus.cc:1685] finished
0709 13:00:25.950027 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.950209 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11921,"raft.queue_time_us":12044,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":9406,"spinlock_wait_cycles":64889600,"thread_start_us":367586,"threads_started":1,"wal-append.queue_time_us":1226198}
W20260709 13:00:25.953711  1688 rpcz_store.cc:269] 0709 13:00:24.041294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.827037 (+785743us) service_pool.cc:224] Handling call
0709 13:00:25.880369 (+1053332us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b54002896d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:25.880574 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":951509248}
I20260709 13:00:25.952167  1682 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:25.954746  8983 consensus_queue.cc:1243] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 log is divergent from this leader: its last log entry 26.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 13:00:25.955255  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:25.956241  1582 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:25.887869  1683 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 22.
I20260709 13:00:25.888024  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:25.857625  9097 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:25.904161  8730 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:25.909955  8950 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:25.911130  9120 log.cc:927] Time spent T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.960s	user 0.002s	sys 0.000s
I20260709 13:00:25.958388  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:26.084506  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:25.911590  1690 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 4678) took 2321 ms (client timeout 2465 ms). Trace:
W20260709 13:00:26.006498  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 56397us
I20260709 13:00:25.866082  9037 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:25.915053  8705 raft_consensus.cc:3055] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:00:25.920589  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1176) took 1059 ms. Trace:
W20260709 13:00:25.897614  1612 rpcz_store.cc:269] 0709 13:00:23.782707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.896913 (+2114206us) service_pool.cc:211] Skipping call since client already timed out
0709 13:00:25.897071 (+   158us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:00:26.085744  2301 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 20.
I20260709 13:00:25.866124  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1107) took 2596 ms. Trace:
I20260709 13:00:25.950727  9061 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:00:26.085259  1690 rpcz_store.cc:269] 0709 13:00:23.590435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.590553 (+   118us) service_pool.cc:224] Handling call
0709 13:00:25.911399 (+2320846us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54003372d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:25.911533 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2931728128}
I20260709 13:00:26.085803  1535 rpcz_store.cc:276] 0709 13:00:24.860944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.861520 (+   576us) service_pool.cc:224] Handling call
0709 13:00:24.861803 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:25.008005 (+146202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.920248 (+912243us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54003d1dd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:25.920507 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":306710272}
I20260709 13:00:26.088289  1689 raft_consensus.cc:2393] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 18: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 13:00:26.088878  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 132710us
I20260709 13:00:26.077489  1682 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 23.
I20260709 13:00:26.073717  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:25.950464  1581 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:26.049168  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:25.920328  1534 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 18.
W20260709 13:00:26.079254  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.087848  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:26.091729  1690 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:26.091126  2299 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 13:00:26.092110  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:26.092595  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:26.092938  1682 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 13.
I20260709 13:00:26.093459  1690 raft_consensus.cc:2393] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 21: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 13:00:25.988979  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 210434us
W20260709 13:00:26.069953  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.093592  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 3917) took 1287 ms. Trace:
W20260709 13:00:25.957026  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 294041us
I20260709 13:00:26.094053  1682 rpcz_store.cc:276] 0709 13:00:24.805750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.091780 (+1286030us) service_pool.cc:224] Handling call
0709 13:00:26.093530 (+  1750us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:26.095175  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:26.096058  1682 raft_consensus.cc:2393] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 21: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:26.081111  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:26.081485  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:25.960886  1507 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:25.933681  1691 rpcz_store.cc:276] 0709 13:00:24.628025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:25.902061 (+1274036us) service_pool.cc:224] Handling call
0709 13:00:25.933294 (+ 31233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:26.082167  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:26.025966  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:26.031883  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:25.892825  9153 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:25.959275  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:26.086635  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 147604us
I20260709 13:00:25.956837  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:26.096729  1683 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 13:00:26.097622  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:26.098604  2303 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 13:00:26.090368  1656 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:26.098825  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 138052us
I20260709 13:00:26.087821  2269 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:26.086304  1686 rpcz_store.cc:276] 0709 13:00:23.269486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.326304 (+ 56818us) service_pool.cc:224] Handling call
0709 13:00:23.326632 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:23.452670 (+126038us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:23.452703 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:23.490766 (+ 38063us) log.cc:844] Serialized 26 byte log entry
0709 13:00:23.965378 (+474612us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:23.965419 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.865683 (+1900264us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b540022abd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:25.865737 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:25.865786 (+    49us) raft_consensus.cc:1685] finished
0709 13:00:25.865801 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.866045 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":280,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":18896,"spinlock_wait_cycles":288913792,"thread_start_us":403521,"threads_started":1,"wal-append.queue_time_us":650653,"wal-append.run_cpu_time_us":12165,"wal-append.run_wall_time_us":1675626}
I20260709 13:00:26.103219  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:26.144953  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:26.104331  1583 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:26.146167  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:26.147408  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 57100us
I20260709 13:00:26.103389  1684 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
W20260709 13:00:26.150327  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 45496us
W20260709 13:00:26.084970  9167 log.cc:927] Time spent T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:00:26.108156  1655 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:26.151249  1505 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:26.152778  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 65053.3us
I20260709 13:00:26.069521  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
W20260709 13:00:26.154917  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 46856.5us
I20260709 13:00:26.157917  8125 raft_consensus.cc:3055] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:00:26.158367  8830 consensus_queue.cc:1059] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:00:26.158371  8125 raft_consensus.cc:740] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:26.159919  8968 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:26.159667  8125 consensus_queue.cc:260] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:26.155606  1505 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:26.159613  8830 raft_consensus.cc:3055] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:26.160841  8887 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:26.161036  8830 raft_consensus.cc:740] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:26.161423  8887 raft_consensus.cc:697] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:26.161693  1505 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:26.161865  8830 consensus_queue.cc:260] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:26.162290  8887 consensus_queue.cc:237] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:26.163086  8830 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:26.163451  8769 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:26.072002  9020 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:26.164113  9088 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:00:26.170466  9088 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:26.170854  9088 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:00:26.170959  8125 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:00:26.171561  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:26.152314  8777 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 13:00:26.150342  9037 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:26.162925  8885 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:26.174432  9063 consensus_queue.cc:1059] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:26.160753  9040 raft_consensus.cc:2804] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:26.175282  9040 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:26.175662  9040 raft_consensus.cc:3060] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:26.175834  8885 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:26.059536  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:26.156055  9175 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:26.166512  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:26.088529  8705 raft_consensus.cc:740] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:26.088297  9061 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.184049  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:25.956624  8983 consensus_queue.cc:1059] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 22.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.211s
I20260709 13:00:26.184777  1691 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:26.184191  9061 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:00:26.104422  9164 log.cc:927] Time spent T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:00:26.163964  8769 raft_consensus.cc:697] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:26.164268  9022 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 13:00:26.176576  1690 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 21.
I20260709 13:00:26.177291  9044 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:26.178108  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:26.160326  8968 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:26.194446  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:26.195062  1687 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:26.179931  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:26.181057  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:26.166384  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:26.196095  1684 raft_consensus.cc:2393] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 28: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:26.195974  1688 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:00:26.198719  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.199927  1691 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 22.
I20260709 13:00:26.164589  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:26.202149  1690 raft_consensus.cc:1240] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:00:26.196432  8968 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:26.156503  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 3905) took 1449 ms. Trace:
I20260709 13:00:26.150158  8627 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.039s
I20260709 13:00:26.189208  9144 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:26.100819  8950 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:25.958832  9056 consensus_queue.cc:1059] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.194s
I20260709 13:00:26.220690  9056 raft_consensus.cc:3055] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:26.221136  9056 raft_consensus.cc:740] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:26.221987  9056 consensus_queue.cc:260] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:26.223313  9056 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:26.224572  8886 consensus_queue.cc:1175] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c262eac7fc904ae9bb91e450f6532e3f" responder_term: 10 status { last_received { term: 10 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 10 index: 10 } }
I20260709 13:00:26.101346  9087 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:26.106602  8744 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:26.105603  8730 consensus_queue.cc:1059] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.094s
I20260709 13:00:26.230166  8730 raft_consensus.cc:3055] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:26.230760  8730 raft_consensus.cc:740] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:26.153211  9097 consensus_queue.cc:1059] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:00:26.206228  9044 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:26.207988  8769 consensus_queue.cc:237] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:26.233439  9097 raft_consensus.cc:3055] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:26.233815  9097 raft_consensus.cc:740] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:26.234543  9097 consensus_queue.cc:260] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:26.210121  9166 log.cc:927] Time spent T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:00:26.235734  9097 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:26.210412  8705 consensus_queue.cc:260] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:26.213495  8627 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:26.199985  8871 consensus_queue.cc:1059] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
I20260709 13:00:26.236564  8627 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:26.237016  8627 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:26.237138  8871 raft_consensus.cc:3055] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:26.237540  8871 raft_consensus.cc:740] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:26.238354  8871 consensus_queue.cc:260] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:26.239596  8871 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:26.206748  9063 raft_consensus.cc:3055] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:26.231735  8730 consensus_queue.cc:260] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:26.240648  9063 raft_consensus.cc:740] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:26.241182  8730 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:26.241564  9063 consensus_queue.cc:260] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:26.242826  9063 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:26.203490  9153 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:26.245164  8705 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:26.219033  8968 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:26.291813  1435 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54590 (request call id 311) took 14702 ms (client timeout 15000 ms). Trace:
W20260709 13:00:26.293057  1435 rpcz_store.cc:269] 0709 13:00:11.589564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.597023 (+  7459us) service_pool.cc:224] Handling call
0709 13:00:26.291334 (+14694311us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:19.140717 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:19.153769 (+ 13052us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:19.153822 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:00:19.153842 (+    20us) tablet.cc:662] Decoding operations
0709 13:00:19.245852 (+ 92010us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:19.257115 (+ 11263us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:19.262647 (+  5532us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:00:19.288084 (+ 25437us) tablet.cc:701] Row locks acquired
0709 13:00:19.288141 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:00:19.288321 (+   180us) write_op.cc:270] Start()
0709 13:00:19.288511 (+   190us) write_op.cc:276] Timestamp: P: 1783602019288251 usec, L: 0
0709 13:00:19.288531 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:00:19.298451 (+  9920us) log.cc:844] Serialized 8306 byte log entry
0709 13:00:19.585935 (+287484us) op_driver.cc:464] REPLICATION: finished
0709 13:00:20.150243 (+564308us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc859f470ac 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc860a87ef0
0709 13:00:21.062547 (+912304us) write_op.cc:301] APPLY: starting
0709 13:00:21.062636 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:22.653726 (+1591090us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:22.653753 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:23.410178 (+756425us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:23.410500 (+   322us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=0,mrs_lookups=0
0709 13:00:23.410545 (+    45us) write_op.cc:312] APPLY: finished
0709 13:00:23.410952 (+   407us) log.cc:844] Serialized 188 byte log entry
0709 13:00:23.625802 (+214850us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:23.683096 (+ 57294us) write_op.cc:454] Released schema lock
0709 13:00:23.752049 (+ 68953us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:23.803252 (+ 51203us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:23.812704 (+  9452us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7468,"reported_tablets":29,"spinlock_wait_cycles":43776,"child_traces":[["op",{"apply.queue_time_us":1476348,"apply.run_cpu_time_us":42081,"apply.run_wall_time_us":2717746,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91949,"num_ops":21,"prepare.queue_time_us":92084,"prepare.run_cpu_time_us":48773,"prepare.run_wall_time_us":338051,"raft.queue_time_us":11020,"raft.run_cpu_time_us":125090,"raft.run_wall_time_us":1378171,"replication_time_us":297249,"spinlock_wait_cycles":3485568,"thread_start_us":1746639,"threads_started":5,"wal-append.queue_time_us":605055,"wal-append.run_cpu_time_us":6948,"wal-append.run_wall_time_us":2331268}]]}
W20260709 13:00:26.305886  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 140956us
W20260709 13:00:26.310156  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:26.310823  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.314064  1507 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:26.167936  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 217540us
W20260709 13:00:26.317440  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 215186us
W20260709 13:00:26.318849  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 214438us
I20260709 13:00:26.321504  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1172) took 2142 ms. Trace:
I20260709 13:00:26.324024  1581 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:26.314386  1537 raft_consensus.cc:1240] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:26.322985  1582 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:26.319540  1508 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:26.341718  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.322166  1533 rpcz_store.cc:276] 0709 13:00:24.178988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:24.179480 (+   492us) service_pool.cc:224] Handling call
0709 13:00:24.225925 (+ 46445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:24.226319 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:24.226352 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:24.344326 (+117974us) log.cc:844] Serialized 26 byte log entry
0709 13:00:24.901694 (+557368us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:24.901764 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:24.901838 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:25.886010 (+984172us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 13:00:26.320467 (+434457us) raft_consensus.cc:1685] finished
0709 13:00:26.320576 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:26.321152 (+   576us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6944,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":32248,"spinlock_wait_cycles":3929856,"thread_start_us":376807,"threads_started":1,"wal-append.queue_time_us":463292}
W20260709 13:00:26.335129  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 168919us
I20260709 13:00:26.346865  1507 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:26.349471  1654 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:26.155979  1656 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:26.340001  1508 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:26.354676  1682 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 23. Current term is 24. Ops: []
I20260709 13:00:26.352330  1507 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:26.354861  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 198825us
W20260709 13:00:26.384526  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 61009.7us
I20260709 13:00:26.393388  8968 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:26.353556  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 161389us
I20260709 13:00:26.352344  1654 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:26.354991  1686 rpcz_store.cc:276] 0709 13:00:24.707244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.145905 (+1438661us) service_pool.cc:224] Handling call
0709 13:00:26.156379 (+ 10474us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:26.396953  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3891) took 1759 ms. Trace:
W20260709 13:00:26.398068  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 75295.5us
I20260709 13:00:26.402644  1682 rpcz_store.cc:276] 0709 13:00:24.625599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.353016 (+1727417us) service_pool.cc:224] Handling call
0709 13:00:26.354000 (+   984us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:26.375823 (+ 21823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.384926 (+  9103us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:26.406816  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 84266.2us
I20260709 13:00:26.409392  9077 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:00:26.410127  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3899) took 1576 ms. Trace:
I20260709 13:00:26.413111  9022 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:00:26.433825  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:26.441752  2267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:26.442262  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.444008  1655 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:26.444440  9181 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:26.445098  9181 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:26.445585  9182 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:00:26.446071  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 106488us
I20260709 13:00:26.447573  1508 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:26.447762  8777 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:26.445750  9181 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:26.453802  8950 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:26.454932  8627 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:26.456707  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 104652us
I20260709 13:00:26.457561  8887 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:00:26.458631  8627 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:26.459192  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 107105us
I20260709 13:00:26.459674  1654 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:26.461000  8862 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:26.461643  1507 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:26.463812  1507 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:26.440382  1583 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:26.435894  1690 rpcz_store.cc:276] 0709 13:00:24.627558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.201622 (+1574064us) service_pool.cc:224] Handling call
0709 13:00:26.201943 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:26.204262 (+  2319us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.204418 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:26.469957  8864 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:00:26.471520  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:26.472783  1686 raft_consensus.cc:2368] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 20. Current term is 21.
I20260709 13:00:26.473924  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:26.474823  9020 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:00:26.420317  9061 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:26.477067  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:26.477473  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:26.477859  1685 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:26.478291  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:26.478999  1682 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:26.479048  9061 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:26.456923  8769 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:26.461656  8862 raft_consensus.cc:697] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:26.486184  1581 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:26.490187  9176 consensus_queue.cc:1059] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:00:26.491428  8627 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:00:26.494915  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.492381  8627 raft_consensus.cc:3055] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:00:26.447616  8830 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:26.486245  8862 consensus_queue.cc:237] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:26.525578  8995 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:26.509917  8830 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:26.526878  8830 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:00:26.529294  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.501600  8627 raft_consensus.cc:740] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 24 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:26.531015  8627 consensus_queue.cc:260] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:26.535526  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.525672  1436 catalog_manager.cc:5697] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 19 to 20, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 20 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:26.537385  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 90127.1us
I20260709 13:00:26.508822  8864 raft_consensus.cc:697] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 28 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:26.486387  9087 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
W20260709 13:00:26.545284  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 56864.7us
I20260709 13:00:26.547916  1581 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:26.539503  1508 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:26.503243  9182 raft_consensus.cc:697] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:26.537902  9040 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:26.559870  9040 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:26.561854  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.554171  9182 consensus_queue.cc:237] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 13.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:26.539450  8864 consensus_queue.cc:237] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:26.504413  1582 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:26.568830  8627 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:26.572700  1656 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:26.581403  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:26.582271  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 69496.6us
I20260709 13:00:26.582683  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:26.583362  1686 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:26.583685  1656 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:26.557011  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 113400us
I20260709 13:00:26.586269  8993 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:26.586840  1655 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:26.580322  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.587611  9037 consensus_queue.cc:1059] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:26.588719  9165 consensus_queue.cc:1059] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:26.589931  8793 raft_consensus.cc:3055] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:26.590312  8793 raft_consensus.cc:740] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:26.538833  1436 catalog_manager.cc:5697] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 13 to 16, leader changed from 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 16 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:26.595028  1682 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 13:00:26.595909  9169 raft_consensus.cc:3055] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:00:26.606295  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.608045  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:26.608144  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 144543us
I20260709 13:00:26.608352  9020 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:26.608801  9020 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:26.609226  9020 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:26.611083  1656 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:26.610957  9087 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:26.568698  8777 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.044s
I20260709 13:00:26.607887  9176 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:26.596761  1690 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 13:00:26.612824  1507 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:26.613104  1655 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:26.589354  9037 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:00:26.614706  1685 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 13:00:26.606101  9169 raft_consensus.cc:740] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 13:00:26.619418  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 71771.7us
I20260709 13:00:26.619735  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:26.622756  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:26.624387  1685 raft_consensus.cc:2393] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 8: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:26.614055  9176 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.638032  1656 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:26.640230  9169 consensus_queue.cc:260] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:26.641412  8950 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:26.641659  1436 catalog_manager.cc:5697] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 14 to 16, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 16 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:26.619102  9175 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:26.634706  9176 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:26.652693  1654 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:26.651429  9037 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:26.641718  9169 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:00:26.664455  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 224329us
I20260709 13:00:26.596146  8793 consensus_queue.cc:260] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:26.672432  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:26.641433  8830 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:26.675429  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 267694us
W20260709 13:00:26.677603  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 138663us
I20260709 13:00:26.677734  1685 raft_consensus.cc:1240] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:00:26.681957  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3915) took 1873 ms. Trace:
I20260709 13:00:26.643951  1436 catalog_manager.cc:5697] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:26.682485  1685 rpcz_store.cc:276] 0709 13:00:24.805221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.653659 (+1848438us) service_pool.cc:224] Handling call
0709 13:00:26.668732 (+ 15073us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:26.678533 (+  9801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.678790 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:26.682740  1688 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 17.
I20260709 13:00:26.689402  1508 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:26.692353  1582 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:26.690449  1583 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:26.698678  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:26.700791  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 88094.1us
I20260709 13:00:26.684159  9037 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:26.682896  8777 consensus_queue.cc:1059] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 13:00:26.717226  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3893) took 2024 ms. Trace:
I20260709 13:00:26.722957  1537 raft_consensus.cc:2393] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 19: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:26.727434  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:26.708676  8886 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:26.722067  8950 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:00:26.718694  1689 rpcz_store.cc:276] 0709 13:00:24.626081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.201467 (+1575386us) service_pool.cc:224] Handling call
0709 13:00:26.355860 (+154393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:26.356903 (+  1043us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:26.356930 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:26.357967 (+  1037us) log.cc:844] Serialized 26 byte log entry
0709 13:00:26.436567 (+ 78600us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:26.436605 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.449428 (+ 12823us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:26.650598 (+201170us) raft_consensus.cc:1685] finished
0709 13:00:26.650627 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:26.650811 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91089,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":238,"thread_start_us":78032,"threads_started":1,"wal-append.queue_time_us":264845}
I20260709 13:00:26.732833  1436 catalog_manager.cc:5697] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:26.737519  1582 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:26.740898  1687 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 25.
I20260709 13:00:26.724783  9180 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:26.740703  8950 raft_consensus.cc:697] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 24 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:26.748441  1688 raft_consensus.cc:1240] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:26.750299  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 67896.2us
I20260709 13:00:26.747313  9063 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:26.749387  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:26.708709  8963 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:00:26.752959  9183 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:26.753310  9069 raft_consensus.cc:2764] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:00:26.753858  1436 catalog_manager.cc:5697] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 18 to 19, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 19 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:26.755548  1689 raft_consensus.cc:1240] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:26.756546  8950 consensus_queue.cc:237] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:26.764797  8871 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:26.765290  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:26.765851  1685 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:26.766194  9174 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:00:26.771306  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 158348us
W20260709 13:00:26.771682  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:26.773363  9097 consensus_meta.cc:287] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.537s	user 0.013s	sys 0.006s
W20260709 13:00:26.775902  9088 consensus_meta.cc:287] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.604s	user 0.011s	sys 0.005s
I20260709 13:00:26.748952  8862 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:26.743151  8793 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:26.779431  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1110) took 1320 ms. Trace:
W20260709 13:00:26.778604  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 89290.5us
I20260709 13:00:26.789856  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33206 (request call id 1120) took 1144 ms. Trace:
I20260709 13:00:26.746510  9180 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.790258  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1111) took 1357 ms. Trace:
I20260709 13:00:26.790966  1537 raft_consensus.cc:2393] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 20: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 13:00:26.791071  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 140178us
W20260709 13:00:26.753126  9056 consensus_meta.cc:287] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.519s	user 0.005s	sys 0.009s
I20260709 13:00:26.746762  9181 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:26.797228  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3919) took 1987 ms. Trace:
I20260709 13:00:26.802405  1685 rpcz_store.cc:276] 0709 13:00:24.806329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.691820 (+1885491us) service_pool.cc:224] Handling call
0709 13:00:26.729478 (+ 37658us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:26.793780 (+ 64302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.793966 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:26.780328  9183 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:26.799120  1688 rpcz_store.cc:276] 0709 13:00:25.431573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.727208 (+1295635us) service_pool.cc:224] Handling call
0709 13:00:26.748284 (+ 21076us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:26.748885 (+   601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.751468 (+  2583us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:26.799358  1687 rpcz_store.cc:276] 0709 13:00:25.645453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.194193 (+548740us) service_pool.cc:224] Handling call
0709 13:00:26.779075 (+584882us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:26.800679  1689 rpcz_store.cc:276] 0709 13:00:25.433210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.741092 (+1307882us) service_pool.cc:224] Handling call
0709 13:00:26.755327 (+ 14235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:26.781544 (+ 26217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.790193 (+  8649us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:26.789400  8995 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:26.794950  1582 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:26.802033  1583 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:26.799742  1682 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
W20260709 13:00:26.802073  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 182512us
I20260709 13:00:26.810988  1684 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 24. Current term is 25. Ops: [22.18-24.19]
I20260709 13:00:26.794879  9174 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:26.799661  8862 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:26.817984  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3894) took 2191 ms. Trace:
I20260709 13:00:26.818449  1683 rpcz_store.cc:276] 0709 13:00:24.626305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.356710 (+1730405us) service_pool.cc:224] Handling call
0709 13:00:26.357337 (+   627us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:26.358084 (+   747us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:26.358119 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:26.434687 (+ 76568us) log.cc:844] Serialized 26 byte log entry
0709 13:00:26.604512 (+169825us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:26.725710 (+121198us) log.cc:844] Serialized 14 byte log entry
0709 13:00:26.725899 (+   189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.725967 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:26.817606 (+ 91639us) raft_consensus.cc:1685] finished
0709 13:00:26.817630 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:26.817790 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":193492,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":90750,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":3424,"thread_start_us":216844,"threads_started":2,"wal-append.queue_time_us":239507}
W20260709 13:00:26.820155  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.821004  1683 raft_consensus.cc:1240] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:00:26.821717  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1117) took 1372 ms. Trace:
I20260709 13:00:26.822026  1683 rpcz_store.cc:276] 0709 13:00:25.449336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.820294 (+1370958us) service_pool.cc:224] Handling call
0709 13:00:26.820763 (+   469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:26.821424 (+   661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.821640 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:26.801896  9180 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:26.830045  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 48957.2us
I20260709 13:00:26.831058  1655 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:26.811254  9183 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:26.838336  1685 raft_consensus.cc:1240] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:26.839156  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1112) took 1405 ms. Trace:
I20260709 13:00:26.839489  1685 rpcz_store.cc:276] 0709 13:00:25.433493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.813981 (+1380488us) service_pool.cc:224] Handling call
0709 13:00:26.838035 (+ 24054us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:26.838875 (+   840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.839094 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:26.826112  9174 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:26.822072  9181 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:26.826961  8862 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:26.827890  9182 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:26.840507  1436 catalog_manager.cc:5697] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:26.850639  1686 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 13:00:26.852277  8963 raft_consensus.cc:1064] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 13:00:26.852613  8993 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:26.853915  1683 raft_consensus.cc:1240] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:00:26.855386  8627 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:26.855196  8963 consensus_queue.cc:237] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 17, Current term: 26, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:26.855850  8627 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:26.856360  8627 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:26.857378  1508 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:26.858888  8887 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:26.859704  1508 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:26.860652  8887 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:26.803229  9088 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:26.876892  1688 raft_consensus.cc:1240] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:26.877967  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1116) took 1436 ms. Trace:
I20260709 13:00:26.878376  1688 rpcz_store.cc:276] 0709 13:00:25.441746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.815224 (+1373478us) service_pool.cc:224] Handling call
0709 13:00:26.876749 (+ 61525us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:26.877308 (+   559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.877903 (+   595us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:26.884568  1656 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:26.879851  1436 catalog_manager.cc:5697] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 13:00:26.893203  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 93866.4us
I20260709 13:00:26.894176  1583 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:26.876978  8627 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:26.896638  9097 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:26.898067  9088 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 29 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:26.899163  2267 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:26.899367  9144 consensus_queue.cc:1059] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:00:26.900269  8705 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:26.900826  8705 raft_consensus.cc:697] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:26.902088  8705 consensus_queue.cc:237] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:26.896819  9181 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:26.905311  9181 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:26.905853  9181 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:26.896878  8627 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:26.906908  2294 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 14. (term mismatch)
I20260709 13:00:26.907294  2294 pending_rounds.cc:85] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579: Aborting all ops after (but not including) 13
I20260709 13:00:26.907545  2294 pending_rounds.cc:107] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579: Aborting uncommitted NO_OP operation due to leader change: 21.14
I20260709 13:00:26.907830  2294 raft_consensus.cc:2889] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:26.905869  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:26.905378  2297 raft_consensus.cc:1240] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 22. Current term is 23. Ops: []
I20260709 13:00:26.896427  1583 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:26.911332  9195 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:00:26.912002  9187 log.cc:927] Time spent T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:00:26.913664  1688 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:00:26.922466  1436 catalog_manager.cc:5697] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 17 to 19, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 19 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
W20260709 13:00:26.924573  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 110102us
I20260709 13:00:26.920887  8830 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:26.933826  1686 raft_consensus.cc:1240] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 20. Current term is 21. Ops: []
W20260709 13:00:26.936385  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:26.937180  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 77578.4us
I20260709 13:00:26.932848  1654 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:26.900766  9144 raft_consensus.cc:3055] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:26.947409  1583 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:26.940996  1436 catalog_manager.cc:5697] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:26.951733  1687 raft_consensus.cc:1240] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:00:26.955305  8627 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:26.955912  8627 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:26.956364  8627 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:00:26.959076  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.959092  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:26.959697  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:26.960445  1616 raft_consensus.cc:2393] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 21: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:26.961541  1615 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 16. (term mismatch)
I20260709 13:00:26.962001  1615 pending_rounds.cc:85] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f: Aborting all ops after (but not including) 15
I20260709 13:00:26.962316  1615 pending_rounds.cc:107] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260709 13:00:26.962569  1615 raft_consensus.cc:2889] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:26.961553  1612 raft_consensus.cc:1275] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:00:26.965098  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:26.965694  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.965979  1614 raft_consensus.cc:2393] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 22: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:26.969298  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:26.970491  1505 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:26.970896  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:26.971602  1533 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:26.972432  9087 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:26.974532  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:26.975471  1535 raft_consensus.cc:2393] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 21: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:26.976684  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3900) took 2307 ms. Trace:
I20260709 13:00:26.977136  1691 rpcz_store.cc:276] 0709 13:00:24.627799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.200654 (+1572855us) service_pool.cc:224] Handling call
0709 13:00:26.201001 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:26.432197 (+231196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:26.432276 (+    79us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:26.433416 (+  1140us) log.cc:844] Serialized 26 byte log entry
0709 13:00:26.683826 (+250410us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:26.683860 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.693547 (+  9687us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:26.921292 (+227745us) raft_consensus.cc:1685] finished
0709 13:00:26.921309 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:26.935544 (+ 14235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":194467,"raft.queue_time_us":247166,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":20408,"thread_start_us":249736,"threads_started":1,"wal-append.queue_time_us":361104}
I20260709 13:00:26.971727  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4702) took 2872 ms. Trace:
I20260709 13:00:26.952617  8950 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 13:00:26.987519  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.968595  1534 raft_consensus.cc:1240] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:00:26.954814  1436 catalog_manager.cc:5697] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 17 to 20. New cstate: current_term: 20 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:26.989677  8950 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:26.992306  8950 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:26.985729  1684 rpcz_store.cc:276] 0709 13:00:24.099262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.355133 (+2255871us) service_pool.cc:224] Handling call
0709 13:00:26.747661 (+392528us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:26.825895 (+ 78234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.970409 (+144514us) spinlock_profiling.cc:243] Waited 53.6 ms on lock 0x7b540022a1d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:26.971485 (+  1076us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b540022a1d0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:26.971658 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1015867392}
I20260709 13:00:26.942858  9144 raft_consensus.cc:740] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:27.007570  1655 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
W20260709 13:00:27.009161  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:27.009331  2267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.006716  9195 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:27.010347  9195 raft_consensus.cc:697] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:27.011474  9195 consensus_queue.cc:237] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:26.912113  9194 consensus_queue.cc:1048] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.155s
I20260709 13:00:27.021994  9176 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:27.023607  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:27.024569  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:27.025336  9144 consensus_queue.cc:260] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:26.959277  9146 consensus_queue.cc:1059] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.086s
I20260709 13:00:27.029631  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:27.029853  8744 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.030336  8769 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.030840  9077 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 13:00:27.030779  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 50213.4us
W20260709 13:00:27.031497  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 87587.5us
I20260709 13:00:27.032759  1541 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 28. Current term is 29. Ops: []
I20260709 13:00:27.032994  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:27.033639  2295 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 24. Current term is 25. Ops: [22.18-24.19]
I20260709 13:00:27.033529  9088 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:27.035372  9020 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:27.037086  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:27.040904  1617 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:00:27.062692  9182 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:27.053081  9022 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.064400  2294 raft_consensus.cc:1240] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:00:27.065308  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:27.067739  1542 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:00:27.054328  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 179720us
I20260709 13:00:27.070528  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:27.055105  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:27.068647  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1118) took 1439 ms. Trace:
I20260709 13:00:27.108062  1683 rpcz_store.cc:276] 0709 13:00:25.629461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.822806 (+1193345us) service_pool.cc:224] Handling call
0709 13:00:26.851239 (+ 28433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:26.854389 (+  3150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.067819 (+213430us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b540041bc54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:27.068372 (+   553us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b540041bc50. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:27.068567 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69914240}
I20260709 13:00:27.059888  1612 raft_consensus.cc:1240] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:00:27.061391  8871 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:27.068637  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 13:00:27.074664  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.078219  1533 raft_consensus.cc:2410] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 24 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
W20260709 13:00:27.077171  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 184635us
I20260709 13:00:27.076385  9175 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:27.009861  8730 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:27.099352  1610 raft_consensus.cc:2393] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 18: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 13:00:27.103987  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.085428  8627 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:27.054191  9180 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:27.121268  1613 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:00:27.127913  1534 raft_consensus.cc:2393] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 15: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:27.107223  8705 raft_consensus.cc:3055] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:27.127884  1540 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 22.
I20260709 13:00:27.135982  1583 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:27.110532  8871 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:27.137741  1615 raft_consensus.cc:1240] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:27.142668  1609 raft_consensus.cc:2393] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 14: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:27.143064  1616 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 22. Current term is 23. Ops: []
W20260709 13:00:27.143088  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.135531  8705 raft_consensus.cc:740] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:27.099736  8744 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:27.111817  9088 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:27.137562  9144 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:27.139978  8871 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:27.125984  8769 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:27.161334  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 49722.7us
I20260709 13:00:27.160759  2298 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [term 26 LEARNER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:00:27.162940  1583 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:27.149163  9182 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:27.171955  1533 raft_consensus.cc:1240] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:27.168972  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:27.184978  8627 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:27.172207  8705 consensus_queue.cc:260] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:27.197531  8705 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:27.198844  9087 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:27.200704  1537 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:27.192775  9182 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:27.203344  9182 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:27.203883  1538 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 21.
I20260709 13:00:27.179867  9183 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:27.206131  9183 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:27.209544  9069 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:00:27.211418  9069 consensus_queue.cc:1048] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:00:27.172845  8769 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:27.137764  8963 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:00:27.176760  8862 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:27.145350  8887 consensus_queue.cc:1059] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:00:27.181897  9088 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:27.183663  8744 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:27.185099  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 44907.4us
I20260709 13:00:27.185784  9180 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:27.169523  9181 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:27.126292  9077 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:27.225220  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 62139.4us
I20260709 13:00:27.134675  9022 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:27.179914  9174 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:27.240242  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 77426us
I20260709 13:00:27.241176  1583 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:27.242934  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:27.244403  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:27.244658  1508 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:27.245620  1612 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:27.247303  1612 raft_consensus.cc:1275] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:00:27.249503  1539 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 23. Current term is 24. Ops: []
I20260709 13:00:27.248973  1612 raft_consensus.cc:1275] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:00:27.251300  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:27.252614  1583 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:27.253800  9174 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:27.254112  1583 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:27.254776  9088 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:27.255026  9061 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:27.255232  8993 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:00:27.255746  9061 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:27.250272  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:27.254479  9175 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:27.256166  9061 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:27.256742  9175 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:27.256604  1536 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:27.254931  9146 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.257268  9175 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:27.257738  9146 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:27.259840  9146 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:27.260931  2301 raft_consensus.cc:1275] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:00:27.224381  9056 consensus_queue.cc:1059] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:00:27.249807  1505 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:27.228557  1613 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 29.
I20260709 13:00:27.267794  1535 raft_consensus.cc:1240] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:27.255059  1656 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:27.228112  8730 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:27.272513  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1119) took 1640 ms. Trace:
I20260709 13:00:27.273084  8887 consensus_queue.cc:1048] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:00:27.280297  9169 consensus_queue.cc:1059] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:00:27.281736  1505 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:27.281756  8885 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 13:00:27.283301  9077 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:27.270064  9174 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:00:27.292374  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:27.293838  1536 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 21.
I20260709 13:00:27.238778  9063 consensus_queue.cc:1048] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:00:27.294808  1655 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:27.295043  1608 raft_consensus.cc:1240] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:27.295583  8714 raft_consensus.cc:3055] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:27.295794  8830 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:27.296360  8830 raft_consensus.cc:697] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 21 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:27.297662  1508 leader_election.cc:400] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 20. Current term is 21.
I20260709 13:00:27.298004  1508 leader_election.cc:403] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:00:27.297516  8830 consensus_queue.cc:237] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:27.298195  9087 consensus_queue.cc:1059] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:00:27.299049  9087 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 20. Current term is 21.
I20260709 13:00:27.300876  8714 raft_consensus.cc:740] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:27.301855  8714 consensus_queue.cc:260] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:27.302863  8714 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:27.294907  9077 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:00:27.300554  9097 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:27.274610  9069 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:27.291750  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 139420us
W20260709 13:00:27.343174  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.286080  9040 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:00:27.345587  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 54859.5us
I20260709 13:00:27.304896  9077 raft_consensus.cc:697] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:27.348815  1539 raft_consensus.cc:1240] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:27.351780  1583 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:27.346318  9040 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.348037  9088 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:27.357906  1656 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:27.361506  1611 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:00:27.362898  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:27.363299  9176 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:27.363389  9022 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:27.364667  8744 raft_consensus.cc:3055] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:00:27.369525  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:27.370266  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:27.376837  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:27.371474  9061 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:27.375146  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:27.383601  1609 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 21.
I20260709 13:00:27.386005  1614 raft_consensus.cc:2393] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 21: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:27.352666  8730 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:27.374050  9040 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:00:27.382941  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.377413  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:27.380760  8627 raft_consensus.cc:2764] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:00:27.386626  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:27.380887  9165 raft_consensus.cc:3055] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 23 LEADER]: Stepping down as leader of term 23
W20260709 13:00:27.373790  9212 log.cc:927] Time spent T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.134s	user 0.000s	sys 0.003s
I20260709 13:00:27.382506  9181 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:27.401366  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:27.414511  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:27.402861  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:27.403553  9175 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:27.404126  9214 log.cc:927] Time spent T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:00:27.404723  8862 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:27.404922  8730 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:27.407157  9121 consensus_queue.cc:1059] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 28.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:00:27.407387  9077 consensus_queue.cc:237] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:27.437943  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:27.407862  9144 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:00:27.388898  9182 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:27.410933  8963 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:00:27.411870  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:27.396410  9165 raft_consensus.cc:740] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:27.401098  9097 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:27.413256  8627 consensus_queue.cc:1059] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:00:27.413522  9180 consensus_queue.cc:1059] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:00:27.408620  9146 consensus_queue.cc:1059] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:00:27.407204  2267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.383668  8744 raft_consensus.cc:740] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 13:00:27.418097  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 74061.1us
I20260709 13:00:27.425453  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:27.434814  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:27.466249  1609 raft_consensus.cc:2393] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 18: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:27.463850  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:27.464152  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:27.421926  9183 consensus_queue.cc:1048] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 13:00:27.441691  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:27.448829  1539 raft_consensus.cc:2393] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 21: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:27.407891  9061 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:27.451166  1684 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:00:27.438689  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:27.454124  1686 raft_consensus.cc:1275] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:00:27.383711  9069 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:27.386087  9063 consensus_queue.cc:1059] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
W20260709 13:00:27.454705  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.455128  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:27.474967  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:27.475451  1537 raft_consensus.cc:2393] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 14: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:27.475713  2302 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:27.476518  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:27.477059  9165 consensus_queue.cc:260] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:27.478273  9165 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:27.480417  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:27.480855  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:27.481544  9063 raft_consensus.cc:3055] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:27.481954  9063 raft_consensus.cc:740] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:27.482069  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:27.483238  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:27.482921  9063 consensus_queue.cc:260] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:27.483970  1540 raft_consensus.cc:1240] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:27.457751  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:27.455549  8871 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:27.484833  1691 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 24.
I20260709 13:00:27.485184  1540 raft_consensus.cc:1240] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:27.486164  1691 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:00:27.486477  8871 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:27.460870  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:27.469646  2266 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:27.487797  9020 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:27.473811  1581 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:27.486491  1540 raft_consensus.cc:1275] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:00:27.489405  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:27.490545  8993 consensus_queue.cc:1048] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:27.491788  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:27.492121  8993 consensus_queue.cc:1048] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:00:27.495175  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 108615us
I20260709 13:00:27.457434  9097 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:27.500850  9097 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:27.501410  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:27.502588  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:27.503286  1613 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 21: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:27.504772  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:27.505323  1581 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:27.505627  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:27.503990  1613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 13:00:27.507405  1613 raft_consensus.cc:606] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:27.507773  1613 raft_consensus.cc:614] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:27.494939  9194 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.509061  9061 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:27.482236  1612 raft_consensus.cc:1240] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:27.484282  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:27.477706  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:27.435609  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:27.510872  1609 raft_consensus.cc:1240] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:27.509104  1613 raft_consensus.cc:1240] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:27.494071  1541 raft_consensus.cc:2393] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 21: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:27.494336  1683 raft_consensus.cc:1240] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:27.468330  1617 raft_consensus.cc:2368] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for earlier term 17. Current term is 18.
I20260709 13:00:27.495429  1508 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:27.495662  1614 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 25.
I20260709 13:00:27.496070  1534 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 22.
I20260709 13:00:27.514020  1614 raft_consensus.cc:1240] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 21. Current term is 22. Ops: [19.13-21.14]
W20260709 13:00:27.516142  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.484233  9063 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:27.490585  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:27.471803  9195 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.051s
I20260709 13:00:27.461498  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:27.521389  1610 raft_consensus.cc:2410] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:00:27.521677  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:27.496815  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:27.274281  1685 rpcz_store.cc:276] 0709 13:00:25.632259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.840293 (+1208034us) service_pool.cc:224] Handling call
0709 13:00:26.891142 (+ 50849us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:26.935884 (+ 44742us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:00:26.947122 (+ 11238us) log.cc:844] Serialized 14 byte log entry
0709 13:00:27.272025 (+324903us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:27.272221 (+   196us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:27.272265 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.272321 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:27.272429 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13599,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":45,"raft.queue_time_us":6546,"thread_start_us":191603,"threads_started":1}
I20260709 13:00:27.522574  1616 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 20.
I20260709 13:00:27.528084  1687 raft_consensus.cc:1240] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 28 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 27. Current term is 28. Ops: []
I20260709 13:00:27.480858  9153 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.526991  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:27.534677  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:27.547886  2299 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 22.
I20260709 13:00:27.548672  8885 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.549631  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:27.565436  2301 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:27.534224  9180 consensus_queue.cc:1243] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer 1d6516ff61104bdda54bde95e92fe579 log is divergent from this leader: its last log entry 18.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:00:27.529479  8627 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:00:27.568898  1616 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:00:27.575353  9061 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:27.576007  2298 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 13:00:27.569540  9040 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:27.577740  1609 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 13:00:27.578361  9088 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:27.578791  9088 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:27.579094  1609 raft_consensus.cc:1240] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:00:27.579499  9040 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:27.580544  2303 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:00:27.576932  1542 raft_consensus.cc:2410] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
W20260709 13:00:27.581668  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 46484.8us
I20260709 13:00:27.509013  9194 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:27.586442  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 81204.8us
I20260709 13:00:27.584369  2302 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 13:00:27.588990  1582 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:27.549290  8885 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:27.591934  1613 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 28. Current term is 29. Ops: []
I20260709 13:00:27.594017  8885 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:27.596989  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.567866  9022 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:00:27.608035  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.608140  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3904) took 2925 ms. Trace:
W20260709 13:00:27.621986  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:27.636683  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:27.665138  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 73760.1us
W20260709 13:00:27.670217  9219 log.cc:927] Time spent T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:00:27.671501  8730 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:27.671938  9220 log.cc:927] Time spent T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:00:27.673904  9069 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:27.674749  2266 leader_election.cc:336] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 1.739s (SENT)
I20260709 13:00:27.675192  2266 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:27.657640  1690 rpcz_store.cc:276] 0709 13:00:24.682771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.636521 (+1953750us) service_pool.cc:224] Handling call
0709 13:00:26.664091 (+ 27570us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:26.700075 (+ 35984us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:00:26.909953 (+209878us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b180029f4a0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f61455 00007fc860a493c7 00007fc85d05b9a7 00007fc85d06b0bf 00007fc85d06b038
0709 13:00:27.120049 (+210096us) log.cc:844] Serialized 14 byte log entry
0709 13:00:27.227813 (+107764us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:27.239747 (+ 11934us) log.cc:844] Serialized 26 byte log entry
0709 13:00:27.241093 (+  1346us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:27.241134 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.241217 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:27.373203 (+131986us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 13:00:27.607884 (+234681us) raft_consensus.cc:1685] finished
0709 13:00:27.607909 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:27.608063 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10415,"prepare.queue_time_us":98266,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":32,"raft.queue_time_us":30692,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":14601,"spinlock_wait_cycles":62601216,"thread_start_us":271552,"threads_started":2,"wal-append.queue_time_us":100422}
I20260709 13:00:27.677405  1583 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:27.691601  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:27.727681  2301 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
W20260709 13:00:27.741181  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 75106us
I20260709 13:00:27.602159  9213 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:27.685894  9061 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:27.757030  1610 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 13:00:27.760632  1581 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:27.762116  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 266771us
I20260709 13:00:27.581197  9153 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:27.581422  8744 consensus_queue.cc:260] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:27.778620  1508 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:27.761817  9175 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:27.777530  8993 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:27.784889  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 110197us
I20260709 13:00:27.772257  9180 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:27.772178  9061 raft_consensus.cc:697] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:27.795787  9227 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:00:27.791220  8993 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:27.795496  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 268144us
I20260709 13:00:27.803754  8993 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:27.797086  8830 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.804827  8830 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:27.807243  8830 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:27.807847  9226 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:27.808907  9226 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:27.809566  9226 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:27.810921  9097 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:27.812222  1684 raft_consensus.cc:2368] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for earlier term 17. Current term is 18.
W20260709 13:00:27.812759  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 135428us
I20260709 13:00:27.800741  9061 consensus_queue.cc:237] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:27.815299  9194 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:27.818019  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 57518.7us
I20260709 13:00:27.818881  1581 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:27.796618  9223 log.cc:927] Time spent T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:00:27.829272  9213 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:27.829923  9213 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:27.832278  9213 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:27.838634  9153 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:27.813710  1583 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:27.842994  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 68387.4us
I20260709 13:00:27.843999  1508 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:27.844882  9011 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:27.845654  9011 raft_consensus.cc:697] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:27.846701  9011 consensus_queue.cc:237] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:27.856914  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:27.857583  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.895622  9194 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:27.915704  9022 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:27.916431  9022 raft_consensus.cc:697] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:27.923797  9022 consensus_queue.cc:237] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:27.926056  9226 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:27.930593  1685 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:00:27.930888  9180 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:27.938226  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 124593us
I20260709 13:00:27.939200  1583 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:27.939437  1690 raft_consensus.cc:1240] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:27.940124  8627 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:00:27.941977  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 98037.6us
I20260709 13:00:27.844446  9097 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:27.896324  9194 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:27.897233  8993 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:27.949002  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:27.949833  1689 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 23.
I20260709 13:00:27.950103  1583 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:27.953720  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 134927us
I20260709 13:00:27.954615  1581 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
W20260709 13:00:27.956885  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 367994us
I20260709 13:00:27.963224  1508 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:27.951646  9088 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:27.969985  9227 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:27.973675  8963 raft_consensus.cc:2804] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:27.978296  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:27.956815  8993 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:27.981166  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:27.969563  8950 raft_consensus.cc:3055] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:27.966913  9183 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:27.981431  1581 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:27.984172  1612 raft_consensus.cc:1275] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:00:27.995561  1508 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
W20260709 13:00:28.000144  2267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:27.986089  8950 raft_consensus.cc:740] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 13:00:28.001835  9216 log.cc:927] Time spent T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.748s	user 0.007s	sys 0.013s
I20260709 13:00:28.006405  8993 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:28.008085  9153 consensus_queue.cc:1059] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:00:28.009413  9153 consensus_queue.cc:1059] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:00:28.011000  9146 raft_consensus.cc:3055] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:28.011453  9146 raft_consensus.cc:740] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:28.012108  9194 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:28.012817  2266 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 1.960s (SENT) [suppressed 69 similar messages]
I20260709 13:00:28.012660  9146 consensus_queue.cc:260] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:28.013926  2266 leader_election.cc:336] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 2.017s (SENT)
I20260709 13:00:28.010684  9153 raft_consensus.cc:3055] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:28.014989  9153 raft_consensus.cc:740] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:28.016176  9153 consensus_queue.cc:260] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:28.017112  9088 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:28.017449  9153 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:28.018147  8950 consensus_queue.cc:260] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:28.019143  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.019475  8950 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:00:28.021216  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:28.021811  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.022717  1507 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:28.031102  1686 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 13:00:28.041440  8714 raft_consensus.cc:3060] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:28.043258  8627 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:28.048303  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:28.051033  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.014134  9146 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:28.058539  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 13:00:28.062175  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 80870.5us
I20260709 13:00:27.989248  9183 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:28.063268  2298 raft_consensus.cc:1240] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:28.059228  1684 raft_consensus.cc:2376] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 22. Re-sending same reply.
I20260709 13:00:27.992193  8963 raft_consensus.cc:697] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:28.040750  8993 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.069032  8993 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:28.064678  8769 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:28.070973  8769 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.051659  9011 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.071678  9011 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:28.074139  9011 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:28.076524  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 81154.8us
I20260709 13:00:28.085597  2303 raft_consensus.cc:1240] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:28.071404  8769 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:28.066275  8627 raft_consensus.cc:2804] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:28.094170  8627 raft_consensus.cc:697] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 21 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:28.095183  8627 consensus_queue.cc:237] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:28.065008  9088 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.064833  9183 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:28.050176  9175 consensus_queue.cc:1059] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.035s
I20260709 13:00:28.056795  9194 consensus_queue.cc:1059] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:00:28.057896  9063 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.031s
I20260709 13:00:28.080538  8968 consensus_queue.cc:1059] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:00:28.112685  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 3851) took 1145 ms. Trace:
W20260709 13:00:28.116559  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 53525.1us
I20260709 13:00:28.129251  1581 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:28.065034  9165 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:00:28.127552  1611 rpcz_store.cc:276] 0709 13:00:26.967690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.968990 (+  1300us) service_pool.cc:224] Handling call
0709 13:00:27.072124 (+103134us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b5800091e98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc86202afc0 00007fc862015929 00007fc8620153d2 00007fc85b58cbd4
0709 13:00:27.268235 (+196111us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.376195 (+107960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:27.966889 (+590694us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b54002fec54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:28.112389 (+145500us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54002fec50. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:28.112596 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":518611200}
I20260709 13:00:28.090039  9011 consensus_queue.cc:1059] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:00:28.105664  8993 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:28.152956  9011 raft_consensus.cc:3055] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:28.153411  9011 raft_consensus.cc:740] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:28.154552  9011 consensus_queue.cc:260] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:28.156035  9011 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:28.109151  9020 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.156898  9020 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:28.159017  9020 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:28.159737  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:28.167680  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:28.167974  1685 raft_consensus.cc:1240] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:28.169837  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:28.112731  9097 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.111591  9180 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:28.115698  9227 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:28.105145  8714 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:28.175143  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:28.179497  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 13:00:28.201400  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.181881  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:28.182483  8730 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:28.183452  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:28.184650  9235 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:28.197118  9181 raft_consensus.cc:3055] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 24 LEADER]: Stepping down as leader of term 24
W20260709 13:00:28.179811  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 50675.9us
I20260709 13:00:28.202692  1691 raft_consensus.cc:2393] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 18: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 13:00:28.211107  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:28.233742  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.198889  9183 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:28.234519  1581 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:28.232120  9022 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.232573  9181 raft_consensus.cc:740] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 24 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:28.236734  8769 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:28.235621  8730 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:28.202193  9227 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:28.180903  9097 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:28.239682  9020 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.240163  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:28.142757  9234 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:00:28.243582  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:28.244441  1537 raft_consensus.cc:1240] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:28.262741  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 13:00:28.245316  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:28.263715  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 157053us
W20260709 13:00:28.264087  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.264375  1508 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:28.246423  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 3853) took 1265 ms. Trace:
I20260709 13:00:28.265239  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:28.246842  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 13:00:28.247099  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.236791  1534 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:00:28.114420  9088 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:28.253990  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:28.258356  1539 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 28.
I20260709 13:00:28.266222  1689 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:28.268504  1690 raft_consensus.cc:2393] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 14: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:28.258558  1688 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 21.
I20260709 13:00:28.258908  1610 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:28.251763  9180 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:00:28.251690  9121 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.019s	sys 0.042s
I20260709 13:00:28.260308  1608 raft_consensus.cc:1240] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:28.266161  1536 raft_consensus.cc:2393] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 21: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:28.268512  1609 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 22.
I20260709 13:00:28.265085  1615 rpcz_store.cc:276] 0709 13:00:26.981103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.066338 (+ 85235us) service_pool.cc:224] Handling call
0709 13:00:27.066624 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.141322 (+ 74698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.202858 (+1061536us) spinlock_profiling.cc:243] Waited 68.4 ms on lock 0x7b54001f6dd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:28.246361 (+ 43503us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157239168}
I20260709 13:00:28.278134  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:28.285627  1614 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:28.288404  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:28.289113  1610 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 13:00:28.287703  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:28.203287  9063 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:28.306226  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:28.307242  1536 raft_consensus.cc:2410] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:00:28.308794  1691 raft_consensus.cc:2368] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 18. Current term is 19.
I20260709 13:00:28.314551  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:28.314718  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 13:00:28.284184  9121 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.019s	sys 0.042s
I20260709 13:00:28.309473  1581 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:28.317418  1536 raft_consensus.cc:1275] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:00:28.312742  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:28.319974  1542 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 28.
I20260709 13:00:28.286413  8862 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.328284  1614 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 13:00:28.331533  1581 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:28.258509  9213 consensus_queue.cc:1059] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:00:28.336028  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:28.336229  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 1078) took 1080 ms. Trace:
I20260709 13:00:28.336741  1691 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:28.330926  2269 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:28.335503  1535 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 13:00:28.336689  1613 rpcz_store.cc:276] 0709 13:00:27.255976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.512400 (+256424us) service_pool.cc:224] Handling call
0709 13:00:27.536662 (+ 24262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.592371 (+ 55709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.335955 (+743584us) spinlock_profiling.cc:243] Waited 55.1 ms on lock 0x7b540008bbd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:28.336166 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126680960}
I20260709 13:00:28.334324  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:28.312255  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:28.353536  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:28.355779  1686 raft_consensus.cc:2393] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 18: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:28.261080  9022 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:28.252576  8963 consensus_queue.cc:237] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:28.362332  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:28.285697  9020 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:28.366613  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 54328us
I20260709 13:00:28.332029  9180 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:00:28.366518  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 56366.1us
W20260709 13:00:28.362082  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 97801.6us
I20260709 13:00:28.373960  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:28.374297  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:28.374651  1537 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:00:28.339902  9244 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:28.361632  9175 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:28.386355  1533 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 23.
I20260709 13:00:28.390097  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:28.390874  1686 raft_consensus.cc:2393] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 17: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:28.391196  2267 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:28.393842  9182 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:28.354416  8968 consensus_queue.cc:1059] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:00:28.340791  9235 consensus_queue.cc:1048] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 13:00:28.356887  9146 consensus_queue.cc:1059] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.046s
I20260709 13:00:28.419359  1583 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:28.411217  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:28.354202  9063 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:28.423810  1537 raft_consensus.cc:1275] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 14. (term mismatch)
I20260709 13:00:28.424105  1508 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:28.426158  1537 pending_rounds.cc:85] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 13
I20260709 13:00:28.426445  1537 pending_rounds.cc:107] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 23.14
I20260709 13:00:28.426710  1537 raft_consensus.cc:2889] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:28.430935  1583 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:28.432264  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:28.367787  8862 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:28.394068  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:28.434286  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:28.396409  9242 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:00:28.438730  9097 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:28.420037  9121 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.438905  1583 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:28.418073  9244 raft_consensus.cc:697] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:28.443190  1686 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:28.368587  9181 consensus_queue.cc:260] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.19, Last appended by leader: 19, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:28.419883  9175 raft_consensus.cc:697] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:28.445647  1617 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:00:28.446346  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:28.461498  1617 pending_rounds.cc:85] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f: Aborting all ops after (but not including) 12
I20260709 13:00:28.449671  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:28.456846  1583 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:28.461759  1617 pending_rounds.cc:107] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:00:28.462051  1617 raft_consensus.cc:2889] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:28.437789  8627 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:00:28.469933  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1127) took 1034 ms. Trace:
I20260709 13:00:28.470319  1687 rpcz_store.cc:276] 0709 13:00:27.439289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.449909 (+ 10620us) service_pool.cc:224] Handling call
0709 13:00:27.463609 (+ 13700us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:27.528507 (+ 64898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.469709 (+941202us) spinlock_profiling.cc:243] Waited 64.3 ms on lock 0x7b540029b3d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:28.469873 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147880704}
I20260709 13:00:28.457479  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:28.439561  9235 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:28.442839  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:28.479245  1583 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:28.454859  9213 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:00:28.436358  9153 consensus_queue.cc:1059] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:00:28.481871  1583 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:28.490231  1583 leader_election.cc:400] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 18. Current term is 19.
I20260709 13:00:28.491281  1583 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:28.497056  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:28.437994  2301 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 21.
I20260709 13:00:28.507869  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:28.465020  9242 raft_consensus.cc:697] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 25 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:28.437314  9234 consensus_queue.cc:1059] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:00:28.469486  9182 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:00:28.516803  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 270324us
I20260709 13:00:28.469444  9180 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:28.442889  9261 consensus_queue.cc:1059] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:00:28.479144  9183 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:28.476011  8714 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.062s
I20260709 13:00:28.484547  9213 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.478904  9174 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:28.518445  8627 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:28.536128  9176 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:00:28.549456  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 169175us
I20260709 13:00:28.490357  2296 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:28.446228  9056 consensus_queue.cc:1059] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:00:28.457952  9121 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:28.574988  9020 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:28.584988  9241 log.cc:927] Time spent T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
W20260709 13:00:28.574951  9253 log.cc:927] Time spent T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:00:28.608907  2266 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:28.489198  9061 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:00:28.549173  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 161388us
I20260709 13:00:28.536751  9088 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:28.549575  1686 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
W20260709 13:00:28.589455  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.538065  2295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32794 (request call id 1038) took 1097 ms. Trace:
W20260709 13:00:28.591136  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 170098us
I20260709 13:00:28.570576  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:28.627822  2301 raft_consensus.cc:2393] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 18: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 13:00:28.574205  9246 log.cc:927] Time spent T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:00:28.594575  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:28.594637  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:28.634322  1687 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:28.580544  2294 raft_consensus.cc:3055] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:28.600732  9244 consensus_queue.cc:237] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:28.601397  9022 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:28.605479  8627 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:28.669595  8705 raft_consensus.cc:3055] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:28.606477  9121 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:28.583261  9213 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:00:28.670341  8705 raft_consensus.cc:740] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:28.671344  8705 consensus_queue.cc:260] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:28.672680  8705 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:28.577934  9255 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.584550  9174 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:00:28.612313  1689 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 23.
I20260709 13:00:28.633845  1690 raft_consensus.cc:2393] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 21: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 13:00:28.640230  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.607025  9020 raft_consensus.cc:2804] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:28.606633  9270 consensus_queue.cc:1059] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 13:00:28.654165  2296 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:00:28.636397  9061 raft_consensus.cc:697] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 21 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 13:00:28.656419  9250 log.cc:927] Time spent T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
I20260709 13:00:28.636341  2294 raft_consensus.cc:740] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:28.632680  2295 rpcz_store.cc:276] 0709 13:00:27.415766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.421765 (+  5999us) service_pool.cc:224] Handling call
0709 13:00:28.393892 (+972127us) spinlock_profiling.cc:243] Waited 4.84 ms on lock 0x7b5800003c98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc8620170a0 00007fc862016984 00007fc85b5916d4 00007fc85b591662
0709 13:00:28.513252 (+119360us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11130752}
I20260709 13:00:28.661674  9254 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:28.662416  9243 log.cc:927] Time spent T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:00:28.669924  8862 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:28.677918  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.621471  9153 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:28.583885  9175 consensus_queue.cc:237] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:28.677827  9195 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:28.744619  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.698500  9020 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.680248  9235 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:28.752413  1691 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 22.
W20260709 13:00:28.809494  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 352736us
I20260709 13:00:28.755851  1687 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 20.
W20260709 13:00:28.761416  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.767522  1690 raft_consensus.cc:1275] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:00:28.812353  1505 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:28.780872  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 185925us
I20260709 13:00:28.712440  9264 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:28.783259  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 94033.8us
I20260709 13:00:28.744833  9257 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.783577  1583 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:28.758581  9063 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:28.812418  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 424626us
W20260709 13:00:28.813143  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 168897us
I20260709 13:00:28.692013  9255 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:28.818089  1505 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:28.798077  9020 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:28.817241  1507 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:28.679890  9242 consensus_queue.cc:237] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:28.846333  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 62870.1us
I20260709 13:00:28.813544  9097 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.855784  1508 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:28.849519  1583 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:28.843282  9264 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:28.867690  9264 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:28.867936  9063 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.798547  9195 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:28.868409  9063 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:28.870215  9195 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:28.867704  8871 raft_consensus.cc:3055] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:28.874835  8871 raft_consensus.cc:740] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 13:00:28.875084  9271 log.cc:927] Time spent T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:00:28.875861  8871 consensus_queue.cc:260] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:28.877115  8871 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:28.878531  9077 consensus_queue.cc:1048] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:28.880090  9077 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:00:28.890305  9267 log.cc:927] Time spent T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:00:28.890017  9270 consensus_queue.cc:1059] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:28.898451  9255 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:28.903229  9176 raft_consensus.cc:2804] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:28.903980  9176 raft_consensus.cc:697] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:28.816119  9153 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.049s
I20260709 13:00:28.782276  9254 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
W20260709 13:00:28.903390  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 53941.6us
I20260709 13:00:28.907325  2266 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:28.911062  9285 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:28.912523  2266 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:28.848223  9183 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:00:28.913893  9183 raft_consensus.cc:697] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 23 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:28.914786  9183 consensus_queue.cc:237] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:28.920982  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 103824us
I20260709 13:00:28.922721  9255 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 13:00:28.923828  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 105803us
I20260709 13:00:28.870688  9063 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:28.925235  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.810199  2294 consensus_queue.cc:260] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:28.928678  9282 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.004s
I20260709 13:00:28.929040  9213 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:28.841449  9235 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:28.932977  2299 raft_consensus.cc:2393] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 29: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
W20260709 13:00:28.933738  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 365527us
W20260709 13:00:28.936657  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 95111.1us
I20260709 13:00:28.938688  1542 raft_consensus.cc:1275] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:00:28.858932  9097 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:28.947110  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 102440us
I20260709 13:00:28.948702  2266 leader_election.cc:400] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for earlier term 17. Current term is 18.
I20260709 13:00:28.940451  2269 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:28.855222  9257 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:28.949132  2266 leader_election.cc:403] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:00:28.951735  1656 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:28.923367  9255 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:28.848599  9277 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.090s
I20260709 13:00:28.932585  8871 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.847345  9061 consensus_queue.cc:237] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:28.944708  9276 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:00:28.905043  9176 consensus_queue.cc:237] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:28.937531  8705 consensus_queue.cc:1059] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:00:28.955354  9077 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:28.994264  9077 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.995590  9077 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:28.998628  9286 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:28.999169  9286 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:28.999614  9286 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:29.004832  9290 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.005515  9290 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:29.007948  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 70747.5us
I20260709 13:00:29.010442  9257 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:28.983474  8871 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:29.011530  9273 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:29.013281  9263 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.129s
I20260709 13:00:29.013873  8871 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:29.005437  9284 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.015512  9260 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:29.015100  9284 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:29.021332  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 98408.3us
I20260709 13:00:29.022919  1656 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:28.980940  9063 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:29.029832  1656 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:28.986092  9213 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 29 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:29.028977  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:29.028736  9194 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:29.019023  9285 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:29.008282  9290 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:29.027405  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 171699us
I20260709 13:00:29.040823  1656 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:29.048667  1611 raft_consensus.cc:2393] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 21: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 13:00:29.027915  9227 consensus_meta.cc:287] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.760s	user 0.012s	sys 0.000s
I20260709 13:00:29.016831  9280 raft_consensus.cc:3055] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:00:29.096350  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 55624.1us
W20260709 13:00:29.101563  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 150694us
W20260709 13:00:29.064551  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 147561us
I20260709 13:00:29.087383  1617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 13:00:29.097355  1508 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
W20260709 13:00:29.078099  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 129615us
I20260709 13:00:29.098583  1581 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:29.104629  1617 raft_consensus.cc:606] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:29.105304  1617 raft_consensus.cc:614] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:00:29.106859  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 169559us
I20260709 13:00:29.102262  1505 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:29.042055  9273 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:00:29.048137  9153 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for earlier term 17. Current term is 18.
W20260709 13:00:29.118242  2267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.054320  9282 raft_consensus.cc:3055] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:00:29.121008  2267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.124205  9176 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:00:29.131438  2269 leader_election.cc:400] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for earlier term 17. Current term is 18.
I20260709 13:00:29.016343  9256 consensus_queue.cc:1059] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.176s
I20260709 13:00:29.134049  9270 consensus_queue.cc:1059] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:00:29.128665  8963 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.007s	sys 0.017s
W20260709 13:00:29.135136  8963 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.007s	sys 0.018s
I20260709 13:00:29.040138  9180 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.078s
I20260709 13:00:29.106515  9280 raft_consensus.cc:740] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:29.140034  1541 raft_consensus.cc:1240] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:29.137284  2269 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:29.125080  9176 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:29.053524  9063 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:29.144464  8993 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.129834  9194 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:29.150327  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 127104us
W20260709 13:00:29.151064  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 53817.6us
I20260709 13:00:29.163522  1508 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:29.151583  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 49413.8us
I20260709 13:00:29.130388  8871 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.176837  8871 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:29.125365  9282 raft_consensus.cc:740] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:29.178592  9194 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:29.179126  9282 consensus_queue.cc:260] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:29.181082  9194 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:29.181910  9235 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:29.186827  9020 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:29.187490  9063 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:29.130019  9277 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.033s
I20260709 13:00:29.191252  9174 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:29.146867  9260 raft_consensus.cc:697] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:29.193462  9260 consensus_queue.cc:237] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:29.194979  9301 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:29.196882  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:29.197572  1690 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 22.
I20260709 13:00:29.198690  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:29.199626  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:29.200227  1682 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 22.
I20260709 13:00:29.128981  9227 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:29.201195  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:29.202405  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:29.203013  1688 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 22.
I20260709 13:00:29.203896  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:29.204893  1683 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 13:00:29.206110  9273 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.206669  9273 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:29.210808  9254 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:29.211371  9290 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:29.166997  9295 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:29.212399  9295 raft_consensus.cc:697] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 13:00:29.167608  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.166289  9288 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:29.168076  9292 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:29.168502  9283 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:29.168910  9289 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:00:29.169327  9287 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:29.146587  9011 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.174072  9284 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:29.175091  9280 consensus_queue.cc:260] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:29.176013  9121 consensus_queue.cc:1059] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:00:29.178112  9255 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:29.211480  1655 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:29.225131  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:29.227106  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.188215  9063 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.167251  9077 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:29.202297  9227 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:29.246423  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:29.247509  1683 raft_consensus.cc:1240] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 18. Current term is 19. Ops: []
W20260709 13:00:29.233500  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 127829us
I20260709 13:00:29.250401  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:29.259112  1682 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 22. Current term is 23. Ops: []
I20260709 13:00:29.259820  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:29.273568  1690 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:29.268800  1535 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
W20260709 13:00:29.269086  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.228041  9282 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:00:29.269183  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 57795.2us
I20260709 13:00:29.260906  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:29.245703  9283 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.275599  1655 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:29.269996  1685 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 23.
I20260709 13:00:29.251744  9289 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:29.280910  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 128859us
I20260709 13:00:29.251624  9287 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.284261  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:29.278678  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 141463us
I20260709 13:00:29.322367  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:29.326326  1683 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 19.
W20260709 13:00:29.322903  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 47412us
I20260709 13:00:29.328363  1683 raft_consensus.cc:1275] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:00:29.329027  1655 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:29.330821  1610 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:29.330919  9254 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:29.330919  1508 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:29.331741  9254 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.266247  9288 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:29.333009  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 45837.4us
I20260709 13:00:29.333416  1508 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:29.283340  9180 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.334728  1535 raft_consensus.cc:2393] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 23: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:29.335639  2266 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:29.335840  1508 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:29.227478  8993 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:29.236246  9176 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:29.339754  9302 consensus_queue.cc:1059] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 28.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.008s
I20260709 13:00:29.340736  9293 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
W20260709 13:00:29.341274  9247 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.017s	sys 0.012s
I20260709 13:00:29.341589  9298 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:29.341938  9275 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.344096  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:29.269738  9063 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:29.321674  9289 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:29.286144  9061 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.281327  9291 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:29.357699  9247 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.017s	sys 0.013s
I20260709 13:00:29.351775  1686 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:29.350049  8730 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:29.338899  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:29.337145  2266 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:29.285101  9283 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:29.263182  9011 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:29.355436  1683 raft_consensus.cc:1240] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:29.332178  9254 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:00:29.377797  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.283252  9292 raft_consensus.cc:697] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 21 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:29.332585  8744 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:29.321403  9287 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:29.335496  9257 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:29.370239  9061 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:29.417598  9146 raft_consensus.cc:3055] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:29.418028  9146 raft_consensus.cc:740] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:29.418959  9061 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:29.419134  1613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 13:00:29.419754  1613 raft_consensus.cc:606] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:29.420080  1613 raft_consensus.cc:614] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:29.369092  9260 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:29.346539  9288 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:29.502229  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:29.337106  8885 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:29.334632  9121 consensus_queue.cc:1243] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 16.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:00:29.331166  9311 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.347707  9277 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:29.268606  9286 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:29.367447  8830 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:00:29.371438  1535 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 20.
I20260709 13:00:29.325264  9194 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:00:29.443261  9061 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:29.359546  8627 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:29.337306  9263 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:00:29.380230  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:29.551225  1540 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:00:29.347429  9180 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:29.344360  9210 log.cc:927] Time spent T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 2.052s	user 0.011s	sys 0.015s
I20260709 13:00:29.384521  1690 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 23.
I20260709 13:00:29.386313  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:29.385867  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:29.385303  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:29.417079  9310 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:29.376281  9291 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:29.562644  9291 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:29.376621  9298 raft_consensus.cc:697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 22 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:29.548986  9194 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.564231  9298 consensus_queue.cc:237] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:29.433593  8871 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:29.433976  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:29.566504  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:29.537930  8714 consensus_queue.cc:1048] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:00:29.546648  9063 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:29.567207  2296 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 13:00:29.568022  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:29.434168  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:29.376317  9275 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:29.435262  9307 log.cc:927] Time spent T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:00:29.436512  9174 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 27 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:29.436024  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:29.439536  9175 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.568668  2299 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 13:00:29.571110  9175 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:29.570911  2300 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:29.572875  1542 raft_consensus.cc:2410] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:00:29.573489  9175 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:29.440176  9226 raft_consensus.cc:3055] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:29.276295  9295 consensus_queue.cc:237] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:29.577497  1540 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 29.
I20260709 13:00:29.545679  9235 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:29.534143  1611 raft_consensus.cc:1275] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:00:29.503584  1617 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 19.
I20260709 13:00:29.384323  9020 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:29.538360  1613 raft_consensus.cc:1275] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:00:29.543938  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:29.355687  9273 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:29.586946  1616 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 13:00:29.588460  9282 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.589529  9301 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:29.549193  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:29.574712  9226 raft_consensus.cc:740] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:29.549608  1615 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 26. Current term is 27. Ops: [26.19-26.19]
I20260709 13:00:29.418972  9146 consensus_queue.cc:260] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:29.551357  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:29.591056  9226 consensus_queue.cc:260] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:29.591951  1614 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:29.507661  8885 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:29.592801  8885 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:29.575201  8627 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:29.594722  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:29.595319  8627 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:29.595494  1540 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 24.
I20260709 13:00:29.557827  2295 raft_consensus.cc:3055] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 13:00:29.596781  2295 raft_consensus.cc:740] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:29.597224  9286 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:29.553854  9061 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:29.558887  2301 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 13:00:29.599375  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:29.600101  9061 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:29.560748  9310 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.564823  9194 raft_consensus.cc:3060] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:00:29.568452  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:29.567080  9180 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:29.416949  9257 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.568778  1684 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 25.
I20260709 13:00:29.430661  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1204) took 1224 ms. Trace:
I20260709 13:00:29.429960  9224 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:29.547104  9293 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.589195  9282 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:29.592329  9226 raft_consensus.cc:3060] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:29.776038  9293 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:29.777554  9282 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:29.597712  2295 consensus_queue.cc:260] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:29.778487  2295 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:00:29.559554  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:29.558459  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:29.780331  1609 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 13:00:29.502076  9260 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.781258  9260 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:29.711959  9257 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:29.683300  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:29.784827  1611 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:00:29.706970  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.687515  1541 rpcz_store.cc:276] 0709 13:00:28.205768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.205896 (+   128us) service_pool.cc:224] Handling call
0709 13:00:28.236668 (+ 30772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:29.144988 (+908320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.430371 (+285383us) spinlock_profiling.cc:243] Waited 901 ms on lock 0x7b54003f8ed4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:29.430560 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2073072512}
I20260709 13:00:29.787014  8627 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:29.787624  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:29.787567  8627 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:29.789769  8627 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:29.753901  1608 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:00:29.754125  9176 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:29.754757  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.754963  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:29.755281  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:29.791525  1684 raft_consensus.cc:2376] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 23. Re-sending same reply.
I20260709 13:00:29.791764  1614 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:29.792613  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:29.756464  9247 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:29.757596  9061 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:29.760671  9180 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.761943  8993 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:29.763491  9288 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:29.764055  9283 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:29.768739  2301 raft_consensus.cc:1240] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 18. Current term is 19. Ops: []
W20260709 13:00:29.769236  9312 log.cc:927] Time spent T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.227s	user 0.000s	sys 0.000s
I20260709 13:00:29.771904  9292 consensus_queue.cc:237] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:29.830557  1614 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 23.
I20260709 13:00:29.774341  9275 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:29.682963  9310 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:29.685115  9235 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:29.823911  1684 raft_consensus.cc:2393] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 21: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 13:00:29.825891  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.553484  9311 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:29.838395  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.849472  1608 raft_consensus.cc:1240] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:00:29.851050  1614 raft_consensus.cc:1275] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
W20260709 13:00:29.883100  2267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.877358  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 13:00:29.883662  2267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:29.884105  2267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.885080  1541 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 13:00:29.887281  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:29.888777  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:29.897544  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:29.898114  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:29.898777  1608 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 13:00:29.831900  9180 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:29.830255  9061 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:29.879689  9254 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:29.877660  9293 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:29.882167  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:29.851250  8885 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:29.867183  9287 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:29.850559  9247 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:29.898939  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:29.956212  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:29.963199  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:29.956581  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:30.000247  1609 raft_consensus.cc:2393] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 18: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:29.955796  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:30.001132  1614 raft_consensus.cc:2393] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 23: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:29.891865  9263 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.957429  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:30.006489  1617 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:00:29.957826  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:30.007591  1616 raft_consensus.cc:2393] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 20: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:29.959872  1610 raft_consensus.cc:1240] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 22. Current term is 23. Ops: []
I20260709 13:00:29.881297  9121 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.727037  9077 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:29.993193  1689 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.010s	sys 0.016s
I20260709 13:00:29.998999  1539 raft_consensus.cc:2393] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 16: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:29.911957  1536 raft_consensus.cc:1240] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:29.971459  8705 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.910692  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:29.934407  9056 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.330s	user 0.008s	sys 0.004s
W20260709 13:00:29.934118  9234 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.351s	user 0.007s	sys 0.004s
W20260709 13:00:29.993726  9088 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.373s	user 0.051s	sys 0.029s
I20260709 13:00:30.010087  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:30.011090  2302 raft_consensus.cc:2393] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 24: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:30.053570  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:30.011966  1689 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.010s	sys 0.017s
I20260709 13:00:29.899518  9277 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:29.977913  9311 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:30.014065  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:30.015465  1610 raft_consensus.cc:1240] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21. Ops: [20.13-20.13]
W20260709 13:00:29.992962  9232 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.006s	sys 0.007s
I20260709 13:00:30.012436  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:30.056286  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:30.068773  1614 raft_consensus.cc:2393] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 18: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:30.056720  1608 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 25.
W20260709 13:00:30.016541  9056 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.412s	user 0.009s	sys 0.004s
I20260709 13:00:30.058650  2269 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:29.947561  9194 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 29 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:30.016777  9234 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.437s	user 0.007s	sys 0.004s
I20260709 13:00:30.062724  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:30.056342  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:30.088219  1539 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 21.
W20260709 13:00:30.033185  9088 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.412s	user 0.052s	sys 0.029s
I20260709 13:00:30.087580  1684 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 13:00:30.097503  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:30.084792  9232 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.007s	sys 0.007s
I20260709 13:00:30.111048  1609 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:30.104063  1616 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 21.
I20260709 13:00:30.013667  9263 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:30.017153  9121 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:30.031620  8705 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:30.146842  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:30.146852  9319 log.cc:927] Time spent T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:00:30.148865  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:30.146958  9327 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:00:30.149902  9327 raft_consensus.cc:697] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 23 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:30.150913  9327 consensus_queue.cc:237] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:30.152768  9263 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:30.142699  8993 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:30.155813  8993 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:30.158010  8993 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:30.158252  1685 raft_consensus.cc:1240] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:30.159889  1685 raft_consensus.cc:1275] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:00:30.161190  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:30.162391  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:30.164225  1686 raft_consensus.cc:1275] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:00:30.147228  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 88667.3us
I20260709 13:00:30.143450  1539 raft_consensus.cc:1240] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21. Ops: []
W20260709 13:00:30.165252  9318 log.cc:927] Time spent T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:00:30.165637  1686 raft_consensus.cc:1240] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:30.167001  1686 raft_consensus.cc:1275] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:00:30.164784  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:30.104734  9328 log.cc:927] Time spent T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:00:30.144727  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:30.169369  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:30.169723  1537 raft_consensus.cc:2410] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
W20260709 13:00:30.170238  2303 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32802 (request call id 776) took 1687 ms (client timeout 1788 ms). Trace:
I20260709 13:00:30.169636  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:30.113973  1690 raft_consensus.cc:2393] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 29: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:30.085438  9277 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:30.155334  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:30.173640  9194 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 29 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:30.112592  2295 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 29 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 13:00:30.146539  9235 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:30.175921  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:30.176594  9144 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 29 current term: 29 is higher.
W20260709 13:00:30.145989  2299 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.012s	sys 0.028s
W20260709 13:00:30.177760  2299 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.013s	sys 0.028s
W20260709 13:00:30.177098  2303 rpcz_store.cc:269] 0709 13:00:28.482552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.482705 (+   153us) service_pool.cc:224] Handling call
0709 13:00:30.169214 (+1686509us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b5800003c98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc8620170a0 00007fc862016984 00007fc85b5916d4 00007fc85b591662
0709 13:00:30.170164 (+   950us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35726720}
I20260709 13:00:30.189563  2301 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
W20260709 13:00:30.189603  1508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.016s	sys 0.070s
W20260709 13:00:30.191529  1508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.016s	sys 0.070s
I20260709 13:00:30.164505  9224 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:00:30.194998  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 858330us
I20260709 13:00:30.179641  9283 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:30.201983  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 141235us
I20260709 13:00:30.210273  9061 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:30.211097  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 26 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:30.212679  9332 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:00:30.215086  9121 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:30.217190  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:30.217851  1616 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 13:00:30.218703  2296 raft_consensus.cc:2410] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:00:30.219223  1582 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:30.220100  9061 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:00:30.147897  9260 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:30.220489  9310 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:30.222491  9260 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:30.222755  9310 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:30.223629  9254 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:30.224908  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:30.225270  9289 consensus_meta.cc:287] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.848s	user 0.010s	sys 0.000s
I20260709 13:00:30.225759  9289 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:30.238116  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.228413  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:30.228437  1537 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260709 13:00:30.227910  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:30.254848  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.255364  1617 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 13:00:30.256515  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:30.257200  1617 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 24.
I20260709 13:00:30.258368  1614 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
W20260709 13:00:30.235126  1533 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42356 (request call id 1201) took 2030 ms (client timeout 1775 ms). Trace:
I20260709 13:00:30.263864  1582 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:30.235364  1611 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 13:00:30.228852  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 26 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:30.263460  1533 rpcz_store.cc:269] 0709 13:00:28.204744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.204848 (+   104us) service_pool.cc:224] Handling call
0709 13:00:30.234881 (+2030033us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b540010c2d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:30.235019 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":287986048}
W20260709 13:00:30.265131  2269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:30.265904  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 45419.5us
I20260709 13:00:30.267920  1582 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:30.253872  1608 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 13:00:30.276727  1582 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:30.301848  1581 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.002s	sys 0.025s
W20260709 13:00:30.304553  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:30.248238  9317 log.cc:927] Time spent T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:00:30.321941  2267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:30.306545  1581 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.002s	sys 0.025s
I20260709 13:00:30.277932  9235 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:30.275491  9310 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:30.301726  9234 consensus_queue.cc:1059] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:00:30.310416  9227 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:30.310710  8705 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:30.311888  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:30.314064  9247 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:30.316275  9296 consensus_queue.cc:1059] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:00:30.399562  1616 raft_consensus.cc:2393] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 27: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:30.233834  8862 raft_consensus.cc:3055] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:30.405205  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:30.217113  9180 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:30.251012  9280 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:30.228102  9289 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:30.302497  9261 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.716s	user 0.014s	sys 0.046s
W20260709 13:00:30.350937  1507 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.815s	user 0.015s	sys 0.050s
W20260709 13:00:30.423064  1507 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.015s	sys 0.051s
I20260709 13:00:30.277644  9061 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:30.328984  8714 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.230232  9257 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:30.328992  9121 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:30.372121  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:30.408715  9244 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.520s	user 0.012s	sys 0.012s
I20260709 13:00:30.422916  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3961) took 1182 ms. Trace:
I20260709 13:00:30.372592  1533 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 LEADER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 28. Current term is 29. Ops: []
W20260709 13:00:30.423421  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 1.04466e+06us
I20260709 13:00:30.438973  1689 rpcz_store.cc:276] 0709 13:00:29.229352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.284916 (+ 55564us) service_pool.cc:224] Handling call
0709 13:00:29.332817 (+ 47901us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:29.333202 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.333234 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:29.355103 (+ 21869us) log.cc:844] Serialized 26 byte log entry
0709 13:00:30.054894 (+699791us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:30.200058 (+145164us) log.cc:844] Serialized 14 byte log entry
0709 13:00:30.209741 (+  9683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.209817 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:30.246133 (+ 36316us) spinlock_profiling.cc:243] Waited 8.2 ms on lock 0x7b18004734a0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f322a6 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db
0709 13:00:30.247562 (+  1429us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 13:00:30.411662 (+164100us) raft_consensus.cc:1685] finished
0709 13:00:30.411683 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.411825 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":145193,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":2957,"raft.queue_time_us":27715,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":13824,"spinlock_wait_cycles":46366336,"thread_start_us":769794,"threads_started":2,"wal-append.queue_time_us":671312}
I20260709 13:00:30.440639  2295 raft_consensus.cc:2393] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 21: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
W20260709 13:00:30.422816  9261 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.839s	user 0.015s	sys 0.047s
I20260709 13:00:30.397910  9227 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 13:00:30.423444  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 279794us
I20260709 13:00:30.403214  8862 raft_consensus.cc:740] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 13:00:30.412683  2267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.439534  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1211) took 1070 ms. Trace:
I20260709 13:00:30.442502  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:30.451248  1656 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:30.450871  2267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.452792  2299 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 21.
I20260709 13:00:30.450726  1533 rpcz_store.cc:276] 0709 13:00:29.369655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.329151 (+959496us) service_pool.cc:224] Handling call
0709 13:00:30.372377 (+ 43226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.439261 (+ 66884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.439478 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:30.452432  1684 raft_consensus.cc:2368] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 18. Current term is 19.
W20260709 13:00:30.441745  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 210798us
W20260709 13:00:30.454663  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.404122  9310 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:30.434350  9296 raft_consensus.cc:3055] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:30.460369  2267 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:30.462288  1656 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:30.444959  9244 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.557s	user 0.012s	sys 0.012s
I20260709 13:00:30.467185  2267 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:30.468318  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:30.475180  2295 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 13:00:30.456941  9284 consensus_queue.cc:1059] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:00:30.466686  9292 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:30.470878  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:30.471457  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:30.445443  9227 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:30.440207  9061 raft_consensus.cc:697] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:30.481316  2299 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 29.
I20260709 13:00:30.451668  9289 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.487298  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:30.498821  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:30.499476  1533 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 21.
I20260709 13:00:30.483017  8705 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.437745  8714 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:30.502223  8714 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:30.463011  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:30.503564  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:30.504774  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:30.493947  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:30.465287  9296 raft_consensus.cc:740] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:30.443990  9121 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:30.474510  9327 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:30.474597  9342 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:30.523290  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:30.524231  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:30.485492  9213 raft_consensus.cc:2804] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:00:30.499382  9292 raft_consensus.cc:697] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:30.513298  9327 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.558357  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:30.520057  9194 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.545014  1690 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 22. Current term is 23. Ops: []
I20260709 13:00:30.530722  9244 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.508505  9289 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:30.519230  8705 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:30.571431  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:30.563334  9327 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:30.564200  9234 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.532919  9286 consensus_queue.cc:1059] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
I20260709 13:00:30.568219  9352 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.585807  9352 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:30.586052  9292 consensus_queue.cc:237] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:30.587690  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1199) took 2383 ms. Trace:
I20260709 13:00:30.573961  9213 raft_consensus.cc:697] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 29 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:30.559429  9310 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:30.581158  9257 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:30.581485  2294 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:30.580338  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:30.582717  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:30.594782  1535 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 11.
I20260709 13:00:30.592315  2296 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:00:30.588092  1538 rpcz_store.cc:276] 0709 13:00:28.204030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.204137 (+   107us) service_pool.cc:224] Handling call
0709 13:00:28.241999 (+ 37862us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:28.242394 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:28.242423 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:28.242890 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:00:28.333754 (+ 90864us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:00:28.340801 (+  7047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.340881 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:30.560422 (+2219541us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b24001301a8. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859dea9c4 00007fc859de8acb 00007fc859fa3dc9 00007fc859fa3a55 00007fc859fa2fb0 00007fc85cc19488 00007fc85cc19be8 00007fc85cbf1398 00007fc85cbec76a 00007fc85cbebbb6
0709 13:00:30.577374 (+ 16952us) raft_consensus.cc:1685] finished
0709 13:00:30.577397 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.587621 (+ 10224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11696,"raft.queue_time_us":4040,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":5832,"spinlock_wait_cycles":49813760,"thread_start_us":90105,"threads_started":1,"wal-append.queue_time_us":159409}
I20260709 13:00:30.591946  9352 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:30.599582  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:30.531415  8862 consensus_queue.cc:260] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:30.567981  9194 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:30.603394  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:30.604936  1689 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 13:00:30.529251  9296 consensus_queue.cc:260] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:30.608893  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 4755) took 1012 ms. Trace:
I20260709 13:00:30.609289  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:30.613988  1684 rpcz_store.cc:276] 0709 13:00:29.596108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.105624 (+509516us) service_pool.cc:224] Handling call
0709 13:00:30.608696 (+503072us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b5400393854. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:30.608833 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":699818752}
I20260709 13:00:30.617331  1613 raft_consensus.cc:2410] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:00:30.618393  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:30.620868  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:30.621567  1616 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:30.625392  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:30.626200  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1209) took 1269 ms. Trace:
I20260709 13:00:30.626626  1539 rpcz_store.cc:276] 0709 13:00:29.357278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.166958 (+809680us) service_pool.cc:224] Handling call
0709 13:00:30.167316 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:30.167647 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:30.167674 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:30.168170 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:00:30.447700 (+279530us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:30.447737 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.447802 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:30.626011 (+178209us) raft_consensus.cc:1685] finished
0709 13:00:30.626029 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.626145 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1359,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":124,"thread_start_us":271160,"threads_started":1,"wal-append.queue_time_us":405327}
I20260709 13:00:30.618516  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:30.616585  1508 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:30.628449  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:30.661063  1539 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 20.
I20260709 13:00:30.661345  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:30.652642  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4568) took 1293 ms. Trace:
I20260709 13:00:30.661985  1609 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:00:30.650903  2296 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:00:30.662448  1537 rpcz_store.cc:276] 0709 13:00:29.358808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.170463 (+811655us) service_pool.cc:224] Handling call
0709 13:00:30.170798 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:30.275993 (+105195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.652322 (+376329us) spinlock_profiling.cc:243] Waited 57.4 ms on lock 0x7b54003f9dd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:30.652573 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":131966720}
I20260709 13:00:30.577785  9244 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:30.647977  8705 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:30.665575  9341 log.cc:927] Time spent T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.086s	user 0.000s	sys 0.002s
W20260709 13:00:30.638875  9343 log.cc:927] Time spent T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:00:30.722644  9339 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:00:30.723963  9254 consensus_queue.cc:1059] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:00:30.726225  9011 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:30.726449  9261 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:00:30.727438  9268 raft_consensus.cc:3055] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:30.733600  9331 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.793216  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:30.795938  1612 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 13:00:30.736009  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 3621) took 1388 ms. Trace:
I20260709 13:00:30.736807  1507 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:30.737278  2294 raft_consensus.cc:1275] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:00:30.741611  9182 raft_consensus.cc:3055] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:30.589849  9234 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:30.573463  9061 consensus_queue.cc:237] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:30.749348  1616 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 13:00:30.755213  1609 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:00:30.700059  1654 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:30.701465  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 84987.2us
I20260709 13:00:30.809340  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:30.775137  9263 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.786331  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:30.812345  1538 raft_consensus.cc:2393] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 24: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:30.773957  9342 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:30.645910  9121 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:30.794716  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:30.822400  1617 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:30.796977  1541 rpcz_store.cc:276] 0709 13:00:29.351965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.787335 (+435370us) service_pool.cc:224] Handling call
0709 13:00:30.735853 (+948518us) spinlock_profiling.cc:243] Waited 96.7 ms on lock 0x7b54002e7f54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:30.735950 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222435200}
I20260709 13:00:30.796259  1533 raft_consensus.cc:2393] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 18: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:30.801442  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:30.802596  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 65862.1us
I20260709 13:00:30.823865  1611 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 18.
I20260709 13:00:30.824034  1507 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:30.756750  9296 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:30.745226  9286 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.807384  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:30.813789  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:30.825524  1688 raft_consensus.cc:2376] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 20. Re-sending same reply.
W20260709 13:00:30.815009  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 115046us
I20260709 13:00:30.789666  9257 raft_consensus.cc:3055] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:30.826886  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:30.827096  1654 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:30.788574  9268 raft_consensus.cc:740] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:30.825052  1612 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 13:00:30.645002  9194 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:30.819787  9292 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:30.865710  2294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32802 (request call id 775) took 2372 ms. Trace:
I20260709 13:00:30.866266  2294 rpcz_store.cc:276] 0709 13:00:28.455710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.456735 (+  1025us) service_pool.cc:224] Handling call
0709 13:00:28.538686 (+ 81951us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.580815 (+2042129us) spinlock_profiling.cc:243] Waited 7.76 ms on lock 0x7b58004409d0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85cfad0aa 00007fc85d02f447 00007fc85d047fe7 00007fc85d0497de 00007fc85d053b49 00007fc85d054416 00007fc85d050d8f 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4
0709 13:00:30.804211 (+223396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.827936 (+ 23725us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17856768}
I20260709 13:00:30.861613  1617 raft_consensus.cc:2393] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 20: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:30.868795  9286 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:30.869791  1612 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 13:00:30.861907  1654 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:30.870488  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:30.871155  1538 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 22.
I20260709 13:00:30.871832  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:30.865862  9310 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:30.872123  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:30.877343  1538 raft_consensus.cc:2393] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 20: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:30.863095  1507 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:30.871218  9286 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:30.804805  9182 raft_consensus.cc:740] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:30.802493  9261 raft_consensus.cc:697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:30.883138  1612 raft_consensus.cc:1240] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:30.883700  9244 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:30.883906  9284 raft_consensus.cc:2804] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:30.792868  9227 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:30.804018  9331 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:30.874162  9289 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:30.886309  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:30.814421  9325 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:30.892700  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 3626) took 1526 ms. Trace:
I20260709 13:00:30.780377  9213 consensus_queue.cc:237] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:30.896157  1609 raft_consensus.cc:1240] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:30.907320  1534 rpcz_store.cc:276] 0709 13:00:29.366404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.173905 (+807501us) service_pool.cc:224] Handling call
0709 13:00:30.174254 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:30.174600 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:30.174628 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:30.175119 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:00:30.427180 (+252061us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:30.427226 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.427306 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:30.892425 (+465119us) raft_consensus.cc:1685] finished
0709 13:00:30.892450 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:30.892627 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":181,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"thread_start_us":251556,"threads_started":1,"wal-append.queue_time_us":393168}
I20260709 13:00:30.898379  1583 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:30.872110  9194 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:30.899245  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:30.894313  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:30.900601  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:30.913399  1688 raft_consensus.cc:2376] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18. Re-sending same reply.
I20260709 13:00:30.873005  9254 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:00:30.902355  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:30.915819  1583 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:30.837129  9257 raft_consensus.cc:740] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:30.829319  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3964) took 1591 ms. Trace:
I20260709 13:00:30.815467  8705 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.876897  9310 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.812817  9353 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.914203  1538 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 21.
I20260709 13:00:30.828927  9342 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:30.903146  9284 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.820539  9263 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:30.929934  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:30.962378  1534 raft_consensus.cc:2393] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 24: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:30.931348  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:30.930171  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 3614) took 1704 ms. Trace:
W20260709 13:00:30.963598  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 47862.1us
I20260709 13:00:30.927256  1683 rpcz_store.cc:276] 0709 13:00:29.237946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.329204 (+ 91258us) service_pool.cc:224] Handling call
0709 13:00:29.354213 (+ 25009us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:29.377217 (+ 23004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.829115 (+1451898us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b540041d050. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:30.829258 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56806272}
W20260709 13:00:30.958027  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 67112.3us
I20260709 13:00:30.960754  9359 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:30.910995  9283 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:30.908903  9347 log.cc:927] Time spent T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.333s	user 0.000s	sys 0.001s
I20260709 13:00:30.965610  2267 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:30.900743  9247 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.057s
I20260709 13:00:30.913244  9325 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.963660  1536 rpcz_store.cc:276] 0709 13:00:29.225825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.226040 (+   215us) service_pool.cc:224] Handling call
0709 13:00:29.226325 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.011764 (+785439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.929931 (+918167us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b54002e7554. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:30.930107 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1576368896}
I20260709 13:00:30.925215  8730 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:00:30.969182  9293 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:30.967519  9353 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
W20260709 13:00:30.969667  9351 log.cc:927] Time spent T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.375s	user 0.001s	sys 0.000s
I20260709 13:00:30.971269  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 13:00:30.968990  9357 log.cc:927] Time spent T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:00:30.949476  9310 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:30.962184  9284 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:30.928959  9331 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:30.946199  9097 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:30.915516  9244 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:30.984768  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:30.998657  1542 raft_consensus.cc:2393] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 29: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:30.998708  8968 raft_consensus.cc:3055] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:31.002687  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:30.978039  2267 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:31.011698  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:31.000676  9293 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:31.026283  9293 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:31.028942  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:31.030243  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:30.956409  9254 consensus_queue.cc:1059] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:00:31.032648  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:31.034587  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 163075us
I20260709 13:00:31.035228  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:31.038086  1542 raft_consensus.cc:2410] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 24 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 13:00:30.914153  9182 consensus_queue.cc:260] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:30.981268  9325 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:30.981182  8730 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.038303  1654 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:31.064074  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 86117.8us
W20260709 13:00:31.068259  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.978226  9283 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:31.001075  9289 consensus_queue.cc:1048] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:00:30.973896  9359 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:30.967893  8705 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:31.071743  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 64448.7us
I20260709 13:00:31.020151  8968 raft_consensus.cc:740] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:31.080986  1654 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:31.054075  8730 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:31.016877  9272 consensus_queue.cc:1048] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
I20260709 13:00:30.948302  9268 consensus_queue.cc:260] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:31.089170  1505 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:31.073659  9376 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:00:31.090534  1654 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:31.091128  9339 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:00:31.097337  9363 log.cc:927] Time spent T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:00:31.098436  9227 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:31.077929  9254 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:00:31.099239  9265 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 2.208s	user 0.009s	sys 0.016s
I20260709 13:00:31.040266  9244 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:31.020344  9369 consensus_queue.cc:1059] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 26.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.071s
I20260709 13:00:31.118847  1505 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:31.004632  9261 consensus_queue.cc:237] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:31.127948  1654 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:31.088303  9234 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:31.111270  9182 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:31.140384  1533 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:00:31.141747  1533 raft_consensus.cc:1240] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 22. Current term is 23. Ops: []
I20260709 13:00:31.145092  2297 raft_consensus.cc:1240] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 20. Current term is 21. Ops: [20.17-20.17]
I20260709 13:00:31.145800  2297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32794 (request call id 1055) took 1761 ms. Trace:
I20260709 13:00:31.146092  2297 rpcz_store.cc:276] 0709 13:00:29.384841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.144544 (+1759703us) service_pool.cc:224] Handling call
0709 13:00:31.144880 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:31.145513 (+   633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.145713 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:31.147097  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:31.152549  1505 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:31.153872  1505 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:31.159835  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1141) took 1579 ms. Trace:
I20260709 13:00:31.052553  9257 consensus_queue.cc:260] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
W20260709 13:00:31.170974  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.160310  1686 rpcz_store.cc:276] 0709 13:00:29.580746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.167651 (+586905us) service_pool.cc:224] Handling call
0709 13:00:30.167970 (+   319us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:30.168328 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:30.168358 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:30.189286 (+ 20928us) log.cc:844] Serialized 52 byte log entry
0709 13:00:30.447341 (+258055us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:00:30.471405 (+ 24064us) log.cc:844] Serialized 14 byte log entry
0709 13:00:30.471848 (+   443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.471918 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:31.159562 (+687644us) raft_consensus.cc:1685] finished
0709 13:00:31.159586 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.159752 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23592,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":34,"raft.queue_time_us":6189,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":184,"thread_start_us":187752,"threads_started":1,"wal-append.queue_time_us":368274}
I20260709 13:00:31.121670  9339 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:31.184314  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:31.121707  9364 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:31.111581  9011 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.025s
I20260709 13:00:31.188922  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:31.128826  9367 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:00:31.159008  9251 log.cc:927] Time spent T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 2.623s	user 0.029s	sys 0.008s
I20260709 13:00:31.193109  1684 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 16.
I20260709 13:00:31.135342  9331 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:00:31.223919  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:31.227849  2266 leader_election.cc:336] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 1.642s (SENT)
I20260709 13:00:31.228499  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:31.228586  2266 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:31.179664  9247 raft_consensus.cc:2804] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:31.185225  9292 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:31.191751  9268 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:31.185274  8769 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:31.078953  9375 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.192s
I20260709 13:00:31.229283  1688 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:31.184758  9339 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:31.267716  9367 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:31.191192  9364 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:31.325793  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 328487us
I20260709 13:00:31.271050  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:31.332620  1691 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 3952) took 2129 ms (client timeout 2155 ms). Trace:
I20260709 13:00:31.324715  2296 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 29.
W20260709 13:00:31.269171  9360 log.cc:927] Time spent T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
I20260709 13:00:31.346285  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:31.271006  9272 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:00:31.339231  1691 rpcz_store.cc:269] 0709 13:00:29.195217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.198409 (+  3192us) service_pool.cc:224] Handling call
0709 13:00:31.322952 (+2124543us) spinlock_profiling.cc:243] Waited 999 ms on lock 0x7b540022b0d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:31.324870 (+  1918us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2298273024}
I20260709 13:00:31.184963  9378 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:31.225540  9372 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:31.262063  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:31.324069  9361 log.cc:927] Time spent T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.353s	user 0.001s	sys 0.000s
W20260709 13:00:31.336045  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 182242us
I20260709 13:00:31.338376  1583 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:31.269865  9257 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:31.270700  9247 raft_consensus.cc:697] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:31.331509  9286 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:31.369271  2298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32802 (request call id 770) took 3057 ms. Trace:
W20260709 13:00:31.344210  9373 log.cc:927] Time spent T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 13:00:31.373894  2298 rpcz_store.cc:276] 0709 13:00:28.312383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.312533 (+   150us) service_pool.cc:224] Handling call
0709 13:00:28.331680 (+ 19147us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:28.424348 (+ 92668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:28.424378 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:28.424888 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 13:00:28.547174 (+122286us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:00:28.547220 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.547291 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:31.098608 (+2551317us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 13:00:31.350544 (+251936us) raft_consensus.cc:1685] finished
0709 13:00:31.350564 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.369194 (+ 18630us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18773,"raft.queue_time_us":46141,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":5072,"spinlock_wait_cycles":38512000,"thread_start_us":107568,"threads_started":1,"wal-append.queue_time_us":411614}
W20260709 13:00:31.373986  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 153735us
W20260709 13:00:31.379937  2266 leader_election.cc:336] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 1.755s (SENT)
I20260709 13:00:31.380110  1583 leader_election.cc:400] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 18. Current term is 19.
W20260709 13:00:31.333320  9242 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.440s	user 0.017s	sys 0.017s
I20260709 13:00:31.193564  9254 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:31.341914  9121 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:31.380409  2266 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:31.351207  9342 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:31.370661  1505 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:31.381502  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:31.380519  1583 leader_election.cc:403] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:31.408663  1686 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 21.
I20260709 13:00:31.352782  9272 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.343571  9364 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:31.363109  9292 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.350914  9234 consensus_queue.cc:1048] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:00:31.387787  9254 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.439793  9254 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:00:31.397425  9365 log.cc:927] Time spent T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:00:31.398588  9383 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:00:31.437739  9283 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:31.400573  9121 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:31.434310  9380 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.036s
I20260709 13:00:31.401577  9359 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:31.403661  2301 raft_consensus.cc:1275] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:00:31.358776  9378 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:31.364921  9372 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.408914  1583 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:31.410909  1688 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 24.
W20260709 13:00:31.387609  9242 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.494s	user 0.018s	sys 0.018s
I20260709 13:00:31.459228  9022 raft_consensus.cc:3055] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:00:31.459719  9022 raft_consensus.cc:740] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:31.459245  2300 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 25 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 24. Current term is 25. Ops: [22.18-24.19]
I20260709 13:00:31.460750  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3962) took 2223 ms. Trace:
W20260709 13:00:31.459734  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 50913.8us
I20260709 13:00:31.461187  1682 rpcz_store.cc:276] 0709 13:00:29.237419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.325510 (+ 88091us) service_pool.cc:224] Handling call
0709 13:00:29.353325 (+ 27815us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:29.360670 (+  7345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:29.360708 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:30.174718 (+814010us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b4c00403cc0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85b31da20 00007fc85b32ea29 00007fc85b2f4644 00007fc85b31bf2d 00007fc85b31bb93 00007fc85d04c18b 00007fc85d04ccb5 00007fc85d04e004 00007fc85d04d729 00007fc85d052d96 00007fc85d047adb
0709 13:00:30.932589 (+757871us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b2c00128aa8. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85b94aa11 00007fc85b95a372 00007fc85d08ca01 00007fc85d05143a 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2
0709 13:00:30.982585 (+ 49996us) log.cc:844] Serialized 590 byte log entry
0709 13:00:31.224081 (+241496us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:00:31.394460 (+170379us) log.cc:844] Serialized 14 byte log entry
0709 13:00:31.394778 (+   318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.394859 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:31.460461 (+ 65602us) raft_consensus.cc:1685] finished
0709 13:00:31.460515 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.460667 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":216628,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":21383,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":21802,"spinlock_wait_cycles":44601344,"thread_start_us":272064,"threads_started":2,"wal-append.queue_time_us":347542}
I20260709 13:00:31.459923  9375 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:31.463775  9375 raft_consensus.cc:697] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 20 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:31.432085  2302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32794 (request call id 1052) took 2057 ms. Trace:
W20260709 13:00:31.433804  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.464757  9375 consensus_queue.cc:237] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:31.463457  8968 consensus_queue.cc:260] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:31.465502  9372 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:31.466017  8968 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:00:31.401477  9323 log.cc:927] Time spent T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 1.252s	user 0.000s	sys 0.008s
I20260709 13:00:31.380326  9370 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:31.438196  2298 raft_consensus.cc:1275] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:31.387439  9353 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:31.441931  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 105527us
I20260709 13:00:31.443825  1686 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:00:31.390561  9377 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:31.412045  9180 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 18. Current term is 19.
I20260709 13:00:31.432590  9272 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:31.457470  1688 raft_consensus.cc:1240] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 16. Current term is 17. Ops: []
W20260709 13:00:31.441777  9280 consensus_meta.cc:287] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 1.021s	user 0.020s	sys 0.000s
I20260709 13:00:31.436518  9331 raft_consensus.cc:697] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 13:00:31.462679  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.464382  2302 rpcz_store.cc:276] 0709 13:00:29.374202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.374312 (+   110us) service_pool.cc:224] Handling call
0709 13:00:31.431484 (+2057172us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b54005fb9d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:31.432013 (+   529us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1046164352}
I20260709 13:00:31.410107  1505 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:31.353278  9367 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:31.457226  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 329372us
W20260709 13:00:31.523800  2269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.488412  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.556339  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.468807  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:31.588604  2303 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:31.626155  1583 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:31.643244  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.534070  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:31.646278  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 236272us
W20260709 13:00:31.645421  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.445947  9244 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:31.650795  1654 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:31.437376  9181 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:00:31.623513  9293 consensus_meta.cc:287] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.597s	user 0.009s	sys 0.000s
W20260709 13:00:31.533627  9310 consensus_meta.cc:287] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.000s
I20260709 13:00:31.438889  9011 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:31.597383  9289 raft_consensus.cc:3055] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:00:31.447928  8730 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:31.594641  8885 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:31.644793  8714 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.535833  9022 consensus_queue.cc:260] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:31.535028  9287 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:31.660001  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 280101us
I20260709 13:00:31.663730  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:31.590103  9263 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:31.626436  9377 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.645187  9088 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:31.672183  2269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.649950  9352 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:31.650604  9283 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:31.662828  9327 consensus_meta.cc:287] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 1.073s	user 0.006s	sys 0.013s
I20260709 13:00:31.456590  9378 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:31.652994  8769 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:31.468852  9256 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:00:31.674544  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 49048.3us
I20260709 13:00:31.461581  9285 consensus_queue.cc:1059] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.196s
I20260709 13:00:31.665654  9289 raft_consensus.cc:740] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 13:00:31.701351  2266 leader_election.cc:336] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 1.767s (SENT)
I20260709 13:00:31.713292  9289 consensus_queue.cc:260] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.19, Last appended by leader: 19, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:31.592012  9254 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:31.705211  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.445394  9247 consensus_queue.cc:237] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:31.660871  9369 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.043s
I20260709 13:00:31.457674  9284 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:31.673481  9310 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:31.667683  9011 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 13:00:31.704268  9235 consensus_meta.cc:287] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 1.306s	user 0.010s	sys 0.003s
I20260709 13:00:31.651007  9370 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:31.655671  9292 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:31.666203  9244 consensus_queue.cc:1059] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:00:31.701927  9121 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:31.666663  9293 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:31.708364  8705 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:31.705868  9377 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:31.740983  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.716727  8769 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.727265  9022 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:31.699358  8714 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:31.753814  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 284564us
I20260709 13:00:31.743571  9011 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:31.727862  9352 raft_consensus.cc:697] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 13:00:31.744448  9296 consensus_meta.cc:287] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.883s	user 0.006s	sys 0.005s
W20260709 13:00:31.744876  9325 consensus_meta.cc:287] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.675s	user 0.007s	sys 0.006s
W20260709 13:00:31.754428  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 103706us
I20260709 13:00:31.762130  1656 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:31.708760  9088 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:31.716064  9283 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:31.747058  9235 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:31.717218  9327 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:31.777719  1654 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:31.761092  8769 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:31.763444  9244 consensus_queue.cc:1243] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Peer c262eac7fc904ae9bb91e450f6532e3f log is divergent from this leader: its last log entry 22.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:00:31.786840  8730 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:31.778344  9182 consensus_meta.cc:287] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.616s	user 0.006s	sys 0.004s
I20260709 13:00:31.790319  9293 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:31.791092  9352 consensus_queue.cc:237] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:31.791978  9284 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:31.793825  8714 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:31.767252  9395 consensus_queue.cc:1059] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 13:00:31.776618  9388 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:00:31.763453  9389 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:31.739323  9331 consensus_queue.cc:237] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:31.807286  9403 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:00:31.856415  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 78778.4us
I20260709 13:00:31.780210  9353 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.836597  2299 raft_consensus.cc:2393] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 21: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
W20260709 13:00:31.841831  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 121900us
W20260709 13:00:31.858407  2266 leader_election.cc:336] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 1.960s (SENT)
I20260709 13:00:31.845866  8627 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.852780  1689 raft_consensus.cc:2410] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
I20260709 13:00:31.801554  9404 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:00:31.800446  9397 log.cc:927] Time spent T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 13:00:31.858580  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 96497.9us
I20260709 13:00:31.780627  9325 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:31.858121  1654 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:31.896600  1654 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
W20260709 13:00:31.894383  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 162758us
I20260709 13:00:31.898836  9254 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:31.900650  9396 log.cc:927] Time spent T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:00:31.904901  9410 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:00:31.905401  9410 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.905737  9410 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:31.907158  9409 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:31.922636  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:31.863758  9257 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:31.859258  9403 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:31.931854  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 73484.1us
I20260709 13:00:31.863529  9404 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.937369  1534 raft_consensus.cc:1275] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 27 index: 17. (term mismatch)
I20260709 13:00:31.940132  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 13:00:31.941992  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.896270  9367 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:31.864564  8627 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:31.956123  1610 raft_consensus.cc:2410] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 26 because replica has last-logged OpId of term: 24 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 17.
I20260709 13:00:31.959082  8862 raft_consensus.cc:3060] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:31.960923  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:31.961799  1537 raft_consensus.cc:2393] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 21: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:31.962347  2300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32788 (request call id 721) took 2419 ms. Trace:
I20260709 13:00:31.962885  9310 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:31.965417  9097 raft_consensus.cc:3055] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:00:31.965925  9097 raft_consensus.cc:740] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 13:00:31.966538  9339 consensus_meta.cc:287] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.621s	user 0.009s	sys 0.000s
I20260709 13:00:31.966738  9097 consensus_queue.cc:260] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:31.967764  9292 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:31.941140  1534 pending_rounds.cc:85] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 16
I20260709 13:00:31.970921  1534 pending_rounds.cc:107] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 26.17
I20260709 13:00:31.971257  1534 raft_consensus.cc:2889] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:31.946210  1539 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 LEADER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 22. Current term is 23. Ops: []
I20260709 13:00:31.962731  2300 rpcz_store.cc:276] 0709 13:00:29.543012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.574242 (+ 31230us) service_pool.cc:224] Handling call
0709 13:00:29.574626 (+   384us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:31.460620 (+1885994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.962114 (+501494us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b54004db7d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:31.962295 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4333811968}
W20260709 13:00:31.943044  2266 leader_election.cc:336] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 2.048s (SENT)
I20260709 13:00:31.946818  8705 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.932734  9257 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.946862  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:31.948040  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:31.987998  2302 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:31.928762  9022 consensus_queue.cc:1048] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:00:31.948882  9408 consensus_queue.cc:1059] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.027s
W20260709 13:00:31.950150  9401 log.cc:927] Time spent T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:00:31.952045  9283 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:31.928905  8714 consensus_queue.cc:1048] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:00:31.954070  9372 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:31.954509  9327 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:31.858017  9389 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:32.014215  9181 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:31.947185  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:31.865927  9353 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:32.015038  2302 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 12.
I20260709 13:00:32.014818  9181 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:31.980501  8705 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:32.014771  9389 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:32.017060  8705 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:32.018249  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1146) took 1505 ms. Trace:
I20260709 13:00:32.018642  1690 rpcz_store.cc:276] 0709 13:00:30.513191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.513335 (+   144us) service_pool.cc:224] Handling call
0709 13:00:30.520975 (+  7640us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.564889 (+ 43914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.018037 (+1453148us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b54000de654. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:32.018192 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54816640}
I20260709 13:00:31.984783  2300 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEARNER]: Advancing to term 21
I20260709 13:00:31.941437  9403 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:31.986260  9399 consensus_queue.cc:1048] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:00:31.944195  9404 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:00:31.993283  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 50294.2us
W20260709 13:00:32.026909  2266 leader_election.cc:336] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 2.130s (SENT)
I20260709 13:00:31.968060  9097 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:31.997040  9413 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:31.999312  9325 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:32.000232  9370 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:32.000690  8769 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:32.004595  9310 raft_consensus.cc:3055] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:00:32.006946  9374 log.cc:927] Time spent T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.875s	user 0.001s	sys 0.001s
I20260709 13:00:31.988906  9011 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:31.989334  9257 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:31.960237  9378 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:32.009553  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.980576  9256 consensus_queue.cc:1059] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 13:00:32.011358  1581 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:32.028484  9292 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.012758  9182 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.974788  9339 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:32.023444  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:32.023496  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:32.029835  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:32.094368  1539 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:32.095433  1535 raft_consensus.cc:1240] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:32.055200  9413 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.057346  9181 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:32.077360  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 66088.4us
I20260709 13:00:32.098114  1581 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:32.099395  1581 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:32.012264  9372 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:32.077754  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.058609  9310 raft_consensus.cc:740] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 13:00:32.034199  2266 leader_election.cc:336] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 2.221s (SENT)
I20260709 13:00:32.094131  1537 raft_consensus.cc:2468] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 8.
I20260709 13:00:32.100901  1581 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:32.119951  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:32.130095  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.988950  9377 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:32.072822  9022 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.133117  1690 raft_consensus.cc:1275] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:00:32.136889  2267 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:32.135283  2266 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:32.138749  1581 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:32.144862  1581 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:32.146435  1685 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 25. Current term is 26. Ops: []
W20260709 13:00:32.146859  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 250344us
I20260709 13:00:32.147500  1654 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:32.094097  9293 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:00:32.153244  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.057536  9410 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:32.129036  9256 consensus_queue.cc:1243] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 log is divergent from this leader: its last log entry 23.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
W20260709 13:00:32.139415  9364 consensus_meta.cc:287] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.689s	user 0.007s	sys 0.003s
W20260709 13:00:32.157377  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:32.162648  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.129396  9413 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:32.132119  8730 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:32.138398  9296 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:00:32.146087  9181 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:32.151284  9180 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:32.168411  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:32.163633  1654 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 13:00:32.167399  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 133244us
I20260709 13:00:32.182163  1507 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:32.154137  9372 raft_consensus.cc:2804] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:32.184043  2302 raft_consensus.cc:3055] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:00:32.272956  2302 raft_consensus.cc:740] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:32.097683  9292 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:32.262638  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 30 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:32.151479  9022 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:32.273805  2302 consensus_queue.cc:260] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:32.280944  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 109062us
I20260709 13:00:32.287740  2302 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:00:32.263545  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 118800us
I20260709 13:00:32.300971  9377 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:32.262269  9181 consensus_queue.cc:1048] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:00:32.255745  9293 raft_consensus.cc:2804] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:32.306627  1581 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:32.267035  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 110499us
I20260709 13:00:32.157976  9414 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:32.321784  9414 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:32.322248  9414 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:32.166479  8705 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:32.190737  9372 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.290494  1654 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:32.188977  9180 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:32.307010  2302 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 15. (term mismatch)
W20260709 13:00:32.308710  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.264740  9331 raft_consensus.cc:2804] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:32.340319  9331 raft_consensus.cc:697] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:32.287448  9310 consensus_queue.cc:260] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:32.341331  9331 consensus_queue.cc:237] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:32.167987  9364 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:32.344884  9277 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:32.323068  9272 consensus_meta.cc:287] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.670s	user 0.002s	sys 0.008s
I20260709 13:00:32.345690  9272 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:32.346342  9364 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:32.348273  2296 raft_consensus.cc:2393] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 23: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:32.130515  9182 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:32.289491  9375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.006s	sys 0.005s
I20260709 13:00:32.318017  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:32.308701  9293 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.328370  9410 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:32.328881  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.329428  9339 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 26 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:32.366199  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:32.336751  2302 pending_rounds.cc:85] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579: Aborting all ops after (but not including) 14
I20260709 13:00:32.366816  2302 pending_rounds.cc:107] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579: Aborting uncommitted NO_OP operation due to leader change: 22.15
I20260709 13:00:32.367092  2302 raft_consensus.cc:2889] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:32.338130  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:32.367713  1534 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 21.
I20260709 13:00:32.368709  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:32.369401  1534 raft_consensus.cc:2393] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 25: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:32.370162  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:32.339368  9181 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:32.356858  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:32.332522  9378 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:32.367044  1611 raft_consensus.cc:2410] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for term 22 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 13:00:32.349061  9180 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:32.357568  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:32.341259  9310 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:32.335260  9372 raft_consensus.cc:3060] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:32.354310  9375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.006s	sys 0.005s
I20260709 13:00:32.340652  9022 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:32.365790  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:32.337728  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:32.386435  1537 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:00:32.348847  1655 connection.cc:256] RPC call timeout handler was delayed by -1.7677233539999975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
I20260709 13:00:32.367637  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:32.387388  1614 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 18.
I20260709 13:00:32.370680  1534 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:32.383950  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:32.388311  1615 raft_consensus.cc:2368] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for earlier term 25. Current term is 26.
I20260709 13:00:32.371074  9181 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:32.394716  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.395304  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:32.394781  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:32.361632  9293 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:32.389709  1542 raft_consensus.cc:1275] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:00:32.392354  2300 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [term 21 LEARNER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:00:32.397233  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:32.402748  9181 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:32.405671  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:32.429654  1616 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:32.406394  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:32.407083  1614 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 25. Current term is 26. Ops: [25.18-25.18]
I20260709 13:00:32.370630  9257 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:32.430729  2298 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:32.408422  1534 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 23.
I20260709 13:00:32.408618  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:32.409288  1615 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 28. Current term is 29. Ops: []
W20260709 13:00:32.410310  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.410928  1505 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:32.383807  9011 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:32.416024  9414 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:32.362589  9377 consensus_queue.cc:1059] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:00:32.427598  1539 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 22.
I20260709 13:00:32.445007  1541 raft_consensus.cc:1240] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:32.414724  9427 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:32.432845  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:32.445335  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:32.433349  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 13:00:32.446450  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.444389  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:32.446440  1534 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:32.447233  1582 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:32.445109  8730 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.447312  1614 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 20.
I20260709 13:00:32.418839  8769 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:32.463573  9362 raft_consensus.cc:3055] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:00:32.464067  9362 raft_consensus.cc:740] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:32.434484  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:32.466826  1611 raft_consensus.cc:2410] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:00:32.433619  2267 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:32.442680  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 152273us
I20260709 13:00:32.441413  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:32.467833  2267 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:32.426023  9392 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.455771  1613 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 18.
I20260709 13:00:32.458705  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:32.469388  1608 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 15.
I20260709 13:00:32.433411  1537 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:00:32.470651  1582 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:32.430204  9272 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:32.475896  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:32.476504  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:32.477571  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:32.478035  1537 raft_consensus.cc:2468] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 8.
I20260709 13:00:32.478854  1534 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 25.
I20260709 13:00:32.479899  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:32.426680  9375 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:32.480883  9364 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:00:32.486120  9182 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:32.486027  9277 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:32.445299  9304 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.487226  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:32.481653  9377 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:32.505220  2298 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 22.
I20260709 13:00:32.444368  9378 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:32.511693  1690 raft_consensus.cc:1275] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:00:32.512794  9364 raft_consensus.cc:697] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 23 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:32.512954  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:32.513525  1690 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:32.513787  9364 consensus_queue.cc:237] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:32.514510  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:32.515023  1690 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:32.517072  9277 raft_consensus.cc:697] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 22 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:32.518400  9414 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:32.518082  9277 consensus_queue.cc:237] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:32.519068  9362 consensus_queue.cc:260] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:32.488312  9392 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:32.457687  9352 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.521265  9352 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:32.523447  9352 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:32.457954  9339 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:32.524170  9339 raft_consensus.cc:697] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:32.525820  9339 consensus_queue.cc:237] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:32.486068  9430 log.cc:927] Time spent T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:00:32.501243  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:32.529795  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:32.530879  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:32.500370  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:32.532147  1613 raft_consensus.cc:2410] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:00:32.466184  8730 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:32.472136  9427 raft_consensus.cc:697] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:32.524631  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:32.490638  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:32.491125  1616 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 21.
I20260709 13:00:32.539765  1608 raft_consensus.cc:2393] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 17: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:32.510146  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:32.534626  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:32.541289  2298 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 13:00:32.538909  1614 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 22.
W20260709 13:00:32.554710  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.555094  1613 raft_consensus.cc:1240] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 16. Current term is 17. Ops: []
W20260709 13:00:32.557148  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:32.559237  9403 consensus_meta.cc:287] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.529s	user 0.005s	sys 0.005s
I20260709 13:00:32.558849  9427 consensus_queue.cc:237] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:32.559772  9403 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:32.525182  9304 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:32.562516  9097 consensus_meta.cc:287] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.532s	user 0.008s	sys 0.000s
I20260709 13:00:32.564184  9304 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:32.578519  9181 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:32.591327  1690 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 23.
I20260709 13:00:32.554662  9182 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:32.592327  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:32.593408  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:32.593575  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 135523us
W20260709 13:00:32.594154  1655 connection.cc:256] RPC call timeout handler was delayed by -1.5831666680000467s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2106s for a response
W20260709 13:00:32.594477  1655 connection.cc:256] RPC call timeout handler was delayed by -1.5057294759999991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16810000000000003s for a response
W20260709 13:00:32.594753  1655 connection.cc:256] RPC call timeout handler was delayed by -1.5011653469999828s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
W20260709 13:00:32.595175  1655 connection.cc:256] RPC call timeout handler was delayed by -1.2084508690000462s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23670000000000002s for a response
I20260709 13:00:32.596239  1655 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:32.603374  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:32.604569  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:32.602774  1617 raft_consensus.cc:2393] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 21: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:32.601064  9395 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.607261  8730 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:32.607664  1608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:36136
I20260709 13:00:32.608232  1608 raft_consensus.cc:606] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:32.608562  1608 raft_consensus.cc:614] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:32.612869  1533 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 22. Current term is 23. Ops: []
I20260709 13:00:32.614048  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 13:00:32.614653  9393 log.cc:927] Time spent T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 1.174s	user 0.000s	sys 0.004s
I20260709 13:00:32.615257  9372 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:32.616079  1537 raft_consensus.cc:1275] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:00:32.616220  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4571) took 2226 ms. Trace:
I20260709 13:00:32.616740  9292 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:32.616667  1538 rpcz_store.cc:276] 0709 13:00:30.390247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.031088 (+640841us) service_pool.cc:224] Handling call
0709 13:00:31.031427 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:31.031759 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:00:31.270313 (+238554us) log.cc:844] Serialized 14 byte log entry
0709 13:00:31.394069 (+123756us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:31.410925 (+ 16856us) log.cc:844] Serialized 26 byte log entry
0709 13:00:31.411114 (+   189us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:31.411154 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.411243 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:32.614071 (+1202828us) spinlock_profiling.cc:243] Waited 9.75 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 13:00:32.615949 (+  1878us) raft_consensus.cc:1685] finished
0709 13:00:32.616042 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.616167 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":310579,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":3548,"raft.queue_time_us":39227,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":3232,"spinlock_wait_cycles":22419328,"thread_start_us":272701,"threads_started":2,"wal-append.queue_time_us":104934}
I20260709 13:00:32.619078  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:32.619741  1538 raft_consensus.cc:2368] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 17. Current term is 18.
I20260709 13:00:32.619940  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1152) took 1469 ms. Trace:
I20260709 13:00:32.620448  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:32.616809  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:32.621573  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:32.622932  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:32.623690  1539 raft_consensus.cc:2410] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:00:32.617336  1534 raft_consensus.cc:1240] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:32.620342  1685 rpcz_store.cc:276] 0709 13:00:31.150034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.178999 (+ 28965us) service_pool.cc:224] Handling call
0709 13:00:31.224427 (+ 45428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.146868 (+922441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.619700 (+472832us) spinlock_profiling.cc:243] Waited 922 ms on lock 0x7b54002297d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:32.619878 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2120187776}
W20260709 13:00:32.621915  9404 consensus_meta.cc:287] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.564s	user 0.005s	sys 0.005s
I20260709 13:00:32.626273  9404 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:32.615173  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:32.628639  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4570) took 3186 ms. Trace:
I20260709 13:00:32.629769  9424 raft_consensus.cc:3055] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:00:32.630165  9257 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:32.629086  1540 rpcz_store.cc:276] 0709 13:00:29.442694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.330203 (+887509us) service_pool.cc:224] Handling call
0709 13:00:30.381095 (+ 50892us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:30.480653 (+ 99558us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:00:30.485147 (+  4494us) log.cc:844] Serialized 14 byte log entry
0709 13:00:30.715058 (+229911us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:30.715112 (+    54us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:00:30.715151 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.628370 (+1913219us) spinlock_profiling.cc:243] Waited 99.3 ms on lock 0x7b540045c754. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:32.628419 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:32.628573 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33347,"prepare.queue_time_us":13787,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":33699,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":97,"spinlock_wait_cycles":228331392,"thread_start_us":196173,"threads_started":1,"wal-append.queue_time_us":326466,"wal-append.run_cpu_time_us":2058,"wal-append.run_wall_time_us":1195945}
I20260709 13:00:32.631250  1688 raft_consensus.cc:2368] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 17. Current term is 18.
I20260709 13:00:32.632791  9413 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:32.633970  9404 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:32.616439  2297 raft_consensus.cc:2393] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 9: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:32.634946  9413 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:32.635520  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 3785) took 2417 ms. Trace:
I20260709 13:00:32.635893  1610 rpcz_store.cc:276] 0709 13:00:30.218188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.228587 (+ 10399us) service_pool.cc:224] Handling call
0709 13:00:32.635304 (+2406717us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b54002a62d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:32.635445 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3889537920}
I20260709 13:00:32.499449  9375 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:32.642584  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.642369  2266 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:32.650049  2266 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:32.650421  1533 raft_consensus.cc:1275] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:00:32.629148  9403 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:32.653283  2266 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:32.651283  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 55153.3us
I20260709 13:00:32.653532  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:32.656427  1690 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:32.656870  1581 leader_election.cc:400] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 17. Current term is 18.
I20260709 13:00:32.657289  1581 leader_election.cc:403] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:00:32.644809  8730 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.630164  9424 raft_consensus.cc:740] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 24 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:32.650447  9226 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:32.664213  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:32.655925  1655 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:32.673667  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.689085  1540 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 22: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:32.653308  9413 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:32.653724  8705 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:00:32.693861  1690 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 22.
W20260709 13:00:32.696070  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.699211  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:32.607218  9395 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:32.647114  9327 consensus_queue.cc:1059] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.015s
I20260709 13:00:32.664989  9377 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:32.705708  1682 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 23.
I20260709 13:00:32.683670  9277 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:32.692294  9427 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:32.722942  1655 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:32.722698  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 252133us
I20260709 13:00:32.656020  9304 consensus_queue.cc:1059] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.042s
I20260709 13:00:32.731624  1655 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:32.733130  9327 raft_consensus.cc:3055] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:00:32.733582  9327 raft_consensus.cc:740] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:32.734491  9327 consensus_queue.cc:260] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:32.741339  9403 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:00:32.742125  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.663923  8730 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:32.728328  8627 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:32.764765  1655 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:32.767225  1655 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:32.729650  1582 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:32.697153  9226 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:32.691974  9234 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
W20260709 13:00:32.775372  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.736833  9327 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:32.688217  9352 consensus_queue.cc:1059] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:00:32.781243  1655 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:32.782555  1682 raft_consensus.cc:1275] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:32.792593  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:32.793365  1540 raft_consensus.cc:3060] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:32.730034  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:32.795109  1690 raft_consensus.cc:2393] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 24: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:32.759294  9372 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:32.752396  9395 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:32.760792  8730 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:32.756290  9181 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:32.773666  9427 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:32.780792  9339 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:32.784868  9226 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:00:32.824335  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 171141us
I20260709 13:00:32.773378  9180 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:32.785799  9011 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.788652  9257 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:32.786777  9331 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.833853  2266 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:32.859333  1540 raft_consensus.cc:2468] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 9.
I20260709 13:00:32.810041  1655 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:32.829878  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 138335us
I20260709 13:00:32.812731  8993 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:00:32.865639  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 136088us
I20260709 13:00:32.865911  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:32.754452  9424 consensus_queue.cc:260] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:32.847134  9181 raft_consensus.cc:3055] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:00:32.864053  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 55177.4us
I20260709 13:00:32.873364  2266 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:32.873776  1655 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:32.874547  1655 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:32.866997  1582 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:32.863600  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:32.814975  1690 raft_consensus.cc:1240] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:32.875272  1534 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 13:00:32.868005  2267 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:32.869086  1533 raft_consensus.cc:2393] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 21: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:32.864603  1610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:36136
I20260709 13:00:32.877179  1610 raft_consensus.cc:606] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:32.877525  1610 raft_consensus.cc:614] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:32.877504  1581 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:32.878079  8993 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:00:32.878609  8993 raft_consensus.cc:697] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 25 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:32.879439  8993 consensus_queue.cc:237] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:32.880625  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:32.854206  8627 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:32.882496  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:32.884369  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:32.885823  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.886931  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:32.887658  1539 raft_consensus.cc:2393] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 18: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:32.858678  9423 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:32.858530  9407 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:32.902710  1582 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:32.872041  8705 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:32.873910  9277 raft_consensus.cc:697] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 21 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:32.871273  9339 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:32.903141  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:32.845685  9437 consensus_queue.cc:1048] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:00:32.876078  9181 raft_consensus.cc:740] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:32.859858  9331 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:32.891942   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:32.848517  9011 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:32.969339  1610 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 23 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 22. Current term is 23. Ops: []
I20260709 13:00:32.886945  9257 raft_consensus.cc:2804] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:32.969816  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:32.970602  1616 raft_consensus.cc:1240] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 13:00:33.023161  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.005285  1538 raft_consensus.cc:2393] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 18: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:32.886533  8627 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:33.037875  1608 raft_consensus.cc:2393] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 19: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:33.038604  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:33.033898  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:32.978734  9442 log.cc:927] Time spent T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
W20260709 13:00:32.970770  9441 log.cc:927] Time spent T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:00:32.942199  9446 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:32.996660  9375 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:32.907135  9368 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:33.026522  9339 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.907744  9364 raft_consensus.cc:2804] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:32.909816  9424 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:33.065620  1537 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:32.962733  9449 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.970106  9304 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:00:33.070711  9395 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.079892  9446 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:33.125797  9339 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:33.078116  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:33.034312  9257 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.983814  9180 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:33.079144  1534 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:32.942742  9423 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:32.980962  9445 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.140947  9304 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:33.072108  9293 consensus_meta.cc:287] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.639s	user 0.001s	sys 0.009s
I20260709 13:00:33.047506  8627 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:00:33.167439  1583 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 1.704s (SENT) [suppressed 25 similar messages]
I20260709 13:00:32.969864  9407 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:32.972800  9451 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.182s
I20260709 13:00:33.205837  2298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32794 (request call id 1081) took 1021 ms. Trace:
I20260709 13:00:33.193717  9403 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:00:32.962049  9234 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:33.177170  9277 consensus_queue.cc:237] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:33.206271  2298 rpcz_store.cc:276] 0709 13:00:32.184833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.541990 (+357157us) service_pool.cc:224] Handling call
0709 13:00:32.583177 (+ 41187us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:32.583571 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.583603 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:32.590985 (+  7382us) log.cc:844] Serialized 26 byte log entry
0709 13:00:32.789865 (+198880us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:32.789907 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.789972 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:33.205618 (+415646us) raft_consensus.cc:1685] finished
0709 13:00:33.205639 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.205781 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":513,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":6796,"thread_start_us":167420,"threads_started":1,"wal-append.queue_time_us":243462}
I20260709 13:00:33.179268  9257 raft_consensus.cc:3060] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:33.141281  9364 raft_consensus.cc:697] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 9 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:33.249841  9364 consensus_queue.cc:237] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:33.252827  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:33.254134  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:33.205030  9293 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:33.256626  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:33.257272  1613 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:33.257957  9293 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:33.199488  9445 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:33.260360  9445 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:33.262353  9407 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:33.269537  1613 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 22.
I20260709 13:00:33.172662  9395 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:33.271266  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:33.272625  9395 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:33.272954  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:33.273505  1609 raft_consensus.cc:2368] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for earlier term 11. Current term is 12.
I20260709 13:00:33.174156  9446 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:33.273633  1613 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:33.202215  9292 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:33.221568  2267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.075451  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:33.288901  1610 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:33.222909  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:33.200345  9304 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:00:33.226231  9427 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:33.205143  9146 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:33.141723  9181 consensus_queue.cc:260] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:33.230901  9226 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:33.155143  9449 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:33.234563  9331 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:33.236743  9423 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:33.237399  1534 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 22.
I20260709 13:00:33.244064  8627 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:33.248739  9459 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:33.220388  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.291846  1613 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 22.
I20260709 13:00:33.304814  9459 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:33.307376  9459 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:33.309486  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:33.310496  1613 raft_consensus.cc:2393] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 23: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:33.311514  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:33.312175  1613 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 24.
I20260709 13:00:33.316290  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:33.304260  8627 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:33.318048  9226 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:33.323230  1610 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
W20260709 13:00:33.325259  1508 leader_election.cc:336] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 1.534s (SENT)
W20260709 13:00:33.336544  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 169145us
I20260709 13:00:33.337867  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:33.293136  9292 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:33.346392  1616 raft_consensus.cc:2410] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 25 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
W20260709 13:00:33.356175  1508 leader_election.cc:336] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 1.568s (SENT)
W20260709 13:00:33.357167  9453 log.cc:927] Time spent T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:00:33.359074  1690 raft_consensus.cc:1240] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:33.361589  9449 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:33.359970  9257 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:33.374541  9011 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:33.386301  9377 consensus_meta.cc:287] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.659s	user 0.011s	sys 0.000s
I20260709 13:00:33.421994  2303 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32802 (request call id 783) took 3579 ms. Trace:
I20260709 13:00:33.422508  2303 rpcz_store.cc:276] 0709 13:00:29.842317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.197291 (+354974us) service_pool.cc:224] Handling call
0709 13:00:30.230708 (+ 33417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.628956 (+1398248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.421714 (+1792758us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54009b2654. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:33.421923 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3122576768}
I20260709 13:00:33.423950  9377 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 17. Current term is 18.
I20260709 13:00:33.425318  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 3635) took 1087 ms. Trace:
I20260709 13:00:33.426328  9257 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:33.427853  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4576) took 2978 ms. Trace:
W20260709 13:00:33.428539  9386 log.cc:927] Time spent T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 1.964s	user 0.008s	sys 0.002s
I20260709 13:00:33.429342  9292 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:33.429692  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 3629) took 2731 ms. Trace:
I20260709 13:00:33.430050  1536 rpcz_store.cc:276] 0709 13:00:30.698503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.069422 (+370919us) service_pool.cc:224] Handling call
0709 13:00:31.069764 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:31.104172 (+ 34408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:31.104203 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:31.123400 (+ 19197us) log.cc:844] Serialized 26 byte log entry
0709 13:00:31.347201 (+223801us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:00:31.347238 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:31.964874 (+617636us) spinlock_profiling.cc:243] Waited 34 ms on lock 0x7b5400312ed4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:31.964928 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:33.381538 (+1416610us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 13:00:33.429476 (+ 47938us) raft_consensus.cc:1685] finished
0709 13:00:33.429498 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.429612 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":304,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":16432,"spinlock_wait_cycles":145510016,"thread_start_us":167163,"threads_started":1,"wal-append.queue_time_us":307028}
I20260709 13:00:33.429368  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 4765) took 1777 ms. Trace:
I20260709 13:00:33.435961  1689 rpcz_store.cc:276] 0709 13:00:31.651589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.651709 (+   120us) service_pool.cc:224] Handling call
0709 13:00:33.429144 (+1777435us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b5400287dd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:33.429280 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":355115776}
I20260709 13:00:33.425810  1541 rpcz_store.cc:276] 0709 13:00:32.337518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.337650 (+   132us) service_pool.cc:224] Handling call
0709 13:00:32.444848 (+107198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.449294 (+  4446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.425097 (+975803us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54000749d0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:33.425255 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242048384}
I20260709 13:00:33.438839  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:33.423780  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:33.440984  1690 raft_consensus.cc:1240] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:00:33.428298  1542 rpcz_store.cc:276] 0709 13:00:30.449338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.043800 (+594462us) service_pool.cc:224] Handling call
0709 13:00:31.044132 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.425871 (+1381739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.427586 (+1001715us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400445f54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:33.427786 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3094010624}
W20260709 13:00:33.423677  9327 consensus_meta.cc:287] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.629s	user 0.009s	sys 0.000s
I20260709 13:00:33.447381  1583 leader_election.cc:400] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 17. Current term is 18.
I20260709 13:00:33.452176  1613 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 18.
I20260709 13:00:33.456599  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:33.457566  1690 raft_consensus.cc:2410] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 26 because replica has last-logged OpId of term: 25 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 19.
I20260709 13:00:33.458046  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:33.459399  2303 raft_consensus.cc:2393] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 12: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:33.459914  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:33.461174  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:33.461843  1690 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 13:00:33.448715  9292 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.463153  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:33.470542  1690 raft_consensus.cc:2368] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 21. Current term is 22.
I20260709 13:00:33.472675  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:33.473321  2303 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:33.474686  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:33.476409  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:33.478734  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:33.479167  1690 raft_consensus.cc:2393] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 22: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:33.479861  1684 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 13:00:33.453640  9339 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:33.481956  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:33.483098  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:33.489634  9304 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 30 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:33.494421  9446 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:33.495430  2298 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 13:00:33.495712  1608 raft_consensus.cc:2393] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 17: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:33.497677  1690 raft_consensus.cc:1275] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:00:33.496057  2303 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 22.
I20260709 13:00:33.504136  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:33.504734  2303 raft_consensus.cc:2393] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 22: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:33.496086  9398 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.503360  9368 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:33.507453  1689 raft_consensus.cc:1275] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:00:33.508374  1684 raft_consensus.cc:2393] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 22: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:33.506039  9398 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:33.510859  9339 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:33.513309  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:33.513191  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:33.470497  9292 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:33.514237  1690 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 23.
I20260709 13:00:33.517782  2300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32794 (request call id 1082) took 1332 ms. Trace:
W20260709 13:00:33.518069  2299 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32788 (request call id 728) took 3195 ms (client timeout 2964 ms). Trace:
I20260709 13:00:33.518301  2300 rpcz_store.cc:276] 0709 13:00:32.185056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.569733 (+384677us) service_pool.cc:224] Handling call
0709 13:00:32.590974 (+ 21241us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:32.591362 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.591395 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:32.591857 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:00:33.325062 (+733205us) spinlock_profiling.cc:243] Waited 4.04 ms on lock 0x7b1800315b80. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf10d1 00007fc85d00ca0f
0709 13:00:33.431170 (+106108us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:33.431213 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.431281 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:33.517496 (+ 86215us) raft_consensus.cc:1685] finished
0709 13:00:33.517517 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.517724 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":113,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":7900,"spinlock_wait_cycles":9289472,"thread_start_us":105916,"threads_started":1,"wal-append.queue_time_us":884685}
W20260709 13:00:33.518445  2299 rpcz_store.cc:269] 0709 13:00:30.321015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.500000 (+178985us) service_pool.cc:224] Handling call
0709 13:00:33.515685 (+3015685us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54008e9754. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:33.515835 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2977856768}
I20260709 13:00:33.511157  9352 raft_consensus.cc:3055] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:00:33.518617  1583 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:33.522250  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:33.530432  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:33.531243  2303 raft_consensus.cc:2393] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 21: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:33.531132  1583 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:33.532058  9424 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:33.533038  9424 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:33.535985  1583 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:33.537665  1690 raft_consensus.cc:1275] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:00:33.537776  9088 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:33.538290  9424 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:33.539301  9304 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 30 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:33.529294  9352 raft_consensus.cc:740] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:33.540982  1583 leader_election.cc:400] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 21. Current term is 22.
I20260709 13:00:33.542690  1583 leader_election.cc:403] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:00:33.543931  2300 raft_consensus.cc:1240] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 21 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 20. Current term is 21. Ops: [20.17-20.17]
I20260709 13:00:33.544637  2300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32794 (request call id 1083) took 1359 ms. Trace:
I20260709 13:00:33.544870  1583 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:33.521499  9446 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:33.542514  9424 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.560971  9424 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:33.564841  9254 raft_consensus.cc:3055] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:33.565342  9254 raft_consensus.cc:740] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:33.566216  9254 consensus_queue.cc:260] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:33.567445  9254 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:33.556356  9292 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:33.544979  2300 rpcz_store.cc:276] 0709 13:00:32.185293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.529638 (+1344345us) service_pool.cc:224] Handling call
0709 13:00:33.543646 (+ 14008us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:33.544341 (+   695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.544581 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:33.570597  9465 log.cc:927] Time spent T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:00:33.572186  2302 raft_consensus.cc:1275] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:33.577611  1582 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:33.546811  9304 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:33.546890  9377 raft_consensus.cc:2804] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:33.583070  9377 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.583491  9377 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:33.584728  9392 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:33.547399  9352 consensus_queue.cc:260] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:33.547865  9235 consensus_queue.cc:1048] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:00:33.575184  1507 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:33.551029  9463 log.cc:927] Time spent T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:00:33.553448  2299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32794 (request call id 1084) took 1196 ms. Trace:
I20260709 13:00:33.601258  2299 rpcz_store.cc:276] 0709 13:00:32.357231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.531687 (+1174456us) service_pool.cc:224] Handling call
0709 13:00:33.552866 (+ 21179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:33.553074 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:33.553100 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:33.553158 (+    58us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:00:33.553189 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.553246 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.553359 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:33.554153  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:33.578910  1582 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:33.602998  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:33.603655  1683 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 23.
I20260709 13:00:33.603740  1582 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:33.604501  9423 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:00:33.605159  1582 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:33.605334  9423 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:33.605815  9423 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:33.606195  9423 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:33.606478  1582 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:33.579519  9459 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:33.592057  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:33.609449  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:33.604557  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:33.607651  1582 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:33.592877  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 45253.3us
I20260709 13:00:33.599768  2300 raft_consensus.cc:1240] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:33.611584  9455 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:00:33.615727  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:33.616921  1683 raft_consensus.cc:2393] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 9: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:33.618254  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:33.618394  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3967) took 1125 ms. Trace:
I20260709 13:00:33.618799  1682 rpcz_store.cc:276] 0709 13:00:32.492970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.725628 (+232658us) service_pool.cc:224] Handling call
0709 13:00:32.726437 (+   809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.791027 (+ 64590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.618177 (+827150us) spinlock_profiling.cc:243] Waited 38.7 ms on lock 0x7b54002d00d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:33.618339 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89096960}
I20260709 13:00:33.619663  1683 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:00:33.622547  2269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.622795  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:33.623895  2269 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:33.624261  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:33.625521  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:33.625679  1682 raft_consensus.cc:1240] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:33.626832  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:33.596590  9088 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.034s
I20260709 13:00:33.632503  1615 raft_consensus.cc:2393] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 27: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:33.633340  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:33.634004  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 1118) took 1221 ms. Trace:
I20260709 13:00:33.634400  1615 rpcz_store.cc:276] 0709 13:00:32.412132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.501798 (+ 89666us) service_pool.cc:224] Handling call
0709 13:00:33.633795 (+1131997us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54002fec54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:33.633923 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2514380672}
I20260709 13:00:33.634662  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:33.635349  1683 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 9.
I20260709 13:00:33.634135  1689 raft_consensus.cc:2393] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 9: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:33.636281  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:33.607879  9011 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:33.637089  9011 raft_consensus.cc:697] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:33.635545  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:33.591024  9385 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 13:00:33.637352  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:33.612203  9352 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:33.638037  9011 consensus_queue.cc:237] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:33.637992  1615 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 17.
I20260709 13:00:33.640635  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:33.641268  1615 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 13:00:33.642120  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:33.642249  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:33.642905  1615 raft_consensus.cc:2393] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 27: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:33.643198  1616 raft_consensus.cc:2410] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 29 because replica has last-logged OpId of term: 28 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 16.
I20260709 13:00:33.638877  1689 raft_consensus.cc:2393] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 18: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:33.644369  1616 raft_consensus.cc:1240] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 20. Current term is 21. Ops: [20.17-20.17]
I20260709 13:00:33.627445  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:33.646551  1682 raft_consensus.cc:2393] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 9: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:33.617085  2302 raft_consensus.cc:1275] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:00:33.646801  1616 raft_consensus.cc:1240] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:33.647208  9380 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.647925  2302 raft_consensus.cc:1240] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:33.647706  9380 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:33.613807  9234 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:33.648811  9234 raft_consensus.cc:697] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:33.644842  9459 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:33.650440  1689 raft_consensus.cc:1240] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 22. Current term is 23. Ops: []
I20260709 13:00:33.635578  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:33.655174  2269 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:33.657380  1613 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 26. Current term is 27. Ops: [26.19-26.19]
I20260709 13:00:33.658150  2269 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:33.648183  1616 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:00:33.595431  9456 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:33.627470  1610 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 21.
W20260709 13:00:33.668488  1508 leader_election.cc:336] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 1.698s (SENT)
I20260709 13:00:33.674638  2269 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:33.674713  1508 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:33.673617  1616 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 30 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 29. Current term is 30. Ops: [29.18-29.18]
I20260709 13:00:33.673432  9144 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:33.675985  2269 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:33.676661  9368 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:00:33.647279  9370 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 23 current term: 23 is higher.
I20260709 13:00:33.676715  1615 raft_consensus.cc:1275] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:00:33.676712  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 1102) took 1320 ms. Trace:
I20260709 13:00:33.678514  1617 rpcz_store.cc:276] 0709 13:00:32.356411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.356577 (+   166us) service_pool.cc:224] Handling call
0709 13:00:33.676529 (+1319952us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54000023d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:33.676657 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532480768}
I20260709 13:00:33.684806  2269 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:33.690714  2269 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:33.690469  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1224) took 2223 ms. Trace:
I20260709 13:00:33.688354  1583 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:33.693128  1535 rpcz_store.cc:276] 0709 13:00:31.467574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.469598 (+  2024us) service_pool.cc:224] Handling call
0709 13:00:31.469916 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.095831 (+625915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.690235 (+1594404us) spinlock_profiling.cc:243] Waited 625 ms on lock 0x7b54003133d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:33.690408 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1438289792}
I20260709 13:00:33.699158  9449 raft_consensus.cc:2804] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:33.699368  9455 consensus_queue.cc:1048] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:00:33.700340  9466 consensus_queue.cc:1059] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:33.701311  9466 raft_consensus.cc:3055] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:33.701642  9466 raft_consensus.cc:740] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:33.702643  9466 consensus_queue.cc:260] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:33.699678  9449 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:33.704159  9449 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:33.708159  1614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 1123) took 1291 ms (client timeout 1631 ms). Trace:
I20260709 13:00:33.708340  1689 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
W20260709 13:00:33.704092  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.709937  1583 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:33.711408  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 13:00:33.708673  1614 rpcz_store.cc:269] 0709 13:00:32.416687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.453760 (+ 37073us) service_pool.cc:224] Handling call
0709 13:00:33.707981 (+1254221us) spinlock_profiling.cc:243] Waited 36.2 ms on lock 0x7b54004470d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:33.708097 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83318528}
I20260709 13:00:33.678013  9285 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:00:33.676007  9144 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:33.682251  9327 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:00:33.722402  9226 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.683146  9146 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:00:33.722025  9144 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:33.682719  9388 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:00:33.731246  1616 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 13:00:33.732162  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:33.695096  9399 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:33.680400  9456 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:33.713421  9182 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:33.710973  9466 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:33.747898  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:33.791932  1508 leader_election.cc:336] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 1.762s (SENT)
I20260709 13:00:33.798493  1616 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 25.
W20260709 13:00:33.747725  1686 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 4764) took 2098 ms (client timeout 1704 ms). Trace:
I20260709 13:00:33.750551  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:33.750929  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:33.796947  2301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32794 (request call id 1071) took 2685 ms. Trace:
W20260709 13:00:33.800011  1686 rpcz_store.cc:269] 0709 13:00:31.649541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.649657 (+   116us) service_pool.cc:224] Handling call
0709 13:00:33.732058 (+2082401us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b5800190898. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ceee 0000000000375939 00007fc861fa01e0 00007fc8620690c4 00007fc862069131 00007fc8620170a0 00007fc862016984 00007fc85b5916d4 00007fc85b591662
0709 13:00:33.747646 (+ 15588us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4361856}
I20260709 13:00:33.713822  9459 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:33.802151  1614 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 21.
I20260709 13:00:33.800040  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:33.804560  1616 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:00:33.741520  9213 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.299s	user 0.007s	sys 0.015s
I20260709 13:00:33.800529  2301 rpcz_store.cc:276] 0709 13:00:31.111646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.453657 (+342011us) service_pool.cc:224] Handling call
0709 13:00:31.537384 (+ 83727us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:33.514779 (+1977395us) spinlock_profiling.cc:243] Waited 5.25 ms on lock 0x7b54006a25a0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85cfcc858 00007fc85d050e9d 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c
0709 13:00:33.514834 (+    55us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:33.514855 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:33.517232 (+  2377us) log.cc:844] Serialized 26 byte log entry
0709 13:00:33.592660 (+ 75428us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:00:33.592694 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.592772 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:33.752415 (+159643us) raft_consensus.cc:1685] finished
0709 13:00:33.752438 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.796863 (+ 44425us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91589,"raft.queue_time_us":90712,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":11736,"spinlock_wait_cycles":12068608,"thread_start_us":75010,"threads_started":1,"wal-append.queue_time_us":162524}
I20260709 13:00:33.710994  9364 consensus_queue.cc:1059] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.082s
I20260709 13:00:33.819594  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:33.811590  9213 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.377s	user 0.007s	sys 0.015s
I20260709 13:00:33.808339  9182 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.794811  9296 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.748684  9310 consensus_queue.cc:1059] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.070s
I20260709 13:00:33.732650  8627 consensus_queue.cc:1048] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.084s
I20260709 13:00:33.831346  1614 raft_consensus.cc:2393] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 26: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:33.823436  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:33.833607  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 30 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:33.725155  9377 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:33.839900  2267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.741644  9226 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:33.747434  8714 consensus_queue.cc:1048] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.076s
I20260709 13:00:33.844492  1616 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 25.
I20260709 13:00:33.820591  9304 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 21. Current term is 22.
I20260709 13:00:33.839679  9182 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:33.863271  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:33.790697  9234 consensus_queue.cc:237] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:33.865633  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:33.870777  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:33.870888  1686 raft_consensus.cc:2376] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 23. Re-sending same reply.
I20260709 13:00:33.871860  1690 raft_consensus.cc:2393] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 18: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:33.869122  9377 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:33.862254  9213 raft_consensus.cc:3055] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:33.882202  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:33.883622  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:33.846458  9296 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:33.884280  1690 raft_consensus.cc:2376] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 22. Re-sending same reply.
I20260709 13:00:33.884848  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:33.886741  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:33.884852  1686 raft_consensus.cc:2376] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 23. Re-sending same reply.
I20260709 13:00:33.887985  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:33.888695  1690 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:33.889238  1654 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:33.889657  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:33.890350  1690 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 23.
I20260709 13:00:33.890790  1654 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:33.891309  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:33.893721  1654 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:33.894147  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:33.895913  1689 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:33.896034  1654 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:33.897308  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:33.899173  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:33.899832  1615 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 13:00:33.900703  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:33.901473  1508 leader_election.cc:336] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 1.843s (SENT)
W20260709 13:00:33.904215  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.903820  1508 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:33.905061  1615 raft_consensus.cc:2393] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 18: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 13:00:33.908773  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.908622  1508 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:33.912698  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:33.913393  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:33.914485  1689 raft_consensus.cc:2393] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 18: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:33.883526  9213 raft_consensus.cc:740] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
W20260709 13:00:33.921373  2295 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32802 (request call id 788) took 3387 ms (client timeout 2112 ms). Trace:
I20260709 13:00:33.924000  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4768) took 2270 ms. Trace:
I20260709 13:00:33.925333  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:33.987388  1685 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:33.987996  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 3975) took 1486 ms. Trace:
I20260709 13:00:33.894179  9409 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:00:33.910527  1508 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:33.914844  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:33.989117  1685 rpcz_store.cc:276] 0709 13:00:32.502039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.925042 (+1423003us) service_pool.cc:224] Handling call
0709 13:00:33.987928 (+ 62886us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:33.902994  9403 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:33.926328  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 1111) took 1531 ms. Trace:
I20260709 13:00:33.988575  1691 rpcz_store.cc:276] 0709 13:00:31.653962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.011070 (+357108us) service_pool.cc:224] Handling call
0709 13:00:32.011406 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:32.011761 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:00:32.094120 (+ 82359us) log.cc:844] Serialized 14 byte log entry
0709 13:00:33.835768 (+1741648us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b18003e7580. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc85cbf94bc 00007fc859f4748b 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf123a
0709 13:00:33.835971 (+   203us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:33.836492 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 13:00:33.902823 (+ 66331us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:33.902865 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.903339 (+   474us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:33.923696 (+ 20357us) raft_consensus.cc:1685] finished
0709 13:00:33.923788 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.923935 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":260905,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":8333,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":9961,"spinlock_wait_cycles":6519168,"thread_start_us":362152,"threads_started":3,"wal-append.queue_time_us":364373,"wal-append.run_cpu_time_us":1324,"wal-append.run_wall_time_us":1065781}
I20260709 13:00:33.903308  9292 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:33.998382  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:34.001384  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:33.903908  9410 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:00:34.013164  9410 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:34.013833  9410 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:33.994756  1615 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:34.016954  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:34.018422  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:34.020889  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:34.021523  1617 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:34.024617  1533 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 17. (term mismatch)
I20260709 13:00:34.025048  1533 pending_rounds.cc:85] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 16
I20260709 13:00:34.025305  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:33.901473  9367 consensus_queue.cc:1059] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.096s
I20260709 13:00:34.026558  9367 raft_consensus.cc:3055] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:34.026932  9367 raft_consensus.cc:740] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:34.027719  9367 consensus_queue.cc:260] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:33.932904  9247 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:33.903230  8714 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.104s
I20260709 13:00:34.029054  9247 raft_consensus.cc:697] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:33.929952  9296 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:33.903385  9260 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.127s
I20260709 13:00:34.029995  9247 consensus_queue.cc:237] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:33.999624  9144 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:34.032718  9213 consensus_queue.cc:260] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:34.005932  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:34.035046  1685 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 23.
I20260709 13:00:34.036026  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 30 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:34.037197  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:34.038688  2297 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32794 (request call id 1069) took 3089 ms (client timeout 2618 ms). Trace:
I20260709 13:00:34.025267  1533 pending_rounds.cc:107] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 20.17
I20260709 13:00:34.039336  1533 raft_consensus.cc:2889] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:34.040025  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 3903) took 1074 ms. Trace:
I20260709 13:00:34.040884  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:34.040431  1608 rpcz_store.cc:276] 0709 13:00:32.965732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.038405 (+ 72673us) service_pool.cc:224] Handling call
0709 13:00:34.039839 (+1001434us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b54002a58d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:34.039969 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1049798912}
I20260709 13:00:33.928309  9449 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:34.042150  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:34.043628  9449 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 10 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:34.047598  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.047894  9451 consensus_queue.cc:1048] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:00:34.039085  2297 rpcz_store.cc:269] 0709 13:00:30.949470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.187184 (+237714us) service_pool.cc:224] Handling call
0709 13:00:32.395163 (+1207979us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b5800003c98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc8620170a0 00007fc862016984 00007fc85b5916d4 00007fc85b591662
0709 13:00:34.038482 (+1643319us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54005f0354. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:34.038623 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":510838400}
I20260709 13:00:34.049880  1581 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:34.050482  9392 consensus_queue.cc:1048] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:00:33.930178  9454 log.cc:927] Time spent T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.721s	user 0.003s	sys 0.001s
I20260709 13:00:34.051148  1581 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:33.999956  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:34.052418  1686 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:34.052826  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4598) took 1181 ms. Trace:
I20260709 13:00:33.903863  9339 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:00:33.937261  1683 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 21.
I20260709 13:00:34.058262  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:34.058974  1533 raft_consensus.cc:2368] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 21. Current term is 22.
I20260709 13:00:34.060343  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:34.061869  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:34.062275  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:33.990849  2295 rpcz_store.cc:269] 0709 13:00:30.534043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.564571 (+ 30528us) service_pool.cc:224] Handling call
0709 13:00:33.921132 (+3356561us) spinlock_profiling.cc:243] Waited 3.28 s on lock 0x7b54009a97d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:33.921294 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7537402112}
W20260709 13:00:33.942668  9475 log.cc:927] Time spent T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:00:34.063616  2266 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:34.038009  9144 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:33.999855  9268 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:34.077457  1615 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 13:00:34.005923  9423 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:33.946677  9424 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:33.990573  9327 raft_consensus.cc:697] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 24 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
W20260709 13:00:34.007136  9477 log.cc:927] Time spent T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:00:34.001546  1612 rpcz_store.cc:276] 0709 13:00:32.395105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.395221 (+   116us) service_pool.cc:224] Handling call
0709 13:00:32.475509 (+ 80288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:32.481741 (+  6232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.481773 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:32.482210 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:00:32.652850 (+170640us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:32.652895 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.652967 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:32.754201 (+101234us) raft_consensus.cc:1685] finished
0709 13:00:32.754218 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.926078 (+1171860us) spinlock_profiling.cc:243] Waited 76.8 ms on lock 0x7b5400256cd0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:33.926268 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5799,"raft.queue_time_us":6520,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":29664,"spinlock_wait_cycles":176536960,"thread_start_us":140515,"threads_started":1,"wal-append.queue_time_us":251775,"wal-append.run_cpu_time_us":1521,"wal-append.run_wall_time_us":1037987}
I20260709 13:00:33.902048  9310 consensus_queue.cc:1048] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 13:00:34.012320  9398 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:33.927839  9353 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:33.941929  9226 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:34.025537  1534 raft_consensus.cc:1275] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:34.037909  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:34.053411  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:34.053187  1540 rpcz_store.cc:276] 0709 13:00:32.871202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.872557 (+  1355us) service_pool.cc:224] Handling call
0709 13:00:32.905055 (+ 32498us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:32.905487 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.905514 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:32.905949 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 13:00:33.068511 (+162562us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:33.068556 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.068625 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:33.929567 (+860942us) spinlock_profiling.cc:243] Waited 3.83 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 13:00:34.052558 (+122991us) raft_consensus.cc:1685] finished
0709 13:00:34.052577 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.052775 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":29183,"spinlock_wait_cycles":8819584,"thread_start_us":131838,"threads_started":1,"wal-append.queue_time_us":205646}
W20260709 13:00:33.974555  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.090634  1537 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 22. Current term is 23. Ops: [22.17-22.17]
I20260709 13:00:34.090382  1686 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:34.092530  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:34.055254  1691 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 18.
I20260709 13:00:34.093930  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:34.094107  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:34.037909  1685 raft_consensus.cc:2393] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 22: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 13:00:33.995673  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 85229.2us
I20260709 13:00:34.005209  9289 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:00:33.932787  9388 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:34.068240  1608 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 22.
I20260709 13:00:34.069671  1539 raft_consensus.cc:1275] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:00:34.064764   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:34.032218  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:34.097565  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:34.079804  1609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 1104) took 1722 ms (client timeout 1755 ms). Trace:
I20260709 13:00:34.079780  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:34.083133  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:34.084157  1689 raft_consensus.cc:2410] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
W20260709 13:00:34.084194  2296 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32794 (request call id 1063) took 3193 ms (client timeout 2982 ms). Trace:
I20260709 13:00:34.084545  2300 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 23 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 22. Current term is 23. Ops: [22.17-22.17]
I20260709 13:00:34.096187  1508 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:34.052453  9304 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:00:34.098469  1609 rpcz_store.cc:269] 0709 13:00:32.357139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.357244 (+   105us) service_pool.cc:224] Handling call
0709 13:00:34.079613 (+1722369us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b5400445554. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:34.079749 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2053300608}
I20260709 13:00:34.087972  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:34.068698  8627 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:00:34.088948  2269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.056087  9403 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:34.093088  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:34.093281  1534 raft_consensus.cc:2393] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 9: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:34.132233  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:34.048439  9088 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.098867  2299 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 13:00:34.151504  1542 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:00:34.153618  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 180178us
I20260709 13:00:34.105764  1687 raft_consensus.cc:2410] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:00:34.101553  1615 raft_consensus.cc:2410] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for term 13 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:00:34.087411  9367 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:34.158020  9292 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.158339  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:34.088507  2266 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
W20260709 13:00:34.099452  2296 rpcz_store.cc:269] 0709 13:00:30.891216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.346019 (+454803us) service_pool.cc:224] Handling call
0709 13:00:34.083953 (+2737934us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54007a7e54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:34.084124 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2302539648}
I20260709 13:00:34.159606  1655 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:34.109776  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:34.112524  9310 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:00:34.115806  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:34.116681  9353 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.117229  9388 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:34.120146  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:34.077211  9257 consensus_queue.cc:1175] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" responder_term: 22 status { last_received { term: 21 index: 11 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 21. Current term is 22. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:34.052462  9392 consensus_queue.cc:1059] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:00:34.120886  9410 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:34.053606  9407 consensus_queue.cc:1059] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:00:34.125388  9327 consensus_queue.cc:237] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:34.077606  9268 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:34.078056  9450 consensus_queue.cc:1048] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:00:34.129565  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:34.131321  1581 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:34.057035  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:34.104923  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:34.198591  1690 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:34.151266  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:34.199930  1685 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:34.155865  1540 raft_consensus.cc:1275] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:00:34.161595  1612 raft_consensus.cc:2393] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 19: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:34.161065  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 3970) took 1667 ms. Trace:
I20260709 13:00:34.201586  1687 rpcz_store.cc:276] 0709 13:00:32.493768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.085026 (+1591258us) service_pool.cc:224] Handling call
0709 13:00:34.160990 (+ 75964us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:34.160455  1615 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 13:00:34.202392  1615 pending_rounds.cc:85] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f: Aborting all ops after (but not including) 14
I20260709 13:00:34.202629  1615 pending_rounds.cc:107] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 13:00:34.202844  1615 raft_consensus.cc:2889] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:34.145243  9144 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.067s
I20260709 13:00:34.164661  1682 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 22. Current term is 23. Ops: []
I20260709 13:00:34.162937  1614 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:34.103206  9485 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:34.180063  1686 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 10.
I20260709 13:00:34.217669  2269 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:34.196056  1691 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 13:00:34.163522  9339 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:34.222373  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:34.223241  1691 raft_consensus.cc:2410] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:00:34.164412  9388 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:34.224073  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:34.162427  9412 consensus_queue.cc:1059] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.043s
I20260709 13:00:34.163592  9480 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:34.229032  9480 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.229467  9480 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:34.230672  9403 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:34.205646  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 74436.1us
I20260709 13:00:34.232826  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:34.163180  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 74790.4us
I20260709 13:00:34.234477  2266 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:34.235670  2266 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:34.236487  9485 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:00:34.237186  9485 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:34.237524  9485 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.237826  9485 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:34.240423  9410 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:34.241611  2296 raft_consensus.cc:1240] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:34.206406  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:34.234033  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:34.197917  9268 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:34.243714  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:34.244846  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:34.245497  1687 raft_consensus.cc:2393] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 24: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:34.213658  1615 raft_consensus.cc:1240] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:34.163576  9385 consensus_queue.cc:1059] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:00:34.249966  1615 raft_consensus.cc:1275] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:34.221083  8705 raft_consensus.cc:2804] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:34.221689  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:34.233042  1581 leader_election.cc:400] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Vote denied by peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903) with higher term. Message: Invalid argument: T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 21. Current term is 22.
I20260709 13:00:34.250705  8705 raft_consensus.cc:697] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 10 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:34.250694  1686 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 18.
I20260709 13:00:34.251653  8705 consensus_queue.cc:237] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:34.252763  2269 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:34.253564  9457 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:34.253945  9457 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.162214  9088 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:34.254101  1581 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:34.254166  9182 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:34.255820  9088 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:34.213179  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 117072us
I20260709 13:00:34.158835  9292 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:34.165412  9353 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:34.257946  9353 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:34.254304  9457 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:00:34.260926  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.247776  9388 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:34.255853  2296 raft_consensus.cc:1240] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 10 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:34.243430  1689 raft_consensus.cc:2393] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 9: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:34.252292  1617 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 22.
I20260709 13:00:34.259637  1581 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:34.258585  9339 raft_consensus.cc:697] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 22 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:34.268350  1687 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:00:34.282985  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:34.284580  9304 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:34.270439  9480 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:34.285545  9339 consensus_queue.cc:237] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:34.286568  9480 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:34.288609  9352 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 13:00:34.258679  9392 raft_consensus.cc:3055] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:34.289814  9392 raft_consensus.cc:740] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:34.290079  1612 raft_consensus.cc:1240] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:34.290637  9392 consensus_queue.cc:260] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:34.291364  9412 raft_consensus.cc:3055] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:34.291891  9392 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:34.293874  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:34.300374  1614 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 13:00:34.272953  1685 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 17.
W20260709 13:00:34.273716  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.268875  9182 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:34.293783  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:34.303715  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:34.307960  2298 raft_consensus.cc:2393] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 17: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:34.311633  2269 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:34.271420  1690 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 13:00:34.257975  9292 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:34.313784  1608 raft_consensus.cc:1240] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:34.269896  9296 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:34.278102  9289 raft_consensus.cc:3055] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:34.344236  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:34.344386  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:34.291828  9412 raft_consensus.cc:740] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:34.331149  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:34.339156  1582 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:34.301962  9247 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.346258  1690 raft_consensus.cc:2393] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 18: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:34.347903  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:34.348898  1614 raft_consensus.cc:2393] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 18: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:34.352936  1656 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:34.362149  2301 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 26.
W20260709 13:00:34.395610  2267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.396129  1614 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 17. (term mismatch)
I20260709 13:00:34.396571  1614 pending_rounds.cc:85] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f: Aborting all ops after (but not including) 16
I20260709 13:00:34.396796  1614 pending_rounds.cc:107] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 22.17
I20260709 13:00:34.397033  1614 raft_consensus.cc:2889] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:34.293201  9377 consensus_queue.cc:1048] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.064s
W20260709 13:00:34.401242  2269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.328420  9480 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:34.403411  1656 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:34.412539  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.344178  9289 raft_consensus.cc:740] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:34.394990  9182 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:34.390342  9352 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.391377  9450 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.398600  9488 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:34.419284  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:34.439780  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:34.446497  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 339237us
I20260709 13:00:34.448635  1615 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:00:34.458300  9213 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:34.461869  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 1116) took 2050 ms. Trace:
I20260709 13:00:34.462349  1611 rpcz_store.cc:276] 0709 13:00:32.411582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.553808 (+142226us) service_pool.cc:224] Handling call
0709 13:00:32.635974 (+ 82166us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.636322 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:00:32.636655 (+   333us) log.cc:844] Serialized 14 byte log entry
0709 13:00:32.848327 (+211672us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:32.848379 (+    52us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:00:32.848433 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.848519 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.461651 (+1613132us) spinlock_profiling.cc:243] Waited 81.9 ms on lock 0x7b54002a62d0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:34.461795 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47965,"prepare.queue_time_us":177,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":29899,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":14785,"spinlock_wait_cycles":188308736,"thread_start_us":210689,"threads_started":1,"wal-append.queue_time_us":255090,"wal-append.run_cpu_time_us":1154,"wal-append.run_wall_time_us":1002637}
I20260709 13:00:34.416888  9410 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
W20260709 13:00:34.473281  9496 log.cc:927] Time spent T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:00:34.478682  1542 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 22.
I20260709 13:00:34.481587  1505 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:34.420569  9480 raft_consensus.cc:697] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:34.424703  9182 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.488242  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:34.485757  1505 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:34.395344  9247 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:34.480693  9292 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.494444  1505 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:34.447257  9352 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:34.489858  9182 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:34.486876  9494 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:00:34.522784  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:34.515728  9424 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:34.523438  1688 raft_consensus.cc:2376] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16. Re-sending same reply.
W20260709 13:00:34.523977  1688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 3968) took 2030 ms (client timeout 2177 ms). Trace:
W20260709 13:00:34.524336  1688 rpcz_store.cc:269] 0709 13:00:32.493235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.522466 (+2029231us) service_pool.cc:224] Handling call
0709 13:00:34.523923 (+  1457us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:34.525756  1688 raft_consensus.cc:1275] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:00:34.533237  9495 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:00:34.534600  9456 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:34.500635  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:34.534794  1505 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:34.494175  8627 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:00:34.515341  9368 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:34.515861  9247 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:34.497537  9289 consensus_queue.cc:260] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:34.517927  9011 raft_consensus.cc:3055] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:34.518325  9088 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:34.521162  9362 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:34.543530  1439 catalog_manager.cc:5697] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:34.545222  1439 catalog_manager.cc:5697] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:34.521570  9388 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:34.547039  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:34.547271  1505 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:34.446632  9450 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
W20260709 13:00:34.540302  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.543678  9289 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:34.499269  9485 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:34.542438  9011 raft_consensus.cc:740] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:34.547895  9088 raft_consensus.cc:697] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:34.539554  2298 raft_consensus.cc:2393] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 18: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
W20260709 13:00:34.528466  1436 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54606 (request call id 314) took 19885 ms (client timeout 15000 ms). Trace:
I20260709 13:00:34.546442  9494 raft_consensus.cc:2764] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260709 13:00:34.559444  1505 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:34.532202  9268 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:34.556339  1439 catalog_manager.cc:5697] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 17 to 20, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 20 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:34.498023  9292 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:34.535327  9480 consensus_queue.cc:237] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:34.559278  9440 log.cc:927] Time spent T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 1.789s	user 0.010s	sys 0.003s
I20260709 13:00:34.574410  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:34.574774  1505 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:34.575116  2298 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:34.578930  1686 raft_consensus.cc:1240] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 16. Current term is 17. Ops: [15.13-16.14]
I20260709 13:00:34.580080  2294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32794 (request call id 1078) took 2396 ms. Trace:
I20260709 13:00:34.580617  9182 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:34.581590  9352 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:34.562633  9388 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:34.583863  9450 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:34.585660  9485 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:34.601770  2300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32788 (request call id 747) took 1267 ms. Trace:
I20260709 13:00:34.602222  2300 rpcz_store.cc:276] 0709 13:00:33.334811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.642507 (+307696us) service_pool.cc:224] Handling call
0709 13:00:34.084097 (+441590us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:34.099682 (+ 15585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.601566 (+501884us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b54007a7e50. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:34.601706 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1015167104}
I20260709 13:00:34.562636  9254 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.606015  9254 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:34.607654  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:34.588809  1439 catalog_manager.cc:5697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 18 to 20, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 20 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:34.611099  1439 catalog_manager.cc:5697] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 12 to 13, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 13 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:34.611809  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:34.563470  1436 rpcz_store.cc:269] 0709 13:00:14.643119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:14.643311 (+   192us) service_pool.cc:224] Handling call
0709 13:00:15.670758 (+1027447us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54001b99d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfbb090 00007fc85d059f3a 00007fc862e101cc 00007fc862f0e37e 00007fc8613cf2a4 00007fc8613cf232 00007fc8613cf161 00007fc8613cf0dc 00007fc8613ce392 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:34.528354 (+18857596us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:27.188960 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:27.189713 (+   753us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:27.189769 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:00:27.189790 (+    21us) tablet.cc:662] Decoding operations
0709 13:00:27.281393 (+ 91603us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:27.281474 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:27.281499 (+    25us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:00:27.282593 (+  1094us) tablet.cc:701] Row locks acquired
0709 13:00:27.282647 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:00:27.282847 (+   200us) write_op.cc:270] Start()
0709 13:00:27.282999 (+   152us) write_op.cc:276] Timestamp: P: 1783602027282780 usec, L: 0
0709 13:00:27.283018 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:00:27.283799 (+   781us) log.cc:844] Serialized 4397 byte log entry
0709 13:00:27.591104 (+307305us) op_driver.cc:464] REPLICATION: finished
0709 13:00:29.002135 (+1411031us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b18003b0f20. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f643f3 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd 000000000038f354 000000000038f199 00007fc859f4783a
0709 13:00:29.002326 (+   191us) write_op.cc:301] APPLY: starting
0709 13:00:29.002430 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:29.202967 (+200537us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:29.203014 (+    47us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:29.350204 (+147190us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:29.350562 (+   358us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=0,mrs_lookups=0
0709 13:00:29.350615 (+    53us) write_op.cc:312] APPLY: finished
0709 13:00:29.351107 (+   492us) log.cc:844] Serialized 105 byte log entry
0709 13:00:30.176962 (+825855us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:30.191876 (+ 14914us) write_op.cc:454] Released schema lock
0709 13:00:30.200745 (+  8869us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:30.217814 (+ 17069us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:30.217847 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":35,"spinlock_wait_cycles":335339264,"child_traces":[["op",{"apply.queue_time_us":328013,"apply.run_cpu_time_us":31290,"apply.run_wall_time_us":1215442,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50129,"num_ops":11,"prepare.queue_time_us":191308,"prepare.run_cpu_time_us":31608,"prepare.run_wall_time_us":209624,"raft.queue_time_us":141294,"raft.run_cpu_time_us":12619,"raft.run_wall_time_us":327292,"replication_time_us":307910,"spinlock_wait_cycles":42765696,"thread_start_us":1303198,"threads_started":5,"wal-append.queue_time_us":685617,"wal-append.run_cpu_time_us":21881,"wal-append.run_wall_time_us":2386887}]]}
I20260709 13:00:34.590090  2294 rpcz_store.cc:276] 0709 13:00:32.184091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.525259 (+341168us) service_pool.cc:224] Handling call
0709 13:00:32.525660 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:32.526082 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:00:32.783090 (+257008us) log.cc:844] Serialized 14 byte log entry
0709 13:00:34.284137 (+1501047us) spinlock_profiling.cc:243] Waited 8.5 ms on lock 0x7b180009b980. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf123a 00007fc85d05ba2a
0709 13:00:34.497300 (+213163us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:34.514253 (+ 16953us) log.cc:844] Serialized 26 byte log entry
0709 13:00:34.514405 (+   152us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:34.514443 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.514547 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:34.579750 (+ 65203us) raft_consensus.cc:1685] finished
0709 13:00:34.579851 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.580001 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19040,"prepare.queue_time_us":264435,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":5179,"raft.queue_time_us":11757,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":15179,"spinlock_wait_cycles":19539840,"thread_start_us":409862,"threads_started":2,"wal-append.queue_time_us":1755921}
I20260709 13:00:34.614073  2294 raft_consensus.cc:1240] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:34.608223  9254 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:34.615815  1439 catalog_manager.cc:5697] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:34.595490  9457 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:34.597550  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:34.595502  2297 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:00:34.617882  1439 catalog_manager.cc:5697] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 15 to 17, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 17 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:34.618521  1683 raft_consensus.cc:1275] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:34.619298  2297 raft_consensus.cc:1240] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 22 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:34.619457  1439 catalog_manager.cc:5697] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:34.621178  9181 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:34.622557  9485 consensus_queue.cc:1048] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:34.623250  9182 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:34.626013  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 4777) took 1185 ms. Trace:
I20260709 13:00:34.626497  1684 rpcz_store.cc:276] 0709 13:00:33.440439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.481681 (+ 41242us) service_pool.cc:224] Handling call
0709 13:00:34.625825 (+1144144us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b540029a9d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:34.625951 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55138048}
I20260709 13:00:34.628067  9457 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:34.627594  1439 catalog_manager.cc:5697] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:34.633373  1439 catalog_manager.cc:5697] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 17 to 19, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 19 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:34.633855  9412 consensus_queue.cc:260] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:34.635214  9412 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:34.637411  1508 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:34.613610  2296 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:00:34.650036  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:34.650898  1542 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 20.
I20260709 13:00:34.651511  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:34.653707  2266 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:34.652233  1540 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 13:00:34.662949  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:34.603658  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:34.650856  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:34.655623  2266 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:34.680648  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:34.682677  9457 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.683332  9457 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:34.684171  9470 log.cc:927] Time spent T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 1.014s	user 0.000s	sys 0.009s
I20260709 13:00:34.685618  9457 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:34.688779  9457 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:34.689780  9368 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:34.690380  9368 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:34.691663  9011 consensus_queue.cc:260] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:34.692886  9011 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:34.694521  9088 consensus_queue.cc:237] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:34.700966  1583 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:34.706482  1541 raft_consensus.cc:1240] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:00:34.657140  9494 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:34.709458  9423 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:34.710278  9423 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:34.711946  1610 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:00:34.713536  2295 raft_consensus.cc:2393] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 19: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:34.687563  9292 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:34.687115  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:34.670115  2300 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
W20260709 13:00:34.730182  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 74634.1us
I20260709 13:00:34.731878  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:34.732053  1656 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:34.737651  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:34.724912  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 150214us
I20260709 13:00:34.741358  1505 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:34.742408  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:34.743163  1683 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:34.744938  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:34.746027  1613 raft_consensus.cc:2393] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 30: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:34.749867  1654 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:34.752964  1656 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:34.758921  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:34.759743  1609 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 22.
W20260709 13:00:34.761731  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 124462us
I20260709 13:00:34.762493  1508 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:34.763248  1656 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:34.763571  1508 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:34.761685  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:34.766340  1608 raft_consensus.cc:2393] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 19: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:34.768397  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:34.768999  1613 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:34.775041  1656 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:34.782707  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:34.783471  1540 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 23.
I20260709 13:00:34.781590  1583 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:34.710165  9268 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:34.795348  1581 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:34.803422  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:34.804446  1540 raft_consensus.cc:2410] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 28 because replica has last-logged OpId of term: 26 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 18.
I20260709 13:00:34.805410  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:34.802688  1581 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:34.819963  1581 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:34.824011  1507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.015s	sys 0.020s
I20260709 13:00:34.761343  9144 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:00:34.765559  9409 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:00:34.826174  2298 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
W20260709 13:00:34.827044  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 69732.9us
I20260709 13:00:34.760977  9392 raft_consensus.cc:2764] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:00:34.761633  9327 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.765426  9257 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:34.765740  9254 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:34.828366  1613 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 22.
I20260709 13:00:34.761129  9388 raft_consensus.cc:697] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 13:00:34.824344  1507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.015s	sys 0.020s
W20260709 13:00:34.841966  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 791191us
I20260709 13:00:34.827672  1610 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 25.
I20260709 13:00:34.765651  9399 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.790704  9413 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:34.794131  9310 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:34.827253  9352 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:34.822455  9403 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:34.817575  9296 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:34.861618  2266 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:34.822778  9182 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:00:34.859808  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 96307.3us
I20260709 13:00:34.865073  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 3989) took 1209 ms. Trace:
I20260709 13:00:34.876685  1682 rpcz_store.cc:276] 0709 13:00:33.656061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.656738 (+   677us) service_pool.cc:224] Handling call
0709 13:00:33.930066 (+273328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:34.210379 (+280313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.413459 (+203080us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b5400337cd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:34.864838 (+451379us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b5400337cd0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:34.865004 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1166990976}
I20260709 13:00:34.826565  9437 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:34.822942  9500 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:00:34.832562  9385 raft_consensus.cc:3055] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:34.781824  9292 consensus_queue.cc:1059] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.060s
W20260709 13:00:34.870852  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 129598us
I20260709 13:00:34.793411  9485 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.065s
I20260709 13:00:34.791360  9339 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.073s
I20260709 13:00:34.873412  1508 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:34.884177  1508 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:34.880573  2266 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:34.881439  1654 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:34.882550  9491 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:00:34.880165  9437 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.887125  9437 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:34.861686  9409 raft_consensus.cc:697] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 26 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:34.858929  9254 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:34.880836  1505 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:34.869139  9352 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.897924  1508 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:34.866722  9310 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:34.868718  9331 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:34.866138  9380 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:34.906353  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.901310  1654 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:34.904793  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:34.909399  2296 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:34.900594  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:34.840157  9364 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.046s
I20260709 13:00:34.903100  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
W20260709 13:00:34.925976  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 45226.1us
I20260709 13:00:34.926505  1508 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:34.901793  1656 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:34.879451  9182 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.930416  1654 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:34.879999  9385 raft_consensus.cc:740] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:34.864833  9327 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:34.933120  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:34.934859  1508 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:34.931679  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 4015) took 1021 ms. Trace:
I20260709 13:00:34.979031  1688 rpcz_store.cc:276] 0709 13:00:33.910171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.526391 (+616220us) service_pool.cc:224] Handling call
0709 13:00:34.526671 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:34.526866 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:34.657556 (+130690us) log.cc:844] Serialized 14 byte log entry
0709 13:00:34.931304 (+273748us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:34.931365 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:34.931418 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.931486 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.931613 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13294,"prepare.queue_time_us":333692,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":14091,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":387747,"threads_started":2}
W20260709 13:00:34.933723  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.981817  2296 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 20.
I20260709 13:00:34.929839  9410 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:34.866921  9399 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:34.886168  9413 raft_consensus.cc:697] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 13:00:34.995250  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 60457us
I20260709 13:00:34.996279  1508 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:34.993453  1540 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:00:34.993569  9372 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.909063  9362 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:34.973085  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:34.985384  2303 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:00:35.014864  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:34.908012  9352 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:34.908102  9254 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:34.989562  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:34.991190  1505 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:35.020681  1683 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 19.
I20260709 13:00:35.032606  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:35.033622  1683 raft_consensus.cc:2410] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 28 because replica has last-logged OpId of term: 26 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 18.
I20260709 13:00:35.023711  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:34.963641  9500 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:34.960891  9268 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:00:35.025650  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:35.043231  2296 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 26.
I20260709 13:00:34.925087  9310 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:35.048904  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:35.029042  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:35.049436  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1169) took 1207 ms. Trace:
I20260709 13:00:34.885210  9457 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:35.025830  2300 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 23.
I20260709 13:00:35.030611  1540 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:00:35.035413  1583 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:35.036209  1610 pending_rounds.cc:85] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f: Aborting all ops after (but not including) 17
I20260709 13:00:35.056942  1610 pending_rounds.cc:107] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 22.18
I20260709 13:00:35.057271  1610 raft_consensus.cc:2889] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:35.057934  2302 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:00:35.036250  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:35.058940  1540 raft_consensus.cc:3055] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:35.059406  1540 raft_consensus.cc:740] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:35.059988  1610 pending_rounds.cc:107] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 24.19
I20260709 13:00:34.971876  9392 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:35.060316  1610 raft_consensus.cc:2889] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:34.972396  9182 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:34.930931  9507 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:35.061890  9457 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.930830  9456 consensus_queue.cc:1048] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:00:34.925297  9505 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:00:35.049849  1685 rpcz_store.cc:276] 0709 13:00:33.842028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.330834 (+488806us) service_pool.cc:224] Handling call
0709 13:00:34.390839 (+ 60005us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:34.391074 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 13:00:34.560974 (+169900us) log.cc:844] Serialized 14 byte log entry
0709 13:00:35.048979 (+488005us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:35.049109 (+   130us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:00:35.049169 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.049232 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.049378 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":399014,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"thread_start_us":637792,"threads_started":2}
I20260709 13:00:35.037259  1582 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:35.067436  9457 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:35.060236  1540 consensus_queue.cc:260] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:35.073558  1540 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:35.064507  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:35.081287  1685 raft_consensus.cc:2393] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 19: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:35.000029  9372 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:35.084801  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 47615.7us
I20260709 13:00:35.022578  9410 raft_consensus.cc:697] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:35.087929  9410 consensus_queue.cc:237] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:34.963835  9488 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.079s
I20260709 13:00:34.988902  9292 consensus_queue.cc:1059] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.068s
W20260709 13:00:35.082231  9367 consensus_meta.cc:287] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.924s	user 0.012s	sys 0.000s
I20260709 13:00:35.110242  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:35.022886  9247 consensus_queue.cc:1059] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 28.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.084s
I20260709 13:00:35.114123  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:35.114061  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:35.082536  9339 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:35.048512  9362 raft_consensus.cc:697] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 22 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:35.000931  9331 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.085s
I20260709 13:00:35.121328  1691 raft_consensus.cc:2410] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 22 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:00:35.085879  9234 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:00:34.983137  9388 consensus_queue.cc:237] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:35.129534  1540 raft_consensus.cc:1275] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:35.093217  9392 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:00:35.096858  9451 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:35.141583  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:35.163412  1687 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 23.
I20260709 13:00:35.111783  9268 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:00:35.160888  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:35.165517  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:35.168692  1688 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:35.168848  1685 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:35.115965  9494 raft_consensus.cc:697] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:35.120682  9505 raft_consensus.cc:3055] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:35.129276  9491 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:35.094344  9500 consensus_queue.cc:1048] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.079s
I20260709 13:00:35.112627  9235 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.058s
I20260709 13:00:35.159576  9296 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 13:00:35.216722  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 315010us
I20260709 13:00:35.220944  2269 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:35.193655  9493 log.cc:927] Time spent T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:00:35.211903  1685 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 24.
I20260709 13:00:35.158313  9339 raft_consensus.cc:697] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 22 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:35.205992  1533 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:00:35.171375  9451 raft_consensus.cc:697] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 20 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 13:00:35.205686  9481 log.cc:927] Time spent T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:00:35.239632  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:35.240504  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.268708   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:35.261059  9304 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.008s	sys 0.016s
I20260709 13:00:35.233449  9297 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:35.198688  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:35.196893  9505 raft_consensus.cc:740] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:35.251767  1688 raft_consensus.cc:2468] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 13:00:35.283614  1685 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:00:35.292495  1688 raft_consensus.cc:3055] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:35.292635  2269 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:35.293043  1688 raft_consensus.cc:740] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 13:00:35.281388  9304 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.008s	sys 0.016s
I20260709 13:00:35.156778  9413 consensus_queue.cc:237] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:35.309554  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 379223us
I20260709 13:00:35.312507  1654 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:35.233371  9296 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:35.308845  9509 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.337s	user 0.001s	sys 0.000s
W20260709 13:00:35.331063  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 334884us
I20260709 13:00:35.085335  9409 consensus_queue.cc:237] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:35.055439  9385 consensus_queue.cc:260] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:35.375509  9507 raft_consensus.cc:697] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:35.325336  8627 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.282464  9362 consensus_queue.cc:237] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:35.313819  9331 consensus_queue.cc:1059] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:00:35.307564  9182 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:35.345337  9088 consensus_queue.cc:1048] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:00:35.320627  9367 consensus_queue.cc:1059] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:00:35.337940  9364 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:35.308686  9445 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.030s
I20260709 13:00:35.310671  1688 consensus_queue.cc:260] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:35.391894  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 50062.5us
I20260709 13:00:35.346936  9327 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:35.399771  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 302349us
W20260709 13:00:35.344329  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 284133us
I20260709 13:00:35.446867  1507 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:35.401969  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 410857us
I20260709 13:00:35.415218  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4794) took 1622 ms. Trace:
I20260709 13:00:35.434849  9088 consensus_queue.cc:1243] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 20.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:00:35.383553  9456 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.389704  9410 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:00:35.332005  9235 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.348081  9437 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:35.461278  1505 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:35.416993  9513 log.cc:927] Time spent T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260709 13:00:35.378767  9292 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 13:00:35.404628  9372 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:35.334050  9339 consensus_queue.cc:237] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:35.432435  9512 log.cc:927] Time spent T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 13:00:35.338537  9451 consensus_queue.cc:237] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:35.449915  1689 rpcz_store.cc:276] 0709 13:00:33.793159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.283890 (+490731us) service_pool.cc:224] Handling call
0709 13:00:34.284202 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:34.316388 (+ 32186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:34.399802 (+ 83414us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:34.425323 (+ 25521us) log.cc:844] Serialized 26 byte log entry
0709 13:00:34.807917 (+382594us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:34.807963 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.808037 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:35.414965 (+606928us) raft_consensus.cc:1685] finished
0709 13:00:35.414985 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.415146 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34166,"raft.queue_time_us":32303,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":21261,"thread_start_us":322160,"threads_started":1,"wal-append.queue_time_us":432024}
I20260709 13:00:35.322214  9494 consensus_queue.cc:237] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:35.455643  1507 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:35.455472  9517 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:35.415373  8627 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:35.425343  9457 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:35.350565  9505 consensus_queue.cc:260] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:35.481722  1505 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:35.463508  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:35.489781  1690 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.005s	sys 0.038s
I20260709 13:00:35.453915  9488 consensus_queue.cc:1059] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.024s
W20260709 13:00:35.477129  9523 log.cc:927] Time spent T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.088s	user 0.001s	sys 0.001s
I20260709 13:00:35.460506  9500 consensus_queue.cc:1059] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:00:35.480124  9304 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.470643  9410 raft_consensus.cc:697] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 25 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 13:00:35.495960  1690 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.006s	sys 0.039s
I20260709 13:00:35.503187  1689 raft_consensus.cc:1275] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:00:35.494004  9521 log.cc:927] Time spent T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.211s	user 0.001s	sys 0.001s
I20260709 13:00:35.484329  8714 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:35.463303  9456 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:35.466032  9235 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:35.517590  9488 consensus_queue.cc:1243] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Peer c262eac7fc904ae9bb91e450f6532e3f log is divergent from this leader: its last log entry 22.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
W20260709 13:00:35.535514  9181 consensus_meta.cc:287] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.914s	user 0.006s	sys 0.005s
I20260709 13:00:35.495847  9527 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:00:35.532758  9516 log.cc:927] Time spent T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.376s	user 0.004s	sys 0.000s
I20260709 13:00:35.484141  9531 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.053s
I20260709 13:00:35.517808  9234 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:35.491221  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:35.547461  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 55968.8us
W20260709 13:00:35.547415  9511 log.cc:927] Time spent T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.163s	user 0.000s	sys 0.002s
I20260709 13:00:35.569265  1687 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 23.
I20260709 13:00:35.486135  9507 consensus_queue.cc:237] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:35.565394  9450 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.546519  9532 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:35.553857  9296 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:35.522521  9304 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:35.598888  2295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32802 (request call id 795) took 1332 ms. Trace:
I20260709 13:00:35.599267  2295 rpcz_store.cc:276] 0709 13:00:34.266518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.546783 (+280265us) service_pool.cc:224] Handling call
0709 13:00:35.598649 (+1051866us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b5400938354. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:35.598808 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254851328}
W20260709 13:00:35.578249  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 83147.5us
I20260709 13:00:35.565508  9534 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:35.595433  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 66686.3us
I20260709 13:00:35.575445  2294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32802 (request call id 804) took 1242 ms. Trace:
I20260709 13:00:35.614887  8627 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:35.604012  9528 log.cc:927] Time spent T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:00:35.565691  9530 consensus_queue.cc:1048] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:00:35.601538  9555 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:00:35.613386  9522 log.cc:927] Time spent T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.167s	user 0.001s	sys 0.001s
I20260709 13:00:35.594586  9297 raft_consensus.cc:697] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 19 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
W20260709 13:00:35.610075  9533 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:00:35.575016  9234 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:35.607199  9296 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.628793  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:35.618800  9368 consensus_meta.cc:287] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.928s	user 0.014s	sys 0.000s
I20260709 13:00:35.598511  9450 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:35.632190  1617 raft_consensus.cc:1240] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260709 13:00:35.632918  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:35.673134  1611 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 27.
I20260709 13:00:35.626518  1655 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:35.609851  9182 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:35.675012  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 48586.6us
I20260709 13:00:35.637738  1609 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:00:35.638814  9544 log.cc:927] Time spent T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 13:00:35.638978  9540 log.cc:927] Time spent T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:00:35.639482  9297 consensus_queue.cc:237] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:35.602530  9388 consensus_queue.cc:1048] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:00:35.642585  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:35.646661  9289 consensus_meta.cc:287] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 1.088s	user 0.015s	sys 0.000s
W20260709 13:00:35.653890  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:35.661003  9551 log.cc:927] Time spent T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260709 13:00:35.661744  9526 log.cc:927] Time spent T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:00:35.661454  9296 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:35.666177  1615 raft_consensus.cc:1240] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 21. Current term is 22. Ops: []
W20260709 13:00:35.732560  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 98649.4us
I20260709 13:00:35.582029  9410 consensus_queue.cc:237] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:35.645282  9403 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:35.737296  1583 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:35.704140  9534 raft_consensus.cc:1064] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 13:00:35.706581  1614 raft_consensus.cc:2368] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 23. Current term is 24.
W20260709 13:00:35.652376  9310 consensus_meta.cc:287] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.567s	user 0.010s	sys 0.003s
W20260709 13:00:35.628607  9254 consensus_meta.cc:287] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.573s	user 0.013s	sys 0.000s
I20260709 13:00:35.748234  9310 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:35.748983  9254 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:35.751516  9254 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:35.644860  9437 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:35.753159  1542 raft_consensus.cc:1240] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 23. Current term is 24. Ops: []
W20260709 13:00:35.682651  9412 consensus_meta.cc:287] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 1.047s	user 0.013s	sys 0.000s
I20260709 13:00:35.754519  1686 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 17. (term mismatch)
I20260709 13:00:35.754958  1686 pending_rounds.cc:85] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 16
I20260709 13:00:35.755178  1686 pending_rounds.cc:107] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 21.17
I20260709 13:00:35.755573  1686 raft_consensus.cc:2889] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:35.742254  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50694 (request call id 4020) took 1743 ms. Trace:
I20260709 13:00:35.730037  9235 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:35.729532  9367 consensus_queue.cc:1048] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:00:35.747574  9491 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:35.756556  1691 rpcz_store.cc:276] 0709 13:00:34.002189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.223830 (+221641us) service_pool.cc:224] Handling call
0709 13:00:35.739191 (+1515361us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b5400032d54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:35.742197 (+  3006us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2061520128}
I20260709 13:00:35.757160  1583 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
W20260709 13:00:35.732338  9529 log.cc:927] Time spent T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:00:35.705745  9457 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:35.763736  1616 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 13:00:35.732421  9525 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:35.738224  9555 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:35.807543  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 50483.3us
I20260709 13:00:35.741216  9403 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:35.809916  1583 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:35.680627  9368 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:35.811580  1583 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:35.759183  9182 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:00:35.764499  9534 raft_consensus.cc:1068] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Unable to promote non-voter 1d6516ff61104bdda54bde95e92fe579: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:00:35.820519  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:35.826423  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:35.826668  1535 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 23.
I20260709 13:00:35.826238  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:35.821527  1540 raft_consensus.cc:1240] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:35.821875  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:35.822100  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:35.805830  9491 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:35.806945  9331 raft_consensus.cc:3055] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:35.827921  1536 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 19.
I20260709 13:00:35.827422  1534 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 17.
I20260709 13:00:35.826258  2267 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:35.813798  9011 consensus_meta.cc:287] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 1.119s	user 0.007s	sys 0.007s
I20260709 13:00:35.765012  9547 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:35.827186  1541 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 21.
W20260709 13:00:35.840921  9559 log.cc:927] Time spent T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:00:35.833076  9445 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.006s
I20260709 13:00:35.840281  9296 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:35.808779  9456 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:35.816011  9437 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:00:35.810727  9235 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:35.829914  9545 raft_consensus.cc:2804] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:35.832801  9331 raft_consensus.cc:740] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:35.846397  9530 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:00:35.825419  9457 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:35.611284  2294 rpcz_store.cc:276] 0709 13:00:34.332702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.614857 (+282155us) service_pool.cc:224] Handling call
0709 13:00:34.615214 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:34.615604 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:34.615644 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:34.616170 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:00:35.015394 (+399224us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:00:35.490322 (+474928us) log.cc:844] Serialized 14 byte log entry
0709 13:00:35.545222 (+ 54900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.550548 (+  5326us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:35.554598 (+  4050us) raft_consensus.cc:1685] finished
0709 13:00:35.566695 (+ 12097us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.573149 (+  6454us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23720,"prepare.queue_time_us":542463,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":40224,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":6590,"thread_start_us":763518,"threads_started":2,"wal-append.queue_time_us":494813}
I20260709 13:00:35.833246  9534 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.853885  9549 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 13:00:35.876186  9538 log.cc:927] Time spent T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 13:00:35.868646  9437 raft_consensus.cc:697] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 24 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:35.876833  9234 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:35.872912  9545 raft_consensus.cc:697] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:35.868646  9372 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.022s
I20260709 13:00:35.871418  9456 consensus_queue.cc:1048] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:00:35.898561  1613 raft_consensus.cc:1240] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 20 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:00:35.900964  2267 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:35.878839  9457 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:35.949198  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 49380.7us
I20260709 13:00:35.943583  9424 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.945362  9362 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:35.891667  9331 consensus_queue.cc:260] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:35.953523  2267 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:35.945451  9296 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 13:00:35.952349  9352 consensus_meta.cc:287] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.896s	user 0.005s	sys 0.014s
I20260709 13:00:35.957464  2267 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:35.817024  9555 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:35.881613  9549 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:35.879875  9534 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:35.943563  9437 consensus_queue.cc:237] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:35.955273  9362 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.849596  9547 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:35.965444  2267 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:35.973248  9569 log.cc:927] Time spent T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:00:35.977193  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1170) took 2118 ms. Trace:
I20260709 13:00:35.982724  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:35.984302  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.958561  9457 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:35.994302  1609 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 17.
I20260709 13:00:35.996057  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:36.005846  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:36.007738  2298 raft_consensus.cc:2393] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 21: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:35.997201  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:36.008579  2297 raft_consensus.cc:2410] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 27 because replica has last-logged OpId of term: 25 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 17.
I20260709 13:00:35.997794  2295 raft_consensus.cc:1240] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:00:35.993752  9011 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
I20260709 13:00:36.000353  9534 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:36.013411  1656 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:35.961484  9296 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:36.000744  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.001971  9549 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:36.002234  9403 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:36.003726  9331 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:35.954967  9424 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:36.005846  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:36.024405  1614 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 18.
I20260709 13:00:35.961287  9352 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:36.007952  1615 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:35.993607  1690 rpcz_store.cc:276] 0709 13:00:33.858933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.373776 (+514843us) service_pool.cc:224] Handling call
0709 13:00:34.374144 (+   368us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:34.572827 (+198683us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:00:35.518336 (+945509us) log.cc:844] Serialized 14 byte log entry
0709 13:00:35.763340 (+245004us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:35.802944 (+ 39604us) log.cc:844] Serialized 52 byte log entry
0709 13:00:35.803136 (+   192us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:00:35.803418 (+   282us) log.cc:844] Serialized 14 byte log entry
0709 13:00:35.807248 (+  3830us) log.cc:844] Serialized 14 byte log entry
0709 13:00:35.807471 (+   223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.807546 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:35.976889 (+169343us) raft_consensus.cc:1685] finished
0709 13:00:35.976909 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.977128 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16713,"prepare.queue_time_us":320786,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":106,"raft.queue_time_us":22763,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":46689,"spinlock_wait_cycles":22087424,"thread_start_us":1101501,"threads_started":3,"wal-append.queue_time_us":349951}
W20260709 13:00:36.014683  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.958837  9456 consensus_queue.cc:1059] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
W20260709 13:00:36.021551  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 56167.5us
I20260709 13:00:36.015031  9412 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:35.993649  9362 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:36.023416  9296 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:36.024533  2299 raft_consensus.cc:1275] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:00:35.963583  9557 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:36.032510  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:36.006045  9507 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.038430  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:36.041177  9547 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:36.020236  9367 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:36.023988  9485 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:36.035179  9410 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:36.050660  9372 raft_consensus.cc:3055] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:36.050848  9410 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:36.051503  9372 raft_consensus.cc:740] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:36.052701  9372 consensus_queue.cc:260] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:36.054090  9372 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:36.058967  9450 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:36.062034  9410 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:36.062304  9532 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:36.065831  9491 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:36.067579  9491 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:36.021006  9579 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:36.033531  9181 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.955655  9545 consensus_queue.cc:237] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:36.076467  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 60687.8us
I20260709 13:00:36.043634  9557 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.050273  9507 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:36.083935  1615 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 23.
I20260709 13:00:36.046152  9403 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:36.028304  9549 consensus_queue.cc:1059] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 13:00:36.042336  9412 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:36.079447  9392 raft_consensus.cc:3055] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 LEADER]: Stepping down as leader of term 29
I20260709 13:00:36.094944  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:36.095314  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:36.087971  9584 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.098572  9584 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:36.100819  9584 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:36.101516  2300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32802 (request call id 807) took 1370 ms. Trace:
I20260709 13:00:36.101999  2300 rpcz_store.cc:276] 0709 13:00:34.731155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.740727 (+  9572us) service_pool.cc:224] Handling call
0709 13:00:36.101363 (+1360636us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54005ab254. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:36.101460 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":505045376}
I20260709 13:00:36.071689  9485 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.073666  9579 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.095736  1535 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:36.096108  1540 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 21.
I20260709 13:00:36.085606  9557 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:36.101577  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:36.109416  1581 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:36.108520  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:36.096987  9367 raft_consensus.cc:3055] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:36.109808  1538 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:36.108812  9579 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:36.077008  9181 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:36.093602  9392 raft_consensus.cc:740] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:36.108946  9485 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:36.134071  9181 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:36.135073  9399 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:36.143810  9530 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:00:36.151895  9424 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:36.152685  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1255) took 1166 ms. Trace:
I20260709 13:00:36.125036  9367 raft_consensus.cc:740] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:36.154093  9367 consensus_queue.cc:260] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:36.155134  9367 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:36.122169  9296 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.153139  1542 rpcz_store.cc:276] 0709 13:00:34.986647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.986912 (+   265us) service_pool.cc:224] Handling call
0709 13:00:35.025216 (+ 38304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.753599 (+728383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.152370 (+398771us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b54003f93d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:36.152610 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1673831808}
I20260709 13:00:36.123914  9584 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:36.159232  9296 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:36.122489  9352 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:36.160975  9392 consensus_queue.cc:260] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.18, Last appended by leader: 18, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:36.162175  9456 consensus_queue.cc:1059] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:00:36.162935  9296 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:36.163589  9456 raft_consensus.cc:3055] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:00:36.163990  9456 raft_consensus.cc:740] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:36.122725  9547 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:36.167860  1535 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 24.
W20260709 13:00:36.348572  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.413812  8714 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:36.205994  9362 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.004369  8714 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:37.007570  9362 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:37.008526  9362 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:37.009569  9362 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.011063  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:36.192325  9456 consensus_queue.cc:260] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.018361  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:36.174219  9547 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 13:00:36.226128  9550 log.cc:927] Time spent T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.373s	user 0.003s	sys 0.000s
I20260709 13:00:37.022958  9547 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:36.234038  9554 consensus_queue.cc:1059] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:00:36.218014  9557 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:36.411525  9563 log.cc:927] Time spent T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.559s	user 0.003s	sys 0.000s
I20260709 13:00:37.026417  9531 raft_consensus.cc:3055] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:00:37.026975  9531 raft_consensus.cc:740] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:37.028671  9531 consensus_queue.cc:260] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:36.232692  9571 log.cc:927] Time spent T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:00:36.163542  9412 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:36.177779  9584 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.034461  9584 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:36.216648  9579 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:36.165535  9507 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:36.233848  1505 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:36.876063  9583 log.cc:927] Time spent T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.880s	user 0.007s	sys 0.000s
I20260709 13:00:37.039521  9554 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:00:36.948539  9304 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:37.040097  9554 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.040658  9554 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:00:37.041858  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:37.042402  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:37.043500  1540 raft_consensus.cc:2393] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 25: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:36.223248  9368 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:37.012694  9362 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:37.018616  9456 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:36.212193  9485 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.050964  9485 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:37.037757  9579 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:37.052394  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:37.053318  1542 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 23.
I20260709 13:00:37.054474  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:37.031337  9557 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:37.037701  9531 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:00:37.039382  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 805487us
I20260709 13:00:36.927330  9385 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:36.958020  9407 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.958s	user 0.005s	sys 0.004s
I20260709 13:00:37.043421  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:37.059041  9407 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.059s	user 0.005s	sys 0.005s
I20260709 13:00:37.063962  9407 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:37.070667  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1190) took 1528 ms. Trace:
I20260709 13:00:37.071045  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:37.079967  9495 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.079504  9554 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.080797  9495 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:37.083465  9554 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 28 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:37.089701  9579 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.090590  9579 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.072522  1689 rpcz_store.cc:276] 0709 13:00:35.541811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.623202 (+ 81391us) service_pool.cc:224] Handling call
0709 13:00:35.625993 (+  2791us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:35.646938 (+ 20945us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:35.646971 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:35.666465 (+ 19494us) log.cc:844] Serialized 26 byte log entry
0709 13:00:35.884135 (+217670us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:00:35.884206 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.884327 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:36.231609 (+347282us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 13:00:37.069869 (+838260us) raft_consensus.cc:1685] finished
0709 13:00:37.069923 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.070352 (+   429us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11881,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":54832,"spinlock_wait_cycles":37877504,"thread_start_us":178093,"threads_started":1,"wal-append.queue_time_us":252019}
I20260709 13:00:37.083379  9495 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:37.102954  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4795) took 2376 ms. Trace:
I20260709 13:00:37.107443  1535 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 23.
I20260709 13:00:37.099588  9579 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:37.110149  9557 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.106732  1685 rpcz_store.cc:276] 0709 13:00:34.727637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.290347 (+562710us) service_pool.cc:224] Handling call
0709 13:00:35.290739 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:35.291122 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:00:35.323503 (+ 32381us) log.cc:844] Serialized 14 byte log entry
0709 13:00:35.489672 (+166169us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:35.490203 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 13:00:35.490373 (+   170us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:35.490486 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.490554 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:36.225619 (+735065us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 13:00:37.102374 (+876755us) raft_consensus.cc:1685] finished
0709 13:00:37.102510 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.102731 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1229,"prepare.queue_time_us":33111,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":48412,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":14280,"spinlock_wait_cycles":42836352,"thread_start_us":164556,"threads_started":1,"wal-append.queue_time_us":509238}
I20260709 13:00:37.111102  9557 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.109549  9407 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.112445  9407 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:37.112943  9505 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:37.113656  9557 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:37.115489  8714 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:37.118633  9555 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:37.119171  1535 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:00:37.121806  9547 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.125995  9547 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:37.128239  1688 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:37.124181  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 3927) took 1496 ms. Trace:
I20260709 13:00:37.132733  1616 rpcz_store.cc:276] 0709 13:00:35.628025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.628552 (+   527us) service_pool.cc:224] Handling call
0709 13:00:37.123727 (+1495175us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54004475d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:37.123938 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":270564096}
I20260709 13:00:37.140530  9407 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:37.157508  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:37.158521  2299 raft_consensus.cc:2393] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 24: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
W20260709 13:00:37.172793  9585 log.cc:927] Time spent T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 1.176s	user 0.005s	sys 0.005s
I20260709 13:00:37.188258  9547 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.189200  9547 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.192200  9547 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:37.194607  9547 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.195519  9547 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.198348  9547 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:37.201118  9456 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.202587  9456 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.203614  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1262) took 2117 ms. Trace:
W20260709 13:00:37.206123  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:37.206741  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.193759  8627 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.207650  8627 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:37.208133  9385 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.204054  1533 rpcz_store.cc:276] 0709 13:00:35.085727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.085930 (+   203us) service_pool.cc:224] Handling call
0709 13:00:35.114560 (+ 28630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.261307 (+146747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.202987 (+1941680us) spinlock_profiling.cc:243] Waited 91 ms on lock 0x7b540010c2d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:37.203385 (+   398us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209313152}
I20260709 13:00:37.210999  9385 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:37.216113  9456 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:37.218094  9385 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:37.225138  8627 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:37.242000  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:37.243187  1533 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:37.252411  9579 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:00:37.255352  9310 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:37.256696  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.257977  1688 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:00:37.266831  9547 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:37.267560  9547 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.268358  8714 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:37.269621  9257 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 22 current term: 22 is higher.
I20260709 13:00:37.270177  9537 raft_consensus.cc:3055] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:37.271065  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4804) took 2539 ms. Trace:
I20260709 13:00:37.274286  9537 raft_consensus.cc:740] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:37.275867  9537 consensus_queue.cc:260] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:37.278955  9542 log.cc:927] Time spent T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 1.426s	user 0.005s	sys 0.003s
I20260709 13:00:37.281523  9537 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:00:37.282500  9590 log.cc:927] Time spent T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 1.077s	user 0.000s	sys 0.010s
I20260709 13:00:37.283610  9547 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:37.285951  2294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32788 (request call id 757) took 1291 ms. Trace:
I20260709 13:00:37.286552  2294 rpcz_store.cc:276] 0709 13:00:35.994901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.998236 (+  3335us) service_pool.cc:224] Handling call
0709 13:00:35.998583 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:36.022007 (+ 23424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:36.023131 (+  1124us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:36.023629 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:00:36.125211 (+101582us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:00:36.128881 (+  3670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.131665 (+  2784us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.285342 (+1153677us) raft_consensus.cc:1685] finished
0709 13:00:37.285387 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.285721 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37300,"raft.queue_time_us":27282,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":9729,"thread_start_us":85714,"threads_started":1,"wal-append.queue_time_us":195249,"wal-append.run_cpu_time_us":2007,"wal-append.run_wall_time_us":1008905}
W20260709 13:00:37.291852  1538 consensus_meta.cc:287] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 1.169s	user 0.007s	sys 0.015s
I20260709 13:00:37.292984  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 3657) took 1067 ms. Trace:
I20260709 13:00:37.293390  1542 rpcz_store.cc:276] 0709 13:00:36.225193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.055430 (+830237us) service_pool.cc:224] Handling call
0709 13:00:37.055888 (+   458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:37.056349 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:00:37.109168 (+ 52819us) log.cc:844] Serialized 14 byte log entry
0709 13:00:37.292573 (+183405us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:37.292624 (+    51us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:00:37.292674 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.292736 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.292889 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":94936,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":211,"raft.queue_time_us":24204,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":157,"thread_start_us":157458,"threads_started":2}
I20260709 13:00:37.295423  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:37.298110  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.271451  1688 rpcz_store.cc:276] 0709 13:00:34.731601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.291998 (+560397us) service_pool.cc:224] Handling call
0709 13:00:35.292346 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:37.126322 (+1833976us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b58005bb8d0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85cfad0aa 00007fc85d02f447 00007fc85d047fe7 00007fc85d0497de 00007fc85d053b49 00007fc85d054416 00007fc85d050d8f 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4
0709 13:00:37.258903 (+132581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.271009 (+ 12106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1562511744}
I20260709 13:00:37.310716  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1272) took 1279 ms. Trace:
I20260709 13:00:37.311239  1541 rpcz_store.cc:276] 0709 13:00:36.031641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.032149 (+   508us) service_pool.cc:224] Handling call
0709 13:00:36.033098 (+   949us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:36.033524 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:36.033557 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:36.041684 (+  8127us) log.cc:844] Serialized 26 byte log entry
0709 13:00:36.127826 (+ 86142us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:00:36.127869 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.127943 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:36.775411 (+647468us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b48001401d8. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc861f7aaa1 00007fc861f71b37 00007fc861f719ca 00007fc86206926f 00007fc862068f37 00007fc86207d55c 00007fc86207d508 00007fc86207d488 00007fc86207d443 00007fc86207c6ec 00007fc860fa6a96
0709 13:00:37.281524 (+506113us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 13:00:37.301542 (+ 20018us) raft_consensus.cc:1685] finished
0709 13:00:37.301563 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.310500 (+  8937us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88,"raft.queue_time_us":85,"raft.run_cpu_time_us":9025,"raft.run_wall_time_us":739287,"spinlock_wait_cycles":31406208,"thread_start_us":85717,"threads_started":1,"wal-append.queue_time_us":162205}
I20260709 13:00:37.313706  1540 raft_consensus.cc:1240] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 21. Current term is 22. Ops: [21.17-21.17]
I20260709 13:00:37.292287  1538 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 21.
I20260709 13:00:37.315213  1533 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 24.
I20260709 13:00:37.319783  2299 raft_consensus.cc:1240] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:37.321153  1535 raft_consensus.cc:1240] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:37.323529  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 3663) took 1096 ms. Trace:
I20260709 13:00:37.323939  1535 rpcz_store.cc:276] 0709 13:00:36.226921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.123409 (+896488us) service_pool.cc:224] Handling call
0709 13:00:37.315583 (+192174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:37.321672 (+  6089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.323291 (+  1619us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54003151d0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:37.323460 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":440985856}
I20260709 13:00:37.325340  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:37.326124  1535 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:00:37.328727  1534 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.257s	user 0.008s	sys 0.017s
W20260709 13:00:37.329751  1534 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.259s	user 0.009s	sys 0.018s
I20260709 13:00:37.329852  9527 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:37.330734  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:37.330717  9527 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:37.331631  2299 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 13:00:37.330750  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1276) took 1286 ms. Trace:
I20260709 13:00:37.333215  9527 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:37.333964  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.334733  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:37.335368  2294 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Advancing to term 28
I20260709 13:00:37.332823  1534 rpcz_store.cc:276] 0709 13:00:36.043888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.044394 (+   506us) service_pool.cc:224] Handling call
0709 13:00:36.044794 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:36.045158 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:36.045183 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:36.070894 (+ 25711us) log.cc:844] Serialized 26 byte log entry
0709 13:00:37.330282 (+1259388us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:00:37.330374 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.330493 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.330539 (+    46us) raft_consensus.cc:1685] finished
0709 13:00:37.330557 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.330698 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8364,"raft.queue_time_us":475,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":24718,"thread_start_us":1258896,"threads_started":1,"wal-append.queue_time_us":156862,"wal-append.run_cpu_time_us":3540,"wal-append.run_wall_time_us":1020819}
I20260709 13:00:37.341161  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:37.342808  1534 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:37.344388  9608 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.345772  9608 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.348197  9608 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:37.351732  1538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 4625) took 1257 ms (client timeout 1585 ms). Trace:
I20260709 13:00:37.356781  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:37.366683  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:37.368218  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 3658) took 1142 ms. Trace:
I20260709 13:00:37.370819  1540 rpcz_store.cc:276] 0709 13:00:36.225454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.082046 (+856592us) service_pool.cc:224] Handling call
0709 13:00:37.313244 (+231198us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:37.314361 (+  1117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.367931 (+ 53570us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b54000749d0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:37.368128 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":530142080}
I20260709 13:00:37.372505  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:37.372987  2267 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:37.375451  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 1146) took 1394 ms. Trace:
I20260709 13:00:37.376680  9584 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:00:37.378453  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:37.377213  9584 raft_consensus.cc:697] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 24 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
W20260709 13:00:37.382885  1508 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.261s	user 0.016s	sys 0.009s
W20260709 13:00:37.383440  1508 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.261s	user 0.017s	sys 0.010s
W20260709 13:00:37.383850  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 1.26209e+06us
W20260709 13:00:37.388499  1508 connection.cc:256] RPC call timeout handler was delayed by -1.2088227439999741s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2555s for a response
W20260709 13:00:37.388901  1508 connection.cc:256] RPC call timeout handler was delayed by -1.1170718070000021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1904s for a response
I20260709 13:00:37.371275  1507 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:37.375900  1612 rpcz_store.cc:276] 0709 13:00:35.980747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.981135 (+   388us) service_pool.cc:224] Handling call
0709 13:00:37.048156 (+1067021us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b5800091e98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc86202afc0 00007fc862015929 00007fc8620153d2 00007fc85b58cbd4
0709 13:00:37.128526 (+ 80370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:37.129160 (+   634us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:37.129187 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:37.129724 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 13:00:37.212156 (+ 82432us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:00:37.212195 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.212264 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.226269 (+ 14005us) raft_consensus.cc:1685] finished
0709 13:00:37.226281 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.375133 (+148852us) spinlock_profiling.cc:243] Waited 78.8 ms on lock 0x7b54004475d0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:37.375246 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3741,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":200,"spinlock_wait_cycles":183646336,"thread_start_us":80578,"threads_started":1,"wal-append.queue_time_us":87917}
W20260709 13:00:37.352238  1538 rpcz_store.cc:269] 0709 13:00:36.094260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.101317 (+  7057us) service_pool.cc:224] Handling call
0709 13:00:37.351616 (+1250299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:37.351763  1581 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:37.382836  9584 consensus_queue.cc:237] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.395287  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:37.398411  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:37.399264  1538 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 22.
I20260709 13:00:37.400815  9608 raft_consensus.cc:2804] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:00:37.401371  9608 raft_consensus.cc:697] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 24 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:37.402303  9608 consensus_queue.cc:237] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:37.406219  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 54795.8us
I20260709 13:00:37.408197  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:37.409231  1616 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 26.
I20260709 13:00:37.410224  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:37.411084  1615 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 21.
I20260709 13:00:37.412220  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:37.413149  1614 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 22.
I20260709 13:00:37.413414  9495 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.413918  9495 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:37.424415  9268 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.425287  9310 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:37.425127  9268 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:37.426013  9310 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:37.427857  9268 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:37.416342  9495 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:37.392663  9088 consensus_queue.cc:1059] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:00:37.435788  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1267) took 1615 ms. Trace:
I20260709 13:00:37.439123  9310 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:37.440737  9554 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:37.497357  9554 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.499586  9554 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:37.450408  2302 raft_consensus.cc:1240] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:00:37.500449  2302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32794 (request call id 1104) took 1285 ms. Trace:
I20260709 13:00:37.500764  2302 rpcz_store.cc:276] 0709 13:00:36.215002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.449568 (+1234566us) service_pool.cc:224] Handling call
0709 13:00:37.450023 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:37.500162 (+ 50139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.500374 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:37.501598  9257 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:37.451401  1655 connection.cc:256] RPC call timeout handler was delayed by -1.5509006649999719s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
W20260709 13:00:37.502529  1655 connection.cc:256] RPC call timeout handler was delayed by -1.3603319189999752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20470000000000002s for a response
I20260709 13:00:37.452783  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:37.503141  2300 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:37.504809  1581 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:37.454183  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 1147) took 1473 ms. Trace:
I20260709 13:00:37.451673  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:37.456425  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:37.451642  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:37.459183  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:37.460523  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:37.461756  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:37.462606  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:37.529852  1616 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:00:37.462888  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.463496  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1191) took 1385 ms. Trace:
W20260709 13:00:37.463838  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 107900us
I20260709 13:00:37.465372  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:37.465970  9589 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:37.467113  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:37.467957  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:37.470285  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4618) took 2749 ms. Trace:
W20260709 13:00:37.473348  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.482167  9603 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:00:37.487193  2294 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 28.
I20260709 13:00:37.566393  1542 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 21.
W20260709 13:00:37.494238  9437 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.494s	user 0.015s	sys 0.007s
I20260709 13:00:37.483515  9456 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.491251  1539 rpcz_store.cc:276] 0709 13:00:35.820594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.821025 (+   431us) service_pool.cc:224] Handling call
0709 13:00:35.821371 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:37.433948 (+1612577us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:37.433995 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:37.434039 (+    44us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:37.434073 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.435343 (+  1270us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b54000735d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:37.435387 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.435580 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3707321984}
I20260709 13:00:37.502194  9257 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:37.451781  1540 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 13:00:37.567672  8627 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.561000  1537 rpcz_store.cc:276] 0709 13:00:34.721348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.721594 (+   246us) service_pool.cc:224] Handling call
0709 13:00:34.722066 (+   472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:35.117944 (+395878us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:35.117980 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:35.118466 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 13:00:35.472995 (+354529us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:35.473045 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.473134 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.278012 (+1804878us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 13:00:37.469830 (+191818us) raft_consensus.cc:1685] finished
0709 13:00:37.469852 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.470132 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83626,"raft.queue_time_us":115684,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":22995,"spinlock_wait_cycles":42642816,"thread_start_us":596871,"threads_started":2,"wal-append.queue_time_us":667034}
I20260709 13:00:37.569811  9304 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:37.572670  1581 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:37.569125  9437 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.568s	user 0.015s	sys 0.007s
I20260709 13:00:37.594149  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 31 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:37.594535  1612 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:00:37.591280  1614 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:37.596904  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:37.584818  9310 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:37.594933  1617 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 18.
I20260709 13:00:37.505893  1610 rpcz_store.cc:276] 0709 13:00:35.981087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.981193 (+   106us) service_pool.cc:224] Handling call
0709 13:00:35.981497 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:35.981798 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:35.981838 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:36.104343 (+122505us) spinlock_profiling.cc:243] Waited 7.85 ms on lock 0x7b2c00125b38. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85b94aa11 00007fc85b95a372 00007fc85d08ca01 00007fc85d05143a 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2
0709 13:00:36.105144 (+   801us) log.cc:844] Serialized 26 byte log entry
0709 13:00:36.130811 (+ 25667us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:00:36.130839 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.130897 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.453629 (+1322732us) raft_consensus.cc:1685] finished
0709 13:00:37.453666 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.454015 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":445,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":8391,"spinlock_wait_cycles":18044160,"thread_start_us":25365,"threads_started":1,"wal-append.queue_time_us":116926,"wal-append.run_cpu_time_us":1875,"wal-append.run_wall_time_us":1002081}
I20260709 13:00:37.530598  1690 rpcz_store.cc:276] 0709 13:00:36.077596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.077764 (+   168us) service_pool.cc:224] Handling call
0709 13:00:36.078076 (+   312us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:00:36.078497 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:36.078526 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:00:36.079195 (+   669us) log.cc:844] Serialized 78 byte log entry
0709 13:00:36.168601 (+ 89406us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:37.424154 (+1255553us) log.cc:844] Serialized 14 byte log entry
0709 13:00:37.462925 (+ 38771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.463063 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.463139 (+    76us) raft_consensus.cc:1685] finished
0709 13:00:37.463155 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.463329 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":42632,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":1673,"thread_start_us":127179,"threads_started":2,"wal-append.queue_time_us":179154,"wal-append.run_cpu_time_us":2781,"wal-append.run_wall_time_us":1005964}
I20260709 13:00:37.567677  9495 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:37.600064  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:37.600601  1615 raft_consensus.cc:2393] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 17: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:37.602404  1609 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 18.
I20260709 13:00:37.604086  9614 raft_consensus.cc:3055] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:37.604589  9614 raft_consensus.cc:740] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:37.604694  9088 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:37.605584  2266 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:37.605373  9088 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.605721  9614 consensus_queue.cc:260] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.606419  9495 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.607214  9614 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:37.607637  9088 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:37.610248  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:37.599397  8627 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.587772  9456 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.617576  9602 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.618173  9602 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:37.624413  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.627652  9603 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:37.628113  1538 raft_consensus.cc:2410] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 22 because replica has last-logged OpId of term: 21 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 16.
I20260709 13:00:37.628216  9603 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.628824  9603 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:37.629119  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:37.629814  1538 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:37.631868  2300 raft_consensus.cc:2468] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:00:37.627677  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:37.632405  2300 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32802 (request call id 811) took 1417 ms. Trace:
I20260709 13:00:37.599243  9310 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.596766  9584 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:37.633600  2300 rpcz_store.cc:276] 0709 13:00:36.214609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.452320 (+1237711us) service_pool.cc:224] Handling call
0709 13:00:37.632344 (+180024us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:37.609385  9495 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:37.652751  1537 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 13:00:37.564527  9589 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.665282  8627 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:37.667636  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 79968.3us
I20260709 13:00:37.668663  2266 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:37.673108  9554 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.673977  9554 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.674718  9589 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:37.678145  1612 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 20.
W20260709 13:00:37.681519  1583 leader_election.cc:336] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 1.544s (SENT)
I20260709 13:00:37.681818  9456 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:37.683189  9385 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:37.683838  9385 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.686627  9614 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:37.687288  9614 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.689509  9614 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:37.658504  1540 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 22.
I20260709 13:00:37.651968  9310 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:37.692452  1614 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 18.
I20260709 13:00:37.693043  9385 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:37.704936  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 85682.2us
I20260709 13:00:37.694846  1540 raft_consensus.cc:1240] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:37.707377  2298 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 24.
I20260709 13:00:37.656725  9257 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:37.714555  9557 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:00:37.715348  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 46803.1us
I20260709 13:00:37.716141  2266 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:37.720093  1535 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 22.
I20260709 13:00:37.724285  9495 raft_consensus.cc:1064] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
W20260709 13:00:37.724871  9495 raft_consensus.cc:1068] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Unable to promote non-voter 1d6516ff61104bdda54bde95e92fe579: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:00:37.726294  9602 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:37.726472  9579 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:00:37.726867  9579 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.726930  9602 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:37.727295  9579 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:00:37.727368  9602 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:37.727855  9602 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:00:37.745219  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 46408.4us
I20260709 13:00:37.659967  9584 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.769397  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:37.769994  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 53953.4us
I20260709 13:00:37.770500  1540 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 21.
I20260709 13:00:37.771334  9304 raft_consensus.cc:697] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 21 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:37.772099  9624 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:37.772552  1538 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 20.
W20260709 13:00:37.773592  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:37.774379  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.750229  9557 raft_consensus.cc:697] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 23 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:37.750842  9603 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:37.790441  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.781421  9554 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:37.791358  1508 leader_election.cc:336] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 2.555s (SENT)
I20260709 13:00:37.795325  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1274) took 1709 ms. Trace:
I20260709 13:00:37.782586  9495 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:37.802659  9495 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.785246  9304 consensus_queue.cc:237] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:37.804289  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.806221  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:37.806362  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:37.805203  1505 leader_election.cc:400] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 23. Current term is 24.
I20260709 13:00:37.818692  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:37.795823  1536 rpcz_store.cc:276] 0709 13:00:36.034953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.035789 (+   836us) service_pool.cc:224] Handling call
0709 13:00:36.036237 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:36.036675 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:36.036705 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:36.038844 (+  2139us) log.cc:844] Serialized 26 byte log entry
0709 13:00:37.594746 (+1555902us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b1800030880. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf10d1 00007fc85d00ca0f
0709 13:00:37.702169 (+107423us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:37.702210 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.702336 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:37.729651 (+ 27315us) raft_consensus.cc:1685] finished
0709 13:00:37.729669 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.744674 (+ 15005us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1014,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":3637,"spinlock_wait_cycles":7437568,"thread_start_us":107104,"threads_started":1,"wal-append.queue_time_us":1682933}
I20260709 13:00:37.819397  1505 leader_election.cc:403] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
W20260709 13:00:37.791990  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 230924us
I20260709 13:00:37.801877  9584 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:37.772662  9260 consensus_queue.cc:1059] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 13:00:37.825037  2298 raft_consensus.cc:1240] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:00:37.814332  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1179) took 3218 ms. Trace:
I20260709 13:00:37.833231  1616 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 22.
W20260709 13:00:37.836099  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 76491.2us
I20260709 13:00:37.831813  1686 rpcz_store.cc:276] 0709 13:00:34.595286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.623313 (+ 28027us) service_pool.cc:224] Handling call
0709 13:00:34.793609 (+170296us) spinlock_profiling.cc:243] Waited 51.9 ms on lock 0x7b5800190898. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc86202afc0 00007fc862015929 00007fc8620153d2 00007fc85b58cbd4
0709 13:00:34.793811 (+   202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.756019 (+962208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.813813 (+2057794us) spinlock_profiling.cc:243] Waited 960 ms on lock 0x7b540022b0d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:37.814128 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2328125184}
I20260709 13:00:37.842252  1507 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:37.805267  9495 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:37.846766  8627 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:37.778666  9624 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:37.849140  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 44203.7us
I20260709 13:00:37.855386  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:37.856330  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 89276.9us
I20260709 13:00:37.855268  8627 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:37.863448  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:37.864053  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.850854  9554 raft_consensus.cc:3055] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:00:37.867676  2267 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:37.874583  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:37.875342  2300 raft_consensus.cc:2368] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 19. Current term is 20.
W20260709 13:00:37.876828  9612 log.cc:927] Time spent T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.064s	user 0.001s	sys 0.001s
I20260709 13:00:37.817073  9557 consensus_queue.cc:237] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.862419  9268 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 23. Current term is 24.
I20260709 13:00:37.879375  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3817) took 2389 ms. Trace:
I20260709 13:00:37.879803  1613 rpcz_store.cc:276] 0709 13:00:35.482971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.483118 (+   147us) service_pool.cc:224] Handling call
0709 13:00:35.483505 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:35.899036 (+415531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.834621 (+1935585us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b54002a67d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:37.871994 (+ 37373us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":953948032}
I20260709 13:00:37.885421  2267 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:37.866879  9608 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.891273  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:37.892575  9622 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.893270  9622 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:37.895792  9622 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:37.896289  9626 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 13:00:37.897349  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.898613  9618 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:00:37.899279  9618 raft_consensus.cc:697] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:37.900372  9618 consensus_queue.cc:237] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.902235  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:37.902912  1690 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 23.
I20260709 13:00:37.896926  9626 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.870877  9554 raft_consensus.cc:740] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:37.913479  1614 raft_consensus.cc:1275] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
W20260709 13:00:37.914361  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 44393us
I20260709 13:00:37.881464  9602 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.882431  9617 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.905499  9362 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:37.924952  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:37.925734  8627 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:37.927465  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.927788  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:37.910740  9622 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.923134  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:37.931891  2298 raft_consensus.cc:2393] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 23: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:37.932222  9621 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.932919  9621 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:37.936378  9576 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.937074  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:37.938195  1655 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:37.938748  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:37.939731  1687 raft_consensus.cc:2410] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:00:37.939858  9505 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:37.940567  9505 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:37.941118  9554 consensus_queue.cc:260] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.942441  9554 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:37.943089  9505 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:37.932055  1505 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:37.919214  9485 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:00:37.969198  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 47617.4us
I20260709 13:00:37.940245  1655 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:37.978741  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 44762.1us
I20260709 13:00:37.927311  9257 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.920753  9589 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.944671  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:37.931252  8627 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.945492  2300 raft_consensus.cc:2393] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 19: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:37.971168  9437 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:37.985571  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 119782us
I20260709 13:00:37.986048  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:37.968945  9590 log.cc:927] Time spent T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:00:37.991968  1534 consensus_meta.cc:287] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.648s	user 0.006s	sys 0.000s
I20260709 13:00:37.925637  9537 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:37.985531  1656 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:37.940475  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:37.997969  1686 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:37.940734  9339 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:38.002928  1683 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:38.004624  9437 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:38.009379  9525 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:38.009935  9525 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:38.010767  9437 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:38.012866  9525 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:38.017503  9602 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:38.003273  9505 consensus_queue.cc:1048] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:00:38.019634  1686 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:00:38.020362  9488 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.008299  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:38.022946  2294 raft_consensus.cc:2393] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 18: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:37.977064  9485 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.008150  8627 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:38.007187  1534 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 20.
I20260709 13:00:38.037708  1683 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 24.
I20260709 13:00:38.003062  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:38.043781  1684 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:38.007933  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:38.020896  9488 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.997565  9495 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:37.925426  9608 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:37.992590  9362 raft_consensus.cc:697] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 22 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:38.046718  1612 raft_consensus.cc:1240] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:38.044684  1682 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 17.
W20260709 13:00:38.053197  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.002883  9367 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.008046  9507 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:38.044998  9485 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:00:38.056600  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 71267.9us
I20260709 13:00:38.060628  1613 raft_consensus.cc:1275] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:00:38.007639  9409 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 13:00:38.076170  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 136000us
I20260709 13:00:38.076527  2294 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:00:37.946327  9617 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:38.050917  9495 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:37.937027  9576 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:38.001873  9589 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:37.999027  9257 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:38.058539  9505 raft_consensus.cc:2764] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 13:00:38.039789  9537 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:38.056954  9621 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:38.090728  1613 raft_consensus.cc:1275] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:00:38.093125  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:38.093926  2300 raft_consensus.cc:2393] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 21: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:38.095633  8627 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:38.098284  1656 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
W20260709 13:00:38.099360  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 185035us
I20260709 13:00:38.050855  9622 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:38.081840  9603 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:38.082527  9495 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:38.107609  1688 raft_consensus.cc:1275] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:00:38.075596  9367 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:38.113703  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:38.114638  2294 raft_consensus.cc:2410] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:00:38.117949  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:38.118634  1542 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 15.
I20260709 13:00:38.127425  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 31 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:38.128389  2294 raft_consensus.cc:2410] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 31 because replica has last-logged OpId of term: 29 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 28 index: 17.
I20260709 13:00:38.132833  1534 raft_consensus.cc:1240] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:00:38.084971  9409 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:38.111651  9505 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.112658  9624 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:38.135133  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:38.135252  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:38.135601  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:38.129604  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 130974us
W20260709 13:00:38.145687  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.135819  1581 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:38.136099  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:38.131080  9638 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.143781  1617 raft_consensus.cc:1240] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:00:38.121966  9507 raft_consensus.cc:2804] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:38.144795  1612 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:00:38.140265  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:38.109318  9579 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:38.150338  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:38.135501  9525 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:38.154134  9632 log.cc:927] Time spent T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:00:38.156829  1613 raft_consensus.cc:1275] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
I20260709 13:00:38.160509  9367 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:38.162392  9409 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:38.165768  9576 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:38.166949  9608 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:38.167603  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 69298.6us
I20260709 13:00:38.152657  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:38.151942  1615 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 16.
I20260709 13:00:38.170444  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:38.172364  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:38.171540  1581 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:38.176112  1684 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 22.
I20260709 13:00:38.175469  1613 pending_rounds.cc:85] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f: Aborting all ops after (but not including) 14
I20260709 13:00:38.210894  1538 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 15.
I20260709 13:00:38.144155  9339 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.196892  2267 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:38.207669  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.214478  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:38.209733  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 70332.2us
I20260709 13:00:38.156733  9622 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:38.214603  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:38.220268  1617 raft_consensus.cc:1240] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 22. Current term is 23. Ops: [20.14-22.15]
I20260709 13:00:38.222815  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:38.220499  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:38.215284  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:38.225455  2300 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 16.
I20260709 13:00:38.195644  9638 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:38.227298  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:38.229229  1687 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:00:38.229291  1617 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:00:38.215370  1685 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 22.
W20260709 13:00:38.229923  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 79532us
I20260709 13:00:38.225996  1682 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 20.
I20260709 13:00:38.149403  9626 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:38.212361  1613 pending_rounds.cc:107] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:00:38.238031  9642 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:38.238341  2267 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:38.238732  9642 raft_consensus.cc:697] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:38.239722  9642 consensus_queue.cc:237] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:38.240605  9456 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:38.241142  9456 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:38.241562  9456 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:38.146713  9505 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:38.215982  2269 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 1.512s (SENT) [suppressed 20 similar messages]
I20260709 13:00:38.234771  1613 raft_consensus.cc:2889] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:38.271046  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.141566  9362 consensus_queue.cc:237] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:38.195984  9525 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:38.278122  1686 raft_consensus.cc:3060] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:38.280138  1655 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:38.242704  9622 raft_consensus.cc:2764] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:00:38.288600  9639 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:38.289336  9639 raft_consensus.cc:697] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 21 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:38.290295  9639 consensus_queue.cc:237] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:38.292804  2300 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 30 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 29. Current term is 30. Ops: []
I20260709 13:00:38.293150  9617 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:38.292821  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:38.295792  9640 log.cc:927] Time spent T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:00:38.299937  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:38.300662  1616 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 25.
W20260709 13:00:38.301252  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 85256.2us
I20260709 13:00:38.310321  1617 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 28.
I20260709 13:00:38.272496  9507 raft_consensus.cc:697] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:38.312703  9507 consensus_queue.cc:237] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:38.316008  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:38.352952  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.315824  1581 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:38.329031  1691 raft_consensus.cc:2410] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:00:38.231230  9339 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:38.299405  9505 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:38.376859  1685 raft_consensus.cc:1217] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Deduplicated request from leader. Original: 6.7->[8.8-9.9]   Dedup: 9.9->[]
I20260709 13:00:38.378427  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:38.381659  9579 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 27 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:38.383353  9525 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:38.388669  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 80182.7us
I20260709 13:00:38.390827  1685 raft_consensus.cc:1240] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 9. Current term is 10. Ops: [8.8-9.9]
I20260709 13:00:38.309505  9257 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:38.397212  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:38.397212  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:38.401129  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:38.401643  1685 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:38.373481  9537 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:38.400602  1581 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:38.371451  9652 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:38.412539  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:38.413743  1581 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:38.413784  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:38.415426  8627 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:38.415861  8627 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.415951  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:38.416586  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:38.410738  2324 debug-util.cc:398] Leaking SignalData structure 0x7b080036b180 after lost signal to thread 434
I20260709 13:00:38.418329  9603 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:38.418931  9603 raft_consensus.cc:697] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 20 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:38.408398  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:38.422886  9652 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:38.423442  9652 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:38.395774  9589 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:38.427491  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 158257us
I20260709 13:00:38.391757  9608 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:00:38.418606  2324 debug-util.cc:398] Leaking SignalData structure 0x7b0800324040 after lost signal to thread 1474
I20260709 13:00:38.429323  8627 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:38.432135  1685 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 13:00:38.417335  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:38.436403  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:38.437187  1691 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 22.
I20260709 13:00:38.438743  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:38.441642  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:38.442533  1538 raft_consensus.cc:2410] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 26 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 13:00:38.444192  9485 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:38.446446  9485 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:38.446116  9456 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:38.449003  2300 raft_consensus.cc:2393] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 16: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:38.450232  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:38.450701  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:38.451434  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:38.452265  1612 raft_consensus.cc:2410] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 26 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 13:00:38.453138  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:38.454118  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:38.454803  1617 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
I20260709 13:00:38.455694  1684 raft_consensus.cc:1240] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:00:38.435132  9608 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.457650  9608 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:38.461073  1655 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:38.461401  1682 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:00:38.417420  9621 consensus_queue.cc:1059] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:00:38.462739  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:38.411433  9644 log.cc:927] Time spent T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:00:38.463483  1682 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 27.
I20260709 13:00:38.452080  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:38.465508  1614 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 23.
W20260709 13:00:38.406607  9310 consensus_meta.cc:287] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.692s	user 0.012s	sys 0.000s
I20260709 13:00:38.466965  9392 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:00:38.466711  9310 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:38.451077  1615 raft_consensus.cc:2393] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 23: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:38.469159  9310 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:38.469812  9412 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:00:38.474449  2324 debug-util.cc:398] Leaking SignalData structure 0x7b08003bae00 after lost signal to thread 1566
W20260709 13:00:38.475750  2324 debug-util.cc:398] Leaking SignalData structure 0x7b0800325be0 after lost signal to thread 1641
I20260709 13:00:38.454506  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:38.481457  9488 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:38.482754  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:38.483455  1616 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 22.
I20260709 13:00:38.484637  1541 raft_consensus.cc:1275] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:00:38.477952  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:38.485726  9339 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:38.486210  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:38.487160  1684 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:38.488072  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:38.462687  1655 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:38.491328  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:38.492126  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:38.492642  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 62260.1us
I20260709 13:00:38.493332  1686 raft_consensus.cc:2468] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 24.
I20260709 13:00:38.494311  8627 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:38.494809  1685 raft_consensus.cc:2393] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 24: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:38.490782  1687 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 22.
I20260709 13:00:38.501626  8627 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:38.419840  9603 consensus_queue.cc:237] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:38.503585  2324 debug-util.cc:398] Leaking SignalData structure 0x7b0800422400 after lost signal to thread 1715
W20260709 13:00:38.508370  2324 debug-util.cc:398] Leaking SignalData structure 0x7b0800406100 after lost signal to thread 2327
I20260709 13:00:38.509720  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:38.509981  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:38.510766  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:38.511770  1538 raft_consensus.cc:2410] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 23 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:00:38.515553  9621 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.516718  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:38.517305  1682 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:38.517983  1538 raft_consensus.cc:3055] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:38.518303  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:38.519295  1538 raft_consensus.cc:740] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:38.519529  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:38.520116  1541 raft_consensus.cc:3060] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:38.519145  1534 raft_consensus.cc:2410] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 13:00:38.524617  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.531672  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:38.533744  1535 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:38.533071  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:38.533075  2266 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:38.529968  2269 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:38.535740  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.538854  2266 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:38.541044  2266 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:38.544054  8627 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.544857  8627 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:38.513288  9617 raft_consensus.cc:3055] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:38.518713  9456 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:38.513031  9339 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:38.553402  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:38.555459  1536 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:38.547845  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:38.560364  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:38.573530  1616 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:00:38.574579  8627 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:38.576246  1685 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:38.516269  9621 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:38.583153  9621 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:38.561357  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:38.547787  9584 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:38.547493  9557 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:38.515043  9362 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.045s
I20260709 13:00:38.592181  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:38.591509  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 128878us
I20260709 13:00:38.524142  9651 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:38.552934  9638 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:38.611323  1535 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 22.
I20260709 13:00:38.612766  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:38.558779  9617 raft_consensus.cc:740] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:38.613737  2267 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:38.578550  9602 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:38.615136  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:38.617666  1684 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 23.
I20260709 13:00:38.622130  1534 pending_rounds.cc:85] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 12
I20260709 13:00:38.624554  1534 pending_rounds.cc:107] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 23.13
I20260709 13:00:38.624897  1534 raft_consensus.cc:2889] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:38.534134  9647 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.086s
I20260709 13:00:38.606493  1538 consensus_queue.cc:260] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:38.625000  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:38.629627  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:38.630321  1615 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:00:38.602320  9584 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.625468  1535 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:38.634789  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:38.601071  9557 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:38.636549  1536 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 25.
I20260709 13:00:38.630137  1684 raft_consensus.cc:2376] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21. Re-sending same reply.
I20260709 13:00:38.640791  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:38.642549  1685 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 19.
W20260709 13:00:38.644054  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 103038us
I20260709 13:00:38.649781  1536 raft_consensus.cc:1240] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 18. Current term is 19. Ops: []
W20260709 13:00:38.650633  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 145417us
W20260709 13:00:38.651741  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.621183  9555 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 13:00:38.647675  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 137220us
I20260709 13:00:38.653116  1582 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:38.647981  1581 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:38.641670  9584 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:00:38.706118  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.706198  1538 raft_consensus.cc:3060] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:38.642300  9557 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:38.643002  9647 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:00:38.714382  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.613757  9651 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:38.722318  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 74371.1us
I20260709 13:00:38.653149  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:38.723553  1684 raft_consensus.cc:2376] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 23. Re-sending same reply.
W20260709 13:00:38.720824  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:38.753443  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 101020us
I20260709 13:00:38.644855  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:38.754501  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 47140.7us
I20260709 13:00:38.646932  9621 consensus_queue.cc:1059] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.109s
W20260709 13:00:38.719447  9632 log.cc:927] Time spent T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:00:38.786146  2266 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:38.758297  1538 raft_consensus.cc:1275] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:00:38.798878  1538 pending_rounds.cc:85] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 9
I20260709 13:00:38.789573  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:38.799356  1538 pending_rounds.cc:107] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:00:38.799621  1538 raft_consensus.cc:2889] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:38.757782  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:38.755542  9304 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:00:38.756268  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 50869.2us
W20260709 13:00:38.807631  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:38.808732  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.806844  1690 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 13:00:38.782925  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:38.810039  1685 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:00:38.801357  9495 consensus_meta.cc:287] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.670s	user 0.005s	sys 0.006s
I20260709 13:00:38.784899  9437 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:38.837922  2269 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:38.711576  9555 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:38.844053  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:38.840677  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:38.844861  1684 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 13:00:38.755645  9629 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:38.801151  9647 raft_consensus.cc:697] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 22 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:38.807674  9339 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.753190  9617 consensus_queue.cc:260] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:38.863636  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:38.858336  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 51301.5us
I20260709 13:00:38.779822  9367 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:00:38.783982  9652 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:38.859956  2269 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:38.868647  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 378697us
I20260709 13:00:38.872861  1582 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:38.879359  1685 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 28.
I20260709 13:00:38.808269  9304 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.835359  9642 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:38.866572  2266 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:38.803639  9456 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.048s
I20260709 13:00:38.867993  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:38.869690  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:38.870327  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.228781   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:38.854370  9629 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.842242  9495 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:38.916314  1684 raft_consensus.cc:1275] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 13:00:38.917325  1686 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 13:00:38.784776  9602 raft_consensus.cc:697] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:38.845599  9485 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:00:38.921082  2294 raft_consensus.cc:1240] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 22. Current term is 23. Ops: []
I20260709 13:00:38.921667  2269 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:38.830567  1535 raft_consensus.cc:2468] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 23.
I20260709 13:00:38.923234  2298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32788 (request call id 764) took 1047 ms. Trace:
I20260709 13:00:38.917838  1686 pending_rounds.cc:85] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 14
I20260709 13:00:38.924045  1542 raft_consensus.cc:1240] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:38.925820  1690 raft_consensus.cc:2410] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:00:38.916919  1684 pending_rounds.cc:85] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 11
I20260709 13:00:38.926779  1684 pending_rounds.cc:107] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:00:38.927119  1684 raft_consensus.cc:2889] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:38.881076  9666 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:38.924439  1686 pending_rounds.cc:107] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 13:00:38.938525  1686 raft_consensus.cc:2889] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:38.887337  9642 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.885139  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:38.923681  2298 rpcz_store.cc:276] 0709 13:00:37.873641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.873774 (+   133us) service_pool.cc:224] Handling call
0709 13:00:38.920733 (+1046959us) spinlock_profiling.cc:243] Waited 39.8 ms on lock 0x7b5400a49554. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:38.920894 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91599104}
W20260709 13:00:38.931836  9655 log.cc:927] Time spent T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
W20260709 13:00:38.932937  9659 log.cc:927] Time spent T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:00:38.907765  9629 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:00:38.943315  9658 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:00:38.944845  9368 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:00:38.946336  9663 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:38.909271  9623 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:00:38.952327  9651 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:39.006647  9642 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:00:38.952828  1508 leader_election.cc:336] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 1.566s (SENT)
W20260709 13:00:38.955143  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 67314us
I20260709 13:00:38.881068  9488 consensus_queue.cc:1059] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
W20260709 13:00:39.032621  9661 log.cc:927] Time spent T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.192s	user 0.000s	sys 0.005s
I20260709 13:00:39.053966  1655 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:38.872786  9339 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:38.965370  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:38.966603  9621 raft_consensus.cc:3055] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:38.967842  9637 consensus_queue.cc:1059] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:38.971293  9011 raft_consensus.cc:1064] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
W20260709 13:00:38.973223  9667 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.052s	user 0.002s	sys 0.000s
I20260709 13:00:38.979276  9652 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:38.985337  2299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32788 (request call id 766) took 1013 ms. Trace:
I20260709 13:00:38.989369  1539 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 15. (term mismatch)
I20260709 13:00:38.989668  9495 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:39.011888  1541 raft_consensus.cc:2468] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 23.
I20260709 13:00:39.012408  1685 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 14.
I20260709 13:00:39.013324  1615 raft_consensus.cc:2468] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 27.
I20260709 13:00:39.013722  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:38.920168  9670 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:00:39.031342  9668 log.cc:927] Time spent T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.004s
W20260709 13:00:39.039875  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 166983us
I20260709 13:00:39.073590  1687 raft_consensus.cc:1275] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:00:39.040241  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:39.047187  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 180578us
I20260709 13:00:39.050900  9663 raft_consensus.cc:697] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 22 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:38.884655  9304 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:39.053957  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:39.087148  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:39.069129  1539 pending_rounds.cc:85] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting all ops after (but not including) 14
I20260709 13:00:39.088958  1539 pending_rounds.cc:107] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting uncommitted NO_OP operation due to leader change: 22.15
I20260709 13:00:39.089238  1539 raft_consensus.cc:2889] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:39.058734  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1288) took 1796 ms. Trace:
I20260709 13:00:39.068508  2299 rpcz_store.cc:276] 0709 13:00:37.971779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.971945 (+   166us) service_pool.cc:224] Handling call
0709 13:00:38.984943 (+1012998us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b54008e9754. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:38.985219 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":937456000}
I20260709 13:00:39.040918  1508 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:39.075001  2266 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:39.076005  1582 leader_election.cc:400] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Vote denied by peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437) with higher term. Message: Invalid argument: T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 19. Current term is 20.
I20260709 13:00:39.092450  1582 leader_election.cc:403] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:39.076082  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:39.077575  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 183559us
I20260709 13:00:38.966650  9647 consensus_queue.cc:237] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:39.093364  2269 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:39.077696  9367 consensus_queue.cc:1059] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:39.030439  9639 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:39.096242  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:39.100639  1682 consensus_meta.cc:287] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.558s	user 0.008s	sys 0.016s
I20260709 13:00:39.064242  9621 raft_consensus.cc:740] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:39.103271  1686 raft_consensus.cc:2393] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 23: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:39.113700  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:39.114588  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:39.104250  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 349784us
I20260709 13:00:39.090301  1537 rpcz_store.cc:276] 0709 13:00:37.262457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.680401 (+417944us) service_pool.cc:224] Handling call
0709 13:00:37.681359 (+   958us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:37.728755 (+ 47396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:37.728784 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:37.729300 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 13:00:37.822712 (+ 93412us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:00:37.822754 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.040659 (+1217905us) spinlock_profiling.cc:243] Waited 37.6 ms on lock 0x7b540010c2d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:39.040720 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:39.040780 (+    60us) raft_consensus.cc:1685] finished
0709 13:00:39.040792 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:39.058657 (+ 17865us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6543,"raft.queue_time_us":1480,"raft.run_cpu_time_us":3435,"raft.run_wall_time_us":23020,"spinlock_wait_cycles":86385408,"thread_start_us":93009,"threads_started":1,"wal-append.queue_time_us":99598,"wal-append.run_cpu_time_us":2220,"wal-append.run_wall_time_us":1002240}
I20260709 13:00:39.105036  1682 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 24.
I20260709 13:00:39.103399  1655 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:39.105801  1685 raft_consensus.cc:1240] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:39.116991  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:39.118659  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:39.075274  9670 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:39.115674  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:39.077505  9638 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:39.123587  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:39.124131  1690 raft_consensus.cc:1240] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 21. Current term is 23. Ops: [21.15-21.15]
I20260709 13:00:39.128979  2299 raft_consensus.cc:2393] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 24: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:39.103996  9666 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:39.133257  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:39.139797  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 65761.9us
I20260709 13:00:39.140187  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1195) took 1238 ms. Trace:
I20260709 13:00:39.140645  1688 rpcz_store.cc:276] 0709 13:00:37.902013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.913047 (+ 11034us) service_pool.cc:224] Handling call
0709 13:00:37.922010 (+  8963us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:38.109358 (+187348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.139931 (+1030573us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b540041bc54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:39.140131 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":425948544}
I20260709 13:00:39.139025  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:39.114836  9437 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437) with higher term. Message: Invalid argument: T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 19. Current term is 20.
I20260709 13:00:39.121497  9624 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:39.162439  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 209580us
I20260709 13:00:39.163493  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:39.120544  9554 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:00:39.123139  9638 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:39.128774  9670 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:39.174085  2296 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:00:39.171465  1582 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:39.132870  9652 raft_consensus.cc:3055] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:39.172062  8627 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:00:39.138881  9666 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:39.131840  9622 consensus_queue.cc:1048] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:00:39.092861  9602 consensus_queue.cc:237] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:39.185554  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.241627  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:39.176390  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:39.123168  9485 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:00:39.157603  9488 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:39.232853  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:39.246887  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:39.231376  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:39.247615  1684 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 13:00:39.248332  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:39.250031  1683 raft_consensus.cc:1275] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:00:39.249579  9621 consensus_queue.cc:260] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:39.250751  9621 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:39.251410  1683 raft_consensus.cc:1275] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:00:39.241003  9666 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:39.257810  9011 consensus_queue.cc:237] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 16, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:39.260592  9663 consensus_queue.cc:237] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:39.216166  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 44738us
I20260709 13:00:39.227696  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:39.247149  1686 raft_consensus.cc:2410] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 23 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:00:39.242883  2302 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:39.273406  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:39.274212  1684 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 21.
I20260709 13:00:39.173255  9638 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:39.276836  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:39.265251  2266 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:39.166159  9555 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:39.280725  2266 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:39.266817  1582 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 13:00:39.284094  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 180676us
I20260709 13:00:39.293190  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:39.293936  1688 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 13:00:39.296584  1683 raft_consensus.cc:1240] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 23. Current term is 24. Ops: [21.12-23.13]
W20260709 13:00:39.276166  9608 consensus_meta.cc:287] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.818s	user 0.014s	sys 0.003s
I20260709 13:00:39.238041  9639 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:39.278275  9392 consensus_meta.cc:287] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.800s	user 0.011s	sys 0.015s
I20260709 13:00:39.286149  1582 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:39.301649  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:39.242049  9652 raft_consensus.cc:740] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 13:00:39.305115  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 178445us
I20260709 13:00:39.308104  1688 raft_consensus.cc:1240] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:39.315043  1683 raft_consensus.cc:1275] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:00:39.293395  9362 raft_consensus.cc:2804] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:00:39.312739  1533 raft_consensus.cc:2410] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 31 because replica has last-logged OpId of term: 29 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 28 index: 17.
I20260709 13:00:39.302404  9633 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:00:39.318281  1688 raft_consensus.cc:1275] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:00:39.298818  9622 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:39.232049  9304 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:39.226203  9642 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:39.329507  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.327175  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:39.331051  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:39.317565  9547 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:39.334024  2301 raft_consensus.cc:2393] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 28: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:39.301191  9495 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.023s
I20260709 13:00:39.328666  1582 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:39.331817  1683 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 22.
I20260709 13:00:39.306682  9608 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:39.323858  9088 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.339998  1689 raft_consensus.cc:1240] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:39.327589  9622 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.344554  2303 raft_consensus.cc:1240] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:00:39.349323  9617 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:39.369457  1684 raft_consensus.cc:1240] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:39.357442  1688 raft_consensus.cc:1275] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:00:39.357101  9088 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:39.382207  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 53563.6us
I20260709 13:00:39.355336  9676 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:39.381486  1583 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:39.389978  9676 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:00:39.390270  9557 consensus_meta.cc:287] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.607s	user 0.007s	sys 0.014s
I20260709 13:00:39.390748  9557 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:39.394316  9339 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:39.400806  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:39.402122  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:39.407275  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:39.415774  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:39.415863  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:39.417946  1613 raft_consensus.cc:1240] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 21 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:39.419080  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:39.419938  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:39.421438  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:39.422633  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:39.423501  1683 raft_consensus.cc:2410] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 25 because replica has last-logged OpId of term: 24 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 18.
I20260709 13:00:39.424418  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:39.344745  9652 consensus_queue.cc:260] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:39.339141  9362 raft_consensus.cc:697] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 27 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:39.402731  1583 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:39.429067  1583 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:39.425621  1683 raft_consensus.cc:2368] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 23. Current term is 24.
I20260709 13:00:39.425814  2295 raft_consensus.cc:1240] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 23. Current term is 24. Ops: []
I20260709 13:00:39.426024  2302 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 22.
I20260709 13:00:39.402784  1687 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 10.
I20260709 13:00:39.434732  9639 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:00:39.435304  9608 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:39.436434  9362 consensus_queue.cc:237] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:39.438016  9651 raft_consensus.cc:3055] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:39.438445  9651 raft_consensus.cc:740] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:39.438567  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:39.439199  1688 raft_consensus.cc:2376] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 28 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 28. Re-sending same reply.
I20260709 13:00:39.439345  9651 consensus_queue.cc:260] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:39.440824  9676 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:39.441368  9676 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.433025  1583 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:39.446906  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:39.441730  9676 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:39.456904  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:39.355542  9622 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:00:39.451508  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:39.466413  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:39.466948  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.469722  9642 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:39.470579  1583 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:39.471935  9639 raft_consensus.cc:2804] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:00:39.473409  1583 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:39.470878  9304 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:39.474658  8627 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:39.472533  9639 raft_consensus.cc:697] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 23 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:39.476235  8627 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:39.476864  8627 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:00:39.433576  9584 consensus_meta.cc:287] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.652s	user 0.005s	sys 0.011s
I20260709 13:00:39.483314  9626 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.483575  9663 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:00:39.483459  9584 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:39.484048  9626 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:39.487365  2298 raft_consensus.cc:1240] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 18. Current term is 19. Ops: []
W20260709 13:00:39.484884  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.488425  9626 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:39.488386  9584 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:39.492079  8627 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:39.493342  9651 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:39.488564  9675 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:00:39.506433  9557 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:39.496819  9629 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:39.524863  1583 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:39.526510  1583 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:39.526186  9675 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:00:39.533890  9639 consensus_queue.cc:237] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:39.535074  9675 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:39.540357  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:39.543619  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:39.557329  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:39.565681  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 4036) took 1184 ms. Trace:
I20260709 13:00:39.566218  1684 rpcz_store.cc:276] 0709 13:00:38.381214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.274882 (+893668us) service_pool.cc:224] Handling call
0709 13:00:39.355346 (+ 80464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:39.374560 (+ 19214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.565411 (+190851us) spinlock_profiling.cc:243] Waited 61.4 ms on lock 0x7b54003377d0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:39.565596 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141223808}
I20260709 13:00:39.618623  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 4029) took 1239 ms. Trace:
I20260709 13:00:39.619079  1690 rpcz_store.cc:276] 0709 13:00:38.379103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.095206 (+716103us) service_pool.cc:224] Handling call
0709 13:00:39.123893 (+ 28687us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:39.130467 (+  6574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.618395 (+487928us) spinlock_profiling.cc:243] Waited 6.32 ms on lock 0x7b54003b6ad0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:39.618554 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14533504}
I20260709 13:00:39.620666  9547 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:39.621585  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 4641) took 2267 ms. Trace:
I20260709 13:00:39.622067  1533 rpcz_store.cc:276] 0709 13:00:37.354016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.589473 (+235457us) service_pool.cc:224] Handling call
0709 13:00:39.562616 (+1973143us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b540010b3d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:39.621531 (+ 58915us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3911258496}
W20260709 13:00:39.623579  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.628810  9629 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:39.629240  9666 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:39.630488  2297 raft_consensus.cc:2393] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 23: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
W20260709 13:00:39.630937  9690 log.cc:927] Time spent T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.080s	user 0.003s	sys 0.000s
I20260709 13:00:39.634433  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1300) took 1200 ms. Trace:
I20260709 13:00:39.634959  1542 rpcz_store.cc:276] 0709 13:00:38.433718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.433878 (+   160us) service_pool.cc:224] Handling call
0709 13:00:38.434188 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:38.924972 (+490784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.634114 (+709142us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b540021a2d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:39.634355 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1125506816}
I20260709 13:00:39.634455  1615 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 19.
I20260709 13:00:39.637180  9638 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:39.620805  9688 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.096s	user 0.000s	sys 0.005s
I20260709 13:00:39.638206  1614 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 13:00:39.639865  2299 raft_consensus.cc:1240] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:39.641269  9495 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:39.642174  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.645088  2301 raft_consensus.cc:1240] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:39.664408  9088 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:39.667122  9652 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:39.646456  9670 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:39.677042  2300 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 13:00:39.678855  9670 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:39.653394  9676 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:39.657114  2294 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32794 (request call id 1114) took 1350 ms. Trace:
I20260709 13:00:39.679698  2294 rpcz_store.cc:276] 0709 13:00:38.306427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.306567 (+   140us) service_pool.cc:224] Handling call
0709 13:00:38.920883 (+614316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:38.921530 (+   647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.656860 (+735330us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b5400a49550. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:39.657047 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1261053824}
I20260709 13:00:39.659245  9339 consensus_queue.cc:1059] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:39.681418  9339 raft_consensus.cc:3055] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:39.681843  9339 raft_consensus.cc:740] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:39.682773  9339 consensus_queue.cc:260] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:39.659973  9507 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.661415  9651 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.664745  9679 consensus_queue.cc:1059] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.011s
I20260709 13:00:39.680689  9088 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:39.683264  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 4035) took 1302 ms. Trace:
I20260709 13:00:39.684871  9507 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:39.685155  9412 raft_consensus.cc:3055] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:39.673604  2298 raft_consensus.cc:1275] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:00:39.685801  9412 raft_consensus.cc:740] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:39.685547  9088 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:39.669718  9495 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:39.686825  9412 consensus_queue.cc:260] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:39.688282  9495 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:39.685067  1686 rpcz_store.cc:276] 0709 13:00:38.380952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.269724 (+888772us) service_pool.cc:224] Handling call
0709 13:00:39.293145 (+ 23421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:39.302403 (+  9258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:39.302439 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:39.317355 (+ 14916us) log.cc:844] Serialized 26 byte log entry
0709 13:00:39.425873 (+108518us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:00:39.425912 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.426098 (+   186us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:39.683063 (+256965us) raft_consensus.cc:1685] finished
0709 13:00:39.683084 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:39.683205 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":184,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":5660,"thread_start_us":87534,"threads_started":1,"wal-append.queue_time_us":172727}
I20260709 13:00:39.685316  9651 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:39.668812  2303 raft_consensus.cc:1240] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 22. Current term is 23. Ops: []
I20260709 13:00:39.688076  9412 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:39.689529  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:39.691256  9651 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:39.689014  9507 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:39.695459  9672 log.cc:927] Time spent T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.520s	user 0.005s	sys 0.000s
I20260709 13:00:39.688019  9088 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:39.684255  9339 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:39.696722  9675 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:00:39.698539  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 161987us
I20260709 13:00:39.702391  1616 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:00:39.702570  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:39.703145  1611 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:39.703408  1583 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:39.703725  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:39.704087  9675 consensus_queue.cc:1048] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:39.681414  9676 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:39.705768  1616 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:00:39.705679  9621 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.706516  1608 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:00:39.706650  9621 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:39.707392  1508 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:39.708302  9088 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:00:39.708956  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:39.709805  1608 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:00:39.710085  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:39.711550  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:39.712289  1612 raft_consensus.cc:2393] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 17: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:39.715572  9362 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:39.717964  9362 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:00:39.708809  9621 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:39.719071  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.708927  9088 raft_consensus.cc:697] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:39.720917  9621 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:39.721273  9088 consensus_queue.cc:237] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.19, Last appended by leader: 19, Current term: 28, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:39.728538  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:39.729020  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.729287  9392 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.729838  9392 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:39.730439  9495 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.731678  9554 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:39.732307  9392 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:39.730228  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:39.734090  1691 raft_consensus.cc:2376] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 24. Re-sending same reply.
I20260709 13:00:39.735033  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:39.735242  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:39.736202  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:39.734920  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4814) took 1566 ms. Trace:
I20260709 13:00:39.737367  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:39.763473  1682 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:39.737613  1689 rpcz_store.cc:276] 0709 13:00:38.168682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.186189 (+ 17507us) service_pool.cc:224] Handling call
0709 13:00:38.222070 (+ 35881us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:39.356678 (+1134608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.734703 (+378025us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54000df554. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:39.734863 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2569196416}
I20260709 13:00:39.765261  9621 consensus_queue.cc:1059] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:00:39.766244  9547 consensus_queue.cc:1059] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:00:39.767493  9675 raft_consensus.cc:3055] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:39.767972  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:39.741499  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:39.768802  1690 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 22.
I20260709 13:00:39.729761  1686 raft_consensus.cc:1275] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 13:00:39.769742  1613 raft_consensus.cc:1240] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 16. Current term is 18. Ops: []
I20260709 13:00:39.734954  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:39.767865  9675 raft_consensus.cc:740] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:39.763037  1615 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 23.
I20260709 13:00:39.770474  1612 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 30.
I20260709 13:00:39.771294  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:39.770993  9675 consensus_queue.cc:260] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:39.771550  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:39.772065  1615 raft_consensus.cc:2393] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 21: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:39.772539  9675 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:39.772927  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:39.773655  1615 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 25.
I20260709 13:00:39.769641  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:39.775372  1615 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 26. Current term is 27. Ops: []
I20260709 13:00:39.776593  1615 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 25. Current term is 26. Ops: []
I20260709 13:00:39.769635  1686 pending_rounds.cc:85] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 12
I20260709 13:00:39.789729  1686 pending_rounds.cc:107] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:00:39.790145  1686 raft_consensus.cc:2889] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:39.772815  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:39.791994  1682 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 13:00:39.780354  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:39.801271  1689 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:39.781023  9547 raft_consensus.cc:3055] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:39.801802  9547 raft_consensus.cc:740] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:39.802714  9547 consensus_queue.cc:260] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:39.803929  9547 raft_consensus.cc:3060] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:39.785394  9412 consensus_queue.cc:1048] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:00:39.784951  1438 catalog_manager.cc:5697] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:39.737493  1654 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:39.807606  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 83162.8us
I20260709 13:00:39.807739  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:39.808455  2296 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 30.
I20260709 13:00:39.808656  9412 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:00:39.809494  1654 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:39.788324  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:39.813357  2303 raft_consensus.cc:2393] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 16: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:39.814222  1616 raft_consensus.cc:1240] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:39.762988  9495 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:39.777437  9671 consensus_queue.cc:1059] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:00:39.793773  9554 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.817418  9671 raft_consensus.cc:3055] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:39.817869  9671 raft_consensus.cc:740] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
W20260709 13:00:39.819789  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 89708.2us
I20260709 13:00:39.814234  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:39.821308  1686 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:39.819940  9671 consensus_queue.cc:260] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:39.796885  1583 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:39.825184  1583 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:39.827116  1583 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:39.809777  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:39.780856  1610 raft_consensus.cc:2393] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 15: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:39.816584  9507 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:39.817152  9554 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:39.780408  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:39.827793  9637 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:39.828159  9676 consensus_queue.cc:1048] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:00:39.828325  9555 consensus_queue.cc:1048] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:39.829541  9260 consensus_queue.cc:1048] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:00:39.773881  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:39.790256  1615 raft_consensus.cc:1275] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:00:39.834991  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:39.859450  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:39.835783  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:39.838004  1581 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:39.650969  9666 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:39.659475  9622 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:39.839013  9495 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:39.794230  9701 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:39.875958  1686 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 23.
I20260709 13:00:39.835639  8627 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:39.776873  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.612780  9708 consensus_queue.cc:1048] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:00:40.746991  1505 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.917s	user 0.020s	sys 0.016s
W20260709 13:00:41.496771  1505 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.667s	user 0.022s	sys 0.016s
W20260709 13:00:41.497169  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 1.66644e+06us
I20260709 13:00:40.777715  1438 catalog_manager.cc:5697] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 15 to 17, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 17 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:39.861081  1583 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:40.128495  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.871042  1608 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 20.
W20260709 13:00:41.648201  1608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 1179) took 1940 ms (client timeout 2119 ms). Trace:
I20260709 13:00:40.763574  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:40.036882  1614 raft_consensus.cc:2393] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 17: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 13:00:41.658756  1614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 1175) took 1956 ms (client timeout 1733 ms). Trace:
W20260709 13:00:41.659129  1614 rpcz_store.cc:269] 0709 13:00:39.701860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.703474 (+  1614us) service_pool.cc:224] Handling call
0709 13:00:41.658533 (+1955059us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b5400444b54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:41.658682 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":763505024}
I20260709 13:00:40.078452  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:41.661418  1615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 3838) took 1782 ms (client timeout 1912 ms). Trace:
W20260709 13:00:41.661818  1615 rpcz_store.cc:269] 0709 13:00:39.879029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.879258 (+   229us) service_pool.cc:224] Handling call
0709 13:00:41.661363 (+1782105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:41.662719  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:41.663439  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 3849) took 1152 ms. Trace:
I20260709 13:00:41.663726  1615 rpcz_store.cc:276] 0709 13:00:40.510721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.662453 (+1151732us) service_pool.cc:224] Handling call
0709 13:00:41.663384 (+   931us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:39.869387  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:41.665230  1616 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 22.
W20260709 13:00:41.665685  1616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 3837) took 1896 ms (client timeout 2155 ms). Trace:
W20260709 13:00:41.665995  1616 rpcz_store.cc:269] 0709 13:00:39.848575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.858440 (+  9865us) service_pool.cc:224] Handling call
0709 13:00:41.665629 (+1807189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:39.880553  1617 raft_consensus.cc:1240] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 20 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:41.669157  1538 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:00:40.201767  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:41.671103  1655 connection.cc:256] RPC call timeout handler was delayed by -1.0140610020000054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
W20260709 13:00:41.671445  1655 connection.cc:256] RPC call timeout handler was delayed by -1.0140610020000054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
W20260709 13:00:41.671746  1655 connection.cc:256] RPC call timeout handler was delayed by -1.0023610019999865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
W20260709 13:00:40.171535  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:41.709722  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:39.861061  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.861622  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:39.868312  1683 raft_consensus.cc:2410] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for term 19 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 15.
I20260709 13:00:39.860214  1684 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 24.
W20260709 13:00:41.805716  1684 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33206 (request call id 1224) took 1966 ms (client timeout 1585 ms). Trace:
W20260709 13:00:41.806124  1684 rpcz_store.cc:269] 0709 13:00:39.839310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.859168 (+ 19858us) service_pool.cc:224] Handling call
0709 13:00:41.805634 (+1946466us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:41.807415  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 13:00:40.747735  1685 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.002s	sys 0.009s
I20260709 13:00:41.810640  9739 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:41.811241  9739 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:40.041239  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:41.812855  1686 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:40.258487  1689 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 22.
W20260709 13:00:41.816990  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33206 (request call id 1213) took 2037 ms (client timeout 1504 ms). Trace:
W20260709 13:00:41.817399  1689 rpcz_store.cc:269] 0709 13:00:39.779950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.780064 (+   114us) service_pool.cc:224] Handling call
0709 13:00:41.816903 (+2036839us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:41.818439  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:41.819037  1689 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:00:41.819805  1563 debug-util.cc:398] Leaking SignalData structure 0x7b080024dd20 after lost signal to thread 434
W20260709 13:00:41.821005  1563 debug-util.cc:398] Leaking SignalData structure 0x7b08001c5d00 after lost signal to thread 1474
W20260709 13:00:41.822384  1563 debug-util.cc:398] Leaking SignalData structure 0x7b080014acc0 after lost signal to thread 1566
W20260709 13:00:41.823144  1563 debug-util.cc:398] Leaking SignalData structure 0x7b08003d4420 after lost signal to thread 1611
W20260709 13:00:41.823828  1563 debug-util.cc:398] Leaking SignalData structure 0x7b08003931a0 after lost signal to thread 1641
W20260709 13:00:41.805387  1683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33206 (request call id 1214) took 1971 ms (client timeout 1511 ms). Trace:
I20260709 13:00:40.151700  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 13:00:40.361598  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.826354  9739 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:40.613595  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 51516.6us
I20260709 13:00:41.832645  9623 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.833254  9623 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:39.866398  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:41.838279  2295 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32794 (request call id 1132) took 1991 ms (client timeout 1647 ms). Trace:
W20260709 13:00:41.838672  2295 rpcz_store.cc:269] 0709 13:00:39.846873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.847005 (+   132us) service_pool.cc:224] Handling call
0709 13:00:41.838172 (+1991167us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:40.236243  2297 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.007s	sys 0.011s
W20260709 13:00:41.840891  2297 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.189s	user 0.008s	sys 0.011s
I20260709 13:00:39.865697  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:41.842459  2303 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32794 (request call id 1130) took 1996 ms (client timeout 2041 ms). Trace:
W20260709 13:00:41.842792  2303 rpcz_store.cc:269] 0709 13:00:39.846068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.846212 (+   144us) service_pool.cc:224] Handling call
0709 13:00:41.842400 (+1996188us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:40.307677  9339 consensus_meta.cc:287] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.611s	user 0.010s	sys 0.000s
I20260709 13:00:40.762239  9304 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:40.615193  9362 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.855650  9304 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:39.999023  9507 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:41.858597  9507 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:39.876924  9547 raft_consensus.cc:2804] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:00:40.500597  9554 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:40.235965  9602 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.003s	sys 0.014s
W20260709 13:00:41.866485  9602 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.238s	user 0.004s	sys 0.016s
I20260709 13:00:40.664287  9622 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:39.860060  9637 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.108534  9639 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:39.993059  9647 consensus_queue.cc:1059] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.229s
I20260709 13:00:41.811097  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1211) took 2032 ms. Trace:
W20260709 13:00:40.389596  9652 consensus_meta.cc:287] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.713s	user 0.009s	sys 0.002s
I20260709 13:00:39.870093  9675 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:41.876621  9740 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.877002  2296 raft_consensus.cc:1240] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 27 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 26. Current term is 27. Ops: []
I20260709 13:00:41.877117  9740 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:41.879268  2298 raft_consensus.cc:1240] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 19. Current term is 20. Ops: []
W20260709 13:00:40.677011  9696 log.cc:927] Time spent T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
W20260709 13:00:40.619740  9697 log.cc:927] Time spent T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 13:00:40.620640  9698 log.cc:927] Time spent T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:00:39.890911  9701 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:39.667582  9638 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:39.822968  9671 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:41.939560  9304 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:40.961118  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 1.25308e+06us
W20260709 13:00:41.245483  9707 log.cc:927] Time spent T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.630s	user 0.000s	sys 0.007s
I20260709 13:00:41.366565  9456 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:41.941331  9456 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:41.943975  9456 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:41.502976  1438 catalog_manager.cc:5697] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 16 to 17, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 17 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:39.793728  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.945315  1438 catalog_manager.cc:5697] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:41.947335  1537 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:41.946867  1438 catalog_manager.cc:5697] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 26 to 28, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 28 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:41.544327  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 46261.2us
I20260709 13:00:41.943706  1508 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:41.948884  9554 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.949488  9554 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:41.951848  9554 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:41.952574  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:41.545531  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4853) took 1750 ms. Trace:
I20260709 13:00:41.548738  9718 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:41.953639  9718 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:41.549253  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:41.551084  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:41.549543  9717 consensus_queue.cc:1048] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:00:41.584270  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:41.585880  1541 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:00:41.597308  9676 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:41.612003  9617 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.634789  9608 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:41.642252  9725 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.646332  1507 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:41.648307  1609 raft_consensus.cc:1240] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:39.862331  1611 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 19.
I20260709 13:00:41.986974  1533 raft_consensus.cc:1275] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
W20260709 13:00:41.649283  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:41.648646  1608 rpcz_store.cc:269] 0709 13:00:39.707782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.708692 (+   910us) service_pool.cc:224] Handling call
0709 13:00:41.648139 (+1939447us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:41.654979  1582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.892s	user 0.013s	sys 0.003s
I20260709 13:00:41.669883  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3819) took 2256 ms. Trace:
I20260709 13:00:41.672576  1536 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:00:41.672915  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:41.988502  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:41.673348  1610 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 3840) took 1426 ms (client timeout 1524 ms). Trace:
I20260709 13:00:41.989281  1608 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 22.
I20260709 13:00:41.673900  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:41.989892  1608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 3843) took 1558 ms (client timeout 1913 ms). Trace:
I20260709 13:00:41.701907  9727 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 13:00:41.992672  1582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.230s	user 0.014s	sys 0.003s
W20260709 13:00:41.702096  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 1.84001e+06us
I20260709 13:00:41.706485  9651 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.992805  1612 raft_consensus.cc:1240] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:41.994299  1536 raft_consensus.cc:1275] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:00:41.692581  9412 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.716794  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:41.721452  9730 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 13:00:41.747459  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 55041.9us
I20260709 13:00:41.725227  9722 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:41.751662  9721 log.cc:927] Time spent T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:00:41.758608  9732 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:41.761368  1439 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54582 (request call id 321) took 25341 ms (client timeout 15000 ms). Trace:
I20260709 13:00:41.789062  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4855) took 1993 ms. Trace:
I20260709 13:00:41.792695  9736 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.809149  9738 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:41.824642  1683 rpcz_store.cc:269] 0709 13:00:39.834235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.834729 (+   494us) service_pool.cc:224] Handling call
0709 13:00:41.805271 (+1970542us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:41.836759  9708 consensus_queue.cc:1048] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:41.844786  9579 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:41.848598  9739 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 13:00:41.849582  1654 connection.cc:256] RPC call timeout handler was delayed by -1.0708361859999513s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
I20260709 13:00:41.849720  9743 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.856230  9362 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:39.878242  9368 consensus_queue.cc:1059] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.336s
I20260709 13:00:42.045368  9368 raft_consensus.cc:3055] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:00:42.045773  9368 raft_consensus.cc:740] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:42.046643  9368 consensus_queue.cc:260] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:42.047889  9368 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:42.026017  9738 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:42.050549  9738 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:41.857393  1690 raft_consensus.cc:2410] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
W20260709 13:00:42.052778  1690 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33206 (request call id 1222) took 2214 ms (client timeout 1733 ms). Trace:
W20260709 13:00:42.053171  1690 rpcz_store.cc:269] 0709 13:00:39.838780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.000550 (+161770us) service_pool.cc:224] Handling call
0709 13:00:42.052540 (+2051990us) spinlock_profiling.cc:243] Waited 31.5 ms on lock 0x7b5400392454. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:42.052682 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72535808}
I20260709 13:00:41.869634  9637 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:41.870405  9639 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:42.008191  9412 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:42.056357  9639 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:41.873106  9507 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:41.874226  1685 rpcz_store.cc:276] 0709 13:00:39.778506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.811944 (+ 33438us) service_pool.cc:224] Handling call
0709 13:00:39.812266 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:39.812516 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 19
0709 13:00:40.133354 (+320838us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.810703 (+1677349us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:41.810763 (+    60us) raft_consensus.cc:1645] Marking committed up to 19
0709 13:00:41.810819 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.810889 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.811036 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":499476,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":73,"raft.queue_time_us":16282,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":101,"thread_start_us":1897652,"threads_started":2,"wal-append.queue_time_us":523063,"wal-append.run_cpu_time_us":1381,"wal-append.run_wall_time_us":1016608}
I20260709 13:00:42.057819  9412 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:42.023382  9088 consensus_queue.cc:1059] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:00:42.057966  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:42.015218  9730 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:42.058881  9088 raft_consensus.cc:3055] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:41.882892  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:42.059276  9088 raft_consensus.cc:740] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:41.885495  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:42.060199  9730 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:42.061034  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:41.874255  9647 raft_consensus.cc:3055] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:42.062364  9647 raft_consensus.cc:740] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:41.887017  9740 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:41.891369  2269 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
W20260709 13:00:41.896404  1563 debug-util.cc:398] Leaking SignalData structure 0x7b080023ac00 after lost signal to thread 1715
W20260709 13:00:42.063644  1563 debug-util.cc:398] Leaking SignalData structure 0x7b080025ec00 after lost signal to thread 1716
I20260709 13:00:41.899278  1686 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 24.
W20260709 13:00:42.063784  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 172418us
W20260709 13:00:42.064242  1686 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33206 (request call id 1225) took 2224 ms (client timeout 1661 ms). Trace:
I20260709 13:00:41.912555  2297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32788 (request call id 780) took 2468 ms. Trace:
I20260709 13:00:42.064524  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:42.002012  9727 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:42.064823  2297 rpcz_store.cc:276] 0709 13:00:39.427091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.649898 (+222807us) service_pool.cc:224] Handling call
0709 13:00:39.650312 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:39.650729 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:39.650755 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:39.651282 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:00:41.841350 (+2190068us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:00:41.841399 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.841483 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:41.889547 (+ 48064us) raft_consensus.cc:1685] finished
0709 13:00:41.889566 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.895290 (+  5724us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":89,"thread_start_us":2189631,"threads_started":1,"wal-append.queue_time_us":831072}
I20260709 13:00:41.925830  9749 consensus_queue.cc:1059] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.010s
I20260709 13:00:42.065918  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:42.066354  9749 consensus_queue.cc:1243] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer 1d6516ff61104bdda54bde95e92fe579 log is divergent from this leader: its last log entry 27.19 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 18
I20260709 13:00:41.930271  9701 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:42.066535  1690 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
I20260709 13:00:41.937247  9638 consensus_queue.cc:1059] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:41.500639  9392 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.067689  9392 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:42.069854  9392 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:41.953243  1537 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:42.071599  9362 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:41.956100  1505 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:42.025228  9736 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:42.074847  9736 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:42.075377  1685 raft_consensus.cc:2376] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 19. Re-sending same reply.
W20260709 13:00:41.964977  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 141083us
I20260709 13:00:42.030140  9622 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.925480  1689 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 23.
I20260709 13:00:42.076261  9622 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:42.076965  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:42.077349  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:42.077585  1685 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 28.
I20260709 13:00:42.078474  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:42.035040  9739 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:42.079200  1689 raft_consensus.cc:2393] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 24: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:41.949609  1438 catalog_manager.cc:5697] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 15 to 16, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 16 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:41.967067  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:42.080715  1535 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:41.982251  9745 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.080852  9739 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:42.023001  9732 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:42.081316  9745 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:42.082063  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:41.985164  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 338713us
I20260709 13:00:41.987774  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:42.083822  1563 debug-util.cc:398] Leaking SignalData structure 0x7b08003b6220 after lost signal to thread 2327
W20260709 13:00:42.084127  1563 debug-util.cc:398] Leaking SignalData structure 0x7b0800355400 after lost signal to thread 2328
W20260709 13:00:41.989519  1610 rpcz_store.cc:269] 0709 13:00:40.230547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.762822 (+532275us) service_pool.cc:224] Handling call
0709 13:00:41.656405 (+893583us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:42.052876  9652 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:41.990345  1608 rpcz_store.cc:269] 0709 13:00:40.431584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.988231 (+1556647us) service_pool.cc:224] Handling call
0709 13:00:41.989824 (+  1593us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:41.988448  1617 rpcz_store.cc:276] 0709 13:00:39.413418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.413519 (+   101us) service_pool.cc:224] Handling call
0709 13:00:39.413836 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.668835 (+2254999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.669706 (+   871us) spinlock_profiling.cc:243] Waited 466 ms on lock 0x7b54003b7254. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:41.669835 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1072304896}
W20260709 13:00:41.997197  1611 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 1176) took 2285 ms (client timeout 2419 ms). Trace:
I20260709 13:00:41.993515  1583 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:42.082396  1536 raft_consensus.cc:1275] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:00:42.002950  1615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 3839) took 1895 ms (client timeout 2127 ms). Trace:
I20260709 13:00:42.002784  1616 raft_consensus.cc:2393] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 15: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:41.975620  9608 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.008644  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3827) took 2242 ms. Trace:
W20260709 13:00:42.085503  1611 rpcz_store.cc:269] 0709 13:00:39.702154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.702277 (+   123us) service_pool.cc:224] Handling call
0709 13:00:41.987370 (+2285093us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:41.978703  9554 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:42.095170  1537 raft_consensus.cc:2468] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 26.
I20260709 13:00:42.015219  1688 rpcz_store.cc:276] 0709 13:00:39.795216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.797792 (+  2576us) service_pool.cc:224] Handling call
0709 13:00:39.798187 (+   395us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:39.798651 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:39.798684 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:41.573514 (+1774830us) spinlock_profiling.cc:243] Waited 6.16 ms on lock 0x7b2c00128aa8. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85b94aa11 00007fc85b95a372 00007fc85d08ca01 00007fc85d05143a 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2
0709 13:00:41.574123 (+   609us) log.cc:844] Serialized 52 byte log entry
0709 13:00:41.649796 (+ 75673us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:41.700815 (+ 51019us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.788518 (+ 87703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.788616 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:41.788659 (+    43us) raft_consensus.cc:1685] finished
0709 13:00:41.788836 (+   177us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.788994 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":43373,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":57594,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":163,"spinlock_wait_cycles":14171904,"thread_start_us":162616,"threads_started":2,"wal-append.queue_time_us":81040}
I20260709 13:00:42.020417  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3834) took 2252 ms. Trace:
I20260709 13:00:42.096264  1612 rpcz_store.cc:276] 0709 13:00:39.768360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.792055 (+ 23695us) service_pool.cc:224] Handling call
0709 13:00:41.987604 (+2195549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.002177 (+ 14573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.020206 (+ 18029us) spinlock_profiling.cc:243] Waited 2.19 s on lock 0x7b5400122850. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:42.020355 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5045923584}
I20260709 13:00:41.987174  9621 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:41.986794  9623 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:42.123090  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:41.995246  9555 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:41.986680  9725 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:42.026443  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:42.094619  9608 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:00:42.026778  1654 connection.cc:256] RPC call timeout handler was delayed by -1.0708361859999513s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
W20260709 13:00:42.169349  1654 connection.cc:256] RPC call timeout handler was delayed by -1.0591361859999324s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
I20260709 13:00:42.002768  9547 raft_consensus.cc:697] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 23 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:42.014794  9675 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.002249  9304 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:41.986828  9676 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:41.987352  9728 consensus_queue.cc:1048] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 13:00:42.006626  9651 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:42.035792  9723 consensus_queue.cc:1048] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:00:42.031152  9579 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:42.029911  9011 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:00:42.035422  9743 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:41.880668  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:41.881012  9741 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.934477  1684 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 17.
W20260709 13:00:42.015256  1439 rpcz_store.cc:269] 0709 13:00:16.419784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.437859 (+ 18075us) service_pool.cc:224] Handling call
0709 13:00:16.905316 (+467457us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b54001b99d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfbb090 00007fc85d059f3a 00007fc862e101cc 00007fc862f0e37e 00007fc8613cf2a4 00007fc8613cf232 00007fc8613cf161 00007fc8613cf0dc 00007fc8613ce392 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:41.761125 (+24855809us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:35.197209 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:35.386808 (+189599us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:35.391047 (+  4239us) write_op.cc:435] Acquired schema lock
0709 13:00:35.398986 (+  7939us) tablet.cc:662] Decoding operations
0709 13:00:35.640256 (+241270us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:35.640318 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:35.640349 (+    31us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:00:35.641216 (+   867us) tablet.cc:701] Row locks acquired
0709 13:00:35.641235 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:00:35.641385 (+   150us) write_op.cc:270] Start()
0709 13:00:35.641498 (+   113us) write_op.cc:276] Timestamp: P: 1783602035641335 usec, L: 0
0709 13:00:35.641527 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:00:35.679453 (+ 37926us) log.cc:844] Serialized 3995 byte log entry
0709 13:00:36.173008 (+493555us) op_driver.cc:464] REPLICATION: finished
0709 13:00:36.229599 (+ 56591us) write_op.cc:301] APPLY: starting
0709 13:00:36.229697 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:36.236088 (+  6391us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:36.236165 (+    77us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:36.242282 (+  6117us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:36.242478 (+   196us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=0,mrs_lookups=0
0709 13:00:36.242509 (+    31us) write_op.cc:312] APPLY: finished
0709 13:00:36.242858 (+   349us) log.cc:844] Serialized 97 byte log entry
0709 13:00:36.243738 (+   880us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:36.243889 (+   151us) write_op.cc:454] Released schema lock
0709 13:00:36.243938 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:36.244863 (+   925us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:36.244895 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2072432,"reported_tablets":32,"spinlock_wait_cycles":37524224,"child_traces":[["op",{"apply.queue_time_us":51115,"apply.run_cpu_time_us":14074,"apply.run_wall_time_us":14762,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45947,"num_ops":10,"prepare.queue_time_us":448392,"prepare.run_cpu_time_us":60761,"prepare.run_wall_time_us":670582,"raft.queue_time_us":192218,"raft.run_cpu_time_us":10937,"raft.run_wall_time_us":120320,"replication_time_us":486496,"spinlock_wait_cycles":451328,"thread_start_us":509549,"threads_started":4,"wal-append.queue_time_us":219190,"wal-append.run_cpu_time_us":22155,"wal-append.run_wall_time_us":1343209}]]}
I20260709 13:00:42.201795  2296 raft_consensus.cc:2393] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 24: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:42.074349  9647 consensus_queue.cc:260] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:42.075480  9736 raft_consensus.cc:3055] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:41.965962  1687 raft_consensus.cc:2410] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for term 19 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 15.
W20260709 13:00:42.204576  1687 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33206 (request call id 1223) took 2365 ms (client timeout 2419 ms). Trace:
W20260709 13:00:41.923080  9735 log.cc:927] Time spent T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.131s	user 0.005s	sys 0.003s
I20260709 13:00:41.989177  1614 raft_consensus.cc:2393] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 23: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 13:00:42.086162  2269 connection.cc:256] RPC call timeout handler was delayed by -1.6106786060000218s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1504s for a response
W20260709 13:00:42.084208  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 128136us
W20260709 13:00:42.086048  1615 rpcz_store.cc:269] 0709 13:00:40.107395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.664317 (+1556922us) service_pool.cc:224] Handling call
0709 13:00:42.002885 (+338568us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:42.208074  2269 connection.cc:256] RPC call timeout handler was delayed by -1.6043786060000116s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
I20260709 13:00:42.085078  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:42.208425  2269 connection.cc:256] RPC call timeout handler was delayed by -1.562078606s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
W20260709 13:00:42.208741  2269 connection.cc:256] RPC call timeout handler was delayed by -1.4693786060000207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16610000000000003s for a response
W20260709 13:00:42.209017  2269 connection.cc:256] RPC call timeout handler was delayed by -1.4045786059999728s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1733s for a response
I20260709 13:00:42.209251  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:42.209875  1615 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 28.
W20260709 13:00:42.205099  1687 rpcz_store.cc:269] 0709 13:00:39.839060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.550810 (+1711750us) service_pool.cc:224] Handling call
0709 13:00:42.204516 (+653706us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:42.160641  9554 consensus_queue.cc:1059] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.030s
I20260709 13:00:42.211807  1505 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:42.212765  1610 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 3845) took 1721 ms (client timeout 1921 ms). Trace:
W20260709 13:00:42.213186  1610 rpcz_store.cc:269] 0709 13:00:40.491244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.084817 (+1593573us) service_pool.cc:224] Handling call
0709 13:00:42.212683 (+127866us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:42.214115  1614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 3842) took 1876 ms (client timeout 1693 ms). Trace:
I20260709 13:00:42.214596  2269 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:42.214567  1614 rpcz_store.cc:269] 0709 13:00:40.337720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.660072 (+1322352us) service_pool.cc:224] Handling call
0709 13:00:42.214028 (+553956us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:42.067552  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:42.086189  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:42.216215  1617 raft_consensus.cc:2393] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 28: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:42.082075  1438 catalog_manager.cc:5697] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:42.091850  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 87434.9us
W20260709 13:00:42.064638  1686 rpcz_store.cc:269] 0709 13:00:39.839616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.995499 (+155883us) service_pool.cc:224] Handling call
0709 13:00:42.064162 (+2068663us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:42.092893  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:42.217686  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 3850) took 1601 ms. Trace:
I20260709 13:00:42.218008  1611 rpcz_store.cc:276] 0709 13:00:40.616009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.092633 (+1476624us) service_pool.cc:224] Handling call
0709 13:00:42.217630 (+124997us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:42.090154  1609 rpcz_store.cc:276] 0709 13:00:39.765906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.766042 (+   136us) service_pool.cc:224] Handling call
0709 13:00:41.648139 (+1882097us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.986880 (+338741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.008412 (+ 21532us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b54001f77d0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:42.008580 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4325457152}
W20260709 13:00:42.095716  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 102235us
I20260709 13:00:42.094405  9456 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:00:42.098788  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:42.098956  1616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 3848) took 1590 ms (client timeout 1758 ms). Trace:
W20260709 13:00:42.220983  1616 rpcz_store.cc:269] 0709 13:00:40.508279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.666590 (+1158311us) service_pool.cc:224] Handling call
0709 13:00:41.716643 (+ 50053us) spinlock_profiling.cc:243] Waited 7.55 ms on lock 0x7b5800091e98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc8620690ab 00007fc862069131 00007fc8620170a0 00007fc862016984 00007fc85b5916d4 00007fc85b591662
0709 13:00:42.098894 (+382251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17363328}
I20260709 13:00:42.099459  1507 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:42.078404  9622 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:42.124127  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 3847) took 1616 ms. Trace:
I20260709 13:00:42.222036  1608 rpcz_store.cc:276] 0709 13:00:40.507384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.086998 (+1579614us) service_pool.cc:224] Handling call
0709 13:00:42.124035 (+ 37037us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:42.162597  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1218) took 2324 ms. Trace:
I20260709 13:00:42.129150  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:42.067535  9727 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:42.083655  9745 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:42.101660  9392 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:00:41.976714  9617 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:42.169698  1654 connection.cc:256] RPC call timeout handler was delayed by -1.0069361859999617s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
I20260709 13:00:42.169034  1683 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:42.084483  9718 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:42.169888  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1219) took 2331 ms. Trace:
W20260709 13:00:42.170539  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 142888us
I20260709 13:00:42.100502  9708 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.085013  9652 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:42.123071  9730 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:00:42.231890  1617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 3844) took 1746 ms (client timeout 2100 ms). Trace:
W20260709 13:00:42.241194  1617 rpcz_store.cc:269] 0709 13:00:40.485981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.085934 (+1599953us) service_pool.cc:224] Handling call
0709 13:00:42.231818 (+145884us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:42.230682  1688 rpcz_store.cc:276] 0709 13:00:39.838007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.161080 (+2323073us) service_pool.cc:224] Handling call
0709 13:00:42.169361 (+  8281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.169546 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.169571 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.169611 (+    40us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:00:42.169641 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.169692 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.169828 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:42.237687  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 138231us
I20260709 13:00:42.238054  1505 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:42.238983  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:42.239111  1438 catalog_manager.cc:5697] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:42.231926  1508 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:42.239823  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:42.185621  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.185418  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:42.188004  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:42.247493  1614 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 12.
I20260709 13:00:42.192682  9725 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:42.204202  9736 raft_consensus.cc:740] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:42.198206  1682 raft_consensus.cc:2376] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 24. Re-sending same reply.
I20260709 13:00:42.199491  9651 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:42.200909  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.015039  9722 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:42.260797  9584 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:00:42.261301  9584 raft_consensus.cc:697] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 23 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:42.262042  9722 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:42.262187  9584 consensus_queue.cc:237] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:42.264364  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:42.265033  1614 raft_consensus.cc:2376] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 19. Re-sending same reply.
I20260709 13:00:42.200603  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:42.060248  9088 consensus_queue.cc:260] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:42.202915  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:42.204516  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:41.953289  1691 rpcz_store.cc:276] 0709 13:00:39.794645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.794772 (+   127us) service_pool.cc:224] Handling call
0709 13:00:39.795097 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:39.795419 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:39.795443 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:41.513031 (+1717588us) spinlock_profiling.cc:243] Waited 6.45 ms on lock 0x7b2c00128aa8. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85b94aa11 00007fc85b95a372 00007fc85d08ca01 00007fc85d05143a 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2
0709 13:00:41.513475 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:00:41.541797 (+ 28322us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:00:41.541842 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.541919 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:41.541966 (+    47us) raft_consensus.cc:1685] finished
0709 13:00:41.541979 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:41.545476 (+  3497us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3274,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"spinlock_wait_cycles":14826880,"thread_start_us":27887,"threads_started":1,"wal-append.queue_time_us":26005}
I20260709 13:00:42.205278  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:42.168305  9701 consensus_queue.cc:1059] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
W20260709 13:00:42.221675  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.083725  9732 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:42.225440  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:42.225596  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:42.202795  9737 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.175766  9675 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:42.283931  9675 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:42.284725  9737 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:42.252553  9723 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:42.227620  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:42.222702  1689 rpcz_store.cc:276] 0709 13:00:39.837750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.079771 (+2242021us) service_pool.cc:224] Handling call
0709 13:00:42.080043 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.080241 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:00:42.090561 (+ 10320us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.162065 (+ 71504us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.162228 (+   163us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.162273 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:42.162318 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.162390 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.162523 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6007,"prepare.run_wall_time_us":60950,"raft.queue_time_us":196,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":4002,"spinlock_wait_cycles":36179968,"thread_start_us":70955,"threads_started":1,"wal-append.queue_time_us":75800}
I20260709 13:00:42.228588  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:42.286115  1616 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:00:42.285373  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 1185) took 2387 ms. Trace:
I20260709 13:00:42.229501  2297 raft_consensus.cc:1240] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:42.177104  9304 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:42.211146  9671 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.286562  1611 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 23.
I20260709 13:00:42.287505  1683 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 13:00:42.286646  1614 rpcz_store.cc:276] 0709 13:00:39.898312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.273095 (+2374783us) service_pool.cc:224] Handling call
0709 13:00:42.284877 (+ 11782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.285061 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.285091 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.285129 (+    38us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:00:42.285166 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.285218 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.285316 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:42.289115  1689 raft_consensus.cc:1275] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 13:00:42.290088  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 58218.5us
I20260709 13:00:42.291291  1683 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:00:42.286545  1583 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:42.248204  1542 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 28.
I20260709 13:00:42.237390  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:42.293093  2296 raft_consensus.cc:2393] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 17: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:42.250676  9730 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.193027  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:42.250262  9412 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.216557  9362 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.253571  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:42.226655  9392 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.245154  2295 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 12.
W20260709 13:00:42.255477  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.207515  9741 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:42.237223  9756 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:00:42.308219  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:42.223450  9456 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:42.268904  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1221) took 2430 ms. Trace:
I20260709 13:00:42.276737  1533 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 17.
I20260709 13:00:42.277395  1438 catalog_manager.cc:5697] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:42.253981  9755 raft_consensus.cc:3055] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:00:42.254130  9745 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.253479  9547 consensus_queue.cc:237] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:42.281622  9088 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:42.281878  9727 consensus_queue.cc:1048] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:00:42.196255  9637 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:42.382901  9637 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:42.181957  1535 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 13:00:42.247835  1536 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 21.
I20260709 13:00:42.293700  1688 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:00:42.286759  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 1186) took 2388 ms. Trace:
I20260709 13:00:42.294111  1610 raft_consensus.cc:2393] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 17: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:42.385002  1613 raft_consensus.cc:2393] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 19: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 13:00:42.295231  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.296929  1617 raft_consensus.cc:2376] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 20. Re-sending same reply.
I20260709 13:00:42.298493  1683 raft_consensus.cc:3055] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:00:42.389451  1683 raft_consensus.cc:740] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:42.256541  1654 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:42.302815  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:42.230084  9738 consensus_queue.cc:1048] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:00:42.299804  9671 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:42.305163  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:42.254209  9554 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 30 FOLLOWER]: Leader pre-election won for term 31
W20260709 13:00:42.306236  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 91639.1us
I20260709 13:00:42.418316  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1217) took 2580 ms. Trace:
I20260709 13:00:42.419126  2269 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:42.307129  9762 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:42.309209  1687 rpcz_store.cc:276] 0709 13:00:39.838483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.226137 (+2387654us) service_pool.cc:224] Handling call
0709 13:00:42.251059 (+ 24922us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.258715 (+  7656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.258747 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.258792 (+    45us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:00:42.268617 (+  9825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.268697 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.268840 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:42.346024  2297 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [term 21 LEARNER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:00:42.304915  9412 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:42.336380  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:42.304318  9392 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:42.339563  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:42.310922  9456 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:42.274545  9555 raft_consensus.cc:697] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:42.451994  9763 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:42.296675  9730 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:42.452651  9763 raft_consensus.cc:697] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:42.378042  9736 consensus_queue.cc:260] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:42.455453  9736 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:42.452334  9555 consensus_queue.cc:237] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:42.237483  9744 consensus_queue.cc:1059] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.086s
I20260709 13:00:42.339296  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3846) took 1838 ms. Trace:
I20260709 13:00:42.461993  1614 rpcz_store.cc:276] 0709 13:00:40.501369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.296598 (+1795229us) service_pool.cc:224] Handling call
0709 13:00:42.338639 (+ 42041us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.338926 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.338956 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:42.339002 (+    46us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:42.339042 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.339107 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.339234 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":42223,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89}
W20260709 13:00:42.340113  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 102087us
I20260709 13:00:42.239482  9708 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:42.284000  9617 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:42.377154  1438 catalog_manager.cc:5697] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 19 to 21, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 21 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:42.287246  9622 consensus_queue.cc:1048] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.059s
I20260709 13:00:42.418522  9554 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.338796  9718 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:00:42.385002  1616 rpcz_store.cc:276] 0709 13:00:39.898547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.285484 (+2386937us) service_pool.cc:224] Handling call
0709 13:00:42.285794 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.286519 (+   725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.286708 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:42.388727  9675 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:42.305114  1508 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:42.310562  9362 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:42.410219  1610 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
W20260709 13:00:42.410506  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 153992us
I20260709 13:00:42.408106  9764 consensus_queue.cc:1048] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
W20260709 13:00:42.514400  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 209257us
I20260709 13:00:42.520166  1508 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:42.416839  9745 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:42.408138  1683 consensus_queue.cc:260] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.19, Last appended by leader: 19, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:42.418803  1685 rpcz_store.cc:276] 0709 13:00:39.837485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.078374 (+2240889us) service_pool.cc:224] Handling call
0709 13:00:42.083910 (+  5536us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:42.084257 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.084285 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:42.084840 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 13:00:42.211271 (+126431us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:00:42.417744 (+206473us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.417961 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.418059 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:42.418101 (+    42us) raft_consensus.cc:1685] finished
0709 13:00:42.418113 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.418254 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":202677,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":413,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":99,"thread_start_us":317615,"threads_started":2,"wal-append.queue_time_us":180859}
W20260709 13:00:42.438978  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 149143us
W20260709 13:00:42.531878  2267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.531880  1683 raft_consensus.cc:3060] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:00:42.440793  2269 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
W20260709 13:00:42.533331  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 92572.8us
W20260709 13:00:42.534457  2269 leader_election.cc:336] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Timed out: RequestConsensusVote RPC to 127.0.107.195:45275 timed out after 1.558s (SENT)
I20260709 13:00:42.466562  1505 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:42.420039  9732 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:00:42.338083  9755 raft_consensus.cc:740] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:42.539183  9412 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:42.480720  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 194126us
I20260709 13:00:42.439428  9676 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:42.439548  9762 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 13:00:42.487721  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 199536us
I20260709 13:00:42.545017  1581 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:42.486634  9637 raft_consensus.cc:3055] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:00:42.486994  9554 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:00:42.527611  1654 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:42.453598  9763 consensus_queue.cc:237] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:42.513746  9675 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.528997  1508 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
W20260709 13:00:42.537400  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 70912.2us
I20260709 13:00:42.524222  9722 consensus_queue.cc:1059] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 13:00:42.478778  1438 catalog_manager.cc:5697] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 16 to 20, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 20 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:42.522864  9701 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:42.548542  9608 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:42.548421  9758 consensus_queue.cc:1048] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:00:42.549942  1540 raft_consensus.cc:1240] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 LEADER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:42.531057  9718 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:42.538874  9755 consensus_queue.cc:260] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:42.558822  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:42.563205  1505 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:42.563382  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:42.540246  9732 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:42.566395  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:42.544252  9584 raft_consensus.cc:2804] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:00:42.539634  9743 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:42.564049  1583 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:42.572317  2266 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:42.574345  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:42.550264  9762 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:42.549818  9637 raft_consensus.cc:740] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:42.597882  9637 consensus_queue.cc:260] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:42.599185  9637 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:42.599601  9392 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:42.563223  9555 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:42.596621  9584 raft_consensus.cc:697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 24 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:42.601912  9584 consensus_queue.cc:237] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:42.603873  9781 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:00:42.604401  9781 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.604796  9781 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:00:42.577255  1583 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:42.562002  9675 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:00:42.607367  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 44254.2us
I20260709 13:00:42.608312  1505 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:42.578054  1438 catalog_manager.cc:5697] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:42.584309  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:42.582048  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:42.569689  9339 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:42.596488  9766 consensus_queue.cc:1048] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:00:42.616882  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:42.570780  9304 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:42.637683  1535 raft_consensus.cc:2376] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 26. Re-sending same reply.
I20260709 13:00:42.622424  1538 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 13:00:42.601876  9392 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:42.578977  9732 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:42.613236  1438 catalog_manager.cc:5697] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 18 to 19, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 19 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:42.582680  9764 raft_consensus.cc:2804] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:42.646034  1611 raft_consensus.cc:1240] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 23 LEADER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 22. Current term is 23. Ops: []
I20260709 13:00:42.646775  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:42.647461  1538 raft_consensus.cc:2376] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18. Re-sending same reply.
I20260709 13:00:42.644867  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:42.645217  1505 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:42.648882  1535 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
I20260709 13:00:42.650056  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:42.586706  9617 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:42.616164  9722 raft_consensus.cc:3055] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:00:42.619422  9743 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:00:42.653385  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 84907us
I20260709 13:00:42.675850  1508 leader_election.cc:400] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 23. Current term is 24.
I20260709 13:00:42.655771  1505 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
W20260709 13:00:42.656093  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 83803us
W20260709 13:00:42.665091  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:42.666266  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 92738.8us
I20260709 13:00:42.643507  9755 raft_consensus.cc:3060] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:42.668659  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 31 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:42.668803  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:42.678977  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.680261  2266 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:42.680521  1685 raft_consensus.cc:1240] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 22. Current term is 23. Ops: []
I20260709 13:00:42.681936  1505 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:42.684069  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:42.685189  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:42.685621  1687 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 21.
I20260709 13:00:42.686316  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:42.687224  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:42.687618  1687 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 13:00:42.651612  9671 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:42.651428  9555 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:42.688274  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:42.689612  1687 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 21.
I20260709 13:00:42.690267  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:42.690764  1687 raft_consensus.cc:2393] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 18: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:42.691406  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:42.646360  9764 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:42.711421  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:42.712087  1685 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:42.694768  1505 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:42.534093  9651 consensus_queue.cc:1175] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c262eac7fc904ae9bb91e450f6532e3f" responder_term: 27 status { last_received { term: 24 index: 17 } last_committed_idx: 17 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 26. Current term is 27. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:42.697064  9773 consensus_queue.cc:1048] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 13:00:42.698945  9608 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:42.666162  9392 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:42.700830  9767 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:42.703675  9730 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:42.704035  9737 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:42.704658  9717 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:42.705833  9784 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:42.706257  9652 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:42.733981  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:42.692224  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:42.646987  9718 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.031s
W20260709 13:00:42.742192  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 45885.8us
I20260709 13:00:42.670691  9722 raft_consensus.cc:740] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 13:00:42.774463  1613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 3832) took 3006 ms (client timeout 2270 ms). Trace:
W20260709 13:00:42.774966  1613 rpcz_store.cc:269] 0709 13:00:39.767814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.773647 (+  5833us) service_pool.cc:224] Handling call
0709 13:00:42.774243 (+3000596us) spinlock_profiling.cc:243] Waited 2.52 s on lock 0x7b54002a5dd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:42.774386 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5805275008}
I20260709 13:00:42.744668  9728 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:42.710412  9764 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:42.746531  9783 raft_consensus.cc:2804] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:42.755216  9392 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:42.696343  9617 raft_consensus.cc:697] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:42.763545  9781 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:42.760157  9717 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.766168  9784 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:00:42.767304  9795 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:00:42.768874  1687 raft_consensus.cc:2410] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:00:42.770552  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:42.772953  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 245301us
I20260709 13:00:42.791373  1654 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:42.760787  9362 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:42.795008  1654 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 13:00:42.745129  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 50386.7us
W20260709 13:00:42.778698  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.706907  9743 raft_consensus.cc:697] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 23 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:42.709735  9555 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:00:42.693712  9708 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:42.759222  9767 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 13:00:42.790350  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 110110us
I20260709 13:00:42.760048  9745 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:42.783398  9783 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:42.801326  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:42.802289  2266 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:42.804682  1505 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:42.806206  2297 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [term 29 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 28. Current term is 29. Ops: []
I20260709 13:00:42.798750  1654 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:42.811714  1685 raft_consensus.cc:2468] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
W20260709 13:00:42.813278  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.806725  1610 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 16.
I20260709 13:00:42.814545  1654 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:42.786980  9728 raft_consensus.cc:697] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:42.789239  9717 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:42.818128  1505 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:42.819049  1582 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:42.814844  1583 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:42.818491  1535 raft_consensus.cc:2393] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 22: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:42.823305  2266 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:42.822428  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:42.822975  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:42.828367  1654 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:42.799454  9737 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:42.834832  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:42.835575  1687 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:42.811694  9652 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:42.811532  9783 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:42.932868  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 94391us
I20260709 13:00:42.823699  9722 consensus_queue.cc:260] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:42.817144  9339 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:42.938297  9339 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.938652  9608 raft_consensus.cc:2804] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:42.939211  9608 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:42.939663  9608 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:42.941119  9781 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 29 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:42.948925  9743 consensus_queue.cc:237] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:42.949793  9791 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:00:42.951148  9728 consensus_queue.cc:237] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:42.826900  9555 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:42.829825  9758 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:42.953192  9730 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:42.805668  9767 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:42.814465  9304 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 13:00:42.983945  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 164857us
W20260709 13:00:42.956296  1508 connection.cc:256] RPC call timeout handler was delayed by -1.8028751130000273s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
W20260709 13:00:42.988983  1508 connection.cc:256] RPC call timeout handler was delayed by -1.7335751129999721s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
W20260709 13:00:42.989384  1508 connection.cc:256] RPC call timeout handler was delayed by -1.5821373950000179s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1854s for a response
W20260709 13:00:42.988582  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 174943us
W20260709 13:00:42.989800  1508 connection.cc:256] RPC call timeout handler was delayed by -1.4723373950000678s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1976s for a response
W20260709 13:00:42.989493  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 174626us
W20260709 13:00:42.990254  1508 connection.cc:256] RPC call timeout handler was delayed by -1.4005751130000021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2069s for a response
W20260709 13:00:42.990684  1508 connection.cc:256] RPC call timeout handler was delayed by -1.228719055000056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2222s for a response
I20260709 13:00:42.990718  1583 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:42.991423  1508 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:42.825330  9708 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:42.991963  1583 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:42.836727  9392 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:42.788957  9617 consensus_queue.cc:237] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:42.834954  9676 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:42.939302  9792 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.995093  1583 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:42.999536  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:42.938700  9339 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:42.840314  9652 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.980235  9555 raft_consensus.cc:697] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:42.980010  9718 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.996872  9791 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:42.999675  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:42.836498  9727 consensus_queue.cc:1059] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.167s
I20260709 13:00:43.056874  9708 raft_consensus.cc:697] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 19 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:43.058032  9793 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:00:43.073880  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:43.085345  9782 log.cc:927] Time spent T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:00:43.087793  9718 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:42.995388  9304 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:42.979707  9732 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:42.830055  1610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "4487a53c51be4634bf1ef29c5248353d"
 from {username='slave'} at 127.0.0.1:36136
I20260709 13:00:43.175683  1610 raft_consensus.cc:606] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Received request to transfer leadership to TS 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:43.176100  1610 raft_consensus.cc:614] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:42.994050  9737 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:42.999495  9392 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:43.003443  9730 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:43.126556  1687 raft_consensus.cc:2468] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 22.
I20260709 13:00:43.189090  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:43.067911  9764 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:43.004493  9584 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:43.148753  1613 raft_consensus.cc:2393] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 18: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:43.166235  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:43.246879  1609 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 13:00:43.043761  9652 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:00:43.185261  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 190128us
I20260709 13:00:43.100492  9791 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.096274  9775 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:43.254136  9791 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:43.257005  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:43.258196  9602 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:00:43.258476  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:43.259225  1609 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:00:43.258389  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:43.260178  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:43.108953  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 107371us
W20260709 13:00:43.241940  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.245476  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:43.198421  9743 raft_consensus.cc:3055] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:43.250849  1583 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:43.252677  9799 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:43.253091  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:43.263883  1683 raft_consensus.cc:1275] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 27 index: 19. (term mismatch)
I20260709 13:00:43.266489  1583 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:43.265120  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:43.262753  1687 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 22.
I20260709 13:00:43.092424  9675 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:43.265271  1609 raft_consensus.cc:2393] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 20: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:43.269574  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:43.284147  1687 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 13:00:43.270427  1683 pending_rounds.cc:85] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 18
I20260709 13:00:43.263803  1534 raft_consensus.cc:2468] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 24.
I20260709 13:00:43.285573  1683 pending_rounds.cc:107] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 26.19
I20260709 13:00:43.285948  1683 raft_consensus.cc:2889] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:43.286788  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1235) took 1214 ms. Trace:
I20260709 13:00:43.287127  1683 rpcz_store.cc:276] 0709 13:00:42.071933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.298156 (+226223us) service_pool.cc:224] Handling call
0709 13:00:42.298403 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:43.259788 (+961385us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54003f32a0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85cfc8dc0 00007fc85d053d87 00007fc85d054470 00007fc85d050d8f 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c
0709 13:00:43.286461 (+ 26673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.286706 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":452240256}
I20260709 13:00:43.289253  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:43.291218  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:43.292971  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:43.266110  1613 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 13:00:43.294112  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:43.296226  1687 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:43.145781  9784 consensus_queue.cc:1048] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.122s
I20260709 13:00:43.099224  9783 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:43.173126  9708 consensus_queue.cc:237] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:43.300850  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:43.014645  9792 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:43.270608  9799 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:43.246381  9584 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.326476  9584 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:43.328842  9799 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:43.329608  9304 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:43.330677  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:43.332060  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:43.336772  1542 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 16.
I20260709 13:00:43.337960  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:43.338786  1542 raft_consensus.cc:2393] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 23: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:43.339648  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:43.342185  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:36136
I20260709 13:00:43.342363  9732 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 26 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:43.342878  1609 raft_consensus.cc:606] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:43.343240  1609 raft_consensus.cc:614] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:43.311581  9555 consensus_queue.cc:237] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:43.346618  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db702b262c1644109366a56f6f0d805a"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:36136
I20260709 13:00:43.347224  1609 raft_consensus.cc:606] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:43.350407  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:36136
I20260709 13:00:43.351099  1609 raft_consensus.cc:606] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:43.351536  1609 raft_consensus.cc:614] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:00:43.351886  9088 consensus_meta.cc:287] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.943s	user 0.008s	sys 0.002s
I20260709 13:00:43.352496  1537 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 13:00:43.354223  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 4677) took 1170 ms. Trace:
I20260709 13:00:43.354511  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3"
dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
mode: GRACEFUL
new_leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
 from {username='slave'} at 127.0.0.1:36136
I20260709 13:00:43.355185  1609 raft_consensus.cc:606] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Received request to transfer leadership to TS dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:43.355770  1609 raft_consensus.cc:614] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:43.357745   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:43.357868  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:43.359319  1542 raft_consensus.cc:2368] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 21. Current term is 22.
I20260709 13:00:43.354566  1537 rpcz_store.cc:276] 0709 13:00:42.183893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.187686 (+  3793us) service_pool.cc:224] Handling call
0709 13:00:43.354069 (+1166383us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54003d2054. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:43.354169 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2473078016}
W20260709 13:00:43.280499  9554 consensus_meta.cc:287] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.716s	user 0.009s	sys 0.004s
I20260709 13:00:43.280606  9727 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:43.301386  9637 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:00:43.309078  9638 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 27 current term: 27 is higher.
I20260709 13:00:43.264109  9743 raft_consensus.cc:740] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:43.374439  9743 consensus_queue.cc:260] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:43.375309  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:43.375917  9757 log.cc:927] Time spent T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 13:00:43.375792  9743 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:43.376700  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:43.377125  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:43.377401  1539 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 13:00:43.378396  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:43.378876  9792 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:43.379515  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:43.381254  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:43.382128  9761 raft_consensus.cc:3055] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:00:43.382607  9761 raft_consensus.cc:740] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:43.383579  9761 consensus_queue.cc:260] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:43.386710  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:43.387683  1539 raft_consensus.cc:2393] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 24: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:43.388644  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 13:00:43.389400  9778 log.cc:927] Time spent T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.815s	user 0.005s	sys 0.010s
I20260709 13:00:43.389846  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:43.390547  1539 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 22.
W20260709 13:00:43.391063  9777 log.cc:927] Time spent T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.796s	user 0.003s	sys 0.010s
I20260709 13:00:43.391579  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:43.393011  1539 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:43.394632  9783 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:43.382438  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:43.159972  9456 consensus_meta.cc:287] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.680s	user 0.005s	sys 0.005s
I20260709 13:00:43.367108   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:00:43.405489  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 381473us
I20260709 13:00:43.415529  1508 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:43.417444  1508 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:43.393163  9762 consensus_meta.cc:287] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.757s	user 0.010s	sys 0.000s
I20260709 13:00:43.418924  1542 raft_consensus.cc:2393] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 26: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:43.299671  1683 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 23. Current term is 24. Ops: []
I20260709 13:00:43.187332  9392 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:43.429852  1508 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:43.436733  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 13:00:43.421577  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 101422us
I20260709 13:00:43.423298  9718 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:43.423861  9608 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:43.414028  9779 log.cc:927] Time spent T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.817s	user 0.005s	sys 0.008s
I20260709 13:00:43.447908  1581 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:43.455736  1581 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:43.426882  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:43.425379  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1237) took 1352 ms. Trace:
I20260709 13:00:43.188094  9730 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.425491  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:43.428188  1539 raft_consensus.cc:1275] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:00:43.179607  9717 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:43.457877  1581 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:43.476819  9792 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:43.498112  9792 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:43.498534  9792 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:43.499181  9608 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:43.474861  1691 rpcz_store.cc:276] 0709 13:00:42.080534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.299033 (+218499us) service_pool.cc:224] Handling call
0709 13:00:42.338465 (+ 39432us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:00:42.346732 (+  8267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.346763 (+    31us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:00:42.378149 (+ 31386us) log.cc:844] Serialized 78 byte log entry
0709 13:00:42.518118 (+139969us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:00:42.539798 (+ 21680us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.543753 (+  3955us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.544573 (+   820us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.633845 (+ 89272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.633944 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:43.070122 (+436178us) spinlock_profiling.cc:243] Waited 8.04 ms on lock 0x7b1800428f20. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f64522 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd 000000000038f354 000000000038f199 00007fc859f4783a
0709 13:00:43.385315 (+315193us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b1800428f20. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f643f3 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd 000000000038f354 000000000038f199 00007fc859f4783a
0709 13:00:43.390337 (+  5022us) spinlock_profiling.cc:243] Waited 41.9 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 13:00:43.425139 (+ 34802us) raft_consensus.cc:1685] finished
0709 13:00:43.425167 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.425314 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26433,"prepare.queue_time_us":39320,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":68,"raft.queue_time_us":18963,"raft.run_cpu_time_us":545,"raft.run_wall_time_us":43763,"spinlock_wait_cycles":153633536,"thread_start_us":150291,"threads_started":2,"wal-append.queue_time_us":154412}
I20260709 13:00:43.461918  1508 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:43.477500  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:43.501760  1683 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:00:43.413950  9456 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:43.508415  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 51074.9us
I20260709 13:00:43.198771  9737 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:43.503661  1508 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:43.474911  1542 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 29.
I20260709 13:00:43.449883  9647 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:43.465616  9088 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:43.415138  9554 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 31 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:43.513048  1508 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:43.434235  9741 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:43.510318  1581 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:43.474522  9727 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:00:43.425762  9810 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:43.537437  1581 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:43.514532  9723 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:00:43.521546  2269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.535529  1687 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 13:00:43.553202  1687 raft_consensus.cc:1275] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 13:00:43.553530  1687 pending_rounds.cc:85] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 12
I20260709 13:00:43.553695  1687 pending_rounds.cc:107] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 13:00:43.553867  1687 raft_consensus.cc:2889] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:43.429149  9808 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:00:43.561226  2298 raft_consensus.cc:1240] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 24. Current term is 25. Ops: []
W20260709 13:00:43.561908  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 48924.9us
I20260709 13:00:43.563411  1508 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:43.538842  1581 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:43.522850  2267 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.052s	sys 0.081s
W20260709 13:00:43.565748  2267 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.052s	sys 0.082s
W20260709 13:00:43.591125  2266 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.012s	sys 0.051s
I20260709 13:00:43.496717  9730 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:43.595906  1686 raft_consensus.cc:1275] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:00:43.506225  9011 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:43.450035  9762 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:43.514618  9608 raft_consensus.cc:2804] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:00:43.607455  1691 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
W20260709 13:00:43.597368  2266 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.013s	sys 0.052s
I20260709 13:00:43.609988  1686 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
W20260709 13:00:43.596920  9547 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.046s	sys 0.096s
I20260709 13:00:43.606658  9623 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:43.601197  9725 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:43.611338  9764 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:43.592576  9718 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:43.444114  9392 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:43.616906  9675 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:43.562740  9810 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.617641  9652 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:43.562547  9727 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:43.430948  9799 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:43.619585  9737 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:43.621181  9456 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:43.495240  9339 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:43.602767  9775 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:00:43.603459  9783 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.622583  1538 raft_consensus.cc:2393] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 31 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 31: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 13:00:43.658501  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 834810us
I20260709 13:00:43.661002  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:43.682176  1686 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:43.682690  2266 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:43.562466  9723 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.667069  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:43.569550  9617 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:43.592242  9743 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:00:43.663040  9547 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.046s	sys 0.096s
I20260709 13:00:43.518010  9791 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:43.664463  9725 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.700359  1683 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 29.
I20260709 13:00:43.670394  9718 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.666697  9608 raft_consensus.cc:697] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 26 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:43.704921  1691 raft_consensus.cc:2393] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 23: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:43.621204  9584 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:43.611967  9554 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 31 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:43.616782  9796 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.235s
I20260709 13:00:43.673521  9727 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:00:43.719626  1686 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 25.
I20260709 13:00:43.673951  9810 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:43.690644  9723 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:43.705859  9725 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:43.780640  1690 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 29 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 28. Current term is 29. Ops: []
I20260709 13:00:43.670176  9623 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:43.698413  9764 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:43.786705  1683 raft_consensus.cc:1240] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 21. Current term is 22. Ops: [19.11-21.12]
I20260709 13:00:43.779716  1686 raft_consensus.cc:1240] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:00:43.783164  2269 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:43.721902  9804 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.722710  9718 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:43.715260  9708 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:00:43.781858  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 48038.8us
W20260709 13:00:43.792146  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 51498us
I20260709 13:00:43.696648  9783 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:43.691699  9743 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:43.798576  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:43.801455  2266 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:43.691522  9617 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.800696  9795 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:00:43.798988  9737 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.831116  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:43.806466  9617 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:43.832751  2267 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:43.833187  1533 raft_consensus.cc:2393] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 24: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:43.806180  9743 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:43.790088  9764 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:43.827457  9717 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:43.855998  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 54599.6us
I20260709 13:00:43.799326  9804 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:43.809808  9608 consensus_queue.cc:237] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:43.872583  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:43.827577  9792 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:43.861131  9767 consensus_meta.cc:287] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.849s	user 0.000s	sys 0.011s
I20260709 13:00:43.844099  9795 raft_consensus.cc:697] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 25 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:43.835260  9737 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:43.863788  9708 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:43.894124  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:43.886576  9803 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:43.889161  9762 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:43.918231  2266 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:43.899300  9652 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:43.937024  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:43.902565  9392 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:43.908136  9799 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:43.938222  1533 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 24.
I20260709 13:00:43.887944  9671 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 13:00:43.891521  9767 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:43.915104  9803 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.948336  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3852) took 1142 ms. Trace:
W20260709 13:00:43.958712  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:43.949976  9815 log.cc:927] Time spent T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:00:43.950776  9783 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:43.953397  9812 log.cc:927] Time spent T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:00:43.957629  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4690) took 1291 ms. Trace:
W20260709 13:00:43.959254  1655 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 3.017s (SENT) [suppressed 36 similar messages]
I20260709 13:00:43.964579  1535 rpcz_store.cc:276] 0709 13:00:42.666525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.437480 (+770955us) service_pool.cc:224] Handling call
0709 13:00:43.437820 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:43.438232 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:43.438258 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:43.438714 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:00:43.676395 (+237681us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:43.676520 (+   125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.676595 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:43.957408 (+280813us) raft_consensus.cc:1685] finished
0709 13:00:43.957428 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.957575 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2604,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"thread_start_us":237304,"threads_started":1,"wal-append.queue_time_us":419558}
I20260709 13:00:43.966702  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:43.959211  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:43.936411  9708 raft_consensus.cc:697] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:43.920380  9791 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:43.968425  1682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33206 (request call id 1216) took 4131 ms (client timeout 1558 ms). Trace:
W20260709 13:00:43.970232  9811 log.cc:927] Time spent T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:00:43.971664  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4692) took 1141 ms. Trace:
W20260709 13:00:43.978211  1682 rpcz_store.cc:269] 0709 13:00:39.837204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.861355 (+ 24151us) service_pool.cc:224] Handling call
0709 13:00:43.968194 (+4106839us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b5400033754. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:43.968337 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":992267008}
I20260709 13:00:43.941346  9798 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:43.972841  9767 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:43.973523  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:43.983875  9783 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:43.976002  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1331) took 1154 ms. Trace:
I20260709 13:00:43.984751  1534 rpcz_store.cc:276] 0709 13:00:42.821162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.464861 (+643699us) service_pool.cc:224] Handling call
0709 13:00:43.507111 (+ 42250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:43.974504 (+467393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:43.974535 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:43.974574 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:43.974603 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.975763 (+  1160us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b54003138d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:43.975819 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.975947 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1073863936}
I20260709 13:00:43.986119  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:43.910990  9824 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:00:43.960701  9749 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:43.979557  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:43.991006  1682 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:43.990880  9749 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:43.978700  1542 rpcz_store.cc:276] 0709 13:00:42.830555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.514572 (+684017us) service_pool.cc:224] Handling call
0709 13:00:43.590272 (+ 75700us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:43.590528 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:43.590553 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:43.607451 (+ 16898us) log.cc:844] Serialized 26 byte log entry
0709 13:00:43.808217 (+200766us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:43.808256 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.808319 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:43.971443 (+163124us) raft_consensus.cc:1685] finished
0709 13:00:43.971463 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.971607 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":200453,"threads_started":1,"wal-append.queue_time_us":303840}
I20260709 13:00:43.993244  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:43.993620  9804 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:43.993979  9749 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:43.994410  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:43.994805  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:43.995654  1534 raft_consensus.cc:2410] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 25 because replica has last-logged OpId of term: 24 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 16.
I20260709 13:00:43.996081  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4858) took 1315 ms. Trace:
I20260709 13:00:43.996498  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:43.978957  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3841) took 3713 ms. Trace:
I20260709 13:00:43.948259  9584 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:43.996447  1688 rpcz_store.cc:276] 0709 13:00:42.680405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.688564 (+  8159us) service_pool.cc:224] Handling call
0709 13:00:42.688821 (+   257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:42.696072 (+  7251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.696112 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:42.746272 (+ 50160us) log.cc:844] Serialized 26 byte log entry
0709 13:00:43.428803 (+682531us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b180008f920. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf10d1 00007fc85d00ca0f
0709 13:00:43.674404 (+245601us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:43.674443 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.674533 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:43.995768 (+321235us) raft_consensus.cc:1685] finished
0709 13:00:43.995787 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.996021 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6940,"raft.queue_time_us":18311,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":33723,"spinlock_wait_cycles":23423744,"thread_start_us":245402,"threads_started":1,"wal-append.queue_time_us":1094361}
I20260709 13:00:43.962478  9652 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.920840  9796 consensus_queue.cc:1048] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.044s
I20260709 13:00:44.008632  9792 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:43.998250  9798 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:44.012184  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:44.012835  1691 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:44.014186  9798 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:44.008623  9737 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:44.020052  1690 raft_consensus.cc:1240] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:00:43.988628  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4687) took 1339 ms. Trace:
I20260709 13:00:43.961732  9803 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:00:43.980329  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 62143.5us
I20260709 13:00:43.997846  1611 rpcz_store.cc:276] 0709 13:00:40.265759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.296239 (+2030480us) service_pool.cc:224] Handling call
0709 13:00:42.310705 (+ 14466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.646506 (+335801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.978724 (+1332218us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b5400445054. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:43.978899 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":770331904}
I20260709 13:00:43.988018  1535 raft_consensus.cc:2468] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 22.
W20260709 13:00:43.980289  9813 log.cc:927] Time spent T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:00:43.995608  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:44.005213  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4871) took 1321 ms. Trace:
W20260709 13:00:44.029568  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 70289.4us
I20260709 13:00:44.005982  9392 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:00:44.004940  9701 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:44.001014  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1334) took 1179 ms. Trace:
I20260709 13:00:44.037751  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:44.006767  9708 consensus_queue.cc:237] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:44.009306  9652 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:44.025617  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:44.031183  1687 rpcz_store.cc:276] 0709 13:00:42.683327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.593945 (+910618us) service_pool.cc:224] Handling call
0709 13:00:43.595750 (+  1805us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:43.608081 (+ 12331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:43.608113 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:43.608583 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 13:00:43.900105 (+291522us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:43.900145 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.900212 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:44.005017 (+104805us) raft_consensus.cc:1685] finished
0709 13:00:44.005035 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.005160 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2046,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":17441,"thread_start_us":218843,"threads_started":1,"wal-append.queue_time_us":306337}
I20260709 13:00:44.000433  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:44.040853  1688 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:44.041455  1682 raft_consensus.cc:2468] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 22.
I20260709 13:00:44.034092  1609 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:00:44.039390  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:44.035348  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:44.041867  1615 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:00:44.042790  1611 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 30.
I20260709 13:00:44.034035  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:44.044411  1535 raft_consensus.cc:2468] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 29.
I20260709 13:00:44.021903  1537 rpcz_store.cc:276] 0709 13:00:42.641760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.396947 (+755187us) service_pool.cc:224] Handling call
0709 13:00:43.425932 (+ 28985us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:43.426328 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:00:43.851811 (+425483us) log.cc:844] Serialized 14 byte log entry
0709 13:00:43.949117 (+ 97306us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:43.949849 (+   732us) log.cc:844] Serialized 26 byte log entry
0709 13:00:43.949996 (+   147us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:00:43.950029 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.950092 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:43.981008 (+ 30916us) raft_consensus.cc:1685] finished
0709 13:00:43.981022 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.981156 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":524,"prepare.queue_time_us":404968,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":3000,"raft.queue_time_us":1032,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":6306,"thread_start_us":453350,"threads_started":2,"wal-append.queue_time_us":95991}
I20260709 13:00:44.036067  1539 rpcz_store.cc:276] 0709 13:00:42.821902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.475904 (+654002us) service_pool.cc:224] Handling call
0709 13:00:43.499218 (+ 23314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:43.499617 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:00:43.680962 (+181345us) log.cc:844] Serialized 14 byte log entry
0709 13:00:43.857812 (+176850us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:43.884589 (+ 26777us) log.cc:844] Serialized 26 byte log entry
0709 13:00:43.884933 (+   344us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:43.884972 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.885050 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:44.000778 (+115728us) raft_consensus.cc:1685] finished
0709 13:00:44.000798 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.000956 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1310,"prepare.queue_time_us":361305,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":5793,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":20721,"thread_start_us":298770,"threads_started":2,"wal-append.queue_time_us":204096}
I20260709 13:00:44.045578  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:44.050536  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:43.958215  9795 consensus_queue.cc:237] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:44.057771  2302 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 17.
I20260709 13:00:44.051234  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:44.061661  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:44.062336  1687 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 24.
I20260709 13:00:44.063378  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:44.063735  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:44.063928  1687 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:44.064393  1542 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 13:00:44.066183  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:44.067090  1691 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 13:00:44.044615  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:44.068878  1682 raft_consensus.cc:2393] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 26: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:44.070420  1542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:44.071054  1542 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:44.072777  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:44.074134  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:44.075235  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 13:00:44.076853  9088 consensus_meta.cc:287] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.000s
I20260709 13:00:44.077355  9088 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:44.079381  9652 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:44.080211  1542 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
I20260709 13:00:44.046371  9764 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:44.081959  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:44.082613  1611 raft_consensus.cc:2393] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 13: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:44.083570  1615 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 29.
I20260709 13:00:44.084501  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:44.085364  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:44.022400  9762 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.040s
I20260709 13:00:44.087922  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:44.088692  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:44.090322  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:44.090322  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:44.091230  1611 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:44.035282  9730 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:44.033345  9725 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:44.061309  9791 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.033517  9717 consensus_queue.cc:1059] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.036s
I20260709 13:00:44.090471  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:44.100297  1687 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 23.
I20260709 13:00:44.112193  1688 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 22.
I20260709 13:00:44.112632  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:44.113437  1615 raft_consensus.cc:2410] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 13:00:44.114176  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:44.048049  9701 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:44.103767  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:44.105629  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:44.115209  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 13:00:44.116010  1655 leader_election.cc:336] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.524s (SENT)
I20260709 13:00:44.117743  1655 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:44.119572  1655 leader_election.cc:336] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.524s (SENT)
I20260709 13:00:44.120064  1655 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:44.114893  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3858) took 1125 ms. Trace:
I20260709 13:00:44.120280  1616 raft_consensus.cc:2393] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 20: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:44.123245  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:44.123924  2295 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 22.
I20260709 13:00:44.120582  1613 rpcz_store.cc:276] 0709 13:00:42.989553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.295190 (+305637us) service_pool.cc:224] Handling call
0709 13:00:43.315082 (+ 19892us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:43.332580 (+ 17498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:43.332614 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:43.333229 (+   615us) log.cc:844] Serialized 52 byte log entry
0709 13:00:43.675719 (+342490us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:43.675764 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.675827 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:44.114686 (+438859us) raft_consensus.cc:1685] finished
0709 13:00:44.114706 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.114837 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39764,"raft.queue_time_us":291,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":10359,"thread_start_us":342062,"threads_started":1,"wal-append.queue_time_us":501640}
I20260709 13:00:44.125867  1613 raft_consensus.cc:1240] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:00:44.126744  9723 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:44.127351  1613 raft_consensus.cc:1240] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
W20260709 13:00:44.128008  9780 log.cc:927] Time spent T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 1.531s	user 0.010s	sys 0.013s
I20260709 13:00:44.129781  9730 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:44.130447  1655 leader_election.cc:336] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.537s (SENT)
I20260709 13:00:44.130893  1655 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:44.102828  1539 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 24.
I20260709 13:00:44.132704  1687 raft_consensus.cc:1240] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:44.138885  1615 raft_consensus.cc:1240] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:44.134838  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:44.140755  1687 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:00:44.138706  1655 leader_election.cc:336] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.595s (SENT)
I20260709 13:00:44.141983  1655 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:44.141316  1611 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 24.
I20260709 13:00:44.141499  1535 raft_consensus.cc:2393] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 23: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:44.115110  9764 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:44.145579  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:44.148530  1655 leader_election.cc:336] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.701s (SENT)
I20260709 13:00:44.147678  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:44.148978  1655 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:44.150209  1655 leader_election.cc:336] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.758s (SENT)
I20260709 13:00:44.150656  1655 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:44.120119  9652 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:44.154078  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:44.153007  9737 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:44.161456  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:44.162391  1537 raft_consensus.cc:2368] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 21. Current term is 22.
I20260709 13:00:44.163427  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:44.164235  9834 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:44.145579  9745 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:44.167069  9701 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:44.153012  9749 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:00:44.141921  9765 consensus_queue.cc:1059] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
W20260709 13:00:44.172935  9647 consensus_meta.cc:287] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.656s	user 0.010s	sys 0.000s
I20260709 13:00:44.173485  9765 raft_consensus.cc:3055] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:44.173735  2300 raft_consensus.cc:2410] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 20 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:00:44.173858  9765 raft_consensus.cc:740] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:44.174791  9765 consensus_queue.cc:260] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:44.175943  9765 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:44.176826  9638 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:00:44.177184  9832 log.cc:927] Time spent T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:00:44.177953  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:44.179507  1656 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:44.182377  2266 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:44.178367  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:44.184916  2299 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:00:44.118093  9791 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:44.197126  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.198140  2266 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:44.162161  9725 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:44.177868  9723 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:44.179863  9456 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.208292  2266 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:44.196455  9749 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:00:44.250811  1655 leader_election.cc:336] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.913s (SENT)
W20260709 13:00:44.251940  1655 leader_election.cc:336] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.921s (SENT)
I20260709 13:00:44.252401  1655 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:44.219450  9784 raft_consensus.cc:2804] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:00:44.155829  9764 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:44.257257  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:44.259169  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:44.259999  1691 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 22.
I20260709 13:00:44.268710  1691 raft_consensus.cc:1240] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 17. Current term is 18. Ops: []
I20260709 13:00:44.313696  1687 raft_consensus.cc:2468] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 20.
I20260709 13:00:44.315332  1687 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 25. Current term is 26. Ops: []
I20260709 13:00:44.202580  9647 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.046s
I20260709 13:00:44.316584  1691 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:00:44.228683  9783 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:00:44.358685  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 87242.3us
I20260709 13:00:44.244508  9749 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:44.219419  9584 consensus_queue.cc:1059] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.043s
I20260709 13:00:44.228407  9804 consensus_queue.cc:1059] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.095s
I20260709 13:00:44.362370  9784 raft_consensus.cc:697] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [term 29 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:44.375094  9749 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:44.373203  9783 raft_consensus.cc:697] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 24 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:44.381521  1683 raft_consensus.cc:1240] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 22. Current term is 23. Ops: []
I20260709 13:00:44.261466  9638 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:00:44.222040  9810 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:44.232872  9456 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:44.543278  9456 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:44.383385  1655 leader_election.cc:336] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 1.979s (SENT)
I20260709 13:00:44.510895  2299 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 31.
W20260709 13:00:44.508142  9763 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.913s	user 0.018s	sys 0.013s
I20260709 13:00:44.524541  9800 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.132s
I20260709 13:00:44.526471  9764 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:44.527581  1683 raft_consensus.cc:3055] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:00:44.527904  9617 consensus_meta.cc:287] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.667s	user 0.008s	sys 0.000s
I20260709 13:00:44.528972   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:44.529347  9844 log.cc:927] Time spent T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
W20260709 13:00:44.529825  9743 consensus_meta.cc:287] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.671s	user 0.006s	sys 0.005s
W20260709 13:00:44.530660  9838 log.cc:927] Time spent T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.275s	user 0.000s	sys 0.000s
I20260709 13:00:44.539350  9722 raft_consensus.cc:3060] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:44.219208  9794 consensus_queue.cc:1059] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.146s
W20260709 13:00:44.406193  9718 consensus_meta.cc:287] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.595s	user 0.008s	sys 0.004s
I20260709 13:00:44.562763  1655 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:44.563814  1533 raft_consensus.cc:2368] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 15. Current term is 16.
I20260709 13:00:44.567063  1683 raft_consensus.cc:740] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:44.577153  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
W20260709 13:00:44.564756  9763 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.970s	user 0.019s	sys 0.017s
I20260709 13:00:44.594200  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:44.543529  9784 consensus_queue.cc:237] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.19, Last appended by leader: 19, Current term: 29, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:44.595889  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 212441us
I20260709 13:00:44.595947  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:44.561538  9745 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.562279  9708 raft_consensus.cc:2764] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 31 FOLLOWER]: Leader pre-election decision vote started in defunct term 30: won
I20260709 13:00:44.602360  1536 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 13:00:44.606168  1683 consensus_queue.cc:260] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:44.606969  1683 raft_consensus.cc:3060] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:44.529728  9795 consensus_queue.cc:1059] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.071s
I20260709 13:00:44.595789  9579 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:44.604036  9737 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:44.565062  9647 consensus_queue.cc:1059] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.047s
I20260709 13:00:44.587409  9617 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:44.641803  9810 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:44.596346  9743 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:44.601202  9718 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:44.647841  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.660164  9743 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:44.662312  9617 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:44.665335  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:44.666108  1539 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 24.
I20260709 13:00:44.667117  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:44.667842  1539 raft_consensus.cc:2393] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 24: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:44.631762  9791 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:44.680516  9846 log.cc:927] Time spent T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:00:44.643280  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:44.690951  1654 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
W20260709 13:00:44.688596  1682 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.025s	sys 0.028s
I20260709 13:00:44.688957  1537 raft_consensus.cc:2393] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 22: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 13:00:44.694097  1682 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.025s	sys 0.029s
W20260709 13:00:44.694543  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.609366  9745 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:44.694958  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4875) took 1426 ms. Trace:
I20260709 13:00:44.698617  9718 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:44.699954  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1239) took 1234 ms. Trace:
W20260709 13:00:44.695785  9727 consensus_meta.cc:287] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.913s	user 0.012s	sys 0.001s
I20260709 13:00:44.704191  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:44.689217  9834 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.712415  1682 rpcz_store.cc:276] 0709 13:00:43.268548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.087150 (+818602us) service_pool.cc:224] Handling call
0709 13:00:44.087399 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.087552 (+   153us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:00:44.145152 (+ 57600us) log.cc:844] Serialized 14 byte log entry
0709 13:00:44.694619 (+549467us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:44.694673 (+    54us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:00:44.694721 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.694785 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.694900 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":305669,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":52,"raft.queue_time_us":85,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":4503,"thread_start_us":587507,"threads_started":2}
I20260709 13:00:44.714568  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:44.715143  1682 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:44.704061  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:44.606245  9783 consensus_queue.cc:237] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:44.701241  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:44.709600  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:44.710861  1688 rpcz_store.cc:276] 0709 13:00:43.465404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.112941 (+647537us) service_pool.cc:224] Handling call
0709 13:00:44.113244 (+   303us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:44.117865 (+  4621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:44.117894 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:44.119749 (+  1855us) log.cc:844] Serialized 52 byte log entry
0709 13:00:44.362087 (+242338us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:44.362133 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.362211 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:44.699701 (+337490us) raft_consensus.cc:1685] finished
0709 13:00:44.699733 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.699890 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1707,"raft.queue_time_us":102,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":6190,"thread_start_us":182269,"threads_started":1,"wal-append.queue_time_us":366135}
I20260709 13:00:44.699426  9741 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:44.707640  1683 raft_consensus.cc:1275] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 14. (term mismatch)
I20260709 13:00:44.722456  1683 pending_rounds.cc:85] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 13
I20260709 13:00:44.722712  1683 pending_rounds.cc:107] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 22.14
I20260709 13:00:44.722939  1683 raft_consensus.cc:2889] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:44.703661  9617 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.705497  9743 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.715055  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:44.717124  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:44.721115  1609 raft_consensus.cc:2410] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 22 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 13:00:44.721835  1613 raft_consensus.cc:2368] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 28. Current term is 29.
I20260709 13:00:44.698977  9749 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:44.728106  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:44.728772  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:44.728914  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:44.730379  9803 consensus_meta.cc:287] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.690s	user 0.000s	sys 0.009s
I20260709 13:00:44.731189  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:44.734254  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:44.732683  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:44.733520  1683 raft_consensus.cc:2393] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 18: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:44.731674  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:44.735813  2299 raft_consensus.cc:2393] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 13: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:44.735714  1682 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 13:00:44.734257  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:44.736693  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:44.737195  1682 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:44.742154  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:44.723723  9741 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:44.791090  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:44.737398  2294 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 15. (term mismatch)
I20260709 13:00:44.792312  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:44.795548  1682 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 22.
I20260709 13:00:44.795855  1536 raft_consensus.cc:2410] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 25 because replica has last-logged OpId of term: 24 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 16.
I20260709 13:00:44.796417  2294 pending_rounds.cc:85] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579: Aborting all ops after (but not including) 14
I20260709 13:00:44.723529  9834 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:44.797360  2294 pending_rounds.cc:107] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579: Aborting uncommitted NO_OP operation due to leader change: 22.15
I20260709 13:00:44.797515  1682 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:00:44.717965  9727 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:44.798669  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:44.800129  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:44.801098  1582 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:44.801447  2294 raft_consensus.cc:2889] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:44.811618  1609 raft_consensus.cc:2393] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 23: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:44.815951  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:44.817289  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:44.817534  9745 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:44.793383  9773 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.819342  1582 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:44.819828  1687 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:00:44.821388  1687 raft_consensus.cc:1240] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 21. Current term is 22. Ops: [21.18-21.18]
I20260709 13:00:44.822824  1687 raft_consensus.cc:1240] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 24. Current term is 25. Ops: [24.17-24.17]
I20260709 13:00:44.817884  9828 raft_consensus.cc:3055] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:00:44.824579  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:44.825697  2297 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32794 (request call id 1140) took 2145 ms. Trace:
I20260709 13:00:44.727519  9617 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:44.826085  2297 rpcz_store.cc:276] 0709 13:00:42.679958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.683511 (+  3553us) service_pool.cc:224] Handling call
0709 13:00:42.683762 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.807035 (+123273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.825492 (+2018457us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400b801d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:44.825646 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281031552}
I20260709 13:00:44.826083  1687 raft_consensus.cc:1240] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:00:44.834066  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:44.741827  9803 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:44.835502  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:44.796387  9741 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:44.727440  9743 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:44.792541  9637 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:44.838996  1683 raft_consensus.cc:2410] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 21 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:00:44.843128  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:44.847862  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:44.848837  1682 raft_consensus.cc:1275] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 15. (term mismatch)
I20260709 13:00:44.853765  1682 pending_rounds.cc:85] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 14
I20260709 13:00:44.853849  1536 raft_consensus.cc:2468] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 13:00:44.854064  1682 pending_rounds.cc:107] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 25.15
I20260709 13:00:44.854627  1682 raft_consensus.cc:2889] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:44.854280  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 5
I20260709 13:00:44.855419  1583 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:44.856954  1611 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 15.
I20260709 13:00:44.824960  9766 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:44.857620  1609 raft_consensus.cc:2368] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 18. Current term is 19.
I20260709 13:00:44.824446  9828 raft_consensus.cc:740] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:44.859565  2296 raft_consensus.cc:2393] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 17: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:44.860031  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:44.869158  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:44.870982  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:44.872607  9861 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:44.874823  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4670) took 2926 ms. Trace:
I20260709 13:00:44.875303  1540 rpcz_store.cc:276] 0709 13:00:41.948206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.993433 (+ 45227us) service_pool.cc:224] Handling call
0709 13:00:42.020288 (+ 26855us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.576257 (+555969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.874539 (+2298282us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b5400073ad4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:44.874753 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1206568192}
I20260709 13:00:44.877872  9858 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:00:44.878732  9858 raft_consensus.cc:2804] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:44.879171  9858 raft_consensus.cc:697] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:44.856977  9637 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:44.835768  9362 consensus_queue.cc:1059] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.025s
I20260709 13:00:44.880659  1613 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:44.881493  9362 raft_consensus.cc:3055] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:00:44.881855  9362 raft_consensus.cc:740] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:44.882344  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1246) took 1076 ms. Trace:
I20260709 13:00:44.884152  9803 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:44.818140  9773 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:44.885926  9637 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:44.886377  9773 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:44.882755  9362 consensus_queue.cc:260] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:44.888971  9362 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:44.891216  1613 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 24.
I20260709 13:00:44.893648  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:44.886646  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:44.882755  1691 rpcz_store.cc:276] 0709 13:00:43.805626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.317831 (+512205us) service_pool.cc:224] Handling call
0709 13:00:44.318219 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:44.318695 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 13:00:44.594295 (+275600us) log.cc:844] Serialized 14 byte log entry
0709 13:00:44.725307 (+131012us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:44.728782 (+  3475us) log.cc:844] Serialized 26 byte log entry
0709 13:00:44.731860 (+  3078us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:00:44.731893 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.731956 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:44.882095 (+150139us) raft_consensus.cc:1685] finished
0709 13:00:44.882117 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.882274 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":78975,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":2069,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":7617,"thread_start_us":343792,"threads_started":2,"wal-append.queue_time_us":221916}
I20260709 13:00:44.899585  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:44.899858  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 80648.6us
I20260709 13:00:44.900300  1536 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 13:00:44.900703  1582 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:44.901263  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:44.902933  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:44.903561  1608 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 30 FOLLOWER]: Advancing to term 31
W20260709 13:00:44.904868  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.905277  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:44.906018  1536 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 13:00:44.907168  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:44.907809  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.859453  9766 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:44.908733  9766 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:00:44.911938  9773 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:44.911512  1582 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:44.913596  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:44.918800  2294 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:00:44.920027  2267 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:44.919627  1507 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:44.926565  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:44.902451  9853 log.cc:927] Time spent T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 13:00:44.927707  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 72320.6us
I20260709 13:00:44.929425  1583 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:44.931602  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:44.928515  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:44.933003  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
W20260709 13:00:44.910372  9765 consensus_meta.cc:287] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.734s	user 0.010s	sys 0.003s
I20260709 13:00:44.933876  1541 raft_consensus.cc:2393] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 23: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:44.935102  1536 raft_consensus.cc:2410] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:00:44.938133  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:44.938037  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 3697) took 1221 ms. Trace:
I20260709 13:00:44.938866  1541 rpcz_store.cc:276] 0709 13:00:43.725996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.932717 (+1206721us) service_pool.cc:224] Handling call
0709 13:00:44.937974 (+  5257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:44.940034  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:44.940315  1583 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:44.941484  1683 raft_consensus.cc:1240] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:44.941759  1583 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:44.944731  9862 consensus_queue.cc:1059] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:00:44.946163  1540 raft_consensus.cc:2393] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 11: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:44.947924  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:44.928758  9602 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:44.952135  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
W20260709 13:00:44.955713  9856 log.cc:927] Time spent T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:00:44.943028  9773 raft_consensus.cc:2804] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:44.873198  9861 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:44.958333  1505 leader_election.cc:400] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 28 election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 28. Current term is 29.
I20260709 13:00:44.960222  1505 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:44.963806  1608 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 31.
I20260709 13:00:44.965370  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:44.957192  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:44.966569  1540 raft_consensus.cc:2468] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 21.
I20260709 13:00:44.968374  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 3689) took 1430 ms. Trace:
I20260709 13:00:44.968771  1536 rpcz_store.cc:276] 0709 13:00:43.512876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.931265 (+1418389us) service_pool.cc:224] Handling call
0709 13:00:44.942779 (+ 11514us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:44.969643  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:44.970737  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:44.936609  9718 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 31 FOLLOWER]: Leader election won for term 31
I20260709 13:00:44.971541  1540 raft_consensus.cc:2410] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:00:44.971789  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:44.970650  9304 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:44.957132  9834 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:44.974460  9727 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 29 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:44.974880  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:44.880175  9858 consensus_queue.cc:237] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:44.998423  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:44.940855  9859 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:44.998864  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:45.000066  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 58381.4us
I20260709 13:00:45.000312  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:45.001078  1609 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:45.001259  1536 raft_consensus.cc:2410] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 25 because replica has last-logged OpId of term: 24 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
W20260709 13:00:44.974529  9769 log.cc:927] Time spent T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 2.377s	user 0.008s	sys 0.010s
I20260709 13:00:44.994383  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" is_pre_election: true
I20260709 13:00:44.964975   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:00:45.002048  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:44.994383  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:44.967603  9764 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 13:00:44.993207  9853 log.cc:927] Time spent T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:00:45.006062  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8"
I20260709 13:00:45.007053  2267 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:45.009799  1540 raft_consensus.cc:3060] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:45.007318  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 3692) took 1331 ms. Trace:
I20260709 13:00:45.007815  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:44.993134  9749 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:44.993351  9555 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:45.010450  1683 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 29 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 28. Current term is 29. Ops: [28.20-28.20]
I20260709 13:00:45.013273  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:44.935956  9828 consensus_queue.cc:260] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:45.019732  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:45.005347  1608 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:44.998790  9718 raft_consensus.cc:697] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 31 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:45.011478  9784 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:45.034507  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:45.020076  2294 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:45.021394  2297 raft_consensus.cc:1240] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:45.013878  1536 rpcz_store.cc:276] 0709 13:00:43.675625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.969404 (+1293779us) service_pool.cc:224] Handling call
0709 13:00:45.007256 (+ 37852us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:45.009176  9860 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:45.032932  1542 raft_consensus.cc:1240] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 22. Current term is 23. Ops: []
I20260709 13:00:45.037459  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 3670) took 2204 ms. Trace:
I20260709 13:00:45.037951  1542 rpcz_store.cc:276] 0709 13:00:42.832809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.032410 (+2199601us) service_pool.cc:224] Handling call
0709 13:00:45.032761 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.037241 (+  4480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.037407 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:45.033622  2301 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 11.
I20260709 13:00:45.016247  9773 raft_consensus.cc:697] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 13:00:45.017638  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 57462.8us
I20260709 13:00:45.018036  9862 consensus_queue.cc:1048] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
W20260709 13:00:45.041462  9786 log.cc:927] Time spent T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:00:45.033041  9828 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:45.049998  9718 consensus_queue.cc:237] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.18, Last appended by leader: 18, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:45.051402  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4694) took 2051 ms. Trace:
I20260709 13:00:45.051827  1542 rpcz_store.cc:276] 0709 13:00:43.000084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.041973 (+2041889us) service_pool.cc:224] Handling call
0709 13:00:45.044181 (+  2208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.044705 (+   524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.044842 (+   137us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:45.044890 (+    48us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:45.045036 (+   146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.045203 (+   167us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.051336 (+  6133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:45.053391  1542 raft_consensus.cc:1240] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 23. Current term is 24. Ops: []
I20260709 13:00:45.017376  9727 raft_consensus.cc:3055] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:00:45.054373  9727 raft_consensus.cc:740] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:45.015249  9764 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:45.054607  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4695) took 1954 ms. Trace:
I20260709 13:00:45.056329  1542 rpcz_store.cc:276] 0709 13:00:43.100176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.052871 (+1952695us) service_pool.cc:224] Handling call
0709 13:00:45.053202 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.054324 (+  1122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.054543 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:45.060653  1542 raft_consensus.cc:1240] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 22. Current term is 23. Ops: []
I20260709 13:00:45.060819  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 1184) took 5162 ms. Trace:
I20260709 13:00:45.062794  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1220) took 5224 ms. Trace:
I20260709 13:00:45.063180  1684 rpcz_store.cc:276] 0709 13:00:39.838250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.204427 (+2366177us) service_pool.cc:224] Handling call
0709 13:00:42.204798 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:42.205169 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.205196 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:42.215917 (+ 10721us) log.cc:844] Serialized 26 byte log entry
0709 13:00:42.487399 (+271482us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:42.487445 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.487539 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:44.958329 (+2470790us) spinlock_profiling.cc:243] Waited 41.3 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 13:00:45.062524 (+104195us) raft_consensus.cc:1685] finished
0709 13:00:45.062545 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.062739 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":461,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":16145,"spinlock_wait_cycles":94953856,"thread_start_us":250512,"threads_started":1,"wal-append.queue_time_us":360677}
I20260709 13:00:45.064677  1540 raft_consensus.cc:2468] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 17.
I20260709 13:00:45.058408  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:45.066277  1540 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 25. Current term is 26. Ops: [25.16-25.16]
I20260709 13:00:45.061900  1612 rpcz_store.cc:276] 0709 13:00:39.898056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.122888 (+2224832us) service_pool.cc:224] Handling call
0709 13:00:42.159696 (+ 36808us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:42.160658 (+   962us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:00:42.530340 (+369682us) log.cc:844] Serialized 14 byte log entry
0709 13:00:43.786746 (+1256406us) spinlock_profiling.cc:243] Waited 6.47 ms on lock 0x7b18001c3d20. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc85cbf94bc 00007fc859f4748b 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf123a
0709 13:00:43.786940 (+   194us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:43.789827 (+  2887us) log.cc:844] Serialized 26 byte log entry
0709 13:00:43.789958 (+   131us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:43.789989 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.790054 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:44.869630 (+1079576us) spinlock_profiling.cc:243] Waited 7.38 ms on lock 0x7b18001c3d20. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f643f3 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd 000000000038f354 000000000038f199 00007fc859f4783a
0709 13:00:45.060586 (+190956us) raft_consensus.cc:1685] finished
0709 13:00:45.060608 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.060761 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":408571,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":205,"raft.run_cpu_time_us":393,"raft.run_wall_time_us":2937,"spinlock_wait_cycles":31860480,"thread_start_us":452139,"threads_started":2,"wal-append.queue_time_us":96963}
I20260709 13:00:45.037763  1583 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:45.070057  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 3685) took 1753 ms. Trace:
I20260709 13:00:45.070259  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 3684) took 1767 ms. Trace:
I20260709 13:00:45.072153  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:45.073158  2267 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:45.077741  1542 rpcz_store.cc:276] 0709 13:00:43.302982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.060130 (+1757148us) service_pool.cc:224] Handling call
0709 13:00:45.060463 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.061750 (+  1287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.070195 (+  8445us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:45.055457  9617 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:45.058390  9861 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:45.074834  1608 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 26.
I20260709 13:00:45.083792  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4698) took 1646 ms. Trace:
I20260709 13:00:45.061084  9741 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:45.057504  9764 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:45.082499  1612 raft_consensus.cc:1240] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:45.084436  1542 rpcz_store.cc:276] 0709 13:00:43.435032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.080790 (+1645758us) service_pool.cc:224] Handling call
0709 13:00:45.081113 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.081269 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.081293 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:45.081333 (+    40us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:45.081362 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.081412 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.081515 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:45.056636  9860 raft_consensus.cc:697] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:45.081434  1505 leader_election.cc:400] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 18. Current term is 19.
I20260709 13:00:45.074560  9743 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:45.087015  1505 leader_election.cc:403] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:45.087515  1608 raft_consensus.cc:1240] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:45.088752  1612 raft_consensus.cc:1240] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:00:45.088945  1608 raft_consensus.cc:1240] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 28. Current term is 29. Ops: []
I20260709 13:00:45.090171  1612 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
I20260709 13:00:45.090355  1608 raft_consensus.cc:1240] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 22. Current term is 24. Ops: []
I20260709 13:00:45.091784  9764 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:45.092413  9764 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:45.096110  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:45.096820  1683 raft_consensus.cc:2468] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:45.097590  9764 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:43.958972  1614 rpcz_store.cc:276] 0709 13:00:42.806323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.808727 (+  2404us) service_pool.cc:224] Handling call
0709 13:00:43.795568 (+986841us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b5800091e98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ceee 0000000000375939 00007fc861fa01e0 00007fc8620690c4 00007fc862069131 00007fc86202afc0 00007fc862015929 00007fc8620153d2 00007fc85b58cbd4
0709 13:00:43.795737 (+   169us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:43.795942 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:00:43.885253 (+ 89311us) log.cc:844] Serialized 14 byte log entry
0709 13:00:43.947976 (+ 62723us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:43.948042 (+    66us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:00:43.948088 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.948151 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.948278 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21940,"prepare.queue_time_us":105916,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":40712,"spinlock_wait_cycles":4124288,"thread_start_us":120532,"threads_started":2}
W20260709 13:00:45.099524  1616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 3854) took 2111 ms (client timeout 1804 ms). Trace:
W20260709 13:00:45.099992  1616 rpcz_store.cc:269] 0709 13:00:42.988392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.988529 (+   137us) service_pool.cc:224] Handling call
0709 13:00:45.099305 (+2110776us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000668d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:45.099451 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2334697344}
I20260709 13:00:45.103075  9741 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:45.103384  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 454514us
I20260709 13:00:45.099565  9304 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:00:45.104017  1655 leader_election.cc:336] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.100s (SENT)
I20260709 13:00:45.040885  9864 consensus_queue.cc:1048] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 13:00:45.105461  9617 raft_consensus.cc:2804] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:45.082176  9765 raft_consensus.cc:2804] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:45.109369  9579 raft_consensus.cc:3055] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:00:45.110545  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
W20260709 13:00:45.108160  1538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51500 (request call id 4681) took 2535 ms (client timeout 3055 ms). Trace:
W20260709 13:00:45.114753  1538 rpcz_store.cc:269] 0709 13:00:42.572896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.668295 (+ 95399us) service_pool.cc:224] Handling call
0709 13:00:45.107923 (+2439628us) spinlock_profiling.cc:243] Waited 875 ms on lock 0x7b540010b3d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:45.108069 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2012146048}
W20260709 13:00:45.112051  1655 leader_election.cc:336] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.127s (SENT)
I20260709 13:00:45.112869  1612 pending_rounds.cc:85] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f: Aborting all ops after (but not including) 14
I20260709 13:00:45.117405  1612 pending_rounds.cc:107] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:00:45.087044  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 3688) took 1620 ms. Trace:
I20260709 13:00:45.117352  1655 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:45.118479  1612 raft_consensus.cc:2889] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:45.085650  1540 rpcz_store.cc:276] 0709 13:00:43.316524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.065782 (+1749258us) service_pool.cc:224] Handling call
0709 13:00:45.066073 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:45.069028 (+  2955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.069998 (+   970us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:45.118063  1542 rpcz_store.cc:276] 0709 13:00:43.467134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.085914 (+1618780us) service_pool.cc:224] Handling call
0709 13:00:45.086207 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.086381 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.086403 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:45.086441 (+    38us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:00:45.086476 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.086876 (+   400us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.086996 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:45.119590  2294 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 13:00:45.112191  1505 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:45.130577  1655 leader_election.cc:336] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.136s (SENT)
I20260709 13:00:45.131237  1655 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:45.132848  1505 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:45.113416  9868 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953) with higher term. Message: Invalid argument: T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 18. Current term is 19.
I20260709 13:00:45.144882  9868 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:00:45.145854  9810 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:45.141059  9638 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:45.142452  9765 raft_consensus.cc:697] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:45.150218  9765 consensus_queue.cc:237] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:45.128109  9617 raft_consensus.cc:697] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:45.154047  9617 consensus_queue.cc:237] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:45.160691  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:45.113217  9860 consensus_queue.cc:237] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:45.171878  1655 leader_election.cc:336] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.155s (SENT)
I20260709 13:00:45.173975  1655 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:45.179657  1655 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:45.182986  1508 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:45.191359  1508 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:45.191134  1655 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:45.114180  9579 raft_consensus.cc:740] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:45.194576  9749 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:00:45.192855  9741 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:45.199739  1655 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:45.203011  1609 raft_consensus.cc:2410] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 23 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:00:45.112336  9727 consensus_queue.cc:260] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:45.201713  9749 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:45.207283  9749 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:45.180150  9638 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:45.218954  1654 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:45.202210  9834 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:45.204607  9737 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:45.234860  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:45.222298  1655 leader_election.cc:336] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.232s (SENT)
I20260709 13:00:45.193651  9810 consensus_queue.cc:1059] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:00:45.243607  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:45.243927  1655 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:45.245131  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:45.193784  9868 consensus_queue.cc:1059] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
W20260709 13:00:45.247031  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 169436us
I20260709 13:00:45.248409  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:45.249176  1654 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:45.257720  1614 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 13:00:45.255482  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:45.259052  9834 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:45.261250  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:45.212966  9773 consensus_queue.cc:237] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:45.247895  1655 leader_election.cc:336] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Timed out: RequestConsensusVote RPC to 127.0.107.193:43903 timed out after 2.270s (SENT)
I20260709 13:00:45.253225  1617 raft_consensus.cc:1240] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:00:45.254001  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:45.265102  1608 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:45.265506  9555 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:45.266238  9555 raft_consensus.cc:2804] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:45.266680  9555 raft_consensus.cc:697] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:45.267500  9555 consensus_queue.cc:237] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:45.249085  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:45.225492  9766 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:45.269170  2296 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32788 (request call id 789) took 1162 ms. Trace:
I20260709 13:00:45.269559  2296 rpcz_store.cc:276] 0709 13:00:44.107027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.113915 (+  6888us) service_pool.cc:224] Handling call
0709 13:00:45.268987 (+1155072us) spinlock_profiling.cc:243] Waited 744 ms on lock 0x7b5400511dd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:45.269117 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1711367936}
I20260709 13:00:45.270663  1538 raft_consensus.cc:1240] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 13:00:45.246876  9579 consensus_queue.cc:260] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:45.272200  9579 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:45.273133  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1335) took 1680 ms. Trace:
I20260709 13:00:45.273443  1655 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:45.275137  9745 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:45.275885  9339 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:45.277251  9745 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.277830  9745 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:45.278117  1538 rpcz_store.cc:276] 0709 13:00:43.593029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.128816 (+1535787us) service_pool.cc:224] Handling call
0709 13:00:45.129353 (+   537us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:45.271092 (+141739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.272882 (+  1790us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54003d1dd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:45.273071 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":324208896}
I20260709 13:00:45.279624  1538 raft_consensus.cc:1240] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 22. Current term is 23. Ops: []
I20260709 13:00:45.280197  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1339) took 1678 ms. Trace:
I20260709 13:00:45.280754  1538 rpcz_store.cc:276] 0709 13:00:43.602030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.279134 (+1677104us) service_pool.cc:224] Handling call
0709 13:00:45.279461 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.279978 (+   517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.280139 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:45.280150  9745 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:45.282842  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1340) took 1675 ms. Trace:
I20260709 13:00:45.273013  1608 raft_consensus.cc:2468] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 13:00:45.283262  1538 rpcz_store.cc:276] 0709 13:00:43.607207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.282004 (+1674797us) service_pool.cc:224] Handling call
0709 13:00:45.282374 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.282541 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.282566 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:45.282604 (+    38us) raft_consensus.cc:1645] Marking committed up to 19
0709 13:00:45.282638 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.282687 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.282792 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:45.246641  9743 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.284960  9743 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:45.285769  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1342) took 1625 ms. Trace:
I20260709 13:00:45.286212  1538 rpcz_store.cc:276] 0709 13:00:43.660019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.284904 (+1624885us) service_pool.cc:224] Handling call
0709 13:00:45.285208 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.285392 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.285417 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:45.285459 (+    42us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:00:45.285497 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.285547 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.285712 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:45.255024  9718 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:00:45.287567  9718 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:45.288003  9718 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:45.288218  1538 raft_consensus.cc:1240] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:00:45.289726  9088 raft_consensus.cc:3055] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 13:00:45.290248  9088 raft_consensus.cc:740] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:45.291109  9088 consensus_queue.cc:260] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.20, Last appended by leader: 20, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:45.253578  9638 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:00:45.293426  9638 raft_consensus.cc:697] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 26 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:45.294346  9638 consensus_queue.cc:237] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:45.294847  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 3691) took 1632 ms. Trace:
I20260709 13:00:45.252942  9741 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:45.296422  1612 raft_consensus.cc:2393] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 23: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:45.292269  9088 raft_consensus.cc:3060] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:00:45.295259  1538 rpcz_store.cc:276] 0709 13:00:43.662673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.287633 (+1624960us) service_pool.cc:224] Handling call
0709 13:00:45.287969 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:45.288678 (+   709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.294781 (+  6103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:45.286332  9761 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:45.307121  1654 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:45.310027  1654 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:45.281090  9849 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.554s	user 0.003s	sys 0.000s
I20260709 13:00:45.310881  1538 raft_consensus.cc:1240] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 23. Current term is 24. Ops: []
I20260709 13:00:45.311295  1654 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:45.315558  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 277704us
I20260709 13:00:45.317124  1583 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:45.317305  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:45.317718  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1343) took 1653 ms. Trace:
I20260709 13:00:45.314592  9745 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:00:45.320856  1583 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:45.318104  1538 rpcz_store.cc:276] 0709 13:00:43.664306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.304013 (+1639707us) service_pool.cc:224] Handling call
0709 13:00:45.304411 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.317350 (+ 12939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.317660 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:45.307703  2298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32794 (request call id 1139) took 2959 ms. Trace:
I20260709 13:00:45.326452  2298 rpcz_store.cc:276] 0709 13:00:42.347941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.375420 (+ 27479us) service_pool.cc:224] Handling call
0709 13:00:42.389499 (+ 14079us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:43.569735 (+1180236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.307428 (+1737693us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54005e9054. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:45.307619 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2692893056}
I20260709 13:00:45.324986  9738 raft_consensus.cc:2804] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:45.315368  9741 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:00:45.328114  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.328884  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:45.317059  9339 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:00:45.331899  1614 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:00:45.333894  1535 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 3701) took 1543 ms (client timeout 1992 ms). Trace:
I20260709 13:00:45.334671  1540 raft_consensus.cc:1240] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
W20260709 13:00:45.336541  1535 rpcz_store.cc:269] 0709 13:00:43.790898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.057501 (+266603us) service_pool.cc:224] Handling call
0709 13:00:45.333636 (+1276135us) spinlock_profiling.cc:243] Waited 64.6 ms on lock 0x7b54002198d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:45.333814 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148635008}
I20260709 13:00:45.338469  1535 raft_consensus.cc:1275] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:00:45.339073  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4703) took 1429 ms. Trace:
I20260709 13:00:45.339363  1535 rpcz_store.cc:276] 0709 13:00:43.909224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.337804 (+1428580us) service_pool.cc:224] Handling call
0709 13:00:45.338142 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.338816 (+   674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.339014 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:45.341116  1583 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:45.321270  9744 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:00:45.344720  1538 raft_consensus.cc:1240] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 25. Current term is 26. Ops: []
I20260709 13:00:45.346910  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51512 (request call id 3694) took 1663 ms. Trace:
I20260709 13:00:45.347395  1538 rpcz_store.cc:276] 0709 13:00:43.683745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.328288 (+1644543us) service_pool.cc:224] Handling call
0709 13:00:45.344548 (+ 16260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.346617 (+  2069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.346848 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:45.307288  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 115941us
I20260709 13:00:45.330716  9741 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.350816  1508 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:45.355468  1614 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 13:00:45.358194  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:45.342151  9738 raft_consensus.cc:697] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:45.359061  1614 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 13:00:45.359355  2302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32794 (request call id 1141) took 1182 ms. Trace:
I20260709 13:00:45.360549  2302 rpcz_store.cc:276] 0709 13:00:44.177119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.186537 (+  9418us) service_pool.cc:224] Handling call
0709 13:00:44.205097 (+ 18560us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:44.205516 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:44.205540 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:44.247209 (+ 41669us) log.cc:844] Serialized 564 byte log entry
0709 13:00:44.576683 (+329474us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:00:44.576722 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.576824 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:45.280497 (+703673us) spinlock_profiling.cc:243] Waited 5.14 ms on lock 0x7b4400022b4c. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859e8ac85 00007fc859e8b6a2 00007fc85cbfd1db 00007fc85cbf8aaf 00007fc85cbec86e 00007fc85cbebbb6 00007fc85cbeb7d8 00007fc85cbf5221 00007fc85cbf51d9 00007fc85cbf5169
0709 13:00:45.357298 (+ 76801us) raft_consensus.cc:1685] finished
0709 13:00:45.357320 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.359288 (+  1968us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11821312,"thread_start_us":329099,"threads_started":1,"wal-append.queue_time_us":456026}
I20260709 13:00:45.359707  1508 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:45.356916  9741 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:45.371711  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:45.371191  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:45.379690  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4693) took 2386 ms. Trace:
I20260709 13:00:45.372100  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:45.375433  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 242549us
W20260709 13:00:45.375941  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.376710  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:45.377312  9858 consensus_queue.cc:1059] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:00:45.362641  9874 raft_consensus.cc:2804] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:45.380764  1684 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 23.
I20260709 13:00:45.359781  9880 raft_consensus.cc:3055] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:45.381342  1691 raft_consensus.cc:2393] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 16: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:45.382839  1686 raft_consensus.cc:1275] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:00:45.383890  9728 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.009s	sys 0.005s
I20260709 13:00:45.380739  1536 rpcz_store.cc:276] 0709 13:00:42.993105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.065418 (+2072313us) service_pool.cc:224] Handling call
0709 13:00:45.065674 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.065827 (+   153us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:00:45.245307 (+179480us) log.cc:844] Serialized 14 byte log entry
0709 13:00:45.379396 (+134089us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:45.379446 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:45.379495 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.379554 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.379647 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":246331,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":1625,"thread_start_us":288360,"threads_started":2}
I20260709 13:00:45.387708  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:45.380846  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:45.386996  9887 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:00:45.393704  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 13:00:45.398826  9728 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.010s	sys 0.005s
I20260709 13:00:45.368402  9860 consensus_queue.cc:1048] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:00:45.381111  9872 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 13:00:45.381117  9873 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:45.433100  9873 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:45.435194  9887 raft_consensus.cc:697] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:45.436352  9887 consensus_queue.cc:237] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:45.441293  9743 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:45.443753  9738 consensus_queue.cc:237] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:45.400416  1542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1338) took 1806 ms. Trace:
W20260709 13:00:45.418566  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 128776us
W20260709 13:00:45.456825  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.432040  9790 raft_consensus.cc:3055] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:45.461377  1542 rpcz_store.cc:276] 0709 13:00:43.593848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.127741 (+1533893us) service_pool.cc:224] Handling call
0709 13:00:45.128273 (+   532us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:45.128638 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.128670 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:45.129570 (+   900us) log.cc:844] Serialized 26 byte log entry
0709 13:00:45.357660 (+228090us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:45.357697 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.357767 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:45.400227 (+ 42460us) raft_consensus.cc:1685] finished
0709 13:00:45.400248 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.400363 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":160618,"threads_started":1,"wal-append.queue_time_us":210136}
I20260709 13:00:45.394235  9880 raft_consensus.cc:740] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 13:00:45.525063  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 141819us
W20260709 13:00:45.526093  2300 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32802 (request call id 835) took 3417 ms (client timeout 3070 ms). Trace:
W20260709 13:00:45.528946  2300 rpcz_store.cc:269] 0709 13:00:42.087674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.087794 (+   120us) service_pool.cc:224] Handling call
0709 13:00:45.505064 (+3417270us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b5400938354. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:45.505241 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4488334080}
I20260709 13:00:45.474105  9874 raft_consensus.cc:697] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 20 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:45.494197  9708 consensus_queue.cc:1059] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:00:45.535595  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 4077) took 2541 ms. Trace:
I20260709 13:00:45.536053  1690 rpcz_store.cc:276] 0709 13:00:42.994617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.793321 (+798704us) service_pool.cc:224] Handling call
0709 13:00:44.016083 (+222762us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:44.020531 (+  4448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.535350 (+1514819us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b5400392e50. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:45.535529 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":479063936}
I20260709 13:00:45.475133  9790 raft_consensus.cc:740] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:45.545130  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4704) took 1498 ms. Trace:
I20260709 13:00:45.494462  9728 consensus_queue.cc:1059] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.050s
W20260709 13:00:45.553697  9848 log.cc:927] Time spent T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 1.046s	user 0.001s	sys 0.003s
W20260709 13:00:45.554028  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.558423  1539 raft_consensus.cc:1240] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:00:45.558693  9790 consensus_queue.cc:260] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:45.566082  9790 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:45.564922  1539 raft_consensus.cc:1240] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 23. Current term is 24. Ops: []
I20260709 13:00:45.568081  9880 consensus_queue.cc:260] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:45.569768  9880 raft_consensus.cc:3060] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:00:45.578967  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.595011  1542 raft_consensus.cc:1275] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 13:00:45.595863  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.605027  1536 raft_consensus.cc:1240] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:45.593585  9339 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:45.620123  9623 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:45.536311  9874 consensus_queue.cc:237] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:45.629343  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.630128  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.634631  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 274850us
I20260709 13:00:45.637904  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:45.639425  1508 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:45.640287  1508 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:45.605074  9555 consensus_queue.cc:1059] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 13:00:45.642421  9671 consensus_queue.cc:1059] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:00:45.629748  9873 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:45.613751  9892 consensus_queue.cc:1059] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:00:45.664266  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
W20260709 13:00:45.664795  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.671559  2269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.621618  9339 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:45.641001  9708 consensus_queue.cc:1059] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:00:45.707829  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:45.713470  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:45.714280  1608 raft_consensus.cc:2376] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18. Re-sending same reply.
W20260709 13:00:45.716113  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 75864.5us
I20260709 13:00:45.717063  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:45.670166  9800 consensus_queue.cc:1048] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 13:00:45.718204  1508 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:45.722033  2267 consensus_peers.cc:597] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:45.725747  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:45.743024  1608 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 23.
W20260709 13:00:45.721529  9890 log.cc:927] Time spent T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:00:45.745438  1686 raft_consensus.cc:1275] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:00:45.721345  9728 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:45.743620  9749 consensus_meta.cc:287] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.536s	user 0.008s	sys 0.010s
W20260709 13:00:45.750411  2267 consensus_peers.cc:597] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:45.772656  9749 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:45.752225  1508 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:45.748206  9718 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:45.775058  9749 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:45.776298  9718 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:45.777033  9718 raft_consensus.cc:3055] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:00:45.777393  9718 raft_consensus.cc:740] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:45.778264  9718 consensus_queue.cc:260] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:45.766769  9339 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:45.766840  1686 raft_consensus.cc:1275] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:00:45.787048  2267 consensus_peers.cc:597] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:45.789029  9899 log.cc:927] Time spent T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260709 13:00:45.789383  2267 consensus_peers.cc:597] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:45.790148  2267 consensus_peers.cc:597] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:45.795463  9741 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:45.796676  9904 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:45.798177  9873 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.798760  9873 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:45.746126  9900 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:45.722013  9889 raft_consensus.cc:3055] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:00:45.801776  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.804634  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 276836us
I20260709 13:00:45.819741  9873 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:45.746133  9088 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:45.806733  9900 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:45.837486  9900 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:45.803086  9728 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:45.839156  9905 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:45.839979  9728 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:45.833257  9088 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:45.841085  9088 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:45.804911  9889 raft_consensus.cc:740] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:45.852152  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51500 (request call id 4706) took 1804 ms. Trace:
I20260709 13:00:45.852723  1538 rpcz_store.cc:276] 0709 13:00:44.047663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.348336 (+1300673us) service_pool.cc:224] Handling call
0709 13:00:45.359065 (+ 10729us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.359329 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:00:45.371622 (+ 12293us) log.cc:844] Serialized 14 byte log entry
0709 13:00:45.848147 (+476525us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:45.848202 (+    55us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:00:45.851433 (+  3231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.851508 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.851629 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15094,"prepare.queue_time_us":12639,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":134673,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":6213,"thread_start_us":463976,"threads_started":2,"wal-append.queue_time_us":238395}
I20260709 13:00:45.847159  9887 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:00:45.851060  9761 consensus_meta.cc:287] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.538s	user 0.016s	sys 0.004s
I20260709 13:00:45.869433  1541 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:45.851895  9810 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:45.847864  9900 consensus_queue.cc:1059] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:00:45.860160  9908 consensus_queue.cc:1059] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:00:45.881084  9892 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:00:45.851455  9904 raft_consensus.cc:697] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:45.887508  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3862) took 2896 ms. Trace:
I20260709 13:00:45.887688  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1234) took 3816 ms. Trace:
I20260709 13:00:45.849583  9905 consensus_queue.cc:1059] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 15, Time since last communication: 0.023s
I20260709 13:00:45.887111  9904 consensus_queue.cc:237] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:45.888043  1689 rpcz_store.cc:276] 0709 13:00:42.071664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.291646 (+219982us) service_pool.cc:224] Handling call
0709 13:00:43.968916 (+1677270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:44.030182 (+ 61266us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:00:44.213022 (+182840us) log.cc:844] Serialized 14 byte log entry
0709 13:00:44.593569 (+380547us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:44.602947 (+  9378us) log.cc:844] Serialized 26 byte log entry
0709 13:00:44.603625 (+   678us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:00:44.603958 (+   333us) log.cc:844] Serialized 14 byte log entry
0709 13:00:45.447315 (+843357us) spinlock_profiling.cc:243] Waited 9.93 ms on lock 0x7b18000038e0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f61455 00007fc85d049060 00007fc85d05b716 00007fc85d06c287 00007fc85d06c208
0709 13:00:45.555621 (+108306us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b18000038e0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f643f3 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd 000000000038f354 000000000038f199 00007fc859f4783a
0709 13:00:45.613749 (+ 58128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.613826 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:45.613868 (+    42us) raft_consensus.cc:1685] finished
0709 13:00:45.613881 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.887538 (+273657us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b5400033750. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:45.887634 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20623,"prepare.queue_time_us":188935,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":79,"raft.queue_time_us":6299,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":14159,"spinlock_wait_cycles":3887613952,"thread_start_us":718732,"threads_started":4,"wal-append.queue_time_us":470243}
I20260709 13:00:45.888494  9910 raft_consensus.cc:3055] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:45.895793  9910 raft_consensus.cc:740] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 13:00:45.896307  1537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 3712) took 1779 ms (client timeout 2063 ms). Trace:
I20260709 13:00:45.896644  9910 consensus_queue.cc:260] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:45.898454  1533 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51512 (request call id 3690) took 2328 ms (client timeout 1758 ms). Trace:
W20260709 13:00:45.898913  1533 rpcz_store.cc:269] 0709 13:00:43.569640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.940975 (+371335us) service_pool.cc:224] Handling call
0709 13:00:45.898234 (+1957259us) spinlock_profiling.cc:243] Waited 596 ms on lock 0x7b540007dd54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:45.898381 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1370354048}
I20260709 13:00:45.850508  9728 consensus_queue.cc:1059] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.025s
W20260709 13:00:45.904417  1537 rpcz_store.cc:269] 0709 13:00:44.117024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.163124 (+ 46100us) service_pool.cc:224] Handling call
0709 13:00:45.896069 (+1732945us) spinlock_profiling.cc:243] Waited 524 ms on lock 0x7b54003151d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:45.896224 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1206051200}
I20260709 13:00:45.911731  9728 raft_consensus.cc:3055] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:00:45.912210  9728 raft_consensus.cc:740] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:45.913120  9728 consensus_queue.cc:260] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:45.914372  9728 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:45.917083  1541 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 24.
W20260709 13:00:45.918177  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.923213  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:45.917976  1583 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:45.924641  1687 raft_consensus.cc:1240] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:45.861265  9887 raft_consensus.cc:697] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 13:00:45.926334  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.921041  9764 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.887954  1610 rpcz_store.cc:276] 0709 13:00:42.990692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.301116 (+310424us) service_pool.cc:224] Handling call
0709 13:00:43.301486 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:43.374314 (+ 72828us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:43.374347 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:43.374861 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:00:43.592361 (+217500us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:00:43.783745 (+191384us) log.cc:844] Serialized 14 byte log entry
0709 13:00:43.789796 (+  6051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.887097 (+2097301us) spinlock_profiling.cc:243] Waited 72.5 ms on lock 0x7b54002576d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:45.887147 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:45.887192 (+    45us) raft_consensus.cc:1685] finished
0709 13:00:45.887284 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.887451 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":269043,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":1874,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":6059,"spinlock_wait_cycles":166783232,"thread_start_us":330743,"threads_started":2,"wal-append.queue_time_us":358282,"wal-append.run_cpu_time_us":3727,"wal-append.run_wall_time_us":1357339}
I20260709 13:00:45.928916  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:45.939879  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:45.940102  2300 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 23.
W20260709 13:00:45.929509  9903 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 13:00:45.929796  9891 log.cc:927] Time spent T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:00:45.930814  9741 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:45.941672  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:45.941998  1581 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:45.925408  9339 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.950474  1581 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:45.951030  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42356 (request call id 1337) took 2357 ms. Trace:
I20260709 13:00:45.951462  1540 rpcz_store.cc:276] 0709 13:00:43.593614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.135501 (+1541887us) service_pool.cc:224] Handling call
0709 13:00:45.334383 (+198882us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:45.336689 (+  2306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.950840 (+614151us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54002198d0. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:45.950971 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":456158592}
I20260709 13:00:45.880604  9088 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:45.938028  9792 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:45.951014  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:45.956627  1610 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:00:45.967195  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 183765us
I20260709 13:00:45.968757  1508 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:45.970075  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:45.971861  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:45.971503  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 137477us
I20260709 13:00:45.973296  2302 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 13:00:45.962145  1581 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:45.977409  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:45.977969  1689 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 20.
I20260709 13:00:45.973618  1505 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:45.982215  1688 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:00:45.982467  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:45.984879  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:45.989115  1686 raft_consensus.cc:1240] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 22. Current term is 23. Ops: []
I20260709 13:00:45.956506  9676 consensus_queue.cc:1059] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:00:45.956303  9547 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:00:45.946661  9790 consensus_queue.cc:1048] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:00:45.969624  9821 consensus_queue.cc:1059] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 13:00:45.970258  9339 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:45.996953  9339 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:45.946164  9764 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:45.996944  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:45.999444  9790 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 31 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 13:00:46.003079  2269 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:46.007826  9579 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:46.008944  9821 consensus_queue.cc:1059] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:00:46.009871  9821 consensus_queue.cc:1243] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer 4487a53c51be4634bf1ef29c5248353d log is divergent from this leader: its last log entry 18.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:00:46.010320  9821 raft_consensus.cc:3055] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:46.010638  9821 raft_consensus.cc:740] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:46.011484  9821 consensus_queue.cc:260] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:46.015082  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 53010.2us
I20260709 13:00:45.957468  9792 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.956632  9873 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:46.027170  1684 raft_consensus.cc:1240] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 21. Current term is 22. Ops: [19.11-21.12]
I20260709 13:00:46.029464  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:46.031546  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
W20260709 13:00:46.034343  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.997189  9761 raft_consensus.cc:2804] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:00:46.044648  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.038251  9912 raft_consensus.cc:3055] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:00:46.051479  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 77923.2us
I20260709 13:00:46.052651  1655 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:46.045617  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 74544.2us
W20260709 13:00:46.062629  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.047364  9761 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:46.108901  9339 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.043354  9873 raft_consensus.cc:697] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:46.064086  9821 raft_consensus.cc:3060] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:46.092722  9647 raft_consensus.cc:3055] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:00:46.038406  9790 consensus_queue.cc:1048] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.084s
W20260709 13:00:46.070474  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.029830  9792 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:46.045543  9912 raft_consensus.cc:740] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 13:00:46.128779  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 101753us
I20260709 13:00:46.109404  9761 raft_consensus.cc:3060] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:46.131219  2269 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:46.049520  9749 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.134348  2269 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:46.111191  9898 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.133106  1688 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:00:46.063203  9916 consensus_queue.cc:1059] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:00:46.135579  9905 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.104983  9638 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:46.123976  9647 raft_consensus.cc:740] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:46.065435  1655 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:46.048544  9728 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.136091  9896 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.158663  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:46.122861  9339 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:46.138430  9801 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:46.064107  9900 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:00:46.156625  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:46.129736  9874 consensus_queue.cc:1048] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:00:46.165515  1614 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 20.
I20260709 13:00:46.130764  9926 consensus_queue.cc:1048] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 13:00:46.140169  9749 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:46.172091  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:46.154038  9905 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:46.172770  2266 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:46.174134  2300 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:00:46.143229  9877 consensus_queue.cc:1059] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:00:46.191289  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:46.196213  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:46.196977  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4886) took 1649 ms. Trace:
I20260709 13:00:46.196148  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:46.197458  1682 rpcz_store.cc:276] 0709 13:00:44.547790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.823448 (+275658us) service_pool.cc:224] Handling call
0709 13:00:44.823698 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.863948 (+ 40250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.196674 (+1332726us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b5400159354. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:46.196908 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56886656}
I20260709 13:00:46.176592  9929 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.030s
I20260709 13:00:46.172041  9900 raft_consensus.cc:697] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:46.204149  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:46.205148  1614 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 28. Current term is 29. Ops: []
I20260709 13:00:46.206156  9889 consensus_queue.cc:260] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:46.161676  9728 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:46.063495  9887 consensus_queue.cc:237] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:46.214639  1612 raft_consensus.cc:1240] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 25. Current term is 26. Ops: []
I20260709 13:00:46.190719  9801 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:46.216224  9801 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.216612  9801 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:46.218294  9728 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:46.219385  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:46.220021  1682 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 24.
W20260709 13:00:46.220631  9897 log.cc:927] Time spent T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.505s	user 0.003s	sys 0.000s
W20260709 13:00:46.221235  9907 log.cc:927] Time spent T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:00:46.223362  9889 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:46.191216  9916 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.242950  9916 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:46.245368  9916 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:46.245759  9764 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:46.246729  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42356 (request call id 1348) took 1311 ms. Trace:
I20260709 13:00:46.247153  1541 rpcz_store.cc:276] 0709 13:00:44.935329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.968034 (+ 32705us) service_pool.cc:224] Handling call
0709 13:00:46.246549 (+1278515us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b5400219dd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:46.246669 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2000510720}
I20260709 13:00:46.248601  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 3985) took 1535 ms. Trace:
I20260709 13:00:46.249015  1609 rpcz_store.cc:276] 0709 13:00:44.713465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.893370 (+179905us) service_pool.cc:224] Handling call
0709 13:00:46.248360 (+1354990us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b540032b754. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:46.248541 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245085952}
W20260709 13:00:46.251478  2301 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32794 (request call id 1142) took 2074 ms (client timeout 1624 ms). Trace:
W20260709 13:00:46.251911  2301 rpcz_store.cc:269] 0709 13:00:44.177555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.177669 (+   114us) service_pool.cc:224] Handling call
0709 13:00:46.251302 (+2073633us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b54001617d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:46.251408 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1748678912}
I20260709 13:00:46.164947  9896 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:46.252774  1608 raft_consensus.cc:1240] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 22. Current term is 23. Ops: []
I20260709 13:00:46.229835  1508 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:46.254159  9896 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:46.254743  9896 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:00:46.255072  9896 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.255966  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:46.242971  9880 raft_consensus.cc:3055] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:46.258498  9880 raft_consensus.cc:740] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:46.259259  9880 consensus_queue.cc:260] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:46.255403  9896 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:00:46.264834  9909 log.cc:927] Time spent T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 13:00:46.267670  9749 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:46.215517  9088 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:46.269007  9088 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:46.269498  9088 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:46.141528  9898 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:46.254117  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3874) took 1017 ms. Trace:
I20260709 13:00:46.270829  1608 rpcz_store.cc:276] 0709 13:00:45.236952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.746084 (+509132us) service_pool.cc:224] Handling call
0709 13:00:46.252585 (+506501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:46.253222 (+   637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.253947 (+   725us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b540032b750. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0508ad 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:46.254066 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1015900928}
I20260709 13:00:46.189667  9873 consensus_queue.cc:237] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:46.272248  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:46.195207  9647 consensus_queue.cc:260] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:46.274078  9647 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:46.274576  9766 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:46.282512  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:46.284650  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.284830  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:46.285691  2302 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 22.
I20260709 13:00:46.240662  9928 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:46.286968  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:46.241874  9339 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:46.246268  9900 consensus_queue.cc:237] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:46.315855  9859 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:46.316504  9859 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:46.284811  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:46.317909  2296 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 22.
I20260709 13:00:46.318578  9859 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:46.241904  9905 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:46.322445  9674 raft_consensus.cc:3055] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:00:46.255980  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:46.233916  1610 raft_consensus.cc:2468] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 21.
I20260709 13:00:46.331086  1507 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:46.227918  1612 raft_consensus.cc:1240] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 19. Current term is 20. Ops: []
W20260709 13:00:46.290228  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.301311  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:46.291549  9880 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:46.300068  9928 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:46.335654  1612 raft_consensus.cc:1240] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 13:00:46.336954  1612 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:46.338132  1612 raft_consensus.cc:1240] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 20 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:46.308897  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:46.349961  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:46.309785  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:46.339984  9889 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:00:46.307579  9792 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:46.285295  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:46.321862  9898 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:46.331131  1610 raft_consensus.cc:1240] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:46.336669  1507 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:46.332940  1654 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:46.352303  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:46.329933  9905 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
W20260709 13:00:46.343705  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 218845us
I20260709 13:00:46.329453  9674 raft_consensus.cc:740] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
W20260709 13:00:46.346611  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 162121us
I20260709 13:00:46.349319  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 30 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:46.314337  9854 log.cc:927] Time spent T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 1.498s	user 0.006s	sys 0.022s
I20260709 13:00:46.305233  9761 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:46.338747  9928 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:46.459241  9761 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:46.353082  1507 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
W20260709 13:00:46.461416  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 108343us
I20260709 13:00:46.342702  1582 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:46.353524  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:46.359073  1614 raft_consensus.cc:1240] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 23. Current term is 24. Ops: [23.18-23.18]
W20260709 13:00:46.464123  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 58687us
I20260709 13:00:46.362285  2300 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 22.
I20260709 13:00:46.355353  9765 consensus_queue.cc:1059] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 13:00:46.372741  9932 consensus_queue.cc:1048] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:00:46.373123  9868 raft_consensus.cc:3055] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:46.465673  9868 raft_consensus.cc:740] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:46.466279  1612 raft_consensus.cc:2393] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 17: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:46.355576  9800 consensus_queue.cc:1059] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:00:46.467597  1612 raft_consensus.cc:1240] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 23. Current term is 24. Ops: []
I20260709 13:00:46.377765  9804 raft_consensus.cc:3055] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:46.343789  9801 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:46.354359  9775 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:00:46.465516  9765 consensus_queue.cc:1243] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer c262eac7fc904ae9bb91e450f6532e3f log is divergent from this leader: its last log entry 18.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:00:46.469265  9775 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:46.469969  9775 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:00:46.470384  9801 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:46.468809  9804 raft_consensus.cc:740] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:46.386714  9088 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:46.388207  9727 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:46.471511  9804 consensus_queue.cc:260] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:46.389825  9805 raft_consensus.cc:3055] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:00:46.398571  1616 raft_consensus.cc:1240] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 13:00:46.468425  9800 raft_consensus.cc:3055] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:46.473194  9800 raft_consensus.cc:740] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:46.474040  9800 consensus_queue.cc:260] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:46.475360  9868 consensus_queue.cc:260] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:46.476675  9868 raft_consensus.cc:3060] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:46.481737  9804 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:46.472749  9805 raft_consensus.cc:740] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:46.485667  9805 consensus_queue.cc:260] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:46.486924  9805 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:46.488904  1608 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 24.
I20260709 13:00:46.464148  1507 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:46.491376  1507 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:46.492398  9904 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:46.492976  9904 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.493342  9904 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:00:46.466334  1581 leader_election.cc:336] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:46.498028  9775 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:00:46.505735  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.427688  1505 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:46.511451  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 168708us
I20260709 13:00:46.435213  9792 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:46.512722  1582 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:46.514210  9860 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:46.512584  9791 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 13:00:46.515128  1582 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:46.515892  9860 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:46.516332  9860 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.516734  9860 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:46.517885  1613 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 29 index: 20. (index mismatch)
W20260709 13:00:46.519722  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.523933  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 458288us
I20260709 13:00:46.525454  9638 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:46.525949  9638 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.526309  9638 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:46.512584  9792 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:46.530483  1582 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:46.531944  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:46.531852  1688 raft_consensus.cc:1275] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:00:46.533425  1582 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:46.533700  1689 raft_consensus.cc:2393] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 23: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:46.535827  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:46.533291  1682 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
W20260709 13:00:46.511762  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 84150.8us
I20260709 13:00:46.542876  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:46.543902  1505 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:46.544584  1686 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:46.545921  1505 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:46.555286  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 63992us
W20260709 13:00:46.498086  1581 leader_election.cc:336] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:46.557209  1581 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:46.558265  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:46.560032  2297 raft_consensus.cc:1275] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:00:46.540392  1655 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:46.532366  9932 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:00:46.577414  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 79319.1us
W20260709 13:00:46.585678  1581 consensus_peers.cc:597] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:46.587275  1581 leader_election.cc:336] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:46.588140  1581 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:46.593111  2300 raft_consensus.cc:3060] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:46.531890  9718 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:46.519748  9808 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:00:46.592849  9761 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.568252  9088 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:46.573870  9801 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.573185  9621 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:46.568454  9749 raft_consensus.cc:2804] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:46.615576  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:46.606468  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 60602.1us
I20260709 13:00:46.621112  1505 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:46.599143  9727 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:00:46.567278  9896 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:46.575789  9730 consensus_queue.cc:1048] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:00:46.637274  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:46.605463  9775 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:46.640875  2300 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 22 index: 18. (term mismatch)
I20260709 13:00:46.641448  1608 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 24.
W20260709 13:00:46.637418  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 50149us
I20260709 13:00:46.608050  9900 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 13:00:46.644649  1581 leader_election.cc:336] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:46.617192  9926 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:46.647141  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.647042  1581 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:46.648221  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.619716  9868 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:00:46.616513  9932 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:46.605832  9744 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 15, Time since last communication: 0.037s
W20260709 13:00:46.648694  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.673062  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.643591  2300 pending_rounds.cc:85] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579: Aborting all ops after (but not including) 17
W20260709 13:00:46.665781  1611 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 3969) took 1961 ms (client timeout 1976 ms). Trace:
W20260709 13:00:46.685947  1611 rpcz_store.cc:269] 0709 13:00:44.703859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.703989 (+   130us) service_pool.cc:224] Handling call
0709 13:00:46.665498 (+1961509us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b54002a6cd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:46.665673 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":332393344}
I20260709 13:00:46.687650  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:46.668352  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:46.640527  9887 consensus_queue.cc:1059] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 13:00:46.662166  1686 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 24.
I20260709 13:00:46.640653  9874 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:00:46.680641  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.727807  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:46.641819  9749 raft_consensus.cc:697] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:46.647682  9808 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:00:46.618568  9761 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:46.623751  9905 consensus_queue.cc:1048] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
W20260709 13:00:46.722836  1581 leader_election.cc:336] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:46.645704  9880 consensus_queue.cc:1059] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.076s
I20260709 13:00:46.640527  9621 raft_consensus.cc:697] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 13:00:46.726715  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 140545us
I20260709 13:00:46.664193  9929 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.728461  1608 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 24.
I20260709 13:00:46.622501  9801 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:46.685321  2300 pending_rounds.cc:107] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 21.18
W20260709 13:00:46.750978  1505 leader_election.cc:336] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Timed out: RequestConsensusVote RPC to 127.0.107.194:41953 timed out after 1.976s (SENT)
I20260709 13:00:46.671327  9547 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:46.671159  9872 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.623428  9928 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:46.739041  1581 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:46.765707  1581 consensus_peers.cc:597] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:46.736191  9887 consensus_queue.cc:1243] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer c262eac7fc904ae9bb91e450f6532e3f log is divergent from this leader: its last log entry 22.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:00:46.741959  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 3973) took 2034 ms. Trace:
I20260709 13:00:46.771152  1617 rpcz_store.cc:276] 0709 13:00:44.707691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.064822 (+357131us) service_pool.cc:224] Handling call
0709 13:00:45.065171 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:45.264457 (+199286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.741663 (+1477206us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54002a5dd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:46.741900 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":431656704}
I20260709 13:00:46.751272  2300 raft_consensus.cc:2917] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Aborting config change with OpId 21.18: Aborted: Op aborted by new leader
I20260709 13:00:46.649519  9775 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:46.671239  9900 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:46.762122  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 221681us
W20260709 13:00:46.766307  1581 leader_election.cc:336] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:46.779860  1581 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:46.735472  9339 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:46.769138  1609 raft_consensus.cc:1240] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:00:46.772378  2300 raft_consensus.cc:2889] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [term 22 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:46.682145  9647 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.071s
I20260709 13:00:46.716109  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:46.785822  1581 leader_election.cc:336] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:46.681077  9935 consensus_queue.cc:1059] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.099s
I20260709 13:00:46.789999  1612 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:46.790197  1581 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:46.787855  1655 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:46.724681  9860 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:46.786619  9676 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 13:00:46.791815  2301 raft_consensus.cc:1240] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:46.676664  9932 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:46.796886  1581 leader_election.cc:336] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:46.769771  9730 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:46.670626  9926 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:46.779372  9880 consensus_queue.cc:1243] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Peer c262eac7fc904ae9bb91e450f6532e3f log is divergent from this leader: its last log entry 20.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:00:46.799034  1581 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:46.778437  9889 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.805167  9896 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:46.805438  9940 log.cc:927] Time spent T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:00:46.806070  9939 log.cc:927] Time spent T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:00:46.818478  9775 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:46.809211  9928 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:46.809827  9621 consensus_queue.cc:237] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:46.811189  1612 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 21.
I20260709 13:00:46.766916  9904 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:46.814468  1581 leader_election.cc:336] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:46.815254  1611 raft_consensus.cc:1240] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:00:46.799923  9639 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:46.792874  9088 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:46.820712  1655 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:46.812201  9932 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:46.770270  9872 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:46.765292  9929 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:46.826967  1581 leader_election.cc:336] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:46.830816  1655 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:46.828177  2300 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 31 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 29 index: 18. Preceding OpId from leader: term: 31 index: 19. (index mismatch)
W20260709 13:00:46.831444  1581 consensus_peers.cc:597] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:46.832098  1581 consensus_peers.cc:597] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:46.832619  1581 leader_election.cc:336] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:46.832973  1581 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:46.823208  9730 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:46.845316  9808 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:00:46.852442  1581 consensus_peers.cc:597] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:46.825623  9946 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:46.821498  9889 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:46.853199  1581 consensus_peers.cc:597] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:46.839181  9741 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:46.800683  9749 consensus_queue.cc:237] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:46.859345  1581 consensus_peers.cc:597] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:46.860267  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 527110us
I20260709 13:00:46.854746  9730 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:46.835724  9088 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:46.880157  1654 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:46.863467  1581 consensus_peers.cc:597] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:46.880589  9944 log.cc:927] Time spent T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.062s	user 0.001s	sys 0.001s
I20260709 13:00:46.861531  9808 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:46.839951  9948 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:46.893453  1581 leader_election.cc:336] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:46.895795  1581 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:46.896976  1581 consensus_peers.cc:597] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:46.924923  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 44855.3us
I20260709 13:00:46.862356  9946 consensus_queue.cc:1059] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:00:46.883447  9741 consensus_queue.cc:1059] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.015s
I20260709 13:00:46.899888  9808 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:46.925249  9761 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:46.926554  9951 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:00:46.939319  9951 raft_consensus.cc:3055] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:00:46.939694  9951 raft_consensus.cc:740] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 13:00:46.940335  9941 log.cc:927] Time spent T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:00:46.943234  9904 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:46.943511  2269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.944731  2266 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 13:00:46.945047  2269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.947669  9949 log.cc:927] Time spent T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:00:46.947783  9784 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:46.948383  9784 raft_consensus.cc:697] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 21 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:46.949223  9784 consensus_queue.cc:237] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:46.953790  1608 raft_consensus.cc:1275] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:00:46.956806  9761 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:46.957407  9761 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:46.959477  9761 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:46.960011  9801 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:46.927208  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:46.962740  9088 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:46.927181  2267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.927286  1654 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 13:00:46.974256  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 47034.9us
I20260709 13:00:46.975488  1654 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:46.984589  1654 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:46.953627  9807 raft_consensus.cc:3055] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:00:46.967342  9801 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.992100  9948 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:47.074057  9948 raft_consensus.cc:2764] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 13:00:46.940591  9951 consensus_queue.cc:260] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:46.997349  9889 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:46.997872  9893 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.939720  9860 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:46.998829  9339 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 13:00:47.001718  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 667730us
W20260709 13:00:46.927582  9943 log.cc:927] Time spent T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:00:47.002558  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:47.087004  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 245841us
I20260709 13:00:47.087162  1609 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:47.003441  1617 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 31 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 31 index: 19. (index mismatch)
I20260709 13:00:47.005970  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:47.086017  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 78988.2us
W20260709 13:00:47.107317  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 122754us
W20260709 13:00:47.095021  1655 leader_election.cc:336] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:47.221511  1655 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:47.096010  9804 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.223172  9804 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:47.086069  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.063819  9861 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.033s
I20260709 13:00:46.930902  9872 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:47.173394  9889 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:47.091014  9893 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:47.065301  9807 raft_consensus.cc:740] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:47.245119  1583 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:47.245924  9807 consensus_queue.cc:260] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:47.092051  9808 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:47.246922  9893 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:46.928839  9929 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:47.092453  9339 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:47.248999  9872 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:00:47.249208  9807 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:47.249719  9872 raft_consensus.cc:697] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 24 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:47.249946  9808 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.989914  9946 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:00:47.250995  9808 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:47.251606  9872 consensus_queue.cc:237] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:47.117990  9638 consensus_meta.cc:287] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.591s	user 0.011s	sys 0.000s
I20260709 13:00:47.009469  9671 consensus_queue.cc:1048] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.013s
I20260709 13:00:47.262629  9638 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:47.065850  9718 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.264794  9718 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:47.266660  1683 raft_consensus.cc:1240] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 24. Current term is 25. Ops: []
I20260709 13:00:47.267365  9900 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:47.267834  9718 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:47.072252  9745 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.269266  9745 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:47.272094  9745 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:47.072588  9801 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:46.927703  9926 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:47.126435  9639 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:47.126156  9674 consensus_queue.cc:260] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:47.185909  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:47.196328  1615 raft_consensus.cc:1240] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:00:47.207021  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:47.221812  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58006 (request call id 1214) took 1189 ms. Trace:
I20260709 13:00:47.062361  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:47.229408  9958 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:45.547336  1535 rpcz_store.cc:276] 0709 13:00:44.047109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.340059 (+1292950us) service_pool.cc:224] Handling call
0709 13:00:45.340360 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.340746 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:00:45.341041 (+   295us) log.cc:844] Serialized 14 byte log entry
0709 13:00:45.543359 (+202318us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:45.543421 (+    62us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:45.543472 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.543573 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.544985 (+  1412us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1272,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":175922,"spinlock_wait_cycles":17664,"thread_start_us":197526,"threads_started":2,"wal-append.queue_time_us":44686}
I20260709 13:00:47.229779  1690 raft_consensus.cc:1240] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 23. Current term is 24. Ops: [23.18-23.18]
W20260709 13:00:47.224077  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 132002us
I20260709 13:00:47.238912  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:46.938303  9910 raft_consensus.cc:3060] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:47.252112  9946 raft_consensus.cc:697] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:47.322549  9674 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:47.234404  9889 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:47.325599  9889 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:47.328734  1689 raft_consensus.cc:1275] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:00:47.223332  1654 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:47.083002  9766 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.264111  9808 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:47.304759  1612 raft_consensus.cc:2393] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 29: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:47.293671  9804 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:47.339259  9766 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:47.299187  1614 rpcz_store.cc:276] 0709 13:00:46.032375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.211200 (+178825us) service_pool.cc:224] Handling call
0709 13:00:46.211539 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:46.464530 (+252991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.221101 (+756571us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b540008c5d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:47.221596 (+   495us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":338598784}
I20260709 13:00:47.310194  9801 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:47.313918  1608 raft_consensus.cc:1275] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:00:47.318696  9954 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:47.321977  9946 consensus_queue.cc:237] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:46.932166  9950 log.cc:927] Time spent T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:00:47.318482  9810 raft_consensus.cc:3055] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:47.355240  9766 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:47.356222  9741 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:47.352520  9808 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.357187  9808 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:47.356561  9745 raft_consensus.cc:3055] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:00:47.359252  9745 raft_consensus.cc:740] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:47.349470  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 3999) took 1154 ms. Trace:
W20260709 13:00:47.360999  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 61200.6us
I20260709 13:00:47.349056  9810 raft_consensus.cc:740] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:47.329085  9912 consensus_queue.cc:260] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:47.362761  9808 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:47.387336  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:47.391467  1683 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:00:47.362460  9745 consensus_queue.cc:260] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:47.361244  1610 rpcz_store.cc:276] 0709 13:00:46.126430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.356467 (+230037us) service_pool.cc:224] Handling call
0709 13:00:46.356801 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:46.357011 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:00:46.358555 (+  1544us) log.cc:844] Serialized 14 byte log entry
0709 13:00:47.098885 (+740330us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b18004dd220. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf123a 00007fc85d05ba2a
0709 13:00:47.212039 (+113154us) log.cc:844] Serialized 14 byte log entry
0709 13:00:47.234923 (+ 22884us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:47.237892 (+  2969us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:47.260754 (+ 22862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.275872 (+ 15118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.280718 (+  4846us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7322,"prepare.queue_time_us":27202,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":90,"raft.queue_time_us":959,"raft.run_cpu_time_us":413,"raft.run_wall_time_us":3394,"spinlock_wait_cycles":82562944,"thread_start_us":110505,"threads_started":2,"wal-append.queue_time_us":846655}
I20260709 13:00:47.400226  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:47.400683  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:47.400970  9958 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.407306  9958 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:47.408907  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:47.410359  9958 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:47.413530  9638 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:47.413776  1612 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:00:47.413511  1613 raft_consensus.cc:1275] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260709 13:00:47.415027  1613 pending_rounds.cc:85] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f: Aborting all ops after (but not including) 12
I20260709 13:00:47.415261  1613 pending_rounds.cc:107] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 13:00:47.415563  1613 raft_consensus.cc:2889] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:47.415992  2267 consensus_peers.cc:597] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:47.416531  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 66944.4us
I20260709 13:00:47.416981  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:47.418663  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:47.420890  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:47.421686  1617 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 18.
I20260709 13:00:47.424976  9956 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:47.425989  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:47.429744  9738 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.430423  9738 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:47.432825  9738 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:47.433717  9738 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.434659  9738 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:47.436983  9738 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:47.425750  9956 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:47.426872  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:47.427637  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:47.445343  9638 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.450134  9638 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:47.460897  1688 raft_consensus.cc:1275] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:00:47.398113  9810 consensus_queue.cc:260] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:47.465047  1683 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 21.
W20260709 13:00:47.468613  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 112971us
W20260709 13:00:47.476056  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 252980us
W20260709 13:00:47.478174  9970 log.cc:927] Time spent T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:00:47.478874  9951 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:47.479391  9745 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:47.479653  1654 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:47.480618  9892 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.481271  9892 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:47.484714  9892 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:47.491092  1609 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 25.
W20260709 13:00:47.490906  9969 log.cc:927] Time spent T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:00:47.481755  9912 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:00:47.502808  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.516438  9958 raft_consensus.cc:2804] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:47.517130  9958 raft_consensus.cc:697] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 21 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:47.518355  9958 consensus_queue.cc:237] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:47.520175  2301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32788 (request call id 809) took 1226 ms. Trace:
I20260709 13:00:47.520648  9964 consensus_queue.cc:1059] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 28.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.014s
I20260709 13:00:47.521932  9964 raft_consensus.cc:3055] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 28 LEADER]: Stepping down as leader of term 28
I20260709 13:00:47.522303  9964 raft_consensus.cc:740] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:47.523380  9964 consensus_queue.cc:260] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:47.520617  2301 rpcz_store.cc:276] 0709 13:00:46.293415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.293570 (+   155us) service_pool.cc:224] Handling call
0709 13:00:46.310673 (+ 17103us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:46.795989 (+485316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.519713 (+723724us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b54006bfdd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:47.520000 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1105512320}
I20260709 13:00:47.530042  9956 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:47.530887  9638 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:47.533581  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.534026  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 3972) took 2826 ms. Trace:
W20260709 13:00:47.534582  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.535517  1687 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 29 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 29 index: 20. (index mismatch)
I20260709 13:00:47.537478  9889 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.538147  9889 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:47.543020  2267 consensus_peers.cc:597] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:47.543793  9874 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.544519  9874 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:47.548362  9810 raft_consensus.cc:3060] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:00:47.550287  9972 log.cc:927] Time spent T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.168s	user 0.000s	sys 0.002s
I20260709 13:00:47.534447  1615 rpcz_store.cc:276] 0709 13:00:44.707407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.043419 (+336012us) service_pool.cc:224] Handling call
0709 13:00:45.043852 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:47.305189 (+2261337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.533697 (+228508us) spinlock_profiling.cc:243] Waited 2.13 s on lock 0x7b54001f6dd4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:47.533948 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4900412160}
W20260709 13:00:47.543761  2267 consensus_peers.cc:597] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:47.553845  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:47.556465  1505 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:47.559252  9954 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:47.569253  9964 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:00:47.565832  9638 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:47.572045  9874 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:47.575270  1654 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:47.585290  1688 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 11.
W20260709 13:00:47.580318  1655 leader_election.cc:336] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:47.589990  1655 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:47.605659  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.590745  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:47.615029  2301 raft_consensus.cc:1275] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 13:00:47.615386  2301 pending_rounds.cc:85] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579: Aborting all ops after (but not including) 11
I20260709 13:00:47.615573  2301 pending_rounds.cc:107] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:00:47.615780  2301 raft_consensus.cc:2889] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:47.589849  9956 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:47.610584  9555 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.632272  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:47.613125  9638 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:47.634918  1615 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 26.
I20260709 13:00:47.641752  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:47.633450  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 30 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:47.644856  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 30 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:47.646461  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:47.647688  2295 raft_consensus.cc:2410] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 21 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 15.
I20260709 13:00:47.648736  1686 raft_consensus.cc:1240] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 13:00:47.649075  1435 catalog_manager.cc:5697] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:47.650905  1435 catalog_manager.cc:5697] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 13:00:47.652634  9904 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.652956  9638 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:47.653294  9904 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:47.654150  1608 raft_consensus.cc:1217] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Deduplicated request from leader. Original: 15.13->[16.14-17.15]   Dedup: 16.14->[17.15-17.15]
I20260709 13:00:47.654721  1608 raft_consensus.cc:1240] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 17. Current term is 18. Ops: [16.14-17.15]
I20260709 13:00:47.656414  1615 raft_consensus.cc:1240] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 23. Current term is 24. Ops: []
W20260709 13:00:47.656827  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 120357us
I20260709 13:00:47.658159  1505 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:47.661821  1685 raft_consensus.cc:2410] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 30 because replica has last-logged OpId of term: 26 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 18.
I20260709 13:00:47.654592  9898 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:47.671308  9910 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.672345  9910 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:47.673257  9956 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:00:47.673791  9956 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.674247  9956 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:47.666091  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:47.676718  9722 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:00:47.677234  9722 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:47.671844  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 96310.9us
I20260709 13:00:47.678306  1656 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:47.679276  9638 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:47.676966  9744 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 13:00:47.698930  2303 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:00:47.700124  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:47.700848  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:47.701392  1614 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 13.
I20260709 13:00:47.701527  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:47.701936  9904 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:47.680819  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4912) took 1078 ms. Trace:
I20260709 13:00:47.702704  1613 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:00:47.702732  1691 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 26.
I20260709 13:00:47.680408  1656 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:47.685997  1687 raft_consensus.cc:1240] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 21 LEADER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:47.680902  9339 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:47.680867  9555 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:47.689375  9774 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:47.725071  9339 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:47.725466  9774 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:47.677654  9722 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:00:47.690814  9978 log.cc:927] Time spent T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:00:47.691931  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:47.692178  2300 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 13.
I20260709 13:00:47.741667  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:47.692687  1609 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 23.
W20260709 13:00:47.743101  2267 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.694273  2297 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:00:47.695122  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:47.696599  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:47.697094  9860 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:47.693182  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:47.697598  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:47.745945  2295 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:47.710584  1608 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:00:47.663209  9889 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:47.724242  1610 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
W20260709 13:00:47.728731  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.693295  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:47.741659  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:47.744875  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 182921us
W20260709 13:00:47.746206  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 73907.6us
I20260709 13:00:47.749718  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:47.750461  2297 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 19.
I20260709 13:00:47.751247  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:47.751955  1612 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:47.704138  1684 rpcz_store.cc:276] 0709 13:00:46.531274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.535457 (+  4183us) service_pool.cc:224] Handling call
0709 13:00:46.535809 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:46.536166 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:46.536197 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:46.543550 (+  7353us) log.cc:844] Serialized 26 byte log entry
0709 13:00:47.225711 (+682161us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b180040d680. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f63c02 00007fc85cbeb20b 00007fc85cbf0d23 00007fc85cbf10d1 00007fc85d00ca0f
0709 13:00:47.348236 (+122525us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:00:47.353505 (+  5269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.361382 (+  7877us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:47.588061 (+226679us) raft_consensus.cc:1685] finished
0709 13:00:47.588080 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.609151 (+ 21071us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1919,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":9752,"spinlock_wait_cycles":46615808,"thread_start_us":66435,"threads_started":1,"wal-append.queue_time_us":909547}
I20260709 13:00:47.754596  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:47.755813  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:47.756680  9889 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.734452  9954 consensus_queue.cc:1059] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 13:00:47.725095  9555 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:47.757469  9889 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:47.686080  9800 raft_consensus.cc:3060] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:47.748142  9910 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:47.760428  9889 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:47.760684  2267 leader_election.cc:336] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:47.776705  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:47.777536  1614 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 23.
I20260709 13:00:47.778402  9784 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.778950  9784 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:47.780009  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 99692.2us
I20260709 13:00:47.781863  1656 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:47.783278  9872 raft_consensus.cc:3055] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:47.783757  9872 raft_consensus.cc:740] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:47.784049  9964 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:00:47.785002  1655 leader_election.cc:336] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:47.785641  1655 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:47.786450  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:47.787068  1655 leader_election.cc:336] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:47.787533  1655 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:47.787845  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:47.788379  9745 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:47.789207  9745 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:47.790685  1682 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 22.
I20260709 13:00:47.791296  9964 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:47.791843  9964 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:47.792555  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:47.793244  1609 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 16.
I20260709 13:00:47.795132  1583 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:47.796751  9861 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:47.797400  1656 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:47.798247  9745 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:00:47.798918  9745 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.799400  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:47.799528  9745 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:47.800894  9784 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:47.728819  9774 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:47.801764  9745 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:47.768350  9900 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.034s
I20260709 13:00:47.768671  9718 consensus_queue.cc:1059] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
W20260709 13:00:47.769053  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.805720  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:47.806417  1683 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 23.
I20260709 13:00:47.807334  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:47.807771  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:47.807933  1683 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 29.
I20260709 13:00:47.808379  2303 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 26.
I20260709 13:00:47.767589  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:47.807235  9674 consensus_queue.cc:1059] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.002s
I20260709 13:00:47.809319  2300 raft_consensus.cc:1275] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 15. (term mismatch)
W20260709 13:00:47.770874  2269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.809947  9674 raft_consensus.cc:3055] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:00:47.770967  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:47.810340  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:47.810554  9674 raft_consensus.cc:740] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:47.773934  9555 consensus_queue.cc:1048] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:00:47.784934  9872 consensus_queue.cc:260] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:47.812112  9872 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:47.811825  9674 consensus_queue.cc:260] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:47.813410  9674 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:47.814396  1507 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:47.815282  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:47.815649  1507 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:47.816028  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 54814.9us
I20260709 13:00:47.817076  9774 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:47.817369  9718 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:47.774809  1505 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:47.818774  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:47.819280  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 44575.2us
I20260709 13:00:47.815199  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:47.820880  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:47.822273  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:47.823719  1685 raft_consensus.cc:1240] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:47.773373  9910 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.056s
I20260709 13:00:47.830184  9912 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:00:47.830660  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:47.831280  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:47.831764  2303 raft_consensus.cc:2410] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 24 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 13:00:47.792423  1508 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:47.832754  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:47.821226  9900 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:47.834358  9900 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.834761  9900 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:47.832732  9579 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.837318  9579 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:47.761677  2295 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 23.
I20260709 13:00:47.809779  2300 pending_rounds.cc:85] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579: Aborting all ops after (but not including) 14
I20260709 13:00:47.840912  2300 pending_rounds.cc:107] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579: Aborting uncommitted NO_OP operation due to leader change: 17.15
I20260709 13:00:47.841259  2300 raft_consensus.cc:2889] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:47.819556  1683 raft_consensus.cc:2393] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 25: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:47.842275  9579 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:47.843128  1683 raft_consensus.cc:1240] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:47.809286  1684 raft_consensus.cc:2393] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 19: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:47.847401  1435 catalog_manager.cc:5697] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 20 to 26, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 26 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:47.849732  1581 consensus_peers.cc:597] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:47.849587  1435 catalog_manager.cc:5697] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 16 to 19, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 19 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:47.851683  1581 leader_election.cc:336] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:47.820577  1505 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:47.851599  1435 catalog_manager.cc:5697] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 13:00:47.850385  1684 raft_consensus.cc:1275] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:00:47.857627  1685 raft_consensus.cc:1240] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:00:47.858650  1684 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:00:47.791944  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:47.859885  1689 raft_consensus.cc:1275] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:00:47.834004  1508 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:47.854342  9964 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:47.861888  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 64538.4us
I20260709 13:00:47.866182  1683 raft_consensus.cc:1275] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:00:47.852144  1581 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:47.880419  1687 raft_consensus.cc:1275] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:00:47.798928  1583 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:47.861191  9774 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.895514  1685 raft_consensus.cc:1240] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 20. Current term is 21. Ops: []
W20260709 13:00:47.897251  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 98339.6us
I20260709 13:00:47.883015  9912 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:47.905534  1505 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:47.908787  1583 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:47.916153  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:47.920588  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 68898.5us
I20260709 13:00:47.917968  1689 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 29.
I20260709 13:00:47.887197  9910 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:47.892627  9744 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:47.899708  9774 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:47.920270  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:47.929078  9792 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 13:00:47.931316  2269 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.886273  9954 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.029s
W20260709 13:00:47.921334  1581 leader_election.cc:336] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:47.910812  9555 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:47.934738  1581 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:47.933456  1582 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:47.932857  1612 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:00:47.927707  1507 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:47.948446  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 77837.2us
I20260709 13:00:47.951736  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:47.931618  9792 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.955062  1582 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:47.959031  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:47.959626  2295 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:00:47.959789  2302 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 13:00:47.937292  9718 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:00:47.966143  9555 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:00:47.966758  9555 raft_consensus.cc:697] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:47.966899  1685 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:00:47.968374  9637 raft_consensus.cc:2804] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:47.968703  9639 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:47.968801  9637 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.969201  9637 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:47.970013  9738 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:00:47.970417  9738 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.970736  9738 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:00:47.971253  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:47.971863  1687 raft_consensus.cc:2468] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 25.
I20260709 13:00:47.972951  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:47.956054  9579 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:47.973836  9579 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:47.975436  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:47.977507  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 143567us
I20260709 13:00:47.925908  9900 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:47.954156  9951 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:47.933624  9773 consensus_queue.cc:1059] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:00:47.978680  1508 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:47.969125  9639 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.987877  9639 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:47.961452  9792 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:00:47.994097  9774 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:48.034264  9774 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:47.967854  9555 consensus_queue.cc:237] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:48.036209  9900 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:47.997575  9773 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:00:47.998667  9860 raft_consensus.cc:3055] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:48.039530  9860 raft_consensus.cc:740] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:48.040619  9860 consensus_queue.cc:260] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:48.041997  9860 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:48.005601  1435 catalog_manager.cc:5697] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 13:00:48.044967  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 54264.5us
I20260709 13:00:48.045791  1435 catalog_manager.cc:5697] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 13 to 18, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 18 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 13:00:48.047051  2269 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:48.008749  9859 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:48.048460  9801 consensus_queue.cc:1059] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 24.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 13:00:48.048753  9859 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:48.009420  1438 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38804 (request call id 193) took 27096 ms (client timeout 15000 ms). Trace:
I20260709 13:00:48.011677  9639 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:48.050642  9801 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:00:48.050374  1438 rpcz_store.cc:269] 0709 13:00:20.907964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.929232 (+ 21268us) service_pool.cc:224] Handling call
0709 13:00:48.004355 (+27075123us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:43.326229 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:43.327063 (+   834us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:43.327122 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:00:43.327143 (+    21us) tablet.cc:662] Decoding operations
0709 13:00:43.328444 (+  1301us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:43.356505 (+ 28061us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:43.356538 (+    33us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:00:43.357861 (+  1323us) tablet.cc:701] Row locks acquired
0709 13:00:43.357908 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:00:43.358132 (+   224us) write_op.cc:270] Start()
0709 13:00:43.358326 (+   194us) write_op.cc:276] Timestamp: P: 1783602043358046 usec, L: 0
0709 13:00:43.358362 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:00:43.449420 (+ 91058us) log.cc:844] Serialized 5133 byte log entry
0709 13:00:44.059700 (+610280us) op_driver.cc:464] REPLICATION: finished
0709 13:00:44.095288 (+ 35588us) write_op.cc:301] APPLY: starting
0709 13:00:44.116600 (+ 21312us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:44.660513 (+543913us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:44.660640 (+   127us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:45.055552 (+394912us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:45.055894 (+   342us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=0,mrs_lookups=0
0709 13:00:45.055954 (+    60us) write_op.cc:312] APPLY: finished
0709 13:00:45.056313 (+   359us) log.cc:844] Serialized 121 byte log entry
0709 13:00:45.074062 (+ 17749us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:45.079394 (+  5332us) write_op.cc:454] Released schema lock
0709 13:00:45.085337 (+  5943us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:45.107871 (+ 22534us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:45.107901 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1018956,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":1179,"apply.run_cpu_time_us":23134,"apply.run_wall_time_us":1041887,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58493,"num_ops":13,"prepare.queue_time_us":551544,"prepare.run_cpu_time_us":34185,"prepare.run_wall_time_us":505188,"raft.queue_time_us":83830,"raft.run_cpu_time_us":1467,"raft.run_wall_time_us":1467,"replication_time_us":701179,"thread_start_us":458051,"threads_started":4,"wal-append.queue_time_us":434220,"wal-append.run_cpu_time_us":12248,"wal-append.run_wall_time_us":2178870}]]}
I20260709 13:00:48.014765  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:48.057536  1689 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 22.
W20260709 13:00:48.015363  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 87789.7us
I20260709 13:00:48.019825  9964 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:48.015652  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:48.059072  2267 consensus_peers.cc:597] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:48.023864  1687 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:00:48.026521  9951 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:48.061425  9951 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:48.051419  9801 raft_consensus.cc:3055] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:00:48.062443  9801 raft_consensus.cc:740] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:48.056376  9639 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:48.013675  9722 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:48.063467  9801 consensus_queue.cc:260] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:48.064921  1691 raft_consensus.cc:2393] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 25: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:47.984565  9874 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:00:48.071986  9859 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:48.047639  1435 catalog_manager.cc:5697] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 20 to 22, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 22 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.074535  1435 catalog_manager.cc:5697] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 21 to 25, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 25 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.076529  1435 catalog_manager.cc:5697] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 16 to 18, leader changed from 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 18 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:48.078431  9722 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:48.081351  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:48.072165  9579 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:48.087051  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 121883us
I20260709 13:00:48.088930  1435 catalog_manager.cc:5697] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 18 to 25, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 25 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 13:00:48.113243  2267 consensus_peers.cc:597] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:48.124212  1656 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:48.085024  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:48.127851  2294 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:48.129741  2302 raft_consensus.cc:2393] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 21: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:48.133291  1435 catalog_manager.cc:5697] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 26 to 28. New cstate: current_term: 28 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:48.145949  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.144981  1435 catalog_manager.cc:5697] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 12 to 14, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 13:00:48.132093  9774 consensus_queue.cc:1048] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:00:48.156863  9801 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:48.147521  1435 catalog_manager.cc:5697] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 22 to 29, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 29 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:48.023842  9956 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:48.132717  9339 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:00:48.176935  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 255484us
I20260709 13:00:48.136170  9718 raft_consensus.cc:697] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:48.184866  9775 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:48.186971  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 208265us
W20260709 13:00:48.190531  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 226249us
W20260709 13:00:48.173478  2267 consensus_peers.cc:597] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:48.193179  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 258980us
W20260709 13:00:48.194736  1581 leader_election.cc:336] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:48.195252  1581 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:48.088991  9951 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:48.193527  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 52117.7us
W20260709 13:00:48.200320  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.202062  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:48.204120  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:48.168982  9910 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:48.207650  1508 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:48.211253  1654 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:48.188095  9339 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 13:00:48.220556  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 55669.7us
I20260709 13:00:48.216516  1654 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:48.222141  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:48.223598  1612 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:00:48.225029  1609 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:00:48.193046  9810 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.169603  9964 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.037s
I20260709 13:00:48.233207  1435 catalog_manager.cc:5697] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 20 to 21, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 21 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 13:00:48.226311  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:48.227196  1654 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:48.176409  9792 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:48.198457  9775 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:48.302673  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:48.302721  1435 catalog_manager.cc:5697] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:48.410784  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:48.313427  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:48.252367  1615 raft_consensus.cc:2393] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 25: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:48.285914  2294 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
W20260709 13:00:48.427145  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 142036us
W20260709 13:00:48.286917  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 97398.8us
W20260709 13:00:48.262801  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.314529  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:48.313768  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:48.402460  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 54558.3us
I20260709 13:00:48.207902  9904 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:48.214555  9808 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:48.459611  1614 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 23.
W20260709 13:00:48.432403  9994 log.cc:927] Time spent T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:00:48.233335  9954 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.313267  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:48.430382  9999 log.cc:927] Time spent T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:00:48.224349  9745 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:00:48.430400  9998 log.cc:927] Time spent T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:00:48.227052  9339 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:48.401504  9910 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 13:00:48.375679  9986 log.cc:927] Time spent T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:00:48.225716  9637 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:48.485674  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:48.505388  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:48.507629  9910 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:48.480576  9718 consensus_queue.cc:237] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:48.490573  9808 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:48.509979  9956 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:48.490931  9904 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:48.510517  1435 catalog_manager.cc:5697] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 13:00:48.483016  9744 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.029s
I20260709 13:00:48.483091  9861 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.511979  1435 catalog_manager.cc:5697] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 19 to 22, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 22 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.512990  9861 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:48.513926  1435 catalog_manager.cc:5697] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 15 to 20, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 20 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.515290  9861 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:48.516419  9805 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.507339  2298 raft_consensus.cc:1240] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 22. Current term is 23. Ops: [22.18-22.18]
I20260709 13:00:48.516907  2299 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 18. (term mismatch)
I20260709 13:00:48.517661  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:48.243732  9774 raft_consensus.cc:3055] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:00:48.378069  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 184333us
I20260709 13:00:48.239251  9722 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:48.372141  9874 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:48.517009  9738 consensus_meta.cc:287] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.546s	user 0.006s	sys 0.005s
I20260709 13:00:48.348500  9912 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.494551  9745 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.431519  9784 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.529278  9745 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:48.529486  9784 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:48.489171  1616 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 23.
I20260709 13:00:48.237468  9804 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.495553  1609 raft_consensus.cc:2393] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 27: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 13:00:48.463039  1581 leader_election.cc:336] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:48.533032  9804 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:48.292493  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:48.533629  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 70585.5us
I20260709 13:00:48.501238  1507 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:48.534313  2294 raft_consensus.cc:1275] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:00:48.302254  9555 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:00:48.519086  1689 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:48.537909  9745 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:48.540128  9745 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:48.500011  9954 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:48.490525  2297 raft_consensus.cc:1240] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:00:48.237351  9639 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:00:48.339968  9810 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:48.501092  1615 raft_consensus.cc:1240] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:00:48.515954  1435 catalog_manager.cc:5697] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 13:00:48.583103  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 60643.3us
I20260709 13:00:48.518682  2299 pending_rounds.cc:85] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579: Aborting all ops after (but not including) 17
W20260709 13:00:48.560087 10002 log.cc:927] Time spent T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:00:48.523231  9774 raft_consensus.cc:740] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:48.289142  9741 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.216s
I20260709 13:00:48.526033  9722 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.554322  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:48.559315  9956 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:48.662751  9722 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:48.662863  9956 raft_consensus.cc:697] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:48.664004  9956 consensus_queue.cc:237] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:48.313853  9996 consensus_queue.cc:1048] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.228s
W20260709 13:00:48.546789  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 45611us
I20260709 13:00:48.528148  1508 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:48.667388  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 139280us
I20260709 13:00:48.562383  1689 raft_consensus.cc:2468] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 23.
I20260709 13:00:48.542495  9800 consensus_queue.cc:1048] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.050s
I20260709 13:00:48.516968  9805 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:48.561709  9874 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:48.569511  9912 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:48.654295  2299 pending_rounds.cc:107] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579: Aborting uncommitted NO_OP operation due to leader change: 23.18
I20260709 13:00:48.638520  9951 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:48.624365  1610 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 21.
I20260709 13:00:48.542057  9738 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:48.659826  1435 catalog_manager.cc:5697] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 17 to 23, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 23 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:48.669553  1611 raft_consensus.cc:2393] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 19: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:48.676506  1508 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:48.677706  2299 raft_consensus.cc:2889] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:48.657691  1613 raft_consensus.cc:2410] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 30 because replica has last-logged OpId of term: 29 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 28 index: 20.
I20260709 13:00:48.673990  9889 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:48.662498  9741 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:48.680100  9889 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.685348  2302 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 24.
W20260709 13:00:48.682006  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 454659us
I20260709 13:00:48.662564  9639 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 13:00:48.688153  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 179789us
I20260709 13:00:48.697182  1435 catalog_manager.cc:5697] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 16 to 19, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 19 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.696501  2269 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:48.684859  9889 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:48.709517  1654 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:48.686076  9741 raft_consensus.cc:697] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:48.716274  1435 catalog_manager.cc:5697] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:48.721237  9800 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:00:48.725243  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4943) took 1011 ms. Trace:
I20260709 13:00:48.725960  9792 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 27 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:48.725674  1686 rpcz_store.cc:276] 0709 13:00:47.713737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.833732 (+119995us) service_pool.cc:224] Handling call
0709 13:00:47.834112 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:47.834523 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:47.834556 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:47.835218 (+   662us) log.cc:844] Serialized 26 byte log entry
0709 13:00:48.090357 (+255139us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:48.090386 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.090433 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:48.724996 (+634563us) raft_consensus.cc:1685] finished
0709 13:00:48.725016 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.725162 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2183,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"thread_start_us":254757,"threads_started":1,"wal-append.queue_time_us":749865}
I20260709 13:00:48.712777  9745 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:00:48.711409  9639 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:48.716850  9951 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.033s
I20260709 13:00:48.730165 10000 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.729703  9555 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:48.766659  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:48.771446  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:48.778469  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:48.770982  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 225648us
I20260709 13:00:48.746613  9775 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:48.768808  1435 catalog_manager.cc:5697] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 21 to 25, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 25 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:48.781235  1654 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:48.782488  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:48.793988  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.795007  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:48.795588  1615 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:48.795686  1611 raft_consensus.cc:1275] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:00:48.797499  1614 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 26. Current term is 27. Ops: [26.19-26.19]
I20260709 13:00:48.798841  2266 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:48.779456  9800 raft_consensus.cc:2804] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:48.811254  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:48.807307  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:48.818920  2299 raft_consensus.cc:1275] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:00:48.813318  2301 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 18.
I20260709 13:00:48.821738  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:48.747040  9774 consensus_queue.cc:260] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:48.797928  9637 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:48.788074  9792 consensus_queue.cc:1059] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.033s
I20260709 13:00:48.788210  9555 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:48.835825  2303 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:48.814180  9775 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:00:48.817312  9810 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:48.847011  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 46784.8us
I20260709 13:00:48.833462  9912 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:48.832736  9805 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:48.838939  9774 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:48.855230  2266 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:48.839929  9874 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:48.822459 10000 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:48.844331  9738 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 27 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:48.840406  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 134301us
I20260709 13:00:48.865697 10008 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:00:48.866235 10008 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.866617 10008 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:00:48.797509  9741 consensus_queue.cc:237] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:48.842911  9775 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:48.891310  2266 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:48.891634  2303 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 24.
W20260709 13:00:48.888906  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 217588us
I20260709 13:00:48.850683  9948 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.151s
I20260709 13:00:48.893707  9775 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:00:48.894044  9805 raft_consensus.cc:2804] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:00:48.906440  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.905090  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:48.892825  9579 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 13:00:48.912501  9951 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:48.916193  9951 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:48.918516  9951 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:48.919082  9951 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:48.919556 10006 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:48.920356  9964 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.920935  9964 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:48.921640 10000 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:48.919610  9951 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:48.923260  9555 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:48.908397  9805 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.924137  9805 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:48.925398  9951 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:48.920259  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:48.928097  1687 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 23. Current term is 24. Ops: []
I20260709 13:00:48.918558 10009 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 13:00:48.930338 10006 raft_consensus.cc:697] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 21 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:48.931349 10006 consensus_queue.cc:237] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:48.935809  1615 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 24.
I20260709 13:00:48.936429  1508 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:48.937637  9951 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:48.938383  9555 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:48.938246  9951 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:48.940035  1508 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:48.941303  9555 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:48.942775  1508 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:48.943511  9555 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:48.944675  1508 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:48.945427  9555 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:48.946581  1508 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:48.947458  9555 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:48.955407  1583 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:48.957417  9801 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:00:48.961434  9718 consensus_queue.cc:1048] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:00:48.911368  9860 consensus_meta.cc:287] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.869s	user 0.013s	sys 0.002s
I20260709 13:00:48.923488  9773 raft_consensus.cc:3055] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:00:48.963059  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 75446.5us
I20260709 13:00:48.966113  2269 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:48.967716  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:48.969946  2267 consensus_peers.cc:597] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:48.970367  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 736248us
W20260709 13:00:48.972074  2267 leader_election.cc:336] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:48.972930  2267 leader_election.cc:336] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:48.978132  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:48.979235  9904 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:48.979267  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:48.980888  1691 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:00:48.981995  9808 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:48.991889  1691 raft_consensus.cc:2468] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 27.
I20260709 13:00:48.994915 10017 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.995455 10017 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:48.996574  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:48.999107  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:48.999696  1682 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 21.
I20260709 13:00:48.993927  9722 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:49.002658  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:48.969235  9859 raft_consensus.cc:2804] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:00:48.965166  9773 raft_consensus.cc:740] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:48.962324 10015 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:48.966581  9639 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:48.989631  2267 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 103 similar messages]
I20260709 13:00:49.008039  9951 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:48.974284 10000 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.015264  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:48.954993  9339 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:49.018281  1508 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:49.021754  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:49.022562  1688 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 23.
I20260709 13:00:48.993602  9948 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:49.004832 10009 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:49.002836  9804 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:49.011014 10015 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.018244  9859 raft_consensus.cc:697] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 23 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:49.066891  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:49.038771 10009 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.036707  9900 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:00:49.075439  1508 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:49.028326  9718 consensus_queue.cc:1048] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:00:49.062017  9951 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:49.062578 10015 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:49.043062 10000 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:49.100827 10009 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:49.099611 10011 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.063503  9808 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.043s
I20260709 13:00:49.123534  1583 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:49.094792  9904 consensus_queue.cc:1048] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:00:49.113368  9892 raft_consensus.cc:2804] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:00:49.130530  1583 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:49.131338  9792 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:49.132419  9792 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.132995  9792 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:49.137632  9773 consensus_queue.cc:260] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:49.139043  9773 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:49.141939  9800 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:49.142517  9800 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:49.145190 10018 log.cc:927] Time spent T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:00:49.115417  9964 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:49.071846  9948 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:49.198901  1617 raft_consensus.cc:2468] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
W20260709 13:00:49.205605  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 215859us
W20260709 13:00:49.206499  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 250717us
I20260709 13:00:49.208891  2266 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:49.114683  9951 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:49.129046  9892 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.229655  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:49.118815  9738 consensus_queue.cc:1059] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.081s
I20260709 13:00:49.230800  1615 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:00:49.235451  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 110293us
I20260709 13:00:49.202167  9555 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:49.197820  9784 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:49.121227 10011 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:49.206930  9860 raft_consensus.cc:2804] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Leader election won for term 27
W20260709 13:00:49.258363  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.236770  9892 raft_consensus.cc:3060] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:49.267398  1611 raft_consensus.cc:1240] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
W20260709 13:00:49.261960  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 131463us
I20260709 13:00:49.210831  9889 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:49.282721  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:49.283453 10023 raft_consensus.cc:493] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.284001  9860 raft_consensus.cc:697] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 27 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:49.285907 10011 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:49.286352  9339 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:49.287075 10022 log.cc:927] Time spent T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:00:49.284150  9784 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:49.145888  9859 consensus_queue.cc:237] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:49.259147  9810 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.295162  1611 raft_consensus.cc:2393] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 14: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:49.297951  9948 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:49.303165  1583 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 13:00:49.307274  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 99743.8us
I20260709 13:00:49.310189  1615 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 25.
W20260709 13:00:49.311292  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.303233  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:49.322885  9900 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.323561  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:49.325708 10040 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:49.328925  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:49.332933  1505 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:49.337373 10030 log.cc:927] Time spent T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.105s	user 0.003s	sys 0.000s
W20260709 13:00:49.341179  1581 consensus_peers.cc:597] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:49.452755  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 497760us
W20260709 13:00:49.344837 10019 log.cc:927] Time spent T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.394s	user 0.000s	sys 0.003s
I20260709 13:00:49.455657 10024 consensus_queue.cc:1048] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:00:49.346684  9954 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:49.349282 10017 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:49.355265  9996 raft_consensus.cc:3055] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:00:49.458237  9996 raft_consensus.cc:740] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:49.373327  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:49.399475  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.369879  9555 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:49.460602 10021 log.cc:927] Time spent T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.337s	user 0.002s	sys 0.002s
I20260709 13:00:49.460737  9555 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:49.462877  9555 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:49.290300 10013 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:49.463529 10013 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:49.465755 10013 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:49.467187  9722 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:49.468082 10011 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:49.286978  9800 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:49.468529 10011 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.468952 10011 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:49.469493  9792 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:49.471786  9792 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:49.473062  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 140243us
I20260709 13:00:49.473875  1505 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:49.425678  1654 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 13:00:49.449862  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 147137us
W20260709 13:00:49.477572  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 51965.1us
I20260709 13:00:49.441363  1608 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 23.
I20260709 13:00:49.441587  1614 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 23.
W20260709 13:00:49.456538  9805 consensus_meta.cc:287] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.532s	user 0.008s	sys 0.002s
I20260709 13:00:49.489111  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:49.493861  1505 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:49.291287 10008 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:49.495563  1687 raft_consensus.cc:1240] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:00:49.496198  1505 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
W20260709 13:00:49.474992  1581 consensus_peers.cc:597] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:49.500871  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:49.501480  1685 raft_consensus.cc:2468] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 24.
I20260709 13:00:49.501979  1505 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:49.502209  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 13:00:49.497121  1581 consensus_peers.cc:597] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:49.505738  1581 consensus_peers.cc:597] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:49.434536  9964 consensus_queue.cc:1059] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.049s
I20260709 13:00:49.393617 10023 raft_consensus.cc:515] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:49.500238  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:49.483026  9722 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:00:49.515791  1617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 3897) took 1314 ms. Trace:
I20260709 13:00:49.518261  9860 consensus_queue.cc:237] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:49.521685  9800 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:49.529688  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 327784us
I20260709 13:00:49.523926  1690 raft_consensus.cc:2410] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 24 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 13:00:49.491938  9904 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:49.524549  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:49.533015  1689 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 23.
W20260709 13:00:49.506325  1581 consensus_peers.cc:597] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:49.450538  9810 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:49.525650  1617 rpcz_store.cc:276] 0709 13:00:48.201582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.201739 (+   157us) service_pool.cc:224] Handling call
0709 13:00:49.515585 (+1313846us) spinlock_profiling.cc:243] Waited 764 ms on lock 0x7b54002a58d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:49.515704 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1757160704}
I20260709 13:00:49.474448  9900 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:49.500150  9874 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.500703 10013 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:49.500355  9744 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:49.509274  9808 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:00:49.546716  1581 leader_election.cc:336] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:49.484249  9805 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:49.480182 10040 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:49.561514  1581 leader_election.cc:336] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:49.560226  9872 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.018s	sys 0.018s
W20260709 13:00:49.576758  1655 leader_election.cc:336] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:49.543730  9951 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:49.547766  9889 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:49.554862  9808 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.555687  9722 raft_consensus.cc:697] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 24 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:49.549392 10000 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:49.589228  9784 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 13:00:49.573985  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.589650 10014 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:49.548780  9555 consensus_queue.cc:1059] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
W20260709 13:00:49.591711  9774 consensus_meta.cc:287] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.704s	user 0.006s	sys 0.006s
W20260709 13:00:49.592729  9775 consensus_meta.cc:287] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.636s	user 0.010s	sys 0.002s
I20260709 13:00:49.610114  9775 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:49.588239 10047 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.588315 10008 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 27 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:49.576103  9872 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.018s	sys 0.018s
I20260709 13:00:49.600553  9900 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:49.558772  9874 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:49.614353  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:49.615638  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:49.616261  1616 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 18.
I20260709 13:00:49.618085 10012 raft_consensus.cc:1064] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 13:00:49.620224  9722 consensus_queue.cc:237] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:49.560541  9744 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:49.612213  9775 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 29 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:49.578382  1655 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:49.622031  2267 leader_election.cc:336] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:49.605654  9808 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:00:49.680717  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 58691.2us
I20260709 13:00:49.586550  9904 raft_consensus.cc:3060] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:00:49.626117 10028 log.cc:927] Time spent T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.385s	user 0.003s	sys 0.002s
I20260709 13:00:49.716948  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:49.623682  9910 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:49.717794  1691 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 29.
I20260709 13:00:49.680090 10008 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:49.722285  1656 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:49.704200  9744 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:49.725970  1683 raft_consensus.cc:1240] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:49.620437 10012 consensus_queue.cc:237] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 17, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:49.731823  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 155013us
I20260709 13:00:49.724220  9810 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:49.696422  9718 consensus_queue.cc:1059] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
W20260709 13:00:49.733033  1655 leader_election.cc:336] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:49.622228 10047 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:49.733487  1655 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:49.734686  9892 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:49.627496  9784 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:49.701297 10014 raft_consensus.cc:3055] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:00:49.736449 10014 raft_consensus.cc:740] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 13:00:49.737560  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 235528us
I20260709 13:00:49.740199  1690 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 23. Current term is 24. Ops: []
I20260709 13:00:49.737758  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 13:00:49.740967  1581 leader_election.cc:336] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:49.742000  1581 leader_election.cc:336] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:49.738343  1505 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:49.742617  1581 leader_election.cc:336] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:49.770830  1582 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:49.718391  9555 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:49.760365  1581 leader_election.cc:336] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:49.786172  1582 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:49.788182  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:49.786549  1581 leader_election.cc:336] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:49.772086  9773 consensus_meta.cc:287] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.633s	user 0.008s	sys 0.003s
I20260709 13:00:49.803097  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:49.804328  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:49.811573  1505 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:49.813663  1505 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:49.727788 10024 consensus_queue.cc:1048] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.073s
I20260709 13:00:49.770963 10023 leader_election.cc:290] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:49.830709  1505 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:49.796030  9744 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:49.832515  1615 raft_consensus.cc:1240] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:00:49.739610 10008 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:49.842161  1611 raft_consensus.cc:1240] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 24. Current term is 25. Ops: [24.15-24.15]
I20260709 13:00:49.796717  9792 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:49.840325  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:49.770536 10000 consensus_queue.cc:1059] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 13:00:49.824389  9775 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:00:49.797099  9810 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:00:49.793840 10038 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.046s
I20260709 13:00:49.836934 10024 consensus_queue.cc:1243] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer 1d6516ff61104bdda54bde95e92fe579 log is divergent from this leader: its last log entry 20.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:00:49.839501  9951 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:00:49.857698 10057 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.864848  9874 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:49.866044 10047 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:49.799757  9555 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:49.836808  9900 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:49.841092  9774 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:00:49.885952  2267 leader_election.cc:336] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:49.837539  9744 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.838548  9964 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:00:49.846793  9792 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:49.849269  9892 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:49.850347 10040 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:49.857908 10005 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:00:49.887647  9775 raft_consensus.cc:697] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
W20260709 13:00:49.986189  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.800405  9996 consensus_queue.cc:260] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:49.915392  9774 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.014266  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:50.005398  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 283049us
W20260709 13:00:49.976398  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 60111.5us
I20260709 13:00:49.915444  9900 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:50.004581  9859 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.007s	sys 0.011s
I20260709 13:00:49.974472  9744 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:49.972916  9810 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.058320  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:50.000676  9956 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:49.824743 10014 consensus_queue.cc:260] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:50.052371  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.976002  9805 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:49.974058  9339 raft_consensus.cc:3055] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:00:50.054909  2302 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 27 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 26. Current term is 27. Ops: [26.19-26.19]
I20260709 13:00:50.001332  9792 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:50.008448  9964 raft_consensus.cc:697] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 24 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:50.063305  2297 raft_consensus.cc:1275] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:00:50.052860  9859 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.007s	sys 0.011s
W20260709 13:00:50.069041  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 335849us
W20260709 13:00:50.069953  1655 leader_election.cc:336] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:50.061261  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:50.049847  9774 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:50.066547  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:50.063922  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:50.053611  9900 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:50.012923  9892 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:50.078469  1655 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:49.914963 10057 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:50.068959  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:50.061635 10023 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.112030  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:50.115161  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.115937  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.116591  2303 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 24.
W20260709 13:00:50.142884  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 72920.1us
I20260709 13:00:50.145117  2294 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:00:50.077119 10005 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 13:00:50.146297  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 409916us
W20260709 13:00:50.173262  1508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.015s	sys 0.014s
I20260709 13:00:50.174566  1654 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 13:00:50.176013  1508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.016s	sys 0.014s
I20260709 13:00:50.066807  9996 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:50.066428  9339 raft_consensus.cc:740] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 13:00:50.176405  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 642742us
I20260709 13:00:50.181994  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:50.184775  2294 raft_consensus.cc:2393] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 14: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:50.067582  9956 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:50.111338  9997 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:50.118925 10007 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.170145 10055 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.065869  9810 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:50.225016  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:50.199045  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:50.209409  1583 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.227499  2297 raft_consensus.cc:2410] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:00:50.193627  1685 raft_consensus.cc:1275] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:00:50.192708  1690 raft_consensus.cc:1240] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:00:50.228945  1617 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 18. (term mismatch)
I20260709 13:00:50.109200 10020 consensus_queue.cc:1048] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.075s
I20260709 13:00:50.230150  1617 pending_rounds.cc:85] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f: Aborting all ops after (but not including) 17
I20260709 13:00:50.233831  1617 pending_rounds.cc:107] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 22.18
I20260709 13:00:50.234117  1617 raft_consensus.cc:2889] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:50.234637  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:50.224413  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:50.185107 10044 log.cc:927] Time spent T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.385s	user 0.001s	sys 0.000s
I20260709 13:00:50.232501  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:50.236128  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:50.121280 10023 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:50.110875  9892 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:50.267793  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:50.249162  1614 raft_consensus.cc:2393] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 24: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:50.268850  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:50.188992 10000 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.320147  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:50.320753  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:50.322430  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:50.355094  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:50.355370  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:50.355837  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:50.357280  1683 raft_consensus.cc:2410] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 24 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:00:50.248132  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:50.237840 10020 consensus_queue.cc:1243] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer 1d6516ff61104bdda54bde95e92fe579 log is divergent from this leader: its last log entry 19.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:00:50.361928  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
W20260709 13:00:50.374559  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.362265  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 91522.5us
I20260709 13:00:50.378099  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4681eaad3084357b9677e4242b97c99" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:50.378393 10056 log.cc:927] Time spent T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260709 13:00:50.186579 10005 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:50.379197  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:50.269042 10017 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:50.235858 10008 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:50.354631 10059 log.cc:927] Time spent T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.365s	user 0.001s	sys 0.000s
I20260709 13:00:50.397569  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:50.390514  2297 raft_consensus.cc:2393] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 27: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:50.396972  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:50.183244  9775 consensus_queue.cc:237] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:50.433879  1609 raft_consensus.cc:2393] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 29: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:50.434787  1508 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:50.372690 10024 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 13:00:50.429121 10044 log.cc:927] Time spent T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:00:50.226090  9964 consensus_queue.cc:237] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:50.451584  1617 raft_consensus.cc:1240] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 26. Current term is 27. Ops: [26.19-26.19]
I20260709 13:00:50.453217  2300 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 23. Current term is 24. Ops: []
I20260709 13:00:50.233078  9997 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:50.234483 10007 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:50.477842  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 82514.1us
I20260709 13:00:50.355520 10000 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:50.236531 10055 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:50.444367  9555 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:50.516019  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 82484.6us
I20260709 13:00:50.516878  1508 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:50.477447 10074 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.531584  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:50.433068  9339 consensus_queue.cc:260] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.19, Last appended by leader: 19, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:50.520197 10051 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.403s	user 0.001s	sys 0.000s
I20260709 13:00:50.511768 10060 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.552035  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:50.459342 10024 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:50.574018  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 48843.4us
I20260709 13:00:50.549697  9555 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.598467  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:50.599696  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.598495  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1289) took 1589 ms. Trace:
I20260709 13:00:50.597790  1583 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:50.561579 10038 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.555812  9722 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 13:00:50.613262  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 96425.5us
I20260709 13:00:50.584259 10057 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:50.600162  1682 rpcz_store.cc:276] 0709 13:00:49.008746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.009246 (+   500us) service_pool.cc:224] Handling call
0709 13:00:49.034925 (+ 25679us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:49.035356 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:00:49.110540 (+ 75184us) log.cc:844] Serialized 14 byte log entry
0709 13:00:49.561995 (+451455us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:49.584913 (+ 22918us) log.cc:844] Serialized 26 byte log entry
0709 13:00:49.585075 (+   162us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:00:49.585111 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:49.585182 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:50.598256 (+1013074us) raft_consensus.cc:1685] finished
0709 13:00:50.598276 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:50.598430 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28357,"prepare.queue_time_us":64751,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":35778,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":3643,"spinlock_wait_cycles":5543168,"thread_start_us":438412,"threads_started":2,"wal-append.queue_time_us":591893}
I20260709 13:00:50.583796 10072 raft_consensus.cc:2804] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:50.596335  9339 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:00:50.591773 10005 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:50.642062  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 133161us
I20260709 13:00:50.613806  9956 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:50.638800  9808 consensus_meta.cc:287] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.937s	user 0.002s	sys 0.009s
I20260709 13:00:50.651340  9808 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:50.655982 10089 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.656704 10094 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:00:50.657277 10085 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:00:50.656653 10089 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:50.657676 10094 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:00:50.658891 10085 consensus_queue.cc:1059] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:50.659721 10094 raft_consensus.cc:3055] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:50.657392 10093 consensus_queue.cc:1059] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 13:00:50.550942 10074 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:50.633329 10023 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:50.645848  9904 consensus_meta.cc:287] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.931s	user 0.006s	sys 0.006s
I20260709 13:00:50.640556 10053 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.609898  9555 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:50.583293 10060 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:50.659806 10089 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:50.670650 10058 log.cc:927] Time spent T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.429s	user 0.000s	sys 0.001s
I20260709 13:00:50.648341 10057 raft_consensus.cc:2804] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:00:50.686457 10057 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:50.686983 10057 raft_consensus.cc:3060] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:50.688854  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 4135) took 1198 ms. Trace:
I20260709 13:00:50.641557 10072 raft_consensus.cc:697] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
W20260709 13:00:50.671357 10086 log.cc:927] Time spent T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:00:50.624601  9722 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:50.660235 10094 raft_consensus.cc:740] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:50.678107  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:50.624014 10038 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:50.681870 10066 log.cc:927] Time spent T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
W20260709 13:00:50.682369 10082 log.cc:927] Time spent T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:00:50.682703 10079 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:00:50.682957  9810 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:50.672640  9892 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:50.747155 10009 consensus_meta.cc:287] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 1.624s	user 0.011s	sys 0.001s
W20260709 13:00:50.689184 10065 log.cc:927] Time spent T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.429s	user 0.000s	sys 0.001s
I20260709 13:00:50.748134  2301 raft_consensus.cc:2393] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 14: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
W20260709 13:00:50.683130 10064 log.cc:927] Time spent T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.381s	user 0.000s	sys 0.001s
W20260709 13:00:50.749780  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 97157.4us
W20260709 13:00:50.753274  1655 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.004s	sys 0.008s
W20260709 13:00:50.756058  1506 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.007s	sys 0.006s
I20260709 13:00:50.674304  9904 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:00:50.689402  1687 rpcz_store.cc:276] 0709 13:00:49.489925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.508339 (+ 18414us) service_pool.cc:224] Handling call
0709 13:00:49.508739 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:49.514030 (+  5291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:49.514062 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:49.514583 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 13:00:49.770162 (+255579us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:49.804980 (+ 34818us) log.cc:844] Serialized 14 byte log entry
0709 13:00:50.193059 (+388079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.193132 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:50.688573 (+495441us) raft_consensus.cc:1685] finished
0709 13:00:50.688603 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:50.688777 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1219,"prepare.queue_time_us":31072,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":66,"raft.queue_time_us":252944,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":5178,"thread_start_us":617450,"threads_started":2,"wal-append.queue_time_us":540805}
I20260709 13:00:50.689787 10000 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:50.757879  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:50.787983  2297 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 24.
W20260709 13:00:50.784580  1655 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.004s	sys 0.008s
W20260709 13:00:50.784909  1506 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.008s	sys 0.006s
W20260709 13:00:50.789350  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.787017  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 161747us
I20260709 13:00:50.755558 10079 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.792852 10079 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Advancing to term 30
W20260709 13:00:50.796648 10062 log.cc:927] Time spent T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 13:00:50.796940 10073 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:50.797349  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:50.797849 10038 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:50.797562 10073 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:50.680115 10053 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:50.796679 10017 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:50.799340 10017 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:50.788801  9997 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:50.690742 10072 consensus_queue.cc:237] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:50.789139 10055 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:50.813400  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:50.808172 10051 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260709 13:00:50.816129 10084 log.cc:927] Time spent T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 13:00:50.816586 10094 consensus_queue.cc:260] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:50.821483  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.815248 10092 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:50.861951  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.825179  9744 consensus_meta.cc:287] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.756s	user 0.006s	sys 0.005s
W20260709 13:00:50.825441 10011 consensus_meta.cc:287] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 1.356s	user 0.009s	sys 0.004s
I20260709 13:00:50.805353  9892 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.803663 10007 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:50.871135 10094 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:50.874495  1685 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 29.
I20260709 13:00:50.783836 10009 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:50.885406  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:50.884543 10011 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:50.899971 10011 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:50.901036  1616 raft_consensus.cc:2393] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 24: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:50.902586  9555 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:50.903743 10017 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:50.907956  2301 raft_consensus.cc:2393] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 24: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:50.921371  9784 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:50.921741 10073 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:50.909555 10007 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:50.923085 10053 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:50.923311 10007 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:50.924741  9722 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:50.906973 10106 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 31 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:50.896513 10074 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:50.927981  9900 consensus_meta.cc:287] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.817s	user 0.009s	sys 0.000s
I20260709 13:00:50.881256  9744 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:50.929719  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4978) took 1210 ms. Trace:
I20260709 13:00:50.887878  9892 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:50.931838  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:50.934063  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:50.889478  9808 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:50.933071  1508 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:50.940409  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:50.988394  1683 raft_consensus.cc:2468] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 9.
I20260709 13:00:50.940678  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:50.992515  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:50.992131  1685 raft_consensus.cc:2410] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 25 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260709 13:00:50.993368  1683 raft_consensus.cc:2410] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 23 because replica has last-logged OpId of term: 22 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 18.
I20260709 13:00:50.946913 10052 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.950310  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:50.950840  2300 raft_consensus.cc:1275] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:00:50.995065  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 62043.4us
I20260709 13:00:50.951522  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:50.951924  2298 raft_consensus.cc:1240] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:50.952648  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:50.996598  1507 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:50.953733  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:50.953953  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 4033) took 1809 ms. Trace:
I20260709 13:00:50.952672  2299 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:00:50.956619 10007 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:50.959833  9774 consensus_meta.cc:287] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.844s	user 0.008s	sys 0.003s
I20260709 13:00:50.961668 10060 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:50.965647 10009 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:50.883536 10092 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:50.966851  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:50.968268  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:50.971127  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:50.972965 10057 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:50.932413 10024 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:50.939373  9996 consensus_meta.cc:287] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.751s	user 0.012s	sys 0.000s
W20260709 13:00:50.931715  9792 consensus_meta.cc:287] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.847s	user 0.007s	sys 0.000s
I20260709 13:00:50.985412  1686 rpcz_store.cc:276] 0709 13:00:49.719621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.719738 (+   117us) service_pool.cc:224] Handling call
0709 13:00:49.745661 (+ 25923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:50.051666 (+306005us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:50.051704 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:50.051754 (+    50us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:00:50.051802 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.929419 (+877617us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b5400159354. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:50.929473 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:50.929634 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":702750464}
I20260709 13:00:50.986413 10081 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:50.987694  1687 raft_consensus.cc:2468] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 22.
I20260709 13:00:50.995038  9784 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:50.952986  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:50.996129  1508 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:50.985669 10015 consensus_meta.cc:287] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 1.872s	user 0.009s	sys 0.004s
W20260709 13:00:50.993418  2266 connection.cc:256] RPC call timeout handler was delayed by -1.0146682219999548s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
I20260709 13:00:51.001322  1608 raft_consensus.cc:1240] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 18. Current term is 19. Ops: [16.13-18.14]
I20260709 13:00:50.981878 10053 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:51.047227 10053 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.048554  9784 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.049422 10053 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:50.999913 10052 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:50.997273  1613 rpcz_store.cc:276] 0709 13:00:49.144277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.144459 (+   182us) service_pool.cc:224] Handling call
0709 13:00:49.144949 (+   490us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:49.533725 (+388776us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:49.533906 (+   181us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:49.542647 (+  8741us) log.cc:844] Serialized 52 byte log entry
0709 13:00:49.824268 (+281621us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:49.851877 (+ 27609us) log.cc:844] Serialized 14 byte log entry
0709 13:00:50.182806 (+330929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:50.182883 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:50.953697 (+770814us) raft_consensus.cc:1685] finished
0709 13:00:50.953717 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:50.953872 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9551,"prepare.queue_time_us":27370,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":147893,"raft.run_cpu_time_us":8935,"raft.run_wall_time_us":67468,"thread_start_us":937710,"threads_started":3,"wal-append.queue_time_us":487544}
I20260709 13:00:51.002789  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:51.003752  1688 raft_consensus.cc:2468] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 24.
I20260709 13:00:51.000550  9555 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:50.997922  9805 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:51.054817  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 147907us
I20260709 13:00:50.999708  9808 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:00:51.030869  2266 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:51.023929  9792 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.032922 10069 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:51.035305 10015 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.037180  9892 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:51.038482  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:50.987057  9900 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:51.040987  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:51.068890  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.002322  9774 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.042663  9744 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:50.984980 10106 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.046205 10081 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:50.994078  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:51.059468  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 262857us
I20260709 13:00:51.076027  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:51.077718  1655 leader_election.cc:336] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:51.075233  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:51.079176  1611 raft_consensus.cc:2393] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 27: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:51.060346  1582 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:51.058257  2266 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:51.071949  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:51.080991  1617 raft_consensus.cc:2410] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for term 22 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 13:00:51.080435  1582 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:51.074509  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:51.055142  9775 raft_consensus.cc:2804] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:51.083750  1612 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 24.
I20260709 13:00:51.084980  1582 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:51.075194  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:51.085876  1688 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:51.059592  9773 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 13:00:51.082820  1655 leader_election.cc:336] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:51.089133  1655 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:51.079217  1505 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:51.087157  1582 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:51.087400  2301 raft_consensus.cc:2393] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 24: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:51.028652 10079 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:51.080405  2266 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:51.091593  1615 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 31.
I20260709 13:00:51.067880  9808 raft_consensus.cc:697] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:51.100719  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:51.084380 10009 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:51.093578  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ac6d2e7442458585e7eca31089d547" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:51.097376  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:51.072269 10024 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:51.102026  1505 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:51.096100  9744 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:00:51.105381 10042 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:51.086086 10007 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:51.061764  9805 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.088714  9637 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:51.083824  9775 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:51.086181  9555 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:51.107697  1507 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:51.108467  1687 raft_consensus.cc:2410] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for term 27 because replica has last-logged OpId of term: 26 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 18.
I20260709 13:00:51.108624  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:51.090917 10078 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:00:51.114873  1655 leader_election.cc:336] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:51.097590  9964 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:51.118345  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49312 (request call id 3909) took 1330 ms. Trace:
I20260709 13:00:51.115821  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:51.141950  1611 raft_consensus.cc:2393] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 23: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:51.073546 10069 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.121088  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:51.147315  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:51.121785  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:51.147789  1507 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:51.148099  2295 raft_consensus.cc:2393] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 14: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:51.093413  1582 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:51.129271  1613 raft_consensus.cc:2393] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 14: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:51.109656  9892 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:51.100428 10055 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:00:51.149093 10055 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.140525  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:51.140331  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:51.149994  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:51.150549  1684 raft_consensus.cc:2410] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for term 25 because replica has last-logged OpId of term: 24 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 17.
I20260709 13:00:51.100977  9804 consensus_queue.cc:1059] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:00:51.140120  2302 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 21.
I20260709 13:00:51.122731  1505 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:51.150398  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:51.114202 10053 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:51.094099  9773 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.104007 10040 consensus_queue.cc:1059] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:00:51.141556  1616 rpcz_store.cc:276] 0709 13:00:49.787756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.787896 (+   140us) service_pool.cc:224] Handling call
0709 13:00:51.118108 (+1330212us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540032b754. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:51.118272 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2555722496}
W20260709 13:00:51.149542  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 56211.8us
W20260709 13:00:51.159354  1581 consensus_peers.cc:597] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:51.149855  2299 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 23.
W20260709 13:00:51.169544  1581 leader_election.cc:336] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:51.128969  9912 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:51.153010 10095 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:00:51.162011 10079 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 30 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:51.130416  9775 raft_consensus.cc:3060] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:51.197428  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:51.156744 10118 log.cc:927] Time spent T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:00:51.158951  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:51.165570  1655 leader_election.cc:336] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:51.166775  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 44156.4us
I20260709 13:00:51.149420  9637 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:00:51.208086  1611 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 23.
I20260709 13:00:51.142606 10104 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:51.113358 10024 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.174878  1582 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 13:00:51.171623  1581 leader_election.cc:336] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:51.172749  9892 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:00:51.209273 10115 log.cc:927] Time spent T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:00:51.196442 10081 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:51.187795  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3912) took 1397 ms. Trace:
I20260709 13:00:51.199096  9773 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:51.177167  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:51.177503  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:51.198107  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:51.164561  1507 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:51.208506  1505 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:51.171736  1688 raft_consensus.cc:2468] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 12.
I20260709 13:00:51.149484 10055 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:00:51.183429 10054 log.cc:927] Time spent T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 1.207s	user 0.001s	sys 0.007s
I20260709 13:00:51.231803  2298 raft_consensus.cc:2368] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 23. Current term is 24.
I20260709 13:00:51.232084  9637 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:51.232555  9637 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.232887  9637 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:51.230145  2294 pending_rounds.cc:85] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579: Aborting all ops after (but not including) 13
I20260709 13:00:51.229629  9722 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.234114  9722 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:51.236613  9722 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:51.233067  2298 pending_rounds.cc:85] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579: Aborting all ops after (but not including) 15
I20260709 13:00:51.233477  2294 pending_rounds.cc:107] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 13:00:51.178987  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:51.237885  2298 pending_rounds.cc:107] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260709 13:00:51.217119  1581 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:51.216662  1655 leader_election.cc:336] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:51.238382  2294 raft_consensus.cc:2889] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:51.233507  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:51.196905 10057 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:51.205633  9792 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:51.141350  9555 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.156994 10108 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.058s
W20260709 13:00:51.225337  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 50505.8us
I20260709 13:00:51.153195 10060 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:00:51.224664  1608 rpcz_store.cc:276] 0709 13:00:49.790467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.790582 (+   115us) service_pool.cc:224] Handling call
0709 13:00:49.802798 (+ 12216us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:51.032164 (+1229366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:51.187474 (+155310us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400444b54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:51.187721 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2741744896}
I20260709 13:00:51.256259  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:51.257045  1684 raft_consensus.cc:3060] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:51.228648 10076 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:51.229092  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 64597.8us
I20260709 13:00:51.260246  1616 raft_consensus.cc:1275] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:00:51.203847  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:51.216351  9800 raft_consensus.cc:3055] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:00:51.191136  9804 raft_consensus.cc:3055] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:51.267274  9804 raft_consensus.cc:740] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:51.268754  9804 consensus_queue.cc:260] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.270205  9804 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:00:51.239827  1655 leader_election.cc:336] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:51.296072  9948 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:51.190757  9859 raft_consensus.cc:3055] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:51.154840  1656 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:51.297314  9948 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:51.240849  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:51.237524  9996 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.298441  9722 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:00:51.298529  9996 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:51.238286  2298 raft_consensus.cc:2889] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:51.299121  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 13:00:51.297145  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 57400us
W20260709 13:00:51.298177  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 143330us
I20260709 13:00:51.300856  9996 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:51.242760  9801 raft_consensus.cc:2955] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [term 29 LEADER]: Committing config change with OpId 26.19: config changed from index 16 to 19, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:51.244859 10000 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:51.300004  1688 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:00:51.171715 10053 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:51.300897  1656 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:51.304783  1655 leader_election.cc:336] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:51.257079  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:51.255837  9900 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:51.190624  9808 consensus_queue.cc:237] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:51.305150 10070 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:00:51.306135  1655 leader_election.cc:336] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:51.306618  1655 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:51.297392 10116 log.cc:927] Time spent T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:00:51.224040 10090 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:51.238716 10081 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:51.308558 10090 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.271435 10106 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:51.278318  9860 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.310134  9860 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.311293 10090 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:51.312042  1691 raft_consensus.cc:2468] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 17.
I20260709 13:00:51.312623  9860 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:51.313446 10069 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:51.313905  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:51.315079  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:51.277999  9637 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.278877  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:51.316941  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:51.317523 10117 log.cc:927] Time spent T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6: Append to log took a long time: real 0.164s	user 0.002s	sys 0.000s
I20260709 13:00:51.263250  9774 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:51.307902  1655 leader_election.cc:336] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:51.320252  1655 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:51.280750 10015 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:51.245752 10104 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:51.249652 10078 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
W20260709 13:00:51.238971  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 67328.8us
I20260709 13:00:51.288358  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:51.331979  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
W20260709 13:00:51.333186  1581 leader_election.cc:336] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:51.334228  1581 leader_election.cc:336] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:51.291390  9805 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:51.263887  9800 raft_consensus.cc:740] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:51.298995  9859 raft_consensus.cc:740] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:51.156951 10088 consensus_queue.cc:1059] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:00:51.240670  1505 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:51.250463  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:51.157338  9951 consensus_queue.cc:1048] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:00:51.304997  9948 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:51.279381  1617 raft_consensus.cc:3055] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:51.356948  1617 raft_consensus.cc:740] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:51.358985  2294 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 13:00:51.360162  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.327133  1684 raft_consensus.cc:2468] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 24.
I20260709 13:00:51.330034  2269 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:51.287909 10076 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.335405  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:51.304684 10073 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:00:51.334646  1581 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:51.304301 10053 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:51.342087  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:51.299410  9555 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:51.342929  1583 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:51.327926 10090 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:00:51.354588  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:51.355865  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 115267us
W20260709 13:00:51.323920  1655 leader_election.cc:336] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:51.335351  9774 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:51.380702  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 50730.4us
I20260709 13:00:51.380884 10099 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:51.384081  9805 raft_consensus.cc:2804] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:00:51.377324 10121 log.cc:927] Time spent T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:00:51.371623  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:51.403789 10055 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:51.387315  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 44455.1us
I20260709 13:00:51.387430  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:51.411535  2294 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:51.411760  1582 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:51.388876  1505 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:51.388342  1616 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 23.
W20260709 13:00:51.388978  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 65073.6us
I20260709 13:00:51.389730  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:51.392076  2266 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:51.393860  1688 raft_consensus.cc:2468] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 30.
I20260709 13:00:51.353814  9637 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:51.365644 10073 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:51.399307  9859 consensus_queue.cc:260] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.399302  9805 raft_consensus.cc:697] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 12 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
W20260709 13:00:51.403431 10122 log.cc:927] Time spent T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:00:51.365281 10060 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:51.362047 10108 raft_consensus.cc:3055] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:51.407496  1684 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:00:51.385914  1608 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:51.408883  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:51.435030 10053 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:51.435854  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:51.437310  1687 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 29.
I20260709 13:00:51.340889 10078 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:51.413549  1655 leader_election.cc:336] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:51.414836  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:51.442093  1655 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:51.388374 10106 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:00:51.423385  2266 leader_election.cc:304] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:51.423391  1583 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:51.427259  1505 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:51.430203 10015 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:51.442256  1688 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:51.393265  9948 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:51.436615 10076 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:51.448203  1684 raft_consensus.cc:2468] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 24.
I20260709 13:00:51.448704  2266 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:51.423063  9555 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:51.424767 10073 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:00:51.453747  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.396567  9774 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.471482  9774 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:51.459457 10012 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:51.441996  9859 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:51.465715  2266 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:51.455420 10040 raft_consensus.cc:2749] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:51.462859  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:51.463238  2269 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:51.433936 10108 raft_consensus.cc:740] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:51.482391  1688 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 24.
I20260709 13:00:51.425854 10090 consensus_queue.cc:1059] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:00:51.461779 10104 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:51.457726  1583 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:51.478418  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:51.481288  1684 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 25.
I20260709 13:00:51.483772  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:51.486625  1583 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:51.461722  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:51.464186  9948 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:51.505995 10000 raft_consensus.cc:2804] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:00:51.507863  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 44701us
I20260709 13:00:51.511650 10106 raft_consensus.cc:2804] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 30 FOLLOWER]: Leader election won for term 30
I20260709 13:00:51.473745  9951 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:51.509727  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 96163.8us
I20260709 13:00:51.509727  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 13:00:51.546221  1655 leader_election.cc:336] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:51.546864  1655 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:51.547317  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:51.463913 10079 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:00:51.420065  9800 consensus_queue.cc:260] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.515329 10040 raft_consensus.cc:2804] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:00:51.520959  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:51.522432 10092 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:51.524840  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:51.525763  1612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58006 (request call id 1246) took 1725 ms (client timeout 1942 ms). Trace:
I20260709 13:00:51.433924  9805 consensus_queue.cc:237] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.480573 10069 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:00:51.533139  2294 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 25.
I20260709 13:00:51.489704  1688 raft_consensus.cc:2393] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 19: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:51.466728 10088 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.535916  2269 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:51.569422  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:51.571041  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 13:00:51.572023  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 97075.3us
I20260709 13:00:51.571727  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:51.569830  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:51.574664  1610 raft_consensus.cc:2468] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 29.
I20260709 13:00:51.575593  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:51.575671  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:51.576288  1610 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 20.
I20260709 13:00:51.576494  2294 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 25.
I20260709 13:00:51.533713 10070 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:00:51.603139  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:51.536878  9808 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.569054  1687 raft_consensus.cc:2393] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 24: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
W20260709 13:00:51.551816  1612 rpcz_store.cc:269] 0709 13:00:49.800591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.824222 (+ 23631us) service_pool.cc:224] Handling call
0709 13:00:51.525601 (+1701379us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b540032a854. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:51.525701 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2849133440}
I20260709 13:00:51.578174  1610 raft_consensus.cc:1275] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:00:51.569335 10076 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.579808 10136 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:00:51.580770 10123 log.cc:927] Time spent T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:00:51.581749  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:51.624562  1682 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 25.
W20260709 13:00:51.582620  1655 leader_election.cc:336] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:51.583678 10134 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:51.585969  9722 raft_consensus.cc:3055] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:00:51.568766 10106 raft_consensus.cc:697] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 30 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:51.590368 10052 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:51.482405 10108 consensus_queue.cc:260] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.629693  1610 raft_consensus.cc:2955] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Committing config change with OpId 26.19: config changed from index 16 to 19, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 13:00:51.601789  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.580003  2294 raft_consensus.cc:1240] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 18. Current term is 19. Ops: [16.13-18.14]
I20260709 13:00:51.618959  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:51.614328  2295 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [term 22 LEARNER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 22 index: 19. (index mismatch)
I20260709 13:00:51.573544 10040 raft_consensus.cc:697] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 24 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:51.610808 10081 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:51.626789  1655 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:51.578313 10000 raft_consensus.cc:697] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 24 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:51.608834  9800 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:00:51.633671  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 54003.5us
I20260709 13:00:51.634884  1615 raft_consensus.cc:1240] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 21. Current term is 22. Ops: []
I20260709 13:00:51.597704  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:51.644493  1686 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 22 index: 19. (index mismatch)
I20260709 13:00:51.620273 10136 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.648396  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:51.598798 10088 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:51.653148  2267 leader_election.cc:336] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:51.654294  1682 raft_consensus.cc:1275] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 13:00:51.655050  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:51.654716  1684 raft_consensus.cc:1275] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 13:00:51.655519  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 72892us
I20260709 13:00:51.659219  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:51.636632  9722 raft_consensus.cc:740] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:51.664263  2296 raft_consensus.cc:2393] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 19: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:51.663348  2294 raft_consensus.cc:2368] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 24. Current term is 25.
W20260709 13:00:51.667153  2267 leader_election.cc:336] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:51.626554 10076 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:51.626351  9808 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:51.681761  1686 raft_consensus.cc:1240] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 18. Current term is 19. Ops: []
I20260709 13:00:51.659701 10090 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:51.666358 10055 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:51.667924 10108 raft_consensus.cc:3060] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:51.660789 10136 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:51.722101  9808 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:51.691241  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50708 (request call id 4987) took 1483 ms. Trace:
I20260709 13:00:51.668601  1684 raft_consensus.cc:2955] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 29 FOLLOWER]: Committing config change with OpId 26.19: config changed from index 16 to 19, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:51.693898  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:51.723481  2297 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 24.
I20260709 13:00:51.693086  2266 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:51.682991 10124 log.cc:927] Time spent T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:00:51.679927 10078 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:51.695387  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:51.696635  1682 raft_consensus.cc:1240] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:51.697664  1617 consensus_queue.cc:260] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.727337  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:51.702632 10000 consensus_queue.cc:237] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:51.727798 10014 raft_consensus.cc:3060] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:51.728229  1682 raft_consensus.cc:2410] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 for term 27 because replica has last-logged OpId of term: 26 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 13:00:51.664583  9775 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.729135 10069 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260709 13:00:51.729526 10069 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 31 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:51.729885 10069 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 31 FOLLOWER]: Advancing to term 32
I20260709 13:00:51.730085  9775 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:51.707044 10135 log.cc:927] Time spent T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:00:51.732060  2299 raft_consensus.cc:1240] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 19. Current term is 20. Ops: [19.12-19.12]
W20260709 13:00:51.712209 10127 log.cc:927] Time spent T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:00:51.716781 10040 consensus_queue.cc:237] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.727558  1617 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:51.727798  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:51.723047  1689 rpcz_store.cc:276] 0709 13:00:50.207843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.379557 (+171714us) service_pool.cc:224] Handling call
0709 13:00:50.429743 (+ 50186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:50.605694 (+175951us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:50.605735 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:50.605784 (+    49us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:50.605825 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:51.691043 (+1085218us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b5400393854. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d051e01 00007fc85d05083e 00007fc862015419 00007fc85b58cbd4 00007fc85b58cb62 00007fc85b58ca91 00007fc85b58ca0c 00007fc85b58bcc2 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:51.691082 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:51.691186 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":403693824}
I20260709 13:00:51.704828 10088 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:51.740036  1608 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 24.
I20260709 13:00:51.745040  1615 raft_consensus.cc:2393] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 22: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:51.750191  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:51.751986  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:51.753485  1614 raft_consensus.cc:1240] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:00:51.751503  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:51.756461  1617 raft_consensus.cc:1275] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:00:51.757074  1617 pending_rounds.cc:85] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f: Aborting all ops after (but not including) 11
I20260709 13:00:51.757385  1617 pending_rounds.cc:107] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:00:51.757684  1617 raft_consensus.cc:2889] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:51.759194  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:51.758153  1581 consensus_peers.cc:597] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:51.745297 10125 log.cc:927] Time spent T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:00:51.727247 10076 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:51.780938  1581 consensus_peers.cc:597] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:51.781697  1581 leader_election.cc:336] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:51.771452  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:51.782073  1581 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:51.768137  1507 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:51.789605  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 25 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:51.770187 10053 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:51.774444  9874 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:00:51.796778  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
W20260709 13:00:51.793987  1581 leader_election.cc:336] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:51.769807  9951 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:51.807837  1612 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 19.
I20260709 13:00:51.789533 10088 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:00:51.807128  1581 leader_election.cc:336] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:51.813967  1581 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:51.788041 10079 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.023s
I20260709 13:00:51.800619  9773 consensus_queue.cc:1048] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.021s
I20260709 13:00:51.825081 10073 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.829500  1690 raft_consensus.cc:1240] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Rejecting Update request from peer c262eac7fc904ae9bb91e450f6532e3f for earlier term 24. Current term is 25. Ops: []
I20260709 13:00:51.802970 10053 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:51.820298 10136 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.834110 10024 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:51.834609 10136 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 26 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:51.836170  1581 leader_election.cc:336] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:51.835780  9860 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:00:51.837085  1581 leader_election.cc:336] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:51.838023  1581 leader_election.cc:336] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:51.838840  1581 leader_election.cc:336] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:51.839396  1581 leader_election.cc:336] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:51.839916  1581 leader_election.cc:336] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:51.804280 10076 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:51.848771  1686 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 30 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 29. Current term is 30. Ops: []
W20260709 13:00:51.850966  1581 leader_election.cc:336] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:51.852782  1581 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:51.858366  1581 consensus_peers.cc:597] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:51.857925  1507 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:51.861079  1507 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:51.864928  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:51.866600  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.867491  1656 leader_election.cc:400] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Vote denied by peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437) with higher term. Message: Invalid argument: T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 23. Current term is 24.
I20260709 13:00:51.867878  1656 leader_election.cc:403] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:51.774681 10106 consensus_queue.cc:237] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:51.856810 10130 log.cc:927] Time spent T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.275s	user 0.004s	sys 0.000s
I20260709 13:00:51.804440 10093 consensus_queue.cc:1048] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:00:51.866605 10088 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:00:51.890908 10017 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437) with higher term. Message: Invalid argument: T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for earlier term 23. Current term is 24.
I20260709 13:00:51.892802 10017 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:00:51.895241 10069 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 32 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.897444 10012 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:51.897966 10012 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:51.890844 10088 raft_consensus.cc:697] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:51.862725  9773 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:00:51.901379  1508 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.808936  9951 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:51.910195 10088 consensus_queue.cc:237] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.914640  9784 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:51.936961 10012 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.939327 10012 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:51.940093 10085 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.940773 10085 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.942986 10085 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:51.887092 10014 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:00:51.926137 10139 log.cc:927] Time spent T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:00:51.953050  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:51.956843  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:51.961714  9951 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:51.957628  1616 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 24.
I20260709 13:00:51.969429 10108 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.970171 10108 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:51.948762 10014 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.976373  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:51.980031  1611 raft_consensus.cc:2393] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 19: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:51.977370  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:51.979075  2301 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32794 (request call id 1199) took 1021 ms. Trace:
I20260709 13:00:51.988323  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:51.988287  2301 rpcz_store.cc:276] 0709 13:00:50.953094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.965896 (+ 12802us) service_pool.cc:224] Handling call
0709 13:00:51.973863 (+1007967us) spinlock_profiling.cc:243] Waited 83.3 ms on lock 0x7b54008e9754. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:51.974025 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191641472}
I20260709 13:00:51.978906 10014 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:51.977802 10015 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:51.999019  1508 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:52.004977 10108 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:52.008742  1508 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:52.014133  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:52.017186  1508 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
W20260709 13:00:52.013976  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 144750us
I20260709 13:00:51.993709 10073 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:52.009546  9718 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:51.987473 10000 consensus_queue.cc:1059] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.028s
I20260709 13:00:52.041216  2299 raft_consensus.cc:1240] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 32 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 31. Current term is 32. Ops: []
I20260709 13:00:52.042593  1508 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:52.048837  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:52.049225  1508 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:52.049829  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:52.052778  1508 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:52.025221 10088 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:52.040885 10108 raft_consensus.cc:2804] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:52.011590  9860 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:52.058805  1508 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:52.092511  1508 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:52.093778  1508 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:52.081370 10081 consensus_queue.cc:1059] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 31.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 13:00:52.078997  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 32 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:52.051684 10085 raft_consensus.cc:2804] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:00:52.056129  9859 raft_consensus.cc:3055] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 24 LEADER]: Stepping down as leader of term 24
W20260709 13:00:52.101523  2266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.057499  9808 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:52.096367  9910 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:00:52.060750  9718 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:00:52.065451 10069 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 32 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:52.065091 10108 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.109625  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:52.125002  1688 raft_consensus.cc:3060] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:00:52.113103 10146 log.cc:927] Time spent T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:00:52.097585 10091 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:00:52.104775 10085 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.055481 10150 consensus_queue.cc:1059] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:00:52.134294  2302 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 15. (term mismatch)
I20260709 13:00:52.134781  2302 pending_rounds.cc:85] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579: Aborting all ops after (but not including) 14
I20260709 13:00:52.134994  2302 pending_rounds.cc:107] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579: Aborting uncommitted NO_OP operation due to leader change: 24.15
I20260709 13:00:52.135208  2302 raft_consensus.cc:2889] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:52.103646  9859 raft_consensus.cc:740] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 24 LEADER]: Becoming Follower/Learner. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:52.097070  9860 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:52.127058 10108 raft_consensus.cc:3060] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:52.141259 10085 raft_consensus.cc:3060] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:52.145169  9808 raft_consensus.cc:2804] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:00:52.183694  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 53807.7us
I20260709 13:00:52.175213  9808 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:52.196264  1688 raft_consensus.cc:2468] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 26.
I20260709 13:00:52.176266  9910 raft_consensus.cc:697] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:52.208314  9910 consensus_queue.cc:237] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:52.210525 10014 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:52.212576   431 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 1567)
I20260709 13:00:52.179121  9859 consensus_queue.cc:260] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:52.228420  9860 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:52.230427  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:52.187372 10076 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:52.193917  9808 raft_consensus.cc:3060] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:00:52.233553  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 127531us
W20260709 13:00:52.289784  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 53201.7us
I20260709 13:00:52.290656  2269 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
W20260709 13:00:52.296339  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 56846.4us
I20260709 13:00:52.297781  1508 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:52.305792  1508 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:52.235841  9773 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:52.289417 10090 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:52.313930  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:52.317314  1682 raft_consensus.cc:2393] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 26: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:52.299881 10069 raft_consensus.cc:2804] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:00:52.241955 10076 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:52.307863 10162 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:52.319737  9775 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:00:52.321597 10014 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:52.331535 10069 raft_consensus.cc:697] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 26 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:52.349466  1682 raft_consensus.cc:1275] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:00:52.316834 10164 consensus_queue.cc:1059] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.032s
W20260709 13:00:52.357041 10158 log.cc:927] Time spent T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:00:52.361877 10076 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:52.374265 10164 raft_consensus.cc:3055] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 LEADER]: Stepping down as leader of term 29
I20260709 13:00:52.374719 10164 raft_consensus.cc:740] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:52.375589 10164 consensus_queue.cc:260] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.18, Last appended by leader: 18, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:52.368968  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49296 (request call id 4055) took 1105 ms. Trace:
I20260709 13:00:52.378854  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:52.321223 10090 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:52.379124  1608 rpcz_store.cc:276] 0709 13:00:51.263522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.314841 (+ 51319us) service_pool.cc:224] Handling call
0709 13:00:52.368746 (+1053905us) spinlock_profiling.cc:243] Waited 70.2 ms on lock 0x7b54000023d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:52.368895 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161526016}
I20260709 13:00:52.377077 10053 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:52.388139  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:52.389540 10069 consensus_queue.cc:237] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:52.392904  9722 consensus_queue.cc:260] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:52.394075  9722 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:52.397040  9948 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:52.404754  9718 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:52.409669  2268 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.412923  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:52.362068 10015 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 13:00:52.416661  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:52.419265  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.419135  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:52.420715  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:52.425288  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:52.427811 10024 consensus_queue.cc:1059] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:00:52.415992 10087 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.429742 10087 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:52.431067 10088 raft_consensus.cc:3055] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 31 LEADER]: Stepping down as leader of term 31
I20260709 13:00:52.431550 10088 raft_consensus.cc:740] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 31 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:52.432768  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 24 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:52.433586  2303 raft_consensus.cc:2393] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 24: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:52.364393 10108 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:52.413885 10164 raft_consensus.cc:3060] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:00:52.405512  9718 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:52.419821 10015 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:52.441828  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:52.443526  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:52.453215  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:52.455855  1615 raft_consensus.cc:1275] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:00:52.431805 10087 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:52.457685  1616 raft_consensus.cc:1240] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 18. Current term is 19. Ops: [16.13-18.14]
I20260709 13:00:52.458132  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:52.459910  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:52.435387  9948 consensus_queue.cc:1048] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:00:52.462993 10090 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:52.464874  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:52.469771  1582 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:52.472565  1582 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:52.473954  9637 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:00:52.435595 10088 consensus_queue.cc:260] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 31.19, Last appended by leader: 19, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:52.537495  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 64989.9us
I20260709 13:00:52.538443  1582 leader_election.cc:400] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 election: Vote denied by peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437) with higher term. Message: Invalid argument: T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 24. Current term is 25.
I20260709 13:00:52.538779  1582 leader_election.cc:403] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 13:00:52.539867  1582 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
W20260709 13:00:52.559268  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 787710us
W20260709 13:00:52.561235  2267 leader_election.cc:336] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:52.563215  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:52.561690  2267 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:52.566848  2267 leader_election.cc:336] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:52.541972  9637 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 13:00:52.568195  1582 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:52.476810 10087 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.035s
I20260709 13:00:52.571204  1582 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:52.558307 10106 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:00:52.572664  2267 leader_election.cc:336] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:52.574342  2267 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:52.572651  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33206 (request call id 1306) took 1264 ms. Trace:
I20260709 13:00:52.559346 10088 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 31 FOLLOWER]: Advancing to term 32
I20260709 13:00:52.576412  1684 rpcz_store.cc:276] 0709 13:00:51.319527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.667932 (+348405us) service_pool.cc:224] Handling call
0709 13:00:51.668238 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:51.668463 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 20
0709 13:00:51.767805 (+ 99342us) log.cc:844] Serialized 14 byte log entry
0709 13:00:51.886741 (+118936us) log.cc:844] Serialized 14 byte log entry
0709 13:00:51.898999 (+ 12258us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b18003ba880. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f643f3 00007fc859f667c1 00007fc859f66779 00007fc859f66709 00007fc859f666d1 00007fc859f659cd 000000000038f354 000000000038f199 00007fc859f4783a
0709 13:00:52.434037 (+535038us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b18003ba880. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc862e2cde1 00007fc862e395b1 00007fc859f46e07 00007fc862da1ab9 00007fc859f6369b 00007fc859f6193f 00007fc859f61455 00007fc85d049060 00007fc85d05b716 00007fc85d06c287 00007fc85d06c208
0709 13:00:52.570292 (+136255us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:52.570345 (+    53us) raft_consensus.cc:1645] Marking committed up to 20
0709 13:00:52.572309 (+  1964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.572384 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:52.572591 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7258,"prepare.queue_time_us":23604,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":28103,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":5895,"spinlock_wait_cycles":8624896,"thread_start_us":230951,"threads_started":2,"wal-append.queue_time_us":192543}
I20260709 13:00:52.568760 10076 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:00:52.578966  9805 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:52.565248 10133 raft_consensus.cc:3055] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:00:52.540553 10085 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:52.571909  9804 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:52.596870  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:52.600986 10163 log.cc:927] Time spent T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.275s	user 0.002s	sys 0.000s
I20260709 13:00:52.583585  9808 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:52.612464  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:52.615419  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 50538.1us
I20260709 13:00:52.628429  2266 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:52.629925  2266 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:52.589318  2267 leader_election.cc:336] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:52.632861  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:52.633576  1685 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 17.
I20260709 13:00:52.582741 10000 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:52.625481  9718 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:52.636513  9808 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:52.638386  1508 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:52.639860  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
W20260709 13:00:52.641602  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 52823.7us
I20260709 13:00:52.584729 10133 raft_consensus.cc:740] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:52.587637 10093 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:00:52.644217  2267 leader_election.cc:336] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:52.682008  2267 leader_election.cc:336] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:52.685305  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:52.647154  9859 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:00:52.650239 10152 log.cc:927] Time spent T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:00:52.651357  1507 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
W20260709 13:00:52.653445  1581 leader_election.cc:336] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:52.704914  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 51491.5us
W20260709 13:00:52.705245  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 53944.1us
I20260709 13:00:52.698598  1688 raft_consensus.cc:1275] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:00:52.707005  1688 raft_consensus.cc:1275] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 30 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 30 index: 18. (index mismatch)
I20260709 13:00:52.641351  9800 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:52.626103 10108 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:52.658491 10170 log.cc:927] Time spent T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:00:52.633229 10131 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:00:52.658891  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.661135 10012 consensus_queue.cc:1048] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:00:52.666360  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.731401  1505 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:52.667001 10167 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:52.669770 10085 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:52.708444  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:52.701719  1684 raft_consensus.cc:1275] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:00:52.657644 10128 log.cc:927] Time spent T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 1.079s	user 0.006s	sys 0.000s
I20260709 13:00:52.726673  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:52.735495  1505 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
W20260709 13:00:52.727960  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.704831 10093 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.686165  9808 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:00:52.671149 10090 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.742671  1690 raft_consensus.cc:2393] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 17: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:52.740686  1505 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:52.722434 10095 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:00:52.724994 10007 consensus_queue.cc:1048] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.021s
I20260709 13:00:52.741925  9910 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:52.748126  1613 raft_consensus.cc:1275] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:00:52.732445  9805 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:52.745441 10093 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:52.757063  1505 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:52.739364 10014 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:00:52.742450  9808 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.789304  1685 raft_consensus.cc:1275] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:00:52.799068 10162 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.799628 10162 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:52.801529  1655 leader_election.cc:336] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:52.752250 10085 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:52.748641  9910 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:52.798347  9808 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:00:52.808919  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 237669us
I20260709 13:00:52.811489  9910 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:52.810096 10166 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:52.802881 10158 log.cc:927] Time spent T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:00:52.812788  1582 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:52.784845 10165 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:00:52.784592 10014 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:52.816289  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.739755 10167 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:52.819240 10166 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:52.755759 10053 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:00:52.748778 10090 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:52.831868  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 199666us
I20260709 13:00:52.833472  2266 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
W20260709 13:00:52.835716  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 152619us
W20260709 13:00:52.837087  2267 leader_election.cc:336] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:52.805862 10081 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:00:52.838599  2266 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:52.839159  2267 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:52.842597  2267 leader_election.cc:336] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:52.843118  2267 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:52.829368 10014 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:52.847404  2266 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:52.848726  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 132371us
I20260709 13:00:52.752562 10133 consensus_queue.cc:260] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:52.849239  9744 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:00:52.832195 10165 raft_consensus.cc:697] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:52.844151 10131 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:00:52.856402  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 50697us
W20260709 13:00:52.863328  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 61083.4us
I20260709 13:00:52.879017  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:52.873145  1655 leader_election.cc:336] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:52.880721  1655 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:52.853039  9804 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:00:52.886726  1655 leader_election.cc:336] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:52.891247  9860 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.887722  9722 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:00:52.895748  1581 leader_election.cc:336] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:52.896895  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 84135.5us
I20260709 13:00:52.871675 10069 raft_consensus.cc:2764] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260709 13:00:52.899013  9860 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:52.897892  1655 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:52.904963  1582 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:52.886843 10133 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:52.865881 10131 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 13:00:52.888160 10173 log.cc:927] Time spent T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:00:52.917415 10131 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:52.921010 10012 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:52.921922 10165 consensus_queue.cc:237] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:52.907331  1581 leader_election.cc:336] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:52.923571  1581 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:52.924654 10108 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.914284  1582 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:52.913003  1655 leader_election.cc:336] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:52.913537  9722 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:52.896312  9805 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:52.926656  1655 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:52.927397 10012 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:52.929224 10076 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:52.930784  9860 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:52.929486  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 82134.3us
I20260709 13:00:52.933405  9722 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:52.943037  1582 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:52.944253  1655 consensus_peers.cc:597] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:52.957096  1655 leader_election.cc:336] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:52.957792  1655 leader_election.cc:336] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:52.958179  1655 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:52.958984  9722 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:00:52.960060  1655 leader_election.cc:336] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:52.937723 10175 log.cc:927] Time spent T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:00:52.963253  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:52.963840  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:52.929111  1657 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.969085  1614 raft_consensus.cc:1240] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 30 LEADER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 29. Current term is 30. Ops: []
I20260709 13:00:52.964802  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:52.934432  9808 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:52.965072  1609 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:00:53.008402  1616 raft_consensus.cc:2393] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 19: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:53.009168  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:52.909080 10177 raft_consensus.cc:2749] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:00:53.009761  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:52.960393 10178 log.cc:927] Time spent T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:00:52.966990  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:52.964700  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:53.012923  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:53.015209  1691 raft_consensus.cc:2410] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 28 because replica has last-logged OpId of term: 26 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 18.
I20260709 13:00:53.010363  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:52.995047  1655 leader_election.cc:336] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:53.024921  1655 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:52.964418 10164 consensus_meta.cc:287] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.519s	user 0.006s	sys 0.002s
I20260709 13:00:53.020469  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:53.021303  1654 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:53.026780  1609 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 16.
I20260709 13:00:52.970984 10166 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:52.970330 10182 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:52.925247 10108 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:53.029196  1616 raft_consensus.cc:2468] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 19.
I20260709 13:00:53.035735  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:53.036917  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 194267us
I20260709 13:00:53.037387  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:53.038170  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 182071us
I20260709 13:00:53.040230  2299 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:00:52.995407 10053 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:53.058969  2303 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 22.
I20260709 13:00:53.055137  2302 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 27.
W20260709 13:00:53.070302  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 49025.9us
W20260709 13:00:53.071940  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 76898.2us
I20260709 13:00:53.022274 10091 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.076648  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:53.077666  1655 leader_election.cc:336] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:53.080960  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:53.083118  1655 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:53.075567  1582 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:53.082511  1654 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:53.082600  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:53.079092  2295 raft_consensus.cc:1240] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 18. Current term is 19. Ops: [16.13-18.14]
I20260709 13:00:53.000988  9910 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:53.093748  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:53.089509  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:53.096377  1614 raft_consensus.cc:2393] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 22: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:53.071388  9948 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:00:53.087535 10015 consensus_meta.cc:287] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.627s	user 0.011s	sys 0.000s
I20260709 13:00:53.073451  9805 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.097586  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:53.097765  1617 raft_consensus.cc:2468] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 25.
I20260709 13:00:53.070286 10196 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:00:53.109408  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 139528us
I20260709 13:00:53.071667 10164 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:00:53.095367 10079 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:00:53.117916  1505 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:53.121357  1505 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:53.106226 10090 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:53.110834 10017 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:00:53.125810  1505 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:53.126536 10190 log.cc:927] Time spent T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:00:53.091881 10091 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:53.128297  9718 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:00:53.101086 10073 consensus_queue.cc:1048] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:00:53.119234 10166 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.085548 10053 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:53.126407 10085 raft_consensus.cc:3060] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:00:53.120679  9948 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:53.120541 10079 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.111388 10015 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:53.119576 10040 consensus_queue.cc:1048] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 13:00:53.159526  9637 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.160111  9637 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:53.161573 10014 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:53.162366  9637 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:53.163331 10193 log.cc:927] Time spent T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:00:53.113155  9805 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:53.165465 10053 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:53.165720  9805 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:53.143618 10095 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:53.144449  9800 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:53.141839  9775 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:53.200871  2301 raft_consensus.cc:1240] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 23. Current term is 24. Ops: []
W20260709 13:00:53.204010  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 144847us
I20260709 13:00:53.171319 10007 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.176978 10087 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:53.194820  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 112337us
W20260709 13:00:53.213136   431 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 1567)
W20260709 13:00:53.199306  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 155450us
I20260709 13:00:53.134029 10093 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:53.154065 10081 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.053s
I20260709 13:00:53.152747 10079 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:00:53.216846  1656 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:53.149266 10166 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:53.224133  1654 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:53.228811  1687 raft_consensus.cc:1275] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 24 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260709 13:00:53.229621  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:53.231055  2297 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 27.
I20260709 13:00:53.232590  1611 raft_consensus.cc:1240] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 24. Current term is 25. Ops: []
I20260709 13:00:53.207183  9775 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:53.248670  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 170945us
W20260709 13:00:53.249614  1655 leader_election.cc:336] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:53.250099  1655 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:53.246907  1656 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:53.229331 10017 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:00:53.273052  1613 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 24.
I20260709 13:00:53.227738 10090 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:00:53.261188  1655 leader_election.cc:336] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:53.226547  9784 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:53.262606 10165 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.264510 10053 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.265152  9910 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:53.266754 10194 log.cc:927] Time spent T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:00:53.267105  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:53.229612  9722 consensus_queue.cc:1048] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:00:53.216575 10007 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:53.271817 10015 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:53.273995  1614 raft_consensus.cc:1275] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
W20260709 13:00:53.275291  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 50999.9us
I20260709 13:00:53.278519 10108 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:53.227044 10069 consensus_queue.cc:1048] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:00:53.214753 10087 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:53.285228  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:53.256068  9808 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:53.293041  1611 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:53.285545 10196 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:00:53.273371 10017 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:53.285123  9784 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:53.278749 10197 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.278848 10073 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:00:53.293206  9718 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.304061 10166 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:53.307261 10088 consensus_meta.cc:287] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.721s	user 0.010s	sys 0.000s
I20260709 13:00:53.338032  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:53.339324  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:53.306355  9637 raft_consensus.cc:2955] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Committing config change with OpId 22.19: config changed from index 15 to 19, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:53.340368  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:53.289296 10165 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:53.309931 10069 consensus_queue.cc:1048] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
W20260709 13:00:53.311758 10106 consensus_meta.cc:287] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.734s	user 0.009s	sys 0.002s
I20260709 13:00:53.314962 10131 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:53.279062  1655 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:53.345764  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 84564.8us
W20260709 13:00:53.346606  1655 leader_election.cc:336] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:53.347019  1655 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:53.348276  1655 consensus_peers.cc:597] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:53.323722 10017 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:00:53.326802  9784 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:53.326957 10197 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:53.328025 10091 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:53.319832 10196 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.322009 10007 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:53.331792  9718 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:53.332680 10093 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:53.333036 10087 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:53.344530  1611 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 24.
I20260709 13:00:53.291945 10053 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:53.317706  1613 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 16 FOLLOWER]: Advancing to term 18
W20260709 13:00:53.350615  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.358803  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:53.366163 10195 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:53.379813  9718 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:53.362015 10106 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437) with higher term. Message: Invalid argument: T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for earlier term 24. Current term is 25.
I20260709 13:00:53.392222  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:53.392849 10091 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.390007 10165 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:53.393316  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:53.393805 10205 log.cc:927] Time spent T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:00:53.394711  9775 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:53.395601 10197 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:53.397831  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:53.415201  1655 leader_election.cc:336] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:53.418637  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:53.420857  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:53.454981  1689 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:00:53.421625  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:53.454838  1655 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:53.420243  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:53.425588  1687 raft_consensus.cc:2393] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 25: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:53.431893 10090 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.427650  1505 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:53.458966  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:53.459270  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 44099.2us
I20260709 13:00:53.435335  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:53.436064  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:53.436599  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:53.460103  1655 consensus_peers.cc:597] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:53.438964  1654 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:53.441062  1613 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 18.
I20260709 13:00:53.441161  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:53.433032  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:53.461583  2294 raft_consensus.cc:2410] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:00:53.441785  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:53.371527 10196 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:00:53.442232  1507 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:53.463932  1613 raft_consensus.cc:1240] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:00:53.426226 10093 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.452545  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:53.363034 10073 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:53.456900  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:53.458285  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:53.461690  1611 raft_consensus.cc:2468] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 24.
I20260709 13:00:53.442462  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:53.437026 10200 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.465240  1507 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:53.447292  2297 raft_consensus.cc:2955] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Committing config change with OpId 22.19: config changed from index 15 to 19, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:53.475171  1610 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:53.468816  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:53.478307  2298 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 14.
I20260709 13:00:53.484411  1689 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 18.
W20260709 13:00:53.478682  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 51087.5us
W20260709 13:00:53.460687  1655 leader_election.cc:336] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:53.485302  1505 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:53.485457  1655 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:53.480185  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:53.483170  1613 raft_consensus.cc:1240] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 23. Current term is 24. Ops: []
I20260709 13:00:53.436700  9948 consensus_queue.cc:1059] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.038s
I20260709 13:00:53.485740  1508 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:53.494339  1612 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 25.
I20260709 13:00:53.466459 10197 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:53.476822  9775 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:00:53.481030  9910 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:53.477923 10162 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:53.450356 10091 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:53.450749 10108 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.046s
I20260709 13:00:53.516953  1610 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 21.
I20260709 13:00:53.497134  9722 raft_consensus.cc:2804] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:00:53.511765  9948 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:53.474566 10090 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:53.509687  9718 raft_consensus.cc:2804] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:53.509918 10088 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:00:53.481571 10093 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:53.526875  9775 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:00:53.554221 10191 log.cc:927] Time spent T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.444s	user 0.003s	sys 0.004s
I20260709 13:00:53.554097 10017 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:53.492192 10200 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:53.581482 10053 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:53.567396  9718 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.587844 10090 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:53.588984 10167 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:53.590991 10085 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:53.599615  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:53.568523  9722 raft_consensus.cc:697] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 25 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:53.588734 10000 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:53.600402  1608 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:00:53.597494  9718 raft_consensus.cc:3060] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:53.584280  9775 raft_consensus.cc:697] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:53.604952  9775 consensus_queue.cc:237] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:53.606784 10014 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:53.609923 10131 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:53.614621  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 653419us
I20260709 13:00:53.625211  1654 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:53.644171  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:53.650476 10106 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:53.651248 10106 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:53.653740 10106 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:53.655593  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:53.662129  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:53.662894  2296 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:00:53.673614  1616 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:00:53.658540 10000 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:53.689666 10091 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:53.691917 10000 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:53.701261 10195 raft_consensus.cc:3055] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:00:53.701772 10195 raft_consensus.cc:740] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:53.702698 10195 consensus_queue.cc:260] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:53.703894 10195 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:53.721364  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:53.658347  9948 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:53.729848  1582 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:53.732282 10184 raft_consensus.cc:2804] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:53.732684 10017 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:53.732753 10184 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.733273 10184 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:53.734462 10200 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:53.735872 10093 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:53.736621  9722 consensus_queue.cc:237] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:53.737603  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:53.738272  2300 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 19.
W20260709 13:00:53.739845 10079 consensus_meta.cc:287] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f: Time spent flushing consensus metadata: real 0.510s	user 0.005s	sys 0.005s
I20260709 13:00:53.742062 10079 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:53.743161  1614 raft_consensus.cc:2393] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 28: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:53.744175 10079 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 28 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:53.726640  9718 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:53.729261  9948 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.746650  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:53.754432  1608 raft_consensus.cc:1240] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:53.747913 10184 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:53.755106  9948 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:53.748615  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:53.756201  1688 raft_consensus.cc:2410] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:00:53.754621  9718 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:53.759672  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:53.764421  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:53.765170  1614 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:00:53.761235  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:53.770006  2300 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:00:53.770581  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 26 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:53.758671  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:53.769105  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 283725us
I20260709 13:00:53.773367  1608 raft_consensus.cc:2393] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 22: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:53.773562  1505 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:53.778239  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:53.777134  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:53.780164  1617 raft_consensus.cc:2393] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 25: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
W20260709 13:00:53.780269  1581 leader_election.cc:336] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:53.787676  2297 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 22.
I20260709 13:00:53.783869  1581 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:53.866448  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 86180.9us
W20260709 13:00:53.867945  1581 leader_election.cc:336] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:53.782109  1505 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:53.793788  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:53.795986  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:53.869472  2298 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:00:53.722296 10196 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 28 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:53.789410  9718 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:00:53.805312 10184 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:53.808405 10199 consensus_queue.cc:1059] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 13:00:53.831631  1582 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:53.852528  1616 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 19.
I20260709 13:00:53.868413  1581 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:53.882644  1581 leader_election.cc:336] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:53.883285  1581 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:53.889111  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 62546.4us
I20260709 13:00:53.871845 10106 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:00:53.886370  1687 raft_consensus.cc:2955] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Committing config change with OpId 22.19: config changed from index 15 to 19, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:53.892876  1654 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:53.896817  1614 raft_consensus.cc:2393] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 24: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:53.872011  1656 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:53.899606  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:53.876287  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 94245us
W20260709 13:00:53.817284  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 351921us
I20260709 13:00:53.901608  1505 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:53.887207 10184 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:53.901629  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:53.885046 10213 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:53.906497  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:53.906845  1505 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:53.909844  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:53.909960  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:53.904556 10172 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:53.909229  9775 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:53.912227  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:53.895426 10079 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:00:53.924513  1583 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:53.900898 10007 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:53.929352  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:53.929608  2298 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:53.893181 10206 raft_consensus.cc:3055] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:00:53.931253  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:53.931821  1690 raft_consensus.cc:2393] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 28: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:53.932752 10212 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 32 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.934299  1505 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:53.937698  2299 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 16. (term mismatch)
W20260709 13:00:53.948725  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 50538.5us
I20260709 13:00:53.951573  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:53.908959 10200 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:00:53.965679  1505 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:53.953851  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:53.966522  2297 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:53.967172  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:53.969870  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:53.932195 10172 raft_consensus.cc:493] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.961289  2299 pending_rounds.cc:85] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579: Aborting all ops after (but not including) 15
I20260709 13:00:53.974418  2299 pending_rounds.cc:107] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579: Aborting uncommitted NO_OP operation due to leader change: 22.16
I20260709 13:00:53.974761  2299 raft_consensus.cc:2889] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:53.977979  1507 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:53.942277 10166 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:53.983717  1507 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:53.981467  1505 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:53.908905  9718 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:00:53.951650 10184 raft_consensus.cc:2749] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:53.986709  1505 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:53.991323  1505 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:53.938720 10079 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.952116 10206 raft_consensus.cc:740] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:53.964799 10091 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.979737 10172 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:53.994884  1507 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:53.984364 10200 raft_consensus.cc:697] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 22 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:54.003444  2297 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 24.
W20260709 13:00:53.984956  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 79780.5us
W20260709 13:00:54.026646  2267 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 134 similar messages]
I20260709 13:00:53.985302 10108 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:53.985684  9808 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:53.964763 10213 consensus_queue.cc:1059] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.054s
I20260709 13:00:53.992218  9775 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:53.983031 10214 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:00:54.035374  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 68521.1us
W20260709 13:00:54.105754  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 80450.9us
I20260709 13:00:53.998525 10079 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:53.997012 10085 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:53.996706 10014 raft_consensus.cc:2804] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:00:54.017880 10166 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:53.968554 10212 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:54.108145  1583 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
W20260709 13:00:54.177381  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 52994.7us
W20260709 13:00:54.107416 10193 log.cc:927] Time spent T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:00:54.036826 10162 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:00:54.204010  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 95893.2us
I20260709 13:00:54.187811  2300 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 28.
W20260709 13:00:54.126035 10194 log.cc:927] Time spent T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 13:00:54.213614   431 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 1567)
I20260709 13:00:54.038040 10165 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.170s
I20260709 13:00:54.228298  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:54.127214 10014 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.229401  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:54.228600  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:54.222311 10195 consensus_meta.cc:287] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.008s
I20260709 13:00:54.032287 10091 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:54.237959  1615 raft_consensus.cc:2393] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 15: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:54.238273 10014 raft_consensus.cc:3060] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:00:54.255089 10228 log.cc:927] Time spent T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260709 13:00:54.256829 10229 log.cc:927] Time spent T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:00:54.221570  9637 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:00:54.259452  1685 raft_consensus.cc:2410] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 25 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260709 13:00:54.221508 10166 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.211663 10214 raft_consensus.cc:697] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:54.279862  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
W20260709 13:00:54.243013 10219 log.cc:927] Time spent T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
I20260709 13:00:54.280861  2302 raft_consensus.cc:2393] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 28: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 13:00:54.289363 10230 log.cc:927] Time spent T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:00:54.290370 10223 log.cc:927] Time spent T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 13:00:54.242760 10196 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 28 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:54.329308  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 433221us
I20260709 13:00:54.233492  9948 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:54.340411  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:54.329496 10217 log.cc:927] Time spent T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.384s	user 0.001s	sys 0.001s
I20260709 13:00:54.350127  1608 raft_consensus.cc:2393] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 28: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:54.378863  1691 raft_consensus.cc:2368] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for earlier term 19. Current term is 20.
W20260709 13:00:54.380023  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 166230us
I20260709 13:00:54.338315 10085 raft_consensus.cc:697] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:54.285552 10166 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:54.385073  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:54.258311 10200 consensus_queue.cc:237] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:54.386967  1655 leader_election.cc:336] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:54.388896  1655 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:54.389068  1608 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:00:54.391040  1505 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:54.340770 10167 consensus_queue.cc:1059] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: INVALID_TERM, Last received: 23.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.046s
I20260709 13:00:54.380035 10164 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 13:00:54.390084 10221 log.cc:927] Time spent T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.396s	user 0.001s	sys 0.000s
I20260709 13:00:54.396242  2298 raft_consensus.cc:2468] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 15.
W20260709 13:00:54.443104  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 50087.5us
I20260709 13:00:54.446108  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:54.446856  1616 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 31.
I20260709 13:00:54.448751  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49312 (request call id 3938) took 1427 ms. Trace:
I20260709 13:00:54.466938  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:54.462671  1609 rpcz_store.cc:276] 0709 13:00:53.020924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.465081 (+444157us) service_pool.cc:224] Handling call
0709 13:00:53.465394 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:53.465786 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:53.465818 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:53.479312 (+ 13494us) log.cc:844] Serialized 26 byte log entry
0709 13:00:53.805290 (+325978us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:53.805344 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.805433 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:54.448541 (+643108us) raft_consensus.cc:1685] finished
0709 13:00:54.448560 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.448694 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":99,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":16381,"thread_start_us":284167,"threads_started":1,"wal-append.queue_time_us":377021}
I20260709 13:00:54.465770  1505 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:54.477818 10195 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:54.439599 10246 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:00:54.478485 10235 log.cc:927] Time spent T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:00:54.464349 10091 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:54.442425 10164 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:54.469446 10081 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.009s
I20260709 13:00:54.489332  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50694 (request call id 4183) took 1072 ms. Trace:
I20260709 13:00:54.493073  1684 rpcz_store.cc:276] 0709 13:00:53.417340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.417782 (+   442us) service_pool.cc:224] Handling call
0709 13:00:53.435580 (+ 17798us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:53.508503 (+ 72923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:53.508539 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:53.509194 (+   655us) log.cc:844] Serialized 52 byte log entry
0709 13:00:53.891415 (+382221us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:53.906259 (+ 14844us) log.cc:844] Serialized 14 byte log entry
0709 13:00:53.909458 (+  3199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.909543 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:54.489049 (+579506us) raft_consensus.cc:1685] finished
0709 13:00:54.489073 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.489248 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2978,"prepare.queue_time_us":14863,"prepare.run_wall_time_us":40,"raft.queue_time_us":14830,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":22323,"spinlock_wait_cycles":28058112,"thread_start_us":449856,"threads_started":2,"wal-append.queue_time_us":470458}
I20260709 13:00:54.390748 10214 consensus_queue.cc:237] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:54.499322 10162 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:54.509552 10226 log.cc:927] Time spent T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:00:54.489990 10242 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260709 13:00:54.516888 10242 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.517258 10242 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 32 FOLLOWER]: Advancing to term 33
I20260709 13:00:54.522424 10166 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:54.482558 10085 consensus_queue.cc:237] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:54.529911 10164 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:54.531597  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:54.532277  2301 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 32.
I20260709 13:00:54.533175  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:54.534253  1609 raft_consensus.cc:1275] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:00:54.534794  1508 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.030s	user 0.033s	sys 0.039s
W20260709 13:00:54.535115  1508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.031s	user 0.033s	sys 0.039s
W20260709 13:00:54.535626  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 1.04935e+06us
I20260709 13:00:54.535869 10108 consensus_queue.cc:1048] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:54.503118 10212 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:54.537158  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:54.529948  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49296 (request call id 4087) took 1249 ms. Trace:
I20260709 13:00:54.543453  1610 rpcz_store.cc:276] 0709 13:00:53.280848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.554553 (+273705us) service_pool.cc:224] Handling call
0709 13:00:53.554991 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:53.556157 (+  1166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:53.556188 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:53.567823 (+ 11635us) log.cc:844] Serialized 26 byte log entry
0709 13:00:53.902692 (+334869us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:00:53.902734 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.902797 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:54.529703 (+626906us) raft_consensus.cc:1685] finished
0709 13:00:54.529725 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:54.529884 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":649,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":79,"thread_start_us":233602,"threads_started":1,"wal-append.queue_time_us":670758}
I20260709 13:00:54.544869  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:54.546176  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:54.547233  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:54.542023  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 154999us
I20260709 13:00:54.540786  1508 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:54.550616  1683 raft_consensus.cc:1275] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:00:54.547585  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:54.559018  1508 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:54.573426  1508 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:54.574513  1508 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:54.575960  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:54.531469  9948 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:54.528093 10014 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:54.524119 10079 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:54.577178  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:54.577219  2267 leader_election.cc:336] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:54.588395  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 616294us
W20260709 13:00:54.589622  1581 consensus_peers.cc:597] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:54.590188  1581 consensus_peers.cc:597] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:54.585654  2267 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:54.601819 10213 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:00:54.604198 10213 consensus_queue.cc:1048] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:54.606016  1508 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:54.607064  9718 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:54.607589 10014 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:54.609861  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:54.581300 10243 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:00:54.620144 10172 consensus_meta.cc:287] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d: Time spent flushing consensus metadata: real 0.588s	user 0.004s	sys 0.005s
I20260709 13:00:54.629215 10172 raft_consensus.cc:515] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:54.630330 10240 log.cc:927] Time spent T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:00:54.542479 10162 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:54.634375 10162 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:54.636240 10172 leader_election.cc:290] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:54.626693  1608 raft_consensus.cc:2393] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d in current term 20: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:54.571446 10212 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:54.580324 10166 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:54.636121  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:54.623472 10079 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: Requested vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:54.653316  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 76090.9us
W20260709 13:00:54.654739  2267 leader_election.cc:336] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:54.655646  2267 leader_election.cc:336] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 32 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:54.656054  2267 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:54.667132 10242 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 33 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:54.668805 10206 consensus_queue.cc:260] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:54.670086 10206 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:00:54.682700  1581 leader_election.cc:336] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:54.683990  1581 leader_election.cc:336] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:54.685003  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 80199.6us
I20260709 13:00:54.685735  2266 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:54.687144  2266 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:54.684393  1581 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:54.689697  2267 consensus_peers.cc:597] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:54.690316  2267 consensus_peers.cc:597] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:54.607203  9808 raft_consensus.cc:3055] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:00:54.687362 10040 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:54.688824 10245 raft_consensus.cc:3060] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:54.697469 10079 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:54.699513  1507 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:54.700068 10244 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:00:54.697454  1582 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
W20260709 13:00:54.695998  2267 leader_election.cc:336] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:54.705686  1582 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:54.706883  1656 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:54.693352 10069 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
I20260709 13:00:54.710273  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:54.710783  2297 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:54.723501  2297 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:54.691123 10196 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:54.728849 10196 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:54.731575 10196 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:00:54.695295  1581 leader_election.cc:336] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:54.712074  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:54.705152  2267 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:54.732260  1581 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:54.735049  1581 leader_election.cc:336] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:54.736685 10251 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:54.749567  1610 raft_consensus.cc:1240] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 20. Current term is 21. Ops: []
I20260709 13:00:54.757740  2297 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 13:00:54.693611  9808 raft_consensus.cc:740] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:54.760082  2298 raft_consensus.cc:1240] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 23. Current term is 24. Ops: []
I20260709 13:00:54.701037 10165 raft_consensus.cc:493] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:54.760936  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 52516.8us
W20260709 13:00:54.773763  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 203682us
I20260709 13:00:54.721561 10000 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:00:54.760835 10252 raft_consensus.cc:2804] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:54.808279  1508 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:54.811070  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8b7121a813948bfa350d3f0b9fd6988" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:54.811770  1610 raft_consensus.cc:3060] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:54.711549 10166 raft_consensus.cc:3060] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:54.817760  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:54.821043  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:54.822062 10085 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:54.822630 10085 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:54.721576  9948 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:00:54.829253  1691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33206 (request call id 1347) took 1172 ms. Trace:
I20260709 13:00:54.721750 10212 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.076s
I20260709 13:00:54.829689  1691 rpcz_store.cc:276] 0709 13:00:53.643742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.643922 (+   180us) service_pool.cc:224] Handling call
0709 13:00:54.801126 (+1157204us) spinlock_profiling.cc:243] Waited 733 ms on lock 0x7b5400389d54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:54.815928 (+ 14802us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1686735104}
I20260709 13:00:54.794162 10079 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.814620 10000 raft_consensus.cc:697] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 28 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:54.846961 10085 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:54.853111 10258 log.cc:927] Time spent T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:00:54.854724  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:54.775558 10165 raft_consensus.cc:515] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:54.857048  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 48851.2us
W20260709 13:00:54.877329  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 181290us
I20260709 13:00:54.858101 10088 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
W20260709 13:00:54.871589  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 52337us
I20260709 13:00:54.875579  1610 raft_consensus.cc:2468] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
W20260709 13:00:54.878377  2267 consensus_peers.cc:597] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:54.802301 10214 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:54.883010  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 121123us
I20260709 13:00:54.862392 10000 consensus_queue.cc:237] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:54.886096  2267 leader_election.cc:336] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:54.887836 10244 raft_consensus.cc:697] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 19 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:54.861500  1429 maintenance_manager.cc:419] P 633384cf034a459c9c7300ebf04605f6: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033396
I20260709 13:00:54.886714  2267 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:54.889691 10244 consensus_queue.cc:237] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:54.908902  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:54.892839  1508 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:54.897921  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:54.911089  2267 consensus_peers.cc:597] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:54.898881  1654 leader_election.cc:304] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 13:00:54.907321  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 142467us
I20260709 13:00:54.916080  1686 raft_consensus.cc:2393] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 20: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:54.913501  1508 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:54.883339 10269 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:00:54.921372  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:54.861781 10079 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:54.906939 10253 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.912412 10088 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:54.917775 10242 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 33 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:54.860450  9808 consensus_queue.cc:260] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:54.904637 10214 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:54.920416 10172 raft_consensus.cc:2804] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:00:54.920670 10256 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:00:54.921787  9775 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:00:54.965315  1581 consensus_peers.cc:597] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:54.966260  9808 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:54.938845 10095 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:54.976137 10261 log.cc:927] Time spent T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:00:54.977524 10262 log.cc:927] Time spent T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:00:54.980304 10245 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:54.973788 10246 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.974027 10172 raft_consensus.cc:697] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:54.928159 10253 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:54.990960 10259 log.cc:927] Time spent T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:00:54.997577  2294 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
W20260709 13:00:54.994403 10257 log.cc:927] Time spent T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260709 13:00:54.996706 10260 log.cc:927] Time spent T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:00:55.022927 10079 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:54.986037 10095 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:55.026337 10095 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:55.026914 10095 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:55.027400 10095 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:55.027585  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:54.972054 10085 consensus_queue.cc:1175] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1d6516ff61104bdda54bde95e92fe579" responder_term: 24 status { last_received { term: 23 index: 18 } last_committed_idx: 17 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 23. Current term is 24. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:55.040197 10095 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:55.058068  2302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:55.043174  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:55.058904  2302 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 22.
I20260709 13:00:55.045606  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:54.997994 10246 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:55.062016 10246 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:55.062896 10166 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:55.041234 10214 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:55.058158  1581 consensus_peers.cc:597] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:55.065410  1656 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:55.067124  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:55.045899 10253 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:55.070255 10090 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:55.070766 10090 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.071142 10090 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:55.071638 10172 consensus_queue.cc:237] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:55.086475 10191 log.cc:927] Time spent T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.626s	user 0.003s	sys 0.000s
W20260709 13:00:55.090824  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 277900us
I20260709 13:00:55.094866 10252 raft_consensus.cc:697] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:00:55.095963 10252 consensus_queue.cc:237] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:55.096341 10090 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:55.098605 10090 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:55.100870  1685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50708 (request call id 5054) took 1354 ms (client timeout 1501 ms). Trace:
W20260709 13:00:55.101310  1685 rpcz_store.cc:269] 0709 13:00:53.746193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.746326 (+   133us) service_pool.cc:224] Handling call
0709 13:00:55.100651 (+1354325us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b540041da54. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:55.100801 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1128921344}
I20260709 13:00:55.103051  1608 raft_consensus.cc:1275] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:00:55.106403  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:55.106344  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:55.107910  1614 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 22.
I20260709 13:00:55.110194  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:55.110967  1616 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:55.107484  2300 raft_consensus.cc:2410] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f for term 23 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 13:00:55.117875  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:55.118799  2296 raft_consensus.cc:3060] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:55.080659 10166 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.134312  1616 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 23.
I20260709 13:00:55.135984  1654 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 13:00:55.133972 10280 log.cc:927] Time spent T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:00:55.181650  2296 raft_consensus.cc:2468] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 23.
W20260709 13:00:55.222343   431 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 1567)
W20260709 13:00:55.253496  2267 consensus_peers.cc:597] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:55.188956  1581 consensus_peers.cc:597] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:55.255247  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 66325.6us
I20260709 13:00:55.137004 10250 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.053s
W20260709 13:00:55.269168  1581 consensus_peers.cc:597] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:55.132997 10166 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:55.184191 10206 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:55.182725 10254 raft_consensus.cc:2804] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:00:55.269523 10211 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:55.300697  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 130839us
I20260709 13:00:55.271425 10000 raft_consensus.cc:493] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:55.309813  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 391737us
I20260709 13:00:55.298066 10254 raft_consensus.cc:697] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 23 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:55.285199 10206 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:55.338166  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:55.339781  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:55.340003  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:55.341213  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:55.342505  1690 raft_consensus.cc:2393] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 24: Already voted for candidate 1d6516ff61104bdda54bde95e92fe579 in this term.
I20260709 13:00:55.303112 10211 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:55.346694 10206 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:55.347138  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:55.354048 10254 consensus_queue.cc:237] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:55.360844 10166 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:55.364900  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 33 candidate_status { last_received { term: 31 index: 19 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:55.365569  1616 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 31 FOLLOWER]: Advancing to term 33
I20260709 13:00:55.368935  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:55.370465  1611 raft_consensus.cc:1240] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Rejecting Update request from peer dbe6a89d0e1c4137b3a1b17bf4b520d8 for earlier term 23. Current term is 24. Ops: []
I20260709 13:00:55.453488  1616 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 33.
I20260709 13:00:55.457154  1611 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 13:00:55.458811  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:55.458868  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 76682.9us
I20260709 13:00:55.460958  1611 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:00:55.307615 10000 raft_consensus.cc:515] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:55.465010  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:55.471558  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:55.467895  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 136794us
I20260709 13:00:55.478224  1611 raft_consensus.cc:2393] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 25: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:55.520043  1505 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
W20260709 13:00:55.515791  1581 consensus_peers.cc:597] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:55.530593 10165 leader_election.cc:290] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:55.543591 10273 log.cc:927] Time spent T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.441s	user 0.002s	sys 0.009s
I20260709 13:00:55.468516  9722 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:55.545071  9722 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:55.547339  9722 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:55.549232  1656 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:55.557870  1505 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:55.558782  2269 leader_election.cc:400] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 19 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for earlier term 19. Current term is 20.
I20260709 13:00:55.561218  2301 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:00:55.561959  2298 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 32 FOLLOWER]: Advancing to term 33
I20260709 13:00:55.562450 10253 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:55.563104 10090 raft_consensus.cc:493] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:55.563609 10090 raft_consensus.cc:515] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:55.485867 10166 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.569792  2298 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 33.
W20260709 13:00:55.559484  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 50137.4us
W20260709 13:00:55.571604  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 243407us
I20260709 13:00:55.574028  1508 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:55.577498  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:55.577816  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:55.579696  1508 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:55.582266  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:55.578564  1611 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 25.
W20260709 13:00:55.574072  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 51399.4us
I20260709 13:00:55.553798 10200 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:55.591046  1583 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:55.567174 10213 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 33 FOLLOWER]: Leader election won for term 33
I20260709 13:00:55.570098 10250 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:00:55.595330  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:55.607044  1508 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:55.607617  1690 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 25.
I20260709 13:00:55.564118 10255 consensus_queue.cc:1048] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.028s
I20260709 13:00:55.587322 10165 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:55.611244  1508 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:55.587670 10088 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:00:55.604175 10247 raft_consensus.cc:3060] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:00:55.563066 10253 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:55.580452 10166 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:55.662278 10166 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:55.612156 10095 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:00:55.589533 10091 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.044s
I20260709 13:00:55.646298 10289 raft_consensus.cc:2749] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:00:55.653714 10212 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:55.613160 10213 raft_consensus.cc:697] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 33 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:55.668912 10213 consensus_queue.cc:237] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 31.19, Last appended by leader: 19, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:55.670368 10000 leader_election.cc:290] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:55.656230 10288 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 30 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:55.673058 10288 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:55.607050 10200 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:55.677620 10200 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:55.633841 10081 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.678521 10081 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:55.675460 10288 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:55.589154 10246 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 13:00:55.689534  2269 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:55.666996 10090 leader_election.cc:290] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:55.729933  1685 raft_consensus.cc:1240] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:55.729501  9800 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:55.730007 10199 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:00:55.752426 10199 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:00:55.778437  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95abfe15f7d54f3fb0f01f162b262561" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:55.788024  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 196949us
I20260709 13:00:55.764809 10212 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.788983  1583 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:55.767876 10199 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:55.764935 10081 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:55.796571 10251 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:00:55.801602  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "499cf87d55ba434fa03c7cf6c1bb54c8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:55.736140  9800 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:55.811949  2296 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:00:55.814544  2294 raft_consensus.cc:1275] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:00:55.816418  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42248b4b3b744072a3581db8c3874c55" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:55.825181  2296 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 13:00:55.806851  1655 leader_election.cc:336] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:55.824627  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 218881us
I20260709 13:00:55.841890  1654 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:00:55.782393 10206 consensus_queue.cc:1059] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:00:55.807461 10162 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.831877  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:55.837699  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:55.811661 10081 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.862571  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:55.840875  1655 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:55.795194 10212 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:55.819983 10088 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 13:00:55.865449  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 58590.2us
I20260709 13:00:55.831776  9775 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:55.836833 10007 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:55.865600 10195 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:55.861675  9804 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.892911  9804 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:55.895203  9804 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:55.854506 10162 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:55.901656  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73b99964f4c4107aed2d05c6106b3b5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:55.902727 10162 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:55.868836 10081 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:55.910993 10081 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:55.912209  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:55.879072 10088 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:55.914461  9800 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:55.914783 10088 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:55.854492 10302 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:00:55.917169 10302 raft_consensus.cc:493] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.917558 10302 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:55.920715 10253 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:55.926424 10199 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:55.881212 10206 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.929417 10206 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:55.931818 10206 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:55.934650 10212 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:55.936085 10199 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:55.942513 10211 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:55.944319  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 353429us
I20260709 13:00:55.953787 10040 raft_consensus.cc:3055] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:00:55.954264 10040 raft_consensus.cc:740] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:55.955235 10040 consensus_queue.cc:260] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:00:55.966930  1655 leader_election.cc:336] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:55.978852  2267 consensus_peers.cc:597] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:56.008332  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:55.965946  1507 leader_election.cc:304] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
W20260709 13:00:56.015103  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 49221.1us
I20260709 13:00:56.007611  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:56.009199  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:56.011989  1655 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:55.969986  1508 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:56.038468  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 68542.3us
W20260709 13:00:56.038944  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 72008.9us
W20260709 13:00:56.040350  1655 leader_election.cc:336] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:56.041999  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:56.040997  1655 leader_election.cc:336] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:56.043475  1655 leader_election.cc:336] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:56.047348  1655 leader_election.cc:336] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:56.050434  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 28 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:56.051265  2267 consensus_peers.cc:597] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:56.053190  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:56.055704  2267 consensus_peers.cc:597] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:56.045648 10162 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:55.883144  9775 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:56.058140  1581 consensus_peers.cc:597] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:56.059197  2267 leader_election.cc:336] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:55.956440 10040 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:00:56.071543  1583 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:56.038053 10212 raft_consensus.cc:2749] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:00:56.079190  2296 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:56.079937  2296 raft_consensus.cc:2468] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 22.
I20260709 13:00:56.080577  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:56.081378  2294 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 25.
I20260709 13:00:56.082271 10292 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:00:56.054482 10298 log.cc:927] Time spent T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.132s	user 0.001s	sys 0.005s
I20260709 13:00:56.084846  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:56.069186  2267 leader_election.cc:336] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:56.085784  1508 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:56.085999  1656 leader_election.cc:304] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:56.054417 10294 log.cc:927] Time spent T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.088s	user 0.000s	sys 0.005s
I20260709 13:00:55.886865 10007 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:56.091164  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:56.101781  1615 raft_consensus.cc:1240] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Rejecting Update request from peer 1d6516ff61104bdda54bde95e92fe579 for earlier term 19. Current term is 20. Ops: []
I20260709 13:00:56.063763 10290 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.053138 10251 raft_consensus.cc:493] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:56.108417  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:56.123553  1617 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 22.
I20260709 13:00:56.045956 10164 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.058s
I20260709 13:00:55.965981 10214 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.103s
I20260709 13:00:56.115306  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
W20260709 13:00:56.064682 10306 log.cc:927] Time spent T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8: Append to log took a long time: real 0.138s	user 0.004s	sys 0.002s
I20260709 13:00:56.113776  2266 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:56.053088 10301 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:56.109894  1508 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:56.165324  1615 raft_consensus.cc:2393] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 25: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
W20260709 13:00:56.165980  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 52272us
W20260709 13:00:56.114598  1581 consensus_peers.cc:597] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:56.167760  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 53207.1us
W20260709 13:00:56.171089  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 61236.5us
I20260709 13:00:56.172170  1508 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:56.112464 10162 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.119566 10166 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.195389 10166 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:56.198272 10166 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:56.119423 10091 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:00:56.125957  9808 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.199653  9808 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:56.201721  9808 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:56.121625 10255 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:56.153728 10212 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:56.204418 10212 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:56.206646 10212 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:56.126457 10196 consensus_queue.cc:1048] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.081s
I20260709 13:00:56.211062  2298 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32794 (request call id 1249) took 1290 ms. Trace:
I20260709 13:00:56.179981 10131 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:56.128286 10290 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:56.214322 10290 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:56.105165 10253 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.084s
I20260709 13:00:56.149488 10251 raft_consensus.cc:515] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:56.218353 10251 leader_election.cc:290] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:56.186523 10213 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:00:56.223042  1428 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.495s	user 0.000s	sys 0.013s
W20260709 13:00:56.223088   431 thread.cc:527] Waited for 5000ms trying to join with heartbeat (tid 1567)
I20260709 13:00:56.229352  2266 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:56.190675  9775 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:56.192770 10007 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:56.190474 10095 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:56.232560  2298 rpcz_store.cc:276] 0709 13:00:54.920977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.921115 (+   138us) service_pool.cc:224] Handling call
0709 13:00:56.210837 (+1289722us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b54002d82d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d0552fa 00007fc862016b17 00007fc85b5916d4 00007fc85b591662 00007fc85b591591 00007fc85b59150c 00007fc85b5907c2 00007fc85b38c48c 00007fc85b38b8c6 00007fc85b38b26f
0709 13:00:56.210965 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1470838656}
W20260709 13:00:56.244964  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 146937us
I20260709 13:00:56.230819  2266 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 13:00:56.245910  1581 consensus_peers.cc:597] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:56.250946  1581 consensus_peers.cc:597] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:56.255774  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:56.263139  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:56.264468  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:56.261444  1581 consensus_peers.cc:597] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:56.265923  2294 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 33 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 31 index: 19. Preceding OpId from leader: term: 33 index: 20. (index mismatch)
I20260709 13:00:56.270520  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:56.273351  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:56.248378 10131 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:56.248323 10287 raft_consensus.cc:493] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
W20260709 13:00:56.272562  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 196939us
W20260709 13:00:56.274884  1581 consensus_peers.cc:597] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:56.271632 10201 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:00:56.245000 10162 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:56.275434 10314 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:00:56.302740 10201 raft_consensus.cc:493] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.330163  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:56.331580  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:56.284832 10212 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.038s
W20260709 13:00:56.337186  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 164998us
I20260709 13:00:56.288059 10287 raft_consensus.cc:515] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:56.329273 10201 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:56.343214 10301 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:56.343894 10301 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:56.346192 10301 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:56.320926 10314 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:56.349552 10323 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:56.350178 10323 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:56.353852  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:56.356753  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:56.358855 10302 raft_consensus.cc:515] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:56.359942  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:56.365823  1581 consensus_peers.cc:597] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:56.364800 10166 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.367069 10166 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:56.369074  2266 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 63345.2us
I20260709 13:00:56.371068  1508 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:56.372550  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:56.377422 10166 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:00:56.378912  1581 leader_election.cc:336] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:56.375387 10214 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:00:56.380862  1581 leader_election.cc:336] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:56.382153  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:56.397415  1689 raft_consensus.cc:2368] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for earlier term 25. Current term is 26.
I20260709 13:00:56.398940  1508 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:56.403533  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 30 candidate_status { last_received { term: 29 index: 20 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:56.374542 10323 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:00:56.406119  1583 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:56.380050 10287 leader_election.cc:290] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:56.391656 10214 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.420632  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:56.415720  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:56.430822  2300 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "147199196d114d4c90fd8fba442ab7d8" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:56.428306  2303 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 24.
I20260709 13:00:56.435952  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:56.405257 10212 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:56.412173 10184 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:00:56.446250  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 133918us
I20260709 13:00:56.447570 10327 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:56.463133 10327 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:56.465466 10327 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:56.482920  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:56.434837 10214 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:56.495021 10314 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:56.495841 10302 leader_election.cc:290] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 26 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:56.503141  1691 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 28 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 28 index: 19. (term mismatch)
I20260709 13:00:56.503604  1691 pending_rounds.cc:85] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 18
I20260709 13:00:56.503818  1691 pending_rounds.cc:107] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 26.19
I20260709 13:00:56.504055  1691 raft_consensus.cc:2889] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:56.507145 10214 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:56.508916  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:56.472404 10327 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.479218 10246 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:56.493976 10247 consensus_meta.cc:287] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Time spent flushing consensus metadata: real 0.836s	user 0.012s	sys 0.000s
I20260709 13:00:56.520020  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c62b87395ba4c3a9a99163b300d7ddf" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:56.520716  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:56.523034  2299 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:56.490456 10212 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.485864 10162 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:56.529429  1508 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:56.539697  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:56.546849  1508 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:56.543423 10214 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:56.551025  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:56.552647  1581 leader_election.cc:336] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:56.558179  1428 maintenance_manager.cc:643] P 633384cf034a459c9c7300ebf04605f6: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 1.629s	user 0.044s	sys 0.025s Metrics: {"bytes_written":9278,"delete_count":0,"lbm_write_time_us":1291,"lbm_writes_lt_1ms":7,"reinsert_count":0,"spinlock_wait_cycles":46955264,"thread_start_us":107139,"threads_started":1,"update_count":343,"wal-append.queue_time_us":315088}
I20260709 13:00:56.570793 10314 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:00:56.573478  1429 maintenance_manager.cc:419] P 633384cf034a459c9c7300ebf04605f6: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.403989
I20260709 13:00:56.580874  2269 leader_election.cc:400] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 election: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for earlier term 25. Current term is 26.
I20260709 13:00:56.582011  2269 leader_election.cc:403] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260709 13:00:56.524422 10247 raft_consensus.cc:2749] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:56.588819  2299 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 26.
I20260709 13:00:56.593225  9804 raft_consensus.cc:2749] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275) with higher term. Message: Invalid argument: T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 for earlier term 25. Current term is 26.
I20260709 13:00:56.595395  1656 leader_election.cc:304] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:00:56.595173  2269 leader_election.cc:304] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:56.545595 10088 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:56.585520 10214 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:56.524101 10246 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:56.521842 10327 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:56.610935  1582 leader_election.cc:304] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:56.576205 10212 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:56.598191 10268 raft_consensus.cc:2749] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:56.602967 10090 raft_consensus.cc:2804] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:00:56.641645  1582 leader_election.cc:304] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:56.643023  1582 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:00:56.630265 10040 consensus_meta.cc:287] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579: Time spent flushing consensus metadata: real 0.543s	user 0.003s	sys 0.008s
I20260709 13:00:56.651023  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:56.600383 10088 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:56.653478  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:56.627844 10201 raft_consensus.cc:515] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:56.660672  2298 raft_consensus.cc:1240] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Rejecting Update request from peer 4487a53c51be4634bf1ef29c5248353d for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 13:00:56.661993 10290 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:00:56.679507  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:56.647950 10090 raft_consensus.cc:697] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 26 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:56.680630  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:56.676620  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2eccdddaa724fed8954f5e5bc110b80" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:56.684405  1613 raft_consensus.cc:3060] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:00:56.646407 10238 raft_consensus.cc:2749] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:00:56.685526 10337 log.cc:927] Time spent T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:00:56.680332  1608 raft_consensus.cc:1275] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:00:56.688644  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:56.674127  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:56.677104  1610 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:00:56.671439 10201 leader_election.cc:290] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:56.683531 10090 consensus_queue.cc:237] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:56.679620  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 28 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:56.678344  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:56.676187  1617 raft_consensus.cc:1275] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:00:56.701297  1691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:56.674554  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdff63e2a2e94c729942046ee2f02a09" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:56.671234  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:56.710166  1613 raft_consensus.cc:2468] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 26.
I20260709 13:00:56.648864 10299 raft_consensus.cc:2749] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:00:56.681586 10290 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.721856  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:56.720760  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 64996.7us
I20260709 13:00:56.723889  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:00:56.679433 10246 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:56.677088 10212 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:56.725989  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:56.697898 10088 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:56.678476 10327 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:56.728101  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:56.728667  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0a8a9b410b84b569aa1245ad95bb229" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:56.721776 10290 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:56.728552  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:56.740806  1654 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:56.740896  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:56.745030  1505 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:56.748502  1614 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 33 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 31 index: 19. Preceding OpId from leader: term: 33 index: 20. (index mismatch)
W20260709 13:00:56.748059  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 83604.8us
I20260709 13:00:56.751832  1654 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:56.754817  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:56.762637  2303 raft_consensus.cc:1275] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 28 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 13:00:56.763810  2295 raft_consensus.cc:1275] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:00:56.765962  1582 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:56.768550  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:56.768921  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:56.719421 10172 consensus_queue.cc:1059] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 13:00:56.771660  1505 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:56.773207  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:56.776366  1505 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:56.767870 10106 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:56.774842 10322 consensus_queue.cc:1048] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.005s
I20260709 13:00:56.778321 10289 consensus_queue.cc:1048] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:00:56.767621 10324 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 13:00:56.783164 10085 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:00:56.774968 10212 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:56.760090  9722 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:56.776059  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db011c2c8016405d968fe57a093fc111" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:56.800521  1614 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:56.804768 10081 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.805470 10081 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:56.807821 10081 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:56.807771 10085 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.821686 10085 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:56.816829 10172 raft_consensus.cc:3055] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:00:56.824117 10172 raft_consensus.cc:740] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:56.825124 10172 consensus_queue.cc:260] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:56.826407 10172 raft_consensus.cc:3060] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:00:56.841168  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:56.847064  2301 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 24.
W20260709 13:00:56.847585  1435 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54606 (request call id 315) took 18690 ms (client timeout 15000 ms). Trace:
I20260709 13:00:56.847326  1436 catalog_manager.cc:5697] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 16 to 18, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 18 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:56.849711  1436 catalog_manager.cc:5697] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 20 to 22, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 22 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:56.852711 10332 log.cc:927] Time spent T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.053s	user 0.000s	sys 0.002s
I20260709 13:00:56.852026  1436 catalog_manager.cc:5697] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:56.854136  1436 catalog_manager.cc:5697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 20 to 23, leader changed from 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 23 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:56.855778  1436 catalog_manager.cc:5697] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:56.857267  1436 catalog_manager.cc:5697] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 15 to 16, leader changed from 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 16 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 13:00:56.861965  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 96314.9us
W20260709 13:00:56.866466  2267 consensus_peers.cc:597] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:56.869215  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 92886us
I20260709 13:00:56.873206 10073 consensus_queue.cc:1048] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:56.874621 10088 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:00:56.878974  2267 consensus_peers.cc:597] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:56.879670  2267 consensus_peers.cc:597] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:56.882655  1614 raft_consensus.cc:2468] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 23.
I20260709 13:00:56.887813  1505 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:56.889115  1505 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:56.855134 10340 log.cc:927] Time spent T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.002s
I20260709 13:00:56.886947  1507 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 
I20260709 13:00:56.883632  1654 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:56.892411  1505 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:56.893885  1505 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:56.892259 10246 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:56.895589 10081 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:00:56.896109 10081 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.896507 10081 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:56.892318 10166 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:56.892494  9722 consensus_queue.cc:1048] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.009s
I20260709 13:00:56.902469 10085 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:56.902756 10162 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:56.902271  9722 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:56.904587  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:56.911001  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:56.848033  1435 rpcz_store.cc:269] 0709 13:00:38.157056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.157257 (+   201us) service_pool.cc:224] Handling call
0709 13:00:56.847501 (+18690244us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:49.198199 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:49.317172 (+118973us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:49.317239 (+    67us) write_op.cc:435] Acquired schema lock
0709 13:00:49.317259 (+    20us) tablet.cc:662] Decoding operations
0709 13:00:50.192451 (+875192us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:50.261861 (+ 69410us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:50.268451 (+  6590us) tablet.cc:685] Acquiring locks for 24 operations
0709 13:00:50.854790 (+586339us) tablet.cc:701] Row locks acquired
0709 13:00:50.870561 (+ 15771us) write_op.cc:260] PREPARE: finished
0709 13:00:50.870823 (+   262us) write_op.cc:270] Start()
0709 13:00:50.870993 (+   170us) write_op.cc:276] Timestamp: P: 1783602050870733 usec, L: 0
0709 13:00:50.871033 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:00:50.871842 (+   809us) log.cc:844] Serialized 9407 byte log entry
0709 13:00:51.549855 (+678013us) op_driver.cc:464] REPLICATION: finished
0709 13:00:51.947484 (+397629us) write_op.cc:301] APPLY: starting
0709 13:00:51.954305 (+  6821us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:52.581179 (+626874us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:52.581314 (+   135us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:53.307518 (+726204us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:53.307946 (+   428us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=0,mrs_lookups=0
0709 13:00:53.308005 (+    59us) write_op.cc:312] APPLY: finished
0709 13:00:53.401704 (+ 93699us) log.cc:844] Serialized 212 byte log entry
0709 13:00:53.806113 (+404409us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:53.817555 (+ 11442us) write_op.cc:454] Released schema lock
0709 13:00:53.871265 (+ 53710us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:54.515725 (+644460us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b54001b9828. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc86340d9e1 00007fc86340c64c 00007fc860a9d3fd 00007fc860a89389 00007fc860a88b53 00007fc860a8cd61 00007fc860a8cd19 00007fc860a8cca9 00007fc860a8cc71 00007fc860a8be9d 000000000038f354
0709 13:00:54.516254 (+   529us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:54.516287 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1053106,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":317459,"apply.run_cpu_time_us":100062,"apply.run_wall_time_us":2615306,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104495,"num_ops":24,"prepare.queue_time_us":214563,"prepare.run_cpu_time_us":22597,"prepare.run_wall_time_us":1946909,"raft.queue_time_us":170111,"raft.run_cpu_time_us":37336,"raft.run_wall_time_us":241393,"replication_time_us":659239,"spinlock_wait_cycles":7930624,"thread_start_us":863360,"threads_started":5,"wal-append.queue_time_us":691100,"wal-append.run_cpu_time_us":60398,"wal-append.run_wall_time_us":2363111}]]}
I20260709 13:00:56.924144  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:56.926872  1505 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:56.931185  2266 leader_election.cc:304] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:56.859897  1436 catalog_manager.cc:5697] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 24 to 26, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193), now has a pending config: VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193), VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194), VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195), VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 26 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } } pending_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:56.942224  1505 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:56.916368 10212 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:56.951452  1436 catalog_manager.cc:5697] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 9 to 12, leader changed from 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:56.945883 10085 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:56.954749  1507 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
W20260709 13:00:56.971815  1581 consensus_peers.cc:597] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:56.977411  1505 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:56.947717 10330 raft_consensus.cc:2804] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:00:56.981566  1436 catalog_manager.cc:5697] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 17 to 22. New cstate: current_term: 22 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:56.950256 10162 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.031s
I20260709 13:00:56.989480  1436 catalog_manager.cc:5697] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 19 to 21, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 21 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:56.991394  1436 catalog_manager.cc:5697] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:56.993753  1436 catalog_manager.cc:5697] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 17 to 21, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 21 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 13:00:57.002331  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40880327f92147c1936b74eee0e6724d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:57.003803 10091 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.004352 10091 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:57.004729  9808 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:57.006645 10091 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:57.009219  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:56.999136 10330 raft_consensus.cc:697] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 23 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:00:57.012002 10330 consensus_queue.cc:237] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:57.012889 10081 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:57.015192 10081 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:56.980850 10164 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:57.023727  1436 catalog_manager.cc:5697] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:57.023129 10095 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:00:57.057139  1655 leader_election.cc:336] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:57.057957  1655 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:57.059128  1505 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:57.060058  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 105347us
I20260709 13:00:57.061111  1436 catalog_manager.cc:5697] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:57.064960  1655 leader_election.cc:336] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:57.065438  1655 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:57.067046  1617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:57.070431  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:57.071071  2299 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:00:57.078625  1505 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:57.079974 10091 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 13:00:57.077562  1436 catalog_manager.cc:5697] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 20 to 22, leader changed from 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 22 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:57.081507  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:57.069722 10247 raft_consensus.cc:493] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.073645 10073 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:57.069542  9722 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:00:57.052737 10290 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:57.080549 10095 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:00:57.109071  2299 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in term 25.
I20260709 13:00:57.111294  1507 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:57.116590  1613 raft_consensus.cc:2393] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in current term 25: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:00:57.134562 10290 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:57.115927 10081 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:00:57.098577 10247 raft_consensus.cc:515] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:57.140442 10327 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.169808  2303 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:00:57.170861 10247 leader_election.cc:290] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:57.179491  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:57.149446 10081 raft_consensus.cc:697] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 LEADER]: Becoming Leader. State: Replica: dbe6a89d0e1c4137b3a1b17bf4b520d8, State: Running, Role: LEADER
I20260709 13:00:57.181668 10327 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:57.224545   431 thread.cc:527] Waited for 6000ms trying to join with heartbeat (tid 1567)
W20260709 13:00:57.242539  2267 consensus_peers.cc:597] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:57.247453  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:57.248407  2303 raft_consensus.cc:2393] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate c262eac7fc904ae9bb91e450f6532e3f in current term 25: Already voted for candidate dbe6a89d0e1c4137b3a1b17bf4b520d8 in this term.
I20260709 13:00:57.207841 10081 consensus_queue.cc:237] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:57.190769 10288 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.064s
W20260709 13:00:57.273898 10350 log.cc:927] Time spent T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:00:57.280654  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:57.281776 10200 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.279670 10327 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:57.288130 10213 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.294242 10213 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:57.295872 10200 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:57.298250 10200 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:57.298889  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:57.300958  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:57.301873  2303 raft_consensus.cc:2410] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 21 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:00:57.301605 10213 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:57.392424  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5981b12945c4d5b8d59d139eb1c77a2" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:57.393940  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "920d24d01316479692fb62f167beb41e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:57.400810  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e84698abe8e46788d46c9bf8a4c74c7" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:57.404740  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:57.405429  1609 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 20.
I20260709 13:00:57.406607  1616 raft_consensus.cc:1275] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:00:57.511499 10164 raft_consensus.cc:493] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.513499 10164 raft_consensus.cc:515] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:57.514833 10081 raft_consensus.cc:493] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.515806 10081 raft_consensus.cc:515] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:57.528674 10213 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.529726 10213 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:57.576560  9775 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:57.577664  9775 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:57.581797  9775 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:57.588135  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:57.600288  1682 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 16. (term mismatch)
I20260709 13:00:57.602214  1682 pending_rounds.cc:85] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d: Aborting all ops after (but not including) 15
I20260709 13:00:57.605082  1682 pending_rounds.cc:107] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d: Aborting uncommitted NO_OP operation due to leader change: 22.16
I20260709 13:00:57.605487  1682 raft_consensus.cc:2889] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:57.609357 10213 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:57.610669 10081 leader_election.cc:290] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:57.617442 10256 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:00:57.606328  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 60226.5us
W20260709 13:00:57.634315  2267 consensus_peers.cc:597] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:57.636938  1654 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:57.618338  1505 leader_election.cc:304] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:57.662489 10164 leader_election.cc:290] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:57.663305  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:57.664716  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 46641.7us
I20260709 13:00:57.664791 10164 raft_consensus.cc:2749] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:00:57.666018  1505 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:57.666914 10302 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:00:57.667444 10302 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.667927 10302 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:57.677249  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:57.688686  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 52178.2us
I20260709 13:00:57.687702 10164 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:00:57.688542  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:57.692865 10288 consensus_queue.cc:1048] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.003s
I20260709 13:00:57.707018  1505 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:57.708469 10081 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:57.692905  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:57.732389  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6578815705874ccfb147b36c5f6db70a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:57.734421  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db702b262c1644109366a56f6f0d805a" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:57.735937  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:57.739794  1655 consensus_peers.cc:597] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:57.748291  9804 raft_consensus.cc:493] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.749161  9804 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:57.752058  9804 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:57.760506  1505 leader_election.cc:304] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:57.765723  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9324141fa1ba48aca59e97123ca5742e" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:57.768980  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:57.771178  1614 raft_consensus.cc:1275] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:00:57.773466 10302 raft_consensus.cc:515] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:57.774729  1689 raft_consensus.cc:2393] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 21: Already voted for candidate 4487a53c51be4634bf1ef29c5248353d in this term.
I20260709 13:00:57.785382  1505 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:57.788960  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:57.789849  1616 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 20.
I20260709 13:00:57.789928 10095 raft_consensus.cc:2749] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:57.791802 10081 raft_consensus.cc:2749] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:00:57.806559  1616 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
W20260709 13:00:57.810914  1655 consensus_peers.cc:597] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:57.813947  1508 leader_election.cc:304] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:57.818939 10164 raft_consensus.cc:2749] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:00:57.823925 10164 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:00:57.824878  1507 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:57.825971 10164 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:57.830660  2299 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Refusing update from remote peer dbe6a89d0e1c4137b3a1b17bf4b520d8: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
W20260709 13:00:57.837309  1581 leader_election.cc:336] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:57.837908  1581 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:00:57.838893 10358 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:00:57.842674  1581 consensus_peers.cc:597] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:57.843869  1581 consensus_peers.cc:597] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:57.845798 10302 leader_election.cc:290] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:57.846395  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:00:57.846992  2299 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:00:57.851548  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97c958beecec40918b63217135840ff6" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:00:57.852314  1611 raft_consensus.cc:3060] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:00:57.859262  1581 consensus_peers.cc:597] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:57.859952 10095 raft_consensus.cc:493] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.881108 10095 raft_consensus.cc:515] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:57.883883 10095 leader_election.cc:290] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:57.887130  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:57.905656  1611 raft_consensus.cc:2468] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 21.
I20260709 13:00:57.921826 10081 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:00:57.924839  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f1367cef67f42eab84cbda659b7ffb1" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:57.936357  2299 raft_consensus.cc:2410] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 4487a53c51be4634bf1ef29c5248353d for term 21 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:00:57.946302 10212 raft_consensus.cc:493] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.947108 10212 raft_consensus.cc:515] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:57.953384  1507 leader_election.cc:304] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:57.955655 10353 raft_consensus.cc:2749] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:00:57.958352  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:57.958595 10212 leader_election.cc:290] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:57.965655  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "105edc3ce5964519acbd96dbaa975697" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:57.967314  1654 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579
I20260709 13:00:57.969161 10302 raft_consensus.cc:2804] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:00:57.969801 10302 raft_consensus.cc:697] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 21 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:00:57.971881  1507 leader_election.cc:304] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:57.970976 10302 consensus_queue.cc:237] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:57.975054 10164 raft_consensus.cc:2749] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:57.986213 10256 consensus_queue.cc:1048] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:00:57.980405  1437 catalog_manager.cc:5697] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:57.988257  2266 leader_election.cc:304] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:57.988709  1437 catalog_manager.cc:5697] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 13:00:57.994275 10256 raft_consensus.cc:2764] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:00:57.995568 10095 raft_consensus.cc:493] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.996259 10095 raft_consensus.cc:515] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:57.994918  1437 catalog_manager.cc:5697] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 13 to 17, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 17 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 13:00:58.000138  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:58.001020  1437 catalog_manager.cc:5697] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 17 to 22, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 22 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 13:00:58.002656  1437 catalog_manager.cc:5697] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 22 to 25, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 25 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:58.005350 10212 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.010285 10212 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:58.012437  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7bc646e9bf4d2e9952c8b5d4a5be14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:58.005232 10095 leader_election.cc:290] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:58.018922 10212 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:58.021245  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:58.022555  1436 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38804 (request call id 194) took 20608 ms (client timeout 15000 ms). Trace:
I20260709 13:00:58.023099  1507 leader_election.cc:304] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:58.029412 10212 raft_consensus.cc:2749] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:00:58.025624  1581 consensus_peers.cc:597] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:00:58.030413  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:58.033927  1581 consensus_peers.cc:597] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:58.037165  1437 catalog_manager.cc:5697] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 26 to 27, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 27 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:58.045432  1505 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:58.046207  1437 catalog_manager.cc:5697] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:58.048324  1437 catalog_manager.cc:5697] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 18 to 19, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 19 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:58.052783  1437 catalog_manager.cc:5697] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 17 to 23, leader changed from 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 23 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:58.054221 10212 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:00:58.024636  1436 rpcz_store.cc:269] 0709 13:00:37.414232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:37.414460 (+   228us) service_pool.cc:224] Handling call
0709 13:00:37.934528 (+520068us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b5400210610. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2d0b2 00007fc862ea6a89 00007fc862e3eda6 00007fc862e10088 00007fc862f0e37e 00007fc8613cf2a4 00007fc8613cf232 00007fc8613cf161 00007fc8613cf0dc
0709 13:00:58.022286 (+20087758us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:57.405587 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:57.406284 (+   697us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:57.406316 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:00:57.406335 (+    19us) tablet.cc:662] Decoding operations
0709 13:00:57.407737 (+  1402us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:57.407831 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:57.407861 (+    30us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:00:57.417709 (+  9848us) tablet.cc:701] Row locks acquired
0709 13:00:57.417737 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:00:57.417899 (+   162us) write_op.cc:270] Start()
0709 13:00:57.418032 (+   133us) write_op.cc:276] Timestamp: P: 1783602057417850 usec, L: 0
0709 13:00:57.418063 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:00:57.555632 (+137569us) log.cc:844] Serialized 6272 byte log entry
0709 13:00:57.680153 (+124521us) op_driver.cc:464] REPLICATION: finished
0709 13:00:57.698905 (+ 18752us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54001b99d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfba571 00007fc85d04ce28 00007fc860a87581 00007fc860a86d58 00007fc860a8b9f1 00007fc860a8b9a9 00007fc860a8b939 00007fc860a8b901 00007fc860a8ab2d 000000000038f354 000000000038f199
0709 13:00:57.762417 (+ 63512us) write_op.cc:301] APPLY: starting
0709 13:00:57.762553 (+   136us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:57.809837 (+ 47284us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:57.809875 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:57.834321 (+ 24446us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:57.834805 (+   484us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:00:57.834868 (+    63us) write_op.cc:312] APPLY: finished
0709 13:00:57.835343 (+   475us) log.cc:844] Serialized 139 byte log entry
0709 13:00:57.835550 (+   207us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:57.841034 (+  5484us) write_op.cc:454] Released schema lock
0709 13:00:57.841127 (+    93us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:57.869622 (+ 28495us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:57.890616 (+ 20994us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1108800,"reported_tablets":36,"spinlock_wait_cycles":45489920,"child_traces":[["op",{"apply.queue_time_us":81881,"apply.run_cpu_time_us":21903,"apply.run_wall_time_us":96482,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66857,"num_ops":15,"prepare.queue_time_us":143845,"prepare.run_cpu_time_us":13520,"prepare.run_wall_time_us":293576,"raft.queue_time_us":56779,"raft.run_cpu_time_us":11665,"raft.run_wall_time_us":45871,"replication_time_us":261812,"spinlock_wait_cycles":294034816,"thread_start_us":291344,"threads_started":4,"wal-append.queue_time_us":38917}]]}
I20260709 13:00:58.071229  1437 catalog_manager.cc:5697] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:58.090540  1437 catalog_manager.cc:5697] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index 16 to 19, term changed from 26 to 29, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193), VOTER c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194), VOTER 4487a53c51be4634bf1ef29c5248353d (127.0.107.195), VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 29 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 13:00:58.093683  1581 consensus_peers.cc:597] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:58.095391  1437 catalog_manager.cc:5697] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 13:00:58.098528  1437 catalog_manager.cc:5697] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 20 to 24, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 24 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:58.117967  1437 catalog_manager.cc:5697] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 22 to 23, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 23 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 13:00:58.120970  1437 catalog_manager.cc:5697] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 15 to 19, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 19 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:58.129233  1437 catalog_manager.cc:5697] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 25 to 27, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 27 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 13:00:58.137281  1437 catalog_manager.cc:5697] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index 15 to 19, term changed from 21 to 22, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:58.145104  1437 catalog_manager.cc:5697] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:58.147096  1437 catalog_manager.cc:5697] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 28 to 30, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 30 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
W20260709 13:00:58.159258  1488 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:58.159756  1488 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:58.160032  1488 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:58.165815  1437 catalog_manager.cc:5697] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 19 to 24, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 24 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 13:00:58.176925  1437 catalog_manager.cc:5697] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
W20260709 13:00:58.179076  1488 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:58.188979  1488 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:58.189350  1488 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:00:58.179647  1655 consensus_peers.cc:597] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:58.180226  1581 consensus_peers.cc:597] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:58.195199  1581 consensus_peers.cc:597] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:58.196784  1437 catalog_manager.cc:5697] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 20 to 24. New cstate: current_term: 24 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:58.208333  1437 catalog_manager.cc:5697] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 13:00:58.212843  1437 catalog_manager.cc:5697] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 13 to 19, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 19 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:58.214993  1437 catalog_manager.cc:5697] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 19 to 22, leader changed from 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 22 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:58.217000  1437 catalog_manager.cc:5697] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:58.218629  1437 catalog_manager.cc:5697] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 19 to 24. New cstate: current_term: 24 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:58.219950  1437 catalog_manager.cc:5697] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 23 to 25, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 25 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 13:00:58.221328  1437 catalog_manager.cc:5697] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 22 to 24, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 24 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 13:00:58.222642  1437 catalog_manager.cc:5697] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 23 to 24, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 24 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 13:00:58.225201   431 thread.cc:527] Waited for 7000ms trying to join with heartbeat (tid 1567)
I20260709 13:00:58.224794  1437 catalog_manager.cc:5697] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 20 to 24, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 24 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
W20260709 13:00:58.226012  2267 consensus_peers.cc:597] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:58.226202  1437 catalog_manager.cc:5697] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 20 to 23, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 23 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
W20260709 13:00:58.238583  2267 consensus_peers.cc:597] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:00:58.240191  1437 catalog_manager.cc:5697] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 22 to 23, leader changed from 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 23 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:58.241961  1437 catalog_manager.cc:5697] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 13:00:58.243487  1437 catalog_manager.cc:5697] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:58.244879  1437 catalog_manager.cc:5697] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 19 to 20, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 20 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 13:00:58.246636  1437 catalog_manager.cc:5697] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 20 to 24, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 24 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
I20260709 13:00:58.247990  1437 catalog_manager.cc:5697] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:58.249670  1437 catalog_manager.cc:5697] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 25 to 26, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 26 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } }
W20260709 13:00:58.276181  2267 consensus_peers.cc:597] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:58.277021  2267 consensus_peers.cc:597] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:00:58.278110  1428 maintenance_manager.cc:643] P 633384cf034a459c9c7300ebf04605f6: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 1.704s	user 0.109s	sys 0.038s Metrics: {"cfile_cache_miss":8,"cfile_cache_miss_bytes":29686,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":8036,"dirs.run_cpu_time_us":720,"dirs.run_wall_time_us":1481,"lbm_read_time_us":7629,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":23,"lbm_write_time_us":14506,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":10,"peak_mem_usage":588266,"reinsert_count":0,"thread_start_us":12674,"threads_started":1,"update_count":343}
W20260709 13:00:58.369421  2267 consensus_peers.cc:597] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:00:58.379073 10081 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.379827 10081 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:58.383435  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:58.385087  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1b65240a814ade9a4dff9820c94dd0" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:58.386849  1505 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:58.391407 10212 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:58.394508 10081 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:58.423123  2294 raft_consensus.cc:1275] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 13:00:58.423532  2294 pending_rounds.cc:85] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579: Aborting all ops after (but not including) 15
I20260709 13:00:58.423771  2294 pending_rounds.cc:107] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260709 13:00:58.424005  2294 raft_consensus.cc:2889] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:58.425786 10288 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:00:58.510784  1581 consensus_peers.cc:597] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:00:58.511507  1616 raft_consensus.cc:1275] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:00:58.513113 10302 consensus_queue.cc:1048] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:00:58.558364  2267 consensus_peers.cc:597] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:58.585206  2267 consensus_peers.cc:597] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:00:58.601469  1434 catalog_manager.cc:5697] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 22 to 24, leader changed from 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 24 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:58.604192  1434 catalog_manager.cc:5697] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 15 to 17, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 17 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:58.615675  1434 catalog_manager.cc:5697] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 14 to 20, leader changed from 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 20 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:58.618834  1434 catalog_manager.cc:5697] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:58.613437  1437 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54606 (request call id 316) took 1828 ms. Trace:
I20260709 13:00:58.623143  1437 rpcz_store.cc:276] 0709 13:00:56.785413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.785683 (+   270us) service_pool.cc:224] Handling call
0709 13:00:56.906703 (+121020us) spinlock_profiling.cc:243] Waited 5.69 ms on lock 0x7b54001b99d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfbb090 00007fc85d059f3a 00007fc862e101cc 00007fc862f0e37e 00007fc8613cf2a4 00007fc8613cf232 00007fc8613cf161 00007fc8613cf0dc 00007fc8613ce392 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:58.613348 (+1706645us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:58.314990 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:58.316976 (+  1986us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:58.317026 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:00:58.317046 (+    20us) tablet.cc:662] Decoding operations
0709 13:00:58.320238 (+  3192us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:58.320356 (+   118us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:58.320383 (+    27us) tablet.cc:685] Acquiring locks for 39 operations
0709 13:00:58.322569 (+  2186us) tablet.cc:701] Row locks acquired
0709 13:00:58.322616 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:00:58.322790 (+   174us) write_op.cc:270] Start()
0709 13:00:58.322920 (+   130us) write_op.cc:276] Timestamp: P: 1783602058322721 usec, L: 0
0709 13:00:58.322931 (+    11us) op_driver.cc:348] REPLICATION: starting
0709 13:00:58.323605 (+   674us) log.cc:844] Serialized 15314 byte log entry
0709 13:00:58.342806 (+ 19201us) op_driver.cc:464] REPLICATION: finished
0709 13:00:58.343175 (+   369us) write_op.cc:301] APPLY: starting
0709 13:00:58.343255 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:58.419947 (+ 76692us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:58.420055 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:58.522133 (+102078us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:58.522567 (+   434us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=78,key_file_lookups=78,delta_file_lookups=0,mrs_lookups=0
0709 13:00:58.522615 (+    48us) write_op.cc:312] APPLY: finished
0709 13:00:58.523257 (+   642us) log.cc:844] Serialized 332 byte log entry
0709 13:00:58.538172 (+ 14915us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:58.538481 (+   309us) write_op.cc:454] Released schema lock
0709 13:00:58.538558 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:58.538985 (+   427us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:58.539015 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":37026,"reported_tablets":48,"spinlock_wait_cycles":13086464,"child_traces":[["op",{"apply.queue_time_us":104,"apply.run_cpu_time_us":48456,"apply.run_wall_time_us":195769,"cfile_cache_hit":158,"cfile_cache_hit_bytes":167225,"cfile_init":1,"lbm_read_time_us":434,"lbm_reads_lt_1ms":4,"num_ops":39,"prepare.queue_time_us":35952,"prepare.run_cpu_time_us":7057,"prepare.run_wall_time_us":8941,"replication_time_us":19701,"thread_start_us":42239,"threads_started":1}]]}
I20260709 13:00:58.627321  1434 catalog_manager.cc:5697] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 17 to 24, leader changed from c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 24 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 13:00:58.697669  2267 consensus_peers.cc:597] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:00:58.705336 10213 raft_consensus.cc:493] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:58.730254  1581 consensus_peers.cc:597] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:00:58.736856 10081 raft_consensus.cc:493] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.737637 10081 raft_consensus.cc:515] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:58.747400  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:58.757694  1581 consensus_peers.cc:597] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:00:58.774478 10212 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:00:58.775290 10212 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:00:58.797437  1581 consensus_peers.cc:597] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:00:58.706004 10213 raft_consensus.cc:515] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:58.823956 10081 leader_election.cc:290] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:58.716311  1438 catalog_manager.cc:5697] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 28 to 31, leader changed from 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 31 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:58.834887  1434 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38804 (request call id 195) took 3988 ms. Trace:
I20260709 13:00:58.843391 10213 leader_election.cc:290] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:58.845518  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:58.847962  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3cb0f1c44ec45f38ff2f0c27480a08c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:58.852684  1581 consensus_peers.cc:597] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:00:58.854116  1438 catalog_manager.cc:5697] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 reported cstate change: term changed from 19 to 22, leader changed from 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 22 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:58.865499  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 226464us
I20260709 13:00:58.860411  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:58.867931  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 48651.5us
I20260709 13:00:58.837016  1434 rpcz_store.cc:276] 0709 13:00:54.846481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.852871 (+  6390us) service_pool.cc:224] Handling call
0709 13:00:58.834512 (+3981641us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:58.632836 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:58.637350 (+  4514us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:58.637399 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:00:58.637417 (+    18us) tablet.cc:662] Decoding operations
0709 13:00:58.638156 (+   739us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:58.638211 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:58.638242 (+    31us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:00:58.638844 (+   602us) tablet.cc:701] Row locks acquired
0709 13:00:58.638867 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:00:58.639027 (+   160us) write_op.cc:270] Start()
0709 13:00:58.639153 (+   126us) write_op.cc:276] Timestamp: P: 1783602058638975 usec, L: 0
0709 13:00:58.639176 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:00:58.639872 (+   696us) log.cc:844] Serialized 2069 byte log entry
0709 13:00:58.642013 (+  2141us) op_driver.cc:464] REPLICATION: finished
0709 13:00:58.642495 (+   482us) write_op.cc:301] APPLY: starting
0709 13:00:58.642577 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:58.645233 (+  2656us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:58.645345 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:58.648214 (+  2869us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:58.648405 (+   191us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 13:00:58.648446 (+    41us) write_op.cc:312] APPLY: finished
0709 13:00:58.648716 (+   270us) log.cc:844] Serialized 57 byte log entry
0709 13:00:58.656714 (+  7998us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:58.656827 (+   113us) write_op.cc:454] Released schema lock
0709 13:00:58.656881 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:58.657242 (+   361us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:58.657269 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":214562,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":255,"apply.run_cpu_time_us":6882,"apply.run_wall_time_us":14695,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20910,"num_ops":5,"prepare.queue_time_us":149,"prepare.run_cpu_time_us":3663,"prepare.run_wall_time_us":7800,"replication_time_us":2706}]]}
I20260709 13:00:58.866415  1508 leader_election.cc:304] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:58.877663 10213 raft_consensus.cc:493] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.878386 10213 raft_consensus.cc:515] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:58.882069 10212 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:58.882800 10212 raft_consensus.cc:2749] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:58.901204  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa984c8881704e97b0d6a6eb60605021" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:58.929468  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:58.934046 10389 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.934762 10389 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:58.910748 10213 leader_election.cc:290] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:58.944586  1507 leader_election.cc:304] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:58.940040 10389 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:58.967319  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbdf9662619648c4a3b76fbbda8d0e14" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:58.968523  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 102130us
I20260709 13:00:58.969177  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:00:58.971546  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 68318.1us
I20260709 13:00:58.980382  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b2051da69c4c7f8b35da07093dfc33" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:58.984297  1505 leader_election.cc:304] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:59.006289  1508 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:59.006407  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0507fcc8f9794c668a81d8519fc995be" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:59.003031 10388 raft_consensus.cc:2749] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:00:59.026885 10388 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:59.037118 10391 raft_consensus.cc:493] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:59.037905 10391 raft_consensus.cc:515] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:59.021806 10212 raft_consensus.cc:2749] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:59.040303 10391 leader_election.cc:290] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:59.061285  1507 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 66560.1us
I20260709 13:00:59.070322  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:00:59.073993  1508 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 67763.7us
I20260709 13:00:59.075718  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "940b60c7fb3744a68751996b8bb198ca" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:59.098701  2267 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 256 similar messages]
W20260709 13:00:59.102183  2267 consensus_peers.cc:597] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:00:59.109309  1508 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:59.108037  2295 consensus_queue.cc:237] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 29.20, Last appended by leader: 19, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:59.114370 10388 raft_consensus.cc:493] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:59.114583  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 85719.6us
I20260709 13:00:59.115247 10388 raft_consensus.cc:515] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:59.117686 10388 leader_election.cc:290] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:59.149976  1508 leader_election.cc:304] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:59.148976  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:59.158275  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35beb9f05ad84a8fb211d701469ddd6c" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:59.157575 10213 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:00:59.159847 10388 raft_consensus.cc:2749] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:59.184330  1508 leader_election.cc:304] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:59.187615 10081 raft_consensus.cc:2749] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:00:59.200862  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 99968.4us
W20260709 13:00:59.215574  1581 consensus_peers.cc:597] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:59.225695   431 thread.cc:527] Waited for 8000ms trying to join with heartbeat (tid 1567)
W20260709 13:00:59.237150  1656 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 201892us
I20260709 13:00:59.241825  1437 catalog_manager.cc:5697] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 25 to 28, leader changed from 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 28 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:59.243607  1437 catalog_manager.cc:5697] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:59.245584  1437 catalog_manager.cc:5697] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 22 to 23, leader changed from 4487a53c51be4634bf1ef29c5248353d (127.0.107.195) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 23 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:59.252854  1437 catalog_manager.cc:5697] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 16 to 21. New cstate: current_term: 21 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:59.256804  1581 consensus_peers.cc:597] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:59.260926  1581 consensus_peers.cc:597] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:00:59.291249  2267 consensus_peers.cc:597] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:00:59.295334  1616 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 29 index: 20. Preceding OpId from leader: term: 29 index: 21. (index mismatch)
I20260709 13:00:59.298112 10403 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
W20260709 13:00:59.321214  1581 consensus_peers.cc:597] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:00:59.321966  1581 consensus_peers.cc:597] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:00:59.327412 10330 raft_consensus.cc:2955] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [term 29 LEADER]: Committing config change with OpId 29.21: config changed from index 19 to 21, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:59.329809  1616 raft_consensus.cc:2955] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Committing config change with OpId 29.21: config changed from index 19 to 21, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:59.357445  1682 raft_consensus.cc:1275] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 29 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 29 index: 20. Preceding OpId from leader: term: 29 index: 21. (index mismatch)
I20260709 13:00:59.361689  1438 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54582 (request call id 322) took 11200 ms. Trace:
I20260709 13:00:59.362767 10403 consensus_queue.cc:1048] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260709 13:00:59.372373  1426 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9324141fa1ba48aca59e97123ca5742e with cas_config_opid_index 19: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:00:59.393155  1682 raft_consensus.cc:2955] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 29 FOLLOWER]: Committing config change with OpId 29.21: config changed from index 19 to 21, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:59.362154  1438 rpcz_store.cc:276] 0709 13:00:48.161525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:48.162194 (+   669us) service_pool.cc:224] Handling call
0709 13:00:48.489542 (+327348us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b54001b99d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfbb090 00007fc85d059f3a 00007fc862e101cc 00007fc862f0e37e 00007fc8613cf2a4 00007fc8613cf232 00007fc8613cf161 00007fc8613cf0dc 00007fc8613ce392 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:59.361569 (+10872027us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:58.909755 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:58.939288 (+ 29533us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:58.939333 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:00:58.939351 (+    18us) tablet.cc:662] Decoding operations
0709 13:00:58.939819 (+   468us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:58.939882 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:58.939910 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:00:58.940262 (+   352us) tablet.cc:701] Row locks acquired
0709 13:00:58.940282 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:00:58.940551 (+   269us) write_op.cc:270] Start()
0709 13:00:58.956218 (+ 15667us) write_op.cc:276] Timestamp: P: 1783602058940388 usec, L: 0
0709 13:00:58.957795 (+  1577us) op_driver.cc:348] REPLICATION: starting
0709 13:00:59.016092 (+ 58297us) log.cc:844] Serialized 919 byte log entry
0709 13:00:59.042968 (+ 26876us) op_driver.cc:464] REPLICATION: finished
0709 13:00:59.044245 (+  1277us) write_op.cc:301] APPLY: starting
0709 13:00:59.044345 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:59.069822 (+ 25477us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:59.069917 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:59.071303 (+  1386us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:59.071467 (+   164us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 13:00:59.071512 (+    45us) write_op.cc:312] APPLY: finished
0709 13:00:59.071719 (+   207us) log.cc:844] Serialized 33 byte log entry
0709 13:00:59.071897 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:59.071989 (+    92us) write_op.cc:454] Released schema lock
0709 13:00:59.072027 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:59.072384 (+   357us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:59.072412 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":23763,"reported_tablets":48,"spinlock_wait_cycles":5166464,"child_traces":[["op",{"apply.queue_time_us":986,"apply.run_cpu_time_us":4282,"apply.run_wall_time_us":28092,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8364,"num_ops":2,"prepare.queue_time_us":559,"prepare.run_cpu_time_us":3925,"prepare.run_wall_time_us":111515,"replication_time_us":85016}]]}
I20260709 13:00:59.410336 10401 raft_consensus.cc:493] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 1d6516ff61104bdda54bde95e92fe579)
I20260709 13:00:59.411106 10401 raft_consensus.cc:515] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:59.414381  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:59.418267 10401 leader_election.cc:290] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:59.423967 10390 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.424703 10390 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:59.427634  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba9da8e67563442eaf10dbb50de09eb5" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:59.428798  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:59.431529  1507 leader_election.cc:304] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
W20260709 13:00:59.432420  2267 consensus_peers.cc:597] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:00:59.434214 10390 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:59.435791 10401 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.441149 10081 raft_consensus.cc:2749] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:00:59.443982 10081 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.444651 10081 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:59.449954  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:59.452706 10081 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:59.457304  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc0adb56140a4e698e722f4960e13783" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:59.459709  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "677340b0a53f4ce8b314f9294bdaa546" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:59.473049  1505 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:59.474277  1505 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:59.475759 10388 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:00:59.475942 10213 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:00:59.436350 10401 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:59.491616  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:59.493090  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8fc263f1e8493db14b8c7a8e316a9f" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:59.494813  1507 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:59.497023   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:59.496037 10388 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:59.500376   431 tablet_replica.cc:333] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:00:59.503100   431 raft_consensus.cc:2243] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:59.503957   431 raft_consensus.cc:2272] T 677340b0a53f4ce8b314f9294bdaa546 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:59.491883 10401 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:00:59.504551  1581 consensus_peers.cc:597] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:00:59.507761   431 tablet_replica.cc:333] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:00:59.513523   431 raft_consensus.cc:2243] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:00:59.525055   431 raft_consensus.cc:2272] T 0ff814cc76e74038894b6ec316f8749f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:59.538754   431 tablet_replica.cc:333] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:00:59.525249  1438 catalog_manager.cc:5697] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index 19 to 21, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New cstate: current_term: 29 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:59.544170   431 raft_consensus.cc:2243] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:59.545076   431 pending_rounds.cc:70] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Trying to abort 1 pending ops.
I20260709 13:00:59.545440   431 pending_rounds.cc:77] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting op as it isn't in flight: id { term: 22 index: 13 } timestamp: 7305633981435404288 op_type: NO_OP noop_request { }
I20260709 13:00:59.545955   431 raft_consensus.cc:2889] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:00:59.546360   431 raft_consensus.cc:2272] T 8b1b65240a814ade9a4dff9820c94dd0 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:59.547497  1434 catalog_manager.cc:5697] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 31 to 33. New cstate: current_term: 33 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:59.549813  1434 catalog_manager.cc:5697] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 22 to 25. New cstate: current_term: 25 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:59.551465  1434 catalog_manager.cc:5697] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 21 to 25, leader changed from 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 25 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:59.559129  1434 catalog_manager.cc:5697] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 19 to 24, leader changed from 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 24 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:59.556243   431 tablet_replica.cc:333] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:00:59.570349   431 raft_consensus.cc:2243] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:59.571287   431 raft_consensus.cc:2272] T 940b60c7fb3744a68751996b8bb198ca P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:59.571709  1439 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54590 (request call id 312) took 13212 ms (client timeout 15000 ms). Trace:
W20260709 13:00:59.575228  1439 rpcz_store.cc:269] 0709 13:00:46.359360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.359543 (+   183us) service_pool.cc:224] Handling call
0709 13:00:46.999881 (+640338us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54001b99d4. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc85cfbb090 00007fc85d059f3a 00007fc862e101cc 00007fc862f0e37e 00007fc8613cf2a4 00007fc8613cf232 00007fc8613cf161 00007fc8613cf0dc 00007fc8613ce392 00007fc85b38c48c 00007fc85b38b8c6
0709 13:00:59.571529 (+12571648us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":434022,"reported_tablets":47,"spinlock_wait_cycles":351177600}
I20260709 13:00:59.561076  1434 catalog_manager.cc:5697] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 23 to 25, leader changed from 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 25 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:59.596807   431 tablet_replica.cc:333] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:00:59.598217   431 raft_consensus.cc:2243] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:59.609015   431 raft_consensus.cc:2272] T 40880327f92147c1936b74eee0e6724d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:59.616819 10401 raft_consensus.cc:493] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.617448 10401 raft_consensus.cc:515] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:00:59.619639 10401 leader_election.cc:290] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:00:59.621547  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:00:59.623458   431 tablet_replica.cc:333] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:00:59.624781   431 raft_consensus.cc:2243] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:59.627791   431 raft_consensus.cc:2272] T 5664f3181d5c4b20bb8443fb79030930 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:59.629575  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "398a6324f64f46b0accba6cac64dfec6" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:59.634835  1616 consensus_queue.cc:237] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:59.639032   431 tablet_replica.cc:333] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:00:59.645608  1508 leader_election.cc:304] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:00:59.646881 10401 raft_consensus.cc:2749] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:59.640260   431 raft_consensus.cc:2243] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:00:59.662171   431 raft_consensus.cc:2272] T 1a9d2e2602bd4118abc0a8629a67005c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:59.666637  1425 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 95455.9us
I20260709 13:00:59.583694  1434 catalog_manager.cc:5697] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:59.673357   431 tablet_replica.cc:333] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:00:59.675222  1434 catalog_manager.cc:5697] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 12 to 15, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 15 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:00:59.679185  1434 catalog_manager.cc:5697] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 20 to 21, leader changed from 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) to dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193). New cstate: current_term: 21 leader_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 13:00:59.675527  1425 catalog_manager.cc:4755] TS dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9324141fa1ba48aca59e97123ca5742e: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
W20260709 13:00:59.706760  1581 consensus_peers.cc:597] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:59.715271  1582 consensus_peers.cc:597] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5664f3181d5c4b20bb8443fb79030930. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:59.728166   431 raft_consensus.cc:2243] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:00:59.728788  1684 raft_consensus.cc:1275] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:00:59.748442   431 raft_consensus.cc:2272] T 03a87bdd56034cbaa09fbc461a7bd313 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:59.751391   431 tablet_replica.cc:333] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:00:59.757243   431 raft_consensus.cc:2243] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:59.758050   431 raft_consensus.cc:2272] T 398a6324f64f46b0accba6cac64dfec6 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:59.761633 10316 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:59.766505   431 tablet_replica.cc:333] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:00:59.781772   431 raft_consensus.cc:2243] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:00:59.783085   431 raft_consensus.cc:2272] T d36fee36a84e4cf98ad42f287d4f317f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:59.786216   431 tablet_replica.cc:333] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:00:59.787290 10398 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.796988 10398 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:59.797565   431 raft_consensus.cc:2243] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:59.798684   431 raft_consensus.cc:2272] T db702b262c1644109366a56f6f0d805a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:59.800534  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:00:59.803754 10398 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:59.806136   431 tablet_replica.cc:333] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:00:59.807300   431 raft_consensus.cc:2243] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:00:59.808604   431 raft_consensus.cc:2272] T d5d52e25b9814edbb805e7d6bcce5b5d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:59.812691   431 tablet_replica.cc:333] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
W20260709 13:00:59.790220  2267 consensus_peers.cc:597] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:00:59.824635 10394 raft_consensus.cc:2955] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index -1 to 14, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 13:00:59.837479  1684 raft_consensus.cc:2955] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index -1 to 14, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 13:00:59.843454  1610 consensus_queue.cc:237] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:00:59.822465   431 raft_consensus.cc:2243] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:59.845629  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0eedb9e9c8c4177903e544c600553f3" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:59.849126   431 raft_consensus.cc:2272] T f0a8a9b410b84b569aa1245ad95bb229 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:59.853014   431 tablet_replica.cc:333] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:00:59.865203   431 raft_consensus.cc:2243] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:59.867288   431 raft_consensus.cc:2272] T 42248b4b3b744072a3581db8c3874c55 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:59.871219  1505 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:00:59.873993  1581 consensus_peers.cc:597] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:00:59.876786 10401 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:00:59.877677   431 tablet_replica.cc:333] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:00:59.878701   431 raft_consensus.cc:2243] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:59.894668   431 pending_rounds.cc:70] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Trying to abort 2 pending ops.
I20260709 13:00:59.895008   431 pending_rounds.cc:77] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting op as it isn't in flight: id { term: 23 index: 16 } timestamp: 7305633953941483520 op_type: NO_OP noop_request { }
I20260709 13:00:59.895371   431 raft_consensus.cc:2889] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:00:59.895725   431 pending_rounds.cc:77] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting op as it isn't in flight: id { term: 21 index: 15 } timestamp: 7305633906665938944 op_type: NO_OP noop_request { }
I20260709 13:00:59.896111   431 raft_consensus.cc:2889] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:00:59.896438   431 raft_consensus.cc:2272] T 12b2051da69c4c7f8b35da07093dfc33 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:59.903115  1682 raft_consensus.cc:1275] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:00:59.903996   431 tablet_replica.cc:333] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:00:59.924697   431 raft_consensus.cc:2243] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:00:59.925122 10394 consensus_queue.cc:1048] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:00:59.926178   431 raft_consensus.cc:2272] T 7d92e33e89814e86abdebb8b54a3a5c5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:59.943132  1581 consensus_peers.cc:597] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:59.945305 10398 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.946673 10398 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:00:59.949134 10398 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:00:59.950234  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
W20260709 13:00:59.945823  1582 consensus_peers.cc:597] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 97e583cb09524a098c997f9996eb5b03. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:59.955346  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7634482da3645aeb7462251e5df3726" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:00:59.957975 10316 raft_consensus.cc:2955] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 24 LEADER]: Committing config change with OpId 24.16: config changed from index -1 to 16, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 13:00:59.959642  1505 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:00:59.960994 10401 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 13:00:59.946158   431 tablet_replica.cc:333] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:00:59.965729   431 raft_consensus.cc:2243] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:59.966568   431 pending_rounds.cc:70] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Trying to abort 1 pending ops.
I20260709 13:00:59.966848   431 pending_rounds.cc:77] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting op as it isn't in flight: id { term: 22 index: 14 } timestamp: 7305633952880115712 op_type: NO_OP noop_request { }
I20260709 13:00:59.967600   431 raft_consensus.cc:2889] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:00:59.967944   431 raft_consensus.cc:2272] T aa984c8881704e97b0d6a6eb60605021 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:00.002158   431 tablet_replica.cc:333] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:01:00.003085   431 raft_consensus.cc:2243] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:01:00.022212  1682 raft_consensus.cc:2955] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index -1 to 16, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 13:01:00.030963  1438 catalog_manager.cc:5697] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index -1 to 14, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 21 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 13:01:00.014441   431 raft_consensus.cc:2272] T d7727fcb0cf9452fbbc077ab7987b596 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:00.054131   431 tablet_replica.cc:333] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:01:00.055066   431 raft_consensus.cc:2243] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:00.055622   431 pending_rounds.cc:70] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Trying to abort 1 pending ops.
I20260709 13:01:00.055861   431 pending_rounds.cc:77] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting op as it isn't in flight: id { term: 21 index: 13 } timestamp: 7305633817052336128 op_type: NO_OP noop_request { }
I20260709 13:01:00.056258   431 raft_consensus.cc:2889] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:00.067014   431 raft_consensus.cc:2272] T 920d24d01316479692fb62f167beb41e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:00.085058  1614 consensus_queue.cc:237] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:01:00.098596   431 tablet_replica.cc:333] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:01:00.100749   431 raft_consensus.cc:2243] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:00.104725   431 pending_rounds.cc:70] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Trying to abort 1 pending ops.
I20260709 13:01:00.105077   431 pending_rounds.cc:77] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting op as it isn't in flight: id { term: 29 index: 18 } timestamp: 7305634002154577920 op_type: NO_OP noop_request { }
I20260709 13:01:00.105561   431 raft_consensus.cc:2889] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 30 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:00.105970   431 raft_consensus.cc:2272] T b7634482da3645aeb7462251e5df3726 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:00.115445   431 tablet_replica.cc:333] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:01:00.117486   431 raft_consensus.cc:2243] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:00.123963   431 raft_consensus.cc:2272] T a5981b12945c4d5b8d59d139eb1c77a2 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:00.131916   431 tablet_replica.cc:333] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:01:00.140753   431 raft_consensus.cc:2243] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:00.142096   431 raft_consensus.cc:2272] T 0507fcc8f9794c668a81d8519fc995be P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:00.145390   431 tablet_replica.cc:333] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
W20260709 13:01:00.133237  1582 consensus_peers.cc:597] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f -> Peer 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437): Couldn't send request to peer 1d6516ff61104bdda54bde95e92fe579. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d630fd40a4084d87954d0e6c16998a70. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:00.146359   431 raft_consensus.cc:2243] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:00.133860  1434 catalog_manager.cc:5697] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index -1 to 16, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 24 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 13:01:00.147246   431 raft_consensus.cc:2272] T d630fd40a4084d87954d0e6c16998a70 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:00.150924   431 tablet_replica.cc:333] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:01:00.151937   431 raft_consensus.cc:2243] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:00.152618   431 pending_rounds.cc:70] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Trying to abort 1 pending ops.
I20260709 13:01:00.152927   431 pending_rounds.cc:77] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting op as it isn't in flight: id { term: 21 index: 12 } timestamp: 7305633937164017664 op_type: NO_OP noop_request { }
I20260709 13:01:00.153337   431 raft_consensus.cc:2889] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:00.155999   431 raft_consensus.cc:2272] T cc0adb56140a4e698e722f4960e13783 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:00.156155 10398 raft_consensus.cc:493] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.156744 10398 raft_consensus.cc:515] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:00.159036 10398 leader_election.cc:290] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:01:00.136861  1689 raft_consensus.cc:1275] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:01:00.161232  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:01:00.161253  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3e4ab7be234d07aa27f18779c01c0d" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:01:00.160724   431 tablet_replica.cc:333] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:01:00.163579   431 raft_consensus.cc:2243] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:00.163727  2267 consensus_peers.cc:597] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:00.164337   431 raft_consensus.cc:2272] T 5c8fc263f1e8493db14b8c7a8e316a9f P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:00.166911  1507 leader_election.cc:304] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d
I20260709 13:01:00.168210 10398 raft_consensus.cc:2749] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:01:00.177069   431 tablet_replica.cc:333] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:01:00.178149   431 raft_consensus.cc:2243] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:00.185489   431 pending_rounds.cc:70] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Trying to abort 2 pending ops.
I20260709 13:01:00.186053   431 pending_rounds.cc:77] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting op as it isn't in flight: id { term: 28 index: 20 } timestamp: 7305633954717827072 op_type: NO_OP noop_request { }
I20260709 13:01:00.186439   431 raft_consensus.cc:2889] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:00.186743   431 pending_rounds.cc:77] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting op as it isn't in flight: id { term: 26 index: 19 } timestamp: 7305633901993078784 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "9324141fa1ba48aca59e97123ca5742e" old_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } } new_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } } }
I20260709 13:01:00.187808   431 raft_consensus.cc:2917] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Aborting config change with OpId 26.19: Aborted: Op aborted
I20260709 13:01:00.188208   431 raft_consensus.cc:2889] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
W20260709 13:01:00.197228  1581 consensus_peers.cc:597] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:00.197572   431 raft_consensus.cc:2272] T 9324141fa1ba48aca59e97123ca5742e P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:00.218302 10384 consensus_queue.cc:1048] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:00.236796   431 tablet_replica.cc:333] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:01:00.237787   431 raft_consensus.cc:2243] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:00.238574   431 pending_rounds.cc:70] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Trying to abort 1 pending ops.
I20260709 13:01:00.238811   431 pending_rounds.cc:77] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting op as it isn't in flight: id { term: 23 index: 15 } timestamp: 7305633864019599360 op_type: NO_OP noop_request { }
I20260709 13:01:00.239185   431 raft_consensus.cc:2889] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:00.239532   431 raft_consensus.cc:2272] T cdff63e2a2e94c729942046ee2f02a09 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:00.251344   431 tablet_replica.cc:333] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
W20260709 13:01:00.258805  1655 consensus_peers.cc:597] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:00.252318   431 raft_consensus.cc:2243] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:01:00.274200 10384 raft_consensus.cc:2955] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 13:01:00.280539   431 raft_consensus.cc:2272] T d127be99e2af41c0808e03480c1b64e3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:00.287194  1689 raft_consensus.cc:2955] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 13:01:00.293447   431 tablet_replica.cc:333] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:01:00.294430   431 raft_consensus.cc:2243] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:00.295130   431 raft_consensus.cc:2272] T d3cb0f1c44ec45f38ff2f0c27480a08c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:00.311879   431 tablet_replica.cc:333] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:01:00.328980   431 raft_consensus.cc:2243] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:00.329767   431 raft_consensus.cc:2272] T 35beb9f05ad84a8fb211d701469ddd6c P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:00.343152   431 tablet_replica.cc:333] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:01:00.344115   431 raft_consensus.cc:2243] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:00.353799   431 pending_rounds.cc:70] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Trying to abort 1 pending ops.
I20260709 13:01:00.354126   431 pending_rounds.cc:77] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting op as it isn't in flight: id { term: 20 index: 13 } timestamp: 7305633879888375808 op_type: NO_OP noop_request { }
I20260709 13:01:00.354480   431 raft_consensus.cc:2889] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:00.354898   431 raft_consensus.cc:2272] T 97e583cb09524a098c997f9996eb5b03 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:00.357502  1610 consensus_queue.cc:237] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 22.19, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:00.371631   431 tablet_replica.cc:333] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:01:00.372658   431 raft_consensus.cc:2243] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:00.373459   431 raft_consensus.cc:2272] T ba9da8e67563442eaf10dbb50de09eb5 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:00.380393 10398 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.380975 10398 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:01:00.385692  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:01:00.386552  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22060ec6ef664a749065c3f00807b450" candidate_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:01:00.392853  1505 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbe6a89d0e1c4137b3a1b17bf4b520d8; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:01:00.395505 10401 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:00.396593 10398 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:01:00.398072 10422 ts_tablet_manager.cc:933] T 5664f3181d5c4b20bb8443fb79030930 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:01:00.400579   431 tablet_replica.cc:333] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:01:00.416858   431 raft_consensus.cc:2243] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:00.417594   431 pending_rounds.cc:70] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Trying to abort 2 pending ops.
I20260709 13:01:00.417857   431 pending_rounds.cc:77] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting op as it isn't in flight: id { term: 18 index: 13 } timestamp: 7305633937927127040 op_type: NO_OP noop_request { }
I20260709 13:01:00.418248   431 raft_consensus.cc:2889] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:00.418568   431 pending_rounds.cc:77] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting op as it isn't in flight: id { term: 16 index: 12 } timestamp: 7305633863707205632 op_type: NO_OP noop_request { }
I20260709 13:01:00.418897   431 raft_consensus.cc:2889] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:00.419250   431 raft_consensus.cc:2272] T f0eedb9e9c8c4177903e544c600553f3 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:00.422509   431 tablet_replica.cc:333] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:01:00.423542   431 raft_consensus.cc:2243] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 LEADER]: Raft consensus shutting down.
W20260709 13:01:00.428194  1655 consensus_peers.cc:597] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:00.414028  2295 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 22 index: 19. Preceding OpId from leader: term: 22 index: 20. (index mismatch)
I20260709 13:01:00.433063  1434 catalog_manager.cc:5697] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index -1 to 11, NON_VOTER 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) added. New cstate: current_term: 17 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } }
I20260709 13:01:00.434760 10394 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 13:01:00.448428 10422 tablet_copy_client.cc:323] T 5664f3181d5c4b20bb8443fb79030930 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:41953
I20260709 13:01:00.432914   431 raft_consensus.cc:2272] T e4d03bbba4ce46ecb686052832c7b862 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:00.448930  1488 auto_rebalancer.cc:629] Failed to schedule move for tablet 0ff814cc76e74038894b6ec316f8749f: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:00.451862  1627 tablet_copy_service.cc:140] P c262eac7fc904ae9bb91e450f6532e3f: Received BeginTabletCopySession request for tablet 5664f3181d5c4b20bb8443fb79030930 from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:58006)
I20260709 13:01:00.452692  1627 tablet_copy_service.cc:161] P c262eac7fc904ae9bb91e450f6532e3f: Beginning new tablet copy session on tablet 5664f3181d5c4b20bb8443fb79030930 from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:58006: session id = 1d6516ff61104bdda54bde95e92fe579-5664f3181d5c4b20bb8443fb79030930
I20260709 13:01:00.454241 10424 raft_consensus.cc:2955] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Committing config change with OpId 22.20: config changed from index 19 to 20, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:01:00.462158  1627 tablet_copy_source_session.cc:215] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:00.461639  2301 raft_consensus.cc:2955] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Committing config change with OpId 22.20: config changed from index 19 to 20, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 13:01:00.483297  1581 consensus_peers.cc:597] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:00.463160   431 tablet_replica.cc:333] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:01:00.474828  1689 raft_consensus.cc:1275] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 22 index: 19. Preceding OpId from leader: term: 22 index: 20. (index mismatch)
I20260709 13:01:00.485603  1424 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8a2233a4e08d4138b4eb687a0440be86 with cas_config_opid_index 19: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:00.486218   431 raft_consensus.cc:2243] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:00.486914   431 pending_rounds.cc:70] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Trying to abort 1 pending ops.
I20260709 13:01:00.487210   431 pending_rounds.cc:77] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting op as it isn't in flight: id { term: 19 index: 14 } timestamp: 7305633969554288640 op_type: NO_OP noop_request { }
I20260709 13:01:00.487643   431 raft_consensus.cc:2889] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:00.488036   431 raft_consensus.cc:2272] T 22060ec6ef664a749065c3f00807b450 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:00.496779 10427 ts_tablet_manager.cc:933] T 97e583cb09524a098c997f9996eb5b03 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:01:00.495649  1434 catalog_manager.cc:5697] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: config changed from index 19 to 20, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New cstate: current_term: 22 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:00.495571   431 tablet_replica.cc:333] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:01:00.500167   431 raft_consensus.cc:2243] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:00.502179   431 raft_consensus.cc:2272] T 6f1367cef67f42eab84cbda659b7ffb1 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:00.504743 10422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5664f3181d5c4b20bb8443fb79030930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:00.506875 10424 consensus_queue.cc:1048] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 13:01:00.511089   431 tablet_replica.cc:333] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:01:00.512015   431 raft_consensus.cc:2243] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:00.512723   431 pending_rounds.cc:70] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Trying to abort 1 pending ops.
I20260709 13:01:00.512974   431 pending_rounds.cc:77] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting op as it isn't in flight: id { term: 22 index: 15 } timestamp: 7305633931446755328 op_type: NO_OP noop_request { }
I20260709 13:01:00.513334   431 raft_consensus.cc:2889] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:00.513653   431 raft_consensus.cc:2272] T 6578815705874ccfb147b36c5f6db70a P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:00.529958 10427 tablet_copy_client.cc:323] T 97e583cb09524a098c997f9996eb5b03 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:41953
I20260709 13:01:00.532017  1627 tablet_copy_service.cc:140] P c262eac7fc904ae9bb91e450f6532e3f: Received BeginTabletCopySession request for tablet 97e583cb09524a098c997f9996eb5b03 from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:58006)
I20260709 13:01:00.530515 10424 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:00.532634  1627 tablet_copy_service.cc:161] P c262eac7fc904ae9bb91e450f6532e3f: Beginning new tablet copy session on tablet 97e583cb09524a098c997f9996eb5b03 from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:58006: session id = 1d6516ff61104bdda54bde95e92fe579-97e583cb09524a098c997f9996eb5b03
I20260709 13:01:00.534029 10424 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:01:00.539141  1581 leader_election.cc:336] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:00.545332  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:01:00.542972 10424 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:01:00.546716  1627 tablet_copy_source_session.cc:215] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:00.548496  1583 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:00.549853   431 tablet_replica.cc:333] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:01:00.552191 10424 raft_consensus.cc:2749] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:00.566036 10427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97e583cb09524a098c997f9996eb5b03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:00.568579 10422 tablet_copy_client.cc:806] T 5664f3181d5c4b20bb8443fb79030930 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:00.569507 10422 tablet_copy_client.cc:670] T 5664f3181d5c4b20bb8443fb79030930 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
W20260709 13:01:00.573688  1581 consensus_peers.cc:597] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:00.577505 10422 tablet_copy_client.cc:538] T 5664f3181d5c4b20bb8443fb79030930 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:00.662864 10422 tablet_bootstrap.cc:492] T 5664f3181d5c4b20bb8443fb79030930 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 13:01:00.677166   431 raft_consensus.cc:2243] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:00.678073   431 pending_rounds.cc:70] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Trying to abort 1 pending ops.
I20260709 13:01:00.678355   431 pending_rounds.cc:77] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting op as it isn't in flight: id { term: 21 index: 18 } timestamp: 7305633952729939968 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "8a2233a4e08d4138b4eb687a0440be86" old_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } } } new_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } } }
I20260709 13:01:00.679440   431 raft_consensus.cc:2917] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Aborting config change with OpId 21.18: Aborted: Op aborted
I20260709 13:01:00.679870   431 raft_consensus.cc:2889] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:01:00.680240   431 raft_consensus.cc:2272] T 8a2233a4e08d4138b4eb687a0440be86 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:00.691543  1655 consensus_peers.cc:597] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:00.692508 10427 tablet_copy_client.cc:806] T 97e583cb09524a098c997f9996eb5b03 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
W20260709 13:01:00.692610  2267 consensus_peers.cc:597] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:00.728089 10427 tablet_copy_client.cc:670] T 97e583cb09524a098c997f9996eb5b03 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
W20260709 13:01:00.728618  2267 consensus_peers.cc:597] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:00.716169  1689 raft_consensus.cc:2955] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Committing config change with OpId 22.20: config changed from index 19 to 20, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 13:01:00.733742  1425 catalog_manager.cc:4755] TS dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8a2233a4e08d4138b4eb687a0440be86: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:01:00.747443   431 tablet_replica.cc:333] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:01:00.748361   431 raft_consensus.cc:2243] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:00.757982 10427 tablet_copy_client.cc:538] T 97e583cb09524a098c997f9996eb5b03 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:01:00.760380  1581 consensus_peers.cc:597] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:00.762063   431 raft_consensus.cc:2272] T 8b3e4ab7be234d07aa27f18779c01c0d P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:00.779423 10427 tablet_bootstrap.cc:492] T 97e583cb09524a098c997f9996eb5b03 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
W20260709 13:01:00.779109  1581 consensus_peers.cc:597] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:00.793709  2267 consensus_peers.cc:597] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:01:00.790630   431 tablet_replica.cc:333] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:01:00.804296   431 raft_consensus.cc:2243] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:01:00.805532   431 raft_consensus.cc:2272] T 480b368f643b4d85a5daa23529132504 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:00.814014 10394 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:00.814590 10394 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:00.819464 10394 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:01:00.820434   431 tablet_replica.cc:333] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:01:00.821413   431 raft_consensus.cc:2243] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:01:00.822703   431 raft_consensus.cc:2272] T 9b4de1379d73445699a2babbca8fce44 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:00.827179  2299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:01:00.839017  1581 leader_election.cc:336] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:00.839902  1581 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:01:00.840987  2267 consensus_peers.cc:597] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:00.842428 10384 raft_consensus.cc:2749] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:01:00.849050 10432 ts_tablet_manager.cc:933] T d630fd40a4084d87954d0e6c16998a70 P 1d6516ff61104bdda54bde95e92fe579: Initiating tablet copy from peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:01:00.851008  2267 consensus_peers.cc:597] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:00.882589   431 tablet_replica.cc:333] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:01:00.883646   431 raft_consensus.cc:2243] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:01:00.897259   431 raft_consensus.cc:2272] T eabf19413eea44dd86511e07a036166b P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:00.899885 10432 tablet_copy_client.cc:323] T d630fd40a4084d87954d0e6c16998a70 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:41953
I20260709 13:01:00.903827  1627 tablet_copy_service.cc:140] P c262eac7fc904ae9bb91e450f6532e3f: Received BeginTabletCopySession request for tablet d630fd40a4084d87954d0e6c16998a70 from peer 1d6516ff61104bdda54bde95e92fe579 ({username='slave'} at 127.0.0.1:58006)
I20260709 13:01:00.904410  1627 tablet_copy_service.cc:161] P c262eac7fc904ae9bb91e450f6532e3f: Beginning new tablet copy session on tablet d630fd40a4084d87954d0e6c16998a70 from peer 1d6516ff61104bdda54bde95e92fe579 at {username='slave'} at 127.0.0.1:58006: session id = 1d6516ff61104bdda54bde95e92fe579-d630fd40a4084d87954d0e6c16998a70
I20260709 13:01:00.917075  1627 tablet_copy_source_session.cc:215] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:00.923127 10384 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:00.923767 10384 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:01:00.924868 10431 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:00.925477 10431 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:01:00.926033 10384 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:01:00.927708 10431 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:01:00.928802  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:01:00.929116  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:01:00.929510  1614 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 18.
I20260709 13:01:00.931077  1654 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 13:01:00.931779  1655 leader_election.cc:336] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:00.933876 10431 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:00.934551 10431 raft_consensus.cc:493] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:00.935027 10431 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:00.935456  1581 leader_election.cc:336] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:00.935949  1581 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:00.936698 10384 raft_consensus.cc:2749] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:01:00.946038 10432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d630fd40a4084d87954d0e6c16998a70. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:00.951300  2267 consensus_peers.cc:597] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:00.955650 10393 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:00.956298 10393 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:00.957379   431 tablet_replica.cc:333] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:01:00.958282   431 raft_consensus.cc:2243] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:00.958701 10393 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:01:00.959136   431 raft_consensus.cc:2272] T dbdf9662619648c4a3b76fbbda8d0e14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:00.959787  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:01:00.965119   431 tablet_replica.cc:333] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
W20260709 13:01:00.967898  2267 leader_election.cc:336] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:00.993662  2267 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:00.994635 10410 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:01:00.994989   431 raft_consensus.cc:2243] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:00.995877   431 raft_consensus.cc:2272] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:00.973477 10393 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:00.997635 10393 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:01.000415 10393 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:01:01.004094  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:01:00.973724 10431 raft_consensus.cc:515] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:01:01.007527   431 tablet_replica.cc:333] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:01:01.008638   431 raft_consensus.cc:2243] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:01.017230  2267 leader_election.cc:336] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:01.017910  2267 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:01.028800 10410 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:01:01.043877  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff814cc76e74038894b6ec316f8749f" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:01:01.044564  1614 raft_consensus.cc:3060] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:01:01.046057  1655 leader_election.cc:336] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:01.043771 10384 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:01.047057 10384 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:01.049851   431 raft_consensus.cc:2272] T 105edc3ce5964519acbd96dbaa975697 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:01.050995 10431 leader_election.cc:290] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:01:01.054033  1614 raft_consensus.cc:2468] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 19.
I20260709 13:01:01.055670  1654 leader_election.cc:304] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:01.057157 10408 raft_consensus.cc:2804] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:01.058079 10288 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:01.058694 10288 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:01:01.062479  1581 leader_election.cc:336] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:01.063995 10288 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:01:01.065102 10384 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:01:01.066895  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
W20260709 13:01:01.070240  1655 leader_election.cc:336] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:01.074154  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:01:01.079977  1614 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 24.
I20260709 13:01:01.081212  1654 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:01.082437  1582 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:01.084440 10288 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:01:01.084890 10288 raft_consensus.cc:493] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:01.085242 10288 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:01.083942 10424 raft_consensus.cc:2749] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:01:01.095291 10288 raft_consensus.cc:515] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:01:01.078701 10408 raft_consensus.cc:697] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:01:01.097507 10408 consensus_queue.cc:237] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:01:01.113315 10393 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:01.114135 10288 leader_election.cc:290] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:01:01.113951 10393 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:01.119270  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:01:01.119926  1614 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 25.
I20260709 13:01:01.120916 10393 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:01:01.124428  2266 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 13:01:01.125900  1655 leader_election.cc:336] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:01.128697 10410 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:01:01.129154 10410 raft_consensus.cc:493] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:01.129513 10410 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:01:01.120855  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a9d2e2602bd4118abc0a8629a67005c" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:01:01.135218  1614 raft_consensus.cc:3060] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:01.143368   431 tablet_replica.cc:333] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:01:01.144236   431 raft_consensus.cc:2243] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:01.151732   431 raft_consensus.cc:2272] T 95abfe15f7d54f3fb0f01f162b262561 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:01.158396  1581 consensus_peers.cc:597] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:01.159819  2267 leader_election.cc:336] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:01.147836 10410 raft_consensus.cc:515] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:01:01.170905  1581 consensus_peers.cc:597] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:01.171691  1581 consensus_peers.cc:597] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:01.177424 10433 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:01.177577  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03a87bdd56034cbaa09fbc461a7bd313" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:01:01.178362  1610 raft_consensus.cc:3060] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:01:01.178335 10433 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:01.195787   431 tablet_replica.cc:333] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:01:01.199703  1610 raft_consensus.cc:2468] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 26.
I20260709 13:01:01.178586 10410 leader_election.cc:290] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 26 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:01:01.201161   431 raft_consensus.cc:2243] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:01.203318  1614 raft_consensus.cc:2468] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 25.
I20260709 13:01:01.207327  1654 leader_election.cc:304] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:01.207885   431 pending_rounds.cc:70] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Trying to abort 2 pending ops.
I20260709 13:01:01.208844   431 pending_rounds.cc:77] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting op as it isn't in flight: id { term: 21 index: 15 } timestamp: 7305633968564441088 op_type: NO_OP noop_request { }
I20260709 13:01:01.209240   431 raft_consensus.cc:2889] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:01.215109 10433 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:01:01.209564   431 pending_rounds.cc:77] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8: Aborting op as it isn't in flight: id { term: 20 index: 14 } timestamp: 7305633922058756096 op_type: NO_OP noop_request { }
I20260709 13:01:01.219075  1434 catalog_manager.cc:5697] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 18 to 19, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 19 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:01.227346  2266 leader_election.cc:304] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:01:01.228354 10440 raft_consensus.cc:2804] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:01:01.228938 10440 raft_consensus.cc:697] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 26 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:01:01.229341  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:01:01.229840 10440 consensus_queue.cc:237] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.19, Last appended by leader: 19, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:01.221670   431 raft_consensus.cc:2889] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:01.239620   431 raft_consensus.cc:2272] T 0e84698abe8e46788d46c9bf8a4c74c7 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:01.241892  2267 leader_election.cc:336] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:01.272234  2267 leader_election.cc:336] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:01.272794  2267 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:01.280748 10432 tablet_copy_client.cc:806] T d630fd40a4084d87954d0e6c16998a70 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:01.281497 10432 tablet_copy_client.cc:670] T d630fd40a4084d87954d0e6c16998a70 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:01.287091 10394 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:01.295933 10432 tablet_copy_client.cc:538] T d630fd40a4084d87954d0e6c16998a70 P 1d6516ff61104bdda54bde95e92fe579: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:01.296757 10410 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:01.258078 10384 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:01.301018 10384 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:01.303303 10384 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:01:01.307963  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:01:01.308890  2301 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 24.
I20260709 13:01:01.317049   431 tablet_replica.cc:333] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8: stopping tablet replica
I20260709 13:01:01.317941   431 raft_consensus.cc:2243] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 33 LEADER]: Raft consensus shutting down.
I20260709 13:01:01.319171   431 raft_consensus.cc:2272] T ac600187e28f4d0fa948e0d053317e88 P dbe6a89d0e1c4137b3a1b17bf4b520d8 [term 33 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:01.287819 10394 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:01.280603 10438 raft_consensus.cc:2804] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:01:01.337110 10438 raft_consensus.cc:697] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 25 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:01:01.337374  1439 catalog_manager.cc:5697] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 25 to 26, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 26 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:01.338163 10438 consensus_queue.cc:237] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:01:01.327870 10394 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:01:01.349197 10422 tablet_bootstrap.cc:492] T 5664f3181d5c4b20bb8443fb79030930 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=1 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:01:01.350240  1581 consensus_peers.cc:597] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:01.325924  1582 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:01:01.360918  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:01:01.361553  2295 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 21.
I20260709 13:01:01.386749  1582 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:01:01.350327 10422 tablet_bootstrap.cc:492] T 5664f3181d5c4b20bb8443fb79030930 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
W20260709 13:01:01.391505  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 185069us
I20260709 13:01:01.385823 10394 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:01:01.405341 10425 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:01.399494 10424 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:01:01.404572 10394 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:01.407732 10425 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:01.411940 10424 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:01.429793 10424 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:01.430514 10425 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:01:01.431763 10432 tablet_bootstrap.cc:492] T d630fd40a4084d87954d0e6c16998a70 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap starting.
I20260709 13:01:01.412801 10441 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:01.436818 10441 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:01.443179 10441 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:01:01.438149 10394 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:01.450730  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:01:01.414333 10422 ts_tablet_manager.cc:1403] T 5664f3181d5c4b20bb8443fb79030930 P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 0.752s	user 0.059s	sys 0.009s
I20260709 13:01:01.451447  2301 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 25.
I20260709 13:01:01.459837  1582 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:01:01.461103 10384 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:01:01.461529 10384 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:01.461903 10384 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:01:01.468981 10424 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:01:01.470620  2267 leader_election.cc:336] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:01.475790  1581 leader_election.cc:336] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:01.477604  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:01:01.479614  1614 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 24.
W20260709 13:01:01.488809  1581 leader_election.cc:336] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:01.490010  1581 consensus_peers.cc:597] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:01.493754  2266 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:01.492871 10394 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:01.498139 10433 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:01:01.499737 10433 raft_consensus.cc:493] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:01.500051 10433 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:01.500903 10394 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:01:01.510108  2267 consensus_peers.cc:597] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:01.518328 10427 tablet_bootstrap.cc:492] T 97e583cb09524a098c997f9996eb5b03 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=0 applied=16 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:01.522531  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36fee36a84e4cf98ad42f287d4f317f" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:01:01.523329  2301 raft_consensus.cc:3060] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:01:01.534817  1581 leader_election.cc:336] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:01.537420 10397 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:01.538040 10397 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:01:01.538951 10422 raft_consensus.cc:359] T 5664f3181d5c4b20bb8443fb79030930 P 1d6516ff61104bdda54bde95e92fe579 [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:01:01.539858 10422 raft_consensus.cc:740] T 5664f3181d5c4b20bb8443fb79030930 P 1d6516ff61104bdda54bde95e92fe579 [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
W20260709 13:01:01.543241  1655 consensus_peers.cc:597] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:01.544121 10433 raft_consensus.cc:515] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:01.545506 10427 tablet_bootstrap.cc:492] T 97e583cb09524a098c997f9996eb5b03 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 13:01:01.549173 10427 ts_tablet_manager.cc:1403] T 97e583cb09524a098c997f9996eb5b03 P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 0.770s	user 0.049s	sys 0.020s
W20260709 13:01:01.549474  2267 consensus_peers.cc:597] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:01.551071 10424 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:01:01.552583  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5d52e25b9814edbb805e7d6bcce5b5d" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:01:01.553287  2295 raft_consensus.cc:3060] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:01:01.547372 10422 consensus_queue.cc:260] T 5664f3181d5c4b20bb8443fb79030930 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:01:01.549983 10397 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:01:01.489557 10384 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:01:01.557060  2267 leader_election.cc:336] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:01.562477  2295 raft_consensus.cc:2468] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 22.
I20260709 13:01:01.563874  1582 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:01:01.564630 10384 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:01:01.565223 10433 leader_election.cc:290] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:01:01.566731 10422 ts_tablet_manager.cc:1434] T 5664f3181d5c4b20bb8443fb79030930 P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.114s	user 0.007s	sys 0.000s
I20260709 13:01:01.574128  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d92e33e89814e86abdebb8b54a3a5c5" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:01:01.586221  1610 raft_consensus.cc:3060] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:01.568464  2301 raft_consensus.cc:2468] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 25.
I20260709 13:01:01.577055  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7727fcb0cf9452fbbc077ab7987b596" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:01:01.589147  2295 raft_consensus.cc:3060] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:01:01.589776  1582 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:01:01.577977  1627 tablet_copy_service.cc:342] P c262eac7fc904ae9bb91e450f6532e3f: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-5664f3181d5c4b20bb8443fb79030930 received from {username='slave'} at 127.0.0.1:58006
I20260709 13:01:01.596369  2295 raft_consensus.cc:2468] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 26.
W20260709 13:01:01.597939  1581 leader_election.cc:336] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:01.599519  1627 tablet_copy_service.cc:434] P c262eac7fc904ae9bb91e450f6532e3f: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-5664f3181d5c4b20bb8443fb79030930 on tablet 5664f3181d5c4b20bb8443fb79030930 with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 13:01:01.601017  1582 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:01:01.576494 10384 raft_consensus.cc:2804] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:01:01.582587 10433 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:01.610563 10433 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:01.611721 10453 raft_consensus.cc:2804] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:01:01.612661 10453 raft_consensus.cc:697] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 26 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:01:01.613655 10453 consensus_queue.cc:237] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:01.614557 10433 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:01:01.602236  1581 leader_election.cc:336] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:01.601859 10397 raft_consensus.cc:2804] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:01:01.604607  1610 raft_consensus.cc:2468] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 25.
I20260709 13:01:01.601943 10451 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:01.625784 10451 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:01.584308 10427 raft_consensus.cc:359] T 97e583cb09524a098c997f9996eb5b03 P 1d6516ff61104bdda54bde95e92fe579 [term 24 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:01:01.626937 10427 raft_consensus.cc:740] T 97e583cb09524a098c997f9996eb5b03 P 1d6516ff61104bdda54bde95e92fe579 [term 24 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 13:01:01.609860 10384 raft_consensus.cc:697] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 13:01:01.627733  2267 leader_election.cc:336] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:01.628217 10451 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:01:01.628501 10384 consensus_queue.cc:237] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:01.630260  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:01:01.630942  2301 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 20.
W20260709 13:01:01.620990  1581 leader_election.cc:336] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:01.625118 10397 raft_consensus.cc:697] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 25 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:01:01.638026  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:01:01.627657 10427 consensus_queue.cc:260] T 97e583cb09524a098c997f9996eb5b03 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:01:01.647199 10397 consensus_queue.cc:237] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:01.632181  1582 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:01:01.649372 10446 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:01.649784 10446 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:01.650156 10446 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:01.657850  2266 leader_election.cc:304] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:01.662130 10427 ts_tablet_manager.cc:1434] T 97e583cb09524a098c997f9996eb5b03 P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.111s	user 0.005s	sys 0.002s
I20260709 13:01:01.671257 10443 raft_consensus.cc:2804] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:01:01.673840  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:01:01.708799 10408 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:01.709546 10408 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:01:01.712020 10408 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:01:01.711575  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 46902.9us
I20260709 13:01:01.718133 10443 raft_consensus.cc:697] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 25 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
W20260709 13:01:01.719326  1655 leader_election.cc:336] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:01.719344 10443 consensus_queue.cc:237] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:01.723037  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
W20260709 13:01:01.723840  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 58228.1us
W20260709 13:01:01.722980  1581 consensus_peers.cc:597] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:01.723162  1614 raft_consensus.cc:1275] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:01:01.725004  1581 leader_election.cc:336] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:01.723757  1616 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 25.
W20260709 13:01:01.708781  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 43641.1us
I20260709 13:01:01.742630  1438 catalog_manager.cc:5697] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 24 to 25, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 25 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:01.754874  1654 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:01.755843  1627 tablet_copy_service.cc:342] P c262eac7fc904ae9bb91e450f6532e3f: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-97e583cb09524a098c997f9996eb5b03 received from {username='slave'} at 127.0.0.1:58006
W20260709 13:01:01.797271  1581 leader_election.cc:336] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:01.798009  2267 consensus_peers.cc:597] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:01.800565  1627 tablet_copy_service.cc:434] P c262eac7fc904ae9bb91e450f6532e3f: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-97e583cb09524a098c997f9996eb5b03 on tablet 97e583cb09524a098c997f9996eb5b03 with peer 1d6516ff61104bdda54bde95e92fe579
W20260709 13:01:01.798313  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 43511us
I20260709 13:01:01.764065 10438 consensus_queue.cc:1048] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
W20260709 13:01:01.811085 10459 log.cc:927] Time spent T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:01:01.809810  1434 catalog_manager.cc:5697] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 21 to 22, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 22 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:01.817189  1434 catalog_manager.cc:5697] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 25 to 26, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 26 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:01.819037  1434 catalog_manager.cc:5697] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 24 to 25, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 25 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:01.822606  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 88800.1us
I20260709 13:01:01.830432 10437 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:01.831094 10437 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:01.833186 10437 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:01:01.837534  1655 leader_election.cc:336] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:01.823206 10408 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:01:01.845646 10408 raft_consensus.cc:493] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:01.846017 10408 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:01:01.862150 10446 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:01.865767 10446 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:01:01.866077  1610 raft_consensus.cc:2393] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d6516ff61104bdda54bde95e92fe579 in current term 21: Already voted for candidate c262eac7fc904ae9bb91e450f6532e3f in this term.
I20260709 13:01:01.866529  2294 raft_consensus.cc:1217] T 5664f3181d5c4b20bb8443fb79030930 P 1d6516ff61104bdda54bde95e92fe579 [term 21 LEARNER]: Deduplicated request from leader. Original: 21.13->[21.14-21.14]   Dedup: 21.14->[]
I20260709 13:01:01.863960  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:01:01.894333  2266 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:01.897629  1656 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:01.911386 10437 raft_consensus.cc:2749] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:01.911598  1611 raft_consensus.cc:1275] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260709 13:01:01.913395 10440 raft_consensus.cc:3060] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:01.919649 10408 raft_consensus.cc:515] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:01:01.920228  1581 consensus_peers.cc:597] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:01.921239  1581 consensus_peers.cc:597] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:01.923810  1581 leader_election.cc:336] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:01.924669  1581 consensus_peers.cc:597] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:01.928884  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d127be99e2af41c0808e03480c1b64e3" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
W20260709 13:01:01.938903  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 87434.9us
I20260709 13:01:01.964442 10408 leader_election.cc:290] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 26 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:01:01.967806 10384 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:01.968410 10384 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:01.970300 10440 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:01:01.973927  1425 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 114757us
I20260709 13:01:01.974999  2294 raft_consensus.cc:1217] T 97e583cb09524a098c997f9996eb5b03 P 1d6516ff61104bdda54bde95e92fe579 [term 24 LEARNER]: Deduplicated request from leader. Original: 24.15->[24.16-24.16]   Dedup: 24.16->[]
I20260709 13:01:01.976172  1583 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:01.977648  2295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:01:01.978904  1613 raft_consensus.cc:1275] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:01:01.983486  1434 catalog_manager.cc:5697] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 24 to 25, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 25 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:01.986346  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4d03bbba4ce46ecb686052832c7b862" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:01:01.986976  1611 raft_consensus.cc:3060] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:01:01.987975  2301 raft_consensus.cc:2468] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 21.
W20260709 13:01:01.989074  1655 consensus_peers.cc:597] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:01.992720 10438 consensus_queue.cc:1048] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:01.992761 10397 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:01.970592 10384 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:01:01.996589  1582 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:01:01.989768  1425 catalog_manager.cc:4755] TS dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8a2233a4e08d4138b4eb687a0440be86: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
W20260709 13:01:01.994796  1581 leader_election.cc:336] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:01.994757 10397 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:02.007787  1581 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:01.960517 10443 consensus_queue.cc:1048] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.031s
W20260709 13:01:02.023500  1655 leader_election.cc:336] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:02.040648 10425 raft_consensus.cc:2804] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:01:02.041389 10425 raft_consensus.cc:697] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 21 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
W20260709 13:01:02.041657  1582 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:33437, user_credentials={real_user=slave}} blocked reactor thread for 45188.2us
I20260709 13:01:02.042384 10425 consensus_queue.cc:237] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:02.040189  1611 raft_consensus.cc:2468] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4487a53c51be4634bf1ef29c5248353d in term 26.
I20260709 13:01:02.043466 10446 raft_consensus.cc:2749] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:01:02.044870  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:01:02.014245 10451 raft_consensus.cc:2749] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:01:02.046662 10393 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:02.046819  1654 leader_election.cc:304] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:02.047956 10437 raft_consensus.cc:2804] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:01:02.050268 10437 raft_consensus.cc:697] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 26 LEADER]: Becoming Leader. State: Replica: 4487a53c51be4634bf1ef29c5248353d, State: Running, Role: LEADER
I20260709 13:01:02.017452 10397 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:01:02.051254 10437 consensus_queue.cc:237] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:01:02.047227 10393 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:02.065361 10393 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:01:02.067838  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 46210.7us
W20260709 13:01:02.096376  2267 consensus_peers.cc:597] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:02.097276  2267 consensus_peers.cc:597] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:02.108669  1581 leader_election.cc:336] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:02.109473  1581 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c262eac7fc904ae9bb91e450f6532e3f; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:01:02.101032  2267 leader_election.cc:336] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:02.124215  2294 raft_consensus.cc:1275] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:01:02.129115 10446 raft_consensus.cc:2749] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:01:02.128182 10393 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:02.171422 10451 consensus_queue.cc:1048] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:01:02.204433 10443 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
W20260709 13:01:02.204521  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 82146us
I20260709 13:01:02.156042 10393 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:02.205086 10443 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:02.262321 10393 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:01:02.265287 10443 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:01:02.285122  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:01:02.285861  1614 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 25.
I20260709 13:01:02.287518 10432 tablet_bootstrap.cc:492] T d630fd40a4084d87954d0e6c16998a70 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:02.289666  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:01:02.290374  1689 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 23.
I20260709 13:01:02.293660 10432 tablet_bootstrap.cc:492] T d630fd40a4084d87954d0e6c16998a70 P 1d6516ff61104bdda54bde95e92fe579: Bootstrap complete.
I20260709 13:01:02.294557 10432 ts_tablet_manager.cc:1403] T d630fd40a4084d87954d0e6c16998a70 P 1d6516ff61104bdda54bde95e92fe579: Time spent bootstrapping tablet: real 0.863s	user 0.046s	sys 0.022s
W20260709 13:01:02.296657  2267 leader_election.cc:336] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:02.298573  2269 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:02.305344  2301 raft_consensus.cc:1275] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:01:02.305995 10469 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:01:02.306427 10469 raft_consensus.cc:493] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:02.306821 10469 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:02.307898  1438 catalog_manager.cc:5697] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: term changed from 25 to 26, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 4487a53c51be4634bf1ef29c5248353d (127.0.107.195). New cstate: current_term: 26 leader_uuid: "4487a53c51be4634bf1ef29c5248353d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:02.318624 10469 raft_consensus.cc:515] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:01:02.319944  2267 leader_election.cc:336] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:02.325044  2267 consensus_peers.cc:597] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:02.322161 10469 leader_election.cc:290] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:01:02.340281  1610 raft_consensus.cc:1275] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:01:02.342527  2266 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:02.323546  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "480b368f643b4d85a5daa23529132504" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d"
I20260709 13:01:02.344533  1687 raft_consensus.cc:3060] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:01:02.350277  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:01:02.350672  2301 raft_consensus.cc:1275] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:01:02.312040  1434 catalog_manager.cc:5697] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 20 to 21, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 21 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:02.356020  1614 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 24.
W20260709 13:01:02.355490  1581 consensus_peers.cc:597] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:02.364269 10440 consensus_queue.cc:1048] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.007s
I20260709 13:01:02.358608 10384 consensus_queue.cc:1048] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.011s
I20260709 13:01:02.359380 10452 consensus_queue.cc:1048] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.018s
W20260709 13:01:02.394042  2267 leader_election.cc:336] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:02.404647 10444 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:01:02.405256 10444 raft_consensus.cc:493] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:02.405664 10444 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:01:02.426752 10479 raft_consensus.cc:1064] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 13:01:02.430490 10479 consensus_queue.cc:237] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 12, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:02.443691 10440 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 33 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:02.444360 10440 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:02.446652 10440 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:01:02.451943  1581 consensus_peers.cc:597] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:02.451691  1687 raft_consensus.cc:2468] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 24.
W20260709 13:01:02.456650  2267 leader_election.cc:336] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:02.453161  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 86215.8us
I20260709 13:01:02.465354  2266 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:02.470463  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 34 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f" is_pre_election: true
I20260709 13:01:02.431509 10432 raft_consensus.cc:359] T d630fd40a4084d87954d0e6c16998a70 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:01:02.476648 10432 raft_consensus.cc:740] T d630fd40a4084d87954d0e6c16998a70 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Initialized, Role: LEARNER
I20260709 13:01:02.477443 10432 consensus_queue.cc:260] T d630fd40a4084d87954d0e6c16998a70 P 1d6516ff61104bdda54bde95e92fe579 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: true } }
I20260709 13:01:02.479925 10432 ts_tablet_manager.cc:1434] T d630fd40a4084d87954d0e6c16998a70 P 1d6516ff61104bdda54bde95e92fe579: Time spent starting tablet: real 0.185s	user 0.004s	sys 0.004s
I20260709 13:01:02.481256 10443 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:01:02.481721 10443 raft_consensus.cc:493] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:02.483016  2269 leader_election.cc:304] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:01:02.494163  1581 consensus_peers.cc:597] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:02.482092 10443 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:01:02.497915 10444 raft_consensus.cc:515] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:02.503085 10384 raft_consensus.cc:1064] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 13:01:02.505735 10444 leader_election.cc:290] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 26 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:01:02.509001 10441 raft_consensus.cc:2804] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:01:02.509554 10441 raft_consensus.cc:697] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 24 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:01:02.510385 10441 consensus_queue.cc:237] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:02.526837  2266 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:02.528352  1611 raft_consensus.cc:1275] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Refusing update from remote peer 4487a53c51be4634bf1ef29c5248353d: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:01:02.530105  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b4de1379d73445699a2babbca8fce44" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:01:02.530704  1611 raft_consensus.cc:3060] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:01:02.544086  1627 tablet_copy_service.cc:342] P c262eac7fc904ae9bb91e450f6532e3f: Request end of tablet copy session 1d6516ff61104bdda54bde95e92fe579-d630fd40a4084d87954d0e6c16998a70 received from {username='slave'} at 127.0.0.1:58006
I20260709 13:01:02.539496 10472 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 33 FOLLOWER]: Leader pre-election lost for term 34. Reason: could not achieve majority
W20260709 13:01:02.549458  2267 leader_election.cc:336] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:02.551194  1627 tablet_copy_service.cc:434] P c262eac7fc904ae9bb91e450f6532e3f: ending tablet copy session 1d6516ff61104bdda54bde95e92fe579-d630fd40a4084d87954d0e6c16998a70 on tablet d630fd40a4084d87954d0e6c16998a70 with peer 1d6516ff61104bdda54bde95e92fe579
I20260709 13:01:02.554600 10463 consensus_queue.cc:1048] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
W20260709 13:01:02.571310  1581 consensus_peers.cc:597] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:02.578501  1611 raft_consensus.cc:2468] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 26.
I20260709 13:01:02.593660  2266 leader_election.cc:304] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:02.597116 10472 raft_consensus.cc:2804] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:01:02.597839 10472 raft_consensus.cc:697] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 26 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:01:02.598908 10472 consensus_queue.cc:237] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:02.551676 10384 consensus_queue.cc:237] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 14, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:02.620734  1689 raft_consensus.cc:1275] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 13:01:02.617039  1581 connection.cc:769] client connection to 127.0.107.193:43903 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:01:02.638271 10443 raft_consensus.cc:515] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:02.659770  2303 raft_consensus.cc:1275] T 5664f3181d5c4b20bb8443fb79030930 P 1d6516ff61104bdda54bde95e92fe579 [term 21 LEARNER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:01:02.672405 10460 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 13:01:02.676817 10461 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
I20260709 13:01:02.682206  2303 raft_consensus.cc:1275] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:01:02.683472  2294 raft_consensus.cc:1217] T d630fd40a4084d87954d0e6c16998a70 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.10->[17.11-17.11]   Dedup: 17.11->[]
W20260709 13:01:02.701499 10484 log.cc:927] Time spent T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:01:02.704242 10394 consensus_queue.cc:1048] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:01:02.715090  2267 consensus_peers.cc:597] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:02.721964 10443 leader_election.cc:290] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:01:02.723541  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eabf19413eea44dd86511e07a036166b" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "c262eac7fc904ae9bb91e450f6532e3f"
I20260709 13:01:02.724179  1614 raft_consensus.cc:3060] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:01:02.719781  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 49555us
W20260709 13:01:02.725531  2267 connection.cc:769] client connection to 127.0.107.193:43903 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:01:02.726789  2267 leader_election.cc:336] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:01:02.731629  1614 raft_consensus.cc:2468] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 25.
I20260709 13:01:02.733121  2266 leader_election.cc:304] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:02.737655 10464 raft_consensus.cc:2804] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:01:02.738245 10464 raft_consensus.cc:697] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 25 LEADER]: Becoming Leader. State: Replica: 1d6516ff61104bdda54bde95e92fe579, State: Running, Role: LEADER
I20260709 13:01:02.739161 10464 consensus_queue.cc:237] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:01:02.741053  1581 consensus_peers.cc:597] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:02.792294  1581 consensus_peers.cc:597] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:02.792865  1581 consensus_peers.cc:597] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:02.839766  1655 consensus_peers.cc:597] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:02.816076 10460 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 33 FOLLOWER]: Starting pre-election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:02.846589 10460 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 33 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:02.861253  1438 catalog_manager.cc:5697] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 23 to 24, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 24 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:02.872790 10460 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:01:02.890810  2294 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 34 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:01:02.891618  2294 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 33.
I20260709 13:01:02.901706  1582 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
W20260709 13:01:02.903311  1581 leader_election.cc:336] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
I20260709 13:01:02.908560 10424 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260709 13:01:02.909042 10424 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 33 FOLLOWER]: Starting leader election (detected failure of leader dbe6a89d0e1c4137b3a1b17bf4b520d8)
I20260709 13:01:02.909394 10424 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 33 FOLLOWER]: Advancing to term 34
W20260709 13:01:02.957928 10492 log.cc:927] Time spent T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 13:01:02.962622  2267 consensus_peers.cc:597] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:02.971091  2295 raft_consensus.cc:2955] T 5664f3181d5c4b20bb8443fb79030930 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:01:02.979250  2294 raft_consensus.cc:1275] T 97e583cb09524a098c997f9996eb5b03 P 1d6516ff61104bdda54bde95e92fe579 [term 24 LEARNER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:01:02.967865 10424 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 34 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:02.983182 10446 consensus_queue.cc:1048] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:01:02.984939 10424 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 34 election: Requested vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:01:02.986805  2303 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac600187e28f4d0fa948e0d053317e88" candidate_uuid: "c262eac7fc904ae9bb91e450f6532e3f" candidate_term: 34 candidate_status { last_received { term: 33 index: 20 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579"
I20260709 13:01:02.987695  2303 raft_consensus.cc:3060] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 33 FOLLOWER]: Advancing to term 34
W20260709 13:01:03.003631  2267 consensus_peers.cc:597] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:02.985931 10384 raft_consensus.cc:2955] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 21 LEADER]: Committing config change with OpId 21.15: config changed from index 14 to 15, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:01:03.007830  2303 raft_consensus.cc:2468] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c262eac7fc904ae9bb91e450f6532e3f in term 34.
I20260709 13:01:03.009377  1582 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f; no voters: 
I20260709 13:01:03.010835 10479 raft_consensus.cc:2804] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 34 FOLLOWER]: Leader election won for term 34
I20260709 13:01:03.011361 10479 raft_consensus.cc:697] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 34 LEADER]: Becoming Leader. State: Replica: c262eac7fc904ae9bb91e450f6532e3f, State: Running, Role: LEADER
I20260709 13:01:03.012243 10479 consensus_queue.cc:237] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 33.20, Last appended by leader: 20, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:01:03.033409  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 114150us
I20260709 13:01:03.051234  1689 raft_consensus.cc:1275] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
W20260709 13:01:03.055276  1655 consensus_peers.cc:597] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:03.087669 10394 consensus_queue.cc:1048] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:01:03.088945  1439 catalog_manager.cc:5697] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f reported cstate change: term changed from 33 to 34, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194). New cstate: current_term: 34 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:03.103343  1687 raft_consensus.cc:2955] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 13:01:03.110558  1581 consensus_peers.cc:597] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:03.111184  1581 leader_election.cc:336] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [CANDIDATE]: Term 34 election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
W20260709 13:01:03.111876  1581 consensus_peers.cc:597] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:03.124686  1581 consensus_peers.cc:597] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:03.168715  1581 consensus_peers.cc:597] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:03.186126  1434 catalog_manager.cc:5697] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index 14 to 15, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } attrs { replace: true } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:01:03.212110 10451 raft_consensus.cc:2955] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 24 LEADER]: Committing config change with OpId 24.17: config changed from index 16 to 17, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 13:01:03.215982  1425 catalog_manager.cc:4755] TS dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8a2233a4e08d4138b4eb687a0440be86: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
W20260709 13:01:03.219949  2267 consensus_peers.cc:597] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:03.233675  1689 raft_consensus.cc:1275] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:01:03.241442  1689 raft_consensus.cc:2955] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Committing config change with OpId 24.17: config changed from index 16 to 17, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:01:03.246757  1613 raft_consensus.cc:1275] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:01:03.251893 10464 consensus_queue.cc:1048] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:01:03.265918  2294 raft_consensus.cc:2955] T 97e583cb09524a098c997f9996eb5b03 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Committing config change with OpId 24.17: config changed from index 16 to 17, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 13:01:03.275465  1655 consensus_peers.cc:597] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:03.281512  2267 consensus_peers.cc:597] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:03.286021  2267 consensus_peers.cc:597] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:03.246876 10443 consensus_queue.cc:1048] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.042s
I20260709 13:01:03.328464 10394 raft_consensus.cc:1064] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f: attempting to promote NON_VOTER 1d6516ff61104bdda54bde95e92fe579 to VOTER
I20260709 13:01:03.330888 10394 consensus_queue.cc:237] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:03.344887  1616 raft_consensus.cc:1275] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Refusing update from remote peer 1d6516ff61104bdda54bde95e92fe579: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:01:03.356133 10464 consensus_queue.cc:1048] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.008s
W20260709 13:01:03.374107  2267 consensus_peers.cc:597] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:03.379372  2267 consensus_peers.cc:597] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:03.386420  1655 consensus_peers.cc:597] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:03.387348  1439 catalog_manager.cc:5697] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 25 to 26, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 26 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:03.400417  2294 raft_consensus.cc:1275] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 34 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 33 index: 20. Preceding OpId from leader: term: 34 index: 21. (index mismatch)
I20260709 13:01:03.414785  1439 catalog_manager.cc:5697] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: term changed from 24 to 25, leader changed from dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) to 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196). New cstate: current_term: 25 leader_uuid: "1d6516ff61104bdda54bde95e92fe579" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:03.415443  2267 consensus_peers.cc:597] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:01:03.417068 10451 consensus_queue.cc:1048] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260709 13:01:03.406318  1434 catalog_manager.cc:5697] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d reported cstate change: config changed from index 16 to 17, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 24 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 13:01:03.503320  1581 consensus_peers.cc:597] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:03.505055  2303 raft_consensus.cc:1275] T d630fd40a4084d87954d0e6c16998a70 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEARNER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:01:03.527683 10394 consensus_queue.cc:1048] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:01:03.565282  1688 raft_consensus.cc:1275] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:01:03.570001  2267 consensus_peers.cc:597] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:01:03.572681 10449 consensus_queue.cc:1048] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:01:03.577695  1581 consensus_peers.cc:597] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:03.584573  1581 consensus_peers.cc:597] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:03.613888  1581 consensus_peers.cc:597] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:03.631966 10518 log.cc:927] Time spent T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f: Append to log took a long time: real 0.153s	user 0.002s	sys 0.000s
I20260709 13:01:03.672103  1610 consensus_queue.cc:237] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:03.681070  2303 raft_consensus.cc:1275] T 5664f3181d5c4b20bb8443fb79030930 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:01:03.681892 10384 raft_consensus.cc:2955] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:01:03.692865 10394 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:01:03.714351  1687 raft_consensus.cc:1275] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Refusing update from remote peer c262eac7fc904ae9bb91e450f6532e3f: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:01:03.722834  2295 raft_consensus.cc:2955] T d630fd40a4084d87954d0e6c16998a70 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:01:03.717592 10507 consensus_queue.cc:1048] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:01:03.748368 10461 raft_consensus.cc:2955] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 21 LEADER]: Committing config change with OpId 21.16: config changed from index 15 to 16, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:01:03.750203  2303 raft_consensus.cc:2955] T 5664f3181d5c4b20bb8443fb79030930 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Committing config change with OpId 21.16: config changed from index 15 to 16, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:01:03.758096  1687 raft_consensus.cc:2955] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:01:03.782588  1439 catalog_manager.cc:5697] T d630fd40a4084d87954d0e6c16998a70 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 11 to 12, 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 13:01:03.801586  1581 consensus_peers.cc:597] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:03.811726  1581 consensus_peers.cc:597] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:03.822190  1581 consensus_peers.cc:597] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:01:03.826447  1687 raft_consensus.cc:2955] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Committing config change with OpId 21.16: config changed from index 15 to 16, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
W20260709 13:01:03.833956   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1563)
I20260709 13:01:03.849382  1439 catalog_manager.cc:5697] T 5664f3181d5c4b20bb8443fb79030930 P 1d6516ff61104bdda54bde95e92fe579 reported cstate change: config changed from index 15 to 16, VOTER dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193) evicted. New cstate: current_term: 21 leader_uuid: "c262eac7fc904ae9bb91e450f6532e3f" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } } }
I20260709 13:01:03.855010  1424 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5664f3181d5c4b20bb8443fb79030930 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:01:03.866496  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 86505.3us
W20260709 13:01:03.901717  2267 consensus_peers.cc:597] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:03.918661  1581 consensus_peers.cc:597] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:03.973078  1581 consensus_peers.cc:597] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:04.082392  1655 consensus_peers.cc:597] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:04.086349  2267 consensus_peers.cc:597] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:04.108768  2267 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111) [suppressed 434 similar messages]
W20260709 13:01:04.113628  2267 consensus_peers.cc:597] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:04.226012  1581 consensus_peers.cc:597] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:04.240372  1581 consensus_peers.cc:597] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:04.246622  1655 consensus_peers.cc:597] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:04.304366  1581 consensus_peers.cc:597] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:04.314399  1425 catalog_manager.cc:4755] TS dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5664f3181d5c4b20bb8443fb79030930: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
W20260709 13:01:04.323125  1581 consensus_peers.cc:597] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:04.375872  2267 consensus_peers.cc:597] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:04.376518  2267 consensus_peers.cc:597] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:04.453698  1581 consensus_peers.cc:597] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:04.622655  2267 consensus_peers.cc:597] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:04.637847  2267 consensus_peers.cc:597] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:04.736954  1581 consensus_peers.cc:597] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:04.834517   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 1563)
W20260709 13:01:04.892445  2267 consensus_peers.cc:597] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:04.899760  1581 consensus_peers.cc:597] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:04.999989  1581 consensus_peers.cc:597] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:05.182278  1655 consensus_peers.cc:597] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:05.328667  1425 catalog_manager.cc:4755] TS dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5664f3181d5c4b20bb8443fb79030930: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
W20260709 13:01:05.330128  2267 consensus_peers.cc:597] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:05.418062  1581 consensus_peers.cc:597] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:05.456094  1581 consensus_peers.cc:597] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:05.456673  1581 consensus_peers.cc:597] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:05.617892  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 119453us
W20260709 13:01:05.731897  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 227569us
W20260709 13:01:05.835024   431 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 1563)
W20260709 13:01:05.894583  1655 consensus_peers.cc:597] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:05.910665  1581 consensus_peers.cc:597] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:05.937896  2267 consensus_peers.cc:597] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:05.943521  2267 consensus_peers.cc:597] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:05.979140  1655 consensus_peers.cc:597] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:05.998201  2267 consensus_peers.cc:597] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:05.998962  2267 consensus_peers.cc:597] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:05.999512  2267 consensus_peers.cc:597] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:05.999670  1655 consensus_peers.cc:597] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:06.041762  2267 consensus_peers.cc:597] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:06.046985  2267 consensus_peers.cc:597] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:06.063251  1581 consensus_peers.cc:597] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:06.091078  1581 consensus_peers.cc:597] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:06.106314  1581 consensus_peers.cc:597] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:06.461947  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 61895.6us
W20260709 13:01:06.468954  1712 debug-util.cc:398] Leaking SignalData structure 0x7b0800321740 after lost signal to thread 434
W20260709 13:01:06.470157  1712 debug-util.cc:398] Leaking SignalData structure 0x7b08003445e0 after lost signal to thread 1474
W20260709 13:01:06.471514  1712 debug-util.cc:398] Leaking SignalData structure 0x7b08001bf8e0 after lost signal to thread 1641
W20260709 13:01:06.472649  1712 debug-util.cc:398] Leaking SignalData structure 0x7b08000f1a60 after lost signal to thread 1715
W20260709 13:01:06.479776  1712 debug-util.cc:398] Leaking SignalData structure 0x7b08003e60c0 after lost signal to thread 2327
W20260709 13:01:06.570950  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 47205.8us
W20260709 13:01:06.573778  1425 catalog_manager.cc:4755] TS dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5664f3181d5c4b20bb8443fb79030930: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
W20260709 13:01:06.585930  1581 consensus_peers.cc:597] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:06.592574  1581 consensus_peers.cc:597] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:06.598129  2267 consensus_peers.cc:597] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:06.613595  1581 consensus_peers.cc:597] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:06.625195  1581 consensus_peers.cc:597] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:06.753122  2267 consensus_peers.cc:597] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:06.835544   431 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 1563)
W20260709 13:01:06.908418  1655 consensus_peers.cc:597] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:06.912266  1581 consensus_peers.cc:597] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:06.917748  1581 consensus_peers.cc:597] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:06.945978  1581 consensus_peers.cc:597] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:06.946516  1581 consensus_peers.cc:597] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:06.965363  1581 consensus_peers.cc:597] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:06.966166  1581 consensus_peers.cc:597] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:07.108968  1581 consensus_peers.cc:597] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:07.109627  1581 consensus_peers.cc:597] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:07.110004  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 43706.5us
W20260709 13:01:07.141156  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 119903us
W20260709 13:01:07.184327  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 56625.1us
W20260709 13:01:07.190214  2267 consensus_peers.cc:597] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:07.193239  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41953, user_credentials={real_user=slave}} blocked reactor thread for 157879us
W20260709 13:01:07.204222  2267 consensus_peers.cc:597] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:07.204818  2267 consensus_peers.cc:597] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:07.218652  2267 consensus_peers.cc:597] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:07.225667  2267 consensus_peers.cc:597] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:07.256127  1471 debug-util.cc:398] Leaking SignalData structure 0x7b0800008fa0 after lost signal to thread 434
W20260709 13:01:07.257349  1471 debug-util.cc:398] Leaking SignalData structure 0x7b08001757c0 after lost signal to thread 1474
W20260709 13:01:07.258831  1471 debug-util.cc:398] Leaking SignalData structure 0x7b0800228760 after lost signal to thread 1641
W20260709 13:01:07.264132  1471 debug-util.cc:398] Leaking SignalData structure 0x7b080026d1a0 after lost signal to thread 1715
W20260709 13:01:07.268554  1471 debug-util.cc:398] Leaking SignalData structure 0x7b08003ca9e0 after lost signal to thread 2327
W20260709 13:01:07.455132  1581 consensus_peers.cc:597] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:07.458398  2267 consensus_peers.cc:597] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:07.524542  1655 consensus_peers.cc:597] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:07.550529  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 72315.7us
W20260709 13:01:07.806879  1581 consensus_peers.cc:597] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:07.813234  2267 consensus_peers.cc:597] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:07.836958   431 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 1563)
W20260709 13:01:07.870528  2267 consensus_peers.cc:597] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:07.929039  1581 consensus_peers.cc:597] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:08.021420  2267 consensus_peers.cc:597] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:08.046511  2267 consensus_peers.cc:597] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:08.062511  1655 consensus_peers.cc:597] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:08.113062  1581 consensus_peers.cc:597] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:08.224995  2267 consensus_peers.cc:597] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:08.236804  1581 consensus_peers.cc:597] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:08.292093  1655 consensus_peers.cc:597] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:08.330808  1655 consensus_peers.cc:597] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:08.341234  1425 catalog_manager.cc:4755] TS dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9324141fa1ba48aca59e97123ca5742e: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
W20260709 13:01:08.359710  2267 consensus_peers.cc:597] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:08.446520  1581 consensus_peers.cc:597] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:08.468712  2267 consensus_peers.cc:597] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:08.521317  1581 consensus_peers.cc:597] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:08.566807  1581 consensus_peers.cc:597] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:08.899967  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 350788us
W20260709 13:01:08.692613  2267 consensus_peers.cc:597] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:08.837553   431 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 1563)
W20260709 13:01:09.077965  2267 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 385348us
W20260709 13:01:08.691994  1655 consensus_peers.cc:597] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:09.079332  1655 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 387181us
W20260709 13:01:09.127182  1655 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111) [suppressed 384 similar messages]
W20260709 13:01:09.132498  1583 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 113165us
W20260709 13:01:09.190629  2267 consensus_peers.cc:597] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:09.274698  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 49417us
W20260709 13:01:09.367391  2267 consensus_peers.cc:597] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:09.368242  1581 consensus_peers.cc:597] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:09.375415  1581 consensus_peers.cc:597] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:09.376096  1581 consensus_peers.cc:597] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:09.384835  1581 consensus_peers.cc:597] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:09.485285  1581 consensus_peers.cc:597] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:09.530334  1425 catalog_manager.cc:4755] TS dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8a2233a4e08d4138b4eb687a0440be86: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
W20260709 13:01:09.574978  2267 consensus_peers.cc:597] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:09.614557  1655 consensus_peers.cc:597] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:09.650673  2267 consensus_peers.cc:597] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:09.698716  2267 consensus_peers.cc:597] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:09.709780  1581 consensus_peers.cc:597] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:09.719916  1581 consensus_peers.cc:597] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:09.720706  1581 consensus_peers.cc:597] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:09.766397  2267 consensus_peers.cc:597] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:09.771579  1581 consensus_peers.cc:597] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:09.772332  1581 consensus_peers.cc:597] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:09.781446  1581 consensus_peers.cc:597] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:09.791788  1638 debug-util.cc:398] Leaking SignalData structure 0x7b08001c42a0 after lost signal to thread 434
W20260709 13:01:09.793114  1638 debug-util.cc:398] Leaking SignalData structure 0x7b080018bfe0 after lost signal to thread 1474
W20260709 13:01:09.794521  1638 debug-util.cc:398] Leaking SignalData structure 0x7b08003ac300 after lost signal to thread 1641
W20260709 13:01:09.804608  1638 debug-util.cc:398] Leaking SignalData structure 0x7b080025e8e0 after lost signal to thread 1715
W20260709 13:01:09.806035  1638 debug-util.cc:398] Leaking SignalData structure 0x7b080038a760 after lost signal to thread 2327
W20260709 13:01:09.845358  1581 consensus_peers.cc:597] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:10.012701  2267 consensus_peers.cc:597] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:10.075770  1581 consensus_peers.cc:597] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:10.078146   431 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 1563)
W20260709 13:01:10.147420  1655 consensus_peers.cc:597] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:10.199575  1581 consensus_peers.cc:597] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:10.263055  2267 consensus_peers.cc:597] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:10.309666  2267 consensus_peers.cc:597] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:10.344154  1581 consensus_peers.cc:597] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:10.404299  2267 consensus_peers.cc:597] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:10.477344  2267 consensus_peers.cc:597] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:10.478269  1655 consensus_peers.cc:597] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:10.559535  2267 consensus_peers.cc:597] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:10.571818  2267 consensus_peers.cc:597] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:10.682320  1581 consensus_peers.cc:597] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:10.804774  2267 consensus_peers.cc:597] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:10.871737  1655 consensus_peers.cc:597] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:10.921154  1581 consensus_peers.cc:597] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:11.070724  2267 consensus_peers.cc:597] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:11.078640   431 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 1563)
W20260709 13:01:11.123548  1581 consensus_peers.cc:597] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:11.141557  1655 consensus_peers.cc:597] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:11.175469  2267 consensus_peers.cc:597] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:11.195178  1655 consensus_peers.cc:597] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:11.259429  2267 consensus_peers.cc:597] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:11.333364  2267 consensus_peers.cc:597] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:11.335738  1581 consensus_peers.cc:597] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:11.396052  1581 consensus_peers.cc:597] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:11.581159  1581 consensus_peers.cc:597] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:11.597388  1581 consensus_peers.cc:597] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:11.596662  2269 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45275, user_credentials={real_user=slave}} blocked reactor thread for 105899us
W20260709 13:01:11.631060  1581 consensus_peers.cc:597] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:11.650101  1581 consensus_peers.cc:597] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:11.765995  1581 consensus_peers.cc:597] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:11.880442  2267 consensus_peers.cc:597] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:11.958889  1581 consensus_peers.cc:597] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:11.976063  2267 consensus_peers.cc:597] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:11.991147  2267 consensus_peers.cc:597] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:12.015461  1581 consensus_peers.cc:597] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:12.025862  1581 consensus_peers.cc:597] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:12.079155   431 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 1563)
W20260709 13:01:12.170128  1581 consensus_peers.cc:597] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:12.204540  1581 consensus_peers.cc:597] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:12.229892  2267 consensus_peers.cc:597] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:12.281308  1581 consensus_peers.cc:597] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:12.293048  1581 consensus_peers.cc:597] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:12.361340  1581 consensus_peers.cc:597] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:12.477478  1581 consensus_peers.cc:597] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:12.508275  1655 consensus_peers.cc:597] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:12.733148  1655 consensus_peers.cc:597] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:12.746140  2267 consensus_peers.cc:597] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:12.779608  2267 consensus_peers.cc:597] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:12.780232  2267 consensus_peers.cc:597] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:12.789687  2267 consensus_peers.cc:597] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:12.806813  1425 catalog_manager.cc:4755] TS dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5664f3181d5c4b20bb8443fb79030930: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
W20260709 13:01:12.816224  2267 consensus_peers.cc:597] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:12.807088  1581 consensus_peers.cc:597] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:12.835045  2267 consensus_peers.cc:597] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:12.836319  1581 consensus_peers.cc:597] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:12.881057  1581 consensus_peers.cc:597] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:13.062458  2267 consensus_peers.cc:597] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:13.097031  2267 consensus_peers.cc:597] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:13.387049  1581 consensus_peers.cc:597] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:13.429306  1655 consensus_peers.cc:597] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:13.532557  1581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:43903, user_credentials={real_user=slave}} blocked reactor thread for 140423us
W20260709 13:01:13.563258  1655 consensus_peers.cc:597] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:13.624377  2267 consensus_peers.cc:597] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:13.639964  2267 consensus_peers.cc:597] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:13.640962  2267 consensus_peers.cc:597] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:01:13.644770   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:01:13.647655  1581 consensus_peers.cc:597] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:13.648415  1581 consensus_peers.cc:597] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:13.687343  2267 consensus_peers.cc:597] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:01:13.819475   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:01:13.833034  1655 consensus_peers.cc:597] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:13.883829  1654 consensus_peers.cc:597] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d -> Peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Couldn't send request to peer c262eac7fc904ae9bb91e450f6532e3f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:13.890345   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:13.893606   431 tablet_replica.cc:333] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:13.894589   431 raft_consensus.cc:2243] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:13.895481   431 raft_consensus.cc:2272] T 0ff814cc76e74038894b6ec316f8749f P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.897939   431 tablet_replica.cc:333] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:13.898641   431 raft_consensus.cc:2243] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.899603   431 raft_consensus.cc:2272] T 677340b0a53f4ce8b314f9294bdaa546 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.902192   431 tablet_replica.cc:333] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:13.902945   431 raft_consensus.cc:2243] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.903736   431 raft_consensus.cc:2272] T 40880327f92147c1936b74eee0e6724d P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.905719   431 tablet_replica.cc:333] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:13.906267   431 raft_consensus.cc:2243] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:13.907111   431 raft_consensus.cc:2272] T 97c958beecec40918b63217135840ff6 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.910703   431 tablet_replica.cc:333] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:13.912248   431 raft_consensus.cc:2243] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.913494   431 raft_consensus.cc:2272] T 8b1b65240a814ade9a4dff9820c94dd0 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.916265   431 tablet_replica.cc:333] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:13.917220   431 raft_consensus.cc:2243] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:13.917870  1654 consensus_peers.cc:597] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d -> Peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Couldn't send request to peer c262eac7fc904ae9bb91e450f6532e3f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:13.918104   431 raft_consensus.cc:2272] T 1a9d2e2602bd4118abc0a8629a67005c P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:13.918771  1654 consensus_peers.cc:597] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d -> Peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Couldn't send request to peer c262eac7fc904ae9bb91e450f6532e3f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:13.921072   431 tablet_replica.cc:333] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:13.922066   431 raft_consensus.cc:2243] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.923349   431 raft_consensus.cc:2272] T d36fee36a84e4cf98ad42f287d4f317f P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.927826   431 tablet_replica.cc:333] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:13.929600   431 raft_consensus.cc:2243] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:13.930158   431 raft_consensus.cc:2272] T d2eccdddaa724fed8954f5e5bc110b80 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.932462   431 tablet_replica.cc:333] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:13.933069   431 raft_consensus.cc:2243] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:13.933549   431 raft_consensus.cc:2272] T 03a87bdd56034cbaa09fbc461a7bd313 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.935987   431 tablet_replica.cc:333] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:13.936758   431 raft_consensus.cc:2243] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.937955   431 raft_consensus.cc:2272] T 920d24d01316479692fb62f167beb41e P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:13.938875  1581 consensus_peers.cc:597] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:01:13.940505   431 tablet_replica.cc:333] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:13.941123   431 raft_consensus.cc:2243] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.942176   431 raft_consensus.cc:2272] T 12b2051da69c4c7f8b35da07093dfc33 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.945464   431 tablet_replica.cc:333] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:13.946297   431 raft_consensus.cc:2243] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:13.947242  1654 consensus_peers.cc:597] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d -> Peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Couldn't send request to peer c262eac7fc904ae9bb91e450f6532e3f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:13.947254   431 raft_consensus.cc:2272] T 7d92e33e89814e86abdebb8b54a3a5c5 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.951838   431 tablet_replica.cc:333] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:13.953040   431 raft_consensus.cc:2243] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.954187   431 raft_consensus.cc:2272] T d7727fcb0cf9452fbbc077ab7987b596 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.956848   431 tablet_replica.cc:333] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:13.957995   431 raft_consensus.cc:2243] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.959156   431 raft_consensus.cc:2272] T db702b262c1644109366a56f6f0d805a P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.961714   431 tablet_replica.cc:333] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:13.962361   431 raft_consensus.cc:2243] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.963490   431 raft_consensus.cc:2272] T d5d52e25b9814edbb805e7d6bcce5b5d P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.966183   431 tablet_replica.cc:333] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:13.966802   431 raft_consensus.cc:2243] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.967748   431 raft_consensus.cc:2272] T f0a8a9b410b84b569aa1245ad95bb229 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.969976   431 tablet_replica.cc:333] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:13.970574   431 raft_consensus.cc:2243] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:13.971055   431 raft_consensus.cc:2272] T 07ac6d2e7442458585e7eca31089d547 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.972954   431 tablet_replica.cc:333] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:13.973543   431 raft_consensus.cc:2243] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:13.974071   431 raft_consensus.cc:2272] T e4681eaad3084357b9677e4242b97c99 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.976511   431 tablet_replica.cc:333] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:13.977283   431 raft_consensus.cc:2243] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 30 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.978332   431 raft_consensus.cc:2272] T b7634482da3645aeb7462251e5df3726 P c262eac7fc904ae9bb91e450f6532e3f [term 30 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:13.978765  2266 consensus_peers.cc:597] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 -> Peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Couldn't send request to peer c262eac7fc904ae9bb91e450f6532e3f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:13.981237   431 tablet_replica.cc:333] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:13.982146   431 raft_consensus.cc:2243] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.983310   431 raft_consensus.cc:2272] T 62a133aa1e234c489eaeb6341dc87b49 P c262eac7fc904ae9bb91e450f6532e3f [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:13.985294  1654 consensus_peers.cc:597] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d -> Peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Couldn't send request to peer c262eac7fc904ae9bb91e450f6532e3f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:13.986074   431 tablet_replica.cc:333] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:13.986979   431 raft_consensus.cc:2243] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.988267   431 raft_consensus.cc:2272] T cc0adb56140a4e698e722f4960e13783 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:13.988406  1655 consensus_peers.cc:597] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:01:13.991220   431 tablet_replica.cc:333] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:13.992070   431 raft_consensus.cc:2243] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:13.993636   431 raft_consensus.cc:2272] T d630fd40a4084d87954d0e6c16998a70 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:13.994306  2267 consensus_peers.cc:597] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:01:13.996394   431 tablet_replica.cc:333] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:13.997130   431 raft_consensus.cc:2243] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:13.997649   431 raft_consensus.cc:2272] T a73b99964f4c4107aed2d05c6106b3b5 P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.999691   431 tablet_replica.cc:333] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:14.000406   431 raft_consensus.cc:2243] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:01:14.001576   431 raft_consensus.cc:2272] T 0507fcc8f9794c668a81d8519fc995be P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:14.004048   431 tablet_replica.cc:333] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:14.004786   431 raft_consensus.cc:2243] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:14.005440   431 raft_consensus.cc:2272] T a5981b12945c4d5b8d59d139eb1c77a2 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:14.005633  2266 consensus_peers.cc:597] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 -> Peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Couldn't send request to peer c262eac7fc904ae9bb91e450f6532e3f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:14.007532   431 tablet_replica.cc:333] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:14.008172   431 raft_consensus.cc:2243] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:14.009145   431 raft_consensus.cc:2272] T 5c8fc263f1e8493db14b8c7a8e316a9f P c262eac7fc904ae9bb91e450f6532e3f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:14.011341   431 tablet_replica.cc:333] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:14.012039   431 raft_consensus.cc:2243] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:14.012997   431 raft_consensus.cc:2272] T 9324141fa1ba48aca59e97123ca5742e P c262eac7fc904ae9bb91e450f6532e3f [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:14.015380   431 tablet_replica.cc:333] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:14.015971   431 raft_consensus.cc:2243] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:14.016774   431 raft_consensus.cc:2272] T d8b7121a813948bfa350d3f0b9fd6988 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:14.019047   431 tablet_replica.cc:333] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:14.019667   431 raft_consensus.cc:2243] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:14.020210   431 raft_consensus.cc:2272] T 6578815705874ccfb147b36c5f6db70a P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:14.022395   431 tablet_replica.cc:333] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:14.023145   431 raft_consensus.cc:2243] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:14.023953   431 raft_consensus.cc:2272] T d3cb0f1c44ec45f38ff2f0c27480a08c P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:14.026784   431 tablet_replica.cc:333] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:14.027348   431 raft_consensus.cc:2243] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:14.027984   431 raft_consensus.cc:2272] T db011c2c8016405d968fe57a093fc111 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:14.030308   431 tablet_replica.cc:333] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:14.030892   431 raft_consensus.cc:2243] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:01:14.032193   431 raft_consensus.cc:2272] T d127be99e2af41c0808e03480c1b64e3 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:14.035024   431 tablet_replica.cc:333] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
W20260709 13:01:14.035290  1654 consensus_peers.cc:597] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d -> Peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Couldn't send request to peer c262eac7fc904ae9bb91e450f6532e3f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:14.035885   431 raft_consensus.cc:2243] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:01:14.037639   431 raft_consensus.cc:2272] T 97e583cb09524a098c997f9996eb5b03 P c262eac7fc904ae9bb91e450f6532e3f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:14.040570   431 tablet_replica.cc:333] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:14.041391   431 raft_consensus.cc:2243] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:01:14.042567   431 raft_consensus.cc:2272] T f0eedb9e9c8c4177903e544c600553f3 P c262eac7fc904ae9bb91e450f6532e3f [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:14.045042  2266 consensus_peers.cc:597] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 -> Peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Couldn't send request to peer c262eac7fc904ae9bb91e450f6532e3f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:14.045280   431 tablet_replica.cc:333] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:14.046056   431 raft_consensus.cc:2243] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:14.046655   431 raft_consensus.cc:2272] T e4d03bbba4ce46ecb686052832c7b862 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:14.049142   431 tablet_replica.cc:333] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:14.049742   431 raft_consensus.cc:2243] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:01:14.050837   431 raft_consensus.cc:2272] T 5664f3181d5c4b20bb8443fb79030930 P c262eac7fc904ae9bb91e450f6532e3f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:14.053386   431 tablet_replica.cc:333] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:14.054176   431 raft_consensus.cc:2243] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:01:14.055207   431 raft_consensus.cc:2272] T 22060ec6ef664a749065c3f00807b450 P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:14.057806   431 tablet_replica.cc:333] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:14.058348   431 raft_consensus.cc:2243] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:14.059166   431 raft_consensus.cc:2272] T 3c62b87395ba4c3a9a99163b300d7ddf P c262eac7fc904ae9bb91e450f6532e3f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:14.062362   431 tablet_replica.cc:333] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:14.062987   431 raft_consensus.cc:2243] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:01:14.064116   431 raft_consensus.cc:2272] T 8a2233a4e08d4138b4eb687a0440be86 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:14.066360   431 tablet_replica.cc:333] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:14.067008   431 raft_consensus.cc:2243] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:14.067705   431 raft_consensus.cc:2272] T eabf19413eea44dd86511e07a036166b P c262eac7fc904ae9bb91e450f6532e3f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:14.070070   431 tablet_replica.cc:333] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:14.070706   431 raft_consensus.cc:2243] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:14.071297   431 raft_consensus.cc:2272] T 9b4de1379d73445699a2babbca8fce44 P c262eac7fc904ae9bb91e450f6532e3f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:14.073935   431 tablet_replica.cc:333] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:14.074633   431 raft_consensus.cc:2243] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:01:14.078084   431 raft_consensus.cc:2272] T cdff63e2a2e94c729942046ee2f02a09 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:14.080039  2266 consensus_peers.cc:597] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 -> Peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Couldn't send request to peer c262eac7fc904ae9bb91e450f6532e3f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:14.081962   431 tablet_replica.cc:333] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:14.082652   431 raft_consensus.cc:2243] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 34 LEADER]: Raft consensus shutting down.
I20260709 13:01:14.083781   431 raft_consensus.cc:2272] T ac600187e28f4d0fa948e0d053317e88 P c262eac7fc904ae9bb91e450f6532e3f [term 34 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:14.086679   431 tablet_replica.cc:333] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:14.087387   431 raft_consensus.cc:2243] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 22 LEADER]: Raft consensus shutting down.
W20260709 13:01:14.087847  1654 consensus_peers.cc:597] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d -> Peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Couldn't send request to peer c262eac7fc904ae9bb91e450f6532e3f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:14.088444   431 raft_consensus.cc:2272] T 0e84698abe8e46788d46c9bf8a4c74c7 P c262eac7fc904ae9bb91e450f6532e3f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:14.090657   431 tablet_replica.cc:333] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:14.091346   431 raft_consensus.cc:2243] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:14.091845   431 raft_consensus.cc:2272] T 499cf87d55ba434fa03c7cf6c1bb54c8 P c262eac7fc904ae9bb91e450f6532e3f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:14.093847   431 tablet_replica.cc:333] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:14.094367   431 raft_consensus.cc:2243] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:14.094872   431 raft_consensus.cc:2272] T dbdf9662619648c4a3b76fbbda8d0e14 P c262eac7fc904ae9bb91e450f6532e3f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:14.097231   431 tablet_replica.cc:333] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f: stopping tablet replica
I20260709 13:01:14.097844   431 raft_consensus.cc:2243] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:14.098407   431 raft_consensus.cc:2272] T 147199196d114d4c90fd8fba442ab7d8 P c262eac7fc904ae9bb91e450f6532e3f [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:14.111820  1654 consensus_peers.cc:597] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d -> Peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Couldn't send request to peer c262eac7fc904ae9bb91e450f6532e3f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:14.128103  1654 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 468 similar messages]
W20260709 13:01:14.130956  1654 consensus_peers.cc:597] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d -> Peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Couldn't send request to peer c262eac7fc904ae9bb91e450f6532e3f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:14.133476  2266 consensus_peers.cc:597] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 -> Peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Couldn't send request to peer c262eac7fc904ae9bb91e450f6532e3f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:14.182833  2266 consensus_peers.cc:597] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 -> Peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Couldn't send request to peer c262eac7fc904ae9bb91e450f6532e3f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:14.212045  2266 consensus_peers.cc:597] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 -> Peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Couldn't send request to peer c262eac7fc904ae9bb91e450f6532e3f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:14.246589  2266 consensus_peers.cc:597] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 -> Peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Couldn't send request to peer c262eac7fc904ae9bb91e450f6532e3f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:14.261783  1654 consensus_peers.cc:597] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d -> Peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Couldn't send request to peer c262eac7fc904ae9bb91e450f6532e3f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:14.268214  1654 consensus_peers.cc:597] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d -> Peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Couldn't send request to peer c262eac7fc904ae9bb91e450f6532e3f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:14.307981  1654 consensus_peers.cc:597] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d -> Peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Couldn't send request to peer c262eac7fc904ae9bb91e450f6532e3f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:14.315574  1654 consensus_peers.cc:597] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d -> Peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Couldn't send request to peer c262eac7fc904ae9bb91e450f6532e3f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:14.344769  1654 consensus_peers.cc:597] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d -> Peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Couldn't send request to peer c262eac7fc904ae9bb91e450f6532e3f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:14.430769  2267 consensus_peers.cc:597] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:14.461633  2267 consensus_peers.cc:597] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:14.478363  1712 debug-util.cc:398] Leaking SignalData structure 0x7b0800298620 after lost signal to thread 434
W20260709 13:01:14.479552  1712 debug-util.cc:398] Leaking SignalData structure 0x7b08001b8f00 after lost signal to thread 1474
W20260709 13:01:14.481083  1712 debug-util.cc:398] Leaking SignalData structure 0x7b080038fa80 after lost signal to thread 1641
W20260709 13:01:14.482671  1712 debug-util.cc:398] Leaking SignalData structure 0x7b08000d2ee0 after lost signal to thread 1715
W20260709 13:01:14.483920  1712 debug-util.cc:398] Leaking SignalData structure 0x7b080039df20 after lost signal to thread 2327
W20260709 13:01:14.533067  2267 consensus_peers.cc:597] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:14.961856   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:01:14.973572  2267 consensus_peers.cc:597] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:15.037050 10612 raft_consensus.cc:493] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:01:15.037837 10612 raft_consensus.cc:515] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:01:15.069036 10619 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:01:15.069730 10619 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:15.094830 10612 leader_election.cc:290] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:01:15.099982 10615 raft_consensus.cc:493] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:01:15.100886 10615 raft_consensus.cc:515] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:01:15.103626 10615 leader_election.cc:290] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:01:15.124526 10615 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 13:01:15.105259  1655 leader_election.cc:336] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
I20260709 13:01:15.110121 10618 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:01:15.125144 10615 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:15.125520 10618 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:15.111068 10619 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:01:15.133934 10614 raft_consensus.cc:493] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:01:15.134092  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a133aa1e234c489eaeb6341dc87b49" candidate_uuid: "1d6516ff61104bdda54bde95e92fe579" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "4487a53c51be4634bf1ef29c5248353d" is_pre_election: true
I20260709 13:01:15.135179 10614 raft_consensus.cc:515] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:01:15.135912  1687 raft_consensus.cc:2468] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d6516ff61104bdda54bde95e92fe579 in term 28.
I20260709 13:01:15.133599 10618 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:01:15.112108   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:01:15.121760 10612 raft_consensus.cc:493] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:01:15.138466 10612 raft_consensus.cc:515] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:01:15.140647  1655 leader_election.cc:336] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
I20260709 13:01:15.148818 10619 raft_consensus.cc:493] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:01:15.149504 10619 raft_consensus.cc:515] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:01:15.156138  2269 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579, 4487a53c51be4634bf1ef29c5248353d; no voters: 
I20260709 13:01:15.156335 10618 raft_consensus.cc:493] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:01:15.156944 10618 raft_consensus.cc:515] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:15.157459 10603 raft_consensus.cc:2804] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:01:15.157953 10603 raft_consensus.cc:493] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 28 FOLLOWER]: Starting leader election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:01:15.158336 10603 raft_consensus.cc:3060] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:01:15.159183 10618 leader_election.cc:290] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:01:15.159675  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d630fd40a4084d87954d0e6c16998a70" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:01:15.159196 10612 leader_election.cc:290] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:01:15.165587 10614 leader_election.cc:290] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:01:15.165591 10619 leader_election.cc:290] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:01:15.166245  2266 leader_election.cc:336] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
I20260709 13:01:15.166575 10619 raft_consensus.cc:493] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:01:15.167094 10619 raft_consensus.cc:515] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:01:15.169377 10619 leader_election.cc:290] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:01:15.170984  2266 leader_election.cc:336] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
W20260709 13:01:15.171716  1654 leader_election.cc:336] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
I20260709 13:01:15.172227  1654 leader_election.cc:304] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:01:15.173166  1654 leader_election.cc:336] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
I20260709 13:01:15.173244  1656 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:15.174041 10612 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:15.173835 10619 raft_consensus.cc:2749] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:01:15.174198  1654 leader_election.cc:336] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
I20260709 13:01:15.177145 10615 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
W20260709 13:01:15.178458  1654 leader_election.cc:336] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
W20260709 13:01:15.179145  1654 leader_election.cc:336] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
W20260709 13:01:15.179626  1654 leader_election.cc:336] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
W20260709 13:01:15.180197  1654 leader_election.cc:336] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
I20260709 13:01:15.166772 10603 raft_consensus.cc:515] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:01:15.192866  2269 consensus_peers.cc:597] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 -> Peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Couldn't send request to peer 4487a53c51be4634bf1ef29c5248353d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:15.195444  2269 consensus_peers.cc:597] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 -> Peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Couldn't send request to peer 4487a53c51be4634bf1ef29c5248353d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:15.196264  1654 leader_election.cc:336] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
W20260709 13:01:15.199713  2269 consensus_peers.cc:597] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 -> Peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Couldn't send request to peer 4487a53c51be4634bf1ef29c5248353d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:15.202924  1655 leader_election.cc:336] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
W20260709 13:01:15.204641  2267 consensus_peers.cc:597] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:15.203660  1655 leader_election.cc:304] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:01:15.203033  2269 consensus_peers.cc:597] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 -> Peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Couldn't send request to peer 4487a53c51be4634bf1ef29c5248353d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:15.206548  1655 leader_election.cc:336] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
I20260709 13:01:15.207139 10612 raft_consensus.cc:2749] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:01:15.205684  2267 leader_election.cc:336] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
I20260709 13:01:15.209856  2267 leader_election.cc:304] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:15.212661  1655 leader_election.cc:304] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:15.215378 10618 raft_consensus.cc:2749] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:15.216187 10603 leader_election.cc:290] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 29 election: Requested vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:01:15.217857  2267 consensus_peers.cc:597] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:01:15.218503 10612 raft_consensus.cc:2749] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:01:15.219478  1655 consensus_peers.cc:597] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:15.219918  1655 leader_election.cc:336] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
I20260709 13:01:15.220283  1655 leader_election.cc:304] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:01:15.223500  2269 consensus_peers.cc:597] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 -> Peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Couldn't send request to peer 4487a53c51be4634bf1ef29c5248353d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:15.225170  2269 consensus_peers.cc:597] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 -> Peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Couldn't send request to peer 4487a53c51be4634bf1ef29c5248353d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:15.235363  2298 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2233a4e08d4138b4eb687a0440be86" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 23 candidate_status { last_received { term: 22 index: 20 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:01:15.237958  1656 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
W20260709 13:01:15.240118  2269 consensus_peers.cc:597] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 -> Peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Couldn't send request to peer 4487a53c51be4634bf1ef29c5248353d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:15.240890  2269 leader_election.cc:336] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:15.241460 10612 raft_consensus.cc:2749] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:01:15.244592  2266 leader_election.cc:336] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
I20260709 13:01:15.245105  2266 leader_election.cc:304] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:01:15.245203 10612 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:15.253662 10623 raft_consensus.cc:2749] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
W20260709 13:01:15.256021  1655 leader_election.cc:336] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
I20260709 13:01:15.256546  1655 leader_election.cc:304] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:15.257728 10619 raft_consensus.cc:2749] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:01:15.257360  2269 consensus_peers.cc:597] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 -> Peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Couldn't send request to peer 4487a53c51be4634bf1ef29c5248353d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:15.258817  1655 leader_election.cc:336] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
I20260709 13:01:15.259261  1655 leader_election.cc:304] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:15.259946 10619 raft_consensus.cc:2749] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:15.260793 10622 raft_consensus.cc:493] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:01:15.261595 10622 raft_consensus.cc:515] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:15.266562 10622 leader_election.cc:290] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:01:15.271162 10619 raft_consensus.cc:493] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:01:15.274345 10619 raft_consensus.cc:515] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:01:15.276676 10619 leader_election.cc:290] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:01:15.278927 10621 raft_consensus.cc:493] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:01:15.279457 10621 raft_consensus.cc:515] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:01:15.281744 10621 leader_election.cc:290] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:01:15.284502  1654 leader_election.cc:336] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
W20260709 13:01:15.284706  1655 consensus_peers.cc:597] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:15.287675  1654 leader_election.cc:336] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
I20260709 13:01:15.290864   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:15.292244   431 tablet_replica.cc:333] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.293252   431 raft_consensus.cc:2243] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:15.295892  2269 consensus_peers.cc:597] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 -> Peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Couldn't send request to peer 4487a53c51be4634bf1ef29c5248353d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:15.296977   431 raft_consensus.cc:2272] T 40880327f92147c1936b74eee0e6724d P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.300313   431 tablet_replica.cc:333] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.301299   431 raft_consensus.cc:2243] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:01:15.301873  2269 consensus_peers.cc:597] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 -> Peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Couldn't send request to peer 4487a53c51be4634bf1ef29c5248353d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:15.302477   431 raft_consensus.cc:2272] T 97c958beecec40918b63217135840ff6 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.306313   431 tablet_replica.cc:333] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.307272   431 raft_consensus.cc:2243] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Raft consensus shutting down.
W20260709 13:01:15.307360  2269 consensus_peers.cc:597] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 -> Peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Couldn't send request to peer 4487a53c51be4634bf1ef29c5248353d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:15.307763  2267 leader_election.cc:336] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
I20260709 13:01:15.308586   431 raft_consensus.cc:2272] T 0ff814cc76e74038894b6ec316f8749f P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:15.311508  2266 leader_election.cc:336] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
I20260709 13:01:15.312048 10623 raft_consensus.cc:493] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:01:15.316089  2266 leader_election.cc:304] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:15.316195 10623 raft_consensus.cc:515] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:01:15.314776  2267 consensus_peers.cc:597] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:15.315464  1655 leader_election.cc:336] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
I20260709 13:01:15.317051 10622 raft_consensus.cc:2749] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:01:15.319928  1655 leader_election.cc:304] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:15.320777 10621 raft_consensus.cc:2749] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:01:15.312467   431 tablet_replica.cc:333] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.322388   431 raft_consensus.cc:2243] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.322847 10621 raft_consensus.cc:493] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:01:15.323375 10621 raft_consensus.cc:515] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:01:15.324947   431 raft_consensus.cc:2272] T 677340b0a53f4ce8b314f9294bdaa546 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.325562 10621 leader_election.cc:290] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:01:15.319033 10623 leader_election.cc:290] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:01:15.330163  2267 consensus_peers.cc:597] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:15.334237   431 tablet_replica.cc:333] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.335245   431 raft_consensus.cc:2243] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.335916   431 raft_consensus.cc:2272] T 8b1b65240a814ade9a4dff9820c94dd0 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:15.335825  1654 leader_election.cc:336] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
I20260709 13:01:15.339092   431 tablet_replica.cc:333] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
W20260709 13:01:15.342173  2269 consensus_peers.cc:597] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 -> Peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Couldn't send request to peer 4487a53c51be4634bf1ef29c5248353d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:15.339941   431 raft_consensus.cc:2243] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 25 LEADER]: Raft consensus shutting down.
W20260709 13:01:15.342483  2266 leader_election.cc:336] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
I20260709 13:01:15.343763   431 raft_consensus.cc:2272] T 1a9d2e2602bd4118abc0a8629a67005c P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:15.345269  1655 leader_election.cc:336] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
I20260709 13:01:15.345831  1655 leader_election.cc:304] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:15.346787   431 tablet_replica.cc:333] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.347674   431 raft_consensus.cc:2243] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:15.348405  2267 consensus_peers.cc:597] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:15.349079  2267 leader_election.cc:336] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
I20260709 13:01:15.349188 10621 raft_consensus.cc:2749] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:15.348443   431 raft_consensus.cc:2272] T 940b60c7fb3744a68751996b8bb198ca P 4487a53c51be4634bf1ef29c5248353d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.350847 10621 raft_consensus.cc:493] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:01:15.351413 10621 raft_consensus.cc:515] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:01:15.352631   431 tablet_replica.cc:333] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.353554   431 raft_consensus.cc:2243] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.354179   431 raft_consensus.cc:2272] T aa984c8881704e97b0d6a6eb60605021 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.349529  2267 leader_election.cc:304] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:15.357381 10623 raft_consensus.cc:2749] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:01:15.359578  1654 leader_election.cc:336] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
I20260709 13:01:15.356446 10621 leader_election.cc:290] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:01:15.366197   431 tablet_replica.cc:333] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.367151   431 raft_consensus.cc:2243] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:01:15.367798  1655 leader_election.cc:336] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
I20260709 13:01:15.368310  1655 leader_election.cc:304] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:15.369247 10621 raft_consensus.cc:2749] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:15.368314   431 raft_consensus.cc:2272] T 07ac6d2e7442458585e7eca31089d547 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:15.373181  1655 leader_election.cc:336] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
I20260709 13:01:15.373695  1655 leader_election.cc:304] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:15.374418 10621 raft_consensus.cc:2749] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:01:15.374693  2267 consensus_peers.cc:597] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:15.377089   431 tablet_replica.cc:333] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.378000   431 raft_consensus.cc:2243] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:01:15.379207   431 raft_consensus.cc:2272] T e4681eaad3084357b9677e4242b97c99 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.383879   431 tablet_replica.cc:333] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.384763   431 raft_consensus.cc:2243] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.384989 10621 raft_consensus.cc:493] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:01:15.385557 10621 raft_consensus.cc:515] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
W20260709 13:01:15.387951  2267 consensus_peers.cc:597] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:01:15.385459   431 raft_consensus.cc:2272] T 920d24d01316479692fb62f167beb41e P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.389266 10622 raft_consensus.cc:493] T d630fd40a4084d87954d0e6c16998a70 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:01:15.389860 10622 raft_consensus.cc:515] T d630fd40a4084d87954d0e6c16998a70 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:15.391582   431 tablet_replica.cc:333] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.395183   431 raft_consensus.cc:2243] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.396715   431 raft_consensus.cc:2272] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:15.397204  2267 leader_election.cc:336] T d630fd40a4084d87954d0e6c16998a70 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
W20260709 13:01:15.397643  1654 leader_election.cc:336] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
I20260709 13:01:15.387890 10621 leader_election.cc:290] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:01:15.397915  2266 leader_election.cc:336] T d630fd40a4084d87954d0e6c16998a70 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
I20260709 13:01:15.399405  2266 leader_election.cc:304] T d630fd40a4084d87954d0e6c16998a70 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:15.398746 10622 leader_election.cc:290] T d630fd40a4084d87954d0e6c16998a70 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:01:15.400107 10623 raft_consensus.cc:2749] T d630fd40a4084d87954d0e6c16998a70 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:15.404085  2269 leader_election.cc:336] T d630fd40a4084d87954d0e6c16998a70 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:15.409273  2269 consensus_peers.cc:597] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 -> Peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Couldn't send request to peer 4487a53c51be4634bf1ef29c5248353d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:15.409525  1655 leader_election.cc:336] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
I20260709 13:01:15.410187  1655 leader_election.cc:304] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:01:15.410894  1655 raft_consensus.cc:2686] T db702b262c1644109366a56f6f0d805a P 4487a53c51be4634bf1ef29c5248353d: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:01:15.413319   431 tablet_replica.cc:333] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.414462 10623 raft_consensus.cc:493] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 34 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:01:15.415068 10623 raft_consensus.cc:515] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:15.416416 10621 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:01:15.416996 10621 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:15.417735 10623 leader_election.cc:290] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:01:15.414310   431 raft_consensus.cc:2243] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.419101 10621 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:01:15.419229   431 raft_consensus.cc:2272] T 398a6324f64f46b0accba6cac64dfec6 P 4487a53c51be4634bf1ef29c5248353d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.422143   431 tablet_replica.cc:333] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.423032   431 raft_consensus.cc:2243] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:01:15.424275 10623 raft_consensus.cc:493] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:01:15.424906 10623 raft_consensus.cc:515] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:15.427481 10623 leader_election.cc:290] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:01:15.428558  1654 leader_election.cc:336] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
I20260709 13:01:15.428750  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5664f3181d5c4b20bb8443fb79030930" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:01:15.430282 10623 raft_consensus.cc:493] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 13:01:15.432360  2266 leader_election.cc:336] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
I20260709 13:01:15.432171 10623 raft_consensus.cc:515] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:15.432210  1656 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:01:15.434365 10621 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:15.435555 10623 leader_election.cc:290] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:01:15.433054  2267 leader_election.cc:336] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
I20260709 13:01:15.436527  2267 leader_election.cc:304] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:01:15.437464  2267 leader_election.cc:336] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
I20260709 13:01:15.442158 10622 raft_consensus.cc:2749] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
I20260709 13:01:15.440543   431 raft_consensus.cc:2272] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.447083 10619 raft_consensus.cc:493] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 30 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:01:15.447613 10619 raft_consensus.cc:515] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:01:15.448951   431 tablet_replica.cc:333] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.449863 10619 leader_election.cc:290] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:01:15.450824  2269 consensus_peers.cc:597] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 -> Peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Couldn't send request to peer 4487a53c51be4634bf1ef29c5248353d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:15.452250  2266 leader_election.cc:336] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
I20260709 13:01:15.454537  2266 leader_election.cc:304] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:15.455994 10623 raft_consensus.cc:2749] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:15.458228  1654 leader_election.cc:336] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
I20260709 13:01:15.459272 10621 raft_consensus.cc:493] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
W20260709 13:01:15.459419  2266 leader_election.cc:336] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
I20260709 13:01:15.459810 10621 raft_consensus.cc:515] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:01:15.464216 10623 raft_consensus.cc:493] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:01:15.464875 10623 raft_consensus.cc:515] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:15.466985 10623 leader_election.cc:290] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
I20260709 13:01:15.467651 10619 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:01:15.471243 10619 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:01:15.474207  2269 leader_election.cc:336] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:15.474606 10619 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 1d6516ff61104bdda54bde95e92fe579 (127.0.107.196:33437)
I20260709 13:01:15.464190 10621 leader_election.cc:290] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
W20260709 13:01:15.475138  2269 consensus_peers.cc:597] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 -> Peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Couldn't send request to peer 4487a53c51be4634bf1ef29c5248353d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:15.464560  2267 leader_election.cc:336] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
I20260709 13:01:15.477254  2267 leader_election.cc:304] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:01:15.480451  1654 leader_election.cc:336] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
I20260709 13:01:15.481148 10623 raft_consensus.cc:2749] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:15.482314  2301 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97e583cb09524a098c997f9996eb5b03" candidate_uuid: "4487a53c51be4634bf1ef29c5248353d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "1d6516ff61104bdda54bde95e92fe579" is_pre_election: true
I20260709 13:01:15.449923   431 raft_consensus.cc:2243] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.486153   431 raft_consensus.cc:2272] T cc0adb56140a4e698e722f4960e13783 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.489076   431 tablet_replica.cc:333] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
W20260709 13:01:15.483343  1655 leader_election.cc:336] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
I20260709 13:01:15.489988 10623 raft_consensus.cc:493] T 5664f3181d5c4b20bb8443fb79030930 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:01:15.490691 10623 raft_consensus.cc:515] T 5664f3181d5c4b20bb8443fb79030930 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:01:15.492435  1654 leader_election.cc:336] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
I20260709 13:01:15.492936  1654 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: 1d6516ff61104bdda54bde95e92fe579, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:01:15.490223  1655 leader_election.cc:304] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:15.493853 10621 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:01:15.494655  2266 leader_election.cc:336] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
I20260709 13:01:15.495117  2266 leader_election.cc:304] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:01:15.495795 10622 raft_consensus.cc:2749] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:01:15.495128 10621 raft_consensus.cc:2749] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
W20260709 13:01:15.503538  2266 leader_election.cc:336] T 5664f3181d5c4b20bb8443fb79030930 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
W20260709 13:01:15.504456  1655 leader_election.cc:336] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
I20260709 13:01:15.505275 10623 leader_election.cc:290] T 5664f3181d5c4b20bb8443fb79030930 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:01:15.508018  2269 leader_election.cc:336] T 5664f3181d5c4b20bb8443fb79030930 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:15.508518  2269 leader_election.cc:304] T 5664f3181d5c4b20bb8443fb79030930 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:01:15.508042   431 raft_consensus.cc:2243] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.510005 10623 raft_consensus.cc:2749] T 5664f3181d5c4b20bb8443fb79030930 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:15.510572   431 raft_consensus.cc:2272] T d630fd40a4084d87954d0e6c16998a70 P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.504957  1655 leader_election.cc:304] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:15.514477 10621 raft_consensus.cc:493] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:01:15.514976 10621 raft_consensus.cc:515] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } }
I20260709 13:01:15.517041 10621 leader_election.cc:290] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953)
I20260709 13:01:15.518702 10621 raft_consensus.cc:2749] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:15.521554   431 tablet_replica.cc:333] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
W20260709 13:01:15.521621  1655 leader_election.cc:336] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
I20260709 13:01:15.522653   431 raft_consensus.cc:2243] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:01:15.523916   431 raft_consensus.cc:2272] T a73b99964f4c4107aed2d05c6106b3b5 P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.525509 10623 raft_consensus.cc:493] T 97e583cb09524a098c997f9996eb5b03 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader c262eac7fc904ae9bb91e450f6532e3f)
I20260709 13:01:15.526077 10623 raft_consensus.cc:515] T 97e583cb09524a098c997f9996eb5b03 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "dbe6a89d0e1c4137b3a1b17bf4b520d8" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 43903 } } peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } attrs { replace: true } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
W20260709 13:01:15.526916  1654 leader_election.cc:336] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
I20260709 13:01:15.527118   431 tablet_replica.cc:333] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.529003 10623 leader_election.cc:290] T 97e583cb09524a098c997f9996eb5b03 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903), c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:01:15.535158  2269 leader_election.cc:336] T 97e583cb09524a098c997f9996eb5b03 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:15.531239  1655 leader_election.cc:336] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
I20260709 13:01:15.536372  1655 leader_election.cc:304] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4487a53c51be4634bf1ef29c5248353d; no voters: c262eac7fc904ae9bb91e450f6532e3f, dbe6a89d0e1c4137b3a1b17bf4b520d8
W20260709 13:01:15.536500  2267 leader_election.cc:336] T 97e583cb09524a098c997f9996eb5b03 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
I20260709 13:01:15.537153  2267 leader_election.cc:304] T 97e583cb09524a098c997f9996eb5b03 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, dbe6a89d0e1c4137b3a1b17bf4b520d8
I20260709 13:01:15.538442 10621 raft_consensus.cc:2749] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:15.538383 10623 raft_consensus.cc:2749] T 97e583cb09524a098c997f9996eb5b03 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:01:15.540006  2266 leader_election.cc:336] T 97e583cb09524a098c997f9996eb5b03 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
I20260709 13:01:15.528106   431 raft_consensus.cc:2243] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.545123   431 raft_consensus.cc:2272] T cdff63e2a2e94c729942046ee2f02a09 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.548218   431 tablet_replica.cc:333] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.549152   431 raft_consensus.cc:2243] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.549826   431 raft_consensus.cc:2272] T 12b2051da69c4c7f8b35da07093dfc33 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.552913   431 tablet_replica.cc:333] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.553705   431 raft_consensus.cc:2243] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.554347   431 raft_consensus.cc:2272] T 95abfe15f7d54f3fb0f01f162b262561 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.557384   431 tablet_replica.cc:333] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.558205   431 raft_consensus.cc:2243] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.558840   431 raft_consensus.cc:2272] T f0a8a9b410b84b569aa1245ad95bb229 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.561638   431 tablet_replica.cc:333] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.562420   431 raft_consensus.cc:2243] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.564352   431 raft_consensus.cc:2272] T 42248b4b3b744072a3581db8c3874c55 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.567413   431 tablet_replica.cc:333] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.568192   431 raft_consensus.cc:2243] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.569677   431 raft_consensus.cc:2272] T 9324141fa1ba48aca59e97123ca5742e P 4487a53c51be4634bf1ef29c5248353d [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.572398   431 tablet_replica.cc:333] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.573372   431 raft_consensus.cc:2243] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.573972   431 raft_consensus.cc:2272] T b7634482da3645aeb7462251e5df3726 P 4487a53c51be4634bf1ef29c5248353d [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.576814   431 tablet_replica.cc:333] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.577615   431 raft_consensus.cc:2243] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.578526   431 raft_consensus.cc:2272] T 62a133aa1e234c489eaeb6341dc87b49 P 4487a53c51be4634bf1ef29c5248353d [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.581561   431 tablet_replica.cc:333] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.582324   431 raft_consensus.cc:2243] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.583046   431 raft_consensus.cc:2272] T 0507fcc8f9794c668a81d8519fc995be P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.585736   431 tablet_replica.cc:333] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.586666   431 raft_consensus.cc:2243] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:01:15.587891   431 raft_consensus.cc:2272] T a5981b12945c4d5b8d59d139eb1c77a2 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.590881   431 tablet_replica.cc:333] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.591697   431 raft_consensus.cc:2243] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:01:15.592839   431 raft_consensus.cc:2272] T d8b7121a813948bfa350d3f0b9fd6988 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.595655   431 tablet_replica.cc:333] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.596566   431 raft_consensus.cc:2243] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.597251   431 raft_consensus.cc:2272] T 22060ec6ef664a749065c3f00807b450 P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.610975   431 tablet_replica.cc:333] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.611753   431 raft_consensus.cc:2243] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.612547   431 raft_consensus.cc:2272] T 6f1367cef67f42eab84cbda659b7ffb1 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.615139   431 tablet_replica.cc:333] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.615891   431 raft_consensus.cc:2243] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.617341   431 raft_consensus.cc:2272] T 147199196d114d4c90fd8fba442ab7d8 P 4487a53c51be4634bf1ef29c5248353d [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.620115   431 tablet_replica.cc:333] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.620966   431 raft_consensus.cc:2243] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.621937   431 raft_consensus.cc:2272] T 35beb9f05ad84a8fb211d701469ddd6c P 4487a53c51be4634bf1ef29c5248353d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.624565   431 tablet_replica.cc:333] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.625289   431 raft_consensus.cc:2243] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:01:15.626721   431 raft_consensus.cc:2272] T d2eccdddaa724fed8954f5e5bc110b80 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.629494   431 tablet_replica.cc:333] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.630235   431 raft_consensus.cc:2243] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.631074   431 raft_consensus.cc:2272] T 97e583cb09524a098c997f9996eb5b03 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.633710   431 tablet_replica.cc:333] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.634442   431 raft_consensus.cc:2243] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.635078   431 raft_consensus.cc:2272] T ba9da8e67563442eaf10dbb50de09eb5 P 4487a53c51be4634bf1ef29c5248353d [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.637807   431 tablet_replica.cc:333] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
W20260709 13:01:15.637807  2267 consensus_peers.cc:597] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:15.638808   431 raft_consensus.cc:2243] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.639369   431 raft_consensus.cc:2272] T f0eedb9e9c8c4177903e544c600553f3 P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.641495   431 tablet_replica.cc:333] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.642048   431 raft_consensus.cc:2243] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:01:15.643085   431 raft_consensus.cc:2272] T e4d03bbba4ce46ecb686052832c7b862 P 4487a53c51be4634bf1ef29c5248353d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.645218   431 tablet_replica.cc:333] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.645792   431 raft_consensus.cc:2243] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.646514   431 raft_consensus.cc:2272] T 5664f3181d5c4b20bb8443fb79030930 P 4487a53c51be4634bf1ef29c5248353d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.648643   431 tablet_replica.cc:333] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.649151   431 raft_consensus.cc:2243] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.649979   431 raft_consensus.cc:2272] T db011c2c8016405d968fe57a093fc111 P 4487a53c51be4634bf1ef29c5248353d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.652236   431 tablet_replica.cc:333] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.652808   431 raft_consensus.cc:2243] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:01:15.653729   431 raft_consensus.cc:2272] T d3cb0f1c44ec45f38ff2f0c27480a08c P 4487a53c51be4634bf1ef29c5248353d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.655817   431 tablet_replica.cc:333] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.656348   431 raft_consensus.cc:2243] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:01:15.657353   431 raft_consensus.cc:2272] T 6578815705874ccfb147b36c5f6db70a P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.659482   431 tablet_replica.cc:333] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.660022   431 raft_consensus.cc:2243] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.660893   431 raft_consensus.cc:2272] T 105edc3ce5964519acbd96dbaa975697 P 4487a53c51be4634bf1ef29c5248353d [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.662818   431 tablet_replica.cc:333] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.663365   431 raft_consensus.cc:2243] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:01:15.664203   431 raft_consensus.cc:2272] T 3c62b87395ba4c3a9a99163b300d7ddf P 4487a53c51be4634bf1ef29c5248353d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.666131   431 tablet_replica.cc:333] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.666643   431 raft_consensus.cc:2243] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.667486   431 raft_consensus.cc:2272] T 8a2233a4e08d4138b4eb687a0440be86 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.670131   431 tablet_replica.cc:333] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.670683   431 raft_consensus.cc:2243] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.671432   431 raft_consensus.cc:2272] T 480b368f643b4d85a5daa23529132504 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.673866   431 tablet_replica.cc:333] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.678694   431 raft_consensus.cc:2243] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.679528   431 raft_consensus.cc:2272] T 8b3e4ab7be234d07aa27f18779c01c0d P 4487a53c51be4634bf1ef29c5248353d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.688102   431 tablet_replica.cc:333] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.688907   431 raft_consensus.cc:2243] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.689731   431 raft_consensus.cc:2272] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 4487a53c51be4634bf1ef29c5248353d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:15.692444   431 tablet_replica.cc:333] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d: stopping tablet replica
I20260709 13:01:15.700119   431 raft_consensus.cc:2243] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:15.701213   431 raft_consensus.cc:2272] T 0e84698abe8e46788d46c9bf8a4c74c7 P 4487a53c51be4634bf1ef29c5248353d [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:15.778138  2267 consensus_peers.cc:597] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:15.854696  2267 consensus_peers.cc:597] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:16.035960  2267 consensus_peers.cc:597] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:16.328061  2267 consensus_peers.cc:597] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 -> Peer dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): Couldn't send request to peer dbe6a89d0e1c4137b3a1b17bf4b520d8. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:01:16.331137   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
W20260709 13:01:16.365898  2266 consensus_peers.cc:597] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 -> Peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Couldn't send request to peer c262eac7fc904ae9bb91e450f6532e3f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:16.376541 10622 raft_consensus.cc:493] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:01:16.377147 10622 raft_consensus.cc:515] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:16.379490 10622 leader_election.cc:290] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:01:16.387176  2269 leader_election.cc:336] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45275: connect: Connection refused (error 111)
W20260709 13:01:16.391505  2266 leader_election.cc:336] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
I20260709 13:01:16.392092  2266 leader_election.cc:304] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:01:16.392953 10622 raft_consensus.cc:2749] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:16.435498 10622 raft_consensus.cc:493] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 4487a53c51be4634bf1ef29c5248353d)
I20260709 13:01:16.436113 10622 raft_consensus.cc:515] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c262eac7fc904ae9bb91e450f6532e3f" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41953 } } peers { permanent_uuid: "4487a53c51be4634bf1ef29c5248353d" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45275 } } peers { permanent_uuid: "1d6516ff61104bdda54bde95e92fe579" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 33437 } attrs { promote: false } }
I20260709 13:01:16.437000   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
I20260709 13:01:16.438676 10622 leader_election.cc:290] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953), 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275)
W20260709 13:01:16.444005  2269 leader_election.cc:336] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 4487a53c51be4634bf1ef29c5248353d (127.0.107.195:45275): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45275: connect: Connection refused (error 111)
W20260709 13:01:16.444983  2266 leader_election.cc:336] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111)
I20260709 13:01:16.445399  2266 leader_election.cc:304] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d6516ff61104bdda54bde95e92fe579; no voters: 4487a53c51be4634bf1ef29c5248353d, c262eac7fc904ae9bb91e450f6532e3f
I20260709 13:01:16.446094 10622 raft_consensus.cc:2749] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:01:16.482882   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:01:16.483479  2266 consensus_peers.cc:597] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 -> Peer c262eac7fc904ae9bb91e450f6532e3f (127.0.107.194:41953): Couldn't send request to peer c262eac7fc904ae9bb91e450f6532e3f. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:41953: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:16.483866   431 tablet_replica.cc:333] T d630fd40a4084d87954d0e6c16998a70 P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.484859   431 raft_consensus.cc:2243] T d630fd40a4084d87954d0e6c16998a70 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:16.485608   431 raft_consensus.cc:2272] T d630fd40a4084d87954d0e6c16998a70 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.488098   431 tablet_replica.cc:333] T 97e583cb09524a098c997f9996eb5b03 P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.488772   431 raft_consensus.cc:2243] T 97e583cb09524a098c997f9996eb5b03 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:16.489300   431 raft_consensus.cc:2272] T 97e583cb09524a098c997f9996eb5b03 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.491544   431 tablet_replica.cc:333] T 5664f3181d5c4b20bb8443fb79030930 P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.492178   431 raft_consensus.cc:2243] T 5664f3181d5c4b20bb8443fb79030930 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:16.492777   431 raft_consensus.cc:2272] T 5664f3181d5c4b20bb8443fb79030930 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.494939   431 tablet_replica.cc:333] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.495520   431 raft_consensus.cc:2243] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:01:16.496315   431 raft_consensus.cc:2272] T 147199196d114d4c90fd8fba442ab7d8 P 1d6516ff61104bdda54bde95e92fe579 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.498806   431 tablet_replica.cc:333] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.499403   431 raft_consensus.cc:2243] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:01:16.500248   431 raft_consensus.cc:2272] T 480b368f643b4d85a5daa23529132504 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.502470   431 tablet_replica.cc:333] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.503038   431 raft_consensus.cc:2243] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 34 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:16.503536   431 raft_consensus.cc:2272] T ac600187e28f4d0fa948e0d053317e88 P 1d6516ff61104bdda54bde95e92fe579 [term 34 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.506008   431 tablet_replica.cc:333] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.506642   431 raft_consensus.cc:2243] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:16.507418   431 raft_consensus.cc:2272] T d7727fcb0cf9452fbbc077ab7987b596 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.510293   431 tablet_replica.cc:333] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.510905   431 raft_consensus.cc:2243] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:16.511379   431 raft_consensus.cc:2272] T 62a133aa1e234c489eaeb6341dc87b49 P 1d6516ff61104bdda54bde95e92fe579 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.513654   431 tablet_replica.cc:333] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.514222   431 raft_consensus.cc:2243] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:16.514818   431 raft_consensus.cc:2272] T 3c62b87395ba4c3a9a99163b300d7ddf P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.518128   431 tablet_replica.cc:333] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.519028   431 raft_consensus.cc:2243] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:16.519891   431 raft_consensus.cc:2272] T 8a2233a4e08d4138b4eb687a0440be86 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.523195   431 tablet_replica.cc:333] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.524073   431 raft_consensus.cc:2243] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:01:16.525314   431 raft_consensus.cc:2272] T 8b3e4ab7be234d07aa27f18779c01c0d P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.528600   431 tablet_replica.cc:333] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.529493   431 raft_consensus.cc:2243] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:01:16.530573   431 raft_consensus.cc:2272] T 9b4de1379d73445699a2babbca8fce44 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.533454   431 tablet_replica.cc:333] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.534077   431 raft_consensus.cc:2243] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:01:16.534936   431 raft_consensus.cc:2272] T eabf19413eea44dd86511e07a036166b P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.537309   431 tablet_replica.cc:333] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.537985   431 raft_consensus.cc:2243] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:01:16.538790   431 raft_consensus.cc:2272] T ba9da8e67563442eaf10dbb50de09eb5 P 1d6516ff61104bdda54bde95e92fe579 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.540959   431 tablet_replica.cc:333] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.541541   431 raft_consensus.cc:2243] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:16.541985   431 raft_consensus.cc:2272] T 07ac6d2e7442458585e7eca31089d547 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.544684   431 tablet_replica.cc:333] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.545480   431 raft_consensus.cc:2243] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:01:16.546558   431 raft_consensus.cc:2272] T db011c2c8016405d968fe57a093fc111 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.549252   431 tablet_replica.cc:333] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.549796   431 raft_consensus.cc:2243] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:01:16.550719   431 raft_consensus.cc:2272] T 03a87bdd56034cbaa09fbc461a7bd313 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.553395   431 tablet_replica.cc:333] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.554236   431 raft_consensus.cc:2243] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:01:16.555482   431 raft_consensus.cc:2272] T 42248b4b3b744072a3581db8c3874c55 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:16.558054  1425 catalog_manager.cc:4755] TS dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9324141fa1ba48aca59e97123ca5742e: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
I20260709 13:01:16.558436   431 tablet_replica.cc:333] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.559142   431 raft_consensus.cc:2243] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:01:16.559978   431 raft_consensus.cc:2272] T 7d92e33e89814e86abdebb8b54a3a5c5 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.562140   431 tablet_replica.cc:333] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.562692   431 raft_consensus.cc:2243] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:16.563160   431 raft_consensus.cc:2272] T a73b99964f4c4107aed2d05c6106b3b5 P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.565338   431 tablet_replica.cc:333] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.565866   431 raft_consensus.cc:2243] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:16.566352   431 raft_consensus.cc:2272] T e4681eaad3084357b9677e4242b97c99 P 1d6516ff61104bdda54bde95e92fe579 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.568282   431 tablet_replica.cc:333] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.568909   431 raft_consensus.cc:2243] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:01:16.569734   431 raft_consensus.cc:2272] T aa984c8881704e97b0d6a6eb60605021 P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.571825   431 tablet_replica.cc:333] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.572337   431 raft_consensus.cc:2243] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:16.573278   431 raft_consensus.cc:2272] T 398a6324f64f46b0accba6cac64dfec6 P 1d6516ff61104bdda54bde95e92fe579 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.575291   431 tablet_replica.cc:333] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.575896   431 raft_consensus.cc:2243] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:01:16.576967   431 raft_consensus.cc:2272] T 95abfe15f7d54f3fb0f01f162b262561 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.579185   431 tablet_replica.cc:333] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.579703   431 raft_consensus.cc:2243] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:16.580296   431 raft_consensus.cc:2272] T d36fee36a84e4cf98ad42f287d4f317f P 1d6516ff61104bdda54bde95e92fe579 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.582432   431 tablet_replica.cc:333] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.582968   431 raft_consensus.cc:2243] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:16.583770   431 raft_consensus.cc:2272] T 35beb9f05ad84a8fb211d701469ddd6c P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.585927   431 tablet_replica.cc:333] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.586452   431 raft_consensus.cc:2243] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:01:16.587332   431 raft_consensus.cc:2272] T 9324141fa1ba48aca59e97123ca5742e P 1d6516ff61104bdda54bde95e92fe579 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.589316   431 tablet_replica.cc:333] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.589838   431 raft_consensus.cc:2243] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:16.590620   431 raft_consensus.cc:2272] T 940b60c7fb3744a68751996b8bb198ca P 1d6516ff61104bdda54bde95e92fe579 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.592767   431 tablet_replica.cc:333] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.593323   431 raft_consensus.cc:2243] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:16.593816   431 raft_consensus.cc:2272] T 5c8fc263f1e8493db14b8c7a8e316a9f P 1d6516ff61104bdda54bde95e92fe579 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.595839   431 tablet_replica.cc:333] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.596374   431 raft_consensus.cc:2243] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:01:16.597215   431 raft_consensus.cc:2272] T 105edc3ce5964519acbd96dbaa975697 P 1d6516ff61104bdda54bde95e92fe579 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.599138   431 tablet_replica.cc:333] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.599653   431 raft_consensus.cc:2243] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:16.600167   431 raft_consensus.cc:2272] T d5d52e25b9814edbb805e7d6bcce5b5d P 1d6516ff61104bdda54bde95e92fe579 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.602295   431 tablet_replica.cc:333] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.602907   431 raft_consensus.cc:2243] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:16.603619   431 raft_consensus.cc:2272] T 97c958beecec40918b63217135840ff6 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.606003   431 tablet_replica.cc:333] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.606614   431 raft_consensus.cc:2243] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:16.607101   431 raft_consensus.cc:2272] T d127be99e2af41c0808e03480c1b64e3 P 1d6516ff61104bdda54bde95e92fe579 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.609124   431 tablet_replica.cc:333] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.609623   431 raft_consensus.cc:2243] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:16.610235   431 raft_consensus.cc:2272] T d2eccdddaa724fed8954f5e5bc110b80 P 1d6516ff61104bdda54bde95e92fe579 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.612365   431 tablet_replica.cc:333] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.612901   431 raft_consensus.cc:2243] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:16.613377   431 raft_consensus.cc:2272] T 499cf87d55ba434fa03c7cf6c1bb54c8 P 1d6516ff61104bdda54bde95e92fe579 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.615509   431 tablet_replica.cc:333] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.616144   431 raft_consensus.cc:2243] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:01:16.616962   431 raft_consensus.cc:2272] T 9a7bc646e9bf4d2e9952c8b5d4a5be14 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.619454   431 tablet_replica.cc:333] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.619992   431 raft_consensus.cc:2243] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:16.621018   431 raft_consensus.cc:2272] T dbdf9662619648c4a3b76fbbda8d0e14 P 1d6516ff61104bdda54bde95e92fe579 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.623119   431 tablet_replica.cc:333] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.623601   431 raft_consensus.cc:2243] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:01:16.624363   431 raft_consensus.cc:2272] T 6f1367cef67f42eab84cbda659b7ffb1 P 1d6516ff61104bdda54bde95e92fe579 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:16.626463   431 tablet_replica.cc:333] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579: stopping tablet replica
I20260709 13:01:16.626885   431 raft_consensus.cc:2243] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:16.627351   431 raft_consensus.cc:2272] T d8b7121a813948bfa350d3f0b9fd6988 P 1d6516ff61104bdda54bde95e92fe579 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:17.105082   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:01:17.177848   431 master.cc:562] Master@127.0.107.254:34735 shutting down...
W20260709 13:01:17.215513  1488 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:01:17.215900  1488 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:01:17.216137  1488 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:01:17.787168  1425 catalog_manager.cc:4755] TS dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8a2233a4e08d4138b4eb687a0440be86: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
W20260709 13:01:21.037966  1425 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111) [suppressed 286 similar messages]
W20260709 13:01:21.043066  1425 catalog_manager.cc:4755] TS dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5664f3181d5c4b20bb8443fb79030930: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
W20260709 13:01:32.964689  1425 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
W20260709 13:01:32.968400  1425 catalog_manager.cc:4755] TS dbe6a89d0e1c4137b3a1b17bf4b520d8 (127.0.107.193:43903): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9324141fa1ba48aca59e97123ca5742e: Network error: Client connection negotiation failed: client connection to 127.0.107.193:43903: connect: Connection refused (error 111)
I20260709 13:01:34.226018   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:34.227022   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:34.227463   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 633384cf034a459c9c7300ebf04605f6: stopping tablet replica
I20260709 13:01:34.491137   431 master.cc:584] Master@127.0.107.254:34735 shutdown complete.
I20260709 13:01:34.539047   431 test_util.cc:182] -----------------------------------------------
I20260709 13:01:34.539309   431 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601786404416-431-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (284741 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:01:34.542876   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:46133
I20260709 13:01:34.544003   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:34.549405 10636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:34.549823 10637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:34.550225 10639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:34.551097   431 server_base.cc:1061] running on GCE node
I20260709 13:01:34.554859   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:34.555092   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:34.555248   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602094555229 us; error 0 us; skew 500 ppm
I20260709 13:01:34.555778   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:34.558519   431 webserver.cc:533] Webserver started at http://127.0.107.254:44645/ using document root <none> and password file <none>
I20260709 13:01:34.559042   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:34.559224   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:34.559485   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:34.560814   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601786404416-431-0/minicluster-data/master-0-root/instance:
uuid: "caa2c8769dab41e3b2a6fc730aa64dbc"
format_stamp: "Formatted at 2026-07-09 13:01:34 on dist-test-slave-6j4g"
I20260709 13:01:34.565596   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:01:34.569294 10644 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:34.570076   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:01:34.570379   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601786404416-431-0/minicluster-data/master-0-root
uuid: "caa2c8769dab41e3b2a6fc730aa64dbc"
format_stamp: "Formatted at 2026-07-09 13:01:34 on dist-test-slave-6j4g"
I20260709 13:01:34.570685   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601786404416-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601786404416-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601786404416-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:34.586496   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:34.587792   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:34.627785   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:46133
I20260709 13:01:34.627878 10695 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:46133 every 8 connection(s)
I20260709 13:01:34.631965 10696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:34.643694 10696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P caa2c8769dab41e3b2a6fc730aa64dbc: Bootstrap starting.
I20260709 13:01:34.648609 10696 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P caa2c8769dab41e3b2a6fc730aa64dbc: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:34.653184 10696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P caa2c8769dab41e3b2a6fc730aa64dbc: No bootstrap required, opened a new log
I20260709 13:01:34.655457 10696 raft_consensus.cc:359] T 00000000000000000000000000000000 P caa2c8769dab41e3b2a6fc730aa64dbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "caa2c8769dab41e3b2a6fc730aa64dbc" member_type: VOTER }
I20260709 13:01:34.655928 10696 raft_consensus.cc:385] T 00000000000000000000000000000000 P caa2c8769dab41e3b2a6fc730aa64dbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:34.656105 10696 raft_consensus.cc:740] T 00000000000000000000000000000000 P caa2c8769dab41e3b2a6fc730aa64dbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caa2c8769dab41e3b2a6fc730aa64dbc, State: Initialized, Role: FOLLOWER
I20260709 13:01:34.656728 10696 consensus_queue.cc:260] T 00000000000000000000000000000000 P caa2c8769dab41e3b2a6fc730aa64dbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "caa2c8769dab41e3b2a6fc730aa64dbc" member_type: VOTER }
I20260709 13:01:34.657188 10696 raft_consensus.cc:399] T 00000000000000000000000000000000 P caa2c8769dab41e3b2a6fc730aa64dbc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:01:34.657382 10696 raft_consensus.cc:493] T 00000000000000000000000000000000 P caa2c8769dab41e3b2a6fc730aa64dbc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:01:34.657594 10696 raft_consensus.cc:3060] T 00000000000000000000000000000000 P caa2c8769dab41e3b2a6fc730aa64dbc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:34.662274 10696 raft_consensus.cc:515] T 00000000000000000000000000000000 P caa2c8769dab41e3b2a6fc730aa64dbc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "caa2c8769dab41e3b2a6fc730aa64dbc" member_type: VOTER }
I20260709 13:01:34.662807 10696 leader_election.cc:304] T 00000000000000000000000000000000 P caa2c8769dab41e3b2a6fc730aa64dbc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: caa2c8769dab41e3b2a6fc730aa64dbc; no voters: 
I20260709 13:01:34.663900 10696 leader_election.cc:290] T 00000000000000000000000000000000 P caa2c8769dab41e3b2a6fc730aa64dbc [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:01:34.664309 10699 raft_consensus.cc:2804] T 00000000000000000000000000000000 P caa2c8769dab41e3b2a6fc730aa64dbc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:34.665741 10699 raft_consensus.cc:697] T 00000000000000000000000000000000 P caa2c8769dab41e3b2a6fc730aa64dbc [term 1 LEADER]: Becoming Leader. State: Replica: caa2c8769dab41e3b2a6fc730aa64dbc, State: Running, Role: LEADER
I20260709 13:01:34.666473 10699 consensus_queue.cc:237] T 00000000000000000000000000000000 P caa2c8769dab41e3b2a6fc730aa64dbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "caa2c8769dab41e3b2a6fc730aa64dbc" member_type: VOTER }
I20260709 13:01:34.666819 10696 sys_catalog.cc:565] T 00000000000000000000000000000000 P caa2c8769dab41e3b2a6fc730aa64dbc [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:01:34.673108 10700 sys_catalog.cc:455] T 00000000000000000000000000000000 P caa2c8769dab41e3b2a6fc730aa64dbc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "caa2c8769dab41e3b2a6fc730aa64dbc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "caa2c8769dab41e3b2a6fc730aa64dbc" member_type: VOTER } }
I20260709 13:01:34.673843 10700 sys_catalog.cc:458] T 00000000000000000000000000000000 P caa2c8769dab41e3b2a6fc730aa64dbc [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:34.678176 10701 sys_catalog.cc:455] T 00000000000000000000000000000000 P caa2c8769dab41e3b2a6fc730aa64dbc [sys.catalog]: SysCatalogTable state changed. Reason: New leader caa2c8769dab41e3b2a6fc730aa64dbc. Latest consensus state: current_term: 1 leader_uuid: "caa2c8769dab41e3b2a6fc730aa64dbc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "caa2c8769dab41e3b2a6fc730aa64dbc" member_type: VOTER } }
I20260709 13:01:34.678881 10701 sys_catalog.cc:458] T 00000000000000000000000000000000 P caa2c8769dab41e3b2a6fc730aa64dbc [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:34.679448 10709 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:01:34.684504 10709 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:01:34.685643   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:01:34.694049 10709 catalog_manager.cc:1383] Generated new cluster ID: 63c638c6b0204fc5be6adca649692471
I20260709 13:01:34.694391 10709 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:01:34.707175 10709 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:01:34.708514 10709 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:01:34.723888 10709 catalog_manager.cc:6070] T 00000000000000000000000000000000 P caa2c8769dab41e3b2a6fc730aa64dbc: Generated new TSK 0
I20260709 13:01:34.724568 10709 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:01:34.753072   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:34.759423 10717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:34.760591 10718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:34.761984 10720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:34.762890   431 server_base.cc:1061] running on GCE node
I20260709 13:01:34.765627   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:34.765918   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:34.766093   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602094766075 us; error 0 us; skew 500 ppm
I20260709 13:01:34.766649   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:34.769259   431 webserver.cc:533] Webserver started at http://127.0.107.193:34721/ using document root <none> and password file <none>
I20260709 13:01:34.769748   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:34.769920   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:34.770196   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:34.771456   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601786404416-431-0/minicluster-data/ts-0-root/instance:
uuid: "346158a6aa6747c1b8d31b4fb80238d0"
format_stamp: "Formatted at 2026-07-09 13:01:34 on dist-test-slave-6j4g"
I20260709 13:01:34.776587   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:01:34.780329 10725 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:34.781301   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 13:01:34.781615   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601786404416-431-0/minicluster-data/ts-0-root
uuid: "346158a6aa6747c1b8d31b4fb80238d0"
format_stamp: "Formatted at 2026-07-09 13:01:34 on dist-test-slave-6j4g"
I20260709 13:01:34.781908   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601786404416-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601786404416-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601786404416-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:34.802414   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:34.803680   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:34.805294   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:34.807757   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:34.807971   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:34.808209   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:34.808380   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:34.850147   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:34489
I20260709 13:01:34.850306 10787 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:34489 every 8 connection(s)
I20260709 13:01:34.855404   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:34.863868 10792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:34.864637 10793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:34.867077 10795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:34.868206   431 server_base.cc:1061] running on GCE node
I20260709 13:01:34.870834   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:34.871182   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:34.871341   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602094871328 us; error 0 us; skew 500 ppm
I20260709 13:01:34.872008   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:34.872673 10788 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46133
I20260709 13:01:34.873080 10788 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:34.873907 10788 heartbeater.cc:507] Master 127.0.107.254:46133 requested a full tablet report, sending...
I20260709 13:01:34.874673   431 webserver.cc:533] Webserver started at http://127.0.107.194:42529/ using document root <none> and password file <none>
I20260709 13:01:34.875329   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:34.875524   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:34.875855   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:34.876351 10661 ts_manager.cc:194] Registered new tserver with Master: 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:34.877662   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601786404416-431-0/minicluster-data/ts-1-root/instance:
uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
format_stamp: "Formatted at 2026-07-09 13:01:34 on dist-test-slave-6j4g"
I20260709 13:01:34.878952 10661 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41918
I20260709 13:01:34.883149   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:01:34.887137 10800 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:34.887907   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:01:34.888202   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601786404416-431-0/minicluster-data/ts-1-root
uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
format_stamp: "Formatted at 2026-07-09 13:01:34 on dist-test-slave-6j4g"
I20260709 13:01:34.888516   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601786404416-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601786404416-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601786404416-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:34.899430   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:34.900780   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:34.902305   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:34.904805   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:34.905030   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:34.905258   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:34.905418   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:34.947162   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:35051
I20260709 13:01:34.947260 10862 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:35051 every 8 connection(s)
I20260709 13:01:34.952389   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:34.959416 10866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:34.961064 10867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:34.962572 10869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:34.962612   431 server_base.cc:1061] running on GCE node
I20260709 13:01:34.963975   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:34.964224   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:34.964430   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602094964411 us; error 0 us; skew 500 ppm
I20260709 13:01:34.964766 10863 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46133
I20260709 13:01:34.965204 10863 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:34.965233   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:34.966318 10863 heartbeater.cc:507] Master 127.0.107.254:46133 requested a full tablet report, sending...
I20260709 13:01:34.968361   431 webserver.cc:533] Webserver started at http://127.0.107.195:40351/ using document root <none> and password file <none>
I20260709 13:01:34.968665 10661 ts_manager.cc:194] Registered new tserver with Master: dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:34.969053   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:34.969384   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:34.969727   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:34.970335 10661 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41930
I20260709 13:01:34.971128   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601786404416-431-0/minicluster-data/ts-2-root/instance:
uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
format_stamp: "Formatted at 2026-07-09 13:01:34 on dist-test-slave-6j4g"
I20260709 13:01:34.976684   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.003s
I20260709 13:01:34.980551 10874 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:34.981396   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:01:34.981699   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601786404416-431-0/minicluster-data/ts-2-root
uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
format_stamp: "Formatted at 2026-07-09 13:01:34 on dist-test-slave-6j4g"
I20260709 13:01:34.981992   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601786404416-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601786404416-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601786404416-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:35.008013   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:35.009366   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:35.010893   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:35.013362   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:35.013582   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:35.013808   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:35.013959   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:35.060217   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:36351
I20260709 13:01:35.060336 10936 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:36351 every 8 connection(s)
I20260709 13:01:35.065761   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:35.073277 10940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:35.075321 10941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:35.078279   431 server_base.cc:1061] running on GCE node
W20260709 13:01:35.079128 10943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:35.079771 10937 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46133
I20260709 13:01:35.080303 10937 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:35.080400   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:35.080744   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:35.080955   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602095080936 us; error 0 us; skew 500 ppm
I20260709 13:01:35.081385 10937 heartbeater.cc:507] Master 127.0.107.254:46133 requested a full tablet report, sending...
I20260709 13:01:35.081854   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:35.084671 10661 ts_manager.cc:194] Registered new tserver with Master: b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:35.086004   431 webserver.cc:533] Webserver started at http://127.0.107.196:40971/ using document root <none> and password file <none>
I20260709 13:01:35.086642 10661 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41944
I20260709 13:01:35.086802   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:35.087194   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:35.087564   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:35.089219   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601786404416-431-0/minicluster-data/ts-3-root/instance:
uuid: "5e62c52a41f7476a908dd377c1a8a79f"
format_stamp: "Formatted at 2026-07-09 13:01:35 on dist-test-slave-6j4g"
I20260709 13:01:35.094476   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:01:35.098342 10948 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:35.099180   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:01:35.099543   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601786404416-431-0/minicluster-data/ts-3-root
uuid: "5e62c52a41f7476a908dd377c1a8a79f"
format_stamp: "Formatted at 2026-07-09 13:01:35 on dist-test-slave-6j4g"
I20260709 13:01:35.099815   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601786404416-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601786404416-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601786404416-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:35.112540   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:35.113845   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:35.115509   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:35.118005   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:35.118240   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:35.118484   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:35.118642   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:35.163770   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:42509
I20260709 13:01:35.163863 11010 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:42509 every 8 connection(s)
I20260709 13:01:35.180032 11011 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46133
I20260709 13:01:35.180440 11011 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:35.181294 11011 heartbeater.cc:507] Master 127.0.107.254:46133 requested a full tablet report, sending...
I20260709 13:01:35.183620 10661 ts_manager.cc:194] Registered new tserver with Master: 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:35.183899   431 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016801462s
I20260709 13:01:35.185690 10661 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41958
I20260709 13:01:35.212261 10661 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41970:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:01:35.463037 10902 tablet_service.cc:1511] Processing CreateTablet for tablet 03cf7a6241a444369a57fdaf965107b3 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:01:35.463627 10901 tablet_service.cc:1511] Processing CreateTablet for tablet b74f82b45a3242568f45f6a3fabeda31 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:01:35.464718 10902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03cf7a6241a444369a57fdaf965107b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.465914 10901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b74f82b45a3242568f45f6a3fabeda31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.467655 10900 tablet_service.cc:1511] Processing CreateTablet for tablet 00d1eccb4ed0452ea1afb814db7c7330 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:01:35.469492 10900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00d1eccb4ed0452ea1afb814db7c7330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.474848 10976 tablet_service.cc:1511] Processing CreateTablet for tablet 03cf7a6241a444369a57fdaf965107b3 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:01:35.476428 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03cf7a6241a444369a57fdaf965107b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.480440 10827 tablet_service.cc:1511] Processing CreateTablet for tablet b74f82b45a3242568f45f6a3fabeda31 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:01:35.483409 10827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b74f82b45a3242568f45f6a3fabeda31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.480741 10828 tablet_service.cc:1511] Processing CreateTablet for tablet 03cf7a6241a444369a57fdaf965107b3 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:01:35.485646 10828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03cf7a6241a444369a57fdaf965107b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.481787 10826 tablet_service.cc:1511] Processing CreateTablet for tablet c72b12d4267d44a1a03db0fe148c8d31 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:01:35.488684 10825 tablet_service.cc:1511] Processing CreateTablet for tablet 16fbb9a91d614ce3834f82ce725667fa (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:01:35.489908 10826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c72b12d4267d44a1a03db0fe148c8d31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.491827 10899 tablet_service.cc:1511] Processing CreateTablet for tablet 16fbb9a91d614ce3834f82ce725667fa (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:01:35.495919 10824 tablet_service.cc:1511] Processing CreateTablet for tablet e81009eaf7bf4ee9b7ef6b9a92d61a73 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:01:35.496371 10898 tablet_service.cc:1511] Processing CreateTablet for tablet 049d8b6c7ecf423e95f1db20ab677254 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:01:35.493324 10899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16fbb9a91d614ce3834f82ce725667fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.497606 10824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e81009eaf7bf4ee9b7ef6b9a92d61a73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.500998 10898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049d8b6c7ecf423e95f1db20ab677254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.501986 10825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16fbb9a91d614ce3834f82ce725667fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.506922 10823 tablet_service.cc:1511] Processing CreateTablet for tablet 7cc6b6ca3deb4f59aa2803e2ed33c4e8 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:01:35.507359 10897 tablet_service.cc:1511] Processing CreateTablet for tablet 7cc6b6ca3deb4f59aa2803e2ed33c4e8 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:01:35.508701 10823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cc6b6ca3deb4f59aa2803e2ed33c4e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.509060 10897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cc6b6ca3deb4f59aa2803e2ed33c4e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.514786 10822 tablet_service.cc:1511] Processing CreateTablet for tablet fa2569632a834231ba0f3bad60cf90ee (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:01:35.515225 10896 tablet_service.cc:1511] Processing CreateTablet for tablet fa2569632a834231ba0f3bad60cf90ee (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:01:35.516359 10822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa2569632a834231ba0f3bad60cf90ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.516815 10896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa2569632a834231ba0f3bad60cf90ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.521847 10821 tablet_service.cc:1511] Processing CreateTablet for tablet bb61bf6eaa1845f8add4d4057e49eb15 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:01:35.523348 10821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb61bf6eaa1845f8add4d4057e49eb15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.526692 10820 tablet_service.cc:1511] Processing CreateTablet for tablet 3034b839c8444c8d80acc4fe57bcd00a (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:01:35.528422 10820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3034b839c8444c8d80acc4fe57bcd00a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.535177 10895 tablet_service.cc:1511] Processing CreateTablet for tablet ffe62eca39f04407943d15c5f7646aee (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:01:35.538161 10894 tablet_service.cc:1511] Processing CreateTablet for tablet 3034b839c8444c8d80acc4fe57bcd00a (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:01:35.541240 10893 tablet_service.cc:1511] Processing CreateTablet for tablet c6bb330c30de4041b86d22bf1c838e57 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:01:35.543880 10975 tablet_service.cc:1511] Processing CreateTablet for tablet c72b12d4267d44a1a03db0fe148c8d31 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:01:35.545648 10975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c72b12d4267d44a1a03db0fe148c8d31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.543974 10895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffe62eca39f04407943d15c5f7646aee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.550165 10893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6bb330c30de4041b86d22bf1c838e57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.552908 10894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3034b839c8444c8d80acc4fe57bcd00a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.561241 10819 tablet_service.cc:1511] Processing CreateTablet for tablet c6bb330c30de4041b86d22bf1c838e57 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:01:35.562315 10974 tablet_service.cc:1511] Processing CreateTablet for tablet 00d1eccb4ed0452ea1afb814db7c7330 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:01:35.564080 10974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00d1eccb4ed0452ea1afb814db7c7330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.562901 10819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6bb330c30de4041b86d22bf1c838e57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.580941 10973 tablet_service.cc:1511] Processing CreateTablet for tablet e81009eaf7bf4ee9b7ef6b9a92d61a73 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:01:35.583886 10973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e81009eaf7bf4ee9b7ef6b9a92d61a73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.616804 10972 tablet_service.cc:1511] Processing CreateTablet for tablet 049d8b6c7ecf423e95f1db20ab677254 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:01:35.618834 10972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049d8b6c7ecf423e95f1db20ab677254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.643522 10971 tablet_service.cc:1511] Processing CreateTablet for tablet 7cc6b6ca3deb4f59aa2803e2ed33c4e8 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:01:35.645629 10971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cc6b6ca3deb4f59aa2803e2ed33c4e8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:35.677642 10708 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:35.686978 11033 tablet_bootstrap.cc:492] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:35.695832 10827 tablet_service.cc:1511] Processing CreateTablet for tablet ccad89aaaf3d48008955a353eb0097b9 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:01:35.718721 11031 tablet_bootstrap.cc:492] T b74f82b45a3242568f45f6a3fabeda31 P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:35.736596 10970 tablet_service.cc:1511] Processing CreateTablet for tablet bb61bf6eaa1845f8add4d4057e49eb15 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:01:35.737491 10827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccad89aaaf3d48008955a353eb0097b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.738025 10970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb61bf6eaa1845f8add4d4057e49eb15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.745024 10897 tablet_service.cc:1511] Processing CreateTablet for tablet e3dd15d873514f74a9bca08bc55e5d36 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:01:35.746599 10897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3dd15d873514f74a9bca08bc55e5d36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.749946 10894 tablet_service.cc:1511] Processing CreateTablet for tablet 2f47768053ec47e69b367bd5a49662c3 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:01:35.750147 10969 tablet_service.cc:1511] Processing CreateTablet for tablet ffe62eca39f04407943d15c5f7646aee (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:01:35.751428 10894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f47768053ec47e69b367bd5a49662c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.751574 10969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffe62eca39f04407943d15c5f7646aee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.755506 10895 tablet_service.cc:1511] Processing CreateTablet for tablet 9bf0d822416f49caacd1f92cebd84eb8 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:01:35.752084 10902 tablet_service.cc:1511] Processing CreateTablet for tablet d4b9835406e84c5b88d3c3eed76a3b95 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:01:35.768466 10895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bf0d822416f49caacd1f92cebd84eb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.769104 11032 tablet_bootstrap.cc:492] T 03cf7a6241a444369a57fdaf965107b3 P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:35.771099 10821 tablet_service.cc:1511] Processing CreateTablet for tablet 2f47768053ec47e69b367bd5a49662c3 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:01:35.772707 10902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4b9835406e84c5b88d3c3eed76a3b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.774545 10901 tablet_service.cc:1511] Processing CreateTablet for tablet 1a1b4a3380b746d2bc977cfeff019c26 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:01:35.775909 10901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a1b4a3380b746d2bc977cfeff019c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.778919 10823 tablet_service.cc:1511] Processing CreateTablet for tablet d4b9835406e84c5b88d3c3eed76a3b95 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:01:35.782491 10824 tablet_service.cc:1511] Processing CreateTablet for tablet 830984b68ee046d9b9a67009177b55c2 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:01:35.784670 10753 tablet_service.cc:1511] Processing CreateTablet for tablet b74f82b45a3242568f45f6a3fabeda31 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:01:35.774549 11033 tablet_bootstrap.cc:654] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:35.786202 10753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b74f82b45a3242568f45f6a3fabeda31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.791103 10899 tablet_service.cc:1511] Processing CreateTablet for tablet 9be3de57a254453d9dc75680e7f27f22 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:01:35.792591 10899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9be3de57a254453d9dc75680e7f27f22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.794265 10821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f47768053ec47e69b367bd5a49662c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.797504 11032 tablet_bootstrap.cc:654] T 03cf7a6241a444369a57fdaf965107b3 P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:35.801225 10973 tablet_service.cc:1511] Processing CreateTablet for tablet 3034b839c8444c8d80acc4fe57bcd00a (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:01:35.801741 10976 tablet_service.cc:1511] Processing CreateTablet for tablet ccad89aaaf3d48008955a353eb0097b9 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:01:35.802630 10968 tablet_service.cc:1511] Processing CreateTablet for tablet 2f47768053ec47e69b367bd5a49662c3 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:01:35.784543 10896 tablet_service.cc:1511] Processing CreateTablet for tablet 9fa0ebad5bc4444a8c465b2e412524dd (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:01:35.803632 10974 tablet_service.cc:1511] Processing CreateTablet for tablet e3dd15d873514f74a9bca08bc55e5d36 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:01:35.805059 10967 tablet_service.cc:1511] Processing CreateTablet for tablet 830984b68ee046d9b9a67009177b55c2 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:01:35.805421 11031 tablet_bootstrap.cc:654] T b74f82b45a3242568f45f6a3fabeda31 P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:35.802642 10973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3034b839c8444c8d80acc4fe57bcd00a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.806655 10974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3dd15d873514f74a9bca08bc55e5d36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.807425 10968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f47768053ec47e69b367bd5a49662c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.808207 10898 tablet_service.cc:1511] Processing CreateTablet for tablet e5382a9b34d84b4fbeccc952bb5f4ef5 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:01:35.805261 10896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fa0ebad5bc4444a8c465b2e412524dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.811430 10752 tablet_service.cc:1511] Processing CreateTablet for tablet c72b12d4267d44a1a03db0fe148c8d31 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:01:35.813038 10752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c72b12d4267d44a1a03db0fe148c8d31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.811437 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccad89aaaf3d48008955a353eb0097b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.815755 10967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 830984b68ee046d9b9a67009177b55c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.818377 10751 tablet_service.cc:1511] Processing CreateTablet for tablet 00d1eccb4ed0452ea1afb814db7c7330 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:01:35.819892 10751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00d1eccb4ed0452ea1afb814db7c7330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.827746 10823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4b9835406e84c5b88d3c3eed76a3b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.832154 10824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 830984b68ee046d9b9a67009177b55c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.834839 10825 tablet_service.cc:1511] Processing CreateTablet for tablet 9fa0ebad5bc4444a8c465b2e412524dd (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:01:35.840611 10750 tablet_service.cc:1511] Processing CreateTablet for tablet 16fbb9a91d614ce3834f82ce725667fa (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:01:35.842170 10750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16fbb9a91d614ce3834f82ce725667fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.844283 10749 tablet_service.cc:1511] Processing CreateTablet for tablet e81009eaf7bf4ee9b7ef6b9a92d61a73 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:01:35.845973 10749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e81009eaf7bf4ee9b7ef6b9a92d61a73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.852097 10748 tablet_service.cc:1511] Processing CreateTablet for tablet 049d8b6c7ecf423e95f1db20ab677254 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:01:35.853765 10748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049d8b6c7ecf423e95f1db20ab677254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.792266 10826 tablet_service.cc:1511] Processing CreateTablet for tablet 1a1b4a3380b746d2bc977cfeff019c26 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:01:35.859313 10826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a1b4a3380b746d2bc977cfeff019c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.861596 10746 tablet_service.cc:1511] Processing CreateTablet for tablet bb61bf6eaa1845f8add4d4057e49eb15 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:01:35.863119 10746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb61bf6eaa1845f8add4d4057e49eb15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.865913 10972 tablet_service.cc:1511] Processing CreateTablet for tablet 9bf0d822416f49caacd1f92cebd84eb8 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:01:35.866184 10745 tablet_service.cc:1511] Processing CreateTablet for tablet ffe62eca39f04407943d15c5f7646aee (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:01:35.867695 10745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffe62eca39f04407943d15c5f7646aee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.871320 10828 tablet_service.cc:1511] Processing CreateTablet for tablet 9be3de57a254453d9dc75680e7f27f22 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:01:35.874243 10744 tablet_service.cc:1511] Processing CreateTablet for tablet c6bb330c30de4041b86d22bf1c838e57 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:01:35.875747 10744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6bb330c30de4041b86d22bf1c838e57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.877422 10901 tablet_service.cc:1511] Processing CreateTablet for tablet e187848edaa746928d647a830da8c970 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:01:35.879709 10975 tablet_service.cc:1511] Processing CreateTablet for tablet 1a1b4a3380b746d2bc977cfeff019c26 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:01:35.881089 10972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bf0d822416f49caacd1f92cebd84eb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.881989 10788 heartbeater.cc:499] Master 127.0.107.254:46133 was elected leader, sending a full tablet report...
I20260709 13:01:35.867334 10894 tablet_service.cc:1511] Processing CreateTablet for tablet f547b171c6b9445c95475ce3be870c2e (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:01:35.859212 10747 tablet_service.cc:1511] Processing CreateTablet for tablet fa2569632a834231ba0f3bad60cf90ee (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:01:35.865913 10895 tablet_service.cc:1511] Processing CreateTablet for tablet f1c9e47add2e4175b68fde1a27aa92e0 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:01:35.889003 10828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9be3de57a254453d9dc75680e7f27f22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.890524 10975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a1b4a3380b746d2bc977cfeff019c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.894479 10893 tablet_service.cc:1511] Processing CreateTablet for tablet a19edd96c26a4c91a7b2a412d8221e5b (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:01:35.887676 10898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5382a9b34d84b4fbeccc952bb5f4ef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.895773 11032 tablet_bootstrap.cc:492] T 03cf7a6241a444369a57fdaf965107b3 P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:35.901145 10747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa2569632a834231ba0f3bad60cf90ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.905427 10900 tablet_service.cc:1511] Processing CreateTablet for tablet 3aa37ce6306b47f0b7ead1fda7590834 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:01:35.906139 11032 ts_tablet_manager.cc:1403] T 03cf7a6241a444369a57fdaf965107b3 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.137s	user 0.007s	sys 0.009s
I20260709 13:01:35.892325 10967 tablet_service.cc:1511] Processing CreateTablet for tablet 9fa0ebad5bc4444a8c465b2e412524dd (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:01:35.918195 10967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fa0ebad5bc4444a8c465b2e412524dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.921144 10971 tablet_service.cc:1511] Processing CreateTablet for tablet c403148f1f724c0ca12919d8e85ae572 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:01:35.927739 10974 tablet_service.cc:1511] Processing CreateTablet for tablet 2e976ba764734878bb65c5db5e908f56 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:01:35.929301 10899 tablet_service.cc:1511] Processing CreateTablet for tablet 141934a83d874ca1bf1d69f49b95f1fc (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:01:35.937673 11032 raft_consensus.cc:359] T 03cf7a6241a444369a57fdaf965107b3 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:35.940392 11032 raft_consensus.cc:385] T 03cf7a6241a444369a57fdaf965107b3 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:35.944550 11032 raft_consensus.cc:740] T 03cf7a6241a444369a57fdaf965107b3 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:35.946277 10895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c9e47add2e4175b68fde1a27aa92e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.947100 11031 tablet_bootstrap.cc:492] T b74f82b45a3242568f45f6a3fabeda31 P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:35.946856 10822 tablet_service.cc:1511] Processing CreateTablet for tablet c403148f1f724c0ca12919d8e85ae572 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:01:35.947626 11031 ts_tablet_manager.cc:1403] T b74f82b45a3242568f45f6a3fabeda31 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.229s	user 0.010s	sys 0.012s
I20260709 13:01:35.947986 11033 tablet_bootstrap.cc:492] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:35.948518 11033 ts_tablet_manager.cc:1403] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.262s	user 0.007s	sys 0.008s
I20260709 13:01:35.953718 11033 raft_consensus.cc:359] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:35.954622 11033 raft_consensus.cc:385] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:35.955029 11033 raft_consensus.cc:740] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:35.956874 11032 consensus_queue.cc:260] T 03cf7a6241a444369a57fdaf965107b3 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:35.928352 10819 tablet_service.cc:1511] Processing CreateTablet for tablet 3aa37ce6306b47f0b7ead1fda7590834 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:01:35.945194 10825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fa0ebad5bc4444a8c465b2e412524dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.956001 11033 consensus_queue.cc:260] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:35.959033 11031 raft_consensus.cc:359] T b74f82b45a3242568f45f6a3fabeda31 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:35.972936 11031 raft_consensus.cc:385] T b74f82b45a3242568f45f6a3fabeda31 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:35.973371 10863 heartbeater.cc:499] Master 127.0.107.254:46133 was elected leader, sending a full tablet report...
I20260709 13:01:35.973398 10745 tablet_service.cc:1511] Processing CreateTablet for tablet ccad89aaaf3d48008955a353eb0097b9 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:01:35.977375 10745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccad89aaaf3d48008955a353eb0097b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.978767 10902 tablet_service.cc:1511] Processing CreateTablet for tablet 48e63402e1544658a8d6cf5b9220414b (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:01:35.980901 10971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c403148f1f724c0ca12919d8e85ae572. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.991134 10973 tablet_service.cc:1511] Processing CreateTablet for tablet e5382a9b34d84b4fbeccc952bb5f4ef5 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:01:36.000197 10973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5382a9b34d84b4fbeccc952bb5f4ef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.002926 10820 tablet_service.cc:1511] Processing CreateTablet for tablet 2e976ba764734878bb65c5db5e908f56 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:01:36.008630 10824 tablet_service.cc:1511] Processing CreateTablet for tablet 48e63402e1544658a8d6cf5b9220414b (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:01:36.009650 10751 tablet_service.cc:1511] Processing CreateTablet for tablet 830984b68ee046d9b9a67009177b55c2 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:01:36.011168 10751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 830984b68ee046d9b9a67009177b55c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.014730 10970 tablet_service.cc:1511] Processing CreateTablet for tablet b5a791a0126444ba90c1fb442e1b809b (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:01:36.017982 10745 tablet_service.cc:1511] Processing CreateTablet for tablet 9bf0d822416f49caacd1f92cebd84eb8 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:01:36.019481 10745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bf0d822416f49caacd1f92cebd84eb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.016312 10970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5a791a0126444ba90c1fb442e1b809b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.034511 10749 tablet_service.cc:1511] Processing CreateTablet for tablet 9be3de57a254453d9dc75680e7f27f22 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:01:36.036089 10749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9be3de57a254453d9dc75680e7f27f22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.037489 10973 tablet_service.cc:1511] Processing CreateTablet for tablet a19edd96c26a4c91a7b2a412d8221e5b (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:01:36.040567 10973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a19edd96c26a4c91a7b2a412d8221e5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:35.992995 10968 tablet_service.cc:1511] Processing CreateTablet for tablet f547b171c6b9445c95475ce3be870c2e (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:01:36.047648 10827 tablet_service.cc:1511] Processing CreateTablet for tablet 141934a83d874ca1bf1d69f49b95f1fc (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:01:35.973354 11031 raft_consensus.cc:740] T b74f82b45a3242568f45f6a3fabeda31 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:36.040695 10750 tablet_service.cc:1511] Processing CreateTablet for tablet c403148f1f724c0ca12919d8e85ae572 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:01:36.050036 11031 consensus_queue.cc:260] T b74f82b45a3242568f45f6a3fabeda31 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:35.994366 10744 tablet_service.cc:1511] Processing CreateTablet for tablet d4b9835406e84c5b88d3c3eed76a3b95 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:01:36.049837 10748 tablet_service.cc:1511] Processing CreateTablet for tablet e5382a9b34d84b4fbeccc952bb5f4ef5 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:01:36.055375 10752 tablet_service.cc:1511] Processing CreateTablet for tablet e3dd15d873514f74a9bca08bc55e5d36 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:01:36.055975 10748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5382a9b34d84b4fbeccc952bb5f4ef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.056960 10752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3dd15d873514f74a9bca08bc55e5d36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.061765 10901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e187848edaa746928d647a830da8c970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.070991 10974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e976ba764734878bb65c5db5e908f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.071837 10819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aa37ce6306b47f0b7ead1fda7590834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.074905 10750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c403148f1f724c0ca12919d8e85ae572. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.081282 10899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 141934a83d874ca1bf1d69f49b95f1fc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:36.068579 10647 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.194:35051, user_credentials={real_user=slave}} blocked reactor thread for 66828.9us
I20260709 13:01:36.117455 10820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e976ba764734878bb65c5db5e908f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.118052 11033 ts_tablet_manager.cc:1434] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.167s	user 0.017s	sys 0.006s
I20260709 13:01:36.119184 11033 tablet_bootstrap.cc:492] T bb61bf6eaa1845f8add4d4057e49eb15 P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:36.120596 10968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f547b171c6b9445c95475ce3be870c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.123347 11037 tablet_bootstrap.cc:492] T b74f82b45a3242568f45f6a3fabeda31 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:36.124634 11011 heartbeater.cc:499] Master 127.0.107.254:46133 was elected leader, sending a full tablet report...
I20260709 13:01:36.105556 10937 heartbeater.cc:499] Master 127.0.107.254:46133 was elected leader, sending a full tablet report...
I20260709 13:01:36.131524 11038 raft_consensus.cc:493] T 03cf7a6241a444369a57fdaf965107b3 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.132190 11038 raft_consensus.cc:515] T 03cf7a6241a444369a57fdaf965107b3 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:36.135751 10827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 141934a83d874ca1bf1d69f49b95f1fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.136837 10902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48e63402e1544658a8d6cf5b9220414b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.138921 10824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48e63402e1544658a8d6cf5b9220414b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.139530 10893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a19edd96c26a4c91a7b2a412d8221e5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.141342 10744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4b9835406e84c5b88d3c3eed76a3b95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.145293 10972 tablet_service.cc:1511] Processing CreateTablet for tablet e187848edaa746928d647a830da8c970 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:01:36.146888 10972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e187848edaa746928d647a830da8c970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.141396 10894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f547b171c6b9445c95475ce3be870c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.168879 10900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aa37ce6306b47f0b7ead1fda7590834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.075114 10826 tablet_service.cc:1511] Processing CreateTablet for tablet f1c9e47add2e4175b68fde1a27aa92e0 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:01:36.176875 10826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c9e47add2e4175b68fde1a27aa92e0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:36.179673 11012 tablet.cc:2406] T 03cf7a6241a444369a57fdaf965107b3 P 5e62c52a41f7476a908dd377c1a8a79f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:01:36.181119 11032 ts_tablet_manager.cc:1434] T 03cf7a6241a444369a57fdaf965107b3 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.275s	user 0.022s	sys 0.030s
I20260709 13:01:36.182461 11032 tablet_bootstrap.cc:492] T 00d1eccb4ed0452ea1afb814db7c7330 P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:36.079558 10969 tablet_service.cc:1511] Processing CreateTablet for tablet f1c9e47add2e4175b68fde1a27aa92e0 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:01:36.184819 10969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c9e47add2e4175b68fde1a27aa92e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.188767 10822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c403148f1f724c0ca12919d8e85ae572. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.189129 11038 leader_election.cc:290] T 03cf7a6241a444369a57fdaf965107b3 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:36.194525 10745 tablet_service.cc:1511] Processing CreateTablet for tablet 3aa37ce6306b47f0b7ead1fda7590834 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:01:36.196082 10745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3aa37ce6306b47f0b7ead1fda7590834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.204896 10897 tablet_service.cc:1511] Processing CreateTablet for tablet 26b888af641846d495fe184e39aadc16 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:01:36.206142 11037 tablet_bootstrap.cc:654] T b74f82b45a3242568f45f6a3fabeda31 P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:36.208611 10896 tablet_service.cc:1511] Processing CreateTablet for tablet a62d4f04bff940779e241ebbd0aace2b (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:01:36.218474 10746 tablet_service.cc:1511] Processing CreateTablet for tablet f547b171c6b9445c95475ce3be870c2e (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:01:36.222172 10976 tablet_service.cc:1511] Processing CreateTablet for tablet a8b5a22ddad942d7b4db2b897e159337 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:01:36.226043 10967 tablet_service.cc:1511] Processing CreateTablet for tablet 26b888af641846d495fe184e39aadc16 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:01:36.209312 10753 tablet_service.cc:1511] Processing CreateTablet for tablet 2e976ba764734878bb65c5db5e908f56 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:01:36.259295 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8b5a22ddad942d7b4db2b897e159337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.237412 10975 tablet_service.cc:1511] Processing CreateTablet for tablet dd1014df7b2b4d2d80864646b5e5df5e (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:01:36.265537 10975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd1014df7b2b4d2d80864646b5e5df5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.269358 10967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26b888af641846d495fe184e39aadc16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.242434 10895 tablet_service.cc:1511] Processing CreateTablet for tablet a1ce467fbc054ba89724cca56e1ae56e (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:01:36.257783 10746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f547b171c6b9445c95475ce3be870c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.256317 11033 tablet_bootstrap.cc:654] T bb61bf6eaa1845f8add4d4057e49eb15 P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:36.292961 10973 tablet_service.cc:1511] Processing CreateTablet for tablet a62d4f04bff940779e241ebbd0aace2b (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:01:36.281509 11031 ts_tablet_manager.cc:1434] T b74f82b45a3242568f45f6a3fabeda31 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.334s	user 0.006s	sys 0.033s
I20260709 13:01:36.282338 10823 tablet_service.cc:1511] Processing CreateTablet for tablet b5a791a0126444ba90c1fb442e1b809b (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:01:36.288877 10753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e976ba764734878bb65c5db5e908f56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.290215 10828 tablet_service.cc:1511] Processing CreateTablet for tablet e187848edaa746928d647a830da8c970 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:01:36.303287 10747 tablet_service.cc:1511] Processing CreateTablet for tablet 48e63402e1544658a8d6cf5b9220414b (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:01:36.309640 10823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5a791a0126444ba90c1fb442e1b809b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.323243 10973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a62d4f04bff940779e241ebbd0aace2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.324182 11032 tablet_bootstrap.cc:654] T 00d1eccb4ed0452ea1afb814db7c7330 P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:36.292287 10821 tablet_service.cc:1511] Processing CreateTablet for tablet a8b5a22ddad942d7b4db2b897e159337 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:01:36.329447 10828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e187848edaa746928d647a830da8c970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.335668 10825 tablet_service.cc:1511] Processing CreateTablet for tablet a1ce467fbc054ba89724cca56e1ae56e (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:01:36.337173 10751 tablet_service.cc:1511] Processing CreateTablet for tablet dd1014df7b2b4d2d80864646b5e5df5e (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:01:36.336941 10897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26b888af641846d495fe184e39aadc16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.354604 10895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1ce467fbc054ba89724cca56e1ae56e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.349750 10821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8b5a22ddad942d7b4db2b897e159337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.357821 10974 tablet_service.cc:1511] Processing CreateTablet for tablet 96bfa4098abc4f4ba38783e8b91b8cdb (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:01:36.360323 11040 raft_consensus.cc:493] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.361063 11040 raft_consensus.cc:515] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:36.364156 11040 leader_election.cc:290] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:36.336982 10747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48e63402e1544658a8d6cf5b9220414b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.361016 11031 tablet_bootstrap.cc:492] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:36.376456 10744 tablet_service.cc:1511] Processing CreateTablet for tablet b5a791a0126444ba90c1fb442e1b809b (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:01:36.339876 10971 tablet_service.cc:1511] Processing CreateTablet for tablet 205f5d9c197b405faa72a70e2a010102 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:01:36.378758 10968 tablet_service.cc:1511] Processing CreateTablet for tablet 41a51aa36dad4f1a85c485d67d2903e2 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:01:36.379412 10974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96bfa4098abc4f4ba38783e8b91b8cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.344636 10970 tablet_service.cc:1511] Processing CreateTablet for tablet 64c5fd517a084ef9b707c36ec7c2fe3c (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:01:36.403239 10825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1ce467fbc054ba89724cca56e1ae56e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.354061 10820 tablet_service.cc:1511] Processing CreateTablet for tablet dd1014df7b2b4d2d80864646b5e5df5e (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:01:36.423802 10894 tablet_service.cc:1511] Processing CreateTablet for tablet 41a51aa36dad4f1a85c485d67d2903e2 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:01:36.425727 10824 tablet_service.cc:1511] Processing CreateTablet for tablet a62d4f04bff940779e241ebbd0aace2b (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:01:36.411319 10896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a62d4f04bff940779e241ebbd0aace2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.430945 10826 tablet_service.cc:1511] Processing CreateTablet for tablet 96a3b79f0ed34bce9764f4804d72c382 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:01:36.430534 10819 tablet_service.cc:1511] Processing CreateTablet for tablet 205f5d9c197b405faa72a70e2a010102 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:01:36.431831 10971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 205f5d9c197b405faa72a70e2a010102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.410880 10751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd1014df7b2b4d2d80864646b5e5df5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.451330 10820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd1014df7b2b4d2d80864646b5e5df5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.451459 11041 raft_consensus.cc:493] T b74f82b45a3242568f45f6a3fabeda31 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.460992 11041 raft_consensus.cc:515] T b74f82b45a3242568f45f6a3fabeda31 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:36.465444 10752 tablet_service.cc:1511] Processing CreateTablet for tablet a8b5a22ddad942d7b4db2b897e159337 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:01:36.467749 10894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a51aa36dad4f1a85c485d67d2903e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.475306 10826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a3b79f0ed34bce9764f4804d72c382. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.479923 10899 tablet_service.cc:1511] Processing CreateTablet for tablet 205f5d9c197b405faa72a70e2a010102 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:01:36.481547 10899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 205f5d9c197b405faa72a70e2a010102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.485651 11033 tablet_bootstrap.cc:492] T bb61bf6eaa1845f8add4d4057e49eb15 P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:36.486364 11033 ts_tablet_manager.cc:1403] T bb61bf6eaa1845f8add4d4057e49eb15 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.367s	user 0.026s	sys 0.020s
I20260709 13:01:36.488577 10902 tablet_service.cc:1511] Processing CreateTablet for tablet 96a3b79f0ed34bce9764f4804d72c382 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:01:36.490056 10902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a3b79f0ed34bce9764f4804d72c382. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.491140 11041 leader_election.cc:290] T b74f82b45a3242568f45f6a3fabeda31 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:36.495546 10900 tablet_service.cc:1511] Processing CreateTablet for tablet 96bfa4098abc4f4ba38783e8b91b8cdb (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:01:36.519524 10824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a62d4f04bff940779e241ebbd0aace2b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:36.525571 10647 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.194:35051, user_credentials={real_user=slave}} blocked reactor thread for 59536.6us
I20260709 13:01:36.527751 10827 tablet_service.cc:1511] Processing CreateTablet for tablet f570072427e34a4e843286441c60a630 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:01:36.519691 10970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c5fd517a084ef9b707c36ec7c2fe3c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:36.512780 10646 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.196:42509, user_credentials={real_user=slave}} blocked reactor thread for 51186us
I20260709 13:01:36.531024 10744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5a791a0126444ba90c1fb442e1b809b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.532979 10748 tablet_service.cc:1511] Processing CreateTablet for tablet a19edd96c26a4c91a7b2a412d8221e5b (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:01:36.534351 10748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a19edd96c26a4c91a7b2a412d8221e5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.536825 10968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a51aa36dad4f1a85c485d67d2903e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.537689 10749 tablet_service.cc:1511] Processing CreateTablet for tablet 141934a83d874ca1bf1d69f49b95f1fc (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:01:36.539070 10749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 141934a83d874ca1bf1d69f49b95f1fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.529220 10819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 205f5d9c197b405faa72a70e2a010102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.542119 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03cf7a6241a444369a57fdaf965107b3" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:36.543933 10827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f570072427e34a4e843286441c60a630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.547370 10750 tablet_service.cc:1511] Processing CreateTablet for tablet 26b888af641846d495fe184e39aadc16 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:01:36.515251 10901 tablet_service.cc:1511] Processing CreateTablet for tablet 8273bf9f9a174b3ea62b5ab0a0bb5730 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:01:36.552404 10901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8273bf9f9a174b3ea62b5ab0a0bb5730. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.554086 10752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8b5a22ddad942d7b4db2b897e159337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.558809 11033 raft_consensus.cc:359] T bb61bf6eaa1845f8add4d4057e49eb15 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:36.559700 11033 raft_consensus.cc:385] T bb61bf6eaa1845f8add4d4057e49eb15 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:36.560019 11033 raft_consensus.cc:740] T bb61bf6eaa1845f8add4d4057e49eb15 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:36.507505 10898 tablet_service.cc:1511] Processing CreateTablet for tablet f570072427e34a4e843286441c60a630 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:01:36.518749 10969 tablet_service.cc:1511] Processing CreateTablet for tablet 611ca169fbcc420fb11d1502cbe196a9 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:01:36.591619 10750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26b888af641846d495fe184e39aadc16. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:36.593075 10952 leader_election.cc:343] T 03cf7a6241a444369a57fdaf965107b3 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:36.593216 10838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03cf7a6241a444369a57fdaf965107b3" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
W20260709 13:01:36.596676 10646 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.196:42509, user_credentials={real_user=slave}} blocked reactor thread for 65802.7us
W20260709 13:01:36.589284 10647 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.194:35051, user_credentials={real_user=slave}} blocked reactor thread for 62157.8us
W20260709 13:01:36.612018 10951 leader_election.cc:343] T 03cf7a6241a444369a57fdaf965107b3 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:36.612705 10951 leader_election.cc:304] T 03cf7a6241a444369a57fdaf965107b3 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f; no voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:36.614214 11039 raft_consensus.cc:2749] T 03cf7a6241a444369a57fdaf965107b3 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:36.617630 10893 tablet_service.cc:1511] Processing CreateTablet for tablet bec830b175ce40d69b73d9f73ea266a7 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:01:36.621026 11037 tablet_bootstrap.cc:492] T b74f82b45a3242568f45f6a3fabeda31 P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:36.621701 11037 ts_tablet_manager.cc:1403] T b74f82b45a3242568f45f6a3fabeda31 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.499s	user 0.021s	sys 0.037s
I20260709 13:01:36.622413 10821 tablet_service.cc:1511] Processing CreateTablet for tablet 8273bf9f9a174b3ea62b5ab0a0bb5730 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:01:36.604154 11031 tablet_bootstrap.cc:654] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:36.628566 11037 raft_consensus.cc:359] T b74f82b45a3242568f45f6a3fabeda31 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:36.629616 10900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96bfa4098abc4f4ba38783e8b91b8cdb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:36.639339 10648 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.195:36351, user_credentials={real_user=slave}} blocked reactor thread for 96438.2us
I20260709 13:01:36.640189 10822 tablet_service.cc:1511] Processing CreateTablet for tablet 64c5fd517a084ef9b707c36ec7c2fe3c (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:01:36.636245 11037 raft_consensus.cc:385] T b74f82b45a3242568f45f6a3fabeda31 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:36.641122 11037 raft_consensus.cc:740] T b74f82b45a3242568f45f6a3fabeda31 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:36.641942 11037 consensus_queue.cc:260] T b74f82b45a3242568f45f6a3fabeda31 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:36.504451 10976 tablet_service.cc:1511] Processing CreateTablet for tablet f570072427e34a4e843286441c60a630 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:01:36.641852 10822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c5fd517a084ef9b707c36ec7c2fe3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.649495 11032 tablet_bootstrap.cc:492] T 00d1eccb4ed0452ea1afb814db7c7330 P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:36.650705 10898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f570072427e34a4e843286441c60a630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.656836 11032 ts_tablet_manager.cc:1403] T 00d1eccb4ed0452ea1afb814db7c7330 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.475s	user 0.003s	sys 0.027s
I20260709 13:01:36.605576 10975 tablet_service.cc:1511] Processing CreateTablet for tablet bec830b175ce40d69b73d9f73ea266a7 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:01:36.665565 11032 raft_consensus.cc:359] T 00d1eccb4ed0452ea1afb814db7c7330 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:36.666374 10893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bec830b175ce40d69b73d9f73ea266a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.666461 11032 raft_consensus.cc:385] T 00d1eccb4ed0452ea1afb814db7c7330 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:36.666903 11032 raft_consensus.cc:740] T 00d1eccb4ed0452ea1afb814db7c7330 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:36.667757 11032 consensus_queue.cc:260] T 00d1eccb4ed0452ea1afb814db7c7330 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:36.669979 11032 ts_tablet_manager.cc:1434] T 00d1eccb4ed0452ea1afb814db7c7330 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:01:36.671059 11032 tablet_bootstrap.cc:492] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:36.670812 10753 tablet_service.cc:1511] Processing CreateTablet for tablet 41a51aa36dad4f1a85c485d67d2903e2 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:01:36.586390 11033 consensus_queue.cc:260] T bb61bf6eaa1845f8add4d4057e49eb15 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:36.673781 11033 ts_tablet_manager.cc:1434] T bb61bf6eaa1845f8add4d4057e49eb15 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.187s	user 0.007s	sys 0.000s
I20260709 13:01:36.674417 10753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41a51aa36dad4f1a85c485d67d2903e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.674925 11033 tablet_bootstrap.cc:492] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:36.676676 10828 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53640 (request call id 23) took 1034 ms. Trace:
I20260709 13:01:36.677002 10821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8273bf9f9a174b3ea62b5ab0a0bb5730. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.677206 10828 rpcz_store.cc:276] 0709 13:01:35.642793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.289260 (+646467us) service_pool.cc:224] Handling call
0709 13:01:36.328730 (+ 39470us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.328913 (+   183us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:36.430151 (+101238us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:36.604872 (+174721us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:36.676597 (+ 71725us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:36.679662 10828 tablet_service.cc:1511] Processing CreateTablet for tablet 611ca169fbcc420fb11d1502cbe196a9 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
W20260709 13:01:36.680317 10708 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:36.680974 10828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 611ca169fbcc420fb11d1502cbe196a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.665920 10745 tablet_service.cc:1511] Processing CreateTablet for tablet a1ce467fbc054ba89724cca56e1ae56e (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:01:36.682966 10969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 611ca169fbcc420fb11d1502cbe196a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.683645 10745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1ce467fbc054ba89724cca56e1ae56e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.683347 10972 tablet_service.cc:1511] Processing CreateTablet for tablet d2c28919f0174f6d905b1b1a53f64d6d (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:01:36.684216 10975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bec830b175ce40d69b73d9f73ea266a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.702617 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f570072427e34a4e843286441c60a630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.708375 10972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2c28919f0174f6d905b1b1a53f64d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.716892 10763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b74f82b45a3242568f45f6a3fabeda31" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:36.717753 10763 raft_consensus.cc:2468] T b74f82b45a3242568f45f6a3fabeda31 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 0.
I20260709 13:01:36.720547 10895 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36176 (request call id 27) took 1023 ms. Trace:
I20260709 13:01:36.720971 10802 leader_election.cc:304] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:36.721943 11040 raft_consensus.cc:2804] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:36.722337 11040 raft_consensus.cc:493] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:36.722672 11040 raft_consensus.cc:3060] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:36.737771 10897 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36176 (request call id 25) took 1055 ms. Trace:
I20260709 13:01:36.738245 10897 rpcz_store.cc:276] 0709 13:01:35.682719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.203822 (+521103us) service_pool.cc:224] Handling call
0709 13:01:36.274034 (+ 70212us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.293854 (+ 19820us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:36.491344 (+197490us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:36.737170 (+245826us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:36.737701 (+   531us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:36.741226 10827 tablet_service.cc:1511] Processing CreateTablet for tablet d2c28919f0174f6d905b1b1a53f64d6d (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:01:36.751611 10827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2c28919f0174f6d905b1b1a53f64d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.740197 10897 tablet_service.cc:1511] Processing CreateTablet for tablet d2c28919f0174f6d905b1b1a53f64d6d (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:01:36.753741 10897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2c28919f0174f6d905b1b1a53f64d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.743772 10823 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53640 (request call id 22) took 1101 ms. Trace:
I20260709 13:01:36.756987 10823 rpcz_store.cc:276] 0709 13:01:35.642331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.281315 (+638984us) service_pool.cc:224] Handling call
0709 13:01:36.308791 (+ 27476us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.308959 (+   168us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:36.596027 (+287068us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:36.743157 (+147130us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:36.743701 (+   544us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:36.758545 11033 tablet_bootstrap.cc:654] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:36.759127 10823 tablet_service.cc:1511] Processing CreateTablet for tablet 4a819525c849499885ee37af7d0f42a2 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:01:36.763494 10823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a819525c849499885ee37af7d0f42a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.743868 11040 raft_consensus.cc:515] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:36.765866 10901 tablet_service.cc:1511] Processing CreateTablet for tablet 4a819525c849499885ee37af7d0f42a2 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:01:36.767365 10901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a819525c849499885ee37af7d0f42a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.767902 10763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b74f82b45a3242568f45f6a3fabeda31" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:36.768630 10763 raft_consensus.cc:3060] T b74f82b45a3242568f45f6a3fabeda31 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:36.770679 10967 tablet_service.cc:1511] Processing CreateTablet for tablet 2ea7c6df9b4340ffaf28c5a78966c74b (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:01:36.772264 10967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ea7c6df9b4340ffaf28c5a78966c74b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.771884 10974 tablet_service.cc:1511] Processing CreateTablet for tablet 401ec66526fe4ad0a997979233dd7ef3 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:01:36.750098 10970 tablet_service.cc:1511] Processing CreateTablet for tablet a3b562356d3b4807a92648800cfe3dac (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:01:36.771064 10824 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53640 (request call id 26) took 1068 ms. Trace:
I20260709 13:01:36.774953 10824 rpcz_store.cc:276] 0709 13:01:35.706245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.297819 (+591574us) service_pool.cc:224] Handling call
0709 13:01:36.437367 (+139548us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.437477 (+   110us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:36.598177 (+160700us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:36.770509 (+172332us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:36.770996 (+   487us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:36.784834 10838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b74f82b45a3242568f45f6a3fabeda31" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:36.785715 10838 raft_consensus.cc:2393] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b778a184b0ac46f5b86ce4fe363dcbab in current term 1: Already voted for candidate dbd1fdffc68440e5b6250f6d95a4a367 in this term.
I20260709 13:01:36.787058 10824 tablet_service.cc:1511] Processing CreateTablet for tablet c1470fc689d7429dada3bf5d45a82374 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:01:36.774232 10820 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53640 (request call id 28) took 1062 ms. Trace:
I20260709 13:01:36.817412 10820 rpcz_store.cc:276] 0709 13:01:35.711244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.352910 (+641666us) service_pool.cc:224] Handling call
0709 13:01:36.416698 (+ 63788us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.416794 (+    96us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:36.518581 (+101787us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:36.717214 (+198633us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:36.773214 (+ 56000us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:36.809248 11031 tablet_bootstrap.cc:492] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:36.819193 11031 ts_tablet_manager.cc:1403] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.458s	user 0.013s	sys 0.010s
I20260709 13:01:36.820609 10820 tablet_service.cc:1511] Processing CreateTablet for tablet 401ec66526fe4ad0a997979233dd7ef3 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:01:36.809378 10749 tablet_service.cc:1511] Processing CreateTablet for tablet 8273bf9f9a174b3ea62b5ab0a0bb5730 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:01:36.812031 10824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1470fc689d7429dada3bf5d45a82374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.850301 10749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8273bf9f9a174b3ea62b5ab0a0bb5730. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.842868 10894 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36176 (request call id 28) took 1125 ms. Trace:
I20260709 13:01:36.813123 11040 leader_election.cc:290] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Requested vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:36.852217 10894 rpcz_store.cc:276] 0709 13:01:35.717511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.422798 (+705287us) service_pool.cc:224] Handling call
0709 13:01:36.448560 (+ 25762us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.467309 (+ 18749us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:36.762411 (+295102us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:36.835373 (+ 72962us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:36.842807 (+  7434us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:36.740212 10973 tablet_service.cc:1511] Processing CreateTablet for tablet c1470fc689d7429dada3bf5d45a82374 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:01:36.813783 10900 tablet_service.cc:1511] Processing CreateTablet for tablet a3b562356d3b4807a92648800cfe3dac (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:01:36.799705 10970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b562356d3b4807a92648800cfe3dac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.861641 11031 raft_consensus.cc:359] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:36.862461 11031 raft_consensus.cc:385] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:36.862811 11031 raft_consensus.cc:740] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:36.721040 10895 rpcz_store.cc:276] 0709 13:01:35.696706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.241462 (+544756us) service_pool.cc:224] Handling call
0709 13:01:36.354047 (+112585us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.354195 (+   148us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:36.518045 (+163850us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:36.719979 (+201934us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:36.720445 (+   466us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:36.865880 10820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401ec66526fe4ad0a997979233dd7ef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.866429 10751 tablet_service.cc:1511] Processing CreateTablet for tablet 96a3b79f0ed34bce9764f4804d72c382 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:01:36.867446 10973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1470fc689d7429dada3bf5d45a82374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.867787 10751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a3b79f0ed34bce9764f4804d72c382. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.868346 10974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401ec66526fe4ad0a997979233dd7ef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.869966 10975 tablet_service.cc:1511] Processing CreateTablet for tablet a4eb868d99c9464996fb44dd3acdca7a (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:01:36.839473 10748 tablet_service.cc:1511] Processing CreateTablet for tablet 96bfa4098abc4f4ba38783e8b91b8cdb (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:01:36.843411 11037 ts_tablet_manager.cc:1434] T b74f82b45a3242568f45f6a3fabeda31 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.221s	user 0.019s	sys 0.000s
I20260709 13:01:36.883056 11037 tablet_bootstrap.cc:492] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:36.884557 11033 tablet_bootstrap.cc:492] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:36.885151 11033 ts_tablet_manager.cc:1403] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.210s	user 0.010s	sys 0.014s
I20260709 13:01:36.846735 10826 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53640 (request call id 30) took 1081 ms. Trace:
I20260709 13:01:36.866367 10895 tablet_service.cc:1511] Processing CreateTablet for tablet 3ecfbc8cc6e7441fb568b197ffade11e (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:01:36.862617 10894 tablet_service.cc:1511] Processing CreateTablet for tablet 401ec66526fe4ad0a997979233dd7ef3 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:01:36.833603 10763 raft_consensus.cc:2468] T b74f82b45a3242568f45f6a3fabeda31 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 1.
I20260709 13:01:36.874643 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b74f82b45a3242568f45f6a3fabeda31" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:36.876008 10900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b562356d3b4807a92648800cfe3dac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.876591 10911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b74f82b45a3242568f45f6a3fabeda31" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:36.875923 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b74f82b45a3242568f45f6a3fabeda31" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:36.837246 10971 tablet_service.cc:1511] Processing CreateTablet for tablet c3f9e2acc7244a26b1dbae53f8d0040a (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:01:36.870867 11032 tablet_bootstrap.cc:654] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:36.848443 10902 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36176 (request call id 30) took 1080 ms. Trace:
I20260709 13:01:36.934083 10762 raft_consensus.cc:2393] T b74f82b45a3242568f45f6a3fabeda31 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b778a184b0ac46f5b86ce4fe363dcbab in current term 1: Already voted for candidate dbd1fdffc68440e5b6250f6d95a4a367 in this term.
I20260709 13:01:36.935541 10876 leader_election.cc:304] T b74f82b45a3242568f45f6a3fabeda31 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab; no voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:36.887921 10821 tablet_service.cc:1511] Processing CreateTablet for tablet 3ecfbc8cc6e7441fb568b197ffade11e (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:01:36.937161 10895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ecfbc8cc6e7441fb568b197ffade11e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.932323 10902 rpcz_store.cc:276] 0709 13:01:35.767817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.487546 (+719729us) service_pool.cc:224] Handling call
0709 13:01:36.489535 (+  1989us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.489632 (+    97us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:36.780355 (+290723us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:36.847851 (+ 67496us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:36.848374 (+   523us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:36.938292 10912 raft_consensus.cc:2468] T b74f82b45a3242568f45f6a3fabeda31 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 0.
I20260709 13:01:36.938844 11041 raft_consensus.cc:3060] T b74f82b45a3242568f45f6a3fabeda31 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:36.939487 10902 tablet_service.cc:1511] Processing CreateTablet for tablet c3f9e2acc7244a26b1dbae53f8d0040a (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:01:36.883075 10896 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36176 (request call id 26) took 1193 ms. Trace:
I20260709 13:01:36.893255 10975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4eb868d99c9464996fb44dd3acdca7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.897269 10748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96bfa4098abc4f4ba38783e8b91b8cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.899145 10753 tablet_service.cc:1511] Processing CreateTablet for tablet 64c5fd517a084ef9b707c36ec7c2fe3c (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:01:36.924206 10826 rpcz_store.cc:276] 0709 13:01:35.765567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.430047 (+664480us) service_pool.cc:224] Handling call
0709 13:01:36.471955 (+ 41908us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.472118 (+   163us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:36.667615 (+195497us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:36.846163 (+178548us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:36.846670 (+   507us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:36.946934 10753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64c5fd517a084ef9b707c36ec7c2fe3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.947643 10894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401ec66526fe4ad0a997979233dd7ef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.914578 10744 tablet_service.cc:1511] Processing CreateTablet for tablet 611ca169fbcc420fb11d1502cbe196a9 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:01:36.903378 11031 consensus_queue.cc:260] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:36.950407 10752 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35506 (request call id 25) took 1027 ms. Trace:
I20260709 13:01:36.956671 10752 rpcz_store.cc:276] 0709 13:01:35.923259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.464395 (+541136us) service_pool.cc:224] Handling call
0709 13:01:36.553297 (+ 88902us) spinlock_profiling.cc:243] Waited 52.6 ms on lock 0x7b5800000098. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc862085831 00007fc862062ac3 00007fc862011400 00007fc85b496af4 00007fc85b496a82 00007fc85b4969b1
0709 13:01:36.553480 (+   183us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.553602 (+   122us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:36.833475 (+279873us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:36.949835 (+116360us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:36.950344 (+   509us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121031552}
I20260709 13:01:36.957713 10826 tablet_service.cc:1511] Processing CreateTablet for tablet 2ea7c6df9b4340ffaf28c5a78966c74b (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:01:36.954456 10750 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35506 (request call id 26) took 1030 ms. Trace:
I20260709 13:01:36.876507 10899 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36176 (request call id 29) took 1141 ms. Trace:
I20260709 13:01:36.949601 10744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 611ca169fbcc420fb11d1502cbe196a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.978533 10968 tablet_service.cc:1511] Processing CreateTablet for tablet 211c168fa9614dbda8d8870bf5713616 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:01:36.981379 10972 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43098 (request call id 35) took 1045 ms. Trace:
I20260709 13:01:36.962913 10902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3f9e2acc7244a26b1dbae53f8d0040a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.943739 10896 rpcz_store.cc:276] 0709 13:01:35.689875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.207630 (+517755us) service_pool.cc:224] Handling call
0709 13:01:36.293161 (+ 85531us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b5800201998. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2ca22 00007fc862e45c09 00007fc861f9fee0 00007fc862085831 00007fc862062ac3 00007fc862011400 00007fc85b496af4 00007fc85b496a82 00007fc85b4969b1
0709 13:01:36.353903 (+ 60742us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b5800201998. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cf8c 00007fc859f2cef6 0000000000375939 00007fc861fa01e0 00007fc86208584c 00007fc862062ac3 00007fc862011400 00007fc85b496af4 00007fc85b496a82 00007fc85b4969b1
0709 13:01:36.364779 (+ 10876us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.382720 (+ 17941us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:36.614405 (+231685us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:36.882449 (+268044us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:36.883007 (+   558us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12720256}
I20260709 13:01:36.942904 10746 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35506 (request call id 20) took 1021 ms. Trace:
I20260709 13:01:36.981515 11041 raft_consensus.cc:2749] T b74f82b45a3242568f45f6a3fabeda31 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:36.983398 10746 rpcz_store.cc:276] 0709 13:01:35.921577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.217404 (+295827us) service_pool.cc:224] Handling call
0709 13:01:36.257265 (+ 39861us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.257371 (+   106us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:36.786040 (+528669us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:36.942368 (+156328us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:36.942843 (+   475us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:36.982108 10972 rpcz_store.cc:276] 0709 13:01:35.935933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.682305 (+746372us) service_pool.cc:224] Handling call
0709 13:01:36.707848 (+ 25543us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.707951 (+   103us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:36.808996 (+101045us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:36.980794 (+171798us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:36.981312 (+   518us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:36.974942 10899 rpcz_store.cc:276] 0709 13:01:35.734804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.448939 (+714135us) service_pool.cc:224] Handling call
0709 13:01:36.481006 (+ 32067us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.481129 (+   123us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:36.701035 (+219906us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:36.793518 (+ 92483us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:36.876425 (+ 82907us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:36.992247 10749 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35506 (request call id 33) took 1007 ms. Trace:
I20260709 13:01:36.970412 10976 tablet_service.cc:1511] Processing CreateTablet for tablet c6842d144c244233a18d121c7966712a (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:01:36.971360 11037 tablet_bootstrap.cc:654] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:36.969156 10752 tablet_service.cc:1511] Processing CreateTablet for tablet bec830b175ce40d69b73d9f73ea266a7 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:01:36.974094 10897 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36176 (request call id 35) took 1051 ms. Trace:
I20260709 13:01:36.995422 10897 rpcz_store.cc:276] 0709 13:01:35.922332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.739269 (+816937us) service_pool.cc:224] Handling call
0709 13:01:36.753215 (+ 13946us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.753326 (+   111us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:36.878304 (+124978us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:36.973439 (+ 95135us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:36.974022 (+   583us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:36.996946 10893 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36176 (request call id 34) took 1081 ms. Trace:
I20260709 13:01:36.971879 10747 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35506 (request call id 21) took 1050 ms. Trace:
I20260709 13:01:36.997082 10746 tablet_service.cc:1511] Processing CreateTablet for tablet 4a819525c849499885ee37af7d0f42a2 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:01:36.982038 10802 leader_election.cc:304] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367; no voters: b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:36.999053 11040 raft_consensus.cc:2804] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:36.894498 10825 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53640 (request call id 27) took 1185 ms. Trace:
I20260709 13:01:36.996027 10752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bec830b175ce40d69b73d9f73ea266a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.997767 10747 rpcz_store.cc:276] 0709 13:01:35.921900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.302309 (+380409us) service_pool.cc:224] Handling call
0709 13:01:36.304258 (+  1949us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.304391 (+   133us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:36.676289 (+371898us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:36.971323 (+295034us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:36.971814 (+   491us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:36.937217 10821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ecfbc8cc6e7441fb568b197ffade11e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:37.003769 10971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3f9e2acc7244a26b1dbae53f8d0040a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.888661 11033 raft_consensus.cc:359] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:37.001085 10825 rpcz_store.cc:276] 0709 13:01:35.708895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.334540 (+625645us) service_pool.cc:224] Handling call
0709 13:01:36.350684 (+ 16144us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.350772 (+    88us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:36.642308 (+291536us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:36.893939 (+251631us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:36.894432 (+   493us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.005319 10745 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35506 (request call id 27) took 1081 ms. Trace:
I20260709 13:01:36.962133 10750 rpcz_store.cc:276] 0709 13:01:35.923571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.546370 (+622799us) service_pool.cc:224] Handling call
0709 13:01:36.548318 (+  1948us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.548421 (+   103us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:36.772547 (+224126us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:36.953937 (+181390us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:36.954395 (+   458us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.033483 10899 tablet_service.cc:1511] Processing CreateTablet for tablet c6842d144c244233a18d121c7966712a (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:01:37.033998 10750 tablet_service.cc:1511] Processing CreateTablet for tablet a3b562356d3b4807a92648800cfe3dac (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:01:37.034893 10899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6842d144c244233a18d121c7966712a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:36.998324 10896 tablet_service.cc:1511] Processing CreateTablet for tablet a4eb868d99c9464996fb44dd3acdca7a (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:01:37.036142 10896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4eb868d99c9464996fb44dd3acdca7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:37.016644 10746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a819525c849499885ee37af7d0f42a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:37.005652 10749 rpcz_store.cc:276] 0709 13:01:35.984559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.808177 (+823618us) service_pool.cc:224] Handling call
0709 13:01:36.849820 (+ 41643us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.849920 (+   100us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:36.903110 (+ 53190us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:36.968366 (+ 65256us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:36.992185 (+ 23819us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.018388 10819 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53640 (request call id 29) took 1297 ms. Trace:
I20260709 13:01:36.997462 10893 rpcz_store.cc:276] 0709 13:01:35.915359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.560987 (+645628us) service_pool.cc:224] Handling call
0709 13:01:36.634735 (+ 73748us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.644075 (+  9340us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:36.902227 (+258152us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:36.996330 (+ 94103us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:36.996886 (+   556us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.024892 10968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 211c168fa9614dbda8d8870bf5713616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:37.025682 10747 tablet_service.cc:1511] Processing CreateTablet for tablet c1470fc689d7429dada3bf5d45a82374 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:01:37.042390 11031 ts_tablet_manager.cc:1434] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.223s	user 0.014s	sys 0.012s
I20260709 13:01:36.998436 10897 tablet_service.cc:1511] Processing CreateTablet for tablet 14dc277ad7874e419ed2d2bff2165611 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:01:37.058208 10826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ea7c6df9b4340ffaf28c5a78966c74b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:37.069602 10821 tablet_service.cc:1511] Processing CreateTablet for tablet 14dc277ad7874e419ed2d2bff2165611 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:01:37.064522 11031 tablet_bootstrap.cc:492] T ffe62eca39f04407943d15c5f7646aee P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:37.056691 11041 raft_consensus.cc:493] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.066018 10750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b562356d3b4807a92648800cfe3dac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:37.033901 10825 tablet_service.cc:1511] Processing CreateTablet for tablet a4eb868d99c9464996fb44dd3acdca7a (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:01:37.067675 10901 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36176 (request call id 36) took 1139 ms. Trace:
I20260709 13:01:37.092126 10901 rpcz_store.cc:276] 0709 13:01:35.928288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.760131 (+831843us) service_pool.cc:224] Handling call
0709 13:01:36.766862 (+  6731us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.766962 (+   100us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:36.851204 (+ 84242us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:37.067140 (+215936us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:37.067607 (+   467us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.072274 11039 raft_consensus.cc:493] T 00d1eccb4ed0452ea1afb814db7c7330 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.093782 11039 raft_consensus.cc:515] T 00d1eccb4ed0452ea1afb814db7c7330 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:37.076720 10976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6842d144c244233a18d121c7966712a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:37.076772 11032 tablet_bootstrap.cc:492] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:37.077790 10897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14dc277ad7874e419ed2d2bff2165611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:37.036861 10745 rpcz_store.cc:276] 0709 13:01:35.923882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.664992 (+741110us) service_pool.cc:224] Handling call
0709 13:01:36.683167 (+ 18175us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.683282 (+   115us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:36.933776 (+250494us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:37.004702 (+ 70926us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:37.005251 (+   549us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.053303 10819 rpcz_store.cc:276] 0709 13:01:35.721346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.429518 (+708172us) service_pool.cc:224] Handling call
0709 13:01:36.466127 (+ 36609us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b5800550e98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2ce9c 00007fc859f2ca5b 00007fc862e45c09 00007fc861f9fee0 00007fc862085831 00007fc862062ac3 00007fc862011400 00007fc85b496af4 00007fc85b496a82 00007fc85b4969b1
0709 13:01:36.472584 (+  6457us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.472682 (+    98us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:36.691524 (+218842us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:37.017619 (+326095us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:37.018321 (+   702us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10861824}
I20260709 13:01:37.101104 10745 tablet_service.cc:1511] Processing CreateTablet for tablet 2ea7c6df9b4340ffaf28c5a78966c74b (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:01:37.081485 10749 tablet_service.cc:1511] Processing CreateTablet for tablet 3ecfbc8cc6e7441fb568b197ffade11e (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:01:37.037019 11033 raft_consensus.cc:385] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:37.087903 11037 tablet_bootstrap.cc:492] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:37.061048 11040 raft_consensus.cc:697] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Becoming Leader. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Running, Role: LEADER
I20260709 13:01:37.090402 10751 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35506 (request call id 30) took 1111 ms. Trace:
I20260709 13:01:37.091080 11041 raft_consensus.cc:515] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:37.107540 11033 raft_consensus.cc:740] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:37.115237 10821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14dc277ad7874e419ed2d2bff2165611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:37.092707 10747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1470fc689d7429dada3bf5d45a82374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:37.104005 11032 ts_tablet_manager.cc:1403] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.433s	user 0.011s	sys 0.032s
I20260709 13:01:37.099313 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d1eccb4ed0452ea1afb814db7c7330" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:37.109754 11040 consensus_queue.cc:237] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:37.108629 10751 rpcz_store.cc:276] 0709 13:01:35.978797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.865520 (+886723us) service_pool.cc:224] Handling call
0709 13:01:36.867323 (+  1803us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.867426 (+   103us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:36.966713 (+ 99287us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:37.089849 (+123136us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:37.090338 (+   489us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.122695 10753 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35506 (request call id 31) took 1143 ms. Trace:
I20260709 13:01:37.096387 11039 leader_election.cc:290] T 00d1eccb4ed0452ea1afb814db7c7330 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:37.124135 10751 tablet_service.cc:1511] Processing CreateTablet for tablet c3f9e2acc7244a26b1dbae53f8d0040a (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:01:37.124293 10820 tablet_service.cc:1511] Processing CreateTablet for tablet 211c168fa9614dbda8d8870bf5713616 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:01:37.119122 11041 leader_election.cc:290] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:37.111186 11037 ts_tablet_manager.cc:1403] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.228s	user 0.016s	sys 0.023s
I20260709 13:01:37.115075 11033 consensus_queue.cc:260] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:37.120134 10745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ea7c6df9b4340ffaf28c5a78966c74b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:37.128237 10898 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36176 (request call id 32) took 1293 ms. Trace:
W20260709 13:01:37.119606 10952 leader_election.cc:343] T 00d1eccb4ed0452ea1afb814db7c7330 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:37.138540 10749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ecfbc8cc6e7441fb568b197ffade11e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:37.123175 10753 rpcz_store.cc:276] 0709 13:01:35.979207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.897946 (+918739us) service_pool.cc:224] Handling call
0709 13:01:36.946461 (+ 48515us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.946568 (+   107us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:37.023367 (+ 76799us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:37.122100 (+ 98733us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:37.122576 (+   476us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.138675 10898 rpcz_store.cc:276] 0709 13:01:35.834366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.506544 (+672178us) service_pool.cc:224] Handling call
0709 13:01:36.606037 (+ 99493us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.626331 (+ 20294us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:36.806126 (+179795us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:37.098026 (+291900us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:37.127937 (+ 29911us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.140538 10753 tablet_service.cc:1511] Processing CreateTablet for tablet 14dc277ad7874e419ed2d2bff2165611 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:01:37.141964 10820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 211c168fa9614dbda8d8870bf5713616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:37.141860 11032 raft_consensus.cc:359] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:37.142725 11032 raft_consensus.cc:385] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:37.143023 11032 raft_consensus.cc:740] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:37.143792 11032 consensus_queue.cc:260] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:37.140976 10828 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53640 (request call id 34) took 1227 ms. Trace:
I20260709 13:01:37.098671 10748 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35506 (request call id 32) took 1113 ms. Trace:
I20260709 13:01:37.152659 11063 raft_consensus.cc:493] T bb61bf6eaa1845f8add4d4057e49eb15 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.152957 10825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4eb868d99c9464996fb44dd3acdca7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:37.152866 10823 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53640 (request call id 36) took 1225 ms. Trace:
I20260709 13:01:37.153316 10822 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53640 (request call id 31) took 1357 ms. Trace:
I20260709 13:01:37.154337 10822 rpcz_store.cc:276] 0709 13:01:35.795755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.500020 (+704265us) service_pool.cc:224] Handling call
0709 13:01:36.641221 (+141201us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.641328 (+   107us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:36.899695 (+258367us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:37.131602 (+231907us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:37.153258 (+ 21656us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.147207 10828 rpcz_store.cc:276] 0709 13:01:35.913145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.678714 (+765569us) service_pool.cc:224] Handling call
0709 13:01:36.680469 (+  1755us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.680596 (+   127us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:36.864909 (+184313us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:37.101627 (+236718us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:37.104873 (+  3246us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b5800550e98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2d1a2 00007fc862e6ebb9 00007fc861f9fd88 00007fc862066973 00007fc86206270f 00007fc862062ecd 00007fc862011400 00007fc85b496af4 00007fc85b496a82
0709 13:01:37.140911 (+ 36038us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7293,"spinlock_wait_cycles":2720512}
I20260709 13:01:37.156612 10753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14dc277ad7874e419ed2d2bff2165611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:37.153865 10823 rpcz_store.cc:276] 0709 13:01:35.927231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.758132 (+830901us) service_pool.cc:224] Handling call
0709 13:01:36.762952 (+  4820us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.763049 (+    97us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:36.937129 (+174080us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:37.099144 (+162015us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:37.123702 (+ 24558us) spinlock_profiling.cc:243] Waited 6.35 ms on lock 0x7b5800550e98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2d1a2 00007fc862e6ebb9 00007fc861f9fd88 00007fc862066973 00007fc86206270f 00007fc862062ecd 00007fc862011400 00007fc85b496af4 00007fc85b496a82
0709 13:01:37.152802 (+ 29100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7597,"spinlock_wait_cycles":14605184}
I20260709 13:01:37.150718 10748 rpcz_store.cc:276] 0709 13:01:35.984207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.838493 (+854286us) service_pool.cc:224] Handling call
0709 13:01:36.896790 (+ 58297us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.896884 (+    94us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:37.053747 (+156863us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:37.096007 (+ 42260us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:37.097989 (+  1982us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.153395 11063 raft_consensus.cc:515] T bb61bf6eaa1845f8add4d4057e49eb15 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:37.160315 10748 tablet_service.cc:1511] Processing CreateTablet for tablet 211c168fa9614dbda8d8870bf5713616 (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:01:37.161794 10748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 211c168fa9614dbda8d8870bf5713616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:37.162585 11063 leader_election.cc:290] T bb61bf6eaa1845f8add4d4057e49eb15 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:37.165153 10744 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35506 (request call id 34) took 1180 ms. Trace:
I20260709 13:01:37.165647 10744 rpcz_store.cc:276] 0709 13:01:35.984907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.913513 (+928606us) service_pool.cc:224] Handling call
0709 13:01:36.949105 (+ 35592us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.949245 (+   140us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:37.067012 (+117767us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:37.164571 (+ 97559us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:37.165088 (+   517us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.168522 10744 tablet_service.cc:1511] Processing CreateTablet for tablet c6842d144c244233a18d121c7966712a (DEFAULT_TABLE table=test-workload [id=370f0c23b1e14334971d9fa5d57abb11]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:01:37.160527 10827 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53640 (request call id 35) took 1233 ms. Trace:
I20260709 13:01:37.181427 11037 raft_consensus.cc:359] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:37.182303 11037 raft_consensus.cc:385] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:37.182601 11037 raft_consensus.cc:740] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:37.202860 10751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3f9e2acc7244a26b1dbae53f8d0040a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:37.209352 10744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6842d144c244233a18d121c7966712a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:37.252727 11033 ts_tablet_manager.cc:1434] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.367s	user 0.034s	sys 0.044s
I20260709 13:01:37.253780 11033 tablet_bootstrap.cc:492] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:37.265514 11031 tablet_bootstrap.cc:654] T ffe62eca39f04407943d15c5f7646aee P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:37.177256 10827 rpcz_store.cc:276] 0709 13:01:35.919913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.740242 (+820329us) service_pool.cc:224] Handling call
0709 13:01:36.751095 (+ 10853us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.751192 (+    97us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:36.842314 (+ 91122us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:37.103803 (+261489us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:37.112063 (+  8260us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b5800550e98. stack: 00007fc859f32343 00007fc859f32240 00007fc8598c11d4 00007fc8635ff304 00007fc8635ff299 00007fc859decdb1 00007fc859f2cb71 00007fc859f2d1a2 00007fc862e6ebb9 00007fc861f9fd88 00007fc862066973 00007fc86206270f 00007fc862062ecd 00007fc862011400 00007fc85b496af4 00007fc85b496a82
0709 13:01:37.150784 (+ 38721us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3482368}
I20260709 13:01:37.279122 10752 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35506 (request call id 35) took 1293 ms. Trace:
I20260709 13:01:37.279671 10752 rpcz_store.cc:276] 0709 13:01:35.985219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.958001 (+972782us) service_pool.cc:224] Handling call
0709 13:01:36.995538 (+ 37537us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.995644 (+   106us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:37.070088 (+ 74444us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:37.278533 (+208445us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:37.279055 (+   522us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.278204 10973 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43098 (request call id 36) took 1341 ms. Trace:
I20260709 13:01:37.282675 10973 rpcz_store.cc:276] 0709 13:01:35.936436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.739188 (+802752us) service_pool.cc:224] Handling call
0709 13:01:36.860928 (+121740us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.861023 (+    95us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:37.089053 (+228030us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:37.275407 (+186354us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:37.278138 (+  2731us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.283589 10824 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:53640 (request call id 37) took 1305 ms. Trace:
I20260709 13:01:37.285653 10824 rpcz_store.cc:276] 0709 13:01:35.978520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.786061 (+807541us) service_pool.cc:224] Handling call
0709 13:01:36.788523 (+  2462us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.788667 (+   144us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:37.097251 (+308584us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:37.283064 (+185813us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:37.283520 (+   456us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.221850 11037 consensus_queue.cc:260] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:37.306613 10745 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35506 (request call id 40) took 1027 ms. Trace:
I20260709 13:01:37.318269 10745 rpcz_store.cc:276] 0709 13:01:36.279495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.100112 (+820617us) service_pool.cc:224] Handling call
0709 13:01:37.101940 (+  1828us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:37.102036 (+    96us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:37.285494 (+183458us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:37.305779 (+ 20285us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:37.306525 (+   746us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.326471 10763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d1eccb4ed0452ea1afb814db7c7330" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:37.327747 11032 ts_tablet_manager.cc:1434] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.212s	user 0.008s	sys 0.000s
W20260709 13:01:37.328598 10950 leader_election.cc:343] T 00d1eccb4ed0452ea1afb814db7c7330 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:37.329116 10950 leader_election.cc:304] T 00d1eccb4ed0452ea1afb814db7c7330 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f; no voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:37.331961 11039 raft_consensus.cc:2749] T 00d1eccb4ed0452ea1afb814db7c7330 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:37.334607 11032 tablet_bootstrap.cc:492] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:37.342059 11039 raft_consensus.cc:493] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.342913 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b6ca3deb4f59aa2803e2ed33c4e8" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:37.342996 11039 raft_consensus.cc:515] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
W20260709 13:01:37.346524 10876 leader_election.cc:343] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:37.346727 11073 raft_consensus.cc:493] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.347036 11039 leader_election.cc:290] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:37.347759 10763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61bf6eaa1845f8add4d4057e49eb15" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:37.348603 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81009eaf7bf4ee9b7ef6b9a92d61a73" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:37.348984 11068 raft_consensus.cc:493] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.350263 11068 raft_consensus.cc:515] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:37.348527 10838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b6ca3deb4f59aa2803e2ed33c4e8" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
W20260709 13:01:37.351197 10950 leader_election.cc:343] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:37.350788 10660 catalog_manager.cc:5697] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:37.352453 11068 leader_election.cc:290] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:37.353721 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b6ca3deb4f59aa2803e2ed33c4e8" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:37.354370 10912 raft_consensus.cc:2468] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 0.
I20260709 13:01:37.351692 10838 raft_consensus.cc:2468] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 0.
I20260709 13:01:37.358201 11032 tablet_bootstrap.cc:654] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:37.358788 10804 leader_election.cc:304] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:37.347285 11073 raft_consensus.cc:515] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:37.359843 11068 raft_consensus.cc:2804] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:37.360219 11068 raft_consensus.cc:493] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.360715 11068 raft_consensus.cc:3060] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:37.354637 10802 leader_election.cc:343] T bb61bf6eaa1845f8add4d4057e49eb15 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:37.371089 10838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81009eaf7bf4ee9b7ef6b9a92d61a73" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:37.364079 11073 leader_election.cc:290] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:37.368943 10750 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35506 (request call id 38) took 1217 ms. Trace:
I20260709 13:01:37.407011 10877 leader_election.cc:304] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:01:37.408457 11041 raft_consensus.cc:2804] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:37.408885 11037 ts_tablet_manager.cc:1434] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.279s	user 0.012s	sys 0.006s
I20260709 13:01:37.408914 11041 raft_consensus.cc:493] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.409627 11041 raft_consensus.cc:3060] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:37.410403 11037 tablet_bootstrap.cc:492] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:37.406550 10750 rpcz_store.cc:276] 0709 13:01:36.150578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.033133 (+882555us) service_pool.cc:224] Handling call
0709 13:01:37.034806 (+  1673us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:37.034900 (+    94us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:37.320796 (+285896us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:37.355746 (+ 34950us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:37.367553 (+ 11807us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.366492 10900 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:36176 (request call id 37) took 1265 ms. Trace:
I20260709 13:01:37.416885 10900 rpcz_store.cc:276] 0709 13:01:36.111458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.791890 (+680432us) service_pool.cc:224] Handling call
0709 13:01:36.875508 (+ 83618us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.875609 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:37.062754 (+187145us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:37.331308 (+268554us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:37.364571 (+ 33263us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:37.418658 10951 leader_election.cc:343] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:37.422726 10951 leader_election.cc:304] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f; no voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:37.424207 11039 raft_consensus.cc:2749] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:37.441000 11031 tablet_bootstrap.cc:492] T ffe62eca39f04407943d15c5f7646aee P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:37.441726 11031 ts_tablet_manager.cc:1403] T ffe62eca39f04407943d15c5f7646aee P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.377s	user 0.024s	sys 0.031s
I20260709 13:01:37.442139 11032 tablet_bootstrap.cc:492] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:37.442806 11032 ts_tablet_manager.cc:1403] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.108s	user 0.013s	sys 0.003s
I20260709 13:01:37.451503 11031 raft_consensus.cc:359] T ffe62eca39f04407943d15c5f7646aee P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:37.452435 11031 raft_consensus.cc:385] T ffe62eca39f04407943d15c5f7646aee P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:37.452806 11031 raft_consensus.cc:740] T ffe62eca39f04407943d15c5f7646aee P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:37.456286 11032 raft_consensus.cc:359] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:37.457165 11032 raft_consensus.cc:385] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:37.457525 11032 raft_consensus.cc:740] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:37.458338 11032 consensus_queue.cc:260] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:37.461516 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61bf6eaa1845f8add4d4057e49eb15" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:37.462276 10749 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35506 (request call id 39) took 1246 ms. Trace:
I20260709 13:01:37.463145 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b6ca3deb4f59aa2803e2ed33c4e8" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:37.463723 11031 consensus_queue.cc:260] T ffe62eca39f04407943d15c5f7646aee P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
W20260709 13:01:37.465095 10802 leader_election.cc:343] T bb61bf6eaa1845f8add4d4057e49eb15 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:37.466920 11031 ts_tablet_manager.cc:1434] T ffe62eca39f04407943d15c5f7646aee P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:01:37.467471 10802 leader_election.cc:304] T bb61bf6eaa1845f8add4d4057e49eb15 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbd1fdffc68440e5b6250f6d95a4a367; no voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:01:37.458904 11041 raft_consensus.cc:515] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:37.470018 11040 raft_consensus.cc:2749] T bb61bf6eaa1845f8add4d4057e49eb15 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:01:37.471246 10802 leader_election.cc:343] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:37.471144 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b6ca3deb4f59aa2803e2ed33c4e8" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:37.462689 10749 rpcz_store.cc:276] 0709 13:01:36.216386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.080515 (+864129us) service_pool.cc:224] Handling call
0709 13:01:37.128611 (+ 48096us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:37.128710 (+    99us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:37.330354 (+201644us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:37.456255 (+125901us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:37.462200 (+  5945us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.473404 10838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b6ca3deb4f59aa2803e2ed33c4e8" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
W20260709 13:01:37.473021 10876 leader_election.cc:343] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:37.472028 11041 leader_election.cc:290] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Requested vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:37.476205 11031 tablet_bootstrap.cc:492] T 3034b839c8444c8d80acc4fe57bcd00a P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:37.485359 11031 tablet_bootstrap.cc:654] T 3034b839c8444c8d80acc4fe57bcd00a P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:37.504920 11033 tablet_bootstrap.cc:654] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:37.508111 11037 tablet_bootstrap.cc:654] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:37.511014 10747 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35506 (request call id 37) took 1525 ms. Trace:
I20260709 13:01:37.512032 10746 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35506 (request call id 36) took 1526 ms. Trace:
I20260709 13:01:37.511476 10747 rpcz_store.cc:276] 0709 13:01:35.985872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:37.024693 (+1038821us) service_pool.cc:224] Handling call
0709 13:01:37.062554 (+ 37861us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:37.078068 (+ 15514us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:37.261864 (+183796us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:37.510438 (+248574us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:37.510950 (+   512us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.513540 10746 rpcz_store.cc:276] 0709 13:01:35.985545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.989999 (+1004454us) service_pool.cc:224] Handling call
0709 13:01:36.997969 (+  7970us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:01:36.998062 (+    93us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:01:37.356753 (+358691us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:37.511508 (+154755us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:37.511971 (+   463us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:37.537297 11032 ts_tablet_manager.cc:1434] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.094s	user 0.007s	sys 0.003s
I20260709 13:01:37.538784 11032 tablet_bootstrap.cc:492] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:37.550567 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe62eca39f04407943d15c5f7646aee" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:37.551437 10912 raft_consensus.cc:2468] T ffe62eca39f04407943d15c5f7646aee P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 0.
I20260709 13:01:37.553126 10729 leader_election.cc:304] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:37.554111 11031 tablet_bootstrap.cc:492] T 3034b839c8444c8d80acc4fe57bcd00a P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:37.554665 11031 ts_tablet_manager.cc:1403] T 3034b839c8444c8d80acc4fe57bcd00a P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.015s
I20260709 13:01:37.558239 11073 raft_consensus.cc:2804] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:37.558040 11031 raft_consensus.cc:359] T 3034b839c8444c8d80acc4fe57bcd00a P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:37.559319 11031 raft_consensus.cc:385] T 3034b839c8444c8d80acc4fe57bcd00a P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:37.559962 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe62eca39f04407943d15c5f7646aee" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
W20260709 13:01:37.561793 10727 leader_election.cc:343] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:37.562755 11031 raft_consensus.cc:740] T 3034b839c8444c8d80acc4fe57bcd00a P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:37.535845 11068 raft_consensus.cc:515] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:37.563726 11031 consensus_queue.cc:260] T 3034b839c8444c8d80acc4fe57bcd00a P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:37.565985 11068 leader_election.cc:290] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Requested vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:37.566825 11031 ts_tablet_manager.cc:1434] T 3034b839c8444c8d80acc4fe57bcd00a P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:01:37.569170 11032 tablet_bootstrap.cc:654] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:37.569873 10838 raft_consensus.cc:2393] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b778a184b0ac46f5b86ce4fe363dcbab in current term 1: Already voted for candidate dbd1fdffc68440e5b6250f6d95a4a367 in this term.
I20260709 13:01:37.570062 11031 tablet_bootstrap.cc:492] T 03cf7a6241a444369a57fdaf965107b3 P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:37.568830 11037 tablet_bootstrap.cc:492] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:37.572327 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b6ca3deb4f59aa2803e2ed33c4e8" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:37.572860 11037 ts_tablet_manager.cc:1403] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.163s	user 0.023s	sys 0.028s
I20260709 13:01:37.573196 10912 raft_consensus.cc:2393] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dbd1fdffc68440e5b6250f6d95a4a367 in current term 1: Already voted for candidate b778a184b0ac46f5b86ce4fe363dcbab in this term.
I20260709 13:01:37.569465 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b6ca3deb4f59aa2803e2ed33c4e8" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
W20260709 13:01:37.576658 10802 leader_election.cc:343] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:37.558643 11073 raft_consensus.cc:493] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.577658 11073 raft_consensus.cc:3060] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:37.581382 11031 tablet_bootstrap.cc:654] T 03cf7a6241a444369a57fdaf965107b3 P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:37.581557 10804 leader_election.cc:304] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbd1fdffc68440e5b6250f6d95a4a367; no voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:37.582232 11037 raft_consensus.cc:359] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:37.582990 11037 raft_consensus.cc:385] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:37.583254 11037 raft_consensus.cc:740] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:37.584307 11032 tablet_bootstrap.cc:492] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:37.584198 11037 consensus_queue.cc:260] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:37.584996 11032 ts_tablet_manager.cc:1403] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.006s
I20260709 13:01:37.586809 11037 ts_tablet_manager.cc:1434] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
I20260709 13:01:37.587931 11037 tablet_bootstrap.cc:492] T c72b12d4267d44a1a03db0fe148c8d31 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:37.589221 11032 raft_consensus.cc:359] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:37.590355 11032 raft_consensus.cc:385] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:37.590713 11032 raft_consensus.cc:740] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:37.591787 11032 consensus_queue.cc:260] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:37.595043 11032 ts_tablet_manager.cc:1434] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:01:37.595356 11037 tablet_bootstrap.cc:654] T c72b12d4267d44a1a03db0fe148c8d31 P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:37.595641 11040 consensus_queue.cc:1048] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:37.596406 11032 tablet_bootstrap.cc:492] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:37.605598 11032 tablet_bootstrap.cc:654] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:37.606815 10877 leader_election.cc:304] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab; no voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:37.608099 11041 raft_consensus.cc:2749] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:37.611893 11031 tablet_bootstrap.cc:492] T 03cf7a6241a444369a57fdaf965107b3 P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:37.606745 11068 raft_consensus.cc:2749] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:37.612936 11031 ts_tablet_manager.cc:1403] T 03cf7a6241a444369a57fdaf965107b3 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.000s
I20260709 13:01:37.616115 11031 raft_consensus.cc:359] T 03cf7a6241a444369a57fdaf965107b3 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:37.621951 11031 raft_consensus.cc:385] T 03cf7a6241a444369a57fdaf965107b3 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:37.622378 11031 raft_consensus.cc:740] T 03cf7a6241a444369a57fdaf965107b3 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:37.623256 11031 consensus_queue.cc:260] T 03cf7a6241a444369a57fdaf965107b3 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:37.626168 11037 tablet_bootstrap.cc:492] T c72b12d4267d44a1a03db0fe148c8d31 P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:37.627048 11037 ts_tablet_manager.cc:1403] T c72b12d4267d44a1a03db0fe148c8d31 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.001s
I20260709 13:01:37.630291 11032 tablet_bootstrap.cc:492] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:37.631332 11032 ts_tablet_manager.cc:1403] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.010s
I20260709 13:01:37.632834 11031 ts_tablet_manager.cc:1434] T 03cf7a6241a444369a57fdaf965107b3 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:01:37.634382 11031 tablet_bootstrap.cc:492] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:37.635267 11032 raft_consensus.cc:359] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:37.630393 11037 raft_consensus.cc:359] T c72b12d4267d44a1a03db0fe148c8d31 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:37.636679 11037 raft_consensus.cc:385] T c72b12d4267d44a1a03db0fe148c8d31 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:37.637043 11037 raft_consensus.cc:740] T c72b12d4267d44a1a03db0fe148c8d31 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:37.637985 11037 consensus_queue.cc:260] T c72b12d4267d44a1a03db0fe148c8d31 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:37.640897 11037 ts_tablet_manager.cc:1434] T c72b12d4267d44a1a03db0fe148c8d31 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 13:01:37.642326 11037 tablet_bootstrap.cc:492] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:37.643462 11031 tablet_bootstrap.cc:654] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:37.636272 11032 raft_consensus.cc:385] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:37.644769 11032 raft_consensus.cc:740] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:37.612143 11073 raft_consensus.cc:515] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:37.645862 11032 consensus_queue.cc:260] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:37.649269 11032 ts_tablet_manager.cc:1434] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:01:37.650571 11032 tablet_bootstrap.cc:492] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:37.661863 11039 raft_consensus.cc:493] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.662467 11039 raft_consensus.cc:515] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:37.663699 11037 tablet_bootstrap.cc:654] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:37.664700 11039 leader_election.cc:290] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:37.666745 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830984b68ee046d9b9a67009177b55c2" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
W20260709 13:01:37.668670 10950 leader_election.cc:343] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:37.669932 11032 tablet_bootstrap.cc:654] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:37.669965 11031 tablet_bootstrap.cc:492] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:37.670970 11031 ts_tablet_manager.cc:1403] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.010s
I20260709 13:01:37.673125 10838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830984b68ee046d9b9a67009177b55c2" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
W20260709 13:01:37.676112 10951 leader_election.cc:343] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:37.676621 10951 leader_election.cc:304] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f; no voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:37.677825 11039 raft_consensus.cc:2749] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:37.678323 11031 raft_consensus.cc:359] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:37.679095 11031 raft_consensus.cc:385] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:37.679406 11031 raft_consensus.cc:740] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:37.680248 11031 consensus_queue.cc:260] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:37.682801 11031 ts_tablet_manager.cc:1434] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:01:37.682904 11068 consensus_queue.cc:1048] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:01:37.683441 10708 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:37.683964 11031 tablet_bootstrap.cc:492] T fa2569632a834231ba0f3bad60cf90ee P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:37.684799 11032 tablet_bootstrap.cc:492] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:37.685434 11032 ts_tablet_manager.cc:1403] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.005s
I20260709 13:01:37.694581 11032 raft_consensus.cc:359] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:37.695513 11031 tablet_bootstrap.cc:654] T fa2569632a834231ba0f3bad60cf90ee P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:37.695621 11032 raft_consensus.cc:385] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:37.696362 11032 raft_consensus.cc:740] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:37.697602 11032 consensus_queue.cc:260] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:37.698626 11041 raft_consensus.cc:493] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.699131 11039 raft_consensus.cc:493] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.699280 11041 raft_consensus.cc:515] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:37.699904 11039 raft_consensus.cc:515] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:37.701866 11041 leader_election.cc:290] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:37.703178 10763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72b12d4267d44a1a03db0fe148c8d31" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:37.703655 10761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d1eccb4ed0452ea1afb814db7c7330" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:37.704188 10763 raft_consensus.cc:2468] T c72b12d4267d44a1a03db0fe148c8d31 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 0.
I20260709 13:01:37.704461 10761 raft_consensus.cc:2468] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 0.
I20260709 13:01:37.706101 10950 leader_election.cc:304] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f; no voters: 
I20260709 13:01:37.706655 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d1eccb4ed0452ea1afb814db7c7330" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:37.707401 10985 raft_consensus.cc:2468] T 00d1eccb4ed0452ea1afb814db7c7330 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 0.
I20260709 13:01:37.708530 10876 leader_election.cc:304] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:37.709431 10838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72b12d4267d44a1a03db0fe148c8d31" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:37.710152 11041 raft_consensus.cc:2804] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:37.710716 11041 raft_consensus.cc:493] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:37.711048 10951 leader_election.cc:343] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:37.711167 11041 raft_consensus.cc:3060] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:37.712263 11039 leader_election.cc:290] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:37.713106 11039 raft_consensus.cc:2804] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:37.713486 11039 raft_consensus.cc:493] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.715917 11039 raft_consensus.cc:3060] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:37.723706 11041 raft_consensus.cc:515] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:37.728340 10911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe62eca39f04407943d15c5f7646aee" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:37.729359 10911 raft_consensus.cc:3060] T ffe62eca39f04407943d15c5f7646aee P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:37.731164 10761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d1eccb4ed0452ea1afb814db7c7330" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:37.731933 10761 raft_consensus.cc:3060] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:37.738883 10911 raft_consensus.cc:2468] T ffe62eca39f04407943d15c5f7646aee P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 1.
I20260709 13:01:37.740455 10729 leader_election.cc:304] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:37.741752 11071 raft_consensus.cc:2804] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:37.645058 11033 tablet_bootstrap.cc:492] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:37.742849 11033 ts_tablet_manager.cc:1403] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.489s	user 0.028s	sys 0.024s
I20260709 13:01:37.750833 11031 tablet_bootstrap.cc:492] T fa2569632a834231ba0f3bad60cf90ee P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:37.751618 11031 ts_tablet_manager.cc:1403] T fa2569632a834231ba0f3bad60cf90ee P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.068s	user 0.014s	sys 0.003s
I20260709 13:01:37.756728 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d1eccb4ed0452ea1afb814db7c7330" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:37.757639 10985 raft_consensus.cc:3060] T 00d1eccb4ed0452ea1afb814db7c7330 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:37.765748 10950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34489, user_credentials={real_user=slave}} blocked reactor thread for 59738.6us
I20260709 13:01:37.774475 11032 ts_tablet_manager.cc:1434] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.089s	user 0.026s	sys 0.017s
I20260709 13:01:37.779062 11032 tablet_bootstrap.cc:492] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:37.781280 11033 raft_consensus.cc:359] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:37.782747 11033 raft_consensus.cc:385] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:37.783142 11033 raft_consensus.cc:740] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:37.767407 11041 leader_election.cc:290] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Requested vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:37.766803 10761 raft_consensus.cc:2468] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 1.
I20260709 13:01:37.764442 11039 raft_consensus.cc:515] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:37.768582 11031 raft_consensus.cc:359] T fa2569632a834231ba0f3bad60cf90ee P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:37.788786 11031 raft_consensus.cc:385] T fa2569632a834231ba0f3bad60cf90ee P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:37.789134 11031 raft_consensus.cc:740] T fa2569632a834231ba0f3bad60cf90ee P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:37.769155 11073 leader_election.cc:290] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Requested vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:37.770689 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe62eca39f04407943d15c5f7646aee" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:37.766239 10985 raft_consensus.cc:2468] T 00d1eccb4ed0452ea1afb814db7c7330 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 1.
I20260709 13:01:37.789980 11039 leader_election.cc:290] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Requested vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:37.789899 11031 consensus_queue.cc:260] T fa2569632a834231ba0f3bad60cf90ee P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:37.791747 11033 consensus_queue.cc:260] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
W20260709 13:01:37.792320 10727 leader_election.cc:343] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:37.793448 11031 ts_tablet_manager.cc:1434] T fa2569632a834231ba0f3bad60cf90ee P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.001s
I20260709 13:01:37.771649 11071 raft_consensus.cc:697] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:01:37.793673 10876 leader_election.cc:304] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:37.794203 11033 ts_tablet_manager.cc:1434] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 13:01:37.794958 11061 raft_consensus.cc:2804] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:37.795312 11033 tablet_bootstrap.cc:492] T c72b12d4267d44a1a03db0fe148c8d31 P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:37.795472 11061 raft_consensus.cc:697] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Becoming Leader. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Running, Role: LEADER
I20260709 13:01:37.795642 11037 tablet_bootstrap.cc:492] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:37.796275 11061 consensus_queue.cc:237] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:37.797173 11037 ts_tablet_manager.cc:1403] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.155s	user 0.025s	sys 0.041s
I20260709 13:01:37.791195 10838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72b12d4267d44a1a03db0fe148c8d31" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:37.799248 11032 tablet_bootstrap.cc:654] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:37.799551 10951 leader_election.cc:343] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:37.796425 11071 consensus_queue.cc:237] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:37.802977 10761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72b12d4267d44a1a03db0fe148c8d31" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:37.803815 10761 raft_consensus.cc:3060] T c72b12d4267d44a1a03db0fe148c8d31 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:37.804155 11033 tablet_bootstrap.cc:654] T c72b12d4267d44a1a03db0fe148c8d31 P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:37.805816 11037 raft_consensus.cc:359] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:37.806654 11037 raft_consensus.cc:385] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:37.806955 11037 raft_consensus.cc:740] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:37.807806 11037 consensus_queue.cc:260] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:37.804108 11031 tablet_bootstrap.cc:492] T 16fbb9a91d614ce3834f82ce725667fa P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:37.816743 11033 tablet_bootstrap.cc:492] T c72b12d4267d44a1a03db0fe148c8d31 P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:37.817545 11033 ts_tablet_manager.cc:1403] T c72b12d4267d44a1a03db0fe148c8d31 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.008s
I20260709 13:01:37.819804 11037 ts_tablet_manager.cc:1434] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:01:37.821105 11037 tablet_bootstrap.cc:492] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:37.820786 11033 raft_consensus.cc:359] T c72b12d4267d44a1a03db0fe148c8d31 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:37.821655 11033 raft_consensus.cc:385] T c72b12d4267d44a1a03db0fe148c8d31 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:37.822014 11033 raft_consensus.cc:740] T c72b12d4267d44a1a03db0fe148c8d31 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:37.823179 11033 consensus_queue.cc:260] T c72b12d4267d44a1a03db0fe148c8d31 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:37.826390 11033 ts_tablet_manager.cc:1434] T c72b12d4267d44a1a03db0fe148c8d31 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:01:37.827490 11033 tablet_bootstrap.cc:492] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:37.831466 10761 raft_consensus.cc:2468] T c72b12d4267d44a1a03db0fe148c8d31 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 1.
I20260709 13:01:37.831532 11031 tablet_bootstrap.cc:654] T 16fbb9a91d614ce3834f82ce725667fa P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:37.832839 10950 leader_election.cc:304] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f; no voters: dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:37.835454 11039 raft_consensus.cc:2804] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:37.836160 11033 tablet_bootstrap.cc:654] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:37.836012 11039 raft_consensus.cc:697] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Becoming Leader. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
I20260709 13:01:37.839341 11039 consensus_queue.cc:237] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:37.844580 11037 tablet_bootstrap.cc:654] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:37.915716 11033 tablet_bootstrap.cc:492] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:37.915417 11039 raft_consensus.cc:493] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.917137 11033 ts_tablet_manager.cc:1403] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.090s	user 0.014s	sys 0.010s
I20260709 13:01:37.917016 11039 raft_consensus.cc:515] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:37.923516 11033 raft_consensus.cc:359] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:37.924503 11033 raft_consensus.cc:385] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:37.924872 11033 raft_consensus.cc:740] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:37.914366 10657 catalog_manager.cc:5697] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:37.925923 11033 consensus_queue.cc:260] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:37.926821 10911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049d8b6c7ecf423e95f1db20ab677254" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
W20260709 13:01:37.929713 10952 leader_election.cc:343] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:37.930358 11033 ts_tablet_manager.cc:1434] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.005s
I20260709 13:01:37.927008 10761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049d8b6c7ecf423e95f1db20ab677254" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
W20260709 13:01:37.935158 10950 leader_election.cc:343] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:37.932407 11033 tablet_bootstrap.cc:492] T 03cf7a6241a444369a57fdaf965107b3 P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:37.935773 10950 leader_election.cc:304] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f; no voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:37.937003 11039 leader_election.cc:290] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:37.938004 11039 raft_consensus.cc:2749] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:37.931229 10659 catalog_manager.cc:5697] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196). New cstate: current_term: 1 leader_uuid: "5e62c52a41f7476a908dd377c1a8a79f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:37.945379 11033 tablet_bootstrap.cc:654] T 03cf7a6241a444369a57fdaf965107b3 P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:37.949117 11032 tablet_bootstrap.cc:492] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:37.949031 11031 tablet_bootstrap.cc:492] T 16fbb9a91d614ce3834f82ce725667fa P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:37.950217 11032 ts_tablet_manager.cc:1403] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.175s	user 0.026s	sys 0.015s
I20260709 13:01:37.950814 11031 ts_tablet_manager.cc:1403] T 16fbb9a91d614ce3834f82ce725667fa P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.147s	user 0.017s	sys 0.012s
I20260709 13:01:37.955092 11032 raft_consensus.cc:359] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:37.955407 11031 raft_consensus.cc:359] T 16fbb9a91d614ce3834f82ce725667fa P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:37.956229 11032 raft_consensus.cc:385] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:37.956629 11031 raft_consensus.cc:385] T 16fbb9a91d614ce3834f82ce725667fa P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:37.956668 11032 raft_consensus.cc:740] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:37.957233 11031 raft_consensus.cc:740] T 16fbb9a91d614ce3834f82ce725667fa P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:37.957791 11032 consensus_queue.cc:260] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:37.958350 11031 consensus_queue.cc:260] T 16fbb9a91d614ce3834f82ce725667fa P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:37.961459 11071 raft_consensus.cc:493] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.962349 11032 ts_tablet_manager.cc:1434] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.002s
I20260709 13:01:37.962148 11071 raft_consensus.cc:515] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:37.963932 11032 tablet_bootstrap.cc:492] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:37.965412 11037 tablet_bootstrap.cc:492] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:37.966321 11037 ts_tablet_manager.cc:1403] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.145s	user 0.014s	sys 0.013s
I20260709 13:01:37.968505 11061 raft_consensus.cc:493] T 3034b839c8444c8d80acc4fe57bcd00a P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.969313 11061 raft_consensus.cc:515] T 3034b839c8444c8d80acc4fe57bcd00a P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:37.973721 10838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3034b839c8444c8d80acc4fe57bcd00a" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:37.973898 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3034b839c8444c8d80acc4fe57bcd00a" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:37.975394 11061 leader_election.cc:290] T 3034b839c8444c8d80acc4fe57bcd00a P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:37.974967 11071 leader_election.cc:290] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
W20260709 13:01:37.975911 10876 leader_election.cc:343] T 3034b839c8444c8d80acc4fe57bcd00a P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:37.961460 11031 ts_tablet_manager.cc:1434] T 16fbb9a91d614ce3834f82ce725667fa P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:01:37.977005 11037 raft_consensus.cc:359] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:37.979368 11037 raft_consensus.cc:385] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:37.980201 11037 raft_consensus.cc:740] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:37.980592 10911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bb330c30de4041b86d22bf1c838e57" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:37.981788 11032 tablet_bootstrap.cc:654] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:37.981616 11037 consensus_queue.cc:260] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
W20260709 13:01:37.982913 10877 leader_election.cc:343] T 3034b839c8444c8d80acc4fe57bcd00a P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:37.983444 10877 leader_election.cc:304] T 3034b839c8444c8d80acc4fe57bcd00a P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab; no voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:37.977726 11031 tablet_bootstrap.cc:492] T 049d8b6c7ecf423e95f1db20ab677254 P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:37.984804 11061 raft_consensus.cc:2749] T 3034b839c8444c8d80acc4fe57bcd00a P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:01:37.985967 10729 leader_election.cc:343] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:37.994107 11031 tablet_bootstrap.cc:654] T 049d8b6c7ecf423e95f1db20ab677254 P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:37.984372 11037 ts_tablet_manager.cc:1434] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:01:38.000522 11037 tablet_bootstrap.cc:492] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:38.002607 10660 catalog_manager.cc:5697] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab reported cstate change: term changed from 0 to 1, leader changed from <none> to b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:38.013477 11037 tablet_bootstrap.cc:654] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.015308 11068 raft_consensus.cc:493] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.015938 11068 raft_consensus.cc:515] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.019515 10761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16fbb9a91d614ce3834f82ce725667fa" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
W20260709 13:01:38.021488 10802 leader_election.cc:343] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.022364 11033 tablet_bootstrap.cc:492] T 03cf7a6241a444369a57fdaf965107b3 P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:38.022954 11033 ts_tablet_manager.cc:1403] T 03cf7a6241a444369a57fdaf965107b3 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.091s	user 0.018s	sys 0.012s
I20260709 13:01:38.023861 11068 leader_election.cc:290] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:38.024034 10911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16fbb9a91d614ce3834f82ce725667fa" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:38.024926 10911 raft_consensus.cc:2468] T 16fbb9a91d614ce3834f82ce725667fa P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 0.
I20260709 13:01:38.026522 10804 leader_election.cc:304] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 346158a6aa6747c1b8d31b4fb80238d0
I20260709 13:01:38.026700 11033 raft_consensus.cc:359] T 03cf7a6241a444369a57fdaf965107b3 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:38.027601 11033 raft_consensus.cc:385] T 03cf7a6241a444369a57fdaf965107b3 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.027979 11033 raft_consensus.cc:740] T 03cf7a6241a444369a57fdaf965107b3 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.028031 11068 raft_consensus.cc:2804] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:38.028719 11068 raft_consensus.cc:493] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.029132 11068 raft_consensus.cc:3060] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.029114 11033 consensus_queue.cc:260] T 03cf7a6241a444369a57fdaf965107b3 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:38.034807 11033 ts_tablet_manager.cc:1434] T 03cf7a6241a444369a57fdaf965107b3 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:01:38.036311 11033 tablet_bootstrap.cc:492] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:38.036580 11032 tablet_bootstrap.cc:492] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:38.037120 11032 ts_tablet_manager.cc:1403] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.074s	user 0.014s	sys 0.005s
I20260709 13:01:38.040128 11032 raft_consensus.cc:359] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:38.041702 11032 raft_consensus.cc:385] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.041996 11032 raft_consensus.cc:740] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.047192 11068 raft_consensus.cc:515] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.049628 11068 leader_election.cc:290] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Requested vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:38.051415 10761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16fbb9a91d614ce3834f82ce725667fa" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:38.051204 11032 consensus_queue.cc:260] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:38.051786 10911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16fbb9a91d614ce3834f82ce725667fa" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:38.053122 10911 raft_consensus.cc:3060] T 16fbb9a91d614ce3834f82ce725667fa P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.053329 11061 raft_consensus.cc:493] T 03cf7a6241a444369a57fdaf965107b3 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.053876 11061 raft_consensus.cc:515] T 03cf7a6241a444369a57fdaf965107b3 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
W20260709 13:01:38.054741 10802 leader_election.cc:343] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.056249 11061 leader_election.cc:290] T 03cf7a6241a444369a57fdaf965107b3 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:38.058532 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03cf7a6241a444369a57fdaf965107b3" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:38.059494 11033 tablet_bootstrap.cc:654] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.059396 10985 raft_consensus.cc:2468] T 03cf7a6241a444369a57fdaf965107b3 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 0.
I20260709 13:01:38.061106 11039 raft_consensus.cc:493] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.068037 11039 raft_consensus.cc:515] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:38.070703 11037 tablet_bootstrap.cc:492] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:38.071288 11039 leader_election.cc:290] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:38.065130 11031 tablet_bootstrap.cc:492] T 049d8b6c7ecf423e95f1db20ab677254 P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:38.072108 11031 ts_tablet_manager.cc:1403] T 049d8b6c7ecf423e95f1db20ab677254 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.095s	user 0.010s	sys 0.003s
I20260709 13:01:38.073446 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b6ca3deb4f59aa2803e2ed33c4e8" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:38.073688 10911 raft_consensus.cc:2468] T 16fbb9a91d614ce3834f82ce725667fa P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 1.
I20260709 13:01:38.074374 10836 raft_consensus.cc:2393] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e62c52a41f7476a908dd377c1a8a79f in current term 1: Already voted for candidate dbd1fdffc68440e5b6250f6d95a4a367 in this term.
I20260709 13:01:38.074965 11037 ts_tablet_manager.cc:1403] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.076s	user 0.024s	sys 0.005s
I20260709 13:01:38.063298 10838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bb330c30de4041b86d22bf1c838e57" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:38.066464 11064 raft_consensus.cc:493] T c72b12d4267d44a1a03db0fe148c8d31 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.075222 11031 raft_consensus.cc:359] T 049d8b6c7ecf423e95f1db20ab677254 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:38.076020 11031 raft_consensus.cc:385] T 049d8b6c7ecf423e95f1db20ab677254 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.075819 11064 raft_consensus.cc:515] T c72b12d4267d44a1a03db0fe148c8d31 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:38.076292 11031 raft_consensus.cc:740] T 049d8b6c7ecf423e95f1db20ab677254 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.076982 11031 consensus_queue.cc:260] T 049d8b6c7ecf423e95f1db20ab677254 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:38.078152 11064 leader_election.cc:290] T c72b12d4267d44a1a03db0fe148c8d31 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:38.078696 11037 raft_consensus.cc:359] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:38.079265 11031 ts_tablet_manager.cc:1434] T 049d8b6c7ecf423e95f1db20ab677254 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:01:38.079573 11037 raft_consensus.cc:385] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.079929 11037 raft_consensus.cc:740] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.080544 11031 tablet_bootstrap.cc:492] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:38.080849 11037 consensus_queue.cc:260] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:38.084923 10761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72b12d4267d44a1a03db0fe148c8d31" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:38.085913 10761 raft_consensus.cc:2393] T c72b12d4267d44a1a03db0fe148c8d31 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbd1fdffc68440e5b6250f6d95a4a367 in current term 1: Already voted for candidate 5e62c52a41f7476a908dd377c1a8a79f in this term.
I20260709 13:01:38.087342 11037 ts_tablet_manager.cc:1434] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 13:01:38.089154 11037 tablet_bootstrap.cc:492] T 16fbb9a91d614ce3834f82ce725667fa P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:38.065351 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03cf7a6241a444369a57fdaf965107b3" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:38.090570 10837 raft_consensus.cc:2468] T 03cf7a6241a444369a57fdaf965107b3 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 0.
I20260709 13:01:38.091974 10877 leader_election.cc:304] T 03cf7a6241a444369a57fdaf965107b3 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:38.092870 11061 raft_consensus.cc:2804] T 03cf7a6241a444369a57fdaf965107b3 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:38.093268 11061 raft_consensus.cc:493] T 03cf7a6241a444369a57fdaf965107b3 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.093581 11061 raft_consensus.cc:3060] T 03cf7a6241a444369a57fdaf965107b3 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.096974 11037 tablet_bootstrap.cc:654] T 16fbb9a91d614ce3834f82ce725667fa P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.099933 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b6ca3deb4f59aa2803e2ed33c4e8" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:38.100953 10912 raft_consensus.cc:2393] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e62c52a41f7476a908dd377c1a8a79f in current term 1: Already voted for candidate b778a184b0ac46f5b86ce4fe363dcbab in this term.
I20260709 13:01:38.101130 11031 tablet_bootstrap.cc:654] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.102391 10952 leader_election.cc:304] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f; no voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:38.104772 10804 leader_election.cc:304] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 346158a6aa6747c1b8d31b4fb80238d0
W20260709 13:01:38.106240 10728 leader_election.cc:343] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.106788 10728 leader_election.cc:304] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0; no voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:38.107547 11071 raft_consensus.cc:2749] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:38.108266 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c72b12d4267d44a1a03db0fe148c8d31" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:38.109076 11037 tablet_bootstrap.cc:492] T 16fbb9a91d614ce3834f82ce725667fa P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:38.109656 11037 ts_tablet_manager.cc:1403] T 16fbb9a91d614ce3834f82ce725667fa P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.006s
I20260709 13:01:38.110517 10802 leader_election.cc:304] T c72b12d4267d44a1a03db0fe148c8d31 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbd1fdffc68440e5b6250f6d95a4a367; no voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:01:38.111701 11040 raft_consensus.cc:2804] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:38.112202 11040 raft_consensus.cc:697] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Becoming Leader. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Running, Role: LEADER
I20260709 13:01:38.097157 11041 raft_consensus.cc:493] T fa2569632a834231ba0f3bad60cf90ee P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.113054 11037 raft_consensus.cc:359] T 16fbb9a91d614ce3834f82ce725667fa P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.113119 11040 consensus_queue.cc:237] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.114023 11037 raft_consensus.cc:385] T 16fbb9a91d614ce3834f82ce725667fa P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.114389 11037 raft_consensus.cc:740] T 16fbb9a91d614ce3834f82ce725667fa P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.115198 11037 consensus_queue.cc:260] T 16fbb9a91d614ce3834f82ce725667fa P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.117461 11037 ts_tablet_manager.cc:1434] T 16fbb9a91d614ce3834f82ce725667fa P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:01:38.119153 11037 tablet_bootstrap.cc:492] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:38.120747 11039 raft_consensus.cc:3060] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.125308 11031 tablet_bootstrap.cc:492] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:38.113164 11041 raft_consensus.cc:515] T fa2569632a834231ba0f3bad60cf90ee P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.127246 11031 ts_tablet_manager.cc:1403] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.007s
I20260709 13:01:38.121290 11064 raft_consensus.cc:3060] T c72b12d4267d44a1a03db0fe148c8d31 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.130201 10761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2569632a834231ba0f3bad60cf90ee" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
W20260709 13:01:38.132200 10876 leader_election.cc:343] T fa2569632a834231ba0f3bad60cf90ee P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.126770 11037 tablet_bootstrap.cc:654] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.133235 11031 raft_consensus.cc:359] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:38.133961 11031 raft_consensus.cc:385] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.134222 11031 raft_consensus.cc:740] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.134949 11031 consensus_queue.cc:260] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:38.137447 11041 leader_election.cc:290] T fa2569632a834231ba0f3bad60cf90ee P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:38.143147 10838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2569632a834231ba0f3bad60cf90ee" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:38.144972 11037 tablet_bootstrap.cc:492] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:38.145663 11037 ts_tablet_manager.cc:1403] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.004s
W20260709 13:01:38.148429 10877 leader_election.cc:343] T fa2569632a834231ba0f3bad60cf90ee P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.149037 10877 leader_election.cc:304] T fa2569632a834231ba0f3bad60cf90ee P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab; no voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:38.150759 11041 raft_consensus.cc:2749] T fa2569632a834231ba0f3bad60cf90ee P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:38.071568 11032 ts_tablet_manager.cc:1434] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:01:38.153143 11037 raft_consensus.cc:359] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:38.154076 11037 raft_consensus.cc:385] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.154384 11037 raft_consensus.cc:740] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.153600 10659 catalog_manager.cc:5697] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:38.155293 11037 consensus_queue.cc:260] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:38.157740 11037 ts_tablet_manager.cc:1434] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:01:38.159581 11037 tablet_bootstrap.cc:492] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:38.166672 11037 tablet_bootstrap.cc:654] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.167043 11061 raft_consensus.cc:515] T 03cf7a6241a444369a57fdaf965107b3 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:38.170915 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03cf7a6241a444369a57fdaf965107b3" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:38.171579 10985 raft_consensus.cc:3060] T 03cf7a6241a444369a57fdaf965107b3 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.179253 11037 tablet_bootstrap.cc:492] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:38.180027 11037 ts_tablet_manager.cc:1403] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.004s
I20260709 13:01:38.168008 11032 tablet_bootstrap.cc:492] T 2f47768053ec47e69b367bd5a49662c3 P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:38.183780 11037 raft_consensus.cc:359] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:38.184731 11037 raft_consensus.cc:385] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.185091 11037 raft_consensus.cc:740] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.186059 11037 consensus_queue.cc:260] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:38.188390 11064 raft_consensus.cc:2749] T c72b12d4267d44a1a03db0fe148c8d31 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:38.189088 11037 ts_tablet_manager.cc:1434] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:01:38.189474 11061 leader_election.cc:290] T 03cf7a6241a444369a57fdaf965107b3 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Requested vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:38.198770 11031 ts_tablet_manager.cc:1434] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.071s	user 0.013s	sys 0.002s
I20260709 13:01:38.190935 10838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03cf7a6241a444369a57fdaf965107b3" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:38.199575 10838 raft_consensus.cc:3060] T 03cf7a6241a444369a57fdaf965107b3 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.200212 11033 tablet_bootstrap.cc:492] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:38.200941 11033 ts_tablet_manager.cc:1403] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.165s	user 0.054s	sys 0.060s
I20260709 13:01:38.209779 11037 tablet_bootstrap.cc:492] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:38.210103 11033 raft_consensus.cc:359] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.210847 11033 raft_consensus.cc:385] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.211117 11033 raft_consensus.cc:740] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.212189 11031 tablet_bootstrap.cc:492] T d4b9835406e84c5b88d3c3eed76a3b95 P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:38.213999 11033 consensus_queue.cc:260] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.191860 10985 raft_consensus.cc:2468] T 03cf7a6241a444369a57fdaf965107b3 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 1.
I20260709 13:01:38.216197 10876 leader_election.cc:304] T 03cf7a6241a444369a57fdaf965107b3 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:38.195573 11032 tablet_bootstrap.cc:654] T 2f47768053ec47e69b367bd5a49662c3 P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.190824 11039 raft_consensus.cc:2749] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:38.218990 11122 raft_consensus.cc:2804] T 03cf7a6241a444369a57fdaf965107b3 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:38.219240 11033 ts_tablet_manager.cc:1434] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 13:01:38.219871 11122 raft_consensus.cc:697] T 03cf7a6241a444369a57fdaf965107b3 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Becoming Leader. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Running, Role: LEADER
I20260709 13:01:38.219709 11039 raft_consensus.cc:493] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.221119 11039 raft_consensus.cc:515] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:38.221138 11122 consensus_queue.cc:237] T 03cf7a6241a444369a57fdaf965107b3 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:38.223996 11037 tablet_bootstrap.cc:654] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.220698 11033 tablet_bootstrap.cc:492] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:38.224460 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3034b839c8444c8d80acc4fe57bcd00a" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:38.231531 11061 consensus_queue.cc:1048] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:01:38.233206 10951 leader_election.cc:343] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.226107 11039 leader_election.cc:290] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:38.224517 11031 tablet_bootstrap.cc:654] T d4b9835406e84c5b88d3c3eed76a3b95 P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.226799 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3034b839c8444c8d80acc4fe57bcd00a" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:38.234443 10912 raft_consensus.cc:2468] T 3034b839c8444c8d80acc4fe57bcd00a P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 0.
I20260709 13:01:38.216624 10838 raft_consensus.cc:2468] T 03cf7a6241a444369a57fdaf965107b3 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 1.
I20260709 13:01:38.235677 10952 leader_election.cc:304] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:38.236971 11039 raft_consensus.cc:2804] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:38.237406 11039 raft_consensus.cc:493] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.237739 11039 raft_consensus.cc:3060] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.241145 11096 raft_consensus.cc:493] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.241848 11096 raft_consensus.cc:515] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:38.243158 11033 tablet_bootstrap.cc:654] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.249758 11097 consensus_queue.cc:1048] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:38.250089 11096 leader_election.cc:290] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:38.253404 10659 catalog_manager.cc:5697] T 03cf7a6241a444369a57fdaf965107b3 P b778a184b0ac46f5b86ce4fe363dcbab reported cstate change: term changed from 0 to 1, leader changed from <none> to b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:38.250139 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3dd15d873514f74a9bca08bc55e5d36" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
W20260709 13:01:38.258780 10950 leader_election.cc:343] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.262553 11039 raft_consensus.cc:515] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:38.267402 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3034b839c8444c8d80acc4fe57bcd00a" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:38.269520 11100 raft_consensus.cc:493] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.270151 11100 raft_consensus.cc:515] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:38.281322 11039 leader_election.cc:290] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Requested vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:38.284644 11040 raft_consensus.cc:493] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.285097 11033 tablet_bootstrap.cc:492] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
W20260709 13:01:38.276625 10951 leader_election.cc:343] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.285705 11033 ts_tablet_manager.cc:1403] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.013s
I20260709 13:01:38.288654 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3dd15d873514f74a9bca08bc55e5d36" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:38.290951 11073 raft_consensus.cc:493] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.289960 11033 raft_consensus.cc:359] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.291538 11073 raft_consensus.cc:515] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:38.280540 11071 consensus_queue.cc:1048] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:01:38.291527 11033 raft_consensus.cc:385] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:01:38.294615 10952 leader_election.cc:343] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.295177 11033 raft_consensus.cc:740] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.285207 11040 raft_consensus.cc:515] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:38.296372 11033 consensus_queue.cc:260] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.298818 11040 leader_election.cc:290] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:38.299928 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3034b839c8444c8d80acc4fe57bcd00a" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:38.300980 10910 raft_consensus.cc:3060] T 3034b839c8444c8d80acc4fe57bcd00a P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.303278 11033 ts_tablet_manager.cc:1434] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:01:38.300971 10761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81009eaf7bf4ee9b7ef6b9a92d61a73" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:38.305389 10761 raft_consensus.cc:2468] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 0.
I20260709 13:01:38.306137 11040 raft_consensus.cc:493] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.306809 11040 raft_consensus.cc:515] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.307464 10802 leader_election.cc:304] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:38.308521 11125 raft_consensus.cc:2804] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:38.308954 11125 raft_consensus.cc:493] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.309269 11125 raft_consensus.cc:3060] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.310316 10761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2569632a834231ba0f3bad60cf90ee" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
W20260709 13:01:38.312099 10802 leader_election.cc:343] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.312974 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049d8b6c7ecf423e95f1db20ab677254" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:38.313766 10912 raft_consensus.cc:2468] T 049d8b6c7ecf423e95f1db20ab677254 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 0.
I20260709 13:01:38.315191 10729 leader_election.cc:304] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:38.315461 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2569632a834231ba0f3bad60cf90ee" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:38.316298 10912 raft_consensus.cc:2468] T fa2569632a834231ba0f3bad60cf90ee P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 0.
I20260709 13:01:38.317508 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049d8b6c7ecf423e95f1db20ab677254" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:38.317807 10804 leader_election.cc:304] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 346158a6aa6747c1b8d31b4fb80238d0
I20260709 13:01:38.318287 10985 raft_consensus.cc:2468] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 0.
I20260709 13:01:38.318869 11040 leader_election.cc:290] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:38.319382 11073 leader_election.cc:290] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:38.319721 11040 raft_consensus.cc:2804] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:38.320444 11040 raft_consensus.cc:493] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.321908 11040 raft_consensus.cc:3060] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.315913 11100 leader_election.cc:290] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:38.295146 10952 leader_election.cc:304] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f; no voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:38.321280 10838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccad89aaaf3d48008955a353eb0097b9" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:38.324149 11097 raft_consensus.cc:2749] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:38.324815 11125 raft_consensus.cc:515] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:38.321192 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccad89aaaf3d48008955a353eb0097b9" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:38.337591 11100 raft_consensus.cc:2804] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:38.339047 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81009eaf7bf4ee9b7ef6b9a92d61a73" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:38.339895 10986 raft_consensus.cc:2468] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 0.
I20260709 13:01:38.338927 11100 raft_consensus.cc:493] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:38.341403 10728 leader_election.cc:343] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.342592 11100 raft_consensus.cc:3060] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:38.349472 10727 leader_election.cc:343] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.350176 10727 leader_election.cc:304] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0; no voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:38.351325 11099 raft_consensus.cc:2749] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:38.352125 11097 consensus_queue.cc:1048] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:38.354426 11031 tablet_bootstrap.cc:492] T d4b9835406e84c5b88d3c3eed76a3b95 P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
W20260709 13:01:38.354677 10727 consensus_peers.cc:597] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 -> Peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Couldn't send request to peer 5e62c52a41f7476a908dd377c1a8a79f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:38.354983 11031 ts_tablet_manager.cc:1403] T d4b9835406e84c5b88d3c3eed76a3b95 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.153s	user 0.022s	sys 0.022s
I20260709 13:01:38.359553 11033 tablet_bootstrap.cc:492] T 3034b839c8444c8d80acc4fe57bcd00a P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:38.363159 11031 raft_consensus.cc:359] T d4b9835406e84c5b88d3c3eed76a3b95 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.363938 11031 raft_consensus.cc:385] T d4b9835406e84c5b88d3c3eed76a3b95 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.364248 11031 raft_consensus.cc:740] T d4b9835406e84c5b88d3c3eed76a3b95 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.362772 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81009eaf7bf4ee9b7ef6b9a92d61a73" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:38.369526 10986 raft_consensus.cc:3060] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.369719 11125 leader_election.cc:290] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Requested vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:38.370092 10763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81009eaf7bf4ee9b7ef6b9a92d61a73" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:38.371078 10763 raft_consensus.cc:3060] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.373061 11041 consensus_queue.cc:1048] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:38.375990 11032 tablet_bootstrap.cc:492] T 2f47768053ec47e69b367bd5a49662c3 P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:38.376574 11032 ts_tablet_manager.cc:1403] T 2f47768053ec47e69b367bd5a49662c3 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.216s	user 0.021s	sys 0.030s
I20260709 13:01:38.386731 11032 raft_consensus.cc:359] T 2f47768053ec47e69b367bd5a49662c3 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:38.388986 11031 consensus_queue.cc:260] T d4b9835406e84c5b88d3c3eed76a3b95 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.391010 11032 raft_consensus.cc:385] T 2f47768053ec47e69b367bd5a49662c3 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.396198 11031 ts_tablet_manager.cc:1434] T d4b9835406e84c5b88d3c3eed76a3b95 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.004s
I20260709 13:01:38.391685 11032 raft_consensus.cc:740] T 2f47768053ec47e69b367bd5a49662c3 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.402200 11031 tablet_bootstrap.cc:492] T 1a1b4a3380b746d2bc977cfeff019c26 P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:38.405604 11032 consensus_queue.cc:260] T 2f47768053ec47e69b367bd5a49662c3 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:38.408751 11099 raft_consensus.cc:493] T 16fbb9a91d614ce3834f82ce725667fa P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.409396 11099 raft_consensus.cc:515] T 16fbb9a91d614ce3834f82ce725667fa P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.410511 11032 ts_tablet_manager.cc:1434] T 2f47768053ec47e69b367bd5a49662c3 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.001s
I20260709 13:01:38.410835 10986 raft_consensus.cc:2468] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 1.
I20260709 13:01:38.411738 11099 leader_election.cc:290] T 16fbb9a91d614ce3834f82ce725667fa P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:38.412299 10802 leader_election.cc:304] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:38.412463 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16fbb9a91d614ce3834f82ce725667fa" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:38.413328 11125 raft_consensus.cc:2804] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:38.413430 10911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16fbb9a91d614ce3834f82ce725667fa" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:38.413820 11125 raft_consensus.cc:697] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Becoming Leader. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Running, Role: LEADER
I20260709 13:01:38.414415 10911 raft_consensus.cc:2393] T 16fbb9a91d614ce3834f82ce725667fa P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 346158a6aa6747c1b8d31b4fb80238d0 in current term 1: Already voted for candidate dbd1fdffc68440e5b6250f6d95a4a367 in this term.
I20260709 13:01:38.414660 11125 consensus_queue.cc:237] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:38.417344 10728 leader_election.cc:304] T 16fbb9a91d614ce3834f82ce725667fa P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0; no voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:38.419456 11099 raft_consensus.cc:3060] T 16fbb9a91d614ce3834f82ce725667fa P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.425868 10910 raft_consensus.cc:2468] T 3034b839c8444c8d80acc4fe57bcd00a P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 1.
I20260709 13:01:38.427416 10952 leader_election.cc:304] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:38.412243 11032 tablet_bootstrap.cc:492] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:38.429097 11037 tablet_bootstrap.cc:492] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:38.429634 11037 ts_tablet_manager.cc:1403] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.220s	user 0.034s	sys 0.023s
I20260709 13:01:38.432888 11037 raft_consensus.cc:359] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:38.433645 11037 raft_consensus.cc:385] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.433934 11037 raft_consensus.cc:740] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.437618 11031 tablet_bootstrap.cc:654] T 1a1b4a3380b746d2bc977cfeff019c26 P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.438210 11037 consensus_queue.cc:260] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:38.440508 11037 ts_tablet_manager.cc:1434] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:01:38.442028 11037 tablet_bootstrap.cc:492] T fa2569632a834231ba0f3bad60cf90ee P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:38.442479 11033 tablet_bootstrap.cc:654] T 3034b839c8444c8d80acc4fe57bcd00a P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.434427 10763 raft_consensus.cc:2468] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 1.
I20260709 13:01:38.434705 11099 raft_consensus.cc:2749] T 16fbb9a91d614ce3834f82ce725667fa P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:38.440644 11096 raft_consensus.cc:2804] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:38.444547 11096 raft_consensus.cc:697] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Becoming Leader. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
I20260709 13:01:38.445520 11096 consensus_queue.cc:237] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:38.442840 11040 raft_consensus.cc:515] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.449123 10763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2569632a834231ba0f3bad60cf90ee" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
W20260709 13:01:38.450510 10802 leader_election.cc:343] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.457296 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2569632a834231ba0f3bad60cf90ee" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:38.457957 10910 raft_consensus.cc:3060] T fa2569632a834231ba0f3bad60cf90ee P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.462435 11032 tablet_bootstrap.cc:654] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.465070 11100 raft_consensus.cc:515] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:38.471935 11040 leader_election.cc:290] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Requested vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:38.472435 10658 catalog_manager.cc:5697] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:38.478154 11100 leader_election.cc:290] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Requested vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:38.479199 10911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049d8b6c7ecf423e95f1db20ab677254" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:38.480007 10911 raft_consensus.cc:3060] T 049d8b6c7ecf423e95f1db20ab677254 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.482823 11037 tablet_bootstrap.cc:654] T fa2569632a834231ba0f3bad60cf90ee P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.483850 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049d8b6c7ecf423e95f1db20ab677254" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:38.484764 10985 raft_consensus.cc:3060] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.492718 11122 raft_consensus.cc:493] T d4b9835406e84c5b88d3c3eed76a3b95 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.493471 11122 raft_consensus.cc:515] T d4b9835406e84c5b88d3c3eed76a3b95 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.497136 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b9835406e84c5b88d3c3eed76a3b95" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
W20260709 13:01:38.499182 10877 leader_election.cc:343] T d4b9835406e84c5b88d3c3eed76a3b95 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.499501 10761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b9835406e84c5b88d3c3eed76a3b95" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:38.499697 11122 leader_election.cc:290] T d4b9835406e84c5b88d3c3eed76a3b95 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
W20260709 13:01:38.501360 10876 leader_election.cc:343] T d4b9835406e84c5b88d3c3eed76a3b95 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.501870 10876 leader_election.cc:304] T d4b9835406e84c5b88d3c3eed76a3b95 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab; no voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:38.502627 11122 raft_consensus.cc:2749] T d4b9835406e84c5b88d3c3eed76a3b95 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:38.502971 11033 tablet_bootstrap.cc:492] T 3034b839c8444c8d80acc4fe57bcd00a P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:38.503499 11033 ts_tablet_manager.cc:1403] T 3034b839c8444c8d80acc4fe57bcd00a P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.144s	user 0.015s	sys 0.014s
I20260709 13:01:38.503532 10985 raft_consensus.cc:2468] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 1.
I20260709 13:01:38.503717 10910 raft_consensus.cc:2468] T fa2569632a834231ba0f3bad60cf90ee P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 1.
I20260709 13:01:38.505110 10804 leader_election.cc:304] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 346158a6aa6747c1b8d31b4fb80238d0
I20260709 13:01:38.505852 11040 raft_consensus.cc:2804] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:38.505110 10727 leader_election.cc:304] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f; no voters: 
I20260709 13:01:38.506361 11040 raft_consensus.cc:697] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Becoming Leader. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Running, Role: LEADER
I20260709 13:01:38.507007 11100 raft_consensus.cc:2804] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:38.507500 11100 raft_consensus.cc:697] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:01:38.507243 11040 consensus_queue.cc:237] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.508078 11032 tablet_bootstrap.cc:492] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:38.508617 11032 ts_tablet_manager.cc:1403] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.097s	user 0.011s	sys 0.003s
I20260709 13:01:38.508306 11100 consensus_queue.cc:237] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:38.509487 10658 catalog_manager.cc:5697] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196). New cstate: current_term: 1 leader_uuid: "5e62c52a41f7476a908dd377c1a8a79f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:38.506093 11031 tablet_bootstrap.cc:492] T 1a1b4a3380b746d2bc977cfeff019c26 P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:38.512434 11032 raft_consensus.cc:359] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:38.512936 11031 ts_tablet_manager.cc:1403] T 1a1b4a3380b746d2bc977cfeff019c26 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.113s	user 0.036s	sys 0.032s
I20260709 13:01:38.503585 11037 tablet_bootstrap.cc:492] T fa2569632a834231ba0f3bad60cf90ee P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:38.513720 11037 ts_tablet_manager.cc:1403] T fa2569632a834231ba0f3bad60cf90ee P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.072s	user 0.009s	sys 0.003s
I20260709 13:01:38.514498 11033 raft_consensus.cc:359] T 3034b839c8444c8d80acc4fe57bcd00a P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:38.513226 11032 raft_consensus.cc:385] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.515637 11032 raft_consensus.cc:740] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.516444 11032 consensus_queue.cc:260] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:38.516547 11031 raft_consensus.cc:359] T 1a1b4a3380b746d2bc977cfeff019c26 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:38.517527 11031 raft_consensus.cc:385] T 1a1b4a3380b746d2bc977cfeff019c26 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.517810 11031 raft_consensus.cc:740] T 1a1b4a3380b746d2bc977cfeff019c26 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.518496 11031 consensus_queue.cc:260] T 1a1b4a3380b746d2bc977cfeff019c26 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:38.518958 11032 ts_tablet_manager.cc:1434] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:01:38.501571 10911 raft_consensus.cc:2468] T 049d8b6c7ecf423e95f1db20ab677254 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 1.
I20260709 13:01:38.520279 11032 tablet_bootstrap.cc:492] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:38.520249 11037 raft_consensus.cc:359] T fa2569632a834231ba0f3bad60cf90ee P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.521168 11037 raft_consensus.cc:385] T fa2569632a834231ba0f3bad60cf90ee P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.521476 11037 raft_consensus.cc:740] T fa2569632a834231ba0f3bad60cf90ee P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.521967 10659 catalog_manager.cc:5697] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:38.524497 11031 ts_tablet_manager.cc:1434] T 1a1b4a3380b746d2bc977cfeff019c26 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:01:38.522902 11125 consensus_queue.cc:1048] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:38.525775 11031 tablet_bootstrap.cc:492] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:38.515250 11033 raft_consensus.cc:385] T 3034b839c8444c8d80acc4fe57bcd00a P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.526309 11033 raft_consensus.cc:740] T 3034b839c8444c8d80acc4fe57bcd00a P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.527544 11032 tablet_bootstrap.cc:654] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.522181 11037 consensus_queue.cc:260] T fa2569632a834231ba0f3bad60cf90ee P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.527222 11033 consensus_queue.cc:260] T 3034b839c8444c8d80acc4fe57bcd00a P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:38.539682 11037 ts_tablet_manager.cc:1434] T fa2569632a834231ba0f3bad60cf90ee P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 13:01:38.540439 11122 raft_consensus.cc:493] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.541014 11122 raft_consensus.cc:515] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:38.541946 11033 ts_tablet_manager.cc:1434] T 3034b839c8444c8d80acc4fe57bcd00a P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.002s
I20260709 13:01:38.543139 11033 tablet_bootstrap.cc:492] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:38.543362 11122 leader_election.cc:290] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:38.543777 11037 tablet_bootstrap.cc:492] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:38.556996 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f47768053ec47e69b367bd5a49662c3" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:38.562628 11031 tablet_bootstrap.cc:654] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.557070 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f47768053ec47e69b367bd5a49662c3" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:38.564014 10985 raft_consensus.cc:2468] T 2f47768053ec47e69b367bd5a49662c3 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 0.
I20260709 13:01:38.566550 10876 leader_election.cc:304] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:38.567687 11122 raft_consensus.cc:2804] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:01:38.569164 10877 leader_election.cc:343] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.568210 11122 raft_consensus.cc:493] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.572917 11122 raft_consensus.cc:3060] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.580117 11033 tablet_bootstrap.cc:654] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.585675 11064 consensus_queue.cc:1048] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:38.583792 11040 raft_consensus.cc:493] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.587002 11040 raft_consensus.cc:515] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.587451 11100 raft_consensus.cc:493] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.588511 11100 raft_consensus.cc:515] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:38.590448 11040 leader_election.cc:290] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:38.591528 11100 leader_election.cc:290] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:38.593977 11122 raft_consensus.cc:515] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:38.594544 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61bf6eaa1845f8add4d4057e49eb15" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:38.595942 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61bf6eaa1845f8add4d4057e49eb15" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:38.587348 11032 tablet_bootstrap.cc:492] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:38.596761 10837 raft_consensus.cc:2468] T bb61bf6eaa1845f8add4d4057e49eb15 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 0.
I20260709 13:01:38.596915 11032 ts_tablet_manager.cc:1403] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.077s	user 0.008s	sys 0.020s
I20260709 13:01:38.597364 10763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bb330c30de4041b86d22bf1c838e57" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:38.598030 10763 raft_consensus.cc:2468] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 0.
I20260709 13:01:38.598308 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bb330c30de4041b86d22bf1c838e57" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:38.599735 10802 leader_election.cc:304] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:38.594718 11037 tablet_bootstrap.cc:654] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.600270 11032 raft_consensus.cc:359] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
W20260709 13:01:38.601220 10804 leader_election.cc:343] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.602629 11031 tablet_bootstrap.cc:492] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:38.602735 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f47768053ec47e69b367bd5a49662c3" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
W20260709 13:01:38.596418 10727 leader_election.cc:343] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.603314 11031 ts_tablet_manager.cc:1403] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.078s	user 0.017s	sys 0.000s
I20260709 13:01:38.603622 10986 raft_consensus.cc:3060] T 2f47768053ec47e69b367bd5a49662c3 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.604292 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f47768053ec47e69b367bd5a49662c3" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:38.604689 10728 leader_election.cc:304] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:01:38.605504 11099 raft_consensus.cc:2804] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:38.605863 11099 raft_consensus.cc:493] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.606204 11099 raft_consensus.cc:3060] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:38.609146 10877 leader_election.cc:343] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.611359 11031 raft_consensus.cc:359] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:38.612142 11031 raft_consensus.cc:385] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.612416 11031 raft_consensus.cc:740] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.612901 11032 raft_consensus.cc:385] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.613327 11032 raft_consensus.cc:740] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.613453 11031 consensus_queue.cc:260] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:38.612377 10986 raft_consensus.cc:2468] T 2f47768053ec47e69b367bd5a49662c3 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 1.
I20260709 13:01:38.615482 10876 leader_election.cc:304] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:38.615916 11031 ts_tablet_manager.cc:1434] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:01:38.616662 11041 raft_consensus.cc:2804] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:38.617161 11031 tablet_bootstrap.cc:492] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:38.616788 11099 raft_consensus.cc:515] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:38.617278 11041 raft_consensus.cc:697] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Becoming Leader. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Running, Role: LEADER
I20260709 13:01:38.618422 11041 consensus_queue.cc:237] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:38.612604 11122 leader_election.cc:290] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Requested vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:38.624681 10660 catalog_manager.cc:5697] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:38.627506 11032 consensus_queue.cc:260] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:38.628578 11031 tablet_bootstrap.cc:654] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.631469 11040 raft_consensus.cc:2804] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:38.632540 11040 raft_consensus.cc:493] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.635416 11040 raft_consensus.cc:3060] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.642263 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61bf6eaa1845f8add4d4057e49eb15" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:38.643077 10837 raft_consensus.cc:3060] T bb61bf6eaa1845f8add4d4057e49eb15 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.650229 11032 ts_tablet_manager.cc:1434] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 13:01:38.652757 10837 raft_consensus.cc:2468] T bb61bf6eaa1845f8add4d4057e49eb15 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 1.
I20260709 13:01:38.654914 10728 leader_election.cc:304] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:38.655813 11100 raft_consensus.cc:2804] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:38.656298 11100 raft_consensus.cc:697] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:01:38.656324 11061 consensus_queue.cc:1048] T 03cf7a6241a444369a57fdaf965107b3 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:38.657481 11100 consensus_queue.cc:237] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:38.653653 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61bf6eaa1845f8add4d4057e49eb15" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:38.674893 11073 raft_consensus.cc:493] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.676803 11073 raft_consensus.cc:515] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:38.679134 11073 leader_election.cc:290] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:38.680703 10986 raft_consensus.cc:3060] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.682089 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf0d822416f49caacd1f92cebd84eb8" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:38.680768 11041 raft_consensus.cc:493] T 1a1b4a3380b746d2bc977cfeff019c26 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.683100 11041 raft_consensus.cc:515] T 1a1b4a3380b746d2bc977cfeff019c26 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:38.668071 11099 leader_election.cc:290] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Requested vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:38.684278 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf0d822416f49caacd1f92cebd84eb8" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
W20260709 13:01:38.685918 10727 leader_election.cc:343] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.686760 10910 raft_consensus.cc:2468] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 0.
I20260709 13:01:38.688110 10729 leader_election.cc:304] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:01:38.689512 11099 raft_consensus.cc:2804] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:38.689937 11099 raft_consensus.cc:493] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.690361 11099 raft_consensus.cc:3060] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:38.694188 10708 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:38.698060 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a1b4a3380b746d2bc977cfeff019c26" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:38.702792 11033 tablet_bootstrap.cc:492] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:38.703315 11033 ts_tablet_manager.cc:1403] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.160s	user 0.033s	sys 0.025s
W20260709 13:01:38.703524 10876 leader_election.cc:343] T 1a1b4a3380b746d2bc977cfeff019c26 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.698632 11041 leader_election.cc:290] T 1a1b4a3380b746d2bc977cfeff019c26 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:38.699476 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a1b4a3380b746d2bc977cfeff019c26" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
W20260709 13:01:38.705718 10877 leader_election.cc:343] T 1a1b4a3380b746d2bc977cfeff019c26 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.706192 10877 leader_election.cc:304] T 1a1b4a3380b746d2bc977cfeff019c26 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab; no voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:38.706408 11033 raft_consensus.cc:359] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:38.707026 11041 raft_consensus.cc:2749] T 1a1b4a3380b746d2bc977cfeff019c26 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:38.699736 11032 tablet_bootstrap.cc:492] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:38.708398 11037 tablet_bootstrap.cc:492] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:38.708961 11037 ts_tablet_manager.cc:1403] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.165s	user 0.032s	sys 0.027s
I20260709 13:01:38.707053 11033 raft_consensus.cc:385] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.710003 11033 raft_consensus.cc:740] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.670447 10659 catalog_manager.cc:5697] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab reported cstate change: term changed from 0 to 1, leader changed from <none> to b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:38.711892 11037 raft_consensus.cc:359] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:38.717106 11037 raft_consensus.cc:385] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.717453 11037 raft_consensus.cc:740] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.718182 11037 consensus_queue.cc:260] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:38.720165 11037 ts_tablet_manager.cc:1434] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:01:38.713871 11041 consensus_queue.cc:1048] T 03cf7a6241a444369a57fdaf965107b3 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:38.723714 11040 raft_consensus.cc:515] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.734810 10761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bb330c30de4041b86d22bf1c838e57" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:38.734297 10657 catalog_manager.cc:5697] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:38.735611 10761 raft_consensus.cc:3060] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.736176 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bb330c30de4041b86d22bf1c838e57" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
W20260709 13:01:38.738330 10804 leader_election.cc:343] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.714200 11031 tablet_bootstrap.cc:492] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:38.714543 11033 consensus_queue.cc:260] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:38.741101 11033 ts_tablet_manager.cc:1434] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.001s
I20260709 13:01:38.742298 11033 tablet_bootstrap.cc:492] T 1a1b4a3380b746d2bc977cfeff019c26 P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:38.743793 10986 raft_consensus.cc:2468] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 1.
I20260709 13:01:38.745072 11096 raft_consensus.cc:493] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.745615 11096 raft_consensus.cc:515] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:38.749620 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe62eca39f04407943d15c5f7646aee" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:38.750365 11031 ts_tablet_manager.cc:1403] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.133s	user 0.022s	sys 0.005s
I20260709 13:01:38.752581 11096 leader_election.cc:290] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:38.753293 11031 raft_consensus.cc:359] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.754002 11031 raft_consensus.cc:385] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.754012 10763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe62eca39f04407943d15c5f7646aee" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:38.754874 11040 leader_election.cc:290] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Requested vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:38.755946 10950 leader_election.cc:304] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f; no voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:38.756259 10761 raft_consensus.cc:2468] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 1.
I20260709 13:01:38.754338 11031 raft_consensus.cc:740] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.757607 10802 leader_election.cc:304] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367; no voters: b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:38.757928 11031 consensus_queue.cc:260] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.759346 11040 raft_consensus.cc:2804] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:38.760170 11031 ts_tablet_manager.cc:1434] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:01:38.760511 11040 raft_consensus.cc:697] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Becoming Leader. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Running, Role: LEADER
I20260709 13:01:38.761322 11031 tablet_bootstrap.cc:492] T c6bb330c30de4041b86d22bf1c838e57 P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:38.761425 11040 consensus_queue.cc:237] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.767966 11031 tablet_bootstrap.cc:654] T c6bb330c30de4041b86d22bf1c838e57 P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.757117 11096 raft_consensus.cc:2749] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:38.727213 11032 tablet_bootstrap.cc:654] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.730099 11037 tablet_bootstrap.cc:492] T d4b9835406e84c5b88d3c3eed76a3b95 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:38.731146 11099 raft_consensus.cc:515] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:38.773785 11099 leader_election.cc:290] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Requested vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:38.774888 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf0d822416f49caacd1f92cebd84eb8" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:38.775921 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf0d822416f49caacd1f92cebd84eb8" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:38.776163 11031 tablet_bootstrap.cc:492] T c6bb330c30de4041b86d22bf1c838e57 P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:38.776587 10910 raft_consensus.cc:3060] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.776744 11031 ts_tablet_manager.cc:1403] T c6bb330c30de4041b86d22bf1c838e57 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.005s
I20260709 13:01:38.778708 11037 tablet_bootstrap.cc:654] T d4b9835406e84c5b88d3c3eed76a3b95 P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.778170 10660 catalog_manager.cc:5697] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:38.779614 11031 raft_consensus.cc:359] T c6bb330c30de4041b86d22bf1c838e57 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.780299 11031 raft_consensus.cc:385] T c6bb330c30de4041b86d22bf1c838e57 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.780611 11031 raft_consensus.cc:740] T c6bb330c30de4041b86d22bf1c838e57 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
W20260709 13:01:38.776605 10727 leader_election.cc:343] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:38.781392 11031 consensus_queue.cc:260] T c6bb330c30de4041b86d22bf1c838e57 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.781402 11033 tablet_bootstrap.cc:654] T 1a1b4a3380b746d2bc977cfeff019c26 P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.783427 11031 ts_tablet_manager.cc:1434] T c6bb330c30de4041b86d22bf1c838e57 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:01:38.784588 11031 tablet_bootstrap.cc:492] T e3dd15d873514f74a9bca08bc55e5d36 P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:38.790892 11031 tablet_bootstrap.cc:654] T e3dd15d873514f74a9bca08bc55e5d36 P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.794579 11037 tablet_bootstrap.cc:492] T d4b9835406e84c5b88d3c3eed76a3b95 P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:38.795132 11037 ts_tablet_manager.cc:1403] T d4b9835406e84c5b88d3c3eed76a3b95 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.001s
I20260709 13:01:38.790892 10910 raft_consensus.cc:2468] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 1.
I20260709 13:01:38.800397 10729 leader_election.cc:304] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:01:38.800865 11032 tablet_bootstrap.cc:492] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:38.803094 11032 ts_tablet_manager.cc:1403] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.104s	user 0.010s	sys 0.007s
I20260709 13:01:38.803894 11073 raft_consensus.cc:493] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.804423 11073 raft_consensus.cc:515] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:38.805053 11040 consensus_queue.cc:1048] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:38.805922 11032 raft_consensus.cc:359] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:38.801703 11037 raft_consensus.cc:359] T d4b9835406e84c5b88d3c3eed76a3b95 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.801970 11099 raft_consensus.cc:2804] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:38.807022 11099 raft_consensus.cc:697] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:01:38.807540 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830984b68ee046d9b9a67009177b55c2" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:38.806406 11073 leader_election.cc:290] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:38.807981 11031 tablet_bootstrap.cc:492] T e3dd15d873514f74a9bca08bc55e5d36 P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:38.808504 11031 ts_tablet_manager.cc:1403] T e3dd15d873514f74a9bca08bc55e5d36 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.004s
I20260709 13:01:38.807883 11099 consensus_queue.cc:237] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:38.808610 11037 raft_consensus.cc:385] T d4b9835406e84c5b88d3c3eed76a3b95 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.809119 11037 raft_consensus.cc:740] T d4b9835406e84c5b88d3c3eed76a3b95 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.809374 10986 raft_consensus.cc:2468] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 0.
I20260709 13:01:38.809929 11037 consensus_queue.cc:260] T d4b9835406e84c5b88d3c3eed76a3b95 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.811277 11031 raft_consensus.cc:359] T e3dd15d873514f74a9bca08bc55e5d36 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:38.812000 11032 raft_consensus.cc:385] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.811954 11031 raft_consensus.cc:385] T e3dd15d873514f74a9bca08bc55e5d36 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.811884 10727 leader_election.cc:304] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f; no voters: 
I20260709 13:01:38.811926 11037 ts_tablet_manager.cc:1434] T d4b9835406e84c5b88d3c3eed76a3b95 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:01:38.812652 11031 raft_consensus.cc:740] T e3dd15d873514f74a9bca08bc55e5d36 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.813359 11073 raft_consensus.cc:2804] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:38.808368 10838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830984b68ee046d9b9a67009177b55c2" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:38.813747 11073 raft_consensus.cc:493] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.812527 11032 raft_consensus.cc:740] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.813649 11031 consensus_queue.cc:260] T e3dd15d873514f74a9bca08bc55e5d36 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:38.814424 11073 raft_consensus.cc:3060] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.814420 10838 raft_consensus.cc:2468] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 0.
I20260709 13:01:38.814862 11032 consensus_queue.cc:260] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:38.817435 11032 ts_tablet_manager.cc:1434] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:01:38.818711 11032 tablet_bootstrap.cc:492] T 9bf0d822416f49caacd1f92cebd84eb8 P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:38.824236 11033 tablet_bootstrap.cc:492] T 1a1b4a3380b746d2bc977cfeff019c26 P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:38.813848 11037 tablet_bootstrap.cc:492] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:38.828949 11033 ts_tablet_manager.cc:1403] T 1a1b4a3380b746d2bc977cfeff019c26 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.087s	user 0.012s	sys 0.004s
I20260709 13:01:38.837739 11032 tablet_bootstrap.cc:654] T 9bf0d822416f49caacd1f92cebd84eb8 P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.840736 11033 raft_consensus.cc:359] T 1a1b4a3380b746d2bc977cfeff019c26 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:38.841513 11033 raft_consensus.cc:385] T 1a1b4a3380b746d2bc977cfeff019c26 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.841784 11033 raft_consensus.cc:740] T 1a1b4a3380b746d2bc977cfeff019c26 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.842495 11033 consensus_queue.cc:260] T 1a1b4a3380b746d2bc977cfeff019c26 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:38.842998 11037 tablet_bootstrap.cc:654] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.833693 11031 ts_tablet_manager.cc:1434] T e3dd15d873514f74a9bca08bc55e5d36 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 13:01:38.843964 11064 consensus_queue.cc:1048] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:38.844599 11031 tablet_bootstrap.cc:492] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:38.850505 11031 tablet_bootstrap.cc:654] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.854203 11033 ts_tablet_manager.cc:1434] T 1a1b4a3380b746d2bc977cfeff019c26 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:01:38.855028 11032 tablet_bootstrap.cc:492] T 9bf0d822416f49caacd1f92cebd84eb8 P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:38.843771 10657 catalog_manager.cc:5697] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:38.855309 11033 tablet_bootstrap.cc:492] T ccad89aaaf3d48008955a353eb0097b9 P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:38.828135 11073 raft_consensus.cc:515] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:38.855561 11032 ts_tablet_manager.cc:1403] T 9bf0d822416f49caacd1f92cebd84eb8 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.000s
I20260709 13:01:38.859302 11073 leader_election.cc:290] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Requested vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:38.860690 11032 raft_consensus.cc:359] T 9bf0d822416f49caacd1f92cebd84eb8 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:38.861918 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830984b68ee046d9b9a67009177b55c2" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:38.862653 10838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830984b68ee046d9b9a67009177b55c2" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:38.863988 10985 raft_consensus.cc:3060] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.864045 10838 raft_consensus.cc:3060] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.863373 11032 raft_consensus.cc:385] T 9bf0d822416f49caacd1f92cebd84eb8 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.865240 11032 raft_consensus.cc:740] T 9bf0d822416f49caacd1f92cebd84eb8 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.866240 11033 tablet_bootstrap.cc:654] T ccad89aaaf3d48008955a353eb0097b9 P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.879642 10838 raft_consensus.cc:2468] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 1.
I20260709 13:01:38.888039 10728 leader_election.cc:304] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:38.888382 11037 tablet_bootstrap.cc:492] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:38.889007 11037 ts_tablet_manager.cc:1403] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.008s
I20260709 13:01:38.889221 11073 raft_consensus.cc:2804] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:38.889856 11073 raft_consensus.cc:697] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:01:38.890771 11073 consensus_queue.cc:237] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:38.892186 11037 raft_consensus.cc:359] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:38.893106 11037 raft_consensus.cc:385] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.893362 11037 raft_consensus.cc:740] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.893975 11037 consensus_queue.cc:260] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:38.894814 11033 tablet_bootstrap.cc:492] T ccad89aaaf3d48008955a353eb0097b9 P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:38.895364 11033 ts_tablet_manager.cc:1403] T ccad89aaaf3d48008955a353eb0097b9 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.022s
I20260709 13:01:38.897262 11032 consensus_queue.cc:260] T 9bf0d822416f49caacd1f92cebd84eb8 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:38.898139 11033 raft_consensus.cc:359] T ccad89aaaf3d48008955a353eb0097b9 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:38.898800 11033 raft_consensus.cc:385] T ccad89aaaf3d48008955a353eb0097b9 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.899024 11032 ts_tablet_manager.cc:1434] T 9bf0d822416f49caacd1f92cebd84eb8 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.000s
I20260709 13:01:38.899061 11033 raft_consensus.cc:740] T ccad89aaaf3d48008955a353eb0097b9 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.900266 11032 tablet_bootstrap.cc:492] T 1a1b4a3380b746d2bc977cfeff019c26 P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:38.883749 10985 raft_consensus.cc:2468] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 1.
I20260709 13:01:38.902151 11037 ts_tablet_manager.cc:1434] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 13:01:38.899941 11033 consensus_queue.cc:260] T ccad89aaaf3d48008955a353eb0097b9 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:38.906303 10985 raft_consensus.cc:3060] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.909294 10657 catalog_manager.cc:5697] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:38.911615 11037 tablet_bootstrap.cc:492] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:38.913313 11033 ts_tablet_manager.cc:1434] T ccad89aaaf3d48008955a353eb0097b9 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:01:38.914424 11033 tablet_bootstrap.cc:492] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:38.925163 11031 tablet_bootstrap.cc:492] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:38.926321 11032 tablet_bootstrap.cc:654] T 1a1b4a3380b746d2bc977cfeff019c26 P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.929039 11031 ts_tablet_manager.cc:1403] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.085s	user 0.011s	sys 0.003s
I20260709 13:01:38.928212 11033 tablet_bootstrap.cc:654] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.932091 11031 raft_consensus.cc:359] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:38.937958 11031 raft_consensus.cc:385] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.938292 11031 raft_consensus.cc:740] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.938973 11031 consensus_queue.cc:260] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:38.940503 11040 raft_consensus.cc:493] T 3034b839c8444c8d80acc4fe57bcd00a P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.941188 11031 ts_tablet_manager.cc:1434] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:01:38.941052 11040 raft_consensus.cc:515] T 3034b839c8444c8d80acc4fe57bcd00a P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:38.943466 11040 leader_election.cc:290] T 3034b839c8444c8d80acc4fe57bcd00a P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:38.945202 11031 tablet_bootstrap.cc:492] T f1c9e47add2e4175b68fde1a27aa92e0 P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:38.945617 10911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3034b839c8444c8d80acc4fe57bcd00a" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:38.946456 10911 raft_consensus.cc:2393] T 3034b839c8444c8d80acc4fe57bcd00a P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbd1fdffc68440e5b6250f6d95a4a367 in current term 1: Already voted for candidate 5e62c52a41f7476a908dd377c1a8a79f in this term.
I20260709 13:01:38.948431 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3034b839c8444c8d80acc4fe57bcd00a" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:38.951509 10802 leader_election.cc:304] T 3034b839c8444c8d80acc4fe57bcd00a P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbd1fdffc68440e5b6250f6d95a4a367; no voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:38.954651 11040 raft_consensus.cc:3060] T 3034b839c8444c8d80acc4fe57bcd00a P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.956779 11037 tablet_bootstrap.cc:654] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.958567 11032 tablet_bootstrap.cc:492] T 1a1b4a3380b746d2bc977cfeff019c26 P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:38.959137 11032 ts_tablet_manager.cc:1403] T 1a1b4a3380b746d2bc977cfeff019c26 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.000s
I20260709 13:01:38.965513 11033 tablet_bootstrap.cc:492] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:38.966151 11040 raft_consensus.cc:2749] T 3034b839c8444c8d80acc4fe57bcd00a P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:38.966310 11032 raft_consensus.cc:359] T 1a1b4a3380b746d2bc977cfeff019c26 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:38.967222 11032 raft_consensus.cc:385] T 1a1b4a3380b746d2bc977cfeff019c26 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.967545 11032 raft_consensus.cc:740] T 1a1b4a3380b746d2bc977cfeff019c26 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.966112 11033 ts_tablet_manager.cc:1403] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.006s
I20260709 13:01:38.968802 11032 consensus_queue.cc:260] T 1a1b4a3380b746d2bc977cfeff019c26 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:38.969524 11031 tablet_bootstrap.cc:654] T f1c9e47add2e4175b68fde1a27aa92e0 P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.971340 11033 raft_consensus.cc:359] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.972200 11033 raft_consensus.cc:385] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.972648 11033 raft_consensus.cc:740] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.973433 11033 consensus_queue.cc:260] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.975814 11033 ts_tablet_manager.cc:1434] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:01:38.976660 11037 tablet_bootstrap.cc:492] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:38.977208 11037 ts_tablet_manager.cc:1403] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.074s	user 0.012s	sys 0.009s
I20260709 13:01:38.977581 11033 tablet_bootstrap.cc:492] T 48e63402e1544658a8d6cf5b9220414b P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:38.978102 11032 ts_tablet_manager.cc:1434] T 1a1b4a3380b746d2bc977cfeff019c26 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 13:01:38.979949 11037 raft_consensus.cc:359] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.980772 11037 raft_consensus.cc:385] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:38.981029 11037 raft_consensus.cc:740] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:38.981696 11037 consensus_queue.cc:260] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.984234 11037 ts_tablet_manager.cc:1434] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:01:38.987675 11032 tablet_bootstrap.cc:492] T ccad89aaaf3d48008955a353eb0097b9 P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:38.992437 11073 consensus_queue.cc:1048] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:38.993320 11100 raft_consensus.cc:493] T fa2569632a834231ba0f3bad60cf90ee P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.994143 11037 tablet_bootstrap.cc:492] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:38.993918 11100 raft_consensus.cc:515] T fa2569632a834231ba0f3bad60cf90ee P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:38.998178 11040 raft_consensus.cc:493] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.998813 10838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2569632a834231ba0f3bad60cf90ee" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:39.000928 11037 tablet_bootstrap.cc:654] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:39.002318 10911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa2569632a834231ba0f3bad60cf90ee" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:38.994029 11073 raft_consensus.cc:493] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.003098 11073 raft_consensus.cc:515] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:39.004387 11032 tablet_bootstrap.cc:654] T ccad89aaaf3d48008955a353eb0097b9 P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.998780 11040 raft_consensus.cc:515] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:39.009949 11040 leader_election.cc:290] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:39.012037 10761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b9835406e84c5b88d3c3eed76a3b95" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:39.012892 10761 raft_consensus.cc:2468] T d4b9835406e84c5b88d3c3eed76a3b95 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 0.
I20260709 13:01:39.003217 10911 raft_consensus.cc:2393] T fa2569632a834231ba0f3bad60cf90ee P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 346158a6aa6747c1b8d31b4fb80238d0 in current term 1: Already voted for candidate dbd1fdffc68440e5b6250f6d95a4a367 in this term.
I20260709 13:01:39.015282 11073 leader_election.cc:290] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:39.015640 10802 leader_election.cc:304] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:39.015728 10729 leader_election.cc:304] T fa2569632a834231ba0f3bad60cf90ee P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0; no voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:39.017252 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3dd15d873514f74a9bca08bc55e5d36" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:39.018036 10986 raft_consensus.cc:2468] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 0.
I20260709 13:01:39.017354 11037 tablet_bootstrap.cc:492] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:39.018864 11037 ts_tablet_manager.cc:1403] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.000s
I20260709 13:01:39.016678 10911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3dd15d873514f74a9bca08bc55e5d36" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:39.020967 10911 raft_consensus.cc:2468] T e3dd15d873514f74a9bca08bc55e5d36 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 0.
I20260709 13:01:39.021879 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b9835406e84c5b88d3c3eed76a3b95" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:39.022137 10729 leader_election.cc:304] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:39.022598 10912 raft_consensus.cc:2468] T d4b9835406e84c5b88d3c3eed76a3b95 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 0.
I20260709 13:01:39.022778 11064 raft_consensus.cc:2804] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:39.023291 11064 raft_consensus.cc:493] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.016693 11068 raft_consensus.cc:493] T 1a1b4a3380b746d2bc977cfeff019c26 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.023705 11064 raft_consensus.cc:3060] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.023379 11040 consensus_queue.cc:1048] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:39.024663 11124 raft_consensus.cc:493] T ccad89aaaf3d48008955a353eb0097b9 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.025256 11032 tablet_bootstrap.cc:492] T ccad89aaaf3d48008955a353eb0097b9 P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:39.024820 11068 raft_consensus.cc:515] T 1a1b4a3380b746d2bc977cfeff019c26 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:39.025889 11032 ts_tablet_manager.cc:1403] T ccad89aaaf3d48008955a353eb0097b9 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.007s
I20260709 13:01:39.027325 11068 leader_election.cc:290] T 1a1b4a3380b746d2bc977cfeff019c26 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:39.025135 11099 raft_consensus.cc:2804] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:39.028040 11099 raft_consensus.cc:493] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.028412 11099 raft_consensus.cc:3060] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:38.996213 11100 leader_election.cc:290] T fa2569632a834231ba0f3bad60cf90ee P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:39.029253 11032 raft_consensus.cc:359] T ccad89aaaf3d48008955a353eb0097b9 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:39.030009 11032 raft_consensus.cc:385] T ccad89aaaf3d48008955a353eb0097b9 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.018944 11073 raft_consensus.cc:3060] T fa2569632a834231ba0f3bad60cf90ee P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.021844 11037 raft_consensus.cc:359] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:39.031131 11037 raft_consensus.cc:385] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.031445 11037 raft_consensus.cc:740] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.032296 11037 consensus_queue.cc:260] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:39.032898 11064 raft_consensus.cc:515] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:39.034250 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a1b4a3380b746d2bc977cfeff019c26" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:39.034621 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a1b4a3380b746d2bc977cfeff019c26" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:39.034981 10912 raft_consensus.cc:2468] T 1a1b4a3380b746d2bc977cfeff019c26 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 0.
I20260709 13:01:39.035369 10986 raft_consensus.cc:2468] T 1a1b4a3380b746d2bc977cfeff019c26 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 0.
I20260709 13:01:39.030287 11032 raft_consensus.cc:740] T ccad89aaaf3d48008955a353eb0097b9 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.036612 11124 raft_consensus.cc:515] T ccad89aaaf3d48008955a353eb0097b9 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:39.037271 11032 consensus_queue.cc:260] T ccad89aaaf3d48008955a353eb0097b9 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:39.037638 10761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b9835406e84c5b88d3c3eed76a3b95" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:39.038311 10761 raft_consensus.cc:3060] T d4b9835406e84c5b88d3c3eed76a3b95 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.038821 11124 leader_election.cc:290] T ccad89aaaf3d48008955a353eb0097b9 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:39.040759 11037 ts_tablet_manager.cc:1434] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:01:39.041357 10804 leader_election.cc:304] T 1a1b4a3380b746d2bc977cfeff019c26 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:39.041931 11037 tablet_bootstrap.cc:492] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:39.044291 11124 raft_consensus.cc:2804] T 1a1b4a3380b746d2bc977cfeff019c26 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:39.044876 11124 raft_consensus.cc:493] T 1a1b4a3380b746d2bc977cfeff019c26 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.045339 11124 raft_consensus.cc:3060] T 1a1b4a3380b746d2bc977cfeff019c26 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.039727 11032 ts_tablet_manager.cc:1434] T ccad89aaaf3d48008955a353eb0097b9 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:01:39.049149 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccad89aaaf3d48008955a353eb0097b9" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:39.050057 10986 raft_consensus.cc:2468] T ccad89aaaf3d48008955a353eb0097b9 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 0.
I20260709 13:01:39.051537 10763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccad89aaaf3d48008955a353eb0097b9" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:39.052309 10763 raft_consensus.cc:2468] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 0.
I20260709 13:01:39.054016 11033 tablet_bootstrap.cc:654] T 48e63402e1544658a8d6cf5b9220414b P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:38.993172 11031 tablet_bootstrap.cc:492] T f1c9e47add2e4175b68fde1a27aa92e0 P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:39.055641 11031 ts_tablet_manager.cc:1403] T f1c9e47add2e4175b68fde1a27aa92e0 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.111s	user 0.013s	sys 0.007s
I20260709 13:01:39.055956 10802 leader_election.cc:304] T ccad89aaaf3d48008955a353eb0097b9 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
W20260709 13:01:39.057559 10877 consensus_peers.cc:597] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab -> Peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Couldn't send request to peer dbd1fdffc68440e5b6250f6d95a4a367. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:39.058444 11031 raft_consensus.cc:359] T f1c9e47add2e4175b68fde1a27aa92e0 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:39.059160 11031 raft_consensus.cc:385] T f1c9e47add2e4175b68fde1a27aa92e0 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.059430 11031 raft_consensus.cc:740] T f1c9e47add2e4175b68fde1a27aa92e0 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.059599 11037 tablet_bootstrap.cc:654] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:39.060681 11040 raft_consensus.cc:2804] T ccad89aaaf3d48008955a353eb0097b9 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:39.061213 11040 raft_consensus.cc:493] T ccad89aaaf3d48008955a353eb0097b9 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.061715 11040 raft_consensus.cc:3060] T ccad89aaaf3d48008955a353eb0097b9 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.062129 11099 raft_consensus.cc:515] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:39.065465 10911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3dd15d873514f74a9bca08bc55e5d36" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:39.066085 10911 raft_consensus.cc:3060] T e3dd15d873514f74a9bca08bc55e5d36 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.050201 11032 tablet_bootstrap.cc:492] T 9fa0ebad5bc4444a8c465b2e412524dd P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:39.070326 11061 raft_consensus.cc:493] T c6bb330c30de4041b86d22bf1c838e57 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.070950 11061 raft_consensus.cc:515] T c6bb330c30de4041b86d22bf1c838e57 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:39.073668 10911 raft_consensus.cc:2468] T e3dd15d873514f74a9bca08bc55e5d36 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 1.
I20260709 13:01:39.075812 10729 leader_election.cc:304] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:39.076079 11061 leader_election.cc:290] T c6bb330c30de4041b86d22bf1c838e57 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:39.076263 11099 leader_election.cc:290] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Requested vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:39.070370 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3dd15d873514f74a9bca08bc55e5d36" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:39.077754 10986 raft_consensus.cc:3060] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.077956 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bb330c30de4041b86d22bf1c838e57" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:39.078791 10838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6bb330c30de4041b86d22bf1c838e57" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:39.077270 11100 raft_consensus.cc:2804] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:39.079779 11100 raft_consensus.cc:697] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:01:39.080744 11100 consensus_queue.cc:237] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:39.078761 10762 raft_consensus.cc:2393] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b778a184b0ac46f5b86ce4fe363dcbab in current term 1: Already voted for candidate dbd1fdffc68440e5b6250f6d95a4a367 in this term.
I20260709 13:01:39.085510 10876 leader_election.cc:304] T c6bb330c30de4041b86d22bf1c838e57 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab; no voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:39.086438 11061 raft_consensus.cc:3060] T c6bb330c30de4041b86d22bf1c838e57 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.091086 11031 consensus_queue.cc:260] T f1c9e47add2e4175b68fde1a27aa92e0 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:39.093410 11031 ts_tablet_manager.cc:1434] T f1c9e47add2e4175b68fde1a27aa92e0 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:01:39.094730 11031 tablet_bootstrap.cc:492] T f547b171c6b9445c95475ce3be870c2e P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:39.111042 11122 raft_consensus.cc:493] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.105363 11064 leader_election.cc:290] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Requested vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:39.125512 11122 raft_consensus.cc:515] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:39.120517 11040 raft_consensus.cc:515] T ccad89aaaf3d48008955a353eb0097b9 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:39.127671 11122 leader_election.cc:290] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:39.128372 11100 raft_consensus.cc:493] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.128778 10838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b6ca3deb4f59aa2803e2ed33c4e8" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:39.129166 11100 raft_consensus.cc:515] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:39.129616 10838 raft_consensus.cc:2468] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 1.
I20260709 13:01:39.130995 10877 leader_election.cc:304] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:39.131954 11122 raft_consensus.cc:2804] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:39.132385 11122 raft_consensus.cc:493] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.133652 11122 raft_consensus.cc:3060] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.133041 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5382a9b34d84b4fbeccc952bb5f4ef5" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:39.134199 11061 raft_consensus.cc:2749] T c6bb330c30de4041b86d22bf1c838e57 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:39.135558 11033 tablet_bootstrap.cc:492] T 48e63402e1544658a8d6cf5b9220414b P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:39.136071 11033 ts_tablet_manager.cc:1403] T 48e63402e1544658a8d6cf5b9220414b P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.159s	user 0.012s	sys 0.001s
W20260709 13:01:39.135414 10729 leader_election.cc:343] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:39.148968 11100 leader_election.cc:290] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:39.149574 11073 raft_consensus.cc:2749] T fa2569632a834231ba0f3bad60cf90ee P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:39.153523 11033 raft_consensus.cc:359] T 48e63402e1544658a8d6cf5b9220414b P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:39.154057 11033 raft_consensus.cc:385] T 48e63402e1544658a8d6cf5b9220414b P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.154400 11033 raft_consensus.cc:740] T 48e63402e1544658a8d6cf5b9220414b P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
W20260709 13:01:39.152027 10727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42509, user_credentials={real_user=slave}} blocked reactor thread for 69728.5us
I20260709 13:01:39.159583 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5382a9b34d84b4fbeccc952bb5f4ef5" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:39.160326 10985 raft_consensus.cc:2468] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 0.
I20260709 13:01:39.164345 11189 consensus_queue.cc:1048] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:39.165463 11033 consensus_queue.cc:260] T 48e63402e1544658a8d6cf5b9220414b P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:39.166795 10727 leader_election.cc:304] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f; no voters: b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:39.169318 11178 consensus_queue.cc:1048] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:39.170662 11033 ts_tablet_manager.cc:1434] T 48e63402e1544658a8d6cf5b9220414b P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.034s	user 0.002s	sys 0.004s
I20260709 13:01:39.171762 11032 tablet_bootstrap.cc:654] T 9fa0ebad5bc4444a8c465b2e412524dd P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:39.149986 11100 consensus_queue.cc:1048] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:01:39.173957 11073 raft_consensus.cc:2804] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:39.174408 11073 raft_consensus.cc:493] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.151741 10986 raft_consensus.cc:2468] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 1.
I20260709 13:01:39.174743 11073 raft_consensus.cc:3060] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.151963 10911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4b9835406e84c5b88d3c3eed76a3b95" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:39.144929 10761 raft_consensus.cc:2468] T d4b9835406e84c5b88d3c3eed76a3b95 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 1.
I20260709 13:01:39.186775 11033 tablet_bootstrap.cc:492] T 9be3de57a254453d9dc75680e7f27f22 P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:39.189536 11073 raft_consensus.cc:515] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:39.193090 11040 leader_election.cc:290] T ccad89aaaf3d48008955a353eb0097b9 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Requested vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:39.193918 10911 raft_consensus.cc:3060] T d4b9835406e84c5b88d3c3eed76a3b95 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.194321 11033 tablet_bootstrap.cc:654] T 9be3de57a254453d9dc75680e7f27f22 P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:39.195804 10802 leader_election.cc:304] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:39.196058 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccad89aaaf3d48008955a353eb0097b9" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:39.196794 10986 raft_consensus.cc:3060] T ccad89aaaf3d48008955a353eb0097b9 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.115302 11124 raft_consensus.cc:515] T 1a1b4a3380b746d2bc977cfeff019c26 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:39.199669 10761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccad89aaaf3d48008955a353eb0097b9" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:39.201018 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5382a9b34d84b4fbeccc952bb5f4ef5" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:39.200433 10761 raft_consensus.cc:3060] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.204905 11189 raft_consensus.cc:2804] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:01:39.215548 10729 leader_election.cc:343] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:39.224324 11189 raft_consensus.cc:697] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Becoming Leader. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Running, Role: LEADER
I20260709 13:01:39.225405 11189 consensus_queue.cc:237] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:39.202024 11122 raft_consensus.cc:515] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:39.233180 11061 raft_consensus.cc:493] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.233773 11061 raft_consensus.cc:515] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:39.236225 11180 consensus_queue.cc:1048] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:39.237532 11031 tablet_bootstrap.cc:654] T f547b171c6b9445c95475ce3be870c2e P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:39.212563 11073 leader_election.cc:290] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Requested vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:39.244632 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be3de57a254453d9dc75680e7f27f22" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:39.244078 11188 consensus_queue.cc:1048] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:01:39.246132 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5382a9b34d84b4fbeccc952bb5f4ef5" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:39.246776 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b6ca3deb4f59aa2803e2ed33c4e8" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:39.246820 10984 raft_consensus.cc:3060] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.247560 10985 raft_consensus.cc:2468] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 1.
I20260709 13:01:39.249634 11193 raft_consensus.cc:493] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.250190 11193 raft_consensus.cc:515] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:39.236958 11061 leader_election.cc:290] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:39.253377 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be3de57a254453d9dc75680e7f27f22" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:39.257429 11124 leader_election.cc:290] T 1a1b4a3380b746d2bc977cfeff019c26 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Requested vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
W20260709 13:01:39.259527 10728 leader_election.cc:343] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:39.259744 11122 leader_election.cc:290] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 election: Requested vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
W20260709 13:01:39.266711 10877 leader_election.cc:343] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:39.267982 11037 tablet_bootstrap.cc:492] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:39.268082 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a1b4a3380b746d2bc977cfeff019c26" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:39.269722 10983 raft_consensus.cc:3060] T 1a1b4a3380b746d2bc977cfeff019c26 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.273461 11186 consensus_queue.cc:1048] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:39.277014 10909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be3de57a254453d9dc75680e7f27f22" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:39.277720 10909 raft_consensus.cc:2468] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 0.
I20260709 13:01:39.279119 10729 leader_election.cc:304] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:39.279729 11124 consensus_queue.cc:1048] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:39.280283 11186 consensus_queue.cc:1048] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:39.280714 11037 ts_tablet_manager.cc:1403] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.239s	user 0.029s	sys 0.020s
I20260709 13:01:39.281739 11186 raft_consensus.cc:2804] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:39.281837 11122 consensus_queue.cc:1048] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:39.283515 11037 raft_consensus.cc:359] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:39.280061 10761 raft_consensus.cc:2468] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 1.
I20260709 13:01:39.282169 11186 raft_consensus.cc:493] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.284251 11037 raft_consensus.cc:385] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.288030 11037 raft_consensus.cc:740] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.256124 10911 raft_consensus.cc:2468] T d4b9835406e84c5b88d3c3eed76a3b95 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 1.
I20260709 13:01:39.279955 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b6ca3deb4f59aa2803e2ed33c4e8" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:39.301498 11037 consensus_queue.cc:260] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:39.310073 11032 tablet_bootstrap.cc:492] T 9fa0ebad5bc4444a8c465b2e412524dd P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:39.310719 11032 ts_tablet_manager.cc:1403] T 9fa0ebad5bc4444a8c465b2e412524dd P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.261s	user 0.015s	sys 0.001s
I20260709 13:01:39.311328 10909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a1b4a3380b746d2bc977cfeff019c26" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:39.311996 10909 raft_consensus.cc:3060] T 1a1b4a3380b746d2bc977cfeff019c26 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.313552 11032 raft_consensus.cc:359] T 9fa0ebad5bc4444a8c465b2e412524dd P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:39.314278 11032 raft_consensus.cc:385] T 9fa0ebad5bc4444a8c465b2e412524dd P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.276446 10984 raft_consensus.cc:2468] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 1.
I20260709 13:01:39.290912 11186 raft_consensus.cc:3060] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.314549 11032 raft_consensus.cc:740] T 9fa0ebad5bc4444a8c465b2e412524dd P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.301456 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be3de57a254453d9dc75680e7f27f22" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:39.288686 11193 leader_election.cc:290] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:39.317351 10837 raft_consensus.cc:3060] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.336323 11032 consensus_queue.cc:260] T 9fa0ebad5bc4444a8c465b2e412524dd P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:39.301056 10986 raft_consensus.cc:2468] T ccad89aaaf3d48008955a353eb0097b9 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 1.
I20260709 13:01:39.345763 11178 raft_consensus.cc:493] T 9bf0d822416f49caacd1f92cebd84eb8 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.348892 11037 ts_tablet_manager.cc:1434] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.002s
I20260709 13:01:39.352723 11032 ts_tablet_manager.cc:1434] T 9fa0ebad5bc4444a8c465b2e412524dd P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:01:39.346021 11073 raft_consensus.cc:493] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.354826 11073 raft_consensus.cc:515] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:39.370594 11032 tablet_bootstrap.cc:492] T a19edd96c26a4c91a7b2a412d8221e5b P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:39.371888 11037 tablet_bootstrap.cc:492] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:39.347585 10802 leader_election.cc:304] T ccad89aaaf3d48008955a353eb0097b9 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:39.383080 11033 tablet_bootstrap.cc:492] T 9be3de57a254453d9dc75680e7f27f22 P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:39.384228 11033 ts_tablet_manager.cc:1403] T 9be3de57a254453d9dc75680e7f27f22 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.198s	user 0.015s	sys 0.035s
I20260709 13:01:39.370748 11073 leader_election.cc:290] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:39.346339 11178 raft_consensus.cc:515] T 9bf0d822416f49caacd1f92cebd84eb8 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:39.406396 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cc6b6ca3deb4f59aa2803e2ed33c4e8" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:39.407215 10986 raft_consensus.cc:3060] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:39.407862 10835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c403148f1f724c0ca12919d8e85ae572" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
W20260709 13:01:39.409699 10728 leader_election.cc:343] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:39.425958 11178 leader_election.cc:290] T 9bf0d822416f49caacd1f92cebd84eb8 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:39.428689 11124 raft_consensus.cc:2804] T ccad89aaaf3d48008955a353eb0097b9 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:39.429311 11124 raft_consensus.cc:697] T ccad89aaaf3d48008955a353eb0097b9 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Becoming Leader. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Running, Role: LEADER
W20260709 13:01:39.417376 10802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34489, user_credentials={real_user=slave}} blocked reactor thread for 81776us
I20260709 13:01:39.430142 11124 consensus_queue.cc:237] T ccad89aaaf3d48008955a353eb0097b9 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:39.430629 10911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf0d822416f49caacd1f92cebd84eb8" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:39.431443 10911 raft_consensus.cc:2393] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e62c52a41f7476a908dd377c1a8a79f in current term 1: Already voted for candidate 346158a6aa6747c1b8d31b4fb80238d0 in this term.
I20260709 13:01:39.433535 11122 raft_consensus.cc:493] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.441599 11122 raft_consensus.cc:515] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:39.443882 11122 leader_election.cc:290] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:39.444898 10763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf0d822416f49caacd1f92cebd84eb8" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:39.446462 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa0ebad5bc4444a8c465b2e412524dd" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:39.446786 10950 leader_election.cc:304] T 9bf0d822416f49caacd1f92cebd84eb8 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f; no voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:39.449455 11096 raft_consensus.cc:3060] T 9bf0d822416f49caacd1f92cebd84eb8 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.456429 10658 catalog_manager.cc:5697] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:39.447288 10982 raft_consensus.cc:2468] T 9fa0ebad5bc4444a8c465b2e412524dd P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 0.
I20260709 13:01:39.382344 11193 consensus_queue.cc:1048] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.072s
I20260709 13:01:39.430174 10837 raft_consensus.cc:2468] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 2.
I20260709 13:01:39.489531 11031 tablet_bootstrap.cc:492] T f547b171c6b9445c95475ce3be870c2e P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:39.490098 11031 ts_tablet_manager.cc:1403] T f547b171c6b9445c95475ce3be870c2e P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.396s	user 0.019s	sys 0.016s
I20260709 13:01:39.467976 10727 leader_election.cc:304] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f; no voters: b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:39.485575 10876 leader_election.cc:304] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:39.494853 10909 raft_consensus.cc:2468] T 1a1b4a3380b746d2bc977cfeff019c26 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 1.
W20260709 13:01:39.513756 11199 log.cc:927] Time spent T 3034b839c8444c8d80acc4fe57bcd00a P b778a184b0ac46f5b86ce4fe363dcbab: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:01:39.517015 11198 raft_consensus.cc:2804] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:39.517714 11198 raft_consensus.cc:697] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:01:39.518683 11198 consensus_queue.cc:237] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
W20260709 13:01:39.509047 10727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42509, user_credentials={real_user=slave}} blocked reactor thread for 49300.1us
I20260709 13:01:39.517932 11096 raft_consensus.cc:2749] T 9bf0d822416f49caacd1f92cebd84eb8 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:39.521442 11122 raft_consensus.cc:2804] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:39.563179 11031 raft_consensus.cc:359] T f547b171c6b9445c95475ce3be870c2e P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:39.564070 11031 raft_consensus.cc:385] T f547b171c6b9445c95475ce3be870c2e P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.564350 11031 raft_consensus.cc:740] T f547b171c6b9445c95475ce3be870c2e P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.567126 11031 consensus_queue.cc:260] T f547b171c6b9445c95475ce3be870c2e P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:39.573391 11041 raft_consensus.cc:493] T f1c9e47add2e4175b68fde1a27aa92e0 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.573835 11041 raft_consensus.cc:515] T f1c9e47add2e4175b68fde1a27aa92e0 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:39.575556 11041 leader_election.cc:290] T f1c9e47add2e4175b68fde1a27aa92e0 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:39.577888 11031 ts_tablet_manager.cc:1434] T f547b171c6b9445c95475ce3be870c2e P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.001s
I20260709 13:01:39.564574 10982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c403148f1f724c0ca12919d8e85ae572" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:39.559475 11122 raft_consensus.cc:493] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.560030 11040 raft_consensus.cc:493] T 48e63402e1544658a8d6cf5b9220414b P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.549041 11186 raft_consensus.cc:515] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:39.591200 10762 raft_consensus.cc:2393] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b778a184b0ac46f5b86ce4fe363dcbab in current term 1: Already voted for candidate 346158a6aa6747c1b8d31b4fb80238d0 in this term.
I20260709 13:01:39.592257 11033 raft_consensus.cc:359] T 9be3de57a254453d9dc75680e7f27f22 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:39.593219 11033 raft_consensus.cc:385] T 9be3de57a254453d9dc75680e7f27f22 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.593465 11033 raft_consensus.cc:740] T 9be3de57a254453d9dc75680e7f27f22 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.584726 11122 raft_consensus.cc:3060] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.601859 11033 consensus_queue.cc:260] T 9be3de57a254453d9dc75680e7f27f22 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:39.612870 10838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa0ebad5bc4444a8c465b2e412524dd" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:39.600732 10804 leader_election.cc:304] T 1a1b4a3380b746d2bc977cfeff019c26 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:39.618769 10986 raft_consensus.cc:2468] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 2.
I20260709 13:01:39.619627 11186 leader_election.cc:290] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Requested vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:39.619720 11188 raft_consensus.cc:2804] T 1a1b4a3380b746d2bc977cfeff019c26 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:01:39.620137 11203 log.cc:927] Time spent T c6bb330c30de4041b86d22bf1c838e57 P b778a184b0ac46f5b86ce4fe363dcbab: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:01:39.592962 11040 raft_consensus.cc:515] T 48e63402e1544658a8d6cf5b9220414b P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:39.624215 11040 leader_election.cc:290] T 48e63402e1544658a8d6cf5b9220414b P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:39.627354 10909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e63402e1544658a8d6cf5b9220414b" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
W20260709 13:01:39.629031 10804 leader_election.cc:343] T 48e63402e1544658a8d6cf5b9220414b P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:39.629302 10761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e63402e1544658a8d6cf5b9220414b" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:39.630383 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c9e47add2e4175b68fde1a27aa92e0" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:39.631846 11193 consensus_queue.cc:1048] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:39.635020 11188 raft_consensus.cc:697] T 1a1b4a3380b746d2bc977cfeff019c26 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Becoming Leader. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Running, Role: LEADER
I20260709 13:01:39.635941 11188 consensus_queue.cc:237] T 1a1b4a3380b746d2bc977cfeff019c26 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
W20260709 13:01:39.636819 10802 leader_election.cc:343] T 48e63402e1544658a8d6cf5b9220414b P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:39.637346 10802 leader_election.cc:304] T 48e63402e1544658a8d6cf5b9220414b P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbd1fdffc68440e5b6250f6d95a4a367; no voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:39.638049 11040 raft_consensus.cc:2749] T 48e63402e1544658a8d6cf5b9220414b P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:39.599948 10877 leader_election.cc:304] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
W20260709 13:01:39.638988 10877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35051, user_credentials={real_user=slave}} blocked reactor thread for 46943.2us
I20260709 13:01:39.639094 11041 raft_consensus.cc:2804] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:39.639715 11041 raft_consensus.cc:697] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 LEADER]: Becoming Leader. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Running, Role: LEADER
W20260709 13:01:39.639901 10877 leader_election.cc:343] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:39.640700 11041 consensus_queue.cc:237] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:39.647827 11033 ts_tablet_manager.cc:1434] T 9be3de57a254453d9dc75680e7f27f22 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.263s	user 0.008s	sys 0.000s
I20260709 13:01:39.649103 10983 raft_consensus.cc:2468] T 1a1b4a3380b746d2bc977cfeff019c26 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 1.
W20260709 13:01:39.650677 10877 leader_election.cc:343] T f1c9e47add2e4175b68fde1a27aa92e0 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:39.656909 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be3de57a254453d9dc75680e7f27f22" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:39.657697 10836 raft_consensus.cc:3060] T 9be3de57a254453d9dc75680e7f27f22 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.649297 11033 tablet_bootstrap.cc:492] T 2f47768053ec47e69b367bd5a49662c3 P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:39.656380 11037 tablet_bootstrap.cc:654] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:39.661727 10876 leader_election.cc:304] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab; no voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:39.662899 11061 raft_consensus.cc:3060] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:39.665216 10908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be3de57a254453d9dc75680e7f27f22" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:39.669727 11191 raft_consensus.cc:493] T f547b171c6b9445c95475ce3be870c2e P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.670389 11191 raft_consensus.cc:515] T f547b171c6b9445c95475ce3be870c2e P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:39.670786 10657 catalog_manager.cc:5697] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:39.675881 10727 leader_election.cc:343] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:39.676498 10727 leader_election.cc:304] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0; no voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:39.677449 11100 raft_consensus.cc:2749] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:39.679677 11122 raft_consensus.cc:515] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:39.682039 11122 leader_election.cc:290] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Requested vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:39.684796 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c9e47add2e4175b68fde1a27aa92e0" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:39.696204 11032 tablet_bootstrap.cc:654] T a19edd96c26a4c91a7b2a412d8221e5b P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:39.697631 11191 leader_election.cc:290] T f547b171c6b9445c95475ce3be870c2e P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:39.699416 11193 consensus_queue.cc:1048] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:39.719265 11099 consensus_queue.cc:1048] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:39.722370 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa0ebad5bc4444a8c465b2e412524dd" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:39.723068 10985 raft_consensus.cc:3060] T 9fa0ebad5bc4444a8c465b2e412524dd P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:39.727242 10708 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:39.734328 11212 consensus_queue.cc:1048] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:01:39.737393 11212 consensus_queue.cc:1048] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:39.739794 10836 raft_consensus.cc:2468] T 9be3de57a254453d9dc75680e7f27f22 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 1.
I20260709 13:01:39.741029 11033 tablet_bootstrap.cc:654] T 2f47768053ec47e69b367bd5a49662c3 P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:39.757392 11031 tablet_bootstrap.cc:492] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:39.751367 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f547b171c6b9445c95475ce3be870c2e" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:39.763471 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f547b171c6b9445c95475ce3be870c2e" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:39.764786 10985 raft_consensus.cc:2468] T 9fa0ebad5bc4444a8c465b2e412524dd P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 1.
I20260709 13:01:39.765954 10728 leader_election.cc:304] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:39.789387 11198 raft_consensus.cc:2804] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:39.802556 11061 raft_consensus.cc:2749] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:39.807035 11189 consensus_queue.cc:1048] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:39.793243 11198 raft_consensus.cc:697] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:01:39.815375 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa0ebad5bc4444a8c465b2e412524dd" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
W20260709 13:01:39.817121 11215 log.cc:927] Time spent T 1a1b4a3380b746d2bc977cfeff019c26 P dbd1fdffc68440e5b6250f6d95a4a367: Append to log took a long time: real 0.060s	user 0.002s	sys 0.001s
I20260709 13:01:39.815106 11198 consensus_queue.cc:237] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:39.823002 11031 tablet_bootstrap.cc:654] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:39.823618 11032 tablet_bootstrap.cc:492] T a19edd96c26a4c91a7b2a412d8221e5b P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:39.824297 11032 ts_tablet_manager.cc:1403] T a19edd96c26a4c91a7b2a412d8221e5b P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.467s	user 0.020s	sys 0.009s
I20260709 13:01:39.829224 11037 tablet_bootstrap.cc:492] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:39.829762 11037 ts_tablet_manager.cc:1403] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.464s	user 0.016s	sys 0.017s
W20260709 13:01:39.811398 10876 leader_election.cc:343] T f1c9e47add2e4175b68fde1a27aa92e0 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:39.846601 11032 raft_consensus.cc:359] T a19edd96c26a4c91a7b2a412d8221e5b P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:39.847385 11032 raft_consensus.cc:385] T a19edd96c26a4c91a7b2a412d8221e5b P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.847675 11032 raft_consensus.cc:740] T a19edd96c26a4c91a7b2a412d8221e5b P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.851032 11037 raft_consensus.cc:359] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:39.851799 11037 raft_consensus.cc:385] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:39.852059 11037 raft_consensus.cc:740] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:39.853005 11032 consensus_queue.cc:260] T a19edd96c26a4c91a7b2a412d8221e5b P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:39.856001 11032 ts_tablet_manager.cc:1434] T a19edd96c26a4c91a7b2a412d8221e5b P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.001s
I20260709 13:01:39.837193 10876 leader_election.cc:304] T f1c9e47add2e4175b68fde1a27aa92e0 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab; no voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367
W20260709 13:01:39.834736 10877 leader_election.cc:343] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:39.863947 11037 consensus_queue.cc:260] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:39.866698 11037 ts_tablet_manager.cc:1434] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.002s
I20260709 13:01:39.868283 11037 tablet_bootstrap.cc:492] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:39.875759 11037 tablet_bootstrap.cc:654] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:39.881937 11032 tablet_bootstrap.cc:492] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:39.884634 11061 raft_consensus.cc:2749] T f1c9e47add2e4175b68fde1a27aa92e0 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:39.888072 11189 consensus_queue.cc:1048] T ccad89aaaf3d48008955a353eb0097b9 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:39.889845 11032 tablet_bootstrap.cc:654] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:39.904922 10908 raft_consensus.cc:2468] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 1.
W20260709 13:01:39.907208 10876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42509, user_credentials={real_user=slave}} blocked reactor thread for 97269.6us
W20260709 13:01:39.909674 10876 leader_election.cc:343] T f547b171c6b9445c95475ce3be870c2e P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:39.910735 10876 leader_election.cc:304] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:39.914206 11061 raft_consensus.cc:2804] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:39.914749 11061 raft_consensus.cc:697] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Becoming Leader. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Running, Role: LEADER
I20260709 13:01:39.915598 11061 consensus_queue.cc:237] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
W20260709 13:01:39.987339 10876 leader_election.cc:343] T f547b171c6b9445c95475ce3be870c2e P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:39.988134 10876 leader_election.cc:304] T f547b171c6b9445c95475ce3be870c2e P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab; no voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:01:39.989321 11191 raft_consensus.cc:2749] T f547b171c6b9445c95475ce3be870c2e P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:39.994791 11033 tablet_bootstrap.cc:492] T 2f47768053ec47e69b367bd5a49662c3 P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:39.995597 11033 ts_tablet_manager.cc:1403] T 2f47768053ec47e69b367bd5a49662c3 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.347s	user 0.054s	sys 0.020s
I20260709 13:01:40.000029 11033 raft_consensus.cc:359] T 2f47768053ec47e69b367bd5a49662c3 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:40.004845 11033 raft_consensus.cc:385] T 2f47768053ec47e69b367bd5a49662c3 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.005367 11033 raft_consensus.cc:740] T 2f47768053ec47e69b367bd5a49662c3 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.006527 11033 consensus_queue.cc:260] T 2f47768053ec47e69b367bd5a49662c3 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:40.009888 11033 ts_tablet_manager.cc:1434] T 2f47768053ec47e69b367bd5a49662c3 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.001s
I20260709 13:01:40.012094 11033 tablet_bootstrap.cc:492] T 9fa0ebad5bc4444a8c465b2e412524dd P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:40.015712 11031 tablet_bootstrap.cc:492] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:40.018385 11031 ts_tablet_manager.cc:1403] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.261s	user 0.030s	sys 0.045s
I20260709 13:01:40.025125 11033 tablet_bootstrap.cc:654] T 9fa0ebad5bc4444a8c465b2e412524dd P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:40.025336 11189 consensus_queue.cc:1048] T ccad89aaaf3d48008955a353eb0097b9 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:40.042171 11033 tablet_bootstrap.cc:492] T 9fa0ebad5bc4444a8c465b2e412524dd P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:40.042721 11033 ts_tablet_manager.cc:1403] T 9fa0ebad5bc4444a8c465b2e412524dd P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.007s
I20260709 13:01:40.045974 11033 raft_consensus.cc:359] T 9fa0ebad5bc4444a8c465b2e412524dd P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:40.046777 11033 raft_consensus.cc:385] T 9fa0ebad5bc4444a8c465b2e412524dd P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.047066 11033 raft_consensus.cc:740] T 9fa0ebad5bc4444a8c465b2e412524dd P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.047956 11033 consensus_queue.cc:260] T 9fa0ebad5bc4444a8c465b2e412524dd P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:40.050776 11033 ts_tablet_manager.cc:1434] T 9fa0ebad5bc4444a8c465b2e412524dd P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:01:40.052062 11033 tablet_bootstrap.cc:492] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:40.058776 11033 tablet_bootstrap.cc:654] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:40.059885 11032 tablet_bootstrap.cc:492] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:40.060423 11032 ts_tablet_manager.cc:1403] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.179s	user 0.016s	sys 0.004s
I20260709 13:01:40.015604 10658 catalog_manager.cc:5697] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab reported cstate change: term changed from 0 to 2, leader changed from <none> to b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195). New cstate: current_term: 2 leader_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:40.065376 11031 raft_consensus.cc:359] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:40.066088 11031 raft_consensus.cc:385] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.066368 11031 raft_consensus.cc:740] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.067060 11031 consensus_queue.cc:260] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
W20260709 13:01:40.067709 10876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34489, user_credentials={real_user=slave}} blocked reactor thread for 77723us
I20260709 13:01:40.068538 10836 raft_consensus.cc:3060] T 2f47768053ec47e69b367bd5a49662c3 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:40.072099 11031 ts_tablet_manager.cc:1434] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.053s	user 0.004s	sys 0.003s
I20260709 13:01:40.073370 11031 tablet_bootstrap.cc:492] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:40.076843 11032 raft_consensus.cc:359] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.080789 11032 raft_consensus.cc:385] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.081235 11032 raft_consensus.cc:740] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.082170 11031 tablet_bootstrap.cc:654] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:40.082111 11032 consensus_queue.cc:260] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.098553 11032 ts_tablet_manager.cc:1434] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:01:40.099056 11064 consensus_queue.cc:1048] T 1a1b4a3380b746d2bc977cfeff019c26 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:40.099920 11032 tablet_bootstrap.cc:492] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:40.098729 11040 consensus_queue.cc:1048] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:01:40.102777 10837 raft_consensus.cc:1275] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Refusing update from remote peer b778a184b0ac46f5b86ce4fe363dcbab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:01:40.106451 11037 tablet_bootstrap.cc:492] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:40.108963 11037 ts_tablet_manager.cc:1403] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.241s	user 0.019s	sys 0.050s
I20260709 13:01:40.117888 11037 raft_consensus.cc:359] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:40.118709 11037 raft_consensus.cc:385] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.118985 11037 raft_consensus.cc:740] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.119704 11037 consensus_queue.cc:260] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:40.108276 11033 tablet_bootstrap.cc:492] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:40.110142 11189 consensus_queue.cc:1048] T 1a1b4a3380b746d2bc977cfeff019c26 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:40.110852 11217 consensus_queue.cc:1048] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:40.113689 11032 tablet_bootstrap.cc:654] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:40.122347 11033 ts_tablet_manager.cc:1403] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.071s	user 0.015s	sys 0.013s
I20260709 13:01:40.127166 11033 raft_consensus.cc:359] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.127876 11033 raft_consensus.cc:385] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.121717 10659 catalog_manager.cc:5697] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:40.128162 11033 raft_consensus.cc:740] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.136207 11033 consensus_queue.cc:260] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.137558 10984 raft_consensus.cc:1275] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Refusing update from remote peer b778a184b0ac46f5b86ce4fe363dcbab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:01:40.139313 11041 consensus_queue.cc:1048] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:40.139969 11033 ts_tablet_manager.cc:1434] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:01:40.141115 11033 tablet_bootstrap.cc:492] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:40.132000 10659 catalog_manager.cc:5697] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:40.152261 11037 ts_tablet_manager.cc:1434] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:01:40.153478 11037 tablet_bootstrap.cc:492] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:40.162776 11037 tablet_bootstrap.cc:654] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:40.166281 11033 tablet_bootstrap.cc:654] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:40.167035 10657 catalog_manager.cc:5697] T ccad89aaaf3d48008955a353eb0097b9 P dbd1fdffc68440e5b6250f6d95a4a367 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:40.172896 10657 catalog_manager.cc:5697] T 1a1b4a3380b746d2bc977cfeff019c26 P dbd1fdffc68440e5b6250f6d95a4a367 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:40.174021 10729 consensus_peers.cc:597] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 -> Peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Couldn't send request to peer b778a184b0ac46f5b86ce4fe363dcbab. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:40.185184 11122 raft_consensus.cc:493] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.185758 11122 raft_consensus.cc:515] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:40.187907 11122 leader_election.cc:290] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:40.190325 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141934a83d874ca1bf1d69f49b95f1fc" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:40.190778 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141934a83d874ca1bf1d69f49b95f1fc" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
W20260709 13:01:40.191934 10876 leader_election.cc:343] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:40.192241 11031 tablet_bootstrap.cc:492] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:40.192775 11031 ts_tablet_manager.cc:1403] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.120s	user 0.034s	sys 0.030s
W20260709 13:01:40.192690 10877 leader_election.cc:343] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:40.193288 10877 leader_election.cc:304] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab; no voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:40.194463 11122 raft_consensus.cc:2749] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:40.197882 11031 raft_consensus.cc:359] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:40.198585 11031 raft_consensus.cc:385] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.198869 11031 raft_consensus.cc:740] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.199635 11031 consensus_queue.cc:260] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:40.202047 11031 ts_tablet_manager.cc:1434] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:01:40.208500 11031 tablet_bootstrap.cc:492] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:40.215983 11032 tablet_bootstrap.cc:492] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:40.216699 11032 ts_tablet_manager.cc:1403] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.117s	user 0.010s	sys 0.007s
I20260709 13:01:40.225616 11031 tablet_bootstrap.cc:654] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:40.231369 11032 raft_consensus.cc:359] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:40.232293 11032 raft_consensus.cc:385] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.232224 11178 raft_consensus.cc:493] T a19edd96c26a4c91a7b2a412d8221e5b P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.232834 11032 raft_consensus.cc:740] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.233027 11178 raft_consensus.cc:515] T a19edd96c26a4c91a7b2a412d8221e5b P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:40.233615 11032 consensus_queue.cc:260] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:40.235456 11032 ts_tablet_manager.cc:1434] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:01:40.237337 11032 tablet_bootstrap.cc:492] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:40.239120 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a19edd96c26a4c91a7b2a412d8221e5b" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
W20260709 13:01:40.241163 10952 leader_election.cc:343] T a19edd96c26a4c91a7b2a412d8221e5b P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:40.242285 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a19edd96c26a4c91a7b2a412d8221e5b" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:40.242865 11198 consensus_queue.cc:1048] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:40.243570 11032 tablet_bootstrap.cc:654] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:40.244017 10950 leader_election.cc:343] T a19edd96c26a4c91a7b2a412d8221e5b P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:40.244519 10950 leader_election.cc:304] T a19edd96c26a4c91a7b2a412d8221e5b P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f; no voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:40.245361 11096 raft_consensus.cc:2749] T a19edd96c26a4c91a7b2a412d8221e5b P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:40.246438 11178 leader_election.cc:290] T a19edd96c26a4c91a7b2a412d8221e5b P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:40.252465 11031 tablet_bootstrap.cc:492] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:40.253000 11032 tablet_bootstrap.cc:492] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:40.253072 11031 ts_tablet_manager.cc:1403] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.004s
I20260709 13:01:40.253762 11032 ts_tablet_manager.cc:1403] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.017s	user 0.005s	sys 0.006s
I20260709 13:01:40.256615 11033 tablet_bootstrap.cc:492] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:40.257133 11033 ts_tablet_manager.cc:1403] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.116s	user 0.012s	sys 0.020s
I20260709 13:01:40.257187 11032 raft_consensus.cc:359] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.258038 11032 raft_consensus.cc:385] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.258374 11032 raft_consensus.cc:740] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.259178 11032 consensus_queue.cc:260] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.259809 11033 raft_consensus.cc:359] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:40.260828 11031 raft_consensus.cc:359] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:40.264173 11033 raft_consensus.cc:385] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.261651 11032 ts_tablet_manager.cc:1434] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:01:40.264403 11031 raft_consensus.cc:385] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.264536 11033 raft_consensus.cc:740] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.264955 11031 raft_consensus.cc:740] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.265437 11033 consensus_queue.cc:260] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:40.266364 11032 tablet_bootstrap.cc:492] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:40.267611 11033 ts_tablet_manager.cc:1434] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:01:40.271988 11031 consensus_queue.cc:260] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:40.263383 11037 tablet_bootstrap.cc:492] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:40.273398 11037 ts_tablet_manager.cc:1403] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.120s	user 0.010s	sys 0.022s
I20260709 13:01:40.275352 11032 tablet_bootstrap.cc:654] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:40.276810 11031 ts_tablet_manager.cc:1434] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:01:40.278096 11031 tablet_bootstrap.cc:492] T 3aa37ce6306b47f0b7ead1fda7590834 P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:40.272871 11033 tablet_bootstrap.cc:492] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:40.278934 10658 catalog_manager.cc:5697] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab reported cstate change: term changed from 0 to 1, leader changed from <none> to b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:40.285058 11031 tablet_bootstrap.cc:654] T 3aa37ce6306b47f0b7ead1fda7590834 P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:40.288240 11033 tablet_bootstrap.cc:654] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:40.333041 11037 raft_consensus.cc:359] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:40.334146 11037 raft_consensus.cc:385] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.334810 11037 raft_consensus.cc:740] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.335752 11037 consensus_queue.cc:260] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:40.339160 11037 ts_tablet_manager.cc:1434] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.001s
I20260709 13:01:40.339541 11040 raft_consensus.cc:493] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.369097 11040 raft_consensus.cc:515] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.371398 11040 leader_election.cc:290] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:40.342411 11189 raft_consensus.cc:493] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.372109 11189 raft_consensus.cc:515] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:40.374370 11189 leader_election.cc:290] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:40.375564 11037 tablet_bootstrap.cc:492] T a19edd96c26a4c91a7b2a412d8221e5b P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:40.349447 11193 raft_consensus.cc:493] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.376677 11193 raft_consensus.cc:515] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.377303 11100 raft_consensus.cc:493] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.377858 11100 raft_consensus.cc:515] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:40.379187 11193 leader_election.cc:290] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:40.350060 11198 consensus_queue.cc:1048] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:40.379838 11100 leader_election.cc:290] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:40.380716 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e976ba764734878bb65c5db5e908f56" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:40.365571 11178 raft_consensus.cc:493] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.381397 10762 raft_consensus.cc:2468] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 0.
I20260709 13:01:40.381520 11178 raft_consensus.cc:515] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:40.382493 10761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa37ce6306b47f0b7ead1fda7590834" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:40.383165 10761 raft_consensus.cc:2468] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 0.
I20260709 13:01:40.384020 11178 leader_election.cc:290] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:40.384816 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f547b171c6b9445c95475ce3be870c2e" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:40.385303 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e976ba764734878bb65c5db5e908f56" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:40.385474 10910 raft_consensus.cc:2468] T f547b171c6b9445c95475ce3be870c2e P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 0.
I20260709 13:01:40.385989 10986 raft_consensus.cc:2468] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 0.
I20260709 13:01:40.348148 11251 raft_consensus.cc:493] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.387187 11251 raft_consensus.cc:515] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.388441 11037 tablet_bootstrap.cc:654] T a19edd96c26a4c91a7b2a412d8221e5b P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:40.376022 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e976ba764734878bb65c5db5e908f56" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:40.390103 10984 raft_consensus.cc:2468] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 0.
I20260709 13:01:40.390202 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa37ce6306b47f0b7ead1fda7590834" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
W20260709 13:01:40.391738 10729 leader_election.cc:343] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:40.392868 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c403148f1f724c0ca12919d8e85ae572" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
W20260709 13:01:40.394383 10951 leader_election.cc:343] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:40.389721 10952 leader_election.cc:304] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:40.396607 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c403148f1f724c0ca12919d8e85ae572" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:40.396610 11031 tablet_bootstrap.cc:492] T 3aa37ce6306b47f0b7ead1fda7590834 P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:40.397328 10762 raft_consensus.cc:2468] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 0.
I20260709 13:01:40.397760 10802 leader_election.cc:304] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:40.398787 10950 leader_election.cc:304] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f; no voters: dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:40.399463 10802 leader_election.cc:304] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:40.399832 11096 raft_consensus.cc:2804] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:40.400403 11096 raft_consensus.cc:493] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.394625 10727 leader_election.cc:304] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f; no voters: 
I20260709 13:01:40.400902 11096 raft_consensus.cc:3060] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:40.397204 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa37ce6306b47f0b7ead1fda7590834" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:40.402487 11031 ts_tablet_manager.cc:1403] T 3aa37ce6306b47f0b7ead1fda7590834 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.125s	user 0.044s	sys 0.029s
I20260709 13:01:40.402707 10837 raft_consensus.cc:2468] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 0.
I20260709 13:01:40.404088 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e976ba764734878bb65c5db5e908f56" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:40.404877 10836 raft_consensus.cc:2468] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 0.
I20260709 13:01:40.405316 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa37ce6306b47f0b7ead1fda7590834" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:40.401928 11198 raft_consensus.cc:2804] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:40.406461 11198 raft_consensus.cc:493] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.406698 11178 raft_consensus.cc:2804] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:40.407125 11178 raft_consensus.cc:493] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.406817 11198 raft_consensus.cc:3060] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:40.407495 11178 raft_consensus.cc:3060] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:40.409258 11031 raft_consensus.cc:359] T 3aa37ce6306b47f0b7ead1fda7590834 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:40.410022 11031 raft_consensus.cc:385] T 3aa37ce6306b47f0b7ead1fda7590834 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.410295 11031 raft_consensus.cc:740] T 3aa37ce6306b47f0b7ead1fda7590834 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.417011 10728 leader_election.cc:304] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367; no voters: b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:40.417830 11099 raft_consensus.cc:493] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.418300 11099 raft_consensus.cc:515] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:40.411092 11031 consensus_queue.cc:260] T 3aa37ce6306b47f0b7ead1fda7590834 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:40.422196 11193 raft_consensus.cc:2804] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:40.422745 11193 raft_consensus.cc:493] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.423128 11193 raft_consensus.cc:3060] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:40.407321 10761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f547b171c6b9445c95475ce3be870c2e" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:40.426321 11031 ts_tablet_manager.cc:1434] T 3aa37ce6306b47f0b7ead1fda7590834 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.003s
I20260709 13:01:40.427587 11031 tablet_bootstrap.cc:492] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
W20260709 13:01:40.426906 10804 leader_election.cc:343] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:40.389572 11251 leader_election.cc:290] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:40.432245 11189 raft_consensus.cc:2804] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:40.432850 11189 raft_consensus.cc:493] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.433233 11189 raft_consensus.cc:3060] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:40.436542 11040 raft_consensus.cc:2804] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:40.437135 11040 raft_consensus.cc:493] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.437493 11040 raft_consensus.cc:3060] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:40.439679 11178 raft_consensus.cc:515] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
W20260709 13:01:40.441542 10950 leader_election.cc:343] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:40.441974 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141934a83d874ca1bf1d69f49b95f1fc" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:40.462894 11193 raft_consensus.cc:515] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
W20260709 13:01:40.463938 10728 leader_election.cc:343] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:40.442382 11096 raft_consensus.cc:515] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:40.444630 11099 leader_election.cc:290] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:40.445781 10837 raft_consensus.cc:3060] T 9fa0ebad5bc4444a8c465b2e412524dd P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:40.447184 10908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141934a83d874ca1bf1d69f49b95f1fc" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:40.466965 11096 leader_election.cc:290] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Requested vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:40.447703 11032 tablet_bootstrap.cc:492] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:40.450240 11122 raft_consensus.cc:493] T 3aa37ce6306b47f0b7ead1fda7590834 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.467052 11041 consensus_queue.cc:1048] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:40.452705 11100 consensus_queue.cc:1048] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:40.467747 11122 raft_consensus.cc:515] T 3aa37ce6306b47f0b7ead1fda7590834 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:40.468617 10761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f547b171c6b9445c95475ce3be870c2e" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:40.467141 10908 raft_consensus.cc:2468] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 0.
I20260709 13:01:40.469949 11122 leader_election.cc:290] T 3aa37ce6306b47f0b7ead1fda7590834 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
W20260709 13:01:40.470234 10950 leader_election.cc:343] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:40.471225 10729 leader_election.cc:304] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:40.467355 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f547b171c6b9445c95475ce3be870c2e" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:40.472065 11100 raft_consensus.cc:2804] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:40.471959 10910 raft_consensus.cc:3060] T f547b171c6b9445c95475ce3be870c2e P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:40.472463 11100 raft_consensus.cc:493] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.472870 11100 raft_consensus.cc:3060] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:40.452864 11031 tablet_bootstrap.cc:654] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:40.477722 11032 ts_tablet_manager.cc:1403] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.212s	user 0.056s	sys 0.052s
I20260709 13:01:40.478823 10838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa37ce6306b47f0b7ead1fda7590834" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:40.482872 11122 consensus_queue.cc:1048] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:40.484293 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c403148f1f724c0ca12919d8e85ae572" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:40.485091 10762 raft_consensus.cc:3060] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:40.477780 10761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa37ce6306b47f0b7ead1fda7590834" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:40.491979 10761 raft_consensus.cc:2393] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b778a184b0ac46f5b86ce4fe363dcbab in current term 1: Already voted for candidate 346158a6aa6747c1b8d31b4fb80238d0 in this term.
I20260709 13:01:40.415844 11198 raft_consensus.cc:515] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.493602 10910 raft_consensus.cc:2468] T f547b171c6b9445c95475ce3be870c2e P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 1.
I20260709 13:01:40.495035 11198 leader_election.cc:290] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Requested vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:40.496342 10835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e976ba764734878bb65c5db5e908f56" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:40.497114 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e976ba764734878bb65c5db5e908f56" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:40.497788 10984 raft_consensus.cc:3060] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:40.498530 11032 raft_consensus.cc:359] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.499289 11032 raft_consensus.cc:385] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.499564 11032 raft_consensus.cc:740] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.501395 11037 tablet_bootstrap.cc:492] T a19edd96c26a4c91a7b2a412d8221e5b P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:40.503232 10834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c403148f1f724c0ca12919d8e85ae572" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:40.503870 10952 leader_election.cc:304] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 346158a6aa6747c1b8d31b4fb80238d0
I20260709 13:01:40.504769 11178 leader_election.cc:290] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Requested vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:40.507467 11178 raft_consensus.cc:2804] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:40.508613 11100 raft_consensus.cc:515] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
W20260709 13:01:40.505380 10951 leader_election.cc:343] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:40.516855 10762 raft_consensus.cc:2468] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 1.
I20260709 13:01:40.466157 11033 tablet_bootstrap.cc:492] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:40.517908 11033 ts_tablet_manager.cc:1403] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.249s	user 0.040s	sys 0.040s
I20260709 13:01:40.523556 11100 leader_election.cc:290] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Requested vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:40.525123 10909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141934a83d874ca1bf1d69f49b95f1fc" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:40.525866 10909 raft_consensus.cc:3060] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:40.528716 11040 raft_consensus.cc:515] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:40.528896 11032 consensus_queue.cc:260] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.529510 10950 leader_election.cc:304] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f; no voters: dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:40.532842 10838 raft_consensus.cc:2393] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b778a184b0ac46f5b86ce4fe363dcbab in current term 1: Already voted for candidate dbd1fdffc68440e5b6250f6d95a4a367 in this term.
I20260709 13:01:40.536069 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa37ce6306b47f0b7ead1fda7590834" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:40.562441 11096 raft_consensus.cc:2804] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:40.562878 10762 raft_consensus.cc:2393] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dbd1fdffc68440e5b6250f6d95a4a367 in current term 1: Already voted for candidate 346158a6aa6747c1b8d31b4fb80238d0 in this term.
I20260709 13:01:40.512210 10984 raft_consensus.cc:2468] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 1.
I20260709 13:01:40.537542 11189 raft_consensus.cc:515] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.562999 11096 raft_consensus.cc:697] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Becoming Leader. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
I20260709 13:01:40.563961 11096 consensus_queue.cc:237] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.564812 11189 leader_election.cc:290] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Requested vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:40.536345 10909 raft_consensus.cc:2468] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 1.
I20260709 13:01:40.543560 10908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa37ce6306b47f0b7ead1fda7590834" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:40.566675 10877 leader_election.cc:304] T 3aa37ce6306b47f0b7ead1fda7590834 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab; no voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:40.568874 10729 leader_election.cc:304] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:40.569542 10835 raft_consensus.cc:2393] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 346158a6aa6747c1b8d31b4fb80238d0 in current term 1: Already voted for candidate dbd1fdffc68440e5b6250f6d95a4a367 in this term.
I20260709 13:01:40.571370 11261 raft_consensus.cc:2804] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:40.567204 10908 raft_consensus.cc:3060] T 3aa37ce6306b47f0b7ead1fda7590834 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:40.568776 11037 ts_tablet_manager.cc:1403] T a19edd96c26a4c91a7b2a412d8221e5b P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.194s	user 0.033s	sys 0.026s
I20260709 13:01:40.571388 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e976ba764734878bb65c5db5e908f56" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:40.578217 10762 raft_consensus.cc:2393] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dbd1fdffc68440e5b6250f6d95a4a367 in current term 1: Already voted for candidate 346158a6aa6747c1b8d31b4fb80238d0 in this term.
I20260709 13:01:40.572187 11261 raft_consensus.cc:697] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:01:40.580909 11261 consensus_queue.cc:237] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:40.541147 11193 leader_election.cc:290] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Requested vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:40.521112 11033 raft_consensus.cc:359] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:40.554688 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa37ce6306b47f0b7ead1fda7590834" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:40.555241 10834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa37ce6306b47f0b7ead1fda7590834" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:40.556061 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141934a83d874ca1bf1d69f49b95f1fc" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:40.587814 10834 raft_consensus.cc:2393] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 346158a6aa6747c1b8d31b4fb80238d0 in current term 1: Already voted for candidate dbd1fdffc68440e5b6250f6d95a4a367 in this term.
I20260709 13:01:40.588730 11033 raft_consensus.cc:385] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.589104 11033 raft_consensus.cc:740] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.590126 11033 consensus_queue.cc:260] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:40.591203 11037 raft_consensus.cc:359] T a19edd96c26a4c91a7b2a412d8221e5b P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:40.564313 10727 leader_election.cc:304] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f; no voters: 
I20260709 13:01:40.544231 11040 leader_election.cc:290] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Requested vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:40.593326 11033 ts_tablet_manager.cc:1434] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.075s	user 0.005s	sys 0.003s
I20260709 13:01:40.600589 11193 raft_consensus.cc:2804] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:40.601387 11193 raft_consensus.cc:697] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:01:40.602434 11193 consensus_queue.cc:237] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.599493 11037 raft_consensus.cc:385] T a19edd96c26a4c91a7b2a412d8221e5b P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.604838 11037 raft_consensus.cc:740] T a19edd96c26a4c91a7b2a412d8221e5b P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.556738 11178 raft_consensus.cc:697] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Becoming Leader. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
I20260709 13:01:40.610008 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e976ba764734878bb65c5db5e908f56" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:40.614420 11033 tablet_bootstrap.cc:492] T c403148f1f724c0ca12919d8e85ae572 P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:40.614243 11037 consensus_queue.cc:260] T a19edd96c26a4c91a7b2a412d8221e5b P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:40.623172 10986 raft_consensus.cc:2393] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dbd1fdffc68440e5b6250f6d95a4a367 in current term 1: Already voted for candidate 346158a6aa6747c1b8d31b4fb80238d0 in this term.
I20260709 13:01:40.623675 11041 raft_consensus.cc:493] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.624238 11041 raft_consensus.cc:515] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:40.623193 11268 raft_consensus.cc:493] T 9fa0ebad5bc4444a8c465b2e412524dd P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b778a184b0ac46f5b86ce4fe363dcbab)
I20260709 13:01:40.626030 11268 raft_consensus.cc:515] T 9fa0ebad5bc4444a8c465b2e412524dd P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
W20260709 13:01:40.627897 10728 leader_election.cc:343] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:40.629876 11037 ts_tablet_manager.cc:1434] T a19edd96c26a4c91a7b2a412d8221e5b P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.001s
I20260709 13:01:40.633442 10804 leader_election.cc:304] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbd1fdffc68440e5b6250f6d95a4a367; no voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:40.630900 11122 raft_consensus.cc:493] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.637082 11032 ts_tablet_manager.cc:1434] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.159s	user 0.009s	sys 0.001s
I20260709 13:01:40.640123 11033 tablet_bootstrap.cc:654] T c403148f1f724c0ca12919d8e85ae572 P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:40.640681 11037 tablet_bootstrap.cc:492] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:40.642822 11032 tablet_bootstrap.cc:492] T a8b5a22ddad942d7b4db2b897e159337 P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:40.643149 11122 raft_consensus.cc:515] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:40.637307 11268 leader_election.cc:290] T 9fa0ebad5bc4444a8c465b2e412524dd P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:40.637470 11041 leader_election.cc:290] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:40.647555 11122 leader_election.cc:290] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:40.647606 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a19edd96c26a4c91a7b2a412d8221e5b" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:40.648509 10762 raft_consensus.cc:2468] T a19edd96c26a4c91a7b2a412d8221e5b P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 0.
I20260709 13:01:40.649865 11268 raft_consensus.cc:2749] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:40.650553 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e63402e1544658a8d6cf5b9220414b" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:40.651774 10876 leader_election.cc:304] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:40.654649 11122 raft_consensus.cc:2804] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:40.655215 11122 raft_consensus.cc:493] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.637885 10908 raft_consensus.cc:2468] T 3aa37ce6306b47f0b7ead1fda7590834 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 1.
I20260709 13:01:40.648618 10802 leader_election.cc:304] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbd1fdffc68440e5b6250f6d95a4a367; no voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:01:40.655611 11122 raft_consensus.cc:3060] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:40.656610 11040 raft_consensus.cc:2749] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:40.656818 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a19edd96c26a4c91a7b2a412d8221e5b" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:40.658231 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa0ebad5bc4444a8c465b2e412524dd" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:40.631577 11178 consensus_queue.cc:237] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:40.655544 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa0ebad5bc4444a8c465b2e412524dd" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:40.659291 11061 raft_consensus.cc:2749] T 3aa37ce6306b47f0b7ead1fda7590834 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:40.657560 10986 raft_consensus.cc:2468] T a19edd96c26a4c91a7b2a412d8221e5b P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 0.
I20260709 13:01:40.660907 10729 leader_election.cc:304] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:40.663465 11261 raft_consensus.cc:2804] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:40.664268 11261 raft_consensus.cc:697] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:01:40.665503 11031 tablet_bootstrap.cc:492] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
W20260709 13:01:40.664754 10876 leader_election.cc:343] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:40.669809 11037 tablet_bootstrap.cc:654] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:40.666543 10804 leader_election.cc:304] T 9fa0ebad5bc4444a8c465b2e412524dd P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbd1fdffc68440e5b6250f6d95a4a367; no voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:40.666034 11031 ts_tablet_manager.cc:1403] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.239s	user 0.018s	sys 0.010s
I20260709 13:01:40.677316 11033 tablet_bootstrap.cc:492] T c403148f1f724c0ca12919d8e85ae572 P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:40.681063 11033 ts_tablet_manager.cc:1403] T c403148f1f724c0ca12919d8e85ae572 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.070s	user 0.017s	sys 0.003s
I20260709 13:01:40.681543 11268 raft_consensus.cc:2749] T 9fa0ebad5bc4444a8c465b2e412524dd P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:40.685120 11031 raft_consensus.cc:359] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:40.686098 11031 raft_consensus.cc:385] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.686473 11031 raft_consensus.cc:740] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.687263 11031 consensus_queue.cc:260] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:40.665699 11261 consensus_queue.cc:237] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:40.692341 11031 ts_tablet_manager.cc:1434] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.003s
I20260709 13:01:40.698721 11122 raft_consensus.cc:515] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:40.701046 11122 leader_election.cc:290] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Requested vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:40.702101 11032 tablet_bootstrap.cc:654] T a8b5a22ddad942d7b4db2b897e159337 P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:40.672446 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e63402e1544658a8d6cf5b9220414b" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:40.713514 10837 raft_consensus.cc:2468] T 48e63402e1544658a8d6cf5b9220414b P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 0.
I20260709 13:01:40.714838 10877 leader_election.cc:304] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 346158a6aa6747c1b8d31b4fb80238d0
I20260709 13:01:40.725374 11037 tablet_bootstrap.cc:492] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:40.725929 11037 ts_tablet_manager.cc:1403] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.089s	user 0.020s	sys 0.022s
I20260709 13:01:40.725915 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a19edd96c26a4c91a7b2a412d8221e5b" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:40.726713 10986 raft_consensus.cc:3060] T a19edd96c26a4c91a7b2a412d8221e5b P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:40.721509 11122 raft_consensus.cc:2804] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:40.728988 11122 raft_consensus.cc:493] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.729406 11122 raft_consensus.cc:3060] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:40.729126 11037 raft_consensus.cc:359] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.730396 11037 raft_consensus.cc:385] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.730665 11037 raft_consensus.cc:740] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.732826 11037 consensus_queue.cc:260] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.733974 10986 raft_consensus.cc:2468] T a19edd96c26a4c91a7b2a412d8221e5b P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 1.
I20260709 13:01:40.734699 10657 catalog_manager.cc:5697] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196). New cstate: current_term: 1 leader_uuid: "5e62c52a41f7476a908dd377c1a8a79f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:40.736166 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a19edd96c26a4c91a7b2a412d8221e5b" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:40.736428 11037 ts_tablet_manager.cc:1434] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:01:40.736825 10762 raft_consensus.cc:3060] T a19edd96c26a4c91a7b2a412d8221e5b P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:40.737648 11037 tablet_bootstrap.cc:492] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:40.738391 11122 raft_consensus.cc:515] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:40.741763 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e63402e1544658a8d6cf5b9220414b" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:40.742441 10837 raft_consensus.cc:3060] T 48e63402e1544658a8d6cf5b9220414b P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:40.750028 11031 tablet_bootstrap.cc:492] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:40.749177 11122 leader_election.cc:290] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Requested vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:40.756340 10762 raft_consensus.cc:2468] T a19edd96c26a4c91a7b2a412d8221e5b P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 1.
I20260709 13:01:40.758760 10657 catalog_manager.cc:5697] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196). New cstate: current_term: 1 leader_uuid: "5e62c52a41f7476a908dd377c1a8a79f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:40.761965 11033 raft_consensus.cc:359] T c403148f1f724c0ca12919d8e85ae572 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.762712 11033 raft_consensus.cc:385] T c403148f1f724c0ca12919d8e85ae572 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.762977 11033 raft_consensus.cc:740] T c403148f1f724c0ca12919d8e85ae572 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.763693 11033 consensus_queue.cc:260] T c403148f1f724c0ca12919d8e85ae572 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.764771 11031 tablet_bootstrap.cc:654] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:40.765573 10761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e63402e1544658a8d6cf5b9220414b" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:40.765616 10876 leader_election.cc:304] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:40.767532 11041 raft_consensus.cc:2804] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:40.768002 11041 raft_consensus.cc:697] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Becoming Leader. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Running, Role: LEADER
I20260709 13:01:40.769543 10837 raft_consensus.cc:2468] T 48e63402e1544658a8d6cf5b9220414b P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 1.
I20260709 13:01:40.770257 10661 catalog_manager.cc:5697] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:40.770514 11041 consensus_queue.cc:237] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:40.773494 11037 tablet_bootstrap.cc:654] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:40.777359 11033 ts_tablet_manager.cc:1434] T c403148f1f724c0ca12919d8e85ae572 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.096s	user 0.007s	sys 0.000s
W20260709 13:01:40.778029 10876 leader_election.cc:343] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:40.778530 11033 tablet_bootstrap.cc:492] T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:40.779312 10877 leader_election.cc:304] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 346158a6aa6747c1b8d31b4fb80238d0
I20260709 13:01:40.780148 11041 raft_consensus.cc:2804] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:40.780912 11041 raft_consensus.cc:697] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Becoming Leader. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Running, Role: LEADER
I20260709 13:01:40.781770 11041 consensus_queue.cc:237] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:40.771972 10661 catalog_manager.cc:5697] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:40.788937 11032 tablet_bootstrap.cc:492] T a8b5a22ddad942d7b4db2b897e159337 P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:40.789526 11032 ts_tablet_manager.cc:1403] T a8b5a22ddad942d7b4db2b897e159337 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.147s	user 0.012s	sys 0.002s
I20260709 13:01:40.790999 11033 tablet_bootstrap.cc:654] T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:40.793483 11261 raft_consensus.cc:493] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.794039 11261 raft_consensus.cc:515] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.797672 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd1014df7b2b4d2d80864646b5e5df5e" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:40.799111 11037 tablet_bootstrap.cc:492] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
W20260709 13:01:40.799389 10728 leader_election.cc:343] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:40.799624 11037 ts_tablet_manager.cc:1403] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.062s	user 0.006s	sys 0.007s
W20260709 13:01:40.800838 10708 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:40.803006 11037 raft_consensus.cc:359] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:40.803731 11037 raft_consensus.cc:385] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.804028 11037 raft_consensus.cc:740] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.796232 11261 leader_election.cc:290] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:40.804713 11037 consensus_queue.cc:260] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:40.805882 11032 raft_consensus.cc:359] T a8b5a22ddad942d7b4db2b897e159337 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.806483 11032 raft_consensus.cc:385] T a8b5a22ddad942d7b4db2b897e159337 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.806738 11032 raft_consensus.cc:740] T a8b5a22ddad942d7b4db2b897e159337 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.807857 11037 ts_tablet_manager.cc:1434] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:01:40.808394 11033 tablet_bootstrap.cc:492] T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:40.808954 11037 tablet_bootstrap.cc:492] T b5a791a0126444ba90c1fb442e1b809b P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:40.809432 11032 consensus_queue.cc:260] T a8b5a22ddad942d7b4db2b897e159337 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.814275 10658 catalog_manager.cc:5697] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:40.815390 11037 tablet_bootstrap.cc:654] T b5a791a0126444ba90c1fb442e1b809b P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:40.808986 11033 ts_tablet_manager.cc:1403] T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.000s
I20260709 13:01:40.819828 11033 raft_consensus.cc:359] T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:40.820533 11033 raft_consensus.cc:385] T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.820814 11033 raft_consensus.cc:740] T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.821426 11033 consensus_queue.cc:260] T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:40.823251 11032 ts_tablet_manager.cc:1434] T a8b5a22ddad942d7b4db2b897e159337 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.003s
I20260709 13:01:40.823652 11033 ts_tablet_manager.cc:1434] T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:01:40.824437 11032 tablet_bootstrap.cc:492] T f1c9e47add2e4175b68fde1a27aa92e0 P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:40.815138 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd1014df7b2b4d2d80864646b5e5df5e" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:40.824771 11033 tablet_bootstrap.cc:492] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
W20260709 13:01:40.826318 10727 leader_election.cc:343] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:40.826834 10727 leader_election.cc:304] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0; no voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:40.828528 11100 raft_consensus.cc:2749] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:40.838660 11033 tablet_bootstrap.cc:654] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:40.844195 11032 tablet_bootstrap.cc:654] T f1c9e47add2e4175b68fde1a27aa92e0 P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:40.849314 11031 tablet_bootstrap.cc:492] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:40.849872 11031 ts_tablet_manager.cc:1403] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.102s	user 0.007s	sys 0.005s
I20260709 13:01:40.855050 11032 tablet_bootstrap.cc:492] T f1c9e47add2e4175b68fde1a27aa92e0 P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:40.855655 11032 ts_tablet_manager.cc:1403] T f1c9e47add2e4175b68fde1a27aa92e0 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.004s
I20260709 13:01:40.849638 10659 catalog_manager.cc:5697] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab reported cstate change: term changed from 0 to 1, leader changed from <none> to b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:40.857638 11033 tablet_bootstrap.cc:492] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:40.858144 11033 ts_tablet_manager.cc:1403] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.000s
I20260709 13:01:40.858373 11032 raft_consensus.cc:359] T f1c9e47add2e4175b68fde1a27aa92e0 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:40.859048 11032 raft_consensus.cc:385] T f1c9e47add2e4175b68fde1a27aa92e0 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.859323 11032 raft_consensus.cc:740] T f1c9e47add2e4175b68fde1a27aa92e0 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.858106 10659 catalog_manager.cc:5697] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab reported cstate change: term changed from 0 to 1, leader changed from <none> to b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:40.851516 11037 tablet_bootstrap.cc:492] T b5a791a0126444ba90c1fb442e1b809b P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:40.860258 11037 ts_tablet_manager.cc:1403] T b5a791a0126444ba90c1fb442e1b809b P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.005s
I20260709 13:01:40.861006 11033 raft_consensus.cc:359] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.861716 11033 raft_consensus.cc:385] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.862003 11033 raft_consensus.cc:740] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.861402 11031 raft_consensus.cc:359] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:40.862190 11032 consensus_queue.cc:260] T f1c9e47add2e4175b68fde1a27aa92e0 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:40.862924 11037 raft_consensus.cc:359] T b5a791a0126444ba90c1fb442e1b809b P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.862880 11033 consensus_queue.cc:260] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.863703 11037 raft_consensus.cc:385] T b5a791a0126444ba90c1fb442e1b809b P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.864039 11037 raft_consensus.cc:740] T b5a791a0126444ba90c1fb442e1b809b P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.864326 11032 ts_tablet_manager.cc:1434] T f1c9e47add2e4175b68fde1a27aa92e0 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.001s
I20260709 13:01:40.864683 11037 consensus_queue.cc:260] T b5a791a0126444ba90c1fb442e1b809b P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.866876 11037 ts_tablet_manager.cc:1434] T b5a791a0126444ba90c1fb442e1b809b P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:01:40.868557 11032 tablet_bootstrap.cc:492] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:40.875116 11032 tablet_bootstrap.cc:654] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:40.876830 11033 ts_tablet_manager.cc:1434] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:01:40.878103 11033 tablet_bootstrap.cc:492] T e187848edaa746928d647a830da8c970 P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:40.863054 11031 raft_consensus.cc:385] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.879478 11031 raft_consensus.cc:740] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.880264 11031 consensus_queue.cc:260] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:40.882963 11031 ts_tablet_manager.cc:1434] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 13:01:40.870798 11037 tablet_bootstrap.cc:492] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:40.892354 11037 tablet_bootstrap.cc:654] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:40.895527 11031 tablet_bootstrap.cc:492] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:40.898331 11032 tablet_bootstrap.cc:492] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:40.898898 11032 ts_tablet_manager.cc:1403] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.012s
I20260709 13:01:40.901598 11031 tablet_bootstrap.cc:654] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:40.901902 11033 tablet_bootstrap.cc:654] T e187848edaa746928d647a830da8c970 P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:40.901937 11032 raft_consensus.cc:359] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.902900 11032 raft_consensus.cc:385] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.903220 11032 raft_consensus.cc:740] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.903438 11037 tablet_bootstrap.cc:492] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:40.903983 11037 ts_tablet_manager.cc:1403] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:01:40.905395 11178 raft_consensus.cc:493] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.905874 11178 raft_consensus.cc:515] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.906875 11037 raft_consensus.cc:359] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:40.908031 11178 leader_election.cc:290] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:40.908850 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a791a0126444ba90c1fb442e1b809b" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:40.909472 10762 raft_consensus.cc:2468] T b5a791a0126444ba90c1fb442e1b809b P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 0.
I20260709 13:01:40.909953 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a791a0126444ba90c1fb442e1b809b" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:40.910863 10950 leader_election.cc:304] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f; no voters: 
W20260709 13:01:40.912077 10951 leader_election.cc:343] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:40.904250 11032 consensus_queue.cc:260] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.913005 11272 raft_consensus.cc:2804] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:40.913398 11272 raft_consensus.cc:493] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.913698 11272 raft_consensus.cc:3060] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:40.914016 11032 ts_tablet_manager.cc:1434] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.001s
I20260709 13:01:40.915192 11032 tablet_bootstrap.cc:492] T e187848edaa746928d647a830da8c970 P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:40.915570 11033 tablet_bootstrap.cc:492] T e187848edaa746928d647a830da8c970 P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:40.916105 11033 ts_tablet_manager.cc:1403] T e187848edaa746928d647a830da8c970 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.004s
I20260709 13:01:40.913803 11031 tablet_bootstrap.cc:492] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:40.919757 11031 ts_tablet_manager.cc:1403] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.003s
I20260709 13:01:40.920821 11189 raft_consensus.cc:493] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.921298 11032 tablet_bootstrap.cc:654] T e187848edaa746928d647a830da8c970 P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:40.907519 11037 raft_consensus.cc:385] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.922068 11037 raft_consensus.cc:740] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.921375 11189 raft_consensus.cc:515] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:40.922890 11037 consensus_queue.cc:260] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:40.923306 11031 raft_consensus.cc:359] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:40.924055 11031 raft_consensus.cc:385] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.924376 11031 raft_consensus.cc:740] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.925544 11037 ts_tablet_manager.cc:1434] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 13:01:40.918946 11033 raft_consensus.cc:359] T e187848edaa746928d647a830da8c970 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:40.926069 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c9e47add2e4175b68fde1a27aa92e0" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:40.926447 11033 raft_consensus.cc:385] T e187848edaa746928d647a830da8c970 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.926810 11033 raft_consensus.cc:740] T e187848edaa746928d647a830da8c970 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.926913 11037 tablet_bootstrap.cc:492] T a8b5a22ddad942d7b4db2b897e159337 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:40.927613 11033 consensus_queue.cc:260] T e187848edaa746928d647a830da8c970 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:40.925191 11031 consensus_queue.cc:260] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:40.933032 11037 tablet_bootstrap.cc:654] T a8b5a22ddad942d7b4db2b897e159337 P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:40.934064 11031 ts_tablet_manager.cc:1434] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:01:40.935467 11031 tablet_bootstrap.cc:492] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:40.924381 11189 leader_election.cc:290] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:40.936915 10985 raft_consensus.cc:2468] T f1c9e47add2e4175b68fde1a27aa92e0 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 0.
I20260709 13:01:40.947405 11037 tablet_bootstrap.cc:492] T a8b5a22ddad942d7b4db2b897e159337 P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:40.947990 11037 ts_tablet_manager.cc:1403] T a8b5a22ddad942d7b4db2b897e159337 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.003s
I20260709 13:01:40.948992 11061 raft_consensus.cc:493] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.949563 11061 raft_consensus.cc:515] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:40.951193 11037 raft_consensus.cc:359] T a8b5a22ddad942d7b4db2b897e159337 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.951745 11061 leader_election.cc:290] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:40.952013 11037 raft_consensus.cc:385] T a8b5a22ddad942d7b4db2b897e159337 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.952399 11037 raft_consensus.cc:740] T a8b5a22ddad942d7b4db2b897e159337 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.953274 11037 consensus_queue.cc:260] T a8b5a22ddad942d7b4db2b897e159337 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.953608 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c9e47add2e4175b68fde1a27aa92e0" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:40.954349 10912 raft_consensus.cc:2468] T f1c9e47add2e4175b68fde1a27aa92e0 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 0.
I20260709 13:01:40.954933 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e187848edaa746928d647a830da8c970" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:40.956035 11037 ts_tablet_manager.cc:1434] T a8b5a22ddad942d7b4db2b897e159337 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:01:40.957091 11037 tablet_bootstrap.cc:492] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
W20260709 13:01:40.958237 10876 leader_election.cc:343] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:40.959990 11061 raft_consensus.cc:493] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.960187 10804 leader_election.cc:304] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:40.960601 11061 raft_consensus.cc:515] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:40.961928 11189 raft_consensus.cc:2804] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:40.962321 11189 raft_consensus.cc:493] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.962649 11189 raft_consensus.cc:3060] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:40.963205 11061 leader_election.cc:290] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:40.965641 11037 tablet_bootstrap.cc:654] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:40.969179 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e187848edaa746928d647a830da8c970" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:40.970045 10837 raft_consensus.cc:2468] T e187848edaa746928d647a830da8c970 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 0.
I20260709 13:01:40.971009 11268 raft_consensus.cc:493] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.971596 11268 raft_consensus.cc:515] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.974051 11193 consensus_queue.cc:1048] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:40.974051 11268 leader_election.cc:290] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:40.978788 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b5a22ddad942d7b4db2b897e159337" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:40.979199 10877 leader_election.cc:304] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:01:40.979571 10762 raft_consensus.cc:2468] T a8b5a22ddad942d7b4db2b897e159337 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 0.
I20260709 13:01:40.980239 11033 ts_tablet_manager.cc:1434] T e187848edaa746928d647a830da8c970 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.064s	user 0.004s	sys 0.004s
I20260709 13:01:40.980549 11061 raft_consensus.cc:2804] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:40.986310 11061 raft_consensus.cc:493] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.986780 11061 raft_consensus.cc:3060] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:40.988821 10837 raft_consensus.cc:3060] T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:40.990993 11178 consensus_queue.cc:1048] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:40.981204 10802 leader_election.cc:304] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:40.994525 11268 raft_consensus.cc:2804] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:40.994988 11268 raft_consensus.cc:493] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.995352 11268 raft_consensus.cc:3060] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:40.995611 11033 tablet_bootstrap.cc:492] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:40.994647 11061 raft_consensus.cc:515] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:40.997874 11041 raft_consensus.cc:493] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.998456 11041 raft_consensus.cc:515] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:41.003528 11031 tablet_bootstrap.cc:654] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:41.003377 11041 leader_election.cc:290] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:41.004818 10834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e187848edaa746928d647a830da8c970" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:41.005484 10834 raft_consensus.cc:3060] T e187848edaa746928d647a830da8c970 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:41.005149 11261 consensus_queue.cc:1048] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:41.009061 11061 leader_election.cc:290] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Requested vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:41.011737 11040 raft_consensus.cc:493] T c403148f1f724c0ca12919d8e85ae572 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.012303 11040 raft_consensus.cc:515] T c403148f1f724c0ca12919d8e85ae572 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:40.982416 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b5a22ddad942d7b4db2b897e159337" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:41.013288 10985 raft_consensus.cc:2468] T a8b5a22ddad942d7b4db2b897e159337 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 0.
I20260709 13:01:41.014649 11040 leader_election.cc:290] T c403148f1f724c0ca12919d8e85ae572 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:41.014643 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce467fbc054ba89724cca56e1ae56e" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:41.015787 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c403148f1f724c0ca12919d8e85ae572" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:41.018901 10761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c403148f1f724c0ca12919d8e85ae572" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:41.019654 11033 tablet_bootstrap.cc:654] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:41.020781 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5382a9b34d84b4fbeccc952bb5f4ef5" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
W20260709 13:01:41.025764 10877 leader_election.cc:343] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:41.026031 11031 tablet_bootstrap.cc:492] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:41.026705 11031 ts_tablet_manager.cc:1403] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.092s	user 0.006s	sys 0.005s
I20260709 13:01:41.028102 10761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5382a9b34d84b4fbeccc952bb5f4ef5" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:41.032759 11031 raft_consensus.cc:359] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:41.033710 11031 raft_consensus.cc:385] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:41.034009 11031 raft_consensus.cc:740] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:41.034390 10802 leader_election.cc:304] T c403148f1f724c0ca12919d8e85ae572 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbd1fdffc68440e5b6250f6d95a4a367; no voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:01:41.034835 11031 consensus_queue.cc:260] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:41.036985 10834 raft_consensus.cc:2468] T e187848edaa746928d647a830da8c970 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 1.
I20260709 13:01:41.038072 11040 raft_consensus.cc:2749] T c403148f1f724c0ca12919d8e85ae572 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:41.041448 10877 leader_election.cc:304] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:41.042294 11061 raft_consensus.cc:2804] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:41.042960 11061 raft_consensus.cc:697] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Becoming Leader. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Running, Role: LEADER
I20260709 13:01:41.043865 11061 consensus_queue.cc:237] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:41.044988 11268 raft_consensus.cc:515] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:41.046262 11198 consensus_queue.cc:1048] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:41.052018 11198 consensus_queue.cc:1048] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:41.059998 11268 leader_election.cc:290] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Requested vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:41.042281 11031 ts_tablet_manager.cc:1434] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.003s
I20260709 13:01:41.069820 11031 tablet_bootstrap.cc:492] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:41.023913 11272 raft_consensus.cc:515] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:41.062974 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b5a22ddad942d7b4db2b897e159337" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:41.071236 10985 raft_consensus.cc:3060] T a8b5a22ddad942d7b4db2b897e159337 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:41.063083 10761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b5a22ddad942d7b4db2b897e159337" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:41.073581 10760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a791a0126444ba90c1fb442e1b809b" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:41.074262 11033 tablet_bootstrap.cc:492] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:41.074358 10760 raft_consensus.cc:3060] T b5a791a0126444ba90c1fb442e1b809b P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:41.075026 11033 ts_tablet_manager.cc:1403] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.080s	user 0.015s	sys 0.003s
I20260709 13:01:41.062974 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e187848edaa746928d647a830da8c970" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:41.065503 10763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce467fbc054ba89724cca56e1ae56e" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:41.080965 11033 raft_consensus.cc:359] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:41.081868 11033 raft_consensus.cc:385] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:41.082160 11033 raft_consensus.cc:740] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:41.083087 10985 raft_consensus.cc:2468] T a8b5a22ddad942d7b4db2b897e159337 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 1.
I20260709 13:01:41.082933 11033 consensus_queue.cc:260] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:41.084739 10802 leader_election.cc:304] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:41.073613 10761 raft_consensus.cc:3060] T a8b5a22ddad942d7b4db2b897e159337 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:41.085924 11040 raft_consensus.cc:2804] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:41.086572 11040 raft_consensus.cc:697] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Becoming Leader. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Running, Role: LEADER
I20260709 13:01:41.087476 11040 consensus_queue.cc:237] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:41.088265 11031 tablet_bootstrap.cc:654] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:41.092604 11033 ts_tablet_manager.cc:1434] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.002s
I20260709 13:01:41.093860 11033 tablet_bootstrap.cc:492] T dd1014df7b2b4d2d80864646b5e5df5e P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:41.083087 10760 raft_consensus.cc:2468] T b5a791a0126444ba90c1fb442e1b809b P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 1.
I20260709 13:01:41.096549 10950 leader_election.cc:304] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f; no voters: 
I20260709 13:01:41.097674 11178 raft_consensus.cc:2804] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:41.098240 11178 raft_consensus.cc:697] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Becoming Leader. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
I20260709 13:01:41.099278 11178 consensus_queue.cc:237] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:41.102089 11033 tablet_bootstrap.cc:654] T dd1014df7b2b4d2d80864646b5e5df5e P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:41.112792 11198 consensus_queue.cc:1048] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:41.123301 11267 raft_consensus.cc:493] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.123857 11267 raft_consensus.cc:515] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:41.124599 11033 tablet_bootstrap.cc:492] T dd1014df7b2b4d2d80864646b5e5df5e P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:41.125123 11033 ts_tablet_manager.cc:1403] T dd1014df7b2b4d2d80864646b5e5df5e P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.001s
I20260709 13:01:41.127656 11267 leader_election.cc:290] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:41.128871 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f570072427e34a4e843286441c60a630" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
W20260709 13:01:41.130950 10802 leader_election.cc:343] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:41.133445 10912 raft_consensus.cc:3060] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:41.128090 11033 raft_consensus.cc:359] T dd1014df7b2b4d2d80864646b5e5df5e P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:41.140110 11033 raft_consensus.cc:385] T dd1014df7b2b4d2d80864646b5e5df5e P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:41.140740 11033 raft_consensus.cc:740] T dd1014df7b2b4d2d80864646b5e5df5e P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:41.141820 11033 consensus_queue.cc:260] T dd1014df7b2b4d2d80864646b5e5df5e P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:41.150226 11033 ts_tablet_manager.cc:1434] T dd1014df7b2b4d2d80864646b5e5df5e P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:01:41.151654 11033 tablet_bootstrap.cc:492] T b5a791a0126444ba90c1fb442e1b809b P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:41.151305 11189 raft_consensus.cc:515] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:41.142900 10657 catalog_manager.cc:5697] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196). New cstate: current_term: 1 leader_uuid: "5e62c52a41f7476a908dd377c1a8a79f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:41.162523 11189 leader_election.cc:290] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Requested vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:41.165910 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c9e47add2e4175b68fde1a27aa92e0" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:41.166846 10986 raft_consensus.cc:3060] T f1c9e47add2e4175b68fde1a27aa92e0 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:41.176769 11033 tablet_bootstrap.cc:654] T b5a791a0126444ba90c1fb442e1b809b P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:41.179782 10986 raft_consensus.cc:2468] T f1c9e47add2e4175b68fde1a27aa92e0 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 1.
I20260709 13:01:41.182703 11260 consensus_queue.cc:1048] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:41.186677 10802 leader_election.cc:304] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:41.187991 11189 raft_consensus.cc:2804] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:41.188900 11189 raft_consensus.cc:697] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Becoming Leader. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Running, Role: LEADER
I20260709 13:01:41.191972 11189 consensus_queue.cc:237] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:41.199095 11260 raft_consensus.cc:493] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.199775 11260 raft_consensus.cc:515] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:41.202405 11260 leader_election.cc:290] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:41.205277 10834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd1014df7b2b4d2d80864646b5e5df5e" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:41.206192 10834 raft_consensus.cc:2468] T dd1014df7b2b4d2d80864646b5e5df5e P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 0.
I20260709 13:01:41.207697 10951 leader_election.cc:304] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:41.208707 11178 raft_consensus.cc:2804] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:41.210036 10837 raft_consensus.cc:3060] T c403148f1f724c0ca12919d8e85ae572 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:41.214190 10760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd1014df7b2b4d2d80864646b5e5df5e" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:41.214656 11198 consensus_queue.cc:1048] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:41.215020 10760 raft_consensus.cc:2468] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 0.
I20260709 13:01:41.209141 11178 raft_consensus.cc:493] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.216979 11178 raft_consensus.cc:3060] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:41.243515 10657 catalog_manager.cc:5697] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:41.232489 11272 leader_election.cc:290] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Requested vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:41.246096 11178 raft_consensus.cc:515] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:41.242451 11193 raft_consensus.cc:493] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.266788 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f570072427e34a4e843286441c60a630" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:41.259161 11193 raft_consensus.cc:515] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:41.282011 11033 tablet_bootstrap.cc:492] T b5a791a0126444ba90c1fb442e1b809b P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:41.282593 11033 ts_tablet_manager.cc:1403] T b5a791a0126444ba90c1fb442e1b809b P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.131s	user 0.009s	sys 0.018s
I20260709 13:01:41.272317 10834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a791a0126444ba90c1fb442e1b809b" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:41.275970 10760 raft_consensus.cc:3060] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:41.299522 11178 leader_election.cc:290] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Requested vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:41.299798 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd1014df7b2b4d2d80864646b5e5df5e" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:41.300094 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a51aa36dad4f1a85c485d67d2903e2" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:41.300580 10836 raft_consensus.cc:3060] T dd1014df7b2b4d2d80864646b5e5df5e P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:41.301172 11193 leader_election.cc:290] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
W20260709 13:01:41.302193 10727 leader_election.cc:343] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:41.306083 10908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c9e47add2e4175b68fde1a27aa92e0" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:41.306867 10908 raft_consensus.cc:3060] T f1c9e47add2e4175b68fde1a27aa92e0 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:41.307565 11032 tablet_bootstrap.cc:492] T e187848edaa746928d647a830da8c970 P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:41.308104 11032 ts_tablet_manager.cc:1403] T e187848edaa746928d647a830da8c970 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.393s	user 0.063s	sys 0.063s
I20260709 13:01:41.310016 10763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd1014df7b2b4d2d80864646b5e5df5e" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:41.310698 10763 raft_consensus.cc:3060] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:41.312563 10761 raft_consensus.cc:2468] T a8b5a22ddad942d7b4db2b897e159337 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 1.
I20260709 13:01:41.312872 10911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a51aa36dad4f1a85c485d67d2903e2" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:41.314612 11031 tablet_bootstrap.cc:492] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:41.315142 11031 ts_tablet_manager.cc:1403] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.246s	user 0.041s	sys 0.046s
I20260709 13:01:41.317088 10908 raft_consensus.cc:2468] T f1c9e47add2e4175b68fde1a27aa92e0 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 1.
I20260709 13:01:41.319561 11032 raft_consensus.cc:359] T e187848edaa746928d647a830da8c970 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:41.320261 11198 raft_consensus.cc:493] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.325989 11032 raft_consensus.cc:385] T e187848edaa746928d647a830da8c970 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:41.326313 11198 raft_consensus.cc:515] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:41.327490 10836 raft_consensus.cc:2468] T dd1014df7b2b4d2d80864646b5e5df5e P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 1.
I20260709 13:01:41.328466 11032 raft_consensus.cc:740] T e187848edaa746928d647a830da8c970 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:41.328665 11033 raft_consensus.cc:359] T b5a791a0126444ba90c1fb442e1b809b P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:41.321120 11272 consensus_queue.cc:1048] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:41.321321 11178 consensus_queue.cc:1048] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:41.325377 10763 raft_consensus.cc:2468] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 1.
I20260709 13:01:41.329435 11033 raft_consensus.cc:385] T b5a791a0126444ba90c1fb442e1b809b P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:41.329507 11032 consensus_queue.cc:260] T e187848edaa746928d647a830da8c970 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:41.332712 11033 raft_consensus.cc:740] T b5a791a0126444ba90c1fb442e1b809b P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
W20260709 13:01:41.327641 10951 leader_election.cc:343] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:41.335059 11037 tablet_bootstrap.cc:492] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:41.336674 11037 ts_tablet_manager.cc:1403] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.380s	user 0.064s	sys 0.062s
I20260709 13:01:41.337028 11033 consensus_queue.cc:260] T b5a791a0126444ba90c1fb442e1b809b P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:41.345588 11033 ts_tablet_manager.cc:1434] T b5a791a0126444ba90c1fb442e1b809b P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.002s
W20260709 13:01:41.346688 10804 leader_election.cc:343] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:41.343904 11031 raft_consensus.cc:359] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:41.353169 11031 raft_consensus.cc:385] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:41.354588 11040 raft_consensus.cc:493] T b5a791a0126444ba90c1fb442e1b809b P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.353588 11031 raft_consensus.cc:740] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:41.355294 11040 raft_consensus.cc:515] T b5a791a0126444ba90c1fb442e1b809b P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
W20260709 13:01:41.338991 10729 leader_election.cc:343] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:41.358000 11031 consensus_queue.cc:260] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:41.361517 11040 leader_election.cc:290] T b5a791a0126444ba90c1fb442e1b809b P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:41.373925 11031 ts_tablet_manager.cc:1434] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.002s
I20260709 13:01:41.354480 10804 leader_election.cc:304] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbd1fdffc68440e5b6250f6d95a4a367; no voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:41.387158 11269 raft_consensus.cc:2749] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:41.387984 11198 leader_election.cc:290] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:41.390767 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a791a0126444ba90c1fb442e1b809b" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:41.392220 10761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5a791a0126444ba90c1fb442e1b809b" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:41.393105 10761 raft_consensus.cc:2393] T b5a791a0126444ba90c1fb442e1b809b P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbd1fdffc68440e5b6250f6d95a4a367 in current term 1: Already voted for candidate 5e62c52a41f7476a908dd377c1a8a79f in this term.
W20260709 13:01:41.393426 10804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36351, user_credentials={real_user=slave}} blocked reactor thread for 46791.7us
I20260709 13:01:41.364764 10729 leader_election.cc:304] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0; no voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:41.394376 11198 raft_consensus.cc:2749] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:01:41.394539 10729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36351, user_credentials={real_user=slave}} blocked reactor thread for 56645.8us
W20260709 13:01:41.395560 11310 log.cc:927] Time spent T f547b171c6b9445c95475ce3be870c2e P b778a184b0ac46f5b86ce4fe363dcbab: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:01:41.382153 10951 leader_election.cc:304] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:41.399902 11313 raft_consensus.cc:2804] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:41.407388 11313 raft_consensus.cc:697] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Becoming Leader. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
I20260709 13:01:41.408407 11313 consensus_queue.cc:237] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:41.419669 11037 raft_consensus.cc:359] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:41.420809 10909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f547b171c6b9445c95475ce3be870c2e" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:41.420742 11037 raft_consensus.cc:385] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:41.421502 11037 raft_consensus.cc:740] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:41.422499 11037 consensus_queue.cc:260] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:41.406698 10802 leader_election.cc:304] T b5a791a0126444ba90c1fb442e1b809b P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbd1fdffc68440e5b6250f6d95a4a367; no voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:01:41.435046 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f547b171c6b9445c95475ce3be870c2e" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:41.435935 11040 raft_consensus.cc:3060] T b5a791a0126444ba90c1fb442e1b809b P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:41.430691 11037 ts_tablet_manager.cc:1434] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.094s	user 0.006s	sys 0.002s
W20260709 13:01:41.442384 10950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34489, user_credentials={real_user=slave}} blocked reactor thread for 46030.6us
W20260709 13:01:41.444514 10802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34489, user_credentials={real_user=slave}} blocked reactor thread for 46860.6us
I20260709 13:01:41.446766 11033 tablet_bootstrap.cc:492] T a62d4f04bff940779e241ebbd0aace2b P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:41.448074 11037 tablet_bootstrap.cc:492] T 48e63402e1544658a8d6cf5b9220414b P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:41.453024 11040 raft_consensus.cc:2749] T b5a791a0126444ba90c1fb442e1b809b P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:41.457366 10729 leader_election.cc:304] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0; no voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:41.458292 11198 raft_consensus.cc:2749] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:41.461891 10876 leader_election.cc:343] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:41.462565 10876 leader_election.cc:304] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab; no voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:41.463217 11032 ts_tablet_manager.cc:1434] T e187848edaa746928d647a830da8c970 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.155s	user 0.023s	sys 0.017s
I20260709 13:01:41.464298 10876 leader_election.cc:304] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab; no voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:01:41.464720 11316 raft_consensus.cc:2749] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:41.462010 11041 consensus_queue.cc:1048] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:01:41.465456 11314 consensus_queue.cc:1048] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:41.464406 11032 tablet_bootstrap.cc:492] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:41.468510 11316 raft_consensus.cc:2749] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:41.472029 11037 tablet_bootstrap.cc:654] T 48e63402e1544658a8d6cf5b9220414b P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:41.474682 11317 raft_consensus.cc:493] T e187848edaa746928d647a830da8c970 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.475258 11317 raft_consensus.cc:515] T e187848edaa746928d647a830da8c970 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:41.483412 11033 tablet_bootstrap.cc:654] T a62d4f04bff940779e241ebbd0aace2b P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:41.488934 11317 leader_election.cc:290] T e187848edaa746928d647a830da8c970 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:41.492957 11032 tablet_bootstrap.cc:654] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:41.492161 10835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e187848edaa746928d647a830da8c970" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:41.490754 10657 catalog_manager.cc:5697] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:41.496703 10835 raft_consensus.cc:2393] T e187848edaa746928d647a830da8c970 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e62c52a41f7476a908dd377c1a8a79f in current term 1: Already voted for candidate b778a184b0ac46f5b86ce4fe363dcbab in this term.
I20260709 13:01:41.491384 11031 tablet_bootstrap.cc:492] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:41.518736 10659 catalog_manager.cc:5697] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196). New cstate: current_term: 1 leader_uuid: "5e62c52a41f7476a908dd377c1a8a79f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:41.490310 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e187848edaa746928d647a830da8c970" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:41.522339 10952 leader_election.cc:304] T e187848edaa746928d647a830da8c970 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f; no voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:41.523859 11260 raft_consensus.cc:3060] T e187848edaa746928d647a830da8c970 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:41.502439 10876 leader_election.cc:343] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:41.535696 11316 consensus_queue.cc:1048] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:41.547765 11260 raft_consensus.cc:2749] T e187848edaa746928d647a830da8c970 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:41.553824 11031 tablet_bootstrap.cc:654] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:41.590152 11040 consensus_queue.cc:1048] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:41.612898 11037 tablet_bootstrap.cc:492] T 48e63402e1544658a8d6cf5b9220414b P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:41.613476 11037 ts_tablet_manager.cc:1403] T 48e63402e1544658a8d6cf5b9220414b P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.166s	user 0.012s	sys 0.017s
I20260709 13:01:41.617995 11032 tablet_bootstrap.cc:492] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:41.619146 11032 ts_tablet_manager.cc:1403] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.155s	user 0.014s	sys 0.010s
I20260709 13:01:41.618917 10657 catalog_manager.cc:5697] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab reported cstate change: term changed from 0 to 1, leader changed from <none> to b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:41.621742 11260 consensus_queue.cc:1048] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:01:41.616137 11037 raft_consensus.cc:359] T 48e63402e1544658a8d6cf5b9220414b P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:41.630723 11037 raft_consensus.cc:385] T 48e63402e1544658a8d6cf5b9220414b P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:41.631107 11037 raft_consensus.cc:740] T 48e63402e1544658a8d6cf5b9220414b P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:41.660848 11037 consensus_queue.cc:260] T 48e63402e1544658a8d6cf5b9220414b P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:41.674226 11269 consensus_queue.cc:1048] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:41.682881 11323 consensus_queue.cc:1048] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:41.684676 11031 tablet_bootstrap.cc:492] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:41.685211 11031 ts_tablet_manager.cc:1403] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.194s	user 0.005s	sys 0.020s
I20260709 13:01:41.694861 11318 raft_consensus.cc:493] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.701334 11318 raft_consensus.cc:515] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:41.703491 11031 raft_consensus.cc:359] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:41.704365 11031 raft_consensus.cc:385] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:41.704674 11031 raft_consensus.cc:740] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:41.716320 11318 leader_election.cc:290] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:41.720700 11033 tablet_bootstrap.cc:492] T a62d4f04bff940779e241ebbd0aace2b P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:41.721299 11033 ts_tablet_manager.cc:1403] T a62d4f04bff940779e241ebbd0aace2b P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.275s	user 0.021s	sys 0.030s
I20260709 13:01:41.730466 11037 ts_tablet_manager.cc:1434] T 48e63402e1544658a8d6cf5b9220414b P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.117s	user 0.008s	sys 0.006s
I20260709 13:01:41.731675 11037 tablet_bootstrap.cc:492] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
W20260709 13:01:41.712893 10727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42509, user_credentials={real_user=slave}} blocked reactor thread for 59504.9us
I20260709 13:01:41.740139 11031 consensus_queue.cc:260] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:41.742220 11033 raft_consensus.cc:359] T a62d4f04bff940779e241ebbd0aace2b P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:41.743139 11033 raft_consensus.cc:385] T a62d4f04bff940779e241ebbd0aace2b P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:41.746675 11032 raft_consensus.cc:359] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:41.748641 11033 raft_consensus.cc:740] T a62d4f04bff940779e241ebbd0aace2b P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:41.748972 11032 raft_consensus.cc:385] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:41.749294 11032 raft_consensus.cc:740] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:41.750057 11033 consensus_queue.cc:260] T a62d4f04bff940779e241ebbd0aace2b P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:41.755189 11033 ts_tablet_manager.cc:1434] T a62d4f04bff940779e241ebbd0aace2b P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.002s
I20260709 13:01:41.756362 11033 tablet_bootstrap.cc:492] T 96a3b79f0ed34bce9764f4804d72c382 P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:41.759052 11040 consensus_queue.cc:1048] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:41.760001 11031 ts_tablet_manager.cc:1434] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.074s	user 0.006s	sys 0.000s
I20260709 13:01:41.751091 11032 consensus_queue.cc:260] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:41.765894 11061 raft_consensus.cc:493] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.766418 11061 raft_consensus.cc:515] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:41.768301 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b888af641846d495fe184e39aadc16" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
W20260709 13:01:41.732703 10729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36351, user_credentials={real_user=slave}} blocked reactor thread for 49313us
I20260709 13:01:41.775204 11061 leader_election.cc:290] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:41.777710 11031 tablet_bootstrap.cc:492] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:41.778249 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8273bf9f9a174b3ea62b5ab0a0bb5730" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:41.783914 11032 ts_tablet_manager.cc:1434] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.164s	user 0.007s	sys 0.001s
I20260709 13:01:41.793105 11032 tablet_bootstrap.cc:492] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
W20260709 13:01:41.799294 10877 leader_election.cc:343] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:41.802569 11037 tablet_bootstrap.cc:654] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:41.804926 11314 consensus_queue.cc:1048] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:41.820720 11336 raft_consensus.cc:493] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.821363 11336 raft_consensus.cc:515] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:41.822405 11033 tablet_bootstrap.cc:654] T 96a3b79f0ed34bce9764f4804d72c382 P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:41.823757 11336 leader_election.cc:290] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:41.827622 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b888af641846d495fe184e39aadc16" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:41.829396 10761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b888af641846d495fe184e39aadc16" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
W20260709 13:01:41.829617 10727 leader_election.cc:343] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:41.830155 10761 raft_consensus.cc:2468] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 0.
W20260709 13:01:41.838047 10876 leader_election.cc:343] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:41.839354 10876 consensus_peers.cc:597] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:41.849079 11032 tablet_bootstrap.cc:654] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:41.864811 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8273bf9f9a174b3ea62b5ab0a0bb5730" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:41.864440 10876 leader_election.cc:304] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:01:41.871791 11061 raft_consensus.cc:2804] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:41.872215 11061 raft_consensus.cc:493] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.872596 11061 raft_consensus.cc:3060] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:41.856093 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b888af641846d495fe184e39aadc16" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:41.866875 11260 consensus_queue.cc:1048] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:01:41.881166 11061 raft_consensus.cc:515] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:41.882486 10912 raft_consensus.cc:2393] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 346158a6aa6747c1b8d31b4fb80238d0 in current term 1: Already voted for candidate b778a184b0ac46f5b86ce4fe363dcbab in this term.
I20260709 13:01:41.889362 10729 leader_election.cc:304] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0; no voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:41.886541 11031 tablet_bootstrap.cc:654] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:41.893126 11037 tablet_bootstrap.cc:492] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:41.893702 11037 ts_tablet_manager.cc:1403] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.162s	user 0.011s	sys 0.001s
I20260709 13:01:41.891240 11339 raft_consensus.cc:3060] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:41.895910 11318 consensus_queue.cc:1048] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:41.902392 11037 raft_consensus.cc:359] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:41.903172 11037 raft_consensus.cc:385] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:41.903442 11037 raft_consensus.cc:740] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
W20260709 13:01:41.853156 10804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36351, user_credentials={real_user=slave}} blocked reactor thread for 94030.6us
I20260709 13:01:41.907115 11040 consensus_queue.cc:1048] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:41.904156 11037 consensus_queue.cc:260] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:41.923820 11061 leader_election.cc:290] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Requested vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:41.931583 11032 tablet_bootstrap.cc:492] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:41.932224 11032 ts_tablet_manager.cc:1403] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.139s	user 0.010s	sys 0.001s
I20260709 13:01:41.934818 11037 ts_tablet_manager.cc:1434] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.003s
I20260709 13:01:41.941015 11037 tablet_bootstrap.cc:492] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:41.938915 11339 raft_consensus.cc:2749] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:01:41.938583 10876 leader_election.cc:343] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:41.945538 10876 leader_election.cc:304] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab; no voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:41.948375 11316 raft_consensus.cc:2749] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:41.963202 11032 raft_consensus.cc:359] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:41.965030 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b888af641846d495fe184e39aadc16" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:41.967129 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b888af641846d495fe184e39aadc16" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:41.963984 11032 raft_consensus.cc:385] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:41.975729 11032 raft_consensus.cc:740] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:41.976847 11032 consensus_queue.cc:260] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:41.981909 11032 ts_tablet_manager.cc:1434] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
W20260709 13:01:41.995069 10708 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:41.997028 11336 raft_consensus.cc:493] T 48e63402e1544658a8d6cf5b9220414b P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.997638 11336 raft_consensus.cc:515] T 48e63402e1544658a8d6cf5b9220414b P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:42.000245 11336 leader_election.cc:290] T 48e63402e1544658a8d6cf5b9220414b P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:42.002424 11033 tablet_bootstrap.cc:492] T 96a3b79f0ed34bce9764f4804d72c382 P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:42.002880 11033 ts_tablet_manager.cc:1403] T 96a3b79f0ed34bce9764f4804d72c382 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.247s	user 0.021s	sys 0.011s
I20260709 13:01:42.004762 11032 tablet_bootstrap.cc:492] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:42.001209 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e63402e1544658a8d6cf5b9220414b" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:42.015005 10762 raft_consensus.cc:2468] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 1.
I20260709 13:01:42.015545 11031 tablet_bootstrap.cc:492] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:42.016075 11031 ts_tablet_manager.cc:1403] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.239s	user 0.015s	sys 0.000s
I20260709 13:01:42.019184 11031 raft_consensus.cc:359] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:42.019608 11313 consensus_queue.cc:1048] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:42.020042 11031 raft_consensus.cc:385] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.020363 11031 raft_consensus.cc:740] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.021037 11318 raft_consensus.cc:493] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.021170 11031 consensus_queue.cc:260] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:42.021607 11318 raft_consensus.cc:515] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:42.023833 11031 ts_tablet_manager.cc:1434] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:01:42.025743 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48e63402e1544658a8d6cf5b9220414b" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:42.023695 11318 leader_election.cc:290] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:42.032713 11031 tablet_bootstrap.cc:492] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:42.036777 10728 leader_election.cc:304] T 48e63402e1544658a8d6cf5b9220414b P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0; no voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:42.038679 11339 raft_consensus.cc:2749] T 48e63402e1544658a8d6cf5b9220414b P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:42.039388 11339 raft_consensus.cc:493] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.045967 11031 tablet_bootstrap.cc:654] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.039844 11339 raft_consensus.cc:515] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:42.049304 11339 leader_election.cc:290] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:42.050201 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8273bf9f9a174b3ea62b5ab0a0bb5730" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
W20260709 13:01:42.052305 10728 leader_election.cc:343] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.060369 11037 tablet_bootstrap.cc:654] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.061750 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bfa4098abc4f4ba38783e8b91b8cdb" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:42.063334 10876 leader_election.cc:304] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:42.064921 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8273bf9f9a174b3ea62b5ab0a0bb5730" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:42.066049 10761 raft_consensus.cc:3060] T 48e63402e1544658a8d6cf5b9220414b P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.067320 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bfa4098abc4f4ba38783e8b91b8cdb" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:42.075996 11318 raft_consensus.cc:2804] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:42.076567 11318 raft_consensus.cc:697] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Becoming Leader. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Running, Role: LEADER
I20260709 13:01:42.077435 11318 consensus_queue.cc:237] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:42.080547 10912 raft_consensus.cc:2468] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 0.
I20260709 13:01:42.090752 11323 raft_consensus.cc:493] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.091457 11323 raft_consensus.cc:515] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:42.104352 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a62d4f04bff940779e241ebbd0aace2b" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:42.105113 10836 raft_consensus.cc:2468] T a62d4f04bff940779e241ebbd0aace2b P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 0.
I20260709 13:01:42.105993 11323 leader_election.cc:290] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:42.106498 10951 leader_election.cc:304] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:42.107316 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a62d4f04bff940779e241ebbd0aace2b" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
W20260709 13:01:42.109110 10952 leader_election.cc:343] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.112555 11313 raft_consensus.cc:2804] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:42.113200 11313 raft_consensus.cc:493] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.113582 11313 raft_consensus.cc:3060] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.133864 11033 raft_consensus.cc:359] T 96a3b79f0ed34bce9764f4804d72c382 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:42.141170 10729 leader_election.cc:304] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: dbd1fdffc68440e5b6250f6d95a4a367
W20260709 13:01:42.152673 10876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34489, user_credentials={real_user=slave}} blocked reactor thread for 89405.8us
W20260709 13:01:42.196918 10876 leader_election.cc:343] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.153555 11339 raft_consensus.cc:2804] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:42.200789 11339 raft_consensus.cc:493] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.201164 11339 raft_consensus.cc:3060] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.152894 11033 raft_consensus.cc:385] T 96a3b79f0ed34bce9764f4804d72c382 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.210786 11033 raft_consensus.cc:740] T 96a3b79f0ed34bce9764f4804d72c382 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.211835 11033 consensus_queue.cc:260] T 96a3b79f0ed34bce9764f4804d72c382 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:42.213657 11033 ts_tablet_manager.cc:1434] T 96a3b79f0ed34bce9764f4804d72c382 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.211s	user 0.008s	sys 0.000s
I20260709 13:01:42.214916 11033 tablet_bootstrap.cc:492] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:42.231264 11032 tablet_bootstrap.cc:654] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.193143 11313 raft_consensus.cc:515] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
W20260709 13:01:42.253613 10876 leader_election.cc:343] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:42.279429 10876 leader_election.cc:343] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.279901 10876 leader_election.cc:304] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab; no voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:01:42.287139 11031 tablet_bootstrap.cc:492] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:42.287878 11031 ts_tablet_manager.cc:1403] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.263s	user 0.014s	sys 0.015s
I20260709 13:01:42.292328 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a62d4f04bff940779e241ebbd0aace2b" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:42.293401 10836 raft_consensus.cc:3060] T a62d4f04bff940779e241ebbd0aace2b P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.261965 11339 raft_consensus.cc:515] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:42.318917 11339 leader_election.cc:290] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Requested vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:42.292343 11031 raft_consensus.cc:359] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:42.325594 11031 raft_consensus.cc:385] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.325951 11031 raft_consensus.cc:740] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.326504 11031 consensus_queue.cc:260] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
W20260709 13:01:42.329051 10876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34489, user_credentials={real_user=slave}} blocked reactor thread for 49670.8us
I20260709 13:01:42.332705 11314 raft_consensus.cc:2749] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:42.336760 10909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8273bf9f9a174b3ea62b5ab0a0bb5730" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:42.337587 10909 raft_consensus.cc:3060] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.340572 11031 ts_tablet_manager.cc:1434] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.004s
I20260709 13:01:42.342983 11031 tablet_bootstrap.cc:492] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:42.344115 11033 tablet_bootstrap.cc:654] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.349581 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a62d4f04bff940779e241ebbd0aace2b" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:42.350054 11031 tablet_bootstrap.cc:654] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.350255 11313 leader_election.cc:290] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Requested vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:42.354420 11316 raft_consensus.cc:493] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:42.355203 10952 leader_election.cc:343] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.355072 11316 raft_consensus.cc:515] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:42.358215 11316 leader_election.cc:290] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:42.359997 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a3b79f0ed34bce9764f4804d72c382" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:42.360973 10837 raft_consensus.cc:2468] T 96a3b79f0ed34bce9764f4804d72c382 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 0.
I20260709 13:01:42.362600 10877 leader_election.cc:304] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:42.364992 11031 tablet_bootstrap.cc:492] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:42.365597 11031 ts_tablet_manager.cc:1403] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.002s
I20260709 13:01:42.365979 11316 raft_consensus.cc:2804] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:42.366523 11316 raft_consensus.cc:493] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.366983 11316 raft_consensus.cc:3060] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.370342 11031 raft_consensus.cc:359] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:42.367156 11032 tablet_bootstrap.cc:492] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:42.371163 11031 raft_consensus.cc:385] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.371780 11031 raft_consensus.cc:740] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.371969 11032 ts_tablet_manager.cc:1403] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.381s	user 0.013s	sys 0.005s
I20260709 13:01:42.372985 11031 consensus_queue.cc:260] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:42.375463 11031 ts_tablet_manager.cc:1434] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:01:42.376623 11031 tablet_bootstrap.cc:492] T a62d4f04bff940779e241ebbd0aace2b P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:42.381439 11037 tablet_bootstrap.cc:492] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:42.383039 10761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a3b79f0ed34bce9764f4804d72c382" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:42.389816 11037 ts_tablet_manager.cc:1403] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.451s	user 0.023s	sys 0.046s
I20260709 13:01:42.392341 11032 raft_consensus.cc:359] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:42.393126 11031 tablet_bootstrap.cc:654] T a62d4f04bff940779e241ebbd0aace2b P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.393136 11032 raft_consensus.cc:385] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.393615 11032 raft_consensus.cc:740] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.370970 10836 raft_consensus.cc:2468] T a62d4f04bff940779e241ebbd0aace2b P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 1.
I20260709 13:01:42.398295 10657 catalog_manager.cc:5697] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab reported cstate change: term changed from 0 to 1, leader changed from <none> to b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:42.394711 11032 consensus_queue.cc:260] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:42.404524 10951 leader_election.cc:304] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367; no voters: b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:42.405481 11356 raft_consensus.cc:493] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.406002 11356 raft_consensus.cc:515] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:42.406513 11260 raft_consensus.cc:2804] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:42.407069 11260 raft_consensus.cc:697] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Becoming Leader. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
I20260709 13:01:42.407905 11260 consensus_queue.cc:237] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:42.408254 11356 leader_election.cc:290] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:42.414781 11032 ts_tablet_manager.cc:1434] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
W20260709 13:01:42.416018 10876 leader_election.cc:343] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:42.415161 10804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36351, user_credentials={real_user=slave}} blocked reactor thread for 80537.2us
I20260709 13:01:42.410624 10909 raft_consensus.cc:2468] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 1.
I20260709 13:01:42.422286 11037 raft_consensus.cc:359] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:42.423117 11037 raft_consensus.cc:385] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.423403 11037 raft_consensus.cc:740] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.424011 11032 tablet_bootstrap.cc:492] T 26b888af641846d495fe184e39aadc16 P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:42.424773 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a51aa36dad4f1a85c485d67d2903e2" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:42.425504 10762 raft_consensus.cc:2468] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 0.
I20260709 13:01:42.424688 10984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a51aa36dad4f1a85c485d67d2903e2" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:42.427592 11033 tablet_bootstrap.cc:492] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:42.428184 11033 ts_tablet_manager.cc:1403] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.214s	user 0.016s	sys 0.019s
I20260709 13:01:42.434945 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8273bf9f9a174b3ea62b5ab0a0bb5730" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:42.436800 10876 leader_election.cc:304] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
W20260709 13:01:42.439847 10876 leader_election.cc:343] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:42.443392 10728 leader_election.cc:343] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.440903 11356 raft_consensus.cc:2804] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:42.443994 11356 raft_consensus.cc:493] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.444382 11356 raft_consensus.cc:3060] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.451210 11032 tablet_bootstrap.cc:654] T 26b888af641846d495fe184e39aadc16 P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.442560 11037 consensus_queue.cc:260] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:42.453920 10728 leader_election.cc:304] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:42.455840 11316 raft_consensus.cc:515] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:42.458966 11033 raft_consensus.cc:359] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:42.459532 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a3b79f0ed34bce9764f4804d72c382" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:42.460172 10837 raft_consensus.cc:3060] T 96a3b79f0ed34bce9764f4804d72c382 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.460737 11339 raft_consensus.cc:2804] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:42.461254 11339 raft_consensus.cc:697] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:01:42.461616 11033 raft_consensus.cc:385] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.461890 11033 raft_consensus.cc:740] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.462054 11339 consensus_queue.cc:237] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:42.462566 11033 consensus_queue.cc:260] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:42.458057 11316 leader_election.cc:290] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Requested vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:42.465585 11033 ts_tablet_manager.cc:1434] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.005s
I20260709 13:01:42.466681 11033 tablet_bootstrap.cc:492] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:42.461413 11037 ts_tablet_manager.cc:1434] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.070s	user 0.004s	sys 0.003s
I20260709 13:01:42.471877 11260 raft_consensus.cc:493] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.471719 10658 catalog_manager.cc:5697] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196). New cstate: current_term: 1 leader_uuid: "5e62c52a41f7476a908dd377c1a8a79f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:42.472465 11260 raft_consensus.cc:515] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:42.473356 11037 tablet_bootstrap.cc:492] T 96a3b79f0ed34bce9764f4804d72c382 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:42.474753 10837 raft_consensus.cc:2468] T 96a3b79f0ed34bce9764f4804d72c382 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 1.
I20260709 13:01:42.475912 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c5fd517a084ef9b707c36ec7c2fe3c" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:42.476150 10877 leader_election.cc:304] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:42.478806 11260 leader_election.cc:290] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:42.480180 11061 raft_consensus.cc:2804] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:42.484696 11061 raft_consensus.cc:697] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Becoming Leader. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Running, Role: LEADER
I20260709 13:01:42.485448 11061 consensus_queue.cc:237] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
W20260709 13:01:42.479614 10951 leader_election.cc:343] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.471299 11356 raft_consensus.cc:515] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:42.510288 11356 leader_election.cc:290] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Requested vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:42.510568 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a3b79f0ed34bce9764f4804d72c382" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:42.512751 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a51aa36dad4f1a85c485d67d2903e2" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
W20260709 13:01:42.515187 10876 leader_election.cc:343] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.503111 11031 tablet_bootstrap.cc:492] T a62d4f04bff940779e241ebbd0aace2b P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
W20260709 13:01:42.517382 10876 leader_election.cc:343] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.520546 11033 tablet_bootstrap.cc:654] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.520413 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c5fd517a084ef9b707c36ec7c2fe3c" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:42.517894 11031 ts_tablet_manager.cc:1403] T a62d4f04bff940779e241ebbd0aace2b P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.142s	user 0.022s	sys 0.004s
I20260709 13:01:42.517534 11037 tablet_bootstrap.cc:654] T 96a3b79f0ed34bce9764f4804d72c382 P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.541613 11032 tablet_bootstrap.cc:492] T 26b888af641846d495fe184e39aadc16 P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:42.542158 11031 raft_consensus.cc:359] T a62d4f04bff940779e241ebbd0aace2b P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:42.542932 11031 raft_consensus.cc:385] T a62d4f04bff940779e241ebbd0aace2b P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.543205 11031 raft_consensus.cc:740] T a62d4f04bff940779e241ebbd0aace2b P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.542191 11032 ts_tablet_manager.cc:1403] T 26b888af641846d495fe184e39aadc16 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.121s	user 0.016s	sys 0.028s
I20260709 13:01:42.543903 11031 consensus_queue.cc:260] T a62d4f04bff940779e241ebbd0aace2b P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:42.546263 11031 ts_tablet_manager.cc:1434] T a62d4f04bff940779e241ebbd0aace2b P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:01:42.547405 11031 tablet_bootstrap.cc:492] T d2c28919f0174f6d905b1b1a53f64d6d P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:42.548043 11032 raft_consensus.cc:359] T 26b888af641846d495fe184e39aadc16 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:42.553977 11032 raft_consensus.cc:385] T 26b888af641846d495fe184e39aadc16 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.554282 11032 raft_consensus.cc:740] T 26b888af641846d495fe184e39aadc16 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.554955 11032 consensus_queue.cc:260] T 26b888af641846d495fe184e39aadc16 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:42.557056 11032 ts_tablet_manager.cc:1434] T 26b888af641846d495fe184e39aadc16 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:01:42.558076 11032 tablet_bootstrap.cc:492] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:42.563406 11031 tablet_bootstrap.cc:654] T d2c28919f0174f6d905b1b1a53f64d6d P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:42.569579 10950 leader_election.cc:343] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.571357 10950 leader_election.cc:304] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f; no voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:42.572701 11260 raft_consensus.cc:2749] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:42.569352 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a51aa36dad4f1a85c485d67d2903e2" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:42.573884 10762 raft_consensus.cc:3060] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.587466 11033 tablet_bootstrap.cc:492] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:42.588032 11033 ts_tablet_manager.cc:1403] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.122s	user 0.020s	sys 0.011s
I20260709 13:01:42.590900 11033 raft_consensus.cc:359] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:42.591542 11033 raft_consensus.cc:385] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.591843 11033 raft_consensus.cc:740] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.591655 10661 catalog_manager.cc:5697] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:42.599696 11037 tablet_bootstrap.cc:492] T 96a3b79f0ed34bce9764f4804d72c382 P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:42.600294 11037 ts_tablet_manager.cc:1403] T 96a3b79f0ed34bce9764f4804d72c382 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.127s	user 0.014s	sys 0.011s
I20260709 13:01:42.602279 10981 raft_consensus.cc:3060] T 26b888af641846d495fe184e39aadc16 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.603152 11037 raft_consensus.cc:359] T 96a3b79f0ed34bce9764f4804d72c382 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:42.603760 11037 raft_consensus.cc:385] T 96a3b79f0ed34bce9764f4804d72c382 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.604012 11037 raft_consensus.cc:740] T 96a3b79f0ed34bce9764f4804d72c382 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.596446 11033 consensus_queue.cc:260] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:42.606504 11032 tablet_bootstrap.cc:654] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.615059 10762 raft_consensus.cc:2468] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 1.
I20260709 13:01:42.615782 11037 consensus_queue.cc:260] T 96a3b79f0ed34bce9764f4804d72c382 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:42.616048 11061 consensus_queue.cc:1048] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:42.616298 10876 leader_election.cc:304] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:01:42.617542 11061 raft_consensus.cc:2804] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:42.617990 11061 raft_consensus.cc:697] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Becoming Leader. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Running, Role: LEADER
I20260709 13:01:42.618084 11037 ts_tablet_manager.cc:1434] T 96a3b79f0ed34bce9764f4804d72c382 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.002s
I20260709 13:01:42.619176 11037 tablet_bootstrap.cc:492] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:42.618847 11061 consensus_queue.cc:237] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:42.626339 11033 ts_tablet_manager.cc:1434] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 13:01:42.627585 11033 tablet_bootstrap.cc:492] T 205f5d9c197b405faa72a70e2a010102 P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:42.663571 11033 tablet_bootstrap.cc:654] T 205f5d9c197b405faa72a70e2a010102 P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.667279 11037 tablet_bootstrap.cc:654] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.670486 11318 consensus_queue.cc:1048] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:42.680297 10659 catalog_manager.cc:5697] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab reported cstate change: term changed from 0 to 1, leader changed from <none> to b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:42.686656 11032 tablet_bootstrap.cc:492] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:42.687244 11032 ts_tablet_manager.cc:1403] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.129s	user 0.021s	sys 0.015s
I20260709 13:01:42.689226 11031 tablet_bootstrap.cc:492] T d2c28919f0174f6d905b1b1a53f64d6d P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:42.689808 11031 ts_tablet_manager.cc:1403] T d2c28919f0174f6d905b1b1a53f64d6d P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.143s	user 0.021s	sys 0.021s
I20260709 13:01:42.692669 11032 raft_consensus.cc:359] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:42.693427 11032 raft_consensus.cc:385] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.693722 11032 raft_consensus.cc:740] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.696300 11032 consensus_queue.cc:260] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:42.697938 11032 ts_tablet_manager.cc:1434] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:01:42.698939 11032 tablet_bootstrap.cc:492] T bec830b175ce40d69b73d9f73ea266a7 P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:42.710013 11031 raft_consensus.cc:359] T d2c28919f0174f6d905b1b1a53f64d6d P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:42.715011 11032 tablet_bootstrap.cc:654] T bec830b175ce40d69b73d9f73ea266a7 P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.722345 11033 tablet_bootstrap.cc:492] T 205f5d9c197b405faa72a70e2a010102 P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:42.728395 11033 ts_tablet_manager.cc:1403] T 205f5d9c197b405faa72a70e2a010102 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.101s	user 0.013s	sys 0.001s
I20260709 13:01:42.732290 11037 tablet_bootstrap.cc:492] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:42.732733 11061 raft_consensus.cc:493] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.732988 11033 raft_consensus.cc:359] T 205f5d9c197b405faa72a70e2a010102 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:42.727969 11031 raft_consensus.cc:385] T d2c28919f0174f6d905b1b1a53f64d6d P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.733934 11033 raft_consensus.cc:385] T 205f5d9c197b405faa72a70e2a010102 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.733533 11037 ts_tablet_manager.cc:1403] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.115s	user 0.009s	sys 0.005s
I20260709 13:01:42.736503 11061 raft_consensus.cc:515] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:42.734369 11033 raft_consensus.cc:740] T 205f5d9c197b405faa72a70e2a010102 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.737813 11037 raft_consensus.cc:359] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:42.738546 11037 raft_consensus.cc:385] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.738229 11033 consensus_queue.cc:260] T 205f5d9c197b405faa72a70e2a010102 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:42.738847 11037 raft_consensus.cc:740] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.738971 11061 leader_election.cc:290] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:42.739604 11037 consensus_queue.cc:260] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:42.734258 11031 raft_consensus.cc:740] T d2c28919f0174f6d905b1b1a53f64d6d P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.740566 11033 ts_tablet_manager.cc:1434] T 205f5d9c197b405faa72a70e2a010102 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:01:42.741268 11031 consensus_queue.cc:260] T d2c28919f0174f6d905b1b1a53f64d6d P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:42.741773 11033 tablet_bootstrap.cc:492] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:42.745327 11031 ts_tablet_manager.cc:1434] T d2c28919f0174f6d905b1b1a53f64d6d P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.000s
I20260709 13:01:42.745687 11037 ts_tablet_manager.cc:1434] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:01:42.746681 11031 tablet_bootstrap.cc:492] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:42.748045 11033 tablet_bootstrap.cc:654] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.748648 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205f5d9c197b405faa72a70e2a010102" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:42.750674 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205f5d9c197b405faa72a70e2a010102" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:42.751410 10837 raft_consensus.cc:2468] T 205f5d9c197b405faa72a70e2a010102 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 0.
I20260709 13:01:42.752159 11032 tablet_bootstrap.cc:492] T bec830b175ce40d69b73d9f73ea266a7 P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:42.752707 11032 ts_tablet_manager.cc:1403] T bec830b175ce40d69b73d9f73ea266a7 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.054s	user 0.017s	sys 0.009s
I20260709 13:01:42.754993 11031 tablet_bootstrap.cc:654] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.755551 11032 raft_consensus.cc:359] T bec830b175ce40d69b73d9f73ea266a7 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:42.756314 11032 raft_consensus.cc:385] T bec830b175ce40d69b73d9f73ea266a7 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.752022 10661 catalog_manager.cc:5697] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab reported cstate change: term changed from 0 to 1, leader changed from <none> to b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:42.756623 11032 raft_consensus.cc:740] T bec830b175ce40d69b73d9f73ea266a7 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.756826 10877 leader_election.cc:304] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:42.760294 11041 raft_consensus.cc:2804] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:42.760715 11041 raft_consensus.cc:493] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.761029 11041 raft_consensus.cc:3060] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.761821 11032 consensus_queue.cc:260] T bec830b175ce40d69b73d9f73ea266a7 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:42.764561 11032 ts_tablet_manager.cc:1434] T bec830b175ce40d69b73d9f73ea266a7 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:01:42.765733 11032 tablet_bootstrap.cc:492] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:42.749425 10981 raft_consensus.cc:2468] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 0.
I20260709 13:01:42.774761 11032 tablet_bootstrap.cc:654] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.778038 11041 raft_consensus.cc:515] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:42.779469 11033 tablet_bootstrap.cc:492] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:42.779700 11339 raft_consensus.cc:493] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.780076 11033 ts_tablet_manager.cc:1403] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.003s
I20260709 13:01:42.780186 11339 raft_consensus.cc:515] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:42.782344 11061 raft_consensus.cc:493] T a62d4f04bff940779e241ebbd0aace2b P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.782922 11061 raft_consensus.cc:515] T a62d4f04bff940779e241ebbd0aace2b P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:42.783382 11033 raft_consensus.cc:359] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:42.784070 11033 raft_consensus.cc:385] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.746683 11037 tablet_bootstrap.cc:492] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:42.784363 11033 raft_consensus.cc:740] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.785144 11033 consensus_queue.cc:260] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:42.785842 11339 leader_election.cc:290] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:42.787998 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bfa4098abc4f4ba38783e8b91b8cdb" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:42.788607 11033 ts_tablet_manager.cc:1434] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:01:42.788815 10910 raft_consensus.cc:2468] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 0.
I20260709 13:01:42.790475 10729 leader_election.cc:304] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:42.790907 11033 tablet_bootstrap.cc:492] T 401ec66526fe4ad0a997979233dd7ef3 P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:42.793756 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a62d4f04bff940779e241ebbd0aace2b" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:42.797477 10837 raft_consensus.cc:2393] T a62d4f04bff940779e241ebbd0aace2b P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b778a184b0ac46f5b86ce4fe363dcbab in current term 1: Already voted for candidate 5e62c52a41f7476a908dd377c1a8a79f in this term.
I20260709 13:01:42.795523 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a62d4f04bff940779e241ebbd0aace2b" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:42.797478 11061 leader_election.cc:290] T a62d4f04bff940779e241ebbd0aace2b P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:42.799487 11032 tablet_bootstrap.cc:492] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:42.799980 11032 ts_tablet_manager.cc:1403] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.035s	user 0.002s	sys 0.008s
I20260709 13:01:42.795892 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bfa4098abc4f4ba38783e8b91b8cdb" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:42.800328 11260 raft_consensus.cc:493] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.797369 11033 tablet_bootstrap.cc:654] T 401ec66526fe4ad0a997979233dd7ef3 P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.791297 11037 tablet_bootstrap.cc:654] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.803053 11031 tablet_bootstrap.cc:492] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:42.829695 11031 ts_tablet_manager.cc:1403] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.083s	user 0.026s	sys 0.040s
I20260709 13:01:42.830971 11336 raft_consensus.cc:2804] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:42.831450 11336 raft_consensus.cc:493] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.831863 11336 raft_consensus.cc:3060] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.803637 11032 raft_consensus.cc:359] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:42.832355 11032 raft_consensus.cc:385] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.832676 11032 raft_consensus.cc:740] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.833207 11031 raft_consensus.cc:359] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:42.833981 11031 raft_consensus.cc:385] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.833575 11032 consensus_queue.cc:260] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:42.825408 11040 raft_consensus.cc:493] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.834385 11031 raft_consensus.cc:740] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.834599 11040 raft_consensus.cc:515] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:42.835203 11031 consensus_queue.cc:260] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:42.836310 11032 ts_tablet_manager.cc:1434] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.011s
I20260709 13:01:42.800029 10877 leader_election.cc:304] T a62d4f04bff940779e241ebbd0aace2b P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab; no voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:42.837491 11032 tablet_bootstrap.cc:492] T 41a51aa36dad4f1a85c485d67d2903e2 P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:42.837801 11031 ts_tablet_manager.cc:1434] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:01:42.839236 11318 raft_consensus.cc:3060] T a62d4f04bff940779e241ebbd0aace2b P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.800922 11260 raft_consensus.cc:515] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:42.840624 10981 raft_consensus.cc:2468] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 0.
I20260709 13:01:42.804683 11259 raft_consensus.cc:493] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.845182 11040 leader_election.cc:290] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:42.847745 11032 tablet_bootstrap.cc:654] T 41a51aa36dad4f1a85c485d67d2903e2 P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.845407 11259 raft_consensus.cc:515] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:42.851200 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce467fbc054ba89724cca56e1ae56e" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:42.852366 10837 raft_consensus.cc:2468] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 0.
I20260709 13:01:42.853408 11318 raft_consensus.cc:2749] T a62d4f04bff940779e241ebbd0aace2b P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:42.854223 10728 leader_election.cc:304] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:42.855496 11339 raft_consensus.cc:2804] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:42.856003 11339 raft_consensus.cc:493] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.858512 11037 tablet_bootstrap.cc:492] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:42.858888 11033 tablet_bootstrap.cc:492] T 401ec66526fe4ad0a997979233dd7ef3 P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:42.859015 11037 ts_tablet_manager.cc:1403] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.113s	user 0.006s	sys 0.005s
I20260709 13:01:42.859380 11033 ts_tablet_manager.cc:1403] T 401ec66526fe4ad0a997979233dd7ef3 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.069s	user 0.011s	sys 0.018s
I20260709 13:01:42.862313 11037 raft_consensus.cc:359] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:42.863058 11037 raft_consensus.cc:385] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.863323 11037 raft_consensus.cc:740] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.863520 11033 raft_consensus.cc:359] T 401ec66526fe4ad0a997979233dd7ef3 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:42.864243 11033 raft_consensus.cc:385] T 401ec66526fe4ad0a997979233dd7ef3 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.863950 11037 consensus_queue.cc:260] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:42.864585 11033 raft_consensus.cc:740] T 401ec66526fe4ad0a997979233dd7ef3 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.865229 11033 consensus_queue.cc:260] T 401ec66526fe4ad0a997979233dd7ef3 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:42.856427 11339 raft_consensus.cc:3060] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.870765 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce467fbc054ba89724cca56e1ae56e" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:42.875583 10909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce467fbc054ba89724cca56e1ae56e" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:42.876408 10909 raft_consensus.cc:2468] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 0.
I20260709 13:01:42.878605 10804 leader_election.cc:304] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:42.879711 11259 leader_election.cc:290] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:42.880580 11031 tablet_bootstrap.cc:492] T 4a819525c849499885ee37af7d0f42a2 P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:42.882449 11358 raft_consensus.cc:493] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.883085 11358 raft_consensus.cc:515] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:42.879840 11323 consensus_queue.cc:1048] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:01:42.885349 11358 leader_election.cc:290] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:42.878921 11260 leader_election.cc:290] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:42.887238 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bfa4098abc4f4ba38783e8b91b8cdb" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:42.888080 10912 raft_consensus.cc:2468] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 0.
I20260709 13:01:42.882390 11340 raft_consensus.cc:2804] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:42.887521 11259 raft_consensus.cc:493] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.889585 11340 raft_consensus.cc:493] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.890038 11340 raft_consensus.cc:3060] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.889829 11259 raft_consensus.cc:515] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:42.890550 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8273bf9f9a174b3ea62b5ab0a0bb5730" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:42.891319 10912 raft_consensus.cc:2393] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbd1fdffc68440e5b6250f6d95a4a367 in current term 1: Already voted for candidate 346158a6aa6747c1b8d31b4fb80238d0 in this term.
I20260709 13:01:42.892057 11259 leader_election.cc:290] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:42.894197 10911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce467fbc054ba89724cca56e1ae56e" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:42.895093 10911 raft_consensus.cc:2468] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 0.
I20260709 13:01:42.867532 11033 ts_tablet_manager.cc:1434] T 401ec66526fe4ad0a997979233dd7ef3 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:01:42.897331 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c5fd517a084ef9b707c36ec7c2fe3c" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:42.869642 11037 ts_tablet_manager.cc:1434] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:01:42.898976 11037 tablet_bootstrap.cc:492] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:42.898762 10763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bfa4098abc4f4ba38783e8b91b8cdb" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:42.898689 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c5fd517a084ef9b707c36ec7c2fe3c" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
W20260709 13:01:42.899895 10728 leader_election.cc:343] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.900080 10952 leader_election.cc:304] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:42.900189 10981 raft_consensus.cc:2468] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 0.
I20260709 13:01:42.902150 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205f5d9c197b405faa72a70e2a010102" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:42.902487 11041 leader_election.cc:290] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Requested vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:42.903044 10727 leader_election.cc:304] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f; no voters: dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:42.903918 11336 raft_consensus.cc:515] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:42.904701 11260 raft_consensus.cc:2804] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:42.905139 10763 raft_consensus.cc:2393] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e62c52a41f7476a908dd377c1a8a79f in current term 1: Already voted for candidate 346158a6aa6747c1b8d31b4fb80238d0 in this term.
I20260709 13:01:42.905194 11260 raft_consensus.cc:493] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.905925 11260 raft_consensus.cc:3060] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.906490 10985 raft_consensus.cc:3060] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.911288 11037 tablet_bootstrap.cc:654] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.915325 11033 tablet_bootstrap.cc:492] T 611ca169fbcc420fb11d1502cbe196a9 P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:42.918213 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bfa4098abc4f4ba38783e8b91b8cdb" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:42.921857 11334 raft_consensus.cc:2804] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:42.922384 11334 raft_consensus.cc:493] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.922803 11334 raft_consensus.cc:3060] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.925884 11336 leader_election.cc:290] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Requested vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:42.928381 11033 tablet_bootstrap.cc:654] T 611ca169fbcc420fb11d1502cbe196a9 P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.931797 11340 raft_consensus.cc:515] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:42.932683 10763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8273bf9f9a174b3ea62b5ab0a0bb5730" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:42.939239 10911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bfa4098abc4f4ba38783e8b91b8cdb" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:42.939515 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205f5d9c197b405faa72a70e2a010102" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:42.949083 10836 raft_consensus.cc:3060] T 205f5d9c197b405faa72a70e2a010102 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.950513 11032 tablet_bootstrap.cc:492] T 41a51aa36dad4f1a85c485d67d2903e2 P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:42.952796 10911 raft_consensus.cc:3060] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.958858 11339 raft_consensus.cc:515] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:42.962996 10762 raft_consensus.cc:2393] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbd1fdffc68440e5b6250f6d95a4a367 in current term 1: Already voted for candidate 346158a6aa6747c1b8d31b4fb80238d0 in this term.
I20260709 13:01:42.964743 10834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce467fbc054ba89724cca56e1ae56e" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:42.965633 10834 raft_consensus.cc:2393] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 346158a6aa6747c1b8d31b4fb80238d0 in current term 1: Already voted for candidate dbd1fdffc68440e5b6250f6d95a4a367 in this term.
I20260709 13:01:42.966410 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce467fbc054ba89724cca56e1ae56e" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:42.966990 10912 raft_consensus.cc:3060] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.967125 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce467fbc054ba89724cca56e1ae56e" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:42.967690 11033 tablet_bootstrap.cc:492] T 611ca169fbcc420fb11d1502cbe196a9 P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:42.968204 11033 ts_tablet_manager.cc:1403] T 611ca169fbcc420fb11d1502cbe196a9 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.002s
I20260709 13:01:42.964283 11260 raft_consensus.cc:515] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:42.954377 11032 ts_tablet_manager.cc:1403] T 41a51aa36dad4f1a85c485d67d2903e2 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.117s	user 0.021s	sys 0.031s
I20260709 13:01:42.921754 11031 tablet_bootstrap.cc:654] T 4a819525c849499885ee37af7d0f42a2 P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.972440 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce467fbc054ba89724cca56e1ae56e" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:42.973382 10762 raft_consensus.cc:2393] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dbd1fdffc68440e5b6250f6d95a4a367 in current term 1: Already voted for candidate 346158a6aa6747c1b8d31b4fb80238d0 in this term.
I20260709 13:01:42.974757 10802 leader_election.cc:304] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbd1fdffc68440e5b6250f6d95a4a367; no voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:42.975549 11358 raft_consensus.cc:3060] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.977870 11260 leader_election.cc:290] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Requested vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:42.979122 10908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bfa4098abc4f4ba38783e8b91b8cdb" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:42.979753 11032 raft_consensus.cc:359] T 41a51aa36dad4f1a85c485d67d2903e2 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:42.980458 11032 raft_consensus.cc:385] T 41a51aa36dad4f1a85c485d67d2903e2 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.980769 11032 raft_consensus.cc:740] T 41a51aa36dad4f1a85c485d67d2903e2 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.981477 11032 consensus_queue.cc:260] T 41a51aa36dad4f1a85c485d67d2903e2 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:42.982318 11259 consensus_queue.cc:1048] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:42.983600 11032 ts_tablet_manager.cc:1434] T 41a51aa36dad4f1a85c485d67d2903e2 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:01:42.946422 10985 raft_consensus.cc:2468] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 1.
I20260709 13:01:42.969295 11339 leader_election.cc:290] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Requested vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:42.982539 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bfa4098abc4f4ba38783e8b91b8cdb" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:42.984751 11032 tablet_bootstrap.cc:492] T f570072427e34a4e843286441c60a630 P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:42.986641 10981 raft_consensus.cc:2393] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 346158a6aa6747c1b8d31b4fb80238d0 in current term 1: Already voted for candidate 5e62c52a41f7476a908dd377c1a8a79f in this term.
I20260709 13:01:42.984767 10762 raft_consensus.cc:2393] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e62c52a41f7476a908dd377c1a8a79f in current term 1: Already voted for candidate 346158a6aa6747c1b8d31b4fb80238d0 in this term.
I20260709 13:01:42.989010 11033 raft_consensus.cc:359] T 611ca169fbcc420fb11d1502cbe196a9 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:42.990645 10950 leader_election.cc:304] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f; no voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:42.991079 11033 raft_consensus.cc:385] T 611ca169fbcc420fb11d1502cbe196a9 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.991398 11033 raft_consensus.cc:740] T 611ca169fbcc420fb11d1502cbe196a9 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.989687 11358 raft_consensus.cc:2749] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:42.992954 11323 raft_consensus.cc:2749] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:42.996685 10912 raft_consensus.cc:2468] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 1.
I20260709 13:01:42.997004 11033 consensus_queue.cc:260] T 611ca169fbcc420fb11d1502cbe196a9 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:43.001885 11313 raft_consensus.cc:493] T 41a51aa36dad4f1a85c485d67d2903e2 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.002472 11313 raft_consensus.cc:515] T 41a51aa36dad4f1a85c485d67d2903e2 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:43.003335 11033 ts_tablet_manager.cc:1434] T 611ca169fbcc420fb11d1502cbe196a9 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:01:42.996261 11032 tablet_bootstrap.cc:654] T f570072427e34a4e843286441c60a630 P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.958825 10836 raft_consensus.cc:2468] T 205f5d9c197b405faa72a70e2a010102 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 1.
I20260709 13:01:43.005950 11313 leader_election.cc:290] T 41a51aa36dad4f1a85c485d67d2903e2 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:43.006712 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a51aa36dad4f1a85c485d67d2903e2" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:43.010128 10729 leader_election.cc:304] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:43.011399 10876 leader_election.cc:304] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:43.012049 10802 leader_election.cc:304] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbd1fdffc68440e5b6250f6d95a4a367; no voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:42.992811 11340 leader_election.cc:290] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Requested vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:43.015445 11385 raft_consensus.cc:2804] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:43.020315 11385 raft_consensus.cc:697] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:01:43.021276 11385 consensus_queue.cc:237] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:43.014560 11041 raft_consensus.cc:2804] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:43.025048 11041 raft_consensus.cc:697] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Becoming Leader. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Running, Role: LEADER
I20260709 13:01:43.026057 11041 consensus_queue.cc:237] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:43.027467 10981 raft_consensus.cc:3060] T 41a51aa36dad4f1a85c485d67d2903e2 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:43.029858 11260 consensus_queue.cc:1048] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:43.032891 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41a51aa36dad4f1a85c485d67d2903e2" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:43.034027 10762 raft_consensus.cc:2393] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e62c52a41f7476a908dd377c1a8a79f in current term 1: Already voted for candidate b778a184b0ac46f5b86ce4fe363dcbab in this term.
I20260709 13:01:43.017704 11334 raft_consensus.cc:515] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
W20260709 13:01:43.063133 10802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34489, user_credentials={real_user=slave}} blocked reactor thread for 51145us
I20260709 13:01:43.065919 11040 raft_consensus.cc:493] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.040385 11259 raft_consensus.cc:493] T 96a3b79f0ed34bce9764f4804d72c382 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.066450 11040 raft_consensus.cc:515] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:43.054057 11340 raft_consensus.cc:2749] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:43.056579 11318 raft_consensus.cc:493] T d2c28919f0174f6d905b1b1a53f64d6d P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.081132 11040 leader_election.cc:290] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:43.066063 11260 raft_consensus.cc:493] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.093427 11033 tablet_bootstrap.cc:492] T d2c28919f0174f6d905b1b1a53f64d6d P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:43.095775 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ecfbc8cc6e7441fb568b197ffade11e" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
W20260709 13:01:43.099150 10802 leader_election.cc:343] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:43.104157 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ecfbc8cc6e7441fb568b197ffade11e" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:43.092857 11260 raft_consensus.cc:515] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:43.082857 11318 raft_consensus.cc:515] T d2c28919f0174f6d905b1b1a53f64d6d P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:43.109249 11032 tablet_bootstrap.cc:492] T f570072427e34a4e843286441c60a630 P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:43.109833 11032 ts_tablet_manager.cc:1403] T f570072427e34a4e843286441c60a630 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.125s	user 0.024s	sys 0.028s
W20260709 13:01:43.110189 10804 leader_election.cc:343] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:43.110625 11334 leader_election.cc:290] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Requested vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:43.110695 10804 leader_election.cc:304] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbd1fdffc68440e5b6250f6d95a4a367; no voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:43.111917 11340 raft_consensus.cc:2749] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:43.101203 10911 raft_consensus.cc:2468] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 1.
I20260709 13:01:43.113948 10952 leader_election.cc:304] T 41a51aa36dad4f1a85c485d67d2903e2 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f; no voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:43.111979 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2c28919f0174f6d905b1b1a53f64d6d" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:43.114610 11260 leader_election.cc:290] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:43.115392 11032 raft_consensus.cc:359] T f570072427e34a4e843286441c60a630 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
W20260709 13:01:43.115895 10876 leader_election.cc:343] T d2c28919f0174f6d905b1b1a53f64d6d P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:43.116192 11032 raft_consensus.cc:385] T f570072427e34a4e843286441c60a630 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:43.116519 11032 raft_consensus.cc:740] T f570072427e34a4e843286441c60a630 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:43.117270 11032 consensus_queue.cc:260] T f570072427e34a4e843286441c60a630 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:43.118016 11323 raft_consensus.cc:493] T bec830b175ce40d69b73d9f73ea266a7 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.118534 11323 raft_consensus.cc:515] T bec830b175ce40d69b73d9f73ea266a7 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:43.073745 11259 raft_consensus.cc:515] T 96a3b79f0ed34bce9764f4804d72c382 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:43.119542 11032 ts_tablet_manager.cc:1434] T f570072427e34a4e843286441c60a630 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:01:43.120682 11032 tablet_bootstrap.cc:492] T d2c28919f0174f6d905b1b1a53f64d6d P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:43.120769 11323 leader_election.cc:290] T bec830b175ce40d69b73d9f73ea266a7 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:43.124014 10832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611ca169fbcc420fb11d1502cbe196a9" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:43.124810 10832 raft_consensus.cc:2468] T 611ca169fbcc420fb11d1502cbe196a9 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 0.
I20260709 13:01:43.125200 11031 tablet_bootstrap.cc:492] T 4a819525c849499885ee37af7d0f42a2 P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:43.125713 11031 ts_tablet_manager.cc:1403] T 4a819525c849499885ee37af7d0f42a2 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.245s	user 0.014s	sys 0.005s
I20260709 13:01:43.124604 11260 raft_consensus.cc:2749] T 41a51aa36dad4f1a85c485d67d2903e2 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:43.127095 11032 tablet_bootstrap.cc:654] T d2c28919f0174f6d905b1b1a53f64d6d P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:43.131739 10834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c5fd517a084ef9b707c36ec7c2fe3c" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:43.132316 11033 tablet_bootstrap.cc:654] T d2c28919f0174f6d905b1b1a53f64d6d P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:43.128509 10729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36351, user_credentials={real_user=slave}} blocked reactor thread for 63226.6us
I20260709 13:01:43.151832 11031 raft_consensus.cc:359] T 4a819525c849499885ee37af7d0f42a2 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:43.153636 11031 raft_consensus.cc:385] T 4a819525c849499885ee37af7d0f42a2 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:43.154059 11031 raft_consensus.cc:740] T 4a819525c849499885ee37af7d0f42a2 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:43.109447 11318 leader_election.cc:290] T d2c28919f0174f6d905b1b1a53f64d6d P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:43.159479 11031 consensus_queue.cc:260] T 4a819525c849499885ee37af7d0f42a2 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:43.166997 11396 consensus_queue.cc:1048] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:43.152607 11259 leader_election.cc:290] T 96a3b79f0ed34bce9764f4804d72c382 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:43.169225 10835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2c28919f0174f6d905b1b1a53f64d6d" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:43.151252 11061 consensus_queue.cc:1048] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 13:01:43.172636 10951 leader_election.cc:304] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:43.152602 11316 raft_consensus.cc:493] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.174296 11316 raft_consensus.cc:515] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:43.172530 10729 leader_election.cc:304] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:01:43.181362 11040 raft_consensus.cc:493] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.188515 11040 raft_consensus.cc:515] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:43.178726 10761 raft_consensus.cc:3060] T 96a3b79f0ed34bce9764f4804d72c382 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:43.174351 11260 raft_consensus.cc:2804] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:43.172941 10760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611ca169fbcc420fb11d1502cbe196a9" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:43.176385 11316 leader_election.cc:290] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
W20260709 13:01:43.164358 10728 leader_election.cc:343] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:43.201390 11037 tablet_bootstrap.cc:492] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:43.205816 11037 ts_tablet_manager.cc:1403] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.307s	user 0.014s	sys 0.021s
I20260709 13:01:43.174216 10758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec830b175ce40d69b73d9f73ea266a7" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:43.176728 11336 raft_consensus.cc:2804] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:01:43.204618 10708 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:43.211925 11336 raft_consensus.cc:697] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:01:43.213277 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec830b175ce40d69b73d9f73ea266a7" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:43.215219 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec830b175ce40d69b73d9f73ea266a7" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:43.215931 10912 raft_consensus.cc:2468] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 0.
I20260709 13:01:43.217288 11033 tablet_bootstrap.cc:492] T d2c28919f0174f6d905b1b1a53f64d6d P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:43.217787 11033 ts_tablet_manager.cc:1403] T d2c28919f0174f6d905b1b1a53f64d6d P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.141s	user 0.010s	sys 0.007s
I20260709 13:01:43.201572 11031 ts_tablet_manager.cc:1434] T 4a819525c849499885ee37af7d0f42a2 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.076s	user 0.005s	sys 0.003s
W20260709 13:01:43.215970 10728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35051, user_credentials={real_user=slave}} blocked reactor thread for 55129.5us
I20260709 13:01:43.178272 11318 consensus_queue.cc:1048] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 13:01:43.194038 11061 consensus_queue.cc:1048] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:01:43.202086 11260 raft_consensus.cc:493] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.231541 11040 leader_election.cc:290] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
W20260709 13:01:43.257094 10876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34489, user_credentials={real_user=slave}} blocked reactor thread for 75418.7us
W20260709 13:01:43.258368 10876 leader_election.cc:343] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:43.267571 11031 tablet_bootstrap.cc:492] T f570072427e34a4e843286441c60a630 P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:43.269727 11033 raft_consensus.cc:359] T d2c28919f0174f6d905b1b1a53f64d6d P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:43.270625 11033 raft_consensus.cc:385] T d2c28919f0174f6d905b1b1a53f64d6d P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:43.270916 11033 raft_consensus.cc:740] T d2c28919f0174f6d905b1b1a53f64d6d P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:43.229954 11260 raft_consensus.cc:3060] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:43.299665 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec830b175ce40d69b73d9f73ea266a7" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:43.300545 10986 raft_consensus.cc:2468] T bec830b175ce40d69b73d9f73ea266a7 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 0.
I20260709 13:01:43.303457 11336 consensus_queue.cc:237] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:43.279537 11037 raft_consensus.cc:359] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:43.286805 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a3b79f0ed34bce9764f4804d72c382" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:43.287765 10952 leader_election.cc:304] T bec830b175ce40d69b73d9f73ea266a7 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:43.308434 11037 raft_consensus.cc:385] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:43.317121 11037 raft_consensus.cc:740] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:43.273190 11033 consensus_queue.cc:260] T d2c28919f0174f6d905b1b1a53f64d6d P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:43.322083 10876 leader_election.cc:304] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 346158a6aa6747c1b8d31b4fb80238d0
I20260709 13:01:43.323572 11037 consensus_queue.cc:260] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:43.326087 10659 catalog_manager.cc:5697] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab reported cstate change: term changed from 0 to 1, leader changed from <none> to b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:43.326993 11037 ts_tablet_manager.cc:1434] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.121s	user 0.004s	sys 0.004s
I20260709 13:01:43.328394 11033 ts_tablet_manager.cc:1434] T d2c28919f0174f6d905b1b1a53f64d6d P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.110s	user 0.006s	sys 0.001s
I20260709 13:01:43.331585 11033 tablet_bootstrap.cc:492] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:43.337204 11032 tablet_bootstrap.cc:492] T d2c28919f0174f6d905b1b1a53f64d6d P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:43.337778 11032 ts_tablet_manager.cc:1403] T d2c28919f0174f6d905b1b1a53f64d6d P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.217s	user 0.025s	sys 0.028s
I20260709 13:01:43.326874 11318 raft_consensus.cc:2804] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:43.339871 11318 raft_consensus.cc:493] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.340214 11318 raft_consensus.cc:3060] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:43.340852 11037 tablet_bootstrap.cc:492] T bec830b175ce40d69b73d9f73ea266a7 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:43.340633 11032 raft_consensus.cc:359] T d2c28919f0174f6d905b1b1a53f64d6d P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:43.341499 11032 raft_consensus.cc:385] T d2c28919f0174f6d905b1b1a53f64d6d P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:43.341841 11032 raft_consensus.cc:740] T d2c28919f0174f6d905b1b1a53f64d6d P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:43.342520 11032 consensus_queue.cc:260] T d2c28919f0174f6d905b1b1a53f64d6d P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:43.431612 11031 tablet_bootstrap.cc:654] T f570072427e34a4e843286441c60a630 P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:43.406812 11189 raft_consensus.cc:493] T 401ec66526fe4ad0a997979233dd7ef3 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:43.407590 10877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35051, user_credentials={real_user=slave}} blocked reactor thread for 226819us
I20260709 13:01:43.458209 11061 consensus_queue.cc:1048] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:01:43.447976 10952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36351, user_credentials={real_user=slave}} blocked reactor thread for 160273us
I20260709 13:01:43.443091 11189 raft_consensus.cc:515] T 401ec66526fe4ad0a997979233dd7ef3 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:43.483412 11401 raft_consensus.cc:493] T 4a819525c849499885ee37af7d0f42a2 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.484189 11401 raft_consensus.cc:515] T 4a819525c849499885ee37af7d0f42a2 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:43.487272 11401 leader_election.cc:290] T 4a819525c849499885ee37af7d0f42a2 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:43.451483 11260 raft_consensus.cc:515] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
W20260709 13:01:43.465201 10877 leader_election.cc:343] T d2c28919f0174f6d905b1b1a53f64d6d P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:43.503216 10758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a819525c849499885ee37af7d0f42a2" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:43.505853 11406 raft_consensus.cc:2804] T bec830b175ce40d69b73d9f73ea266a7 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:43.506430 11406 raft_consensus.cc:493] T bec830b175ce40d69b73d9f73ea266a7 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.506786 11406 raft_consensus.cc:3060] T bec830b175ce40d69b73d9f73ea266a7 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:43.507167 11260 leader_election.cc:290] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Requested vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:43.503547 11033 tablet_bootstrap.cc:654] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:43.510994 10876 leader_election.cc:343] T 4a819525c849499885ee37af7d0f42a2 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:43.463327 10951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35051, user_credentials={real_user=slave}} blocked reactor thread for 140651us
I20260709 13:01:43.509244 11260 raft_consensus.cc:493] T f570072427e34a4e843286441c60a630 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.510213 10877 leader_election.cc:304] T d2c28919f0174f6d905b1b1a53f64d6d P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab; no voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:43.537905 11189 leader_election.cc:290] T 401ec66526fe4ad0a997979233dd7ef3 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
W20260709 13:01:43.538213 10877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35051, user_credentials={real_user=slave}} blocked reactor thread for 75378.7us
I20260709 13:01:43.540392 10838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611ca169fbcc420fb11d1502cbe196a9" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:43.540665 11041 raft_consensus.cc:2749] T d2c28919f0174f6d905b1b1a53f64d6d P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:43.541174 10838 raft_consensus.cc:3060] T 611ca169fbcc420fb11d1502cbe196a9 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:43.543361 11037 tablet_bootstrap.cc:654] T bec830b175ce40d69b73d9f73ea266a7 P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:43.551534 11032 ts_tablet_manager.cc:1434] T d2c28919f0174f6d905b1b1a53f64d6d P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.213s	user 0.027s	sys 0.027s
I20260709 13:01:43.600273 11032 tablet_bootstrap.cc:492] T 401ec66526fe4ad0a997979233dd7ef3 P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:43.545231 11260 raft_consensus.cc:515] T f570072427e34a4e843286441c60a630 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:43.604591 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c5fd517a084ef9b707c36ec7c2fe3c" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:43.605325 10985 raft_consensus.cc:3060] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:43.561326 10834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a819525c849499885ee37af7d0f42a2" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
W20260709 13:01:43.561386 10950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34489, user_credentials={real_user=slave}} blocked reactor thread for 116115us
I20260709 13:01:43.618963 10985 raft_consensus.cc:2468] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 1.
I20260709 13:01:43.630611 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f570072427e34a4e843286441c60a630" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:43.631181 10985 raft_consensus.cc:2468] T f570072427e34a4e843286441c60a630 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 0.
W20260709 13:01:43.625710 10950 leader_election.cc:343] T bec830b175ce40d69b73d9f73ea266a7 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:43.643410 10877 leader_election.cc:343] T 4a819525c849499885ee37af7d0f42a2 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:43.693650 10877 leader_election.cc:304] T 4a819525c849499885ee37af7d0f42a2 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab; no voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367
W20260709 13:01:43.694655 10877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:35051, user_credentials={real_user=slave}} blocked reactor thread for 52977.1us
W20260709 13:01:43.705178 11419 log.cc:927] Time spent T 41a51aa36dad4f1a85c485d67d2903e2 P 5e62c52a41f7476a908dd377c1a8a79f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:01:43.701887 11385 raft_consensus.cc:493] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:43.695511 10950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34489, user_credentials={real_user=slave}} blocked reactor thread for 70645.2us
W20260709 13:01:43.716370 10950 leader_election.cc:343] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:43.705389 11400 raft_consensus.cc:2749] T 4a819525c849499885ee37af7d0f42a2 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:43.713598 11318 raft_consensus.cc:515] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
W20260709 13:01:43.725750 11412 log.cc:927] Time spent T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:01:43.726218 11318 leader_election.cc:290] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Requested vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:43.728621 11260 leader_election.cc:290] T f570072427e34a4e843286441c60a630 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:43.712991 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401ec66526fe4ad0a997979233dd7ef3" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
W20260709 13:01:43.732959 11422 log.cc:927] Time spent T 96a3b79f0ed34bce9764f4804d72c382 P 346158a6aa6747c1b8d31b4fb80238d0: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:01:43.736600 10727 leader_election.cc:304] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f; no voters: dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:43.738368 11336 raft_consensus.cc:2804] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:43.767208 11031 tablet_bootstrap.cc:492] T f570072427e34a4e843286441c60a630 P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:43.767970 11031 ts_tablet_manager.cc:1403] T f570072427e34a4e843286441c60a630 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.509s	user 0.039s	sys 0.026s
I20260709 13:01:43.767939 10802 leader_election.cc:304] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:43.721364 11385 raft_consensus.cc:515] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:43.773883 11385 leader_election.cc:290] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:43.779358 11406 raft_consensus.cc:515] T bec830b175ce40d69b73d9f73ea266a7 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:43.780926 11423 raft_consensus.cc:2804] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:43.781484 11423 raft_consensus.cc:493] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.781829 11423 raft_consensus.cc:3060] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:43.753508 10838 raft_consensus.cc:2468] T 611ca169fbcc420fb11d1502cbe196a9 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 1.
I20260709 13:01:43.779554 11032 tablet_bootstrap.cc:654] T 401ec66526fe4ad0a997979233dd7ef3 P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:43.791221 10876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34489, user_credentials={real_user=slave}} blocked reactor thread for 85113.9us
I20260709 13:01:43.795746 11336 raft_consensus.cc:697] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:01:43.801698 10758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611ca169fbcc420fb11d1502cbe196a9" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:43.802318 11037 tablet_bootstrap.cc:492] T bec830b175ce40d69b73d9f73ea266a7 P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:43.803324 11037 ts_tablet_manager.cc:1403] T bec830b175ce40d69b73d9f73ea266a7 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.465s	user 0.017s	sys 0.010s
I20260709 13:01:43.802767 10758 raft_consensus.cc:3060] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:43.802739 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec830b175ce40d69b73d9f73ea266a7" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:43.796833 11336 consensus_queue.cc:237] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:43.829701 11033 tablet_bootstrap.cc:492] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:43.830300 11033 ts_tablet_manager.cc:1403] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.499s	user 0.028s	sys 0.048s
W20260709 13:01:43.833336 10804 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.018s	sys 0.024s
W20260709 13:01:43.833786 10804 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.018s	sys 0.024s
W20260709 13:01:43.834084 10804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:36351, user_credentials={real_user=slave}} blocked reactor thread for 653137us
W20260709 13:01:43.838973 10802 leader_election.cc:343] T 401ec66526fe4ad0a997979233dd7ef3 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:43.837922 10758 raft_consensus.cc:2468] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 1.
I20260709 13:01:43.855913 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f570072427e34a4e843286441c60a630" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:43.856348 11406 leader_election.cc:290] T bec830b175ce40d69b73d9f73ea266a7 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Requested vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:43.850997 11033 raft_consensus.cc:359] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:43.861407 11033 raft_consensus.cc:385] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:43.861776 11033 raft_consensus.cc:740] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:43.865813 11033 consensus_queue.cc:260] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:43.869990 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec830b175ce40d69b73d9f73ea266a7" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:43.870832 10985 raft_consensus.cc:2393] T bec830b175ce40d69b73d9f73ea266a7 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b778a184b0ac46f5b86ce4fe363dcbab in current term 1: Already voted for candidate 5e62c52a41f7476a908dd377c1a8a79f in this term.
I20260709 13:01:43.874724 10951 leader_election.cc:304] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:43.871349 10908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f570072427e34a4e843286441c60a630" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:43.876384 11031 raft_consensus.cc:359] T f570072427e34a4e843286441c60a630 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:43.877177 11031 raft_consensus.cc:385] T f570072427e34a4e843286441c60a630 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:43.877168 11402 raft_consensus.cc:2804] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:43.878646 11402 raft_consensus.cc:697] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Becoming Leader. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
I20260709 13:01:43.879515 11402 consensus_queue.cc:237] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:43.880713 11423 raft_consensus.cc:515] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:43.877550 11031 raft_consensus.cc:740] T f570072427e34a4e843286441c60a630 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:43.883118 11423 leader_election.cc:290] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Requested vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:43.884542 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f570072427e34a4e843286441c60a630" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:43.885236 10979 raft_consensus.cc:3060] T f570072427e34a4e843286441c60a630 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:43.885942 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96a3b79f0ed34bce9764f4804d72c382" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:43.883132 11031 consensus_queue.cc:260] T f570072427e34a4e843286441c60a630 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
W20260709 13:01:43.828033 10727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42509, user_credentials={real_user=slave}} blocked reactor thread for 78622.1us
I20260709 13:01:43.892241 10908 raft_consensus.cc:2468] T f570072427e34a4e843286441c60a630 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 0.
I20260709 13:01:43.897284 11031 ts_tablet_manager.cc:1434] T f570072427e34a4e843286441c60a630 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.129s	user 0.000s	sys 0.006s
I20260709 13:01:43.897931 10831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611ca169fbcc420fb11d1502cbe196a9" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:43.899173 10831 raft_consensus.cc:2393] T 611ca169fbcc420fb11d1502cbe196a9 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 346158a6aa6747c1b8d31b4fb80238d0 in current term 1: Already voted for candidate 5e62c52a41f7476a908dd377c1a8a79f in this term.
I20260709 13:01:43.900291 10728 leader_election.cc:304] T 96a3b79f0ed34bce9764f4804d72c382 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0; no voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:43.902002 11396 raft_consensus.cc:2749] T 96a3b79f0ed34bce9764f4804d72c382 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:43.902539 10979 raft_consensus.cc:2468] T f570072427e34a4e843286441c60a630 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 1.
I20260709 13:01:43.898438 11033 ts_tablet_manager.cc:1434] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260709 13:01:43.908217 10802 leader_election.cc:304] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:43.904193 11423 raft_consensus.cc:493] T d2c28919f0174f6d905b1b1a53f64d6d P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.910138 10836 raft_consensus.cc:2393] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e62c52a41f7476a908dd377c1a8a79f in current term 1: Already voted for candidate dbd1fdffc68440e5b6250f6d95a4a367 in this term.
I20260709 13:01:43.910785 11340 raft_consensus.cc:2804] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:43.910590 11423 raft_consensus.cc:515] T d2c28919f0174f6d905b1b1a53f64d6d P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:43.911329 11340 raft_consensus.cc:697] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Becoming Leader. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Running, Role: LEADER
I20260709 13:01:43.912180 11340 consensus_queue.cc:237] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:43.913980 10761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec830b175ce40d69b73d9f73ea266a7" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:43.914538 11423 leader_election.cc:290] T d2c28919f0174f6d905b1b1a53f64d6d P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:43.915076 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2c28919f0174f6d905b1b1a53f64d6d" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:43.917603 11031 tablet_bootstrap.cc:492] T c3f9e2acc7244a26b1dbae53f8d0040a P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:43.917001 10981 raft_consensus.cc:2468] T d2c28919f0174f6d905b1b1a53f64d6d P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 0.
I20260709 13:01:43.923135 10802 leader_election.cc:304] T d2c28919f0174f6d905b1b1a53f64d6d P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:43.924026 11423 raft_consensus.cc:2804] T d2c28919f0174f6d905b1b1a53f64d6d P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:43.924418 11423 raft_consensus.cc:493] T d2c28919f0174f6d905b1b1a53f64d6d P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.924858 11423 raft_consensus.cc:3060] T d2c28919f0174f6d905b1b1a53f64d6d P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:43.926312 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f570072427e34a4e843286441c60a630" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:43.926993 10907 raft_consensus.cc:3060] T f570072427e34a4e843286441c60a630 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:43.930212 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611ca169fbcc420fb11d1502cbe196a9" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:43.924945 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401ec66526fe4ad0a997979233dd7ef3" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:43.939534 11033 tablet_bootstrap.cc:492] T 64c5fd517a084ef9b707c36ec7c2fe3c P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:43.941179 11401 consensus_queue.cc:1048] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:43.942325 11037 raft_consensus.cc:359] T bec830b175ce40d69b73d9f73ea266a7 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:43.945292 11037 raft_consensus.cc:385] T bec830b175ce40d69b73d9f73ea266a7 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:43.945606 11037 raft_consensus.cc:740] T bec830b175ce40d69b73d9f73ea266a7 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:43.946367 11037 consensus_queue.cc:260] T bec830b175ce40d69b73d9f73ea266a7 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:43.944761 11394 consensus_queue.cc:1048] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:01:43.961416 11316 consensus_queue.cc:1048] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:43.963640 11033 tablet_bootstrap.cc:654] T 64c5fd517a084ef9b707c36ec7c2fe3c P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:43.938156 11423 raft_consensus.cc:515] T d2c28919f0174f6d905b1b1a53f64d6d P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:43.967542 11423 leader_election.cc:290] T d2c28919f0174f6d905b1b1a53f64d6d P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Requested vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:43.963649 10905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2c28919f0174f6d905b1b1a53f64d6d" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:43.984414 10762 raft_consensus.cc:3060] T bec830b175ce40d69b73d9f73ea266a7 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:43.989089 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2c28919f0174f6d905b1b1a53f64d6d" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:43.990037 10985 raft_consensus.cc:3060] T d2c28919f0174f6d905b1b1a53f64d6d P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:43.937095 10907 raft_consensus.cc:2468] T f570072427e34a4e843286441c60a630 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 1.
I20260709 13:01:43.993492 11037 ts_tablet_manager.cc:1434] T bec830b175ce40d69b73d9f73ea266a7 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.190s	user 0.006s	sys 0.002s
I20260709 13:01:44.001933 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2c28919f0174f6d905b1b1a53f64d6d" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:43.991688 10905 raft_consensus.cc:2468] T d2c28919f0174f6d905b1b1a53f64d6d P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 0.
I20260709 13:01:44.005755 10727 leader_election.cc:304] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0; no voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:44.008248 11032 tablet_bootstrap.cc:492] T 401ec66526fe4ad0a997979233dd7ef3 P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:44.009016 11032 ts_tablet_manager.cc:1403] T 401ec66526fe4ad0a997979233dd7ef3 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.412s	user 0.017s	sys 0.000s
I20260709 13:01:44.017946 11032 raft_consensus.cc:359] T 401ec66526fe4ad0a997979233dd7ef3 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:44.018322 10985 raft_consensus.cc:2468] T d2c28919f0174f6d905b1b1a53f64d6d P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 1.
I20260709 13:01:44.018736 11032 raft_consensus.cc:385] T 401ec66526fe4ad0a997979233dd7ef3 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:44.020955 11037 tablet_bootstrap.cc:492] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:44.020200 11032 raft_consensus.cc:740] T 401ec66526fe4ad0a997979233dd7ef3 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:44.026358 11433 raft_consensus.cc:2749] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:44.027050 11259 consensus_queue.cc:1048] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:44.022127 10802 leader_election.cc:304] T d2c28919f0174f6d905b1b1a53f64d6d P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:44.030262 11404 raft_consensus.cc:2804] T d2c28919f0174f6d905b1b1a53f64d6d P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:44.030789 11404 raft_consensus.cc:697] T d2c28919f0174f6d905b1b1a53f64d6d P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Becoming Leader. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Running, Role: LEADER
I20260709 13:01:44.031628 11404 consensus_queue.cc:237] T d2c28919f0174f6d905b1b1a53f64d6d P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:44.033316 11031 tablet_bootstrap.cc:654] T c3f9e2acc7244a26b1dbae53f8d0040a P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:44.038268 10762 raft_consensus.cc:2468] T bec830b175ce40d69b73d9f73ea266a7 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 1.
W20260709 13:01:44.045220 10804 leader_election.cc:343] T 401ec66526fe4ad0a997979233dd7ef3 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:44.048524 10804 leader_election.cc:304] T 401ec66526fe4ad0a997979233dd7ef3 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbd1fdffc68440e5b6250f6d95a4a367; no voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:44.049737 10905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f570072427e34a4e843286441c60a630" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:44.059685 10876 leader_election.cc:304] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:01:44.060978 11032 consensus_queue.cc:260] T 401ec66526fe4ad0a997979233dd7ef3 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:44.062155 11401 raft_consensus.cc:2804] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:44.062690 11401 raft_consensus.cc:697] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Becoming Leader. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Running, Role: LEADER
I20260709 13:01:44.063501 11401 consensus_queue.cc:237] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:44.070137 11032 ts_tablet_manager.cc:1434] T 401ec66526fe4ad0a997979233dd7ef3 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.000s
I20260709 13:01:44.069284 10905 raft_consensus.cc:2393] T f570072427e34a4e843286441c60a630 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e62c52a41f7476a908dd377c1a8a79f in current term 1: Already voted for candidate dbd1fdffc68440e5b6250f6d95a4a367 in this term.
I20260709 13:01:44.104108 11189 raft_consensus.cc:2749] T 401ec66526fe4ad0a997979233dd7ef3 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:44.118374 11037 tablet_bootstrap.cc:654] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:44.128512 11032 tablet_bootstrap.cc:492] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
W20260709 13:01:44.127496 10804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36351, user_credentials={real_user=slave}} blocked reactor thread for 82283.6us
I20260709 13:01:44.139712 11396 consensus_queue.cc:1048] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:01:44.157282 11358 raft_consensus.cc:493] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.157910 11358 raft_consensus.cc:515] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:44.159991 11358 leader_election.cc:290] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:44.161195 10905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a819525c849499885ee37af7d0f42a2" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:44.161917 10905 raft_consensus.cc:2468] T 4a819525c849499885ee37af7d0f42a2 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 0.
I20260709 13:01:44.164172 10804 leader_election.cc:304] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:44.165380 11189 raft_consensus.cc:2804] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:44.165768 11189 raft_consensus.cc:493] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.166093 11189 raft_consensus.cc:3060] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:44.167351 11031 tablet_bootstrap.cc:492] T c3f9e2acc7244a26b1dbae53f8d0040a P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:44.167703 11033 tablet_bootstrap.cc:492] T 64c5fd517a084ef9b707c36ec7c2fe3c P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:44.167860 11031 ts_tablet_manager.cc:1403] T c3f9e2acc7244a26b1dbae53f8d0040a P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.259s	user 0.025s	sys 0.028s
I20260709 13:01:44.168188 11033 ts_tablet_manager.cc:1403] T 64c5fd517a084ef9b707c36ec7c2fe3c P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.229s	user 0.023s	sys 0.022s
I20260709 13:01:44.170591 11031 raft_consensus.cc:359] T c3f9e2acc7244a26b1dbae53f8d0040a P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:44.171367 11031 raft_consensus.cc:385] T c3f9e2acc7244a26b1dbae53f8d0040a P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:44.174599 11189 raft_consensus.cc:515] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:44.175652 11033 raft_consensus.cc:359] T 64c5fd517a084ef9b707c36ec7c2fe3c P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:44.176519 11033 raft_consensus.cc:385] T 64c5fd517a084ef9b707c36ec7c2fe3c P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:44.175328 11031 raft_consensus.cc:740] T c3f9e2acc7244a26b1dbae53f8d0040a P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:44.178345 10905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a819525c849499885ee37af7d0f42a2" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:44.180514 10905 raft_consensus.cc:3060] T 4a819525c849499885ee37af7d0f42a2 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:44.185387 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec830b175ce40d69b73d9f73ea266a7" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:44.189074 10952 leader_election.cc:304] T f570072427e34a4e843286441c60a630 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f; no voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:44.191475 11406 raft_consensus.cc:2749] T f570072427e34a4e843286441c60a630 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:44.191318 10658 catalog_manager.cc:5697] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:44.195621 10658 catalog_manager.cc:5697] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:44.196925 10658 catalog_manager.cc:5697] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:44.200858 11032 tablet_bootstrap.cc:654] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:44.176819 11033 raft_consensus.cc:740] T 64c5fd517a084ef9b707c36ec7c2fe3c P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:44.205013 11033 consensus_queue.cc:260] T 64c5fd517a084ef9b707c36ec7c2fe3c P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:44.205919 11031 consensus_queue.cc:260] T c3f9e2acc7244a26b1dbae53f8d0040a P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:44.196590 11189 leader_election.cc:290] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Requested vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:44.205209 11396 consensus_queue.cc:1048] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:01:44.229041 10952 leader_election.cc:304] T bec830b175ce40d69b73d9f73ea266a7 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f; no voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:44.213320 10758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a819525c849499885ee37af7d0f42a2" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:44.230650 11420 raft_consensus.cc:2749] T bec830b175ce40d69b73d9f73ea266a7 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:44.232524 11031 ts_tablet_manager.cc:1434] T c3f9e2acc7244a26b1dbae53f8d0040a P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.064s	user 0.002s	sys 0.006s
I20260709 13:01:44.233865 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a819525c849499885ee37af7d0f42a2" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:44.239723 11033 ts_tablet_manager.cc:1434] T 64c5fd517a084ef9b707c36ec7c2fe3c P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.000s
I20260709 13:01:44.244362 11031 tablet_bootstrap.cc:492] T 401ec66526fe4ad0a997979233dd7ef3 P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
W20260709 13:01:44.247805 10802 leader_election.cc:343] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:44.248970 10802 leader_election.cc:343] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:44.250897 10905 raft_consensus.cc:2468] T 4a819525c849499885ee37af7d0f42a2 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 1.
I20260709 13:01:44.261536 10804 leader_election.cc:304] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 346158a6aa6747c1b8d31b4fb80238d0
I20260709 13:01:44.263410 11033 tablet_bootstrap.cc:492] T c1470fc689d7429dada3bf5d45a82374 P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:44.271507 11358 raft_consensus.cc:2804] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:44.272182 11358 raft_consensus.cc:697] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Becoming Leader. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Running, Role: LEADER
I20260709 13:01:44.273653 11358 consensus_queue.cc:237] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:44.279244 11031 tablet_bootstrap.cc:654] T 401ec66526fe4ad0a997979233dd7ef3 P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:44.283209 10708 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:44.305140 11037 tablet_bootstrap.cc:492] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:44.305716 11037 ts_tablet_manager.cc:1403] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.285s	user 0.040s	sys 0.032s
I20260709 13:01:44.307178 11032 tablet_bootstrap.cc:492] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:44.307991 11032 ts_tablet_manager.cc:1403] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.203s	user 0.014s	sys 0.014s
I20260709 13:01:44.314999 11037 raft_consensus.cc:359] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:44.316658 11037 raft_consensus.cc:385] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:44.317034 11037 raft_consensus.cc:740] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:44.318871 11037 consensus_queue.cc:260] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:44.328869 11037 ts_tablet_manager.cc:1434] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:01:44.337028 11031 tablet_bootstrap.cc:492] T 401ec66526fe4ad0a997979233dd7ef3 P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:44.337581 11031 ts_tablet_manager.cc:1403] T 401ec66526fe4ad0a997979233dd7ef3 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.093s	user 0.008s	sys 0.005s
I20260709 13:01:44.338471 11037 tablet_bootstrap.cc:492] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:44.361120 11031 raft_consensus.cc:359] T 401ec66526fe4ad0a997979233dd7ef3 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:44.362071 11031 raft_consensus.cc:385] T 401ec66526fe4ad0a997979233dd7ef3 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:44.362347 11031 raft_consensus.cc:740] T 401ec66526fe4ad0a997979233dd7ef3 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:44.361433 11032 raft_consensus.cc:359] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:44.363864 11032 raft_consensus.cc:385] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:44.364166 11032 raft_consensus.cc:740] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:44.365039 11032 consensus_queue.cc:260] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:44.362949 11033 tablet_bootstrap.cc:654] T c1470fc689d7429dada3bf5d45a82374 P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:44.373395 11032 ts_tablet_manager.cc:1434] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.000s
I20260709 13:01:44.363034 11031 consensus_queue.cc:260] T 401ec66526fe4ad0a997979233dd7ef3 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:44.384197 11032 tablet_bootstrap.cc:492] T 2ea7c6df9b4340ffaf28c5a78966c74b P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:44.393375 11260 consensus_queue.cc:1048] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:44.394512 11031 ts_tablet_manager.cc:1434] T 401ec66526fe4ad0a997979233dd7ef3 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.057s	user 0.001s	sys 0.007s
I20260709 13:01:44.395655 11031 tablet_bootstrap.cc:492] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:44.398350 10836 raft_consensus.cc:3060] T 64c5fd517a084ef9b707c36ec7c2fe3c P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:44.401453 11031 tablet_bootstrap.cc:654] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:44.403086 11394 consensus_queue.cc:1048] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:44.410410 10659 catalog_manager.cc:5697] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196). New cstate: current_term: 1 leader_uuid: "5e62c52a41f7476a908dd377c1a8a79f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:44.426801 11033 tablet_bootstrap.cc:492] T c1470fc689d7429dada3bf5d45a82374 P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:44.427767 11033 ts_tablet_manager.cc:1403] T c1470fc689d7429dada3bf5d45a82374 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.185s	user 0.016s	sys 0.007s
I20260709 13:01:44.434177 11358 consensus_queue.cc:1048] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:44.441843 11033 raft_consensus.cc:359] T c1470fc689d7429dada3bf5d45a82374 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:44.442562 11033 raft_consensus.cc:385] T c1470fc689d7429dada3bf5d45a82374 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:44.442822 11033 raft_consensus.cc:740] T c1470fc689d7429dada3bf5d45a82374 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:44.443562 11033 consensus_queue.cc:260] T c1470fc689d7429dada3bf5d45a82374 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:44.444502 11037 tablet_bootstrap.cc:654] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:44.448621 11260 consensus_queue.cc:1048] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:44.453469 11033 ts_tablet_manager.cc:1434] T c1470fc689d7429dada3bf5d45a82374 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 13:01:44.454654 11032 tablet_bootstrap.cc:654] T 2ea7c6df9b4340ffaf28c5a78966c74b P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:44.455395 11031 tablet_bootstrap.cc:492] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:44.456058 11031 ts_tablet_manager.cc:1403] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.061s	user 0.013s	sys 0.009s
I20260709 13:01:44.455420 10661 catalog_manager.cc:5697] T d2c28919f0174f6d905b1b1a53f64d6d P dbd1fdffc68440e5b6250f6d95a4a367 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:44.459017 10661 catalog_manager.cc:5697] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:44.472839 11033 tablet_bootstrap.cc:492] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:44.481038 11394 consensus_queue.cc:1048] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:44.484653 11037 tablet_bootstrap.cc:492] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:44.485316 11037 ts_tablet_manager.cc:1403] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.153s	user 0.014s	sys 0.006s
I20260709 13:01:44.521327 11032 tablet_bootstrap.cc:492] T 2ea7c6df9b4340ffaf28c5a78966c74b P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:44.521996 11032 ts_tablet_manager.cc:1403] T 2ea7c6df9b4340ffaf28c5a78966c74b P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.138s	user 0.010s	sys 0.003s
I20260709 13:01:44.523797 11189 consensus_queue.cc:1048] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:44.536098 11037 raft_consensus.cc:359] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:44.536933 11037 raft_consensus.cc:385] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:44.537216 11037 raft_consensus.cc:740] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:44.537842 11033 tablet_bootstrap.cc:654] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:44.539525 11031 raft_consensus.cc:359] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:44.542032 11031 raft_consensus.cc:385] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:44.542412 11031 raft_consensus.cc:740] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:44.543615 11031 consensus_queue.cc:260] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:44.549862 11031 ts_tablet_manager.cc:1434] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.094s	user 0.007s	sys 0.000s
I20260709 13:01:44.554164 11031 tablet_bootstrap.cc:492] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:44.537905 11037 consensus_queue.cc:260] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:44.558540 10908 raft_consensus.cc:3060] T d2c28919f0174f6d905b1b1a53f64d6d P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:44.559863 11433 raft_consensus.cc:493] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.563130 11429 raft_consensus.cc:493] T c3f9e2acc7244a26b1dbae53f8d0040a P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.569456 11031 tablet_bootstrap.cc:654] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:44.569723 11037 ts_tablet_manager.cc:1434] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.000s
I20260709 13:01:44.573266 11032 raft_consensus.cc:359] T 2ea7c6df9b4340ffaf28c5a78966c74b P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:44.574364 11032 raft_consensus.cc:385] T 2ea7c6df9b4340ffaf28c5a78966c74b P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:44.574877 11032 raft_consensus.cc:740] T 2ea7c6df9b4340ffaf28c5a78966c74b P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:44.577462 11037 tablet_bootstrap.cc:492] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:44.573616 11429 raft_consensus.cc:515] T c3f9e2acc7244a26b1dbae53f8d0040a P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:44.569326 11433 raft_consensus.cc:515] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:44.587399 11429 leader_election.cc:290] T c3f9e2acc7244a26b1dbae53f8d0040a P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:44.587950 11433 leader_election.cc:290] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:44.594760 11420 raft_consensus.cc:493] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.594970 10979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3f9e2acc7244a26b1dbae53f8d0040a" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:44.595384 11420 raft_consensus.cc:515] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:44.599391 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b562356d3b4807a92648800cfe3dac" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:44.582304 11358 raft_consensus.cc:493] T c1470fc689d7429dada3bf5d45a82374 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.601541 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3f9e2acc7244a26b1dbae53f8d0040a" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:44.602286 10763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b562356d3b4807a92648800cfe3dac" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:44.601564 11420 leader_election.cc:290] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
W20260709 13:01:44.603259 10952 leader_election.cc:343] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:44.603613 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6842d144c244233a18d121c7966712a" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
W20260709 13:01:44.606145 10727 leader_election.cc:343] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:44.603482 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6842d144c244233a18d121c7966712a" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:44.602502 11358 raft_consensus.cc:515] T c1470fc689d7429dada3bf5d45a82374 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:44.611121 11358 leader_election.cc:290] T c1470fc689d7429dada3bf5d45a82374 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
W20260709 13:01:44.612715 10729 leader_election.cc:343] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:44.613287 10729 leader_election.cc:304] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0; no voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab
W20260709 13:01:44.608439 10876 leader_election.cc:343] T c3f9e2acc7244a26b1dbae53f8d0040a P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:44.614696 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1470fc689d7429dada3bf5d45a82374" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
W20260709 13:01:44.615396 10950 leader_election.cc:343] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:44.625217 10876 leader_election.cc:343] T c3f9e2acc7244a26b1dbae53f8d0040a P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:44.625840 10876 leader_election.cc:304] T c3f9e2acc7244a26b1dbae53f8d0040a P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab; no voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:01:44.615034 11032 consensus_queue.cc:260] T 2ea7c6df9b4340ffaf28c5a78966c74b P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:44.611299 11037 tablet_bootstrap.cc:654] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:44.623952 10802 leader_election.cc:343] T c1470fc689d7429dada3bf5d45a82374 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:44.639724 11429 raft_consensus.cc:2749] T c3f9e2acc7244a26b1dbae53f8d0040a P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:44.647171 11033 tablet_bootstrap.cc:492] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:44.647734 11033 ts_tablet_manager.cc:1403] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.182s	user 0.016s	sys 0.021s
I20260709 13:01:44.649796 11189 consensus_queue.cc:1048] T d2c28919f0174f6d905b1b1a53f64d6d P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:44.634120 11433 raft_consensus.cc:2749] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:44.654356 11032 ts_tablet_manager.cc:1434] T 2ea7c6df9b4340ffaf28c5a78966c74b P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.132s	user 0.004s	sys 0.003s
I20260709 13:01:44.658464 11032 tablet_bootstrap.cc:492] T a4eb868d99c9464996fb44dd3acdca7a P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:44.659870 11400 consensus_queue.cc:1048] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:44.662856 11358 consensus_queue.cc:1048] T d2c28919f0174f6d905b1b1a53f64d6d P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:44.664736 11033 raft_consensus.cc:359] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:44.665545 11033 raft_consensus.cc:385] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:44.665843 11033 raft_consensus.cc:740] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:44.666460 11033 consensus_queue.cc:260] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:44.656213 10950 leader_election.cc:304] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f; no voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:44.669725 10661 catalog_manager.cc:5697] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab reported cstate change: term changed from 0 to 1, leader changed from <none> to b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:44.644815 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1470fc689d7429dada3bf5d45a82374" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:44.677829 11033 ts_tablet_manager.cc:1434] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.002s
I20260709 13:01:44.678874 11033 tablet_bootstrap.cc:492] T a4eb868d99c9464996fb44dd3acdca7a P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
W20260709 13:01:44.681787 10950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34489, user_credentials={real_user=slave}} blocked reactor thread for 73810.2us
I20260709 13:01:44.683362 11420 raft_consensus.cc:2749] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:44.684773 11323 raft_consensus.cc:493] T 401ec66526fe4ad0a997979233dd7ef3 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.685441 11323 raft_consensus.cc:515] T 401ec66526fe4ad0a997979233dd7ef3 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:44.689400 11323 leader_election.cc:290] T 401ec66526fe4ad0a997979233dd7ef3 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:44.691474 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401ec66526fe4ad0a997979233dd7ef3" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:44.692289 10912 raft_consensus.cc:2468] T 401ec66526fe4ad0a997979233dd7ef3 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 0.
I20260709 13:01:44.691269 11318 consensus_queue.cc:1048] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:01:44.704826 10659 catalog_manager.cc:5697] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:44.715997 10952 leader_election.cc:304] T 401ec66526fe4ad0a997979233dd7ef3 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:44.717650 11402 raft_consensus.cc:2804] T 401ec66526fe4ad0a997979233dd7ef3 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:44.718190 11402 raft_consensus.cc:493] T 401ec66526fe4ad0a997979233dd7ef3 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.718577 11402 raft_consensus.cc:3060] T 401ec66526fe4ad0a997979233dd7ef3 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:44.723544 10802 leader_election.cc:343] T c1470fc689d7429dada3bf5d45a82374 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:44.724113 10802 leader_election.cc:304] T c1470fc689d7429dada3bf5d45a82374 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbd1fdffc68440e5b6250f6d95a4a367; no voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:01:44.723385 11031 tablet_bootstrap.cc:492] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:44.725201 11031 ts_tablet_manager.cc:1403] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.171s	user 0.026s	sys 0.012s
I20260709 13:01:44.737169 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401ec66526fe4ad0a997979233dd7ef3" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:44.737936 10837 raft_consensus.cc:2468] T 401ec66526fe4ad0a997979233dd7ef3 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 0.
I20260709 13:01:44.730335 11404 raft_consensus.cc:2749] T c1470fc689d7429dada3bf5d45a82374 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:44.746021 11031 raft_consensus.cc:359] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:44.746881 11031 raft_consensus.cc:385] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:44.747198 11031 raft_consensus.cc:740] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:44.747884 11031 consensus_queue.cc:260] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:44.755211 11031 ts_tablet_manager.cc:1434] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
W20260709 13:01:44.761667 10802 consensus_peers.cc:597] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:44.783087 11032 tablet_bootstrap.cc:654] T a4eb868d99c9464996fb44dd3acdca7a P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:44.785122 11037 tablet_bootstrap.cc:492] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:44.785666 11037 ts_tablet_manager.cc:1403] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.210s	user 0.024s	sys 0.016s
I20260709 13:01:44.787607 11031 tablet_bootstrap.cc:492] T a4eb868d99c9464996fb44dd3acdca7a P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:44.801759 11334 raft_consensus.cc:493] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.802404 11334 raft_consensus.cc:515] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:44.804394 11334 leader_election.cc:290] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:44.804641 11033 tablet_bootstrap.cc:654] T a4eb868d99c9464996fb44dd3acdca7a P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:44.805184 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7c6df9b4340ffaf28c5a78966c74b" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:44.806639 10985 raft_consensus.cc:2468] T 2ea7c6df9b4340ffaf28c5a78966c74b P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 0.
I20260709 13:01:44.807780 10727 leader_election.cc:304] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f; no voters: 
I20260709 13:01:44.808708 11334 raft_consensus.cc:2804] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:44.809128 11334 raft_consensus.cc:493] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:44.809514 11334 raft_consensus.cc:3060] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:44.805891 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7c6df9b4340ffaf28c5a78966c74b" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:44.810374 10837 raft_consensus.cc:2468] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 0.
I20260709 13:01:44.860948 11037 raft_consensus.cc:359] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:44.861733 11037 raft_consensus.cc:385] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:44.861996 11037 raft_consensus.cc:740] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:44.866003 11402 raft_consensus.cc:515] T 401ec66526fe4ad0a997979233dd7ef3 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:44.871399 10911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401ec66526fe4ad0a997979233dd7ef3" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:44.872094 10911 raft_consensus.cc:3060] T 401ec66526fe4ad0a997979233dd7ef3 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:44.872915 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401ec66526fe4ad0a997979233dd7ef3" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:44.873515 10837 raft_consensus.cc:3060] T 401ec66526fe4ad0a997979233dd7ef3 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:44.877485 11031 tablet_bootstrap.cc:654] T a4eb868d99c9464996fb44dd3acdca7a P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:44.880412 11402 leader_election.cc:290] T 401ec66526fe4ad0a997979233dd7ef3 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Requested vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:44.880884 11358 consensus_queue.cc:1048] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:44.882829 11032 tablet_bootstrap.cc:492] T a4eb868d99c9464996fb44dd3acdca7a P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:44.881372 10911 raft_consensus.cc:2468] T 401ec66526fe4ad0a997979233dd7ef3 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 1.
I20260709 13:01:44.884006 11033 tablet_bootstrap.cc:492] T a4eb868d99c9464996fb44dd3acdca7a P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:44.884624 11033 ts_tablet_manager.cc:1403] T a4eb868d99c9464996fb44dd3acdca7a P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.206s	user 0.030s	sys 0.025s
I20260709 13:01:44.885200 11037 consensus_queue.cc:260] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:44.887409 11037 ts_tablet_manager.cc:1434] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.101s	user 0.005s	sys 0.001s
I20260709 13:01:44.884241 11334 raft_consensus.cc:515] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:44.887866 11033 raft_consensus.cc:359] T a4eb868d99c9464996fb44dd3acdca7a P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:44.883332 11032 ts_tablet_manager.cc:1403] T a4eb868d99c9464996fb44dd3acdca7a P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.225s	user 0.010s	sys 0.002s
I20260709 13:01:44.888891 11033 raft_consensus.cc:385] T a4eb868d99c9464996fb44dd3acdca7a P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:44.889384 11433 raft_consensus.cc:493] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.944653 11433 raft_consensus.cc:515] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:44.946904 11433 leader_election.cc:290] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:44.947489 11033 raft_consensus.cc:740] T a4eb868d99c9464996fb44dd3acdca7a P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:44.948307 11033 consensus_queue.cc:260] T a4eb868d99c9464996fb44dd3acdca7a P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:44.948927 11334 leader_election.cc:290] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Requested vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:44.942131 11031 tablet_bootstrap.cc:492] T a4eb868d99c9464996fb44dd3acdca7a P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:44.957113 11031 ts_tablet_manager.cc:1403] T a4eb868d99c9464996fb44dd3acdca7a P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.173s	user 0.006s	sys 0.008s
I20260709 13:01:44.959231 11031 raft_consensus.cc:359] T a4eb868d99c9464996fb44dd3acdca7a P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:44.889106 10952 leader_election.cc:304] T 401ec66526fe4ad0a997979233dd7ef3 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:44.959735 11031 raft_consensus.cc:385] T a4eb868d99c9464996fb44dd3acdca7a P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:44.960050 11031 raft_consensus.cc:740] T a4eb868d99c9464996fb44dd3acdca7a P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
W20260709 13:01:44.960177 10952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:36351, user_credentials={real_user=slave}} blocked reactor thread for 71127.9us
I20260709 13:01:44.960754 11031 consensus_queue.cc:260] T a4eb868d99c9464996fb44dd3acdca7a P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:44.962395 11031 ts_tablet_manager.cc:1434] T a4eb868d99c9464996fb44dd3acdca7a P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:01:44.888439 11037 tablet_bootstrap.cc:492] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:44.950150 11033 ts_tablet_manager.cc:1434] T a4eb868d99c9464996fb44dd3acdca7a P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.065s	user 0.011s	sys 0.002s
I20260709 13:01:44.963526 11033 tablet_bootstrap.cc:492] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:44.941186 11032 raft_consensus.cc:359] T a4eb868d99c9464996fb44dd3acdca7a P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:44.953540 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7c6df9b4340ffaf28c5a78966c74b" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:44.964666 11032 raft_consensus.cc:385] T a4eb868d99c9464996fb44dd3acdca7a P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:44.964864 10981 raft_consensus.cc:3060] T 2ea7c6df9b4340ffaf28c5a78966c74b P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:44.954377 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211c168fa9614dbda8d8870bf5713616" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:44.968072 11032 raft_consensus.cc:740] T a4eb868d99c9464996fb44dd3acdca7a P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
W20260709 13:01:44.967964 10727 leader_election.cc:343] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:44.968887 11032 consensus_queue.cc:260] T a4eb868d99c9464996fb44dd3acdca7a P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:44.970530 11032 ts_tablet_manager.cc:1434] T a4eb868d99c9464996fb44dd3acdca7a P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.080s	user 0.003s	sys 0.009s
I20260709 13:01:44.971529 11032 tablet_bootstrap.cc:492] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:44.973474 10981 raft_consensus.cc:2468] T 2ea7c6df9b4340ffaf28c5a78966c74b P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 1.
I20260709 13:01:44.974502 11033 tablet_bootstrap.cc:654] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:44.974910 10727 leader_election.cc:304] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f; no voters: 
I20260709 13:01:44.960273 11402 raft_consensus.cc:2804] T 401ec66526fe4ad0a997979233dd7ef3 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:44.981174 11402 raft_consensus.cc:697] T 401ec66526fe4ad0a997979233dd7ef3 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Becoming Leader. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
I20260709 13:01:44.982033 11402 consensus_queue.cc:237] T 401ec66526fe4ad0a997979233dd7ef3 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:44.988584 11400 raft_consensus.cc:493] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.989217 11400 raft_consensus.cc:515] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:44.997224 11336 raft_consensus.cc:2804] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:44.997855 11336 raft_consensus.cc:697] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:01:44.998710 11336 consensus_queue.cc:237] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:44.999430 11037 tablet_bootstrap.cc:654] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:44.999895 11032 tablet_bootstrap.cc:654] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.019145 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7c6df9b4340ffaf28c5a78966c74b" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:45.019331 10834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211c168fa9614dbda8d8870bf5713616" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:45.020005 10836 raft_consensus.cc:3060] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.028728 11033 tablet_bootstrap.cc:492] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:45.029271 11033 ts_tablet_manager.cc:1403] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.066s	user 0.008s	sys 0.002s
I20260709 13:01:45.028595 10659 catalog_manager.cc:5697] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:45.003616 11031 tablet_bootstrap.cc:492] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:45.036720 11037 tablet_bootstrap.cc:492] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:45.037287 11037 ts_tablet_manager.cc:1403] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.149s	user 0.007s	sys 0.005s
I20260709 13:01:45.040112 11323 raft_consensus.cc:493] T a4eb868d99c9464996fb44dd3acdca7a P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.040697 11323 raft_consensus.cc:515] T a4eb868d99c9464996fb44dd3acdca7a P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:45.042927 11323 leader_election.cc:290] T a4eb868d99c9464996fb44dd3acdca7a P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:45.046672 11428 raft_consensus.cc:493] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.047413 11428 raft_consensus.cc:515] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:45.049837 11428 leader_election.cc:290] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:45.053799 10837 raft_consensus.cc:2468] T 401ec66526fe4ad0a997979233dd7ef3 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 1.
I20260709 13:01:45.067327 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4eb868d99c9464996fb44dd3acdca7a" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:45.065325 11033 raft_consensus.cc:359] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:45.108964 11033 raft_consensus.cc:385] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.065089 11031 tablet_bootstrap.cc:654] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.070477 11040 raft_consensus.cc:493] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.109695 11040 raft_consensus.cc:515] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:45.111784 11040 leader_election.cc:290] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:45.109087 10912 raft_consensus.cc:2468] T a4eb868d99c9464996fb44dd3acdca7a P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 0.
I20260709 13:01:45.031606 10836 raft_consensus.cc:2468] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 1.
I20260709 13:01:45.109305 11033 raft_consensus.cc:740] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.113111 11033 consensus_queue.cc:260] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:45.082952 10833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4eb868d99c9464996fb44dd3acdca7a" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:45.114413 10833 raft_consensus.cc:2468] T a4eb868d99c9464996fb44dd3acdca7a P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 0.
I20260709 13:01:45.094730 10659 catalog_manager.cc:5697] T 401ec66526fe4ad0a997979233dd7ef3 P 5e62c52a41f7476a908dd377c1a8a79f reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196). New cstate: current_term: 1 leader_uuid: "5e62c52a41f7476a908dd377c1a8a79f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:45.115664 11033 ts_tablet_manager.cc:1434] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.000s
I20260709 13:01:45.116890 11033 tablet_bootstrap.cc:492] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367: Bootstrap starting.
I20260709 13:01:45.119938 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6842d144c244233a18d121c7966712a" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:45.120676 10762 raft_consensus.cc:2468] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 0.
I20260709 13:01:45.108415 10763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ecfbc8cc6e7441fb568b197ffade11e" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:45.123483 11033 tablet_bootstrap.cc:654] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:45.100530 10728 leader_election.cc:343] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:45.129703 10728 leader_election.cc:304] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0; no voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:45.130807 11484 raft_consensus.cc:2749] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:45.105311 11037 raft_consensus.cc:359] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:45.075150 10834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ecfbc8cc6e7441fb568b197ffade11e" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:45.131556 11037 raft_consensus.cc:385] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.131827 10834 raft_consensus.cc:2468] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 0.
I20260709 13:01:45.103366 11400 leader_election.cc:290] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:45.131901 11037 raft_consensus.cc:740] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.133809 11037 consensus_queue.cc:260] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:45.135998 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6842d144c244233a18d121c7966712a" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:45.136847 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ecfbc8cc6e7441fb568b197ffade11e" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:45.138922 10907 raft_consensus.cc:2468] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 0.
I20260709 13:01:45.140233 10877 leader_election.cc:304] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:45.141173 11400 raft_consensus.cc:2804] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:45.141562 11400 raft_consensus.cc:493] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.141870 11400 raft_consensus.cc:3060] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.142721 10876 leader_election.cc:304] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:45.143548 11429 raft_consensus.cc:2804] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:45.143851 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ecfbc8cc6e7441fb568b197ffade11e" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
W20260709 13:01:45.144241 10876 leader_election.cc:343] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:45.143905 11429 raft_consensus.cc:493] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.145107 11429 raft_consensus.cc:3060] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:45.146215 10876 leader_election.cc:343] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:45.150159 11037 ts_tablet_manager.cc:1434] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.113s	user 0.008s	sys 0.000s
I20260709 13:01:45.151396 11037 tablet_bootstrap.cc:492] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:45.157104 10951 leader_election.cc:304] T a4eb868d99c9464996fb44dd3acdca7a P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:45.151737 10804 leader_election.cc:304] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:45.157980 11402 raft_consensus.cc:2804] T a4eb868d99c9464996fb44dd3acdca7a P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:45.158247 11189 raft_consensus.cc:2804] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:45.158648 11189 raft_consensus.cc:493] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.158998 11189 raft_consensus.cc:3060] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.159147 11429 raft_consensus.cc:515] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:45.159943 11402 raft_consensus.cc:493] T a4eb868d99c9464996fb44dd3acdca7a P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.160369 11402 raft_consensus.cc:3060] T a4eb868d99c9464996fb44dd3acdca7a P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.170657 11032 tablet_bootstrap.cc:492] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:45.171259 11032 ts_tablet_manager.cc:1403] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.200s	user 0.012s	sys 0.033s
I20260709 13:01:45.178700 11032 raft_consensus.cc:359] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:45.179414 11032 raft_consensus.cc:385] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.179708 11032 raft_consensus.cc:740] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
W20260709 13:01:45.181003 10802 leader_election.cc:343] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:45.185233 11429 leader_election.cc:290] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Requested vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:45.179414 11033 tablet_bootstrap.cc:492] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367: No bootstrap required, opened a new log
I20260709 13:01:45.189865 11033 ts_tablet_manager.cc:1403] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.004s
I20260709 13:01:45.191349 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6842d144c244233a18d121c7966712a" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:45.192070 10762 raft_consensus.cc:3060] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.192281 11032 consensus_queue.cc:260] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:45.199342 11032 ts_tablet_manager.cc:1434] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 13:01:45.201363 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6842d144c244233a18d121c7966712a" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
W20260709 13:01:45.203063 10876 leader_election.cc:343] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:45.205240 11189 raft_consensus.cc:515] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:45.206614 11032 tablet_bootstrap.cc:492] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:45.213289 11189 leader_election.cc:290] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Requested vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:45.214128 10762 raft_consensus.cc:2468] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 1.
I20260709 13:01:45.214593 10911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ecfbc8cc6e7441fb568b197ffade11e" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:45.216518 11033 raft_consensus.cc:359] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:45.231798 11033 raft_consensus.cc:385] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.232089 11033 raft_consensus.cc:740] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.232805 10876 leader_election.cc:304] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:01:45.232806 11033 consensus_queue.cc:260] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:45.234433 11428 raft_consensus.cc:2804] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:45.234774 11033 ts_tablet_manager.cc:1434] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 13:01:45.224861 10763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ecfbc8cc6e7441fb568b197ffade11e" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:45.234956 11428 raft_consensus.cc:697] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Becoming Leader. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Running, Role: LEADER
I20260709 13:01:45.226385 11032 tablet_bootstrap.cc:654] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.227120 11400 raft_consensus.cc:515] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:45.240489 11428 consensus_queue.cc:237] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:45.243126 11400 leader_election.cc:290] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Requested vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:45.201387 11402 raft_consensus.cc:515] T a4eb868d99c9464996fb44dd3acdca7a P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:45.245252 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ecfbc8cc6e7441fb568b197ffade11e" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:45.246061 11402 leader_election.cc:290] T a4eb868d99c9464996fb44dd3acdca7a P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Requested vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
W20260709 13:01:45.247332 10876 leader_election.cc:343] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:45.224536 11031 tablet_bootstrap.cc:492] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:45.242743 10911 raft_consensus.cc:2393] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dbd1fdffc68440e5b6250f6d95a4a367 in current term 1: Already voted for candidate b778a184b0ac46f5b86ce4fe363dcbab in this term.
I20260709 13:01:45.249231 11031 ts_tablet_manager.cc:1403] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.246s	user 0.014s	sys 0.018s
I20260709 13:01:45.254207 10833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4eb868d99c9464996fb44dd3acdca7a" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:45.230818 11037 tablet_bootstrap.cc:654] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.255204 10833 raft_consensus.cc:3060] T a4eb868d99c9464996fb44dd3acdca7a P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:45.255553 10802 leader_election.cc:343] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:45.259052 10834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ecfbc8cc6e7441fb568b197ffade11e" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:45.259631 10804 leader_election.cc:304] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbd1fdffc68440e5b6250f6d95a4a367; no voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:45.260008 10834 raft_consensus.cc:2393] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b778a184b0ac46f5b86ce4fe363dcbab in current term 1: Already voted for candidate dbd1fdffc68440e5b6250f6d95a4a367 in this term.
I20260709 13:01:45.259784 11031 raft_consensus.cc:359] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:45.260625 11031 raft_consensus.cc:385] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.260716 11404 raft_consensus.cc:2749] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:45.260968 11031 raft_consensus.cc:740] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.265235 11031 consensus_queue.cc:260] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:45.263485 10877 leader_election.cc:304] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab; no voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:45.268819 11429 raft_consensus.cc:2749] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:45.270129 10833 raft_consensus.cc:2468] T a4eb868d99c9464996fb44dd3acdca7a P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 1.
I20260709 13:01:45.271763 10951 leader_election.cc:304] T a4eb868d99c9464996fb44dd3acdca7a P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:45.273270 11402 raft_consensus.cc:2804] T a4eb868d99c9464996fb44dd3acdca7a P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:45.273927 11402 raft_consensus.cc:697] T a4eb868d99c9464996fb44dd3acdca7a P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Becoming Leader. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
I20260709 13:01:45.273392 11189 raft_consensus.cc:493] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.274897 11402 consensus_queue.cc:237] T a4eb868d99c9464996fb44dd3acdca7a P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:45.278576 11031 ts_tablet_manager.cc:1434] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 13:01:45.279875 11031 tablet_bootstrap.cc:492] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab: Bootstrap starting.
I20260709 13:01:45.286562 11037 tablet_bootstrap.cc:492] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:45.287330 11037 ts_tablet_manager.cc:1403] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.136s	user 0.009s	sys 0.007s
I20260709 13:01:45.290719 11037 raft_consensus.cc:359] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:45.291453 11037 raft_consensus.cc:385] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.291744 11037 raft_consensus.cc:740] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.292555 11037 consensus_queue.cc:260] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:45.298206 11189 raft_consensus.cc:515] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:45.299937 11037 ts_tablet_manager.cc:1434] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:01:45.306878 11031 tablet_bootstrap.cc:654] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.310860 11032 tablet_bootstrap.cc:492] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:45.311426 11032 ts_tablet_manager.cc:1403] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.105s	user 0.011s	sys 0.011s
I20260709 13:01:45.312556 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14dc277ad7874e419ed2d2bff2165611" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:45.312639 10763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14dc277ad7874e419ed2d2bff2165611" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:45.312708 11037 tablet_bootstrap.cc:492] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
W20260709 13:01:45.316992 10804 leader_election.cc:343] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:45.316838 10911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4eb868d99c9464996fb44dd3acdca7a" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
W20260709 13:01:45.322034 10802 leader_election.cc:343] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:45.329618 10802 leader_election.cc:304] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbd1fdffc68440e5b6250f6d95a4a367; no voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:45.330858 10911 raft_consensus.cc:3060] T a4eb868d99c9464996fb44dd3acdca7a P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.311719 11189 leader_election.cc:290] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:45.336855 11404 raft_consensus.cc:2749] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:45.369695 11032 raft_consensus.cc:359] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:45.371479 11037 tablet_bootstrap.cc:654] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.370437 11032 raft_consensus.cc:385] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.374178 11032 raft_consensus.cc:740] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.376848 11032 consensus_queue.cc:260] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:45.378432 11032 ts_tablet_manager.cc:1434] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.066s	user 0.004s	sys 0.000s
I20260709 13:01:45.384624 11396 raft_consensus.cc:493] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.385231 11396 raft_consensus.cc:515] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
W20260709 13:01:45.390046 10708 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:45.387228 11394 raft_consensus.cc:493] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.391225 11394 raft_consensus.cc:515] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:45.396319 11394 leader_election.cc:290] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:45.399003 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b562356d3b4807a92648800cfe3dac" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:45.399785 10981 raft_consensus.cc:2468] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 0.
I20260709 13:01:45.405752 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b562356d3b4807a92648800cfe3dac" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:45.406611 10907 raft_consensus.cc:2468] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 0.
I20260709 13:01:45.409343 11396 leader_election.cc:290] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:45.410392 11032 tablet_bootstrap.cc:492] T c6842d144c244233a18d121c7966712a P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:45.414243 10727 leader_election.cc:304] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f; no voters: 
I20260709 13:01:45.416441 11484 raft_consensus.cc:2804] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:45.417021 11484 raft_consensus.cc:493] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.417361 11484 raft_consensus.cc:3060] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.421036 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ecfbc8cc6e7441fb568b197ffade11e" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:45.422202 10837 raft_consensus.cc:2393] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 346158a6aa6747c1b8d31b4fb80238d0 in current term 1: Already voted for candidate dbd1fdffc68440e5b6250f6d95a4a367 in this term.
I20260709 13:01:45.429617 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ecfbc8cc6e7441fb568b197ffade11e" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:45.430927 10907 raft_consensus.cc:2393] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 346158a6aa6747c1b8d31b4fb80238d0 in current term 1: Already voted for candidate b778a184b0ac46f5b86ce4fe363dcbab in this term.
I20260709 13:01:45.436952 10729 leader_election.cc:304] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0; no voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:45.439044 11396 raft_consensus.cc:3060] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.440086 11032 tablet_bootstrap.cc:654] T c6842d144c244233a18d121c7966712a P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.447064 11031 tablet_bootstrap.cc:492] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab: No bootstrap required, opened a new log
I20260709 13:01:45.433926 10657 catalog_manager.cc:5697] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab reported cstate change: term changed from 0 to 1, leader changed from <none> to b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195). New cstate: current_term: 1 leader_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:45.447786 11031 ts_tablet_manager.cc:1403] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent bootstrapping tablet: real 0.168s	user 0.013s	sys 0.000s
I20260709 13:01:45.445355 11340 raft_consensus.cc:493] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.455224 11336 consensus_queue.cc:1048] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:45.459084 11031 raft_consensus.cc:359] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:45.454110 10661 catalog_manager.cc:5697] T a4eb868d99c9464996fb44dd3acdca7a P 5e62c52a41f7476a908dd377c1a8a79f reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196). New cstate: current_term: 1 leader_uuid: "5e62c52a41f7476a908dd377c1a8a79f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:45.451838 11340 raft_consensus.cc:515] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:45.459846 11031 raft_consensus.cc:385] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.462684 11037 tablet_bootstrap.cc:492] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:45.463956 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211c168fa9614dbda8d8870bf5713616" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:45.473634 11037 ts_tablet_manager.cc:1403] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.161s	user 0.042s	sys 0.019s
W20260709 13:01:45.473783 10802 leader_election.cc:343] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:45.469775 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211c168fa9614dbda8d8870bf5713616" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:45.477404 10762 raft_consensus.cc:2468] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 0.
I20260709 13:01:45.469938 11484 raft_consensus.cc:515] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:45.476599 11031 raft_consensus.cc:740] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.478907 10802 leader_election.cc:304] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:01:45.480535 11031 consensus_queue.cc:260] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:45.463210 11340 leader_election.cc:290] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:45.483201 11404 raft_consensus.cc:2804] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:45.486680 11404 raft_consensus.cc:493] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.487047 11404 raft_consensus.cc:3060] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.487560 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b562356d3b4807a92648800cfe3dac" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:45.488224 10985 raft_consensus.cc:3060] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.489414 10911 raft_consensus.cc:2468] T a4eb868d99c9464996fb44dd3acdca7a P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 1.
I20260709 13:01:45.484602 11031 ts_tablet_manager.cc:1434] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.003s
I20260709 13:01:45.484706 11037 raft_consensus.cc:359] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:45.493257 11037 raft_consensus.cc:385] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.494578 10908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b562356d3b4807a92648800cfe3dac" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:45.493578 11037 raft_consensus.cc:740] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.496078 11037 consensus_queue.cc:260] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:45.495225 10908 raft_consensus.cc:3060] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.497694 11394 consensus_queue.cc:1048] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:45.509143 11037 ts_tablet_manager.cc:1434] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:01:45.511397 11037 tablet_bootstrap.cc:492] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:45.512537 11323 consensus_queue.cc:1048] T 401ec66526fe4ad0a997979233dd7ef3 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:45.482156 11396 raft_consensus.cc:2749] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:45.523010 11484 leader_election.cc:290] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Requested vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:45.520051 10908 raft_consensus.cc:2468] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 1.
I20260709 13:01:45.531960 11037 tablet_bootstrap.cc:654] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.524611 11404 raft_consensus.cc:515] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:45.537401 11404 leader_election.cc:290] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Requested vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:45.540726 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211c168fa9614dbda8d8870bf5713616" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
W20260709 13:01:45.543242 10802 leader_election.cc:343] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:45.550105 10729 leader_election.cc:304] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:45.520021 10985 raft_consensus.cc:2468] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 1.
I20260709 13:01:45.553671 11032 tablet_bootstrap.cc:492] T c6842d144c244233a18d121c7966712a P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:45.554342 11032 ts_tablet_manager.cc:1403] T c6842d144c244233a18d121c7966712a P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.144s	user 0.010s	sys 0.009s
I20260709 13:01:45.557660 11396 raft_consensus.cc:2804] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:45.560271 11396 raft_consensus.cc:697] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:01:45.561316 11323 raft_consensus.cc:493] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.561868 10762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211c168fa9614dbda8d8870bf5713616" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:45.562065 11323 raft_consensus.cc:515] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:45.562615 10762 raft_consensus.cc:3060] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.561304 11396 consensus_queue.cc:237] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:45.566401 11323 leader_election.cc:290] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:45.566624 10834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1470fc689d7429dada3bf5d45a82374" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:45.567342 10834 raft_consensus.cc:2468] T c1470fc689d7429dada3bf5d45a82374 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 0.
I20260709 13:01:45.568063 10760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1470fc689d7429dada3bf5d45a82374" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:45.568622 10951 leader_election.cc:304] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:45.569702 10762 raft_consensus.cc:2468] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 1.
I20260709 13:01:45.570017 11402 raft_consensus.cc:493] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.570497 11402 raft_consensus.cc:515] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:45.571583 11037 tablet_bootstrap.cc:492] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:45.572082 11037 ts_tablet_manager.cc:1403] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.015s
W20260709 13:01:45.569669 10950 leader_election.cc:343] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:45.575445 10760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3f9e2acc7244a26b1dbae53f8d0040a" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
W20260709 13:01:45.577220 10950 leader_election.cc:343] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:45.578869 11402 leader_election.cc:290] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:45.580843 10802 leader_election.cc:304] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:01:45.569696 11323 raft_consensus.cc:2804] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:45.581854 11323 raft_consensus.cc:493] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.582629 11323 raft_consensus.cc:3060] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.582784 11404 raft_consensus.cc:2804] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:45.587121 11404 raft_consensus.cc:697] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Becoming Leader. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Running, Role: LEADER
I20260709 13:01:45.588405 11402 consensus_queue.cc:1048] T 401ec66526fe4ad0a997979233dd7ef3 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:45.588230 11404 consensus_queue.cc:237] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:45.581154 10908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3f9e2acc7244a26b1dbae53f8d0040a" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:45.595213 10908 raft_consensus.cc:2468] T c3f9e2acc7244a26b1dbae53f8d0040a P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 0.
I20260709 13:01:45.596581 10952 leader_election.cc:304] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 346158a6aa6747c1b8d31b4fb80238d0
I20260709 13:01:45.597826 11402 raft_consensus.cc:2804] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:45.598297 11402 raft_consensus.cc:493] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.598686 11402 raft_consensus.cc:3060] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.616505 11334 raft_consensus.cc:493] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.617063 11334 raft_consensus.cc:515] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:45.619241 11334 leader_election.cc:290] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:45.621598 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14dc277ad7874e419ed2d2bff2165611" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:45.622682 10907 raft_consensus.cc:2468] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 0.
I20260709 13:01:45.623711 10729 leader_election.cc:304] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:45.624507 10834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14dc277ad7874e419ed2d2bff2165611" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:45.625023 11394 raft_consensus.cc:2804] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:45.625276 10834 raft_consensus.cc:2468] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 0.
I20260709 13:01:45.625430 11394 raft_consensus.cc:493] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:45.625993 11394 raft_consensus.cc:3060] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.625635 11037 raft_consensus.cc:359] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:45.629566 11402 raft_consensus.cc:515] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:45.630013 11037 raft_consensus.cc:385] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.631362 11037 raft_consensus.cc:740] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
W20260709 13:01:45.631465 10876 consensus_peers.cc:597] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab -> Peer 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509): Couldn't send request to peer 5e62c52a41f7476a908dd377c1a8a79f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:45.632443 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3f9e2acc7244a26b1dbae53f8d0040a" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:45.632266 11037 consensus_queue.cc:260] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:45.633105 10907 raft_consensus.cc:3060] T c3f9e2acc7244a26b1dbae53f8d0040a P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.634143 11037 ts_tablet_manager.cc:1434] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.001s
I20260709 13:01:45.635224 11037 tablet_bootstrap.cc:492] T 4a819525c849499885ee37af7d0f42a2 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:45.614919 11323 raft_consensus.cc:515] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:45.653775 11032 raft_consensus.cc:359] T c6842d144c244233a18d121c7966712a P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:45.654400 11032 raft_consensus.cc:385] T c6842d144c244233a18d121c7966712a P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.654665 11032 raft_consensus.cc:740] T c6842d144c244233a18d121c7966712a P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.655974 11032 consensus_queue.cc:260] T c6842d144c244233a18d121c7966712a P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:45.686712 11323 leader_election.cc:290] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Requested vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:45.688361 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1470fc689d7429dada3bf5d45a82374" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:45.689025 10837 raft_consensus.cc:3060] T c1470fc689d7429dada3bf5d45a82374 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.693706 10907 raft_consensus.cc:2468] T c3f9e2acc7244a26b1dbae53f8d0040a P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 1.
I20260709 13:01:45.694965 11394 raft_consensus.cc:515] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:45.699797 11037 tablet_bootstrap.cc:654] T 4a819525c849499885ee37af7d0f42a2 P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.700850 11032 ts_tablet_manager.cc:1434] T c6842d144c244233a18d121c7966712a P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.146s	user 0.009s	sys 0.001s
I20260709 13:01:45.701937 11032 tablet_bootstrap.cc:492] T 211c168fa9614dbda8d8870bf5713616 P 5e62c52a41f7476a908dd377c1a8a79f: Bootstrap starting.
I20260709 13:01:45.704267 10658 catalog_manager.cc:5697] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 reported cstate change: term changed from 0 to 1, leader changed from <none> to dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:45.715597 11402 leader_election.cc:290] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Requested vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:45.717602 11394 leader_election.cc:290] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Requested vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:45.711233 10837 raft_consensus.cc:2468] T c1470fc689d7429dada3bf5d45a82374 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 1.
I20260709 13:01:45.707621 11032 tablet_bootstrap.cc:654] T 211c168fa9614dbda8d8870bf5713616 P 5e62c52a41f7476a908dd377c1a8a79f: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.720063 10834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14dc277ad7874e419ed2d2bff2165611" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:45.723305 10951 leader_election.cc:304] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:45.727593 10760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3f9e2acc7244a26b1dbae53f8d0040a" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
W20260709 13:01:45.729873 10950 leader_election.cc:343] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:45.730500 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14dc277ad7874e419ed2d2bff2165611" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:45.731175 10907 raft_consensus.cc:3060] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.729374 11037 tablet_bootstrap.cc:492] T 4a819525c849499885ee37af7d0f42a2 P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:45.732972 11037 ts_tablet_manager.cc:1403] T 4a819525c849499885ee37af7d0f42a2 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.098s	user 0.006s	sys 0.010s
I20260709 13:01:45.734535 10834 raft_consensus.cc:3060] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.739164 10760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1470fc689d7429dada3bf5d45a82374" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:45.744063 10760 raft_consensus.cc:3060] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.739217 11509 raft_consensus.cc:2804] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:45.749145 11037 raft_consensus.cc:359] T 4a819525c849499885ee37af7d0f42a2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:45.739312 11318 consensus_queue.cc:1048] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:01:45.754213 11037 raft_consensus.cc:385] T 4a819525c849499885ee37af7d0f42a2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.755070 10658 catalog_manager.cc:5697] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:45.754570 11037 raft_consensus.cc:740] T 4a819525c849499885ee37af7d0f42a2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.756767 11037 consensus_queue.cc:260] T 4a819525c849499885ee37af7d0f42a2 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:45.763062 11037 ts_tablet_manager.cc:1434] T 4a819525c849499885ee37af7d0f42a2 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.004s
I20260709 13:01:45.764094 11037 tablet_bootstrap.cc:492] T c3f9e2acc7244a26b1dbae53f8d0040a P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:45.760792 10952 leader_election.cc:304] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 346158a6aa6747c1b8d31b4fb80238d0
I20260709 13:01:45.775163 10834 raft_consensus.cc:2468] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 1.
I20260709 13:01:45.778195 11402 raft_consensus.cc:2804] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:45.779244 11402 raft_consensus.cc:697] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Becoming Leader. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
I20260709 13:01:45.780185 11402 consensus_queue.cc:237] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:45.753922 11509 raft_consensus.cc:697] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Becoming Leader. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
I20260709 13:01:45.795168 11509 consensus_queue.cc:237] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:45.790004 10760 raft_consensus.cc:2468] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 1.
I20260709 13:01:45.808072 11032 tablet_bootstrap.cc:492] T 211c168fa9614dbda8d8870bf5713616 P 5e62c52a41f7476a908dd377c1a8a79f: No bootstrap required, opened a new log
I20260709 13:01:45.808840 11032 ts_tablet_manager.cc:1403] T 211c168fa9614dbda8d8870bf5713616 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent bootstrapping tablet: real 0.107s	user 0.017s	sys 0.002s
I20260709 13:01:45.796449 10907 raft_consensus.cc:2468] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 1.
W20260709 13:01:45.818892 10727 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42509, user_credentials={real_user=slave}} blocked reactor thread for 46700.8us
W20260709 13:01:45.823743 10728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35051, user_credentials={real_user=slave}} blocked reactor thread for 53948.4us
I20260709 13:01:45.826267 10757 raft_consensus.cc:3060] T 4a819525c849499885ee37af7d0f42a2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:45.821174 10729 leader_election.cc:304] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:45.830804 11510 raft_consensus.cc:2804] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:45.831271 11510 raft_consensus.cc:697] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:01:45.831851 11510 consensus_queue.cc:237] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:45.841214 11037 tablet_bootstrap.cc:654] T c3f9e2acc7244a26b1dbae53f8d0040a P 346158a6aa6747c1b8d31b4fb80238d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:45.846766 11323 consensus_queue.cc:1048] T a4eb868d99c9464996fb44dd3acdca7a P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:45.866467 11508 consensus_queue.cc:1048] T a4eb868d99c9464996fb44dd3acdca7a P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:45.867527 11032 raft_consensus.cc:359] T 211c168fa9614dbda8d8870bf5713616 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:45.871201 11032 raft_consensus.cc:385] T 211c168fa9614dbda8d8870bf5713616 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.871502 11032 raft_consensus.cc:740] T 211c168fa9614dbda8d8870bf5713616 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.873790 11032 consensus_queue.cc:260] T 211c168fa9614dbda8d8870bf5713616 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:45.868521 10657 catalog_manager.cc:5697] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:45.926237 11037 tablet_bootstrap.cc:492] T c3f9e2acc7244a26b1dbae53f8d0040a P 346158a6aa6747c1b8d31b4fb80238d0: No bootstrap required, opened a new log
I20260709 13:01:45.926787 11037 ts_tablet_manager.cc:1403] T c3f9e2acc7244a26b1dbae53f8d0040a P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.163s	user 0.009s	sys 0.003s
I20260709 13:01:45.928417 11032 ts_tablet_manager.cc:1434] T 211c168fa9614dbda8d8870bf5713616 P 5e62c52a41f7476a908dd377c1a8a79f: Time spent starting tablet: real 0.119s	user 0.008s	sys 0.000s
I20260709 13:01:45.929884 11037 raft_consensus.cc:359] T c3f9e2acc7244a26b1dbae53f8d0040a P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:45.930667 11037 raft_consensus.cc:385] T c3f9e2acc7244a26b1dbae53f8d0040a P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:45.930953 11037 raft_consensus.cc:740] T c3f9e2acc7244a26b1dbae53f8d0040a P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:45.964094 11037 consensus_queue.cc:260] T c3f9e2acc7244a26b1dbae53f8d0040a P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:45.970489 10661 catalog_manager.cc:5697] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196). New cstate: current_term: 1 leader_uuid: "5e62c52a41f7476a908dd377c1a8a79f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:45.971719 10661 catalog_manager.cc:5697] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196). New cstate: current_term: 1 leader_uuid: "5e62c52a41f7476a908dd377c1a8a79f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:45.982100 11037 ts_tablet_manager.cc:1434] T c3f9e2acc7244a26b1dbae53f8d0040a P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.055s	user 0.004s	sys 0.003s
I20260709 13:01:46.028760 10981 raft_consensus.cc:3060] T c6842d144c244233a18d121c7966712a P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.076521 11358 consensus_queue.cc:1048] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:46.086925 10981 raft_consensus.cc:3060] T 211c168fa9614dbda8d8870bf5713616 P 5e62c52a41f7476a908dd377c1a8a79f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.095359 11340 consensus_queue.cc:1048] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:46.112085 11516 consensus_queue.cc:1048] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:46.124423 11516 consensus_queue.cc:1048] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:46.147891 11516 raft_consensus.cc:493] T c3f9e2acc7244a26b1dbae53f8d0040a P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.148329 11516 raft_consensus.cc:515] T c3f9e2acc7244a26b1dbae53f8d0040a P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:46.150409 11516 leader_election.cc:290] T c3f9e2acc7244a26b1dbae53f8d0040a P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:01:46.151851 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3f9e2acc7244a26b1dbae53f8d0040a" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:46.151942 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3f9e2acc7244a26b1dbae53f8d0040a" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:46.153026 10907 raft_consensus.cc:2393] T c3f9e2acc7244a26b1dbae53f8d0040a P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 346158a6aa6747c1b8d31b4fb80238d0 in current term 1: Already voted for candidate 5e62c52a41f7476a908dd377c1a8a79f in this term.
I20260709 13:01:46.153998 10729 leader_election.cc:304] T c3f9e2acc7244a26b1dbae53f8d0040a P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0; no voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:46.154593 11516 raft_consensus.cc:3060] T c3f9e2acc7244a26b1dbae53f8d0040a P 346158a6aa6747c1b8d31b4fb80238d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:46.160683 11516 raft_consensus.cc:2749] T c3f9e2acc7244a26b1dbae53f8d0040a P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:46.222532 11516 consensus_queue.cc:1048] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:46.241923 11514 consensus_queue.cc:1048] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:46.261807 11509 consensus_queue.cc:1048] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:46.265946 11508 consensus_queue.cc:1048] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:46.279682 11509 consensus_queue.cc:1048] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:46.296928 11420 consensus_queue.cc:1048] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:01:46.419572 10708 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:46.773197 11428 raft_consensus.cc:493] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.774070 11428 raft_consensus.cc:515] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:46.779917 11428 leader_election.cc:290] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:46.782052 10757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ecfbc8cc6e7441fb568b197ffade11e" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:46.783104 10757 raft_consensus.cc:2468] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 1.
I20260709 13:01:46.789526 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ecfbc8cc6e7441fb568b197ffade11e" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:46.790683 10836 raft_consensus.cc:2468] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 1.
I20260709 13:01:46.795447 10877 leader_election.cc:304] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:46.797102 11428 raft_consensus.cc:2804] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:46.797658 11428 raft_consensus.cc:493] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.798715 11428 raft_consensus.cc:3060] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:46.811316 11428 raft_consensus.cc:515] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:46.814936 10757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ecfbc8cc6e7441fb568b197ffade11e" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:46.815582 10757 raft_consensus.cc:3060] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:46.817993 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ecfbc8cc6e7441fb568b197ffade11e" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:46.818645 10836 raft_consensus.cc:3060] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:46.821594 11428 leader_election.cc:290] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 election: Requested vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:46.825241 10757 raft_consensus.cc:2468] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 2.
I20260709 13:01:46.825662 10836 raft_consensus.cc:2468] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 2.
I20260709 13:01:46.826800 10877 leader_election.cc:304] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:46.827589 11428 raft_consensus.cc:2804] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:46.828102 11428 raft_consensus.cc:697] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [term 2 LEADER]: Becoming Leader. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Running, Role: LEADER
I20260709 13:01:46.828964 11428 consensus_queue.cc:237] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:46.841450 10661 catalog_manager.cc:5697] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab reported cstate change: term changed from 0 to 2, leader changed from <none> to b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195). New cstate: current_term: 2 leader_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:47.307986 10763 raft_consensus.cc:1275] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Refusing update from remote peer b778a184b0ac46f5b86ce4fe363dcbab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:01:47.309444 11538 consensus_queue.cc:1048] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:47.324417 10836 raft_consensus.cc:1275] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Refusing update from remote peer b778a184b0ac46f5b86ce4fe363dcbab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:01:47.325862 11428 consensus_queue.cc:1048] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:48.781395   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:01:48.786963 10950 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:48.791030 10950 consensus_peers.cc:597] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:48.809814 10950 consensus_peers.cc:597] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:48.827687   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:48.828930   431 tablet_replica.cc:333] T 4a819525c849499885ee37af7d0f42a2 P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
W20260709 13:01:48.829239 10876 consensus_peers.cc:597] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:48.830089 10876 consensus_peers.cc:597] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:48.830396   431 raft_consensus.cc:2243] T 4a819525c849499885ee37af7d0f42a2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.831394   431 raft_consensus.cc:2272] T 4a819525c849499885ee37af7d0f42a2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.835124   431 tablet_replica.cc:333] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.835979   431 raft_consensus.cc:2243] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.836690   431 raft_consensus.cc:2272] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.842018   431 tablet_replica.cc:333] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
W20260709 13:01:48.842698 10802 consensus_peers.cc:597] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:48.843024   431 raft_consensus.cc:2243] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.844115   431 raft_consensus.cc:2272] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.846642   431 tablet_replica.cc:333] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.847579   431 raft_consensus.cc:2243] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.849293   431 raft_consensus.cc:2272] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:48.853938 10950 consensus_peers.cc:597] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:48.854717   431 tablet_replica.cc:333] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.855702   431 raft_consensus.cc:2243] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.857091   431 raft_consensus.cc:2272] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:48.857635 10802 consensus_peers.cc:597] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:48.860765   431 tablet_replica.cc:333] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.861896   431 raft_consensus.cc:2243] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.863165   431 raft_consensus.cc:2272] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:48.863866 10950 consensus_peers.cc:597] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:48.865443 10802 consensus_peers.cc:597] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:48.866199 10802 consensus_peers.cc:597] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:48.866634   431 tablet_replica.cc:333] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.867379   431 raft_consensus.cc:2243] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.868284   431 raft_consensus.cc:2272] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.870546   431 tablet_replica.cc:333] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.871192   431 raft_consensus.cc:2243] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.871690   431 raft_consensus.cc:2272] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.874215   431 tablet_replica.cc:333] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.875048   431 raft_consensus.cc:2243] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.876209   431 raft_consensus.cc:2272] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.878870   431 tablet_replica.cc:333] T 48e63402e1544658a8d6cf5b9220414b P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.879433   431 raft_consensus.cc:2243] T 48e63402e1544658a8d6cf5b9220414b P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.879901   431 raft_consensus.cc:2272] T 48e63402e1544658a8d6cf5b9220414b P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.882314   431 tablet_replica.cc:333] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.883074   431 raft_consensus.cc:2243] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.883682   431 raft_consensus.cc:2272] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.886504   431 tablet_replica.cc:333] T a8b5a22ddad942d7b4db2b897e159337 P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.887126   431 raft_consensus.cc:2243] T a8b5a22ddad942d7b4db2b897e159337 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.887573   431 raft_consensus.cc:2272] T a8b5a22ddad942d7b4db2b897e159337 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.889959   431 tablet_replica.cc:333] T b5a791a0126444ba90c1fb442e1b809b P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.890631   431 raft_consensus.cc:2243] T b5a791a0126444ba90c1fb442e1b809b P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.891101   431 raft_consensus.cc:2272] T b5a791a0126444ba90c1fb442e1b809b P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.893371   431 tablet_replica.cc:333] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.893900   431 raft_consensus.cc:2243] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.894356   431 raft_consensus.cc:2272] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.896643   431 tablet_replica.cc:333] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.897244   431 raft_consensus.cc:2243] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.898072   431 raft_consensus.cc:2272] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.900816   431 tablet_replica.cc:333] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.901448   431 raft_consensus.cc:2243] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.902071   431 raft_consensus.cc:2272] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.904520   431 tablet_replica.cc:333] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.905143   431 raft_consensus.cc:2243] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.905999   431 raft_consensus.cc:2272] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.908732   431 tablet_replica.cc:333] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.909677   431 raft_consensus.cc:2243] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.910882   431 raft_consensus.cc:2272] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.914328   431 tablet_replica.cc:333] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.915305   431 raft_consensus.cc:2243] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.915889   431 raft_consensus.cc:2272] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:48.916410 10802 consensus_peers.cc:597] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:48.918171   431 tablet_replica.cc:333] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.918949   431 raft_consensus.cc:2243] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.919895   431 raft_consensus.cc:2272] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.922982   431 tablet_replica.cc:333] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.923794   431 raft_consensus.cc:2243] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.924410   431 raft_consensus.cc:2272] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.927526   431 tablet_replica.cc:333] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.928406   431 raft_consensus.cc:2243] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.929138   431 raft_consensus.cc:2272] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.932729   431 tablet_replica.cc:333] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.933513   431 raft_consensus.cc:2243] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.934773   431 raft_consensus.cc:2272] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.937877   431 tablet_replica.cc:333] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.938505   431 raft_consensus.cc:2243] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.939348   431 raft_consensus.cc:2272] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.941861   431 tablet_replica.cc:333] T d4b9835406e84c5b88d3c3eed76a3b95 P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.942710   431 raft_consensus.cc:2243] T d4b9835406e84c5b88d3c3eed76a3b95 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.943328   431 raft_consensus.cc:2272] T d4b9835406e84c5b88d3c3eed76a3b95 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.945907   431 tablet_replica.cc:333] T 16fbb9a91d614ce3834f82ce725667fa P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.946498   431 raft_consensus.cc:2243] T 16fbb9a91d614ce3834f82ce725667fa P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.946976   431 raft_consensus.cc:2272] T 16fbb9a91d614ce3834f82ce725667fa P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.949376   431 tablet_replica.cc:333] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.949980   431 raft_consensus.cc:2243] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.950989   431 raft_consensus.cc:2272] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.953709   431 tablet_replica.cc:333] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.954252   431 raft_consensus.cc:2243] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.955194   431 raft_consensus.cc:2272] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.957783   431 tablet_replica.cc:333] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.958354   431 raft_consensus.cc:2243] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.959247   431 raft_consensus.cc:2272] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.961747   431 tablet_replica.cc:333] T c3f9e2acc7244a26b1dbae53f8d0040a P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.962515   431 raft_consensus.cc:2243] T c3f9e2acc7244a26b1dbae53f8d0040a P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.963137   431 raft_consensus.cc:2272] T c3f9e2acc7244a26b1dbae53f8d0040a P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.966100   431 tablet_replica.cc:333] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
W20260709 13:01:48.965958 10950 consensus_peers.cc:597] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:48.966986   431 raft_consensus.cc:2243] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.967841   431 raft_consensus.cc:2272] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.970465   431 tablet_replica.cc:333] T bec830b175ce40d69b73d9f73ea266a7 P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.971029   431 raft_consensus.cc:2243] T bec830b175ce40d69b73d9f73ea266a7 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.971580   431 raft_consensus.cc:2272] T bec830b175ce40d69b73d9f73ea266a7 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.973999   431 tablet_replica.cc:333] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.974552   431 raft_consensus.cc:2243] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:48.975525   431 raft_consensus.cc:2272] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.977763   431 tablet_replica.cc:333] T b74f82b45a3242568f45f6a3fabeda31 P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.978292   431 raft_consensus.cc:2243] T b74f82b45a3242568f45f6a3fabeda31 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.978734   431 raft_consensus.cc:2272] T b74f82b45a3242568f45f6a3fabeda31 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.980929   431 tablet_replica.cc:333] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.981451   431 raft_consensus.cc:2243] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.981876   431 raft_consensus.cc:2272] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.983973   431 tablet_replica.cc:333] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.984571   431 raft_consensus.cc:2243] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.984997   431 raft_consensus.cc:2272] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.987344   431 tablet_replica.cc:333] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.987890   431 raft_consensus.cc:2243] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.988413   431 raft_consensus.cc:2272] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.990752   431 tablet_replica.cc:333] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.991421   431 raft_consensus.cc:2243] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.991873   431 raft_consensus.cc:2272] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:48.994139   431 tablet_replica.cc:333] T fa2569632a834231ba0f3bad60cf90ee P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.994835   431 raft_consensus.cc:2243] T fa2569632a834231ba0f3bad60cf90ee P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.995404   431 raft_consensus.cc:2272] T fa2569632a834231ba0f3bad60cf90ee P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:48.997728 10950 consensus_peers.cc:597] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:48.998330   431 tablet_replica.cc:333] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:48.998976   431 raft_consensus.cc:2243] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:48.999419   431 raft_consensus.cc:2272] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:49.001569   431 tablet_replica.cc:333] T 96a3b79f0ed34bce9764f4804d72c382 P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:49.002068   431 raft_consensus.cc:2243] T 96a3b79f0ed34bce9764f4804d72c382 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:49.002540   431 raft_consensus.cc:2272] T 96a3b79f0ed34bce9764f4804d72c382 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:49.004866   431 tablet_replica.cc:333] T c72b12d4267d44a1a03db0fe148c8d31 P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:49.005607   431 raft_consensus.cc:2243] T c72b12d4267d44a1a03db0fe148c8d31 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:49.006170   431 raft_consensus.cc:2272] T c72b12d4267d44a1a03db0fe148c8d31 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:49.008268 10876 consensus_peers.cc:597] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:49.009289   431 tablet_replica.cc:333] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
W20260709 13:01:49.009500 10950 consensus_peers.cc:597] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:49.010000   431 raft_consensus.cc:2243] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:49.010558   431 raft_consensus.cc:2272] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:49.013131   431 tablet_replica.cc:333] T a19edd96c26a4c91a7b2a412d8221e5b P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:49.013855   431 raft_consensus.cc:2243] T a19edd96c26a4c91a7b2a412d8221e5b P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:49.014297   431 raft_consensus.cc:2272] T a19edd96c26a4c91a7b2a412d8221e5b P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:49.016408   431 tablet_replica.cc:333] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0: stopping tablet replica
I20260709 13:01:49.016968   431 raft_consensus.cc:2243] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:49.017915   431 raft_consensus.cc:2272] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:49.090669   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:01:49.099383 10876 consensus_peers.cc:597] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:49.114238 10876 consensus_peers.cc:597] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:49.129441 10802 consensus_peers.cc:597] T ccad89aaaf3d48008955a353eb0097b9 P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:49.137184 10802 consensus_peers.cc:597] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:49.159327 10876 consensus_peers.cc:597] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:49.160004 10876 consensus_peers.cc:597] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:49.166960 10802 consensus_peers.cc:597] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:49.184723   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:49.189316 10950 consensus_peers.cc:597] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:49.194389 10802 consensus_peers.cc:597] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:49.200450 11564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:49.202028 11563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:49.202194 11566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:49.203495   431 server_base.cc:1061] running on GCE node
I20260709 13:01:49.208312   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:49.208684   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:49.208914   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602109208892 us; error 0 us; skew 500 ppm
I20260709 13:01:49.209515   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:49.212455   431 webserver.cc:533] Webserver started at http://127.0.107.193:34721/ using document root <none> and password file <none>
I20260709 13:01:49.213053   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:49.213249   431 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:01:49.217715   431 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 13:01:49.227240 11571 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:49.228237   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:01:49.228659   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601786404416-431-0/minicluster-data/ts-0-root
uuid: "346158a6aa6747c1b8d31b4fb80238d0"
format_stamp: "Formatted at 2026-07-09 13:01:34 on dist-test-slave-6j4g"
I20260709 13:01:49.229349   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601786404416-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601786404416-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601786404416-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:49.244077   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:49.245414   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:49.247149   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:49.252357 11578 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:01:49.264863 10802 consensus_peers.cc:597] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:49.295110 10876 consensus_peers.cc:597] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:49.311560 10876 consensus_peers.cc:597] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:49.585100   431 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:01:49.585525   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.334s	user 0.005s	sys 0.004s
I20260709 13:01:49.585919   431 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:01:49.596042 11578 tablet_bootstrap.cc:492] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:49.617515 11578 tablet_bootstrap.cc:492] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:49.618480 11578 tablet_bootstrap.cc:492] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:49.619146 11578 ts_tablet_manager.cc:1403] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.008s
I20260709 13:01:49.622035 11578 raft_consensus.cc:359] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:49.622997 11578 raft_consensus.cc:740] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:49.624094 11578 consensus_queue.cc:260] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:49.632871 11578 ts_tablet_manager.cc:1434] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.013s	user 0.014s	sys 0.000s
I20260709 13:01:49.633662 11578 tablet_bootstrap.cc:492] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:49.683311 11578 tablet_bootstrap.cc:492] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:49.684508 11578 tablet_bootstrap.cc:492] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:49.685184 11578 ts_tablet_manager.cc:1403] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.052s	user 0.029s	sys 0.013s
I20260709 13:01:49.687988 11578 raft_consensus.cc:359] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:49.688673 11578 raft_consensus.cc:740] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:49.689381 11578 consensus_queue.cc:260] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:49.691092 11578 ts_tablet_manager.cc:1434] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:01:49.691888 11578 tablet_bootstrap.cc:492] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:49.704242 11578 tablet_bootstrap.cc:492] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:49.705065 11578 tablet_bootstrap.cc:492] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:49.705621 11578 ts_tablet_manager.cc:1403] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:01:49.707638 11578 raft_consensus.cc:359] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:49.708259 11578 raft_consensus.cc:740] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:49.708900 11578 consensus_queue.cc:260] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:49.710826 11578 ts_tablet_manager.cc:1434] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:01:49.711623 11578 tablet_bootstrap.cc:492] T b74f82b45a3242568f45f6a3fabeda31 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:49.748879 11578 tablet_bootstrap.cc:492] T b74f82b45a3242568f45f6a3fabeda31 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:49.749883 11578 tablet_bootstrap.cc:492] T b74f82b45a3242568f45f6a3fabeda31 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:49.750509 11578 ts_tablet_manager.cc:1403] T b74f82b45a3242568f45f6a3fabeda31 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.039s	user 0.019s	sys 0.008s
I20260709 13:01:49.753055 11578 raft_consensus.cc:359] T b74f82b45a3242568f45f6a3fabeda31 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:49.753743 11578 raft_consensus.cc:740] T b74f82b45a3242568f45f6a3fabeda31 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:49.754400 11578 consensus_queue.cc:260] T b74f82b45a3242568f45f6a3fabeda31 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:49.756428 11578 ts_tablet_manager.cc:1434] T b74f82b45a3242568f45f6a3fabeda31 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:01:49.757238 11578 tablet_bootstrap.cc:492] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:49.792681 11578 tablet_bootstrap.cc:492] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:49.793663 11578 tablet_bootstrap.cc:492] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:49.794281 11578 ts_tablet_manager.cc:1403] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.012s
I20260709 13:01:49.796743 11578 raft_consensus.cc:359] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:49.797412 11578 raft_consensus.cc:740] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:49.798092 11578 consensus_queue.cc:260] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:49.800406 11578 ts_tablet_manager.cc:1434] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:01:49.801239 11578 tablet_bootstrap.cc:492] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:49.816022 11578 tablet_bootstrap.cc:492] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:49.816860 11578 tablet_bootstrap.cc:492] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:49.817402 11578 ts_tablet_manager.cc:1403] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 13:01:49.819295 11578 raft_consensus.cc:359] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:49.819810 11578 raft_consensus.cc:740] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:49.820375 11578 consensus_queue.cc:260] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:49.821806 11578 ts_tablet_manager.cc:1434] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:01:49.822518 11578 tablet_bootstrap.cc:492] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:49.838734 11578 tablet_bootstrap.cc:492] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:49.839636 11578 tablet_bootstrap.cc:492] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:49.840256 11578 ts_tablet_manager.cc:1403] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.004s
I20260709 13:01:49.842689 11578 raft_consensus.cc:359] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:49.843364 11578 raft_consensus.cc:740] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:49.844048 11578 consensus_queue.cc:260] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:49.846155 11578 ts_tablet_manager.cc:1434] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:01:49.846961 11578 tablet_bootstrap.cc:492] T c3f9e2acc7244a26b1dbae53f8d0040a P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:49.860010 11578 tablet_bootstrap.cc:492] T c3f9e2acc7244a26b1dbae53f8d0040a P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:49.861056 11578 tablet_bootstrap.cc:492] T c3f9e2acc7244a26b1dbae53f8d0040a P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:49.861723 11578 ts_tablet_manager.cc:1403] T c3f9e2acc7244a26b1dbae53f8d0040a P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.003s
I20260709 13:01:49.864056 11587 raft_consensus.cc:493] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:49.864274 11578 raft_consensus.cc:359] T c3f9e2acc7244a26b1dbae53f8d0040a P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:49.865026 11578 raft_consensus.cc:740] T c3f9e2acc7244a26b1dbae53f8d0040a P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:49.864753 11587 raft_consensus.cc:515] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:49.865883 11578 consensus_queue.cc:260] T c3f9e2acc7244a26b1dbae53f8d0040a P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:49.866991 11587 leader_election.cc:290] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:49.868155 11578 ts_tablet_manager.cc:1434] T c3f9e2acc7244a26b1dbae53f8d0040a P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:01:49.869161 11578 tablet_bootstrap.cc:492] T 96a3b79f0ed34bce9764f4804d72c382 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:49.873027 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141934a83d874ca1bf1d69f49b95f1fc" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
W20260709 13:01:49.875119 10876 leader_election.cc:336] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111)
I20260709 13:01:49.875555 10876 leader_election.cc:304] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab; no voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:49.876389   431 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:01:49.876786   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.291s	user 0.267s	sys 0.004s
I20260709 13:01:49.878813 11587 raft_consensus.cc:2749] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:49.881489 11420 raft_consensus.cc:493] T 2ea7c6df9b4340ffaf28c5a78966c74b P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:49.883561 11420 raft_consensus.cc:515] T 2ea7c6df9b4340ffaf28c5a78966c74b P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:49.885670 11420 leader_election.cc:290] T 2ea7c6df9b4340ffaf28c5a78966c74b P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:49.888379 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7c6df9b4340ffaf28c5a78966c74b" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:49.891104 11578 tablet_bootstrap.cc:492] T 96a3b79f0ed34bce9764f4804d72c382 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:49.892151 11578 tablet_bootstrap.cc:492] T 96a3b79f0ed34bce9764f4804d72c382 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:49.892859 11578 ts_tablet_manager.cc:1403] T 96a3b79f0ed34bce9764f4804d72c382 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.002s
I20260709 13:01:49.895705 11578 raft_consensus.cc:359] T 96a3b79f0ed34bce9764f4804d72c382 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:49.896425 11578 raft_consensus.cc:740] T 96a3b79f0ed34bce9764f4804d72c382 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:49.897356 11578 consensus_queue.cc:260] T 96a3b79f0ed34bce9764f4804d72c382 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
W20260709 13:01:49.897755 10950 leader_election.cc:336] T 2ea7c6df9b4340ffaf28c5a78966c74b P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111)
I20260709 13:01:49.898504 10950 leader_election.cc:304] T 2ea7c6df9b4340ffaf28c5a78966c74b P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f; no voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:49.899317 11420 raft_consensus.cc:2749] T 2ea7c6df9b4340ffaf28c5a78966c74b P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:49.899775 11578 ts_tablet_manager.cc:1434] T 96a3b79f0ed34bce9764f4804d72c382 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:01:49.900748 11578 tablet_bootstrap.cc:492] T 48e63402e1544658a8d6cf5b9220414b P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:49.908746 11420 raft_consensus.cc:493] T 9bf0d822416f49caacd1f92cebd84eb8 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:49.909354 11420 raft_consensus.cc:515] T 9bf0d822416f49caacd1f92cebd84eb8 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:49.911461 11420 leader_election.cc:290] T 9bf0d822416f49caacd1f92cebd84eb8 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:49.913025 10905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf0d822416f49caacd1f92cebd84eb8" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
W20260709 13:01:49.917331 10950 leader_election.cc:336] T 9bf0d822416f49caacd1f92cebd84eb8 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111)
I20260709 13:01:49.917826 10950 leader_election.cc:304] T 9bf0d822416f49caacd1f92cebd84eb8 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f; no voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:49.918519 11420 raft_consensus.cc:2749] T 9bf0d822416f49caacd1f92cebd84eb8 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:49.922472 11578 tablet_bootstrap.cc:492] T 48e63402e1544658a8d6cf5b9220414b P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:49.924050 11578 tablet_bootstrap.cc:492] T 48e63402e1544658a8d6cf5b9220414b P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:49.924844 11578 ts_tablet_manager.cc:1403] T 48e63402e1544658a8d6cf5b9220414b P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.000s
I20260709 13:01:49.927747 11578 raft_consensus.cc:359] T 48e63402e1544658a8d6cf5b9220414b P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:49.928519 11578 raft_consensus.cc:740] T 48e63402e1544658a8d6cf5b9220414b P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:49.929231 11578 consensus_queue.cc:260] T 48e63402e1544658a8d6cf5b9220414b P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:49.931586 11578 ts_tablet_manager.cc:1434] T 48e63402e1544658a8d6cf5b9220414b P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:01:49.932531 11578 tablet_bootstrap.cc:492] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:49.948964 11578 tablet_bootstrap.cc:492] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:49.949718 11578 tablet_bootstrap.cc:492] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:49.950263 11578 ts_tablet_manager.cc:1403] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 13:01:49.952250 11578 raft_consensus.cc:359] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:49.952809 11578 raft_consensus.cc:740] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:49.953423 11578 consensus_queue.cc:260] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:49.954911 11578 ts_tablet_manager.cc:1434] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:01:49.955597 11578 tablet_bootstrap.cc:492] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:49.959946 11420 raft_consensus.cc:493] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:49.960665 11420 raft_consensus.cc:515] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:49.966854 10905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b562356d3b4807a92648800cfe3dac" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
W20260709 13:01:49.970687 10950 leader_election.cc:336] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111)
I20260709 13:01:49.971277 10950 leader_election.cc:304] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f; no voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:49.972148 11420 leader_election.cc:290] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:49.972420 11538 raft_consensus.cc:493] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:49.973582 11538 raft_consensus.cc:515] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:49.975631 11538 leader_election.cc:290] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:49.978442 11578 tablet_bootstrap.cc:492] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:49.978850 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf0d822416f49caacd1f92cebd84eb8" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:49.979645 11578 tablet_bootstrap.cc:492] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:49.980883 11578 ts_tablet_manager.cc:1403] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.007s
I20260709 13:01:49.979681 10981 raft_consensus.cc:2468] T 9bf0d822416f49caacd1f92cebd84eb8 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 1.
I20260709 13:01:49.985277 11578 raft_consensus.cc:359] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:49.986250 11578 raft_consensus.cc:740] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:49.978894 11579 raft_consensus.cc:2749] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:49.987049 11578 consensus_queue.cc:260] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:01:49.989651 11578 ts_tablet_manager.cc:1434] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:01:49.990499 11578 tablet_bootstrap.cc:492] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:49.991490 10876 leader_election.cc:304] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:49.992316 11538 raft_consensus.cc:2804] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:49.992748 11538 raft_consensus.cc:493] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting leader election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:49.993105 11538 raft_consensus.cc:3060] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:49.994844 11537 raft_consensus.cc:493] T 64c5fd517a084ef9b707c36ec7c2fe3c P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:49.995492 11537 raft_consensus.cc:515] T 64c5fd517a084ef9b707c36ec7c2fe3c P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
W20260709 13:01:49.997238 10876 leader_election.cc:336] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111)
I20260709 13:01:50.005045 11538 raft_consensus.cc:515] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:50.010465 11538 leader_election.cc:290] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 election: Requested vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:50.014266 11582 raft_consensus.cc:493] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.014919 11582 raft_consensus.cc:515] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:50.016352 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c5fd517a084ef9b707c36ec7c2fe3c" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:50.022663 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bf0d822416f49caacd1f92cebd84eb8" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:50.023595 10981 raft_consensus.cc:3060] T 9bf0d822416f49caacd1f92cebd84eb8 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:50.025694 10876 leader_election.cc:336] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111)
I20260709 13:01:50.009552 11537 leader_election.cc:290] T 64c5fd517a084ef9b707c36ec7c2fe3c P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
W20260709 13:01:50.027387 10802 leader_election.cc:336] T 64c5fd517a084ef9b707c36ec7c2fe3c P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111)
I20260709 13:01:50.033358 10981 raft_consensus.cc:2468] T 9bf0d822416f49caacd1f92cebd84eb8 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 2.
I20260709 13:01:50.036188 11582 leader_election.cc:290] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:50.037007 10802 leader_election.cc:304] T 64c5fd517a084ef9b707c36ec7c2fe3c P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbd1fdffc68440e5b6250f6d95a4a367; no voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:01:50.040444 11579 raft_consensus.cc:493] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.041335 11579 raft_consensus.cc:515] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:50.044843 11579 leader_election.cc:290] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:50.044867 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bfa4098abc4f4ba38783e8b91b8cdb" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
W20260709 13:01:50.048149 10950 leader_election.cc:336] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111)
W20260709 13:01:50.048597 10802 leader_election.cc:336] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111)
I20260709 13:01:50.048741 10950 leader_election.cc:304] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f; no voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:50.050177 11579 raft_consensus.cc:2749] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:50.050915 11537 raft_consensus.cc:2749] T 64c5fd517a084ef9b707c36ec7c2fe3c P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:50.050953 11582 raft_consensus.cc:493] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.052279 11582 raft_consensus.cc:515] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:50.052852 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8273bf9f9a174b3ea62b5ab0a0bb5730" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:50.052774 10876 leader_election.cc:304] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 346158a6aa6747c1b8d31b4fb80238d0
I20260709 13:01:50.059351 11587 raft_consensus.cc:2804] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:50.061712 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14dc277ad7874e419ed2d2bff2165611" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:50.061391 11587 raft_consensus.cc:697] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 LEADER]: Becoming Leader. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Running, Role: LEADER
I20260709 13:01:50.063417 10804 leader_election.cc:304] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbd1fdffc68440e5b6250f6d95a4a367; no voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:50.063292 11587 consensus_queue.cc:237] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:50.064280 11537 raft_consensus.cc:2749] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:50.068909 11582 leader_election.cc:290] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
W20260709 13:01:50.071024 10802 leader_election.cc:336] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111)
I20260709 13:01:50.074106 10802 leader_election.cc:304] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbd1fdffc68440e5b6250f6d95a4a367; no voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:50.074663 11579 raft_consensus.cc:493] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.075451 11582 raft_consensus.cc:2749] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:50.075230 11579 raft_consensus.cc:515] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:50.073444 11578 tablet_bootstrap.cc:492] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:50.076913 11538 raft_consensus.cc:493] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.077591 11538 raft_consensus.cc:515] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:50.081739 11579 leader_election.cc:290] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:50.082818 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce467fbc054ba89724cca56e1ae56e" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:50.086043 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830984b68ee046d9b9a67009177b55c2" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
W20260709 13:01:50.086427 10950 leader_election.cc:336] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111)
W20260709 13:01:50.087739 10876 leader_election.cc:336] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111)
I20260709 13:01:50.088429 10876 leader_election.cc:304] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab; no voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:50.089540 11587 raft_consensus.cc:2749] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:50.090296 11538 leader_election.cc:290] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:50.076982 11578 tablet_bootstrap.cc:492] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:50.090940 10951 leader_election.cc:304] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f; no voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:50.091837 11578 ts_tablet_manager.cc:1403] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.102s	user 0.036s	sys 0.034s
I20260709 13:01:50.093739   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:34489
I20260709 13:01:50.093961 11654 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:34489 every 8 connection(s)
I20260709 13:01:50.094830 11578 raft_consensus.cc:359] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:50.095643 11578 raft_consensus.cc:740] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.095391 10661 catalog_manager.cc:5697] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab reported cstate change: term changed from 1 to 2, leader changed from 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193) to b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195). New cstate: current_term: 2 leader_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:50.096442 11578 consensus_queue.cc:260] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:50.097967 11579 raft_consensus.cc:2749] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:50.098806 11578 ts_tablet_manager.cc:1434] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 13:01:50.100180 11578 tablet_bootstrap.cc:492] T fa2569632a834231ba0f3bad60cf90ee P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:50.107959 11538 raft_consensus.cc:493] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.108659 11538 raft_consensus.cc:515] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:50.110967 11538 leader_election.cc:290] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:50.115377 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5382a9b34d84b4fbeccc952bb5f4ef5" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:50.155370 11578 tablet_bootstrap.cc:492] T fa2569632a834231ba0f3bad60cf90ee P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:50.156559 11578 tablet_bootstrap.cc:492] T fa2569632a834231ba0f3bad60cf90ee P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:50.157302 11578 ts_tablet_manager.cc:1403] T fa2569632a834231ba0f3bad60cf90ee P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.057s	user 0.033s	sys 0.007s
I20260709 13:01:50.159715 11655 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46133
I20260709 13:01:50.160286 11655 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:50.160146 11578 raft_consensus.cc:359] T fa2569632a834231ba0f3bad60cf90ee P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:50.160941 11578 raft_consensus.cc:740] T fa2569632a834231ba0f3bad60cf90ee P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.161363 11655 heartbeater.cc:507] Master 127.0.107.254:46133 requested a full tablet report, sending...
I20260709 13:01:50.161737 11578 consensus_queue.cc:260] T fa2569632a834231ba0f3bad60cf90ee P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:50.164289 11578 ts_tablet_manager.cc:1434] T fa2569632a834231ba0f3bad60cf90ee P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:01:50.165172 11578 tablet_bootstrap.cc:492] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:50.165679 11587 raft_consensus.cc:493] T 049d8b6c7ecf423e95f1db20ab677254 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.166415 11587 raft_consensus.cc:515] T 049d8b6c7ecf423e95f1db20ab677254 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:50.171023 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049d8b6c7ecf423e95f1db20ab677254" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:50.173339 11537 raft_consensus.cc:493] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.169116 11587 leader_election.cc:290] T 049d8b6c7ecf423e95f1db20ab677254 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:50.182358 11538 raft_consensus.cc:493] T 3aa37ce6306b47f0b7ead1fda7590834 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.182928 11538 raft_consensus.cc:515] T 3aa37ce6306b47f0b7ead1fda7590834 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:50.183180 11537 raft_consensus.cc:515] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:50.185253 11537 leader_election.cc:290] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:50.187815 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa37ce6306b47f0b7ead1fda7590834" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:50.187914 11556 raft_consensus.cc:493] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.188861 11556 raft_consensus.cc:515] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:50.185264 11538 leader_election.cc:290] T 3aa37ce6306b47f0b7ead1fda7590834 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:50.189508 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7c6df9b4340ffaf28c5a78966c74b" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:50.191169 11624 raft_consensus.cc:2468] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 1.
I20260709 13:01:50.191349 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7c6df9b4340ffaf28c5a78966c74b" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:50.192117 10981 raft_consensus.cc:2468] T 2ea7c6df9b4340ffaf28c5a78966c74b P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 1.
I20260709 13:01:50.192552 10802 leader_election.cc:304] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:50.194674 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14dc277ad7874e419ed2d2bff2165611" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:50.195410 10836 raft_consensus.cc:2468] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 1.
I20260709 13:01:50.196272 11537 raft_consensus.cc:2804] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:50.196836 11537 raft_consensus.cc:493] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.197245 11537 raft_consensus.cc:3060] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.203766 10877 leader_election.cc:304] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:50.206080 11579 raft_consensus.cc:493] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.206557 11556 leader_election.cc:290] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:50.206271 11537 raft_consensus.cc:515] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:50.206720 11579 raft_consensus.cc:515] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:50.206086 10659 ts_manager.cc:194] Re-registered known tserver with Master: 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:50.209198 11579 leader_election.cc:290] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:50.209936 11537 leader_election.cc:290] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 election: Requested vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:50.209604 11578 tablet_bootstrap.cc:492] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:50.210613 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7c6df9b4340ffaf28c5a78966c74b" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:50.210945 11538 raft_consensus.cc:2804] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:50.212622 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61bf6eaa1845f8add4d4057e49eb15" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:50.213092 11578 tablet_bootstrap.cc:492] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:50.213287 11624 raft_consensus.cc:3060] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.214133 11578 ts_tablet_manager.cc:1403] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.049s	user 0.020s	sys 0.025s
I20260709 13:01:50.216830 11578 raft_consensus.cc:359] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:50.217562 11578 raft_consensus.cc:740] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.210971 11625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61bf6eaa1845f8add4d4057e49eb15" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:50.218876 11625 raft_consensus.cc:2468] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 1.
I20260709 13:01:50.218274 11578 consensus_queue.cc:260] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:50.220230 10950 leader_election.cc:304] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f; no voters: dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:50.211285 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ea7c6df9b4340ffaf28c5a78966c74b" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:50.221354 11578 ts_tablet_manager.cc:1434] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:01:50.221467 10985 raft_consensus.cc:3060] T 2ea7c6df9b4340ffaf28c5a78966c74b P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.221835 11579 raft_consensus.cc:2804] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:50.222275 11579 raft_consensus.cc:493] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.212970 11538 raft_consensus.cc:493] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting leader election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.222716 11579 raft_consensus.cc:3060] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.222944 11538 raft_consensus.cc:3060] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.227797 11587 raft_consensus.cc:493] T e3dd15d873514f74a9bca08bc55e5d36 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.228418 11587 raft_consensus.cc:515] T e3dd15d873514f74a9bca08bc55e5d36 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:50.230669 11587 leader_election.cc:290] T e3dd15d873514f74a9bca08bc55e5d36 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:50.228662 11537 raft_consensus.cc:493] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.231304 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3dd15d873514f74a9bca08bc55e5d36" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:50.231484 11537 raft_consensus.cc:515] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:50.231709 10985 raft_consensus.cc:2468] T 2ea7c6df9b4340ffaf28c5a78966c74b P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 2.
I20260709 13:01:50.222362 11578 tablet_bootstrap.cc:492] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:50.233186 10802 leader_election.cc:304] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:50.233234 11538 raft_consensus.cc:515] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:50.234241 11537 leader_election.cc:290] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:50.235430 11537 raft_consensus.cc:493] T 9be3de57a254453d9dc75680e7f27f22 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.234611 11581 raft_consensus.cc:2804] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:50.235996 11537 raft_consensus.cc:515] T 9be3de57a254453d9dc75680e7f27f22 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:50.236857 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce467fbc054ba89724cca56e1ae56e" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:50.237547 10912 raft_consensus.cc:2468] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 1.
I20260709 13:01:50.238724 11624 raft_consensus.cc:2468] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 2.
I20260709 13:01:50.239795 11538 leader_election.cc:290] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 election: Requested vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:50.240899 10804 leader_election.cc:304] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:50.241842 11582 raft_consensus.cc:2804] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:50.242292 11582 raft_consensus.cc:493] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.242748 11582 raft_consensus.cc:3060] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.244239 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049d8b6c7ecf423e95f1db20ab677254" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:50.245563 11508 raft_consensus.cc:493] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.246202 11508 raft_consensus.cc:515] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:50.246505 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa37ce6306b47f0b7ead1fda7590834" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:50.235524 11625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce467fbc054ba89724cca56e1ae56e" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:50.248196 11668 raft_consensus.cc:493] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.236372 11581 raft_consensus.cc:697] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 LEADER]: Becoming Leader. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Running, Role: LEADER
I20260709 13:01:50.248957 11668 raft_consensus.cc:515] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:50.249950 11626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14dc277ad7874e419ed2d2bff2165611" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:50.249744 11581 consensus_queue.cc:237] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:50.252578 11537 leader_election.cc:290] T 9be3de57a254453d9dc75680e7f27f22 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:50.253882 11508 leader_election.cc:290] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:50.254703 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be3de57a254453d9dc75680e7f27f22" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:50.255618 11668 leader_election.cc:290] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:50.256132 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3dd15d873514f74a9bca08bc55e5d36" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:50.257915 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c5fd517a084ef9b707c36ec7c2fe3c" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:50.258615 10836 raft_consensus.cc:2468] T 64c5fd517a084ef9b707c36ec7c2fe3c P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 1.
I20260709 13:01:50.258672 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14dc277ad7874e419ed2d2bff2165611" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:50.259948 11626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8273bf9f9a174b3ea62b5ab0a0bb5730" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:50.252036 11582 raft_consensus.cc:515] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:50.261884 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8273bf9f9a174b3ea62b5ab0a0bb5730" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:50.262528 11625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c5fd517a084ef9b707c36ec7c2fe3c" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:50.262537 10837 raft_consensus.cc:2468] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 1.
W20260709 13:01:50.263980 10950 leader_election.cc:343] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.242895 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5382a9b34d84b4fbeccc952bb5f4ef5" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
W20260709 13:01:50.265848 10802 leader_election.cc:343] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.266425 11556 raft_consensus.cc:493] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.266784 10951 leader_election.cc:304] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 346158a6aa6747c1b8d31b4fb80238d0
I20260709 13:01:50.267076 11556 raft_consensus.cc:515] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:50.268814 10877 leader_election.cc:304] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:50.268863 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14dc277ad7874e419ed2d2bff2165611" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:50.269315 11556 leader_election.cc:290] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:50.269902 11557 raft_consensus.cc:2804] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:50.270428 11557 raft_consensus.cc:493] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting leader election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.270852 11557 raft_consensus.cc:3060] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.270030 11508 raft_consensus.cc:2804] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:50.272912 10836 raft_consensus.cc:3060] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.276441 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce467fbc054ba89724cca56e1ae56e" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:50.273211 11508 raft_consensus.cc:493] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.280397 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be3de57a254453d9dc75680e7f27f22" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:50.279680 11537 raft_consensus.cc:493] T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.286710 11537 raft_consensus.cc:515] T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
W20260709 13:01:50.284180 10802 leader_election.cc:343] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:50.289095 10802 leader_election.cc:343] T 9be3de57a254453d9dc75680e7f27f22 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.289167 11557 raft_consensus.cc:515] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:50.289729 10802 leader_election.cc:304] T 9be3de57a254453d9dc75680e7f27f22 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbd1fdffc68440e5b6250f6d95a4a367; no voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:50.292759 11537 leader_election.cc:290] T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:50.284363 11508 raft_consensus.cc:3060] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.293912 11670 raft_consensus.cc:2749] T 9be3de57a254453d9dc75680e7f27f22 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:50.279613 10876 leader_election.cc:343] T 049d8b6c7ecf423e95f1db20ab677254 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.302322 10876 leader_election.cc:304] T 049d8b6c7ecf423e95f1db20ab677254 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab; no voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:01:50.241840 11579 raft_consensus.cc:515] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
W20260709 13:01:50.315413 10876 leader_election.cc:343] T 3aa37ce6306b47f0b7ead1fda7590834 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.315982 10876 leader_election.cc:304] T 3aa37ce6306b47f0b7ead1fda7590834 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab; no voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:50.295539 11557 leader_election.cc:290] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 election: Requested vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:50.294355 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8273bf9f9a174b3ea62b5ab0a0bb5730" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:50.295768 10836 raft_consensus.cc:2468] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 2.
I20260709 13:01:50.272257 11582 leader_election.cc:290] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 election: Requested vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:50.305954 11578 tablet_bootstrap.cc:492] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:50.316095 11579 leader_election.cc:290] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 election: Requested vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:50.317082 10837 raft_consensus.cc:3060] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.308395 11420 raft_consensus.cc:493] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.295862 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141934a83d874ca1bf1d69f49b95f1fc" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
W20260709 13:01:50.321486 10876 leader_election.cc:343] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.324846 11557 raft_consensus.cc:2749] T 049d8b6c7ecf423e95f1db20ab677254 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:50.325194 11580 raft_consensus.cc:493] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.329983 11580 raft_consensus.cc:515] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
W20260709 13:01:50.331840 10876 leader_election.cc:343] T e3dd15d873514f74a9bca08bc55e5d36 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.326314 10877 leader_election.cc:304] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:50.326330 11578 tablet_bootstrap.cc:492] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:50.332980 11580 leader_election.cc:290] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:50.333386 11578 ts_tablet_manager.cc:1403] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.111s	user 0.019s	sys 0.008s
I20260709 13:01:50.334684 11557 raft_consensus.cc:2804] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:50.324867 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61bf6eaa1845f8add4d4057e49eb15" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:50.333447 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049d8b6c7ecf423e95f1db20ab677254" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:50.336422 10912 raft_consensus.cc:2468] T 049d8b6c7ecf423e95f1db20ab677254 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 1.
I20260709 13:01:50.337188 11623 raft_consensus.cc:3060] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.338402 10952 leader_election.cc:304] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:50.340026 11580 raft_consensus.cc:2804] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:50.325675 11668 raft_consensus.cc:2749] T 3aa37ce6306b47f0b7ead1fda7590834 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:50.332384 10876 leader_election.cc:304] T e3dd15d873514f74a9bca08bc55e5d36 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab; no voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:01:50.343500 10834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61bf6eaa1845f8add4d4057e49eb15" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:50.344698 10837 raft_consensus.cc:2468] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 2.
I20260709 13:01:50.334852 11625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049d8b6c7ecf423e95f1db20ab677254" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:50.328783 11420 raft_consensus.cc:515] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:50.341483 11578 raft_consensus.cc:359] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:50.349665 11578 raft_consensus.cc:740] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.350425 11578 consensus_queue.cc:260] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:50.347316 10877 leader_election.cc:304] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:50.351104 11420 leader_election.cc:290] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:50.351500 11556 raft_consensus.cc:493] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.351958 11587 raft_consensus.cc:2804] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:50.352113 11581 raft_consensus.cc:493] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.352856 11581 raft_consensus.cc:515] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
W20260709 13:01:50.353679 10950 leader_election.cc:343] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.348695 11668 raft_consensus.cc:2749] T e3dd15d873514f74a9bca08bc55e5d36 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:50.354413 10834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e976ba764734878bb65c5db5e908f56" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:50.340865 11557 raft_consensus.cc:697] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 LEADER]: Becoming Leader. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Running, Role: LEADER
I20260709 13:01:50.354452 11578 ts_tablet_manager.cc:1434] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 13:01:50.355073 11581 leader_election.cc:290] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:50.356093 11557 consensus_queue.cc:237] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:50.351686 11420 raft_consensus.cc:493] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.357410 11578 tablet_bootstrap.cc:492] T c72b12d4267d44a1a03db0fe148c8d31 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
W20260709 13:01:50.348264 10876 leader_election.cc:343] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:50.358806 10876 leader_election.cc:343] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.354970 11587 raft_consensus.cc:697] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 LEADER]: Becoming Leader. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Running, Role: LEADER
W20260709 13:01:50.359979 10876 leader_election.cc:343] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.360466 10876 leader_election.cc:304] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab; no voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:01:50.342819 11580 raft_consensus.cc:493] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.361490 11538 raft_consensus.cc:2749] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:50.362411 11625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e976ba764734878bb65c5db5e908f56" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:50.363214 11625 raft_consensus.cc:2468] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 1.
I20260709 13:01:50.364681 10950 leader_election.cc:304] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f; no voters: 
I20260709 13:01:50.365561 11508 raft_consensus.cc:515] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:50.367445 11579 raft_consensus.cc:2804] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:50.367925 11579 raft_consensus.cc:493] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.357095 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e976ba764734878bb65c5db5e908f56" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:50.361591 11580 raft_consensus.cc:3060] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.368583 11626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b562356d3b4807a92648800cfe3dac" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:50.368844 11620 raft_consensus.cc:2468] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 1.
I20260709 13:01:50.369427 11626 raft_consensus.cc:2468] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 1.
I20260709 13:01:50.355157 10834 raft_consensus.cc:2468] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 1.
I20260709 13:01:50.371244 10802 leader_election.cc:304] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:50.371428 11587 consensus_queue.cc:237] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:50.368345 11579 raft_consensus.cc:3060] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.372157 11581 raft_consensus.cc:2804] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:50.373061 11581 raft_consensus.cc:493] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.373479 11581 raft_consensus.cc:3060] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.373955 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b562356d3b4807a92648800cfe3dac" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:50.374848 10985 raft_consensus.cc:2468] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 1.
I20260709 13:01:50.352129 11556 raft_consensus.cc:515] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:50.378302 11556 leader_election.cc:290] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:50.378538 11626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8273bf9f9a174b3ea62b5ab0a0bb5730" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:50.380342 11556 raft_consensus.cc:493] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.381013 11508 leader_election.cc:290] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 election: Requested vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:50.380962 11556 raft_consensus.cc:515] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:50.381605 11581 raft_consensus.cc:515] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:50.382513 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1ce467fbc054ba89724cca56e1ae56e" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:50.382529 10834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c5fd517a084ef9b707c36ec7c2fe3c" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:50.336300 11624 raft_consensus.cc:2468] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 1.
I20260709 13:01:50.386054 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141934a83d874ca1bf1d69f49b95f1fc" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:50.360136 11420 raft_consensus.cc:515] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:50.388253 11626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bfa4098abc4f4ba38783e8b91b8cdb" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:50.393640 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bfa4098abc4f4ba38783e8b91b8cdb" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:50.408942 10985 raft_consensus.cc:2468] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 1.
I20260709 13:01:50.394979 10912 raft_consensus.cc:3060] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.402845 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e976ba764734878bb65c5db5e908f56" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:50.395224 10834 raft_consensus.cc:3060] T 64c5fd517a084ef9b707c36ec7c2fe3c P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.406061 10876 leader_election.cc:304] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:50.396922 10802 leader_election.cc:304] T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:50.414623 11537 raft_consensus.cc:493] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.415191 11537 raft_consensus.cc:515] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
W20260709 13:01:50.414002 10876 leader_election.cc:343] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.434638 11537 leader_election.cc:290] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:50.435225 11537 raft_consensus.cc:493] T bb61bf6eaa1845f8add4d4057e49eb15 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.435699 11537 raft_consensus.cc:515] T bb61bf6eaa1845f8add4d4057e49eb15 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:50.436584 11578 tablet_bootstrap.cc:492] T c72b12d4267d44a1a03db0fe148c8d31 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:50.434397 10661 catalog_manager.cc:5697] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367 reported cstate change: term changed from 1 to 2, leader changed from 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193) to dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:50.442214 11537 leader_election.cc:290] T bb61bf6eaa1845f8add4d4057e49eb15 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:50.423643 11668 raft_consensus.cc:2804] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:50.446588 11668 raft_consensus.cc:493] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting leader election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.447116 11668 raft_consensus.cc:3060] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.414094 11626 raft_consensus.cc:2468] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 1.
I20260709 13:01:50.443221 11420 leader_election.cc:290] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:50.411530 10907 raft_consensus.cc:2468] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 1.
I20260709 13:01:50.456207 10912 raft_consensus.cc:2468] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 2.
I20260709 13:01:50.444069 11537 raft_consensus.cc:493] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.413496 11508 raft_consensus.cc:493] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.394006 11623 raft_consensus.cc:2468] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 2.
I20260709 13:01:50.443104 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e976ba764734878bb65c5db5e908f56" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
W20260709 13:01:50.421319 10950 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34489, user_credentials={real_user=slave}} blocked reactor thread for 56738.5us
I20260709 13:01:50.419857 11679 raft_consensus.cc:2804] T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:50.466076 10834 raft_consensus.cc:2468] T 64c5fd517a084ef9b707c36ec7c2fe3c P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 2.
I20260709 13:01:50.453962 11579 raft_consensus.cc:515] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:50.468752 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61bf6eaa1845f8add4d4057e49eb15" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:50.469436 11579 leader_election.cc:290] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 election: Requested vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:50.469997 11679 raft_consensus.cc:493] T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.470532 11679 raft_consensus.cc:3060] T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.471010 11556 leader_election.cc:290] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:50.471345 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e976ba764734878bb65c5db5e908f56" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:50.472137 10837 raft_consensus.cc:2393] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e62c52a41f7476a908dd377c1a8a79f in current term 2: Already voted for candidate dbd1fdffc68440e5b6250f6d95a4a367 in this term.
I20260709 13:01:50.438561 11587 raft_consensus.cc:493] T ffe62eca39f04407943d15c5f7646aee P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.469704 10983 raft_consensus.cc:2393] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbd1fdffc68440e5b6250f6d95a4a367 in current term 2: Already voted for candidate 5e62c52a41f7476a908dd377c1a8a79f in this term.
I20260709 13:01:50.473059 11587 raft_consensus.cc:515] T ffe62eca39f04407943d15c5f7646aee P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:50.472692 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe62eca39f04407943d15c5f7646aee" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:50.476085 10906 raft_consensus.cc:2468] T ffe62eca39f04407943d15c5f7646aee P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 1.
I20260709 13:01:50.476222 10981 raft_consensus.cc:2393] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbd1fdffc68440e5b6250f6d95a4a367 in current term 2: Already voted for candidate 5e62c52a41f7476a908dd377c1a8a79f in this term.
I20260709 13:01:50.476867 11626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa37ce6306b47f0b7ead1fda7590834" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:50.457377 11578 tablet_bootstrap.cc:492] T c72b12d4267d44a1a03db0fe148c8d31 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:50.479561 11508 raft_consensus.cc:515] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:50.479595 11578 ts_tablet_manager.cc:1403] T c72b12d4267d44a1a03db0fe148c8d31 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.123s	user 0.020s	sys 0.000s
I20260709 13:01:50.441648 11581 leader_election.cc:290] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 election: Requested vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:50.482048 11679 raft_consensus.cc:515] T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
W20260709 13:01:50.484308 10802 leader_election.cc:343] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.484970 11679 leader_election.cc:290] T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 election: Requested vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:50.485950 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141934a83d874ca1bf1d69f49b95f1fc" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:50.486361 11508 leader_election.cc:290] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:50.486567 11624 raft_consensus.cc:3060] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.486999 10952 leader_election.cc:304] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:50.484624 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb61bf6eaa1845f8add4d4057e49eb15" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:50.487983 11620 raft_consensus.cc:2393] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dbd1fdffc68440e5b6250f6d95a4a367 in current term 2: Already voted for candidate 5e62c52a41f7476a908dd377c1a8a79f in this term.
I20260709 13:01:50.488662 11675 raft_consensus.cc:2804] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:50.489084 11675 raft_consensus.cc:493] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.459751 11537 raft_consensus.cc:515] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:50.447896 11580 raft_consensus.cc:515] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:50.490056 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5382a9b34d84b4fbeccc952bb5f4ef5" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:50.490751 10906 raft_consensus.cc:2468] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 1.
I20260709 13:01:50.491309 11580 leader_election.cc:290] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 election: Requested vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:50.483920 11578 raft_consensus.cc:359] T c72b12d4267d44a1a03db0fe148c8d31 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:50.489440 11675 raft_consensus.cc:3060] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.491163 11537 leader_election.cc:290] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:50.497004 11578 raft_consensus.cc:740] T c72b12d4267d44a1a03db0fe148c8d31 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:50.497635 10802 leader_election.cc:304] T bb61bf6eaa1845f8add4d4057e49eb15 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbd1fdffc68440e5b6250f6d95a4a367; no voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:01:50.497942 11578 consensus_queue.cc:260] T c72b12d4267d44a1a03db0fe148c8d31 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:50.499343 10951 leader_election.cc:304] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:50.501093 11619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e976ba764734878bb65c5db5e908f56" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:50.501518 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5382a9b34d84b4fbeccc952bb5f4ef5" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:50.502032 11625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830984b68ee046d9b9a67009177b55c2" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:50.502645 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c5fd517a084ef9b707c36ec7c2fe3c" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:50.503772 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049d8b6c7ecf423e95f1db20ab677254" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:50.491957 11580 raft_consensus.cc:493] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.498546 10876 leader_election.cc:304] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:50.507369 10950 leader_election.cc:304] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f; no voters: dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:50.492709 10952 leader_election.cc:304] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:50.509512 11420 raft_consensus.cc:2804] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:50.509968 11420 raft_consensus.cc:493] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.510322 11420 raft_consensus.cc:3060] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.510358 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830984b68ee046d9b9a67009177b55c2" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:50.511122 10981 raft_consensus.cc:2468] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 1.
W20260709 13:01:50.512509 10950 leader_election.cc:343] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.504431 10906 raft_consensus.cc:3060] T 049d8b6c7ecf423e95f1db20ab677254 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.514225 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe62eca39f04407943d15c5f7646aee" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:50.514959 11623 raft_consensus.cc:2468] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 1.
I20260709 13:01:50.514097 11556 raft_consensus.cc:2804] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:50.516505 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141934a83d874ca1bf1d69f49b95f1fc" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:50.516667 11580 raft_consensus.cc:515] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:50.517174 10907 raft_consensus.cc:3060] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.518987 11580 leader_election.cc:290] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:50.504375 11668 raft_consensus.cc:515] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:50.520964 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa37ce6306b47f0b7ead1fda7590834" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:50.521173 11625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049d8b6c7ecf423e95f1db20ab677254" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:50.521324 11579 raft_consensus.cc:2804] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:50.521755 10910 raft_consensus.cc:2468] T 3aa37ce6306b47f0b7ead1fda7590834 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 1.
I20260709 13:01:50.522403 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be3de57a254453d9dc75680e7f27f22" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:50.522739 11668 leader_election.cc:290] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 election: Requested vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:50.523427 11556 raft_consensus.cc:493] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting leader election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.523877 11556 raft_consensus.cc:3060] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.524564 11579 raft_consensus.cc:697] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Becoming Leader. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
I20260709 13:01:50.522846 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe62eca39f04407943d15c5f7646aee" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:50.525672 11579 consensus_queue.cc:237] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:50.526604 11620 raft_consensus.cc:2468] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 1.
I20260709 13:01:50.487109 11626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e976ba764734878bb65c5db5e908f56" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:50.520820 11673 raft_consensus.cc:2804] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:50.528014 11673 raft_consensus.cc:697] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Becoming Leader. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
I20260709 13:01:50.528930 11673 consensus_queue.cc:237] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:50.529874 10906 raft_consensus.cc:2468] T 049d8b6c7ecf423e95f1db20ab677254 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 2.
I20260709 13:01:50.531409 11420 raft_consensus.cc:515] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:50.509476 10804 leader_election.cc:304] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 346158a6aa6747c1b8d31b4fb80238d0
I20260709 13:01:50.509034 11619 raft_consensus.cc:3060] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.537679 11556 raft_consensus.cc:515] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:50.539516 10981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe62eca39f04407943d15c5f7646aee" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f" is_pre_election: true
I20260709 13:01:50.475420 11587 leader_election.cc:290] T ffe62eca39f04407943d15c5f7646aee P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
W20260709 13:01:50.513636 10950 leader_election.cc:343] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.540030 11556 leader_election.cc:290] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 election: Requested vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
W20260709 13:01:50.544421 10802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34489, user_credentials={real_user=slave}} blocked reactor thread for 47040.7us
I20260709 13:01:50.544466 10952 leader_election.cc:304] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:50.548687 11626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3dd15d873514f74a9bca08bc55e5d36" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0" is_pre_election: true
I20260709 13:01:50.549464 11626 raft_consensus.cc:2468] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 1.
I20260709 13:01:50.550179 11670 raft_consensus.cc:2804] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:50.550897 11670 raft_consensus.cc:697] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 LEADER]: Becoming Leader. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Running, Role: LEADER
I20260709 13:01:50.538359 11624 raft_consensus.cc:2468] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 2.
I20260709 13:01:50.551957 11670 consensus_queue.cc:237] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:50.553124 10659 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42480
I20260709 13:01:50.552255 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3dd15d873514f74a9bca08bc55e5d36" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" is_pre_election: true
I20260709 13:01:50.554211 10906 raft_consensus.cc:2468] T e3dd15d873514f74a9bca08bc55e5d36 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 1.
W20260709 13:01:50.546974 10950 leader_election.cc:343] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.556193 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be3de57a254453d9dc75680e7f27f22" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" is_pre_election: true
I20260709 13:01:50.557075 10837 raft_consensus.cc:2468] T 9be3de57a254453d9dc75680e7f27f22 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 1.
I20260709 13:01:50.543566 11420 leader_election.cc:290] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 election: Requested vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:50.557677 11578 ts_tablet_manager.cc:1434] T c72b12d4267d44a1a03db0fe148c8d31 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.000s
I20260709 13:01:50.558554 10952 leader_election.cc:304] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:50.562042 10804 leader_election.cc:304] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 346158a6aa6747c1b8d31b4fb80238d0
I20260709 13:01:50.563881 11578 tablet_bootstrap.cc:492] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:50.563352 10802 leader_election.cc:304] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:50.564793 11537 raft_consensus.cc:2804] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:50.565182 11537 raft_consensus.cc:493] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.565492 11537 raft_consensus.cc:3060] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:50.566406 10802 leader_election.cc:343] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.567246 10802 leader_election.cc:304] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dbd1fdffc68440e5b6250f6d95a4a367; no voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:01:50.569504 11674 raft_consensus.cc:2804] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:50.569885 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5382a9b34d84b4fbeccc952bb5f4ef5" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:50.570562 10906 raft_consensus.cc:3060] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.556226 11679 raft_consensus.cc:3060] T bb61bf6eaa1845f8add4d4057e49eb15 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.561743 11580 raft_consensus.cc:2804] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:50.574337 10802 leader_election.cc:304] T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:50.577510 11682 raft_consensus.cc:2804] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:50.578059 11682 raft_consensus.cc:493] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.578456 11682 raft_consensus.cc:3060] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.585297 11537 raft_consensus.cc:515] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:50.576366 11581 raft_consensus.cc:2749] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:50.572125 11674 raft_consensus.cc:493] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
W20260709 13:01:50.593638 10876 leader_election.cc:343] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.591842 11582 raft_consensus.cc:2804] T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:50.598546 11582 raft_consensus.cc:697] T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 LEADER]: Becoming Leader. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Running, Role: LEADER
I20260709 13:01:50.598555 11674 raft_consensus.cc:3060] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.599558 11582 consensus_queue.cc:237] T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:50.597069 10876 leader_election.cc:304] T ffe62eca39f04407943d15c5f7646aee P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:50.604437 11684 raft_consensus.cc:2804] T ffe62eca39f04407943d15c5f7646aee P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:50.604967 11684 raft_consensus.cc:493] T ffe62eca39f04407943d15c5f7646aee P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting leader election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:01:50.605489 11684 raft_consensus.cc:3060] T ffe62eca39f04407943d15c5f7646aee P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.607605 11655 heartbeater.cc:499] Master 127.0.107.254:46133 was elected leader, sending a full tablet report...
I20260709 13:01:50.589226 11580 raft_consensus.cc:697] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Becoming Leader. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
I20260709 13:01:50.609550 11537 leader_election.cc:290] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 election: Requested vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:50.614665 11682 raft_consensus.cc:515] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:50.617190 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5382a9b34d84b4fbeccc952bb5f4ef5" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:50.625468 11580 consensus_queue.cc:237] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:50.627301 11682 leader_election.cc:290] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 election: Requested vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:01:50.603109 11675 raft_consensus.cc:515] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:50.629259 11675 leader_election.cc:290] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 election: Requested vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:50.622826 11684 raft_consensus.cc:515] T ffe62eca39f04407943d15c5f7646aee P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
W20260709 13:01:50.630183 10951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35051, user_credentials={real_user=slave}} blocked reactor thread for 69526us
I20260709 13:01:50.630774 10981 raft_consensus.cc:2393] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b778a184b0ac46f5b86ce4fe363dcbab in current term 2: Already voted for candidate 5e62c52a41f7476a908dd377c1a8a79f in this term.
I20260709 13:01:50.638463 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe62eca39f04407943d15c5f7646aee" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:50.631556 10659 catalog_manager.cc:5697] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab reported cstate change: term changed from 1 to 2, leader changed from 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193) to b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195). New cstate: current_term: 2 leader_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:50.591190 11626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bfa4098abc4f4ba38783e8b91b8cdb" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
W20260709 13:01:50.640640 10950 leader_election.cc:343] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:50.641321 11626 raft_consensus.cc:3060] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.596093 11624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b562356d3b4807a92648800cfe3dac" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:50.646808 10659 catalog_manager.cc:5697] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab reported cstate change: term changed from 1 to 2, leader changed from 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193) to b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195). New cstate: current_term: 2 leader_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:50.652117 10912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa37ce6306b47f0b7ead1fda7590834" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:50.652834 10912 raft_consensus.cc:3060] T 3aa37ce6306b47f0b7ead1fda7590834 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.634095 10907 raft_consensus.cc:2468] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 2.
I20260709 13:01:50.654304 10910 raft_consensus.cc:2393] T ffe62eca39f04407943d15c5f7646aee P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e62c52a41f7476a908dd377c1a8a79f in current term 2: Already voted for candidate b778a184b0ac46f5b86ce4fe363dcbab in this term.
I20260709 13:01:50.657214 10985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bfa4098abc4f4ba38783e8b91b8cdb" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:50.657897 10985 raft_consensus.cc:3060] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.659546 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b562356d3b4807a92648800cfe3dac" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:50.660349 10983 raft_consensus.cc:3060] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.645401 11620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe62eca39f04407943d15c5f7646aee" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:50.683360 11620 raft_consensus.cc:3060] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.652699 11624 raft_consensus.cc:3060] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.704988 10912 raft_consensus.cc:2468] T 3aa37ce6306b47f0b7ead1fda7590834 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 2.
I20260709 13:01:50.640678 11674 raft_consensus.cc:515] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:50.711460 10804 leader_election.cc:304] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
W20260709 13:01:50.712375 10876 consensus_peers.cc:597] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:50.693148 11619 raft_consensus.cc:2468] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 2.
I20260709 13:01:50.725732 10985 raft_consensus.cc:2468] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 2.
I20260709 13:01:50.717657 11682 raft_consensus.cc:2804] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:50.730782 10950 leader_election.cc:304] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f; no voters: dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:01:50.725137 11679 raft_consensus.cc:2749] T bb61bf6eaa1845f8add4d4057e49eb15 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:50.739427 11678 raft_consensus.cc:2804] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:50.740017 10983 raft_consensus.cc:2468] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 2.
I20260709 13:01:50.740409 11678 raft_consensus.cc:697] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Becoming Leader. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
W20260709 13:01:50.745289 11686 log.cc:927] Time spent T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:01:50.734813 11682 raft_consensus.cc:697] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 LEADER]: Becoming Leader. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Running, Role: LEADER
I20260709 13:01:50.746791 11682 consensus_queue.cc:237] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:50.750738 10906 raft_consensus.cc:2468] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 2.
W20260709 13:01:50.751461 10802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34489, user_credentials={real_user=slave}} blocked reactor thread for 177126us
I20260709 13:01:50.759112 10877 leader_election.cc:304] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 346158a6aa6747c1b8d31b4fb80238d0
I20260709 13:01:50.761219 10952 leader_election.cc:304] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 346158a6aa6747c1b8d31b4fb80238d0
I20260709 13:01:50.733300 11684 leader_election.cc:290] T ffe62eca39f04407943d15c5f7646aee P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 election: Requested vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:50.773440 11580 raft_consensus.cc:2804] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:50.776808 10985 raft_consensus.cc:1275] T 9bf0d822416f49caacd1f92cebd84eb8 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Refusing update from remote peer b778a184b0ac46f5b86ce4fe363dcbab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:01:50.776180 10876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34489, user_credentials={real_user=slave}} blocked reactor thread for 48528.1us
I20260709 13:01:50.783824 10837 raft_consensus.cc:1275] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Refusing update from remote peer b778a184b0ac46f5b86ce4fe363dcbab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:50.773559 11691 raft_consensus.cc:2804] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:50.780354 10906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3dd15d873514f74a9bca08bc55e5d36" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:01:50.787340 10906 raft_consensus.cc:3060] T e3dd15d873514f74a9bca08bc55e5d36 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.787333 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830984b68ee046d9b9a67009177b55c2" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:50.789289 11684 consensus_queue.cc:1048] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:01:50.792102 11678 consensus_queue.cc:237] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:50.798486 10980 raft_consensus.cc:3060] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.802069 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3dd15d873514f74a9bca08bc55e5d36" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:50.802810 11621 raft_consensus.cc:3060] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.777026 11674 leader_election.cc:290] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 election: Requested vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489)
I20260709 13:01:50.785595 11580 raft_consensus.cc:697] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Becoming Leader. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
I20260709 13:01:50.786248 11691 raft_consensus.cc:493] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Starting leader election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
W20260709 13:01:50.822127 11692 log.cc:927] Time spent T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:01:50.825469 10906 raft_consensus.cc:2468] T e3dd15d873514f74a9bca08bc55e5d36 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 2.
I20260709 13:01:50.832512 10952 leader_election.cc:304] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:50.827548 11580 consensus_queue.cc:237] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:50.828765 10978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe62eca39f04407943d15c5f7646aee" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:01:50.829665 10980 raft_consensus.cc:2468] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dbd1fdffc68440e5b6250f6d95a4a367 in term 2.
I20260709 13:01:50.836169 11420 raft_consensus.cc:2804] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:50.837783 11420 raft_consensus.cc:697] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Becoming Leader. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
I20260709 13:01:50.815514 11691 raft_consensus.cc:3060] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.835489 10661 catalog_manager.cc:5697] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 reported cstate change: term changed from 1 to 2, leader changed from 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193) to dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:50.846859 11690 log.cc:927] Time spent T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f: Append to log took a long time: real 0.101s	user 0.001s	sys 0.001s
I20260709 13:01:50.856606 11420 consensus_queue.cc:237] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:50.863327 10876 leader_election.cc:304] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:50.864100 11587 raft_consensus.cc:2804] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:50.863591 10978 raft_consensus.cc:2393] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b778a184b0ac46f5b86ce4fe363dcbab in current term 2: Already voted for candidate 5e62c52a41f7476a908dd377c1a8a79f in this term.
I20260709 13:01:50.867403 11623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffe62eca39f04407943d15c5f7646aee" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:50.877487 11626 raft_consensus.cc:2468] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 2.
I20260709 13:01:50.870738 11691 raft_consensus.cc:515] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:50.879492 10979 raft_consensus.cc:1275] T 2ea7c6df9b4340ffaf28c5a78966c74b P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Refusing update from remote peer dbd1fdffc68440e5b6250f6d95a4a367: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:50.875813 11587 raft_consensus.cc:697] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [term 2 LEADER]: Becoming Leader. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Running, Role: LEADER
I20260709 13:01:50.884239 11691 leader_election.cc:290] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 election: Requested vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:01:50.865833 10876 leader_election.cc:304] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:01:50.875762 10802 leader_election.cc:304] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:50.887277 10834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be3de57a254453d9dc75680e7f27f22" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:01:50.887869 10834 raft_consensus.cc:3060] T 9be3de57a254453d9dc75680e7f27f22 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.884444 11587 consensus_queue.cc:237] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:50.894634 10834 raft_consensus.cc:2468] T 9be3de57a254453d9dc75680e7f27f22 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 2.
I20260709 13:01:50.895848 10877 leader_election.cc:304] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:01:50.896407 11693 raft_consensus.cc:2804] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:50.896986 11693 raft_consensus.cc:697] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 LEADER]: Becoming Leader. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Running, Role: LEADER
I20260709 13:01:50.896725 11695 raft_consensus.cc:2804] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:50.890429 11556 raft_consensus.cc:2804] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:50.894523 11557 consensus_queue.cc:1048] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:01:50.906796 11681 consensus_queue.cc:1048] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:01:50.907428 10833 raft_consensus.cc:1275] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Refusing update from remote peer b778a184b0ac46f5b86ce4fe363dcbab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:50.871733 11624 raft_consensus.cc:2468] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 2.
I20260709 13:01:50.914083 11622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3aa37ce6306b47f0b7ead1fda7590834" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:50.901136 11695 raft_consensus.cc:697] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 LEADER]: Becoming Leader. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Running, Role: LEADER
I20260709 13:01:50.904776 11620 raft_consensus.cc:2468] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 2.
I20260709 13:01:50.939651 11695 consensus_queue.cc:237] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:50.897861 11693 consensus_queue.cc:237] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:50.946785 11625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830984b68ee046d9b9a67009177b55c2" candidate_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:50.954665 10950 leader_election.cc:304] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f; no voters: b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:01:50.943235 11621 raft_consensus.cc:2468] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 2.
I20260709 13:01:50.965358 10833 raft_consensus.cc:1275] T bb61bf6eaa1845f8add4d4057e49eb15 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Refusing update from remote peer 5e62c52a41f7476a908dd377c1a8a79f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:50.971333 11578 tablet_bootstrap.cc:492] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:50.972550 11700 raft_consensus.cc:2804] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:50.973152 11700 raft_consensus.cc:697] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Becoming Leader. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
I20260709 13:01:50.974084 11700 consensus_queue.cc:237] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:50.954013 11668 consensus_queue.cc:1048] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
W20260709 13:01:51.004871 10802 leader_election.cc:343] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:51.006392 11619 raft_consensus.cc:1275] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Refusing update from remote peer dbd1fdffc68440e5b6250f6d95a4a367: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:51.010368 11699 consensus_queue.cc:1048] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:01:51.014817 11702 log.cc:927] Time spent T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367: Append to log took a long time: real 0.077s	user 0.000s	sys 0.002s
I20260709 13:01:51.019802 11578 tablet_bootstrap.cc:492] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:51.021682 11578 ts_tablet_manager.cc:1403] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.458s	user 0.044s	sys 0.019s
W20260709 13:01:51.020438 10802 leader_election.cc:343] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:51.029501 10659 catalog_manager.cc:5697] T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367 reported cstate change: term changed from 1 to 2, leader changed from 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193) to dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:51.031447 10659 catalog_manager.cc:5697] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 reported cstate change: term changed from 1 to 2, leader changed from 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193) to dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:51.036185 11556 raft_consensus.cc:697] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab [term 2 LEADER]: Becoming Leader. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Running, Role: LEADER
W20260709 13:01:51.058948 11709 log.cc:927] Time spent T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:01:51.062687 10950 consensus_peers.cc:597] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:51.063952 10876 leader_election.cc:304] T ffe62eca39f04407943d15c5f7646aee P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab; no voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f
W20260709 13:01:51.086563 11706 log.cc:927] Time spent T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:01:51.068892 11587 raft_consensus.cc:2749] T ffe62eca39f04407943d15c5f7646aee P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.090006 11578 raft_consensus.cc:359] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:51.090816 11578 raft_consensus.cc:740] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.091504 11578 consensus_queue.cc:260] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:51.101577 11578 ts_tablet_manager.cc:1434] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.080s	user 0.007s	sys 0.000s
I20260709 13:01:51.102583 11578 tablet_bootstrap.cc:492] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:51.095675 11556 consensus_queue.cc:237] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:51.109261 10834 raft_consensus.cc:1275] T 64c5fd517a084ef9b707c36ec7c2fe3c P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Refusing update from remote peer 5e62c52a41f7476a908dd377c1a8a79f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:51.110947 11699 consensus_queue.cc:1048] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:51.140215 11671 consensus_queue.cc:1048] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:01:51.155879 10876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34489, user_credentials={real_user=slave}} blocked reactor thread for 87425.7us
I20260709 13:01:51.179773 10906 raft_consensus.cc:1275] T 049d8b6c7ecf423e95f1db20ab677254 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Refusing update from remote peer 5e62c52a41f7476a908dd377c1a8a79f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:51.166976 11621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be3de57a254453d9dc75680e7f27f22" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
I20260709 13:01:51.181305 11621 raft_consensus.cc:3060] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:51.185822 11699 consensus_queue.cc:1048] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.085s
W20260709 13:01:51.323299 11711 log.cc:927] Time spent T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367: Append to log took a long time: real 0.129s	user 0.009s	sys 0.000s
I20260709 13:01:51.323570 10906 raft_consensus.cc:1275] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Refusing update from remote peer dbd1fdffc68440e5b6250f6d95a4a367: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:01:51.328589 11716 log.cc:927] Time spent T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab: Append to log took a long time: real 0.090s	user 0.000s	sys 0.005s
I20260709 13:01:51.334122 11618 raft_consensus.cc:1275] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Refusing update from remote peer 5e62c52a41f7476a908dd377c1a8a79f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:51.348590 10659 catalog_manager.cc:5697] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f reported cstate change: term changed from 1 to 2, leader changed from 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193) to 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196). New cstate: current_term: 2 leader_uuid: "5e62c52a41f7476a908dd377c1a8a79f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:51.352777 10659 catalog_manager.cc:5697] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f reported cstate change: term changed from 1 to 2, leader changed from 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193) to 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196). New cstate: current_term: 2 leader_uuid: "5e62c52a41f7476a908dd377c1a8a79f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:51.355248 10659 catalog_manager.cc:5697] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f reported cstate change: term changed from 1 to 2, leader changed from 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193) to 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196). New cstate: current_term: 2 leader_uuid: "5e62c52a41f7476a908dd377c1a8a79f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:51.357369 10659 catalog_manager.cc:5697] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f reported cstate change: term changed from 1 to 2, leader changed from 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193) to 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196). New cstate: current_term: 2 leader_uuid: "5e62c52a41f7476a908dd377c1a8a79f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:51.359525 10659 catalog_manager.cc:5697] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f reported cstate change: term changed from 1 to 2, leader changed from 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193) to 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196). New cstate: current_term: 2 leader_uuid: "5e62c52a41f7476a908dd377c1a8a79f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:51.338261 10876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42509, user_credentials={real_user=slave}} blocked reactor thread for 144426us
I20260709 13:01:51.361595 10659 catalog_manager.cc:5697] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f reported cstate change: term changed from 1 to 2, leader changed from 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193) to 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196). New cstate: current_term: 2 leader_uuid: "5e62c52a41f7476a908dd377c1a8a79f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:51.363782 10659 catalog_manager.cc:5697] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f reported cstate change: term changed from 1 to 2, leader changed from 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193) to 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196). New cstate: current_term: 2 leader_uuid: "5e62c52a41f7476a908dd377c1a8a79f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:51.386857 10950 consensus_peers.cc:597] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:51.388953 11674 consensus_queue.cc:1048] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:51.393385 11626 raft_consensus.cc:1275] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Refusing update from remote peer 5e62c52a41f7476a908dd377c1a8a79f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:51.398290 10836 raft_consensus.cc:1275] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Refusing update from remote peer 5e62c52a41f7476a908dd377c1a8a79f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:01:51.410946 10950 consensus_peers.cc:597] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:51.417742 10950 consensus_peers.cc:597] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:51.418653 11671 consensus_queue.cc:1048] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:51.420253 10950 consensus_peers.cc:597] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:51.422408 10950 consensus_peers.cc:597] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:51.423933 11699 consensus_queue.cc:1048] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:51.431259 10950 consensus_peers.cc:597] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:51.431959 10910 raft_consensus.cc:1275] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Refusing update from remote peer 5e62c52a41f7476a908dd377c1a8a79f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:01:51.434096 10950 consensus_peers.cc:597] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:51.432919 10906 raft_consensus.cc:1275] T e3dd15d873514f74a9bca08bc55e5d36 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Refusing update from remote peer 5e62c52a41f7476a908dd377c1a8a79f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:01:51.438761 10876 consensus_peers.cc:597] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:51.440030 10876 consensus_peers.cc:597] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:51.440666 10876 consensus_peers.cc:597] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:51.443184 10907 raft_consensus.cc:1275] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Refusing update from remote peer dbd1fdffc68440e5b6250f6d95a4a367: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:51.448285 11625 raft_consensus.cc:1275] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Refusing update from remote peer 5e62c52a41f7476a908dd377c1a8a79f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:51.437252 11699 consensus_queue.cc:1048] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:51.450127 11678 consensus_queue.cc:1048] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:51.450500 11622 raft_consensus.cc:1275] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Refusing update from remote peer dbd1fdffc68440e5b6250f6d95a4a367: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:01:51.431149 10802 consensus_peers.cc:597] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:51.451666 10802 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34489, user_credentials={real_user=slave}} blocked reactor thread for 115247us
I20260709 13:01:51.463327 11579 consensus_queue.cc:1048] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:51.464418 11699 consensus_queue.cc:1048] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:51.468643 11621 raft_consensus.cc:2468] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 2.
W20260709 13:01:51.481890 10951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:35051, user_credentials={real_user=slave}} blocked reactor thread for 45243.2us
I20260709 13:01:51.497349 10905 raft_consensus.cc:1275] T 3aa37ce6306b47f0b7ead1fda7590834 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Refusing update from remote peer dbd1fdffc68440e5b6250f6d95a4a367: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:51.515193 11578 tablet_bootstrap.cc:492] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:01:51.515937 10802 consensus_peers.cc:597] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:51.515655 10657 catalog_manager.cc:5697] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab reported cstate change: term changed from 1 to 2, leader changed from 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193) to b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195). New cstate: current_term: 2 leader_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:51.516866 10802 consensus_peers.cc:597] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:51.517752 10802 consensus_peers.cc:597] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:51.519085 10802 consensus_peers.cc:597] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:51.517921 10657 catalog_manager.cc:5697] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab reported cstate change: term changed from 1 to 2, leader changed from 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193) to b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195). New cstate: current_term: 2 leader_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:51.517889 11537 consensus_queue.cc:1048] T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:01:51.522106 10657 catalog_manager.cc:5697] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab reported cstate change: term changed from 1 to 2, leader changed from 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193) to b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195). New cstate: current_term: 2 leader_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:51.527230 11537 consensus_queue.cc:1048] T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:51.536409 11689 consensus_queue.cc:1048] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:51.535928 10658 catalog_manager.cc:5697] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 reported cstate change: term changed from 1 to 2, leader changed from 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193) to dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:51.543147 11625 raft_consensus.cc:1275] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Refusing update from remote peer b778a184b0ac46f5b86ce4fe363dcbab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:51.545116 11625 raft_consensus.cc:1275] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Refusing update from remote peer b778a184b0ac46f5b86ce4fe363dcbab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:51.555747 11691 consensus_queue.cc:1048] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:51.556028 11557 consensus_queue.cc:1048] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:51.557993 10834 raft_consensus.cc:1275] T 9be3de57a254453d9dc75680e7f27f22 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Refusing update from remote peer b778a184b0ac46f5b86ce4fe363dcbab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:51.559696 11691 consensus_queue.cc:1048] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:51.561863 10876 consensus_peers.cc:597] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:51.565948 11578 tablet_bootstrap.cc:492] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:51.566789 11578 ts_tablet_manager.cc:1403] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.464s	user 0.016s	sys 0.009s
I20260709 13:01:51.580514 10908 raft_consensus.cc:1275] T ffe62eca39f04407943d15c5f7646aee P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Refusing update from remote peer 5e62c52a41f7476a908dd377c1a8a79f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:51.582692 11678 consensus_queue.cc:1048] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:51.602721 11619 raft_consensus.cc:1275] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Refusing update from remote peer b778a184b0ac46f5b86ce4fe363dcbab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:51.657267 10986 raft_consensus.cc:1275] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Refusing update from remote peer b778a184b0ac46f5b86ce4fe363dcbab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:51.667233 11619 raft_consensus.cc:1275] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Refusing update from remote peer 5e62c52a41f7476a908dd377c1a8a79f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:51.671710 10980 raft_consensus.cc:1275] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Refusing update from remote peer dbd1fdffc68440e5b6250f6d95a4a367: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:51.671550 11678 consensus_queue.cc:1048] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:51.604149 10979 raft_consensus.cc:1275] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Refusing update from remote peer b778a184b0ac46f5b86ce4fe363dcbab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:01:51.687522 10876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42509, user_credentials={real_user=slave}} blocked reactor thread for 56291.3us
I20260709 13:01:51.674705 11578 raft_consensus.cc:359] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:51.690351 11578 raft_consensus.cc:740] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.691565 11578 consensus_queue.cc:260] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:51.694705 11578 ts_tablet_manager.cc:1434] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.128s	user 0.007s	sys 0.000s
I20260709 13:01:51.695721 11578 tablet_bootstrap.cc:492] T 4a819525c849499885ee37af7d0f42a2 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:51.699977 11694 consensus_queue.cc:1048] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:51.701719 11694 consensus_queue.cc:1048] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:51.718015 11556 consensus_queue.cc:1048] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:51.730581 11578 tablet_bootstrap.cc:492] T 4a819525c849499885ee37af7d0f42a2 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:51.731859 11578 tablet_bootstrap.cc:492] T 4a819525c849499885ee37af7d0f42a2 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:51.732692 11578 ts_tablet_manager.cc:1403] T 4a819525c849499885ee37af7d0f42a2 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.008s
I20260709 13:01:51.742712 11578 raft_consensus.cc:359] T 4a819525c849499885ee37af7d0f42a2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:51.752884 11537 consensus_queue.cc:1048] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:51.756919 11578 raft_consensus.cc:740] T 4a819525c849499885ee37af7d0f42a2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.759912 11578 consensus_queue.cc:260] T 4a819525c849499885ee37af7d0f42a2 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:51.766764 11578 ts_tablet_manager.cc:1434] T 4a819525c849499885ee37af7d0f42a2 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.000s
I20260709 13:01:51.769665 11578 tablet_bootstrap.cc:492] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
W20260709 13:01:51.789505 10802 consensus_peers.cc:597] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:51.794054 10802 consensus_peers.cc:597] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:51.805137 10802 consensus_peers.cc:597] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:51.844872 10876 consensus_peers.cc:597] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:51.853014 10876 consensus_peers.cc:597] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:51.853089 11578 tablet_bootstrap.cc:492] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:51.854866 11578 tablet_bootstrap.cc:492] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:51.855599 11578 ts_tablet_manager.cc:1403] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.086s	user 0.013s	sys 0.004s
I20260709 13:01:51.859754 11578 raft_consensus.cc:359] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:51.860523 11578 raft_consensus.cc:740] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.861249 11578 consensus_queue.cc:260] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:51.863322 11578 ts_tablet_manager.cc:1434] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:01:51.864161 11578 tablet_bootstrap.cc:492] T bec830b175ce40d69b73d9f73ea266a7 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
W20260709 13:01:51.880121 10950 consensus_peers.cc:597] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:51.891974 11578 tablet_bootstrap.cc:492] T bec830b175ce40d69b73d9f73ea266a7 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:51.893169 11578 tablet_bootstrap.cc:492] T bec830b175ce40d69b73d9f73ea266a7 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:51.893945 11578 ts_tablet_manager.cc:1403] T bec830b175ce40d69b73d9f73ea266a7 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.004s
I20260709 13:01:51.896684 11578 raft_consensus.cc:359] T bec830b175ce40d69b73d9f73ea266a7 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:51.897537 11578 raft_consensus.cc:740] T bec830b175ce40d69b73d9f73ea266a7 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.898429 11578 consensus_queue.cc:260] T bec830b175ce40d69b73d9f73ea266a7 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:51.906272 11578 ts_tablet_manager.cc:1434] T bec830b175ce40d69b73d9f73ea266a7 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:01:51.907299 11578 tablet_bootstrap.cc:492] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
W20260709 13:01:51.961397 10876 consensus_peers.cc:597] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:51.978731 11578 tablet_bootstrap.cc:492] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:01:51.985971 10802 consensus_peers.cc:597] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:51.986197 11578 tablet_bootstrap.cc:492] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:51.987134 11578 ts_tablet_manager.cc:1403] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.080s	user 0.036s	sys 0.011s
I20260709 13:01:51.991132 11578 raft_consensus.cc:359] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:51.991868 11578 raft_consensus.cc:740] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:51.992744 11578 consensus_queue.cc:260] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:51.996182 11578 ts_tablet_manager.cc:1434] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:01:52.013489 11621 raft_consensus.cc:3060] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.022745 11578 tablet_bootstrap.cc:492] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:52.041296 11578 tablet_bootstrap.cc:492] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:52.042323 11578 tablet_bootstrap.cc:492] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:52.046967 11578 ts_tablet_manager.cc:1403] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.002s
I20260709 13:01:52.049731 11578 raft_consensus.cc:359] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:52.050439 11578 raft_consensus.cc:740] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.051133 11578 consensus_queue.cc:260] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:52.053066 11578 ts_tablet_manager.cc:1434] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:01:52.053742 11578 tablet_bootstrap.cc:492] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:52.071761 11578 tablet_bootstrap.cc:492] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:52.072567 11578 tablet_bootstrap.cc:492] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:52.073235 11578 ts_tablet_manager.cc:1403] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:01:52.077190 11578 raft_consensus.cc:359] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:52.077765 11578 raft_consensus.cc:740] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.078444 11578 consensus_queue.cc:260] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:52.083820 11578 ts_tablet_manager.cc:1434] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:01:52.084897 11578 tablet_bootstrap.cc:492] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:52.098613 11578 tablet_bootstrap.cc:492] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:52.099704 11578 tablet_bootstrap.cc:492] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:52.100450 11578 ts_tablet_manager.cc:1403] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.007s
I20260709 13:01:52.102747 11578 raft_consensus.cc:359] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:52.103223 11578 raft_consensus.cc:740] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.103812 11578 consensus_queue.cc:260] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:52.105386 11578 ts_tablet_manager.cc:1434] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
I20260709 13:01:52.106289 11578 tablet_bootstrap.cc:492] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:52.119683 11578 tablet_bootstrap.cc:492] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:52.120450 11578 tablet_bootstrap.cc:492] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:52.121102 11578 ts_tablet_manager.cc:1403] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:01:52.123180 11578 raft_consensus.cc:359] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:52.123803 11578 raft_consensus.cc:740] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.124342 11578 consensus_queue.cc:260] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:52.125939 11578 ts_tablet_manager.cc:1434] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:01:52.126852 11578 tablet_bootstrap.cc:492] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:52.139186 11578 tablet_bootstrap.cc:492] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:52.140012 11578 tablet_bootstrap.cc:492] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:52.140653 11578 ts_tablet_manager.cc:1403] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:01:52.142635 11578 raft_consensus.cc:359] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:52.143126 11578 raft_consensus.cc:740] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.143679 11578 consensus_queue.cc:260] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:52.145262 11578 ts_tablet_manager.cc:1434] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:01:52.146525 11578 tablet_bootstrap.cc:492] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:52.154147 11621 raft_consensus.cc:3060] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.161808 11578 tablet_bootstrap.cc:492] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:52.162840 11578 tablet_bootstrap.cc:492] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:52.163517 11578 ts_tablet_manager.cc:1403] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 13:01:52.166038 11578 raft_consensus.cc:359] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:52.166765 11578 raft_consensus.cc:740] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.167452 11578 consensus_queue.cc:260] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:52.169720 11578 ts_tablet_manager.cc:1434] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:01:52.170536 11578 tablet_bootstrap.cc:492] T d4b9835406e84c5b88d3c3eed76a3b95 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:52.185564 11578 tablet_bootstrap.cc:492] T d4b9835406e84c5b88d3c3eed76a3b95 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:52.186575 11578 tablet_bootstrap.cc:492] T d4b9835406e84c5b88d3c3eed76a3b95 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:52.187264 11578 ts_tablet_manager.cc:1403] T d4b9835406e84c5b88d3c3eed76a3b95 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:01:52.189872 11578 raft_consensus.cc:359] T d4b9835406e84c5b88d3c3eed76a3b95 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:52.190579 11578 raft_consensus.cc:740] T d4b9835406e84c5b88d3c3eed76a3b95 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.191340 11578 consensus_queue.cc:260] T d4b9835406e84c5b88d3c3eed76a3b95 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:52.193531 11578 ts_tablet_manager.cc:1434] T d4b9835406e84c5b88d3c3eed76a3b95 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:01:52.194819 11578 tablet_bootstrap.cc:492] T a19edd96c26a4c91a7b2a412d8221e5b P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:52.208901 11578 tablet_bootstrap.cc:492] T a19edd96c26a4c91a7b2a412d8221e5b P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:52.209862 11578 tablet_bootstrap.cc:492] T a19edd96c26a4c91a7b2a412d8221e5b P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:52.210551 11578 ts_tablet_manager.cc:1403] T a19edd96c26a4c91a7b2a412d8221e5b P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:01:52.212535 11578 raft_consensus.cc:359] T a19edd96c26a4c91a7b2a412d8221e5b P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:52.213088 11578 raft_consensus.cc:740] T a19edd96c26a4c91a7b2a412d8221e5b P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.213759 11578 consensus_queue.cc:260] T a19edd96c26a4c91a7b2a412d8221e5b P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:52.215670 11578 ts_tablet_manager.cc:1434] T a19edd96c26a4c91a7b2a412d8221e5b P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:01:52.217199 11578 tablet_bootstrap.cc:492] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:52.230387 11626 raft_consensus.cc:3060] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.237221 11578 tablet_bootstrap.cc:492] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:52.238272 11578 tablet_bootstrap.cc:492] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:52.238914 11578 ts_tablet_manager.cc:1403] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.001s
I20260709 13:01:52.241478 11578 raft_consensus.cc:359] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:52.242183 11578 raft_consensus.cc:740] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.242854 11578 consensus_queue.cc:260] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:52.244683 11578 ts_tablet_manager.cc:1434] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:01:52.247222 11578 tablet_bootstrap.cc:492] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:52.268065 11578 tablet_bootstrap.cc:492] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:52.268901 11578 tablet_bootstrap.cc:492] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:52.269517 11578 ts_tablet_manager.cc:1403] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.023s	user 0.004s	sys 0.012s
I20260709 13:01:52.271617 11578 raft_consensus.cc:359] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:52.273161 11578 raft_consensus.cc:740] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.274080 11578 consensus_queue.cc:260] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:52.276342 11578 ts_tablet_manager.cc:1434] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:01:52.277264 11578 tablet_bootstrap.cc:492] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:52.294704 11578 tablet_bootstrap.cc:492] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:52.295617 11578 tablet_bootstrap.cc:492] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:52.296315 11578 ts_tablet_manager.cc:1403] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.004s
I20260709 13:01:52.298833 11578 raft_consensus.cc:359] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:52.299361 11578 raft_consensus.cc:740] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.299952 11578 consensus_queue.cc:260] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:52.301875 11578 ts_tablet_manager.cc:1434] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:01:52.303144 11578 tablet_bootstrap.cc:492] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:52.320847 11578 tablet_bootstrap.cc:492] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:52.321736 11578 tablet_bootstrap.cc:492] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:52.322404 11578 ts_tablet_manager.cc:1403] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 13:01:52.324971 11578 raft_consensus.cc:359] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:52.325670 11578 raft_consensus.cc:740] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.326454 11578 consensus_queue.cc:260] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:52.328446 11578 ts_tablet_manager.cc:1434] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:01:52.329315 11578 tablet_bootstrap.cc:492] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:52.345295 11578 tablet_bootstrap.cc:492] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:52.346315 11578 tablet_bootstrap.cc:492] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:52.346975 11578 ts_tablet_manager.cc:1403] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.008s
I20260709 13:01:52.348958 11578 raft_consensus.cc:359] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:52.349519 11578 raft_consensus.cc:740] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.350117 11578 consensus_queue.cc:260] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:52.352232 11578 ts_tablet_manager.cc:1434] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:01:52.354028 11578 tablet_bootstrap.cc:492] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:52.368602 11578 tablet_bootstrap.cc:492] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:52.369549 11578 tablet_bootstrap.cc:492] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:52.370189 11578 ts_tablet_manager.cc:1403] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:01:52.372449 11578 raft_consensus.cc:359] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:52.373157 11578 raft_consensus.cc:740] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.373769 11578 consensus_queue.cc:260] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:52.376085 11578 ts_tablet_manager.cc:1434] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:01:52.377434 11578 tablet_bootstrap.cc:492] T a8b5a22ddad942d7b4db2b897e159337 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:52.393201 11578 tablet_bootstrap.cc:492] T a8b5a22ddad942d7b4db2b897e159337 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:52.394158 11578 tablet_bootstrap.cc:492] T a8b5a22ddad942d7b4db2b897e159337 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:52.394850 11578 ts_tablet_manager.cc:1403] T a8b5a22ddad942d7b4db2b897e159337 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.001s
I20260709 13:01:52.397115 11578 raft_consensus.cc:359] T a8b5a22ddad942d7b4db2b897e159337 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:52.397588 11578 raft_consensus.cc:740] T a8b5a22ddad942d7b4db2b897e159337 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.398155 11578 consensus_queue.cc:260] T a8b5a22ddad942d7b4db2b897e159337 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:52.399749 11578 ts_tablet_manager.cc:1434] T a8b5a22ddad942d7b4db2b897e159337 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:01:52.400875 11578 tablet_bootstrap.cc:492] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:52.401551 11621 raft_consensus.cc:3060] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.420147 11578 tablet_bootstrap.cc:492] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:52.421379 11578 tablet_bootstrap.cc:492] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:52.422187 11578 ts_tablet_manager.cc:1403] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
I20260709 13:01:52.424883 11578 raft_consensus.cc:359] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:52.425680 11578 raft_consensus.cc:740] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.426411 11578 consensus_queue.cc:260] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:52.428680 11578 ts_tablet_manager.cc:1434] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:01:52.429533 11578 tablet_bootstrap.cc:492] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:52.443066 11621 raft_consensus.cc:3060] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.445835 11578 tablet_bootstrap.cc:492] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:52.446985 11578 tablet_bootstrap.cc:492] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:52.447629 11578 ts_tablet_manager.cc:1403] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.001s
I20260709 13:01:52.450174 11578 raft_consensus.cc:359] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:52.451550 11578 raft_consensus.cc:740] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.452510 11578 consensus_queue.cc:260] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:52.491781 11578 ts_tablet_manager.cc:1434] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.044s	user 0.010s	sys 0.012s
I20260709 13:01:52.494045 11578 tablet_bootstrap.cc:492] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:52.529553 11621 raft_consensus.cc:3060] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.532893 11578 tablet_bootstrap.cc:492] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:52.534061 11578 tablet_bootstrap.cc:492] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:52.534823 11578 ts_tablet_manager.cc:1403] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.042s	user 0.022s	sys 0.012s
I20260709 13:01:52.537552 11578 raft_consensus.cc:359] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:52.538367 11578 raft_consensus.cc:740] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.539386 11578 consensus_queue.cc:260] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:52.542158 11578 ts_tablet_manager.cc:1434] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:01:52.543270 11578 tablet_bootstrap.cc:492] T b5a791a0126444ba90c1fb442e1b809b P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:52.548883 11622 raft_consensus.cc:3060] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.573880 11578 tablet_bootstrap.cc:492] T b5a791a0126444ba90c1fb442e1b809b P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:52.574818 11578 tablet_bootstrap.cc:492] T b5a791a0126444ba90c1fb442e1b809b P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:52.576462 11578 ts_tablet_manager.cc:1403] T b5a791a0126444ba90c1fb442e1b809b P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.000s
I20260709 13:01:52.579423 11578 raft_consensus.cc:359] T b5a791a0126444ba90c1fb442e1b809b P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:52.580130 11578 raft_consensus.cc:740] T b5a791a0126444ba90c1fb442e1b809b P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.580776 11578 consensus_queue.cc:260] T b5a791a0126444ba90c1fb442e1b809b P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:01:52.582821 11578 ts_tablet_manager.cc:1434] T b5a791a0126444ba90c1fb442e1b809b P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:01:52.583585 11578 tablet_bootstrap.cc:492] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:52.597247 11578 tablet_bootstrap.cc:492] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:52.598202 11578 tablet_bootstrap.cc:492] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:52.598874 11578 ts_tablet_manager.cc:1403] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:01:52.601004 11578 raft_consensus.cc:359] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:52.601512 11578 raft_consensus.cc:740] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.602115 11578 consensus_queue.cc:260] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:52.603483 11578 ts_tablet_manager.cc:1434] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:01:52.604974 11578 tablet_bootstrap.cc:492] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:52.622385 11622 raft_consensus.cc:3060] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.623680 11578 tablet_bootstrap.cc:492] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:52.624732 11578 tablet_bootstrap.cc:492] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:52.625412 11578 ts_tablet_manager.cc:1403] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 13:01:52.627923 11578 raft_consensus.cc:359] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:52.628624 11578 raft_consensus.cc:740] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.629304 11578 consensus_queue.cc:260] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:01:52.631920 11578 ts_tablet_manager.cc:1434] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:01:52.632823 11578 tablet_bootstrap.cc:492] T 16fbb9a91d614ce3834f82ce725667fa P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap starting.
I20260709 13:01:52.648891 11578 tablet_bootstrap.cc:492] T 16fbb9a91d614ce3834f82ce725667fa P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:52.649695 11578 tablet_bootstrap.cc:492] T 16fbb9a91d614ce3834f82ce725667fa P 346158a6aa6747c1b8d31b4fb80238d0: Bootstrap complete.
I20260709 13:01:52.650270 11578 ts_tablet_manager.cc:1403] T 16fbb9a91d614ce3834f82ce725667fa P 346158a6aa6747c1b8d31b4fb80238d0: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:01:52.652287 11578 raft_consensus.cc:359] T 16fbb9a91d614ce3834f82ce725667fa P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:52.652920 11578 raft_consensus.cc:740] T 16fbb9a91d614ce3834f82ce725667fa P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.653762 11578 consensus_queue.cc:260] T 16fbb9a91d614ce3834f82ce725667fa P 346158a6aa6747c1b8d31b4fb80238d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:01:52.655721 11578 ts_tablet_manager.cc:1434] T 16fbb9a91d614ce3834f82ce725667fa P 346158a6aa6747c1b8d31b4fb80238d0: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:01:52.872097 11622 raft_consensus.cc:3060] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:00.131162   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:00.184813 10980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "611ca169fbcc420fb11d1502cbe196a9"
dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
mode: GRACEFUL
new_leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
 from {username='slave'} at 127.0.0.1:56384
I20260709 13:02:00.185792 10980 raft_consensus.cc:606] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Received request to transfer leadership to TS 346158a6aa6747c1b8d31b4fb80238d0
I20260709 13:02:00.190938 10986 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64c5fd517a084ef9b707c36ec7c2fe3c"
dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
mode: GRACEFUL
new_leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
 from {username='slave'} at 127.0.0.1:56384
I20260709 13:02:00.191772 10986 raft_consensus.cc:606] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Received request to transfer leadership to TS 346158a6aa6747c1b8d31b4fb80238d0
I20260709 13:02:00.216033 10907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e187848edaa746928d647a830da8c970"
dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
mode: GRACEFUL
new_leader_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
 from {username='slave'} at 127.0.0.1:45164
I20260709 13:02:00.216935 10907 raft_consensus.cc:606] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Received request to transfer leadership to TS 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:02:00.221448 10980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3dd15d873514f74a9bca08bc55e5d36"
dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
mode: GRACEFUL
new_leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
 from {username='slave'} at 127.0.0.1:56384
I20260709 13:02:00.222121 10980 raft_consensus.cc:606] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Received request to transfer leadership to TS 346158a6aa6747c1b8d31b4fb80238d0
I20260709 13:02:00.230415 10980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5382a9b34d84b4fbeccc952bb5f4ef5"
dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
mode: GRACEFUL
new_leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
 from {username='slave'} at 127.0.0.1:56384
I20260709 13:02:00.231190 10980 raft_consensus.cc:606] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Received request to transfer leadership to TS 346158a6aa6747c1b8d31b4fb80238d0
I20260709 13:02:00.254151 10837 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e81009eaf7bf4ee9b7ef6b9a92d61a73"
dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
mode: GRACEFUL
new_leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
 from {username='slave'} at 127.0.0.1:37680
I20260709 13:02:00.254743 10837 raft_consensus.cc:606] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Received request to transfer leadership to TS 346158a6aa6747c1b8d31b4fb80238d0
I20260709 13:02:00.256366   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:02:00.257637   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:00.340729 11797 raft_consensus.cc:993] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab: : Instructing follower 5e62c52a41f7476a908dd377c1a8a79f to start an election
I20260709 13:02:00.341585 11792 raft_consensus.cc:1081] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Signalling peer 5e62c52a41f7476a908dd377c1a8a79f to start an election
I20260709 13:02:00.343273 10980 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e187848edaa746928d647a830da8c970"
dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
 from {username='slave'} at 127.0.0.1:43106
I20260709 13:02:00.343948 10980 raft_consensus.cc:493] T e187848edaa746928d647a830da8c970 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:00.344395 10980 raft_consensus.cc:3060] T e187848edaa746928d647a830da8c970 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:00.353792 10980 raft_consensus.cc:515] T e187848edaa746928d647a830da8c970 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:02:00.357326 10980 leader_election.cc:290] T e187848edaa746928d647a830da8c970 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 election: Requested vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:02:00.358456 10907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e187848edaa746928d647a830da8c970" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:02:00.358412 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e187848edaa746928d647a830da8c970" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:02:00.359539 10907 raft_consensus.cc:3055] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:00.359792 10837 raft_consensus.cc:3060] T e187848edaa746928d647a830da8c970 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:00.359882 10907 raft_consensus.cc:740] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Running, Role: LEADER
I20260709 13:02:00.361131 10907 consensus_queue.cc:260] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:02:00.362954 10907 raft_consensus.cc:3060] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:00.368973 10837 raft_consensus.cc:2468] T e187848edaa746928d647a830da8c970 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 2.
I20260709 13:02:00.371017 10951 leader_election.cc:304] T e187848edaa746928d647a830da8c970 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:02:00.372387 10907 raft_consensus.cc:2468] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 2.
I20260709 13:02:00.372448 11795 raft_consensus.cc:2804] T e187848edaa746928d647a830da8c970 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:00.374651 11795 raft_consensus.cc:697] T e187848edaa746928d647a830da8c970 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Becoming Leader. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
I20260709 13:02:00.376248 11795 consensus_queue.cc:237] T e187848edaa746928d647a830da8c970 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:02:00.390746 10657 catalog_manager.cc:5697] T e187848edaa746928d647a830da8c970 P 5e62c52a41f7476a908dd377c1a8a79f reported cstate change: term changed from 1 to 2, leader changed from b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195) to 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196). New cstate: current_term: 2 leader_uuid: "5e62c52a41f7476a908dd377c1a8a79f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:00.395929 11675 raft_consensus.cc:993] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f: : Instructing follower 346158a6aa6747c1b8d31b4fb80238d0 to start an election
I20260709 13:02:00.396510 11795 raft_consensus.cc:1081] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Signalling peer 346158a6aa6747c1b8d31b4fb80238d0 to start an election
I20260709 13:02:00.398736 11626 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "611ca169fbcc420fb11d1502cbe196a9"
dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
 from {username='slave'} at 127.0.0.1:47612
I20260709 13:02:00.399415 11626 raft_consensus.cc:493] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:00.399907 11626 raft_consensus.cc:3060] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:00.408564 11626 raft_consensus.cc:515] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:02:00.419688 11626 leader_election.cc:290] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 2 election: Requested vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:02:00.429637 11795 raft_consensus.cc:993] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f: : Instructing follower 346158a6aa6747c1b8d31b4fb80238d0 to start an election
I20260709 13:02:00.430240 11795 raft_consensus.cc:1081] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Signalling peer 346158a6aa6747c1b8d31b4fb80238d0 to start an election
I20260709 13:02:00.432770 11626 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5382a9b34d84b4fbeccc952bb5f4ef5"
dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
 from {username='slave'} at 127.0.0.1:47612
I20260709 13:02:00.433346 11626 raft_consensus.cc:493] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:00.433677 11626 raft_consensus.cc:3060] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:00.441246 11626 raft_consensus.cc:515] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:02:00.452037 11626 leader_election.cc:290] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 3 election: Requested vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:02:00.463135 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611ca169fbcc420fb11d1502cbe196a9" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:02:00.463559 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5382a9b34d84b4fbeccc952bb5f4ef5" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:02:00.463776 10980 raft_consensus.cc:3055] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:00.464123 10980 raft_consensus.cc:740] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
I20260709 13:02:00.464177 10986 raft_consensus.cc:3055] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:00.464570 10986 raft_consensus.cc:740] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
I20260709 13:02:00.465059 10980 consensus_queue.cc:260] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:02:00.465320 10986 consensus_queue.cc:260] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:02:00.466545 10980 raft_consensus.cc:3060] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:00.466706 10986 raft_consensus.cc:3060] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:00.476598 10980 raft_consensus.cc:2468] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 2.
I20260709 13:02:00.477378 10986 raft_consensus.cc:2468] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 3.
I20260709 13:02:00.483052 11802 raft_consensus.cc:993] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f: : Instructing follower 346158a6aa6747c1b8d31b4fb80238d0 to start an election
I20260709 13:02:00.489562 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5382a9b34d84b4fbeccc952bb5f4ef5" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:02:00.492415 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611ca169fbcc420fb11d1502cbe196a9" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:02:00.492781 11802 raft_consensus.cc:1081] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Signalling peer 346158a6aa6747c1b8d31b4fb80238d0 to start an election
I20260709 13:02:00.493197 11573 leader_election.cc:304] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f; no voters: 
I20260709 13:02:00.494989 10910 raft_consensus.cc:3060] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:00.498147 10837 raft_consensus.cc:3060] T 611ca169fbcc420fb11d1502cbe196a9 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:00.505884 10910 raft_consensus.cc:2468] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 3.
I20260709 13:02:00.508544 10837 raft_consensus.cc:2468] T 611ca169fbcc420fb11d1502cbe196a9 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 2.
I20260709 13:02:00.509917 11574 leader_election.cc:304] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:02:00.511658 11812 raft_consensus.cc:2804] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:00.512439 11626 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3dd15d873514f74a9bca08bc55e5d36"
dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
 from {username='slave'} at 127.0.0.1:47612
I20260709 13:02:00.514977 11626 raft_consensus.cc:493] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:00.515359 11626 raft_consensus.cc:3060] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:00.522410 11626 raft_consensus.cc:515] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:02:00.511978 11814 raft_consensus.cc:2804] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:00.524195 11812 raft_consensus.cc:697] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:02:00.525664 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3dd15d873514f74a9bca08bc55e5d36" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:02:00.525468 11812 consensus_queue.cc:237] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:02:00.526419 10910 raft_consensus.cc:3060] T e3dd15d873514f74a9bca08bc55e5d36 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:00.524268 11626 leader_election.cc:290] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 3 election: Requested vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:02:00.526049 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3dd15d873514f74a9bca08bc55e5d36" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:02:00.530627 10980 raft_consensus.cc:3055] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:00.530982 10980 raft_consensus.cc:740] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
I20260709 13:02:00.533747 10910 raft_consensus.cc:2468] T e3dd15d873514f74a9bca08bc55e5d36 P b778a184b0ac46f5b86ce4fe363dcbab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 3.
I20260709 13:02:00.535312 11575 leader_election.cc:304] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:02:00.535422 10980 consensus_queue.cc:260] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:02:00.536518 11815 raft_consensus.cc:2804] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:00.537081 11815 raft_consensus.cc:697] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:02:00.537111 10980 raft_consensus.cc:3060] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:00.538846 11814 raft_consensus.cc:697] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:02:00.543658 11814 consensus_queue.cc:237] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:02:00.545423 10980 raft_consensus.cc:2468] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 3.
I20260709 13:02:00.546541 11815 consensus_queue.cc:237] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:02:00.556599 10657 catalog_manager.cc:5697] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 2 to 3, leader changed from 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196) to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:00.573876 10657 catalog_manager.cc:5697] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 1 to 2, leader changed from 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196) to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:00.575398 10657 catalog_manager.cc:5697] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 2 to 3, leader changed from 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196) to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:00.643945 11796 raft_consensus.cc:993] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367: : Instructing follower 346158a6aa6747c1b8d31b4fb80238d0 to start an election
I20260709 13:02:00.644492 11798 raft_consensus.cc:1081] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Signalling peer 346158a6aa6747c1b8d31b4fb80238d0 to start an election
I20260709 13:02:00.645910 11626 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e81009eaf7bf4ee9b7ef6b9a92d61a73"
dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
 from {username='slave'} at 127.0.0.1:47598
I20260709 13:02:00.646394 11626 raft_consensus.cc:493] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:00.646660 11626 raft_consensus.cc:3060] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:00.651594 11626 raft_consensus.cc:515] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:02:00.653287 11626 leader_election.cc:290] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 2 election: Requested vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:02:00.654139 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81009eaf7bf4ee9b7ef6b9a92d61a73" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:02:00.654465 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81009eaf7bf4ee9b7ef6b9a92d61a73" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:02:00.654711 10980 raft_consensus.cc:3060] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:00.655020 10837 raft_consensus.cc:3055] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:00.655303 10837 raft_consensus.cc:740] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Running, Role: LEADER
I20260709 13:02:00.656041 10837 consensus_queue.cc:260] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:02:00.657076 10837 raft_consensus.cc:3060] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:00.659801 10980 raft_consensus.cc:2468] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 2.
I20260709 13:02:00.661141 11573 leader_election.cc:304] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f; no voters: 
I20260709 13:02:00.661933 11815 raft_consensus.cc:2804] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:00.662256 10837 raft_consensus.cc:2468] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 2.
I20260709 13:02:00.662413 11815 raft_consensus.cc:697] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:02:00.663564 11815 consensus_queue.cc:237] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:02:00.674000 10657 catalog_manager.cc:5697] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 1 to 2, leader changed from dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194) to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:00.738173 11675 raft_consensus.cc:993] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f: : Instructing follower 346158a6aa6747c1b8d31b4fb80238d0 to start an election
I20260709 13:02:00.738734 11675 raft_consensus.cc:1081] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Signalling peer 346158a6aa6747c1b8d31b4fb80238d0 to start an election
I20260709 13:02:00.740564 11622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64c5fd517a084ef9b707c36ec7c2fe3c"
dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
 from {username='slave'} at 127.0.0.1:47612
I20260709 13:02:00.741096 11622 raft_consensus.cc:493] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:00.741458 11622 raft_consensus.cc:3060] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:00.751549 11622 raft_consensus.cc:515] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:02:00.753253 11622 leader_election.cc:290] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 3 election: Requested vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:02:00.753978 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c5fd517a084ef9b707c36ec7c2fe3c" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:02:00.754495 10834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64c5fd517a084ef9b707c36ec7c2fe3c" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:02:00.754915 10980 raft_consensus.cc:3055] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:00.755148 10834 raft_consensus.cc:3060] T 64c5fd517a084ef9b707c36ec7c2fe3c P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:00.755443 10980 raft_consensus.cc:740] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
I20260709 13:02:00.756410 10980 consensus_queue.cc:260] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:02:00.757870 10980 raft_consensus.cc:3060] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:00.760996 10834 raft_consensus.cc:2468] T 64c5fd517a084ef9b707c36ec7c2fe3c P dbd1fdffc68440e5b6250f6d95a4a367 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 3.
I20260709 13:02:00.762331 11574 leader_election.cc:304] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:02:00.763150 11815 raft_consensus.cc:2804] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:00.763646 11815 raft_consensus.cc:697] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:02:00.763789 10980 raft_consensus.cc:2468] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 3.
I20260709 13:02:00.764595 11815 consensus_queue.cc:237] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:02:00.773365 10657 catalog_manager.cc:5697] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 2 to 3, leader changed from 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196) to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:00.930608 10910 raft_consensus.cc:1275] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Refusing update from remote peer 5e62c52a41f7476a908dd377c1a8a79f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:00.931913 11802 consensus_queue.cc:1048] T e187848edaa746928d647a830da8c970 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:00.934082 10910 raft_consensus.cc:1275] T e3dd15d873514f74a9bca08bc55e5d36 P b778a184b0ac46f5b86ce4fe363dcbab [term 3 FOLLOWER]: Refusing update from remote peer 346158a6aa6747c1b8d31b4fb80238d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:00.935950 11815 consensus_queue.cc:1048] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:00.971978 10980 raft_consensus.cc:1275] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [term 3 FOLLOWER]: Refusing update from remote peer 346158a6aa6747c1b8d31b4fb80238d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:00.973670 11814 consensus_queue.cc:1048] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:00.975562 10834 raft_consensus.cc:1275] T e187848edaa746928d647a830da8c970 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Refusing update from remote peer 5e62c52a41f7476a908dd377c1a8a79f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:00.980885 11675 consensus_queue.cc:1048] T e187848edaa746928d647a830da8c970 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:01.002403 10986 raft_consensus.cc:1275] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Refusing update from remote peer 346158a6aa6747c1b8d31b4fb80238d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:01.004839 11814 consensus_queue.cc:1048] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:01.025717 10837 raft_consensus.cc:1275] T 611ca169fbcc420fb11d1502cbe196a9 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Refusing update from remote peer 346158a6aa6747c1b8d31b4fb80238d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:01.028895 11815 consensus_queue.cc:1048] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:01.038888 10910 raft_consensus.cc:1275] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab [term 3 FOLLOWER]: Refusing update from remote peer 346158a6aa6747c1b8d31b4fb80238d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:01.050630 11812 consensus_queue.cc:1048] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:01.062196 10980 raft_consensus.cc:1275] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [term 3 FOLLOWER]: Refusing update from remote peer 346158a6aa6747c1b8d31b4fb80238d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:01.067469 11812 consensus_queue.cc:1048] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:01.135908 10986 raft_consensus.cc:1275] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Refusing update from remote peer 346158a6aa6747c1b8d31b4fb80238d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:01.137218 11816 consensus_queue.cc:1048] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:01.146828 10834 raft_consensus.cc:1275] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Refusing update from remote peer 346158a6aa6747c1b8d31b4fb80238d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:01.148861 11816 consensus_queue.cc:1048] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:01.174386 10986 raft_consensus.cc:1275] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [term 3 FOLLOWER]: Refusing update from remote peer 346158a6aa6747c1b8d31b4fb80238d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:01.175670 11816 consensus_queue.cc:1048] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:01.191610 10834 raft_consensus.cc:1275] T 64c5fd517a084ef9b707c36ec7c2fe3c P dbd1fdffc68440e5b6250f6d95a4a367 [term 3 FOLLOWER]: Refusing update from remote peer 346158a6aa6747c1b8d31b4fb80238d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:01.193395 11814 consensus_queue.cc:1048] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:01.258713   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:01.300999   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:01.343168 10910 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "205f5d9c197b405faa72a70e2a010102"
dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
mode: GRACEFUL
new_leader_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
 from {username='slave'} at 127.0.0.1:45164
I20260709 13:02:01.343745 10910 raft_consensus.cc:606] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Received request to transfer leadership to TS 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:02:01.346446 10910 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f47768053ec47e69b367bd5a49662c3"
dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
mode: GRACEFUL
new_leader_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
 from {username='slave'} at 127.0.0.1:45164
I20260709 13:02:01.346957 10910 raft_consensus.cc:606] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Received request to transfer leadership to TS 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:02:01.349571 10910 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ecfbc8cc6e7441fb568b197ffade11e"
dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
mode: GRACEFUL
new_leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
 from {username='slave'} at 127.0.0.1:45164
I20260709 13:02:01.350176 10910 raft_consensus.cc:606] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [term 2 LEADER]: Received request to transfer leadership to TS 346158a6aa6747c1b8d31b4fb80238d0
I20260709 13:02:01.352818 10834 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "830984b68ee046d9b9a67009177b55c2"
dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
mode: GRACEFUL
new_leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
 from {username='slave'} at 127.0.0.1:37680
I20260709 13:02:01.353401 10834 raft_consensus.cc:606] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 LEADER]: Received request to transfer leadership to TS 346158a6aa6747c1b8d31b4fb80238d0
I20260709 13:02:01.362684 10910 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96bfa4098abc4f4ba38783e8b91b8cdb"
dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
mode: GRACEFUL
new_leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
 from {username='slave'} at 127.0.0.1:45164
I20260709 13:02:01.363579 10910 raft_consensus.cc:606] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [term 2 LEADER]: Received request to transfer leadership to TS 346158a6aa6747c1b8d31b4fb80238d0
I20260709 13:02:01.366482 10980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f547b171c6b9445c95475ce3be870c2e"
dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
mode: GRACEFUL
new_leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
 from {username='slave'} at 127.0.0.1:56384
I20260709 13:02:01.366997 10980 raft_consensus.cc:606] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Received request to transfer leadership to TS 346158a6aa6747c1b8d31b4fb80238d0
I20260709 13:02:01.368182   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:02:01.369416   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:01.550321 11792 raft_consensus.cc:993] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab: : Instructing follower 346158a6aa6747c1b8d31b4fb80238d0 to start an election
I20260709 13:02:01.550985 11813 raft_consensus.cc:1081] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [term 2 LEADER]: Signalling peer 346158a6aa6747c1b8d31b4fb80238d0 to start an election
I20260709 13:02:01.552969 11622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ecfbc8cc6e7441fb568b197ffade11e"
dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
 from {username='slave'} at 127.0.0.1:47620
I20260709 13:02:01.553649 11622 raft_consensus.cc:493] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:01.554086 11622 raft_consensus.cc:3060] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:01.564857 11622 raft_consensus.cc:515] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:02:01.567219 11622 leader_election.cc:290] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 3 election: Requested vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:02:01.568609 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ecfbc8cc6e7441fb568b197ffade11e" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:02:01.569278 10910 raft_consensus.cc:3055] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:01.569592 10910 raft_consensus.cc:740] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Running, Role: LEADER
I20260709 13:02:01.569731 10834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ecfbc8cc6e7441fb568b197ffade11e" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:02:01.580184 10910 consensus_queue.cc:260] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:02:01.581629 10910 raft_consensus.cc:3060] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:01.582681 10834 raft_consensus.cc:3060] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:01.588951 10910 raft_consensus.cc:2468] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 3.
I20260709 13:02:01.590513 11575 leader_election.cc:304] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:02:01.591811 10834 raft_consensus.cc:2468] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 3.
I20260709 13:02:01.592908 11814 raft_consensus.cc:2804] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:01.593528 11814 raft_consensus.cc:697] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:02:01.594554 11814 consensus_queue.cc:237] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:02:01.603359 10658 catalog_manager.cc:5697] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 2 to 3, leader changed from b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195) to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:01.637760 11796 raft_consensus.cc:993] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367: : Instructing follower 346158a6aa6747c1b8d31b4fb80238d0 to start an election
I20260709 13:02:01.638350 11796 raft_consensus.cc:1081] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 LEADER]: Signalling peer 346158a6aa6747c1b8d31b4fb80238d0 to start an election
I20260709 13:02:01.639796 11622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "830984b68ee046d9b9a67009177b55c2"
dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
 from {username='slave'} at 127.0.0.1:47598
I20260709 13:02:01.640267 11622 raft_consensus.cc:493] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:01.640583 11622 raft_consensus.cc:3060] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:01.645860 11622 raft_consensus.cc:515] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:02:01.647485 11622 leader_election.cc:290] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 3 election: Requested vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:02:01.648341 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830984b68ee046d9b9a67009177b55c2" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:02:01.648429 10834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "830984b68ee046d9b9a67009177b55c2" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:02:01.648989 10980 raft_consensus.cc:3060] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:01.649075 10834 raft_consensus.cc:3055] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:01.649463 10834 raft_consensus.cc:740] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Running, Role: LEADER
I20260709 13:02:01.650230 10834 consensus_queue.cc:260] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:02:01.651455 10834 raft_consensus.cc:3060] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:01.654314 10980 raft_consensus.cc:2468] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 3.
I20260709 13:02:01.655750 11573 leader_election.cc:304] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f; no voters: 
I20260709 13:02:01.656461 10834 raft_consensus.cc:2468] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 3.
I20260709 13:02:01.656669 11814 raft_consensus.cc:2804] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:01.657244 11814 raft_consensus.cc:697] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:02:01.658213 11814 consensus_queue.cc:237] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:02:01.667382 10658 catalog_manager.cc:5697] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 2 to 3, leader changed from dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194) to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:01.723873 11833 raft_consensus.cc:993] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab: : Instructing follower 5e62c52a41f7476a908dd377c1a8a79f to start an election
I20260709 13:02:01.724354 11792 raft_consensus.cc:1081] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Signalling peer 5e62c52a41f7476a908dd377c1a8a79f to start an election
I20260709 13:02:01.725901 10980 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f47768053ec47e69b367bd5a49662c3"
dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
 from {username='slave'} at 127.0.0.1:43106
I20260709 13:02:01.726493 10980 raft_consensus.cc:493] T 2f47768053ec47e69b367bd5a49662c3 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:01.726819 10980 raft_consensus.cc:3060] T 2f47768053ec47e69b367bd5a49662c3 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:01.732262 10980 raft_consensus.cc:515] T 2f47768053ec47e69b367bd5a49662c3 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:02:01.734961 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f47768053ec47e69b367bd5a49662c3" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:02:01.735559 10836 raft_consensus.cc:3060] T 2f47768053ec47e69b367bd5a49662c3 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:01.735777 10980 leader_election.cc:290] T 2f47768053ec47e69b367bd5a49662c3 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 election: Requested vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:02:01.736773 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f47768053ec47e69b367bd5a49662c3" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:02:01.737408 10910 raft_consensus.cc:3055] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:01.737627 10910 raft_consensus.cc:740] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Running, Role: LEADER
I20260709 13:02:01.738322 10910 consensus_queue.cc:260] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:02:01.739471 10910 raft_consensus.cc:3060] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:01.744158 10910 raft_consensus.cc:2468] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 2.
I20260709 13:02:01.745335 10836 raft_consensus.cc:2468] T 2f47768053ec47e69b367bd5a49662c3 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 2.
I20260709 13:02:01.745364 10952 leader_election.cc:304] T 2f47768053ec47e69b367bd5a49662c3 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:02:01.746236 11675 raft_consensus.cc:2804] T 2f47768053ec47e69b367bd5a49662c3 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:01.746680 11675 raft_consensus.cc:697] T 2f47768053ec47e69b367bd5a49662c3 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Becoming Leader. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
I20260709 13:02:01.747332 11675 consensus_queue.cc:237] T 2f47768053ec47e69b367bd5a49662c3 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:02:01.756410 10658 catalog_manager.cc:5697] T 2f47768053ec47e69b367bd5a49662c3 P 5e62c52a41f7476a908dd377c1a8a79f reported cstate change: term changed from 1 to 2, leader changed from b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195) to 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196). New cstate: current_term: 2 leader_uuid: "5e62c52a41f7476a908dd377c1a8a79f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:01.759865 11792 raft_consensus.cc:993] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab: : Instructing follower 346158a6aa6747c1b8d31b4fb80238d0 to start an election
I20260709 13:02:01.760445 11833 raft_consensus.cc:1081] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [term 2 LEADER]: Signalling peer 346158a6aa6747c1b8d31b4fb80238d0 to start an election
I20260709 13:02:01.762195 11622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96bfa4098abc4f4ba38783e8b91b8cdb"
dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
 from {username='slave'} at 127.0.0.1:47620
I20260709 13:02:01.762799 11622 raft_consensus.cc:493] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:01.763273 11622 raft_consensus.cc:3060] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:01.768848 11622 raft_consensus.cc:515] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:02:01.770826 11622 leader_election.cc:290] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 3 election: Requested vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:02:01.771385 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bfa4098abc4f4ba38783e8b91b8cdb" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:02:01.771397 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96bfa4098abc4f4ba38783e8b91b8cdb" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:02:01.772115 10980 raft_consensus.cc:3060] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:01.772208 10910 raft_consensus.cc:3055] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:01.772679 10910 raft_consensus.cc:740] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Running, Role: LEADER
I20260709 13:02:01.773298 10910 consensus_queue.cc:260] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:02:01.774290 10910 raft_consensus.cc:3060] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:01.777552 10980 raft_consensus.cc:2468] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 3.
I20260709 13:02:01.778806 11573 leader_election.cc:304] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f; no voters: 
I20260709 13:02:01.779269 10910 raft_consensus.cc:2468] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 3.
I20260709 13:02:01.779631 11814 raft_consensus.cc:2804] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:01.780174 11814 raft_consensus.cc:697] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:02:01.781013 11814 consensus_queue.cc:237] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:02:01.790659 10658 catalog_manager.cc:5697] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 2 to 3, leader changed from b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195) to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:01.809497 11792 raft_consensus.cc:993] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab: : Instructing follower 5e62c52a41f7476a908dd377c1a8a79f to start an election
I20260709 13:02:01.809985 11833 raft_consensus.cc:1081] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Signalling peer 5e62c52a41f7476a908dd377c1a8a79f to start an election
I20260709 13:02:01.811542 10980 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "205f5d9c197b405faa72a70e2a010102"
dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
 from {username='slave'} at 127.0.0.1:43106
I20260709 13:02:01.812003 10980 raft_consensus.cc:493] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:01.812284 10980 raft_consensus.cc:3060] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:01.817739 10980 raft_consensus.cc:515] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:02:01.819355 10980 leader_election.cc:290] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 election: Requested vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:02:01.820191 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205f5d9c197b405faa72a70e2a010102" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:02:01.820432 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205f5d9c197b405faa72a70e2a010102" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:02:01.820910 10836 raft_consensus.cc:3060] T 205f5d9c197b405faa72a70e2a010102 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:01.821010 10910 raft_consensus.cc:3055] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:01.821364 10910 raft_consensus.cc:740] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Running, Role: LEADER
I20260709 13:02:01.822010 10910 consensus_queue.cc:260] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:02:01.822932 10910 raft_consensus.cc:3060] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:01.826174 10836 raft_consensus.cc:2468] T 205f5d9c197b405faa72a70e2a010102 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 2.
I20260709 13:02:01.827409 10951 leader_election.cc:304] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:02:01.827996 10910 raft_consensus.cc:2468] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 2.
I20260709 13:02:01.828210 11802 raft_consensus.cc:2804] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:01.829005 11802 raft_consensus.cc:697] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Becoming Leader. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
I20260709 13:02:01.829901 11802 consensus_queue.cc:237] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:02:01.840287 10658 catalog_manager.cc:5697] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f reported cstate change: term changed from 1 to 2, leader changed from b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195) to 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196). New cstate: current_term: 2 leader_uuid: "5e62c52a41f7476a908dd377c1a8a79f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:01.852626 11675 raft_consensus.cc:993] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f: : Instructing follower 346158a6aa6747c1b8d31b4fb80238d0 to start an election
I20260709 13:02:01.853125 11802 raft_consensus.cc:1081] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Signalling peer 346158a6aa6747c1b8d31b4fb80238d0 to start an election
I20260709 13:02:01.854676 11622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f547b171c6b9445c95475ce3be870c2e"
dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
 from {username='slave'} at 127.0.0.1:47612
I20260709 13:02:01.855146 11622 raft_consensus.cc:493] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:01.855381 11622 raft_consensus.cc:3060] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:01.860445 11622 raft_consensus.cc:515] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:02:01.863641 11622 leader_election.cc:290] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 2 election: Requested vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:02:01.864070 10908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f547b171c6b9445c95475ce3be870c2e" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:02:01.864127 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f547b171c6b9445c95475ce3be870c2e" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:02:01.864917 10908 raft_consensus.cc:3060] T f547b171c6b9445c95475ce3be870c2e P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:01.864986 10980 raft_consensus.cc:3055] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:01.865512 10980 raft_consensus.cc:740] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
I20260709 13:02:01.866367 10980 consensus_queue.cc:260] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:02:01.867499 10980 raft_consensus.cc:3060] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:01.873032 10908 raft_consensus.cc:2468] T f547b171c6b9445c95475ce3be870c2e P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 2.
I20260709 13:02:01.874291 11575 leader_election.cc:304] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:02:01.874972 11814 raft_consensus.cc:2804] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:01.875520 11814 raft_consensus.cc:697] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:02:01.875409 10980 raft_consensus.cc:2468] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 2.
I20260709 13:02:01.876708 11814 consensus_queue.cc:237] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } }
I20260709 13:02:01.887005 10658 catalog_manager.cc:5697] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 1 to 2, leader changed from 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196) to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:02.031867 10908 raft_consensus.cc:1275] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [term 3 FOLLOWER]: Refusing update from remote peer 346158a6aa6747c1b8d31b4fb80238d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:02.033102 11814 consensus_queue.cc:1048] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:02.045519 10834 raft_consensus.cc:1275] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [term 3 FOLLOWER]: Refusing update from remote peer 346158a6aa6747c1b8d31b4fb80238d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:02.046756 11812 consensus_queue.cc:1048] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:02.079120 10980 raft_consensus.cc:1275] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f [term 3 FOLLOWER]: Refusing update from remote peer 346158a6aa6747c1b8d31b4fb80238d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:02.080602 11812 consensus_queue.cc:1048] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:02.090401 10834 raft_consensus.cc:1275] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 3 FOLLOWER]: Refusing update from remote peer 346158a6aa6747c1b8d31b4fb80238d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:02.091701 11814 consensus_queue.cc:1048] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:02.152513 10908 raft_consensus.cc:1275] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Refusing update from remote peer 5e62c52a41f7476a908dd377c1a8a79f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.154044 11675 consensus_queue.cc:1048] T 2f47768053ec47e69b367bd5a49662c3 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:02.168057 10834 raft_consensus.cc:1275] T 2f47768053ec47e69b367bd5a49662c3 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Refusing update from remote peer 5e62c52a41f7476a908dd377c1a8a79f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.170059 11675 consensus_queue.cc:1048] T 2f47768053ec47e69b367bd5a49662c3 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:02.206995 10908 raft_consensus.cc:1275] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [term 3 FOLLOWER]: Refusing update from remote peer 346158a6aa6747c1b8d31b4fb80238d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:02.208289 11812 consensus_queue.cc:1048] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:02.223927 10986 raft_consensus.cc:1275] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [term 3 FOLLOWER]: Refusing update from remote peer 346158a6aa6747c1b8d31b4fb80238d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:02.225644 11812 consensus_queue.cc:1048] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:02.325574 10834 raft_consensus.cc:1275] T 205f5d9c197b405faa72a70e2a010102 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Refusing update from remote peer 5e62c52a41f7476a908dd377c1a8a79f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.327061 11675 consensus_queue.cc:1048] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:02.339931 10908 raft_consensus.cc:1275] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Refusing update from remote peer 5e62c52a41f7476a908dd377c1a8a79f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.341399 11675 consensus_queue.cc:1048] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:02.370312   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:02.402796 10908 raft_consensus.cc:1275] T f547b171c6b9445c95475ce3be870c2e P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Refusing update from remote peer 346158a6aa6747c1b8d31b4fb80238d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.404091 11812 consensus_queue.cc:1048] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:02.420176 10986 raft_consensus.cc:1275] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Refusing update from remote peer 346158a6aa6747c1b8d31b4fb80238d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.421779 11812 consensus_queue.cc:1048] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:02.426997   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:02.470187 10908 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00d1eccb4ed0452ea1afb814db7c7330"
dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
mode: GRACEFUL
new_leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
 from {username='slave'} at 127.0.0.1:45164
I20260709 13:02:02.470768 10908 raft_consensus.cc:606] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Received request to transfer leadership to TS 346158a6aa6747c1b8d31b4fb80238d0
I20260709 13:02:02.473510 10986 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "205f5d9c197b405faa72a70e2a010102"
dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
mode: GRACEFUL
new_leader_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
 from {username='slave'} at 127.0.0.1:56384
I20260709 13:02:02.474167 10986 raft_consensus.cc:606] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Received request to transfer leadership to TS b778a184b0ac46f5b86ce4fe363dcbab
I20260709 13:02:02.477306 10834 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "211c168fa9614dbda8d8870bf5713616"
dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
mode: GRACEFUL
new_leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
 from {username='slave'} at 127.0.0.1:37680
I20260709 13:02:02.477809 10834 raft_consensus.cc:606] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Received request to transfer leadership to TS 346158a6aa6747c1b8d31b4fb80238d0
I20260709 13:02:02.480249 10980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1470fc689d7429dada3bf5d45a82374"
dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
mode: GRACEFUL
new_leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
 from {username='slave'} at 127.0.0.1:56384
I20260709 13:02:02.480753 10980 raft_consensus.cc:606] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Received request to transfer leadership to TS 346158a6aa6747c1b8d31b4fb80238d0
I20260709 13:02:02.482963 10834 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1c9e47add2e4175b68fde1a27aa92e0"
dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
mode: GRACEFUL
new_leader_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
 from {username='slave'} at 127.0.0.1:37680
I20260709 13:02:02.483423 10834 raft_consensus.cc:606] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Received request to transfer leadership to TS 5e62c52a41f7476a908dd377c1a8a79f
I20260709 13:02:02.485306   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:02.486850   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:02.586360 11675 raft_consensus.cc:993] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f: : Instructing follower 346158a6aa6747c1b8d31b4fb80238d0 to start an election
I20260709 13:02:02.586968 11802 raft_consensus.cc:1081] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Signalling peer 346158a6aa6747c1b8d31b4fb80238d0 to start an election
I20260709 13:02:02.588889 11622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1470fc689d7429dada3bf5d45a82374"
dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
 from {username='slave'} at 127.0.0.1:47612
I20260709 13:02:02.589461 11622 raft_consensus.cc:493] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:02.589804 11622 raft_consensus.cc:3060] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.598367 11622 raft_consensus.cc:515] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:02:02.600019 11622 leader_election.cc:290] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 2 election: Requested vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:02:02.601105 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1470fc689d7429dada3bf5d45a82374" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:02:02.601750 10980 raft_consensus.cc:3055] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:02.601863 10834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1470fc689d7429dada3bf5d45a82374" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:02:02.602478 10834 raft_consensus.cc:3060] T c1470fc689d7429dada3bf5d45a82374 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.602797 10980 raft_consensus.cc:740] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
I20260709 13:02:02.603578 10980 consensus_queue.cc:260] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:02:02.604861 10980 raft_consensus.cc:3060] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.610319 10834 raft_consensus.cc:2468] T c1470fc689d7429dada3bf5d45a82374 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 2.
I20260709 13:02:02.611564 11574 leader_election.cc:304] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:02:02.612905 11814 raft_consensus.cc:2804] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:02.613377 11814 raft_consensus.cc:697] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:02:02.614121 11814 consensus_queue.cc:237] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:02:02.615780 10980 raft_consensus.cc:2468] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 2.
I20260709 13:02:02.626348 10657 catalog_manager.cc:5697] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 1 to 2, leader changed from 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196) to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:02.728847 11860 raft_consensus.cc:993] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f: : Instructing follower b778a184b0ac46f5b86ce4fe363dcbab to start an election
I20260709 13:02:02.729420 11802 raft_consensus.cc:1081] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Signalling peer b778a184b0ac46f5b86ce4fe363dcbab to start an election
I20260709 13:02:02.730872 10910 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "205f5d9c197b405faa72a70e2a010102"
dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
 from {username='slave'} at 127.0.0.1:36192
I20260709 13:02:02.731367 10910 raft_consensus.cc:493] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:02.731648 10910 raft_consensus.cc:3060] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:02.736908 10910 raft_consensus.cc:515] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:02:02.739135 10910 leader_election.cc:290] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 3 election: Requested vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:02:02.740072 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205f5d9c197b405faa72a70e2a010102" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:02:02.740521 10834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205f5d9c197b405faa72a70e2a010102" candidate_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:02:02.741091 10834 raft_consensus.cc:3060] T 205f5d9c197b405faa72a70e2a010102 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:02.740783 10986 raft_consensus.cc:3055] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:02.741581 10986 raft_consensus.cc:740] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
I20260709 13:02:02.742187 10986 consensus_queue.cc:260] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:02:02.743170 10986 raft_consensus.cc:3060] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:02.747202 10834 raft_consensus.cc:2468] T 205f5d9c197b405faa72a70e2a010102 P dbd1fdffc68440e5b6250f6d95a4a367 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 3.
I20260709 13:02:02.748600 10877 leader_election.cc:304] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b778a184b0ac46f5b86ce4fe363dcbab, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:02:02.749116 10986 raft_consensus.cc:2468] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b778a184b0ac46f5b86ce4fe363dcbab in term 3.
I20260709 13:02:02.749425 11792 raft_consensus.cc:2804] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:02.750912 11792 raft_consensus.cc:697] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [term 3 LEADER]: Becoming Leader. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Running, Role: LEADER
I20260709 13:02:02.752858 11792 consensus_queue.cc:237] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:02:02.762917 10657 catalog_manager.cc:5697] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab reported cstate change: term changed from 2 to 3, leader changed from 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196) to b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195). New cstate: current_term: 3 leader_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:02.769134 11833 raft_consensus.cc:993] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab: : Instructing follower 346158a6aa6747c1b8d31b4fb80238d0 to start an election
I20260709 13:02:02.769626 11792 raft_consensus.cc:1081] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Signalling peer 346158a6aa6747c1b8d31b4fb80238d0 to start an election
I20260709 13:02:02.771939 11622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00d1eccb4ed0452ea1afb814db7c7330"
dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
 from {username='slave'} at 127.0.0.1:47620
I20260709 13:02:02.772464 11622 raft_consensus.cc:493] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:02.772837 11622 raft_consensus.cc:3060] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.780442 11622 raft_consensus.cc:515] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:02:02.782018 11622 leader_election.cc:290] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 2 election: Requested vote from peers b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351), 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509)
I20260709 13:02:02.783063 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d1eccb4ed0452ea1afb814db7c7330" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:02:02.783063 10986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00d1eccb4ed0452ea1afb814db7c7330" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:02:02.783938 10910 raft_consensus.cc:3055] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:02.783965 10986 raft_consensus.cc:3060] T 00d1eccb4ed0452ea1afb814db7c7330 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.784458 10910 raft_consensus.cc:740] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Running, Role: LEADER
I20260709 13:02:02.785460 10910 consensus_queue.cc:260] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:02:02.786640 10910 raft_consensus.cc:3060] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.791769 11835 raft_consensus.cc:993] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367: : Instructing follower 5e62c52a41f7476a908dd377c1a8a79f to start an election
I20260709 13:02:02.792132 10986 raft_consensus.cc:2468] T 00d1eccb4ed0452ea1afb814db7c7330 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 2.
I20260709 13:02:02.792366 11835 raft_consensus.cc:1081] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Signalling peer 5e62c52a41f7476a908dd377c1a8a79f to start an election
I20260709 13:02:02.793483 11573 leader_election.cc:304] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f; no voters: 
I20260709 13:02:02.793958 10910 raft_consensus.cc:2468] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 2.
I20260709 13:02:02.794344 10983 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1c9e47add2e4175b68fde1a27aa92e0"
dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
 from {username='slave'} at 127.0.0.1:43120
I20260709 13:02:02.794374 11814 raft_consensus.cc:2804] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:02.795689 10983 raft_consensus.cc:493] T f1c9e47add2e4175b68fde1a27aa92e0 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:02.795769 11814 raft_consensus.cc:697] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:02:02.796200 10983 raft_consensus.cc:3060] T f1c9e47add2e4175b68fde1a27aa92e0 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.796810 11814 consensus_queue.cc:237] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:02:02.804171 10983 raft_consensus.cc:515] T f1c9e47add2e4175b68fde1a27aa92e0 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:02:02.806389 10983 leader_election.cc:290] T f1c9e47add2e4175b68fde1a27aa92e0 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 election: Requested vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:02:02.807135 10834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c9e47add2e4175b68fde1a27aa92e0" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:02:02.807878 10834 raft_consensus.cc:3055] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:02.808147 10834 raft_consensus.cc:740] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Running, Role: LEADER
I20260709 13:02:02.808610 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c9e47add2e4175b68fde1a27aa92e0" candidate_uuid: "5e62c52a41f7476a908dd377c1a8a79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:02:02.808243 10657 catalog_manager.cc:5697] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 1 to 2, leader changed from b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195) to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:02.809240 10910 raft_consensus.cc:3060] T f1c9e47add2e4175b68fde1a27aa92e0 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.809252 10834 consensus_queue.cc:260] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:02:02.810623 10834 raft_consensus.cc:3060] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.817417 10910 raft_consensus.cc:2468] T f1c9e47add2e4175b68fde1a27aa92e0 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 2.
I20260709 13:02:02.818670 10952 leader_election.cc:304] T f1c9e47add2e4175b68fde1a27aa92e0 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:02:02.820323 10834 raft_consensus.cc:2468] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e62c52a41f7476a908dd377c1a8a79f in term 2.
I20260709 13:02:02.820765 11860 raft_consensus.cc:2804] T f1c9e47add2e4175b68fde1a27aa92e0 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:02.821357 11860 raft_consensus.cc:697] T f1c9e47add2e4175b68fde1a27aa92e0 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Becoming Leader. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
I20260709 13:02:02.822294 11860 consensus_queue.cc:237] T f1c9e47add2e4175b68fde1a27aa92e0 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } }
I20260709 13:02:02.826259 11835 raft_consensus.cc:993] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367: : Instructing follower 346158a6aa6747c1b8d31b4fb80238d0 to start an election
I20260709 13:02:02.826820 11835 raft_consensus.cc:1081] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Signalling peer 346158a6aa6747c1b8d31b4fb80238d0 to start an election
I20260709 13:02:02.836241 11622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "211c168fa9614dbda8d8870bf5713616"
dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
 from {username='slave'} at 127.0.0.1:47598
I20260709 13:02:02.837141 11622 raft_consensus.cc:493] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:02.837553 11622 raft_consensus.cc:3060] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.844791 11622 raft_consensus.cc:515] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:02:02.844411 10657 catalog_manager.cc:5697] T f1c9e47add2e4175b68fde1a27aa92e0 P 5e62c52a41f7476a908dd377c1a8a79f reported cstate change: term changed from 1 to 2, leader changed from dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194) to 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196). New cstate: current_term: 2 leader_uuid: "5e62c52a41f7476a908dd377c1a8a79f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:02.848186 11622 leader_election.cc:290] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 2 election: Requested vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:02:02.849224 10983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211c168fa9614dbda8d8870bf5713616" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:02:02.849268 10834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "211c168fa9614dbda8d8870bf5713616" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:02:02.850036 10983 raft_consensus.cc:3060] T 211c168fa9614dbda8d8870bf5713616 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.850085 10834 raft_consensus.cc:3055] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:02.852972 10834 raft_consensus.cc:740] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dbd1fdffc68440e5b6250f6d95a4a367, State: Running, Role: LEADER
I20260709 13:02:02.853823 10834 consensus_queue.cc:260] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:02:02.855118 10834 raft_consensus.cc:3060] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:02.858176 10983 raft_consensus.cc:2468] T 211c168fa9614dbda8d8870bf5713616 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 2.
I20260709 13:02:02.859568 11573 leader_election.cc:304] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, 5e62c52a41f7476a908dd377c1a8a79f; no voters: 
I20260709 13:02:02.860689 11812 raft_consensus.cc:2804] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:02.861213 11812 raft_consensus.cc:697] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:02:02.862068 11812 consensus_queue.cc:237] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:02:02.864421 10834 raft_consensus.cc:2468] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 2.
I20260709 13:02:02.874256 10657 catalog_manager.cc:5697] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 1 to 2, leader changed from dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194) to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:03.010329 10834 raft_consensus.cc:1275] T c1470fc689d7429dada3bf5d45a82374 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Refusing update from remote peer 346158a6aa6747c1b8d31b4fb80238d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:03.011581 11812 consensus_queue.cc:1048] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:03.032035 10983 raft_consensus.cc:1275] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Refusing update from remote peer 346158a6aa6747c1b8d31b4fb80238d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:03.035573 11814 consensus_queue.cc:1048] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:03.204449 10986 raft_consensus.cc:1275] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f [term 3 FOLLOWER]: Refusing update from remote peer b778a184b0ac46f5b86ce4fe363dcbab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:03.206357 11833 consensus_queue.cc:1048] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:03.225754 10836 raft_consensus.cc:1275] T 205f5d9c197b405faa72a70e2a010102 P dbd1fdffc68440e5b6250f6d95a4a367 [term 3 FOLLOWER]: Refusing update from remote peer b778a184b0ac46f5b86ce4fe363dcbab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:03.226018 10910 raft_consensus.cc:1275] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Refusing update from remote peer 346158a6aa6747c1b8d31b4fb80238d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:03.227459 11833 consensus_queue.cc:1048] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:03.227587 11814 consensus_queue.cc:1048] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:03.246869 10986 raft_consensus.cc:1275] T 00d1eccb4ed0452ea1afb814db7c7330 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Refusing update from remote peer 346158a6aa6747c1b8d31b4fb80238d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:03.249168 11814 consensus_queue.cc:1048] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:03.290886 10910 raft_consensus.cc:1275] T f1c9e47add2e4175b68fde1a27aa92e0 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Refusing update from remote peer 5e62c52a41f7476a908dd377c1a8a79f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:03.291911 11860 consensus_queue.cc:1048] T f1c9e47add2e4175b68fde1a27aa92e0 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:03.300040 10836 raft_consensus.cc:1275] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Refusing update from remote peer 5e62c52a41f7476a908dd377c1a8a79f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:03.301532 11883 consensus_queue.cc:1048] T f1c9e47add2e4175b68fde1a27aa92e0 P 5e62c52a41f7476a908dd377c1a8a79f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:03.342590 10836 raft_consensus.cc:1275] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Refusing update from remote peer 346158a6aa6747c1b8d31b4fb80238d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:03.344084 11814 consensus_queue.cc:1048] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:03.358441 10980 raft_consensus.cc:1275] T 211c168fa9614dbda8d8870bf5713616 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Refusing update from remote peer 346158a6aa6747c1b8d31b4fb80238d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:03.363569 11814 consensus_queue.cc:1048] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:03.487916   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:03.541157   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:03.583187 10910 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8273bf9f9a174b3ea62b5ab0a0bb5730"
dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
mode: GRACEFUL
new_leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
 from {username='slave'} at 127.0.0.1:45164
I20260709 13:02:03.583761 10910 raft_consensus.cc:606] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 LEADER]: Received request to transfer leadership to TS 346158a6aa6747c1b8d31b4fb80238d0
I20260709 13:02:03.586465 10980 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c403148f1f724c0ca12919d8e85ae572"
dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
mode: GRACEFUL
new_leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
 from {username='slave'} at 127.0.0.1:56384
I20260709 13:02:03.587069 10980 raft_consensus.cc:606] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Received request to transfer leadership to TS 346158a6aa6747c1b8d31b4fb80238d0
I20260709 13:02:03.588301   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:03.589445   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:03.767532 11792 raft_consensus.cc:993] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab: : Instructing follower 346158a6aa6747c1b8d31b4fb80238d0 to start an election
I20260709 13:02:03.768013 11792 raft_consensus.cc:1081] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 LEADER]: Signalling peer 346158a6aa6747c1b8d31b4fb80238d0 to start an election
I20260709 13:02:03.769536 11621 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8273bf9f9a174b3ea62b5ab0a0bb5730"
dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
 from {username='slave'} at 127.0.0.1:47620
I20260709 13:02:03.769987 11621 raft_consensus.cc:493] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:03.770279 11621 raft_consensus.cc:3060] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:03.778021 11621 raft_consensus.cc:515] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:02:03.779821 11621 leader_election.cc:290] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 3 election: Requested vote from peers dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051), b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351)
I20260709 13:02:03.780830 10910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8273bf9f9a174b3ea62b5ab0a0bb5730" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b778a184b0ac46f5b86ce4fe363dcbab"
I20260709 13:02:03.781412 10910 raft_consensus.cc:3055] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:03.781713 10910 raft_consensus.cc:740] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b778a184b0ac46f5b86ce4fe363dcbab, State: Running, Role: LEADER
I20260709 13:02:03.782351 10910 consensus_queue.cc:260] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:02:03.783419 10910 raft_consensus.cc:3060] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:03.786217 11883 raft_consensus.cc:993] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f: : Instructing follower 346158a6aa6747c1b8d31b4fb80238d0 to start an election
I20260709 13:02:03.786793 11860 raft_consensus.cc:1081] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Signalling peer 346158a6aa6747c1b8d31b4fb80238d0 to start an election
I20260709 13:02:03.788897 10836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8273bf9f9a174b3ea62b5ab0a0bb5730" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:02:03.789649 11622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c403148f1f724c0ca12919d8e85ae572"
dest_uuid: "346158a6aa6747c1b8d31b4fb80238d0"
 from {username='slave'} at 127.0.0.1:47612
I20260709 13:02:03.790232 10836 raft_consensus.cc:3060] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:03.790414 11622 raft_consensus.cc:493] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:03.790870 11622 raft_consensus.cc:3060] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:03.793705 10910 raft_consensus.cc:2468] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 3.
I20260709 13:02:03.795047 11575 leader_election.cc:304] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, b778a184b0ac46f5b86ce4fe363dcbab; no voters: 
I20260709 13:02:03.795984 11814 raft_consensus.cc:2804] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:03.796306 11622 raft_consensus.cc:515] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:02:03.796728 11814 raft_consensus.cc:697] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:02:03.797755 11814 consensus_queue.cc:237] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } }
I20260709 13:02:03.799522 10980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c403148f1f724c0ca12919d8e85ae572" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e62c52a41f7476a908dd377c1a8a79f"
I20260709 13:02:03.799830 10837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c403148f1f724c0ca12919d8e85ae572" candidate_uuid: "346158a6aa6747c1b8d31b4fb80238d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dbd1fdffc68440e5b6250f6d95a4a367"
I20260709 13:02:03.800184 10980 raft_consensus.cc:3055] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:03.800390 10837 raft_consensus.cc:3060] T c403148f1f724c0ca12919d8e85ae572 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:03.800627 10836 raft_consensus.cc:2468] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 3.
I20260709 13:02:03.801112 10980 raft_consensus.cc:740] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e62c52a41f7476a908dd377c1a8a79f, State: Running, Role: LEADER
I20260709 13:02:03.798492 11622 leader_election.cc:290] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 2 election: Requested vote from peers 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196:42509), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
I20260709 13:02:03.801934 10980 consensus_queue.cc:260] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:02:03.803150 10980 raft_consensus.cc:3060] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:03.809582 10837 raft_consensus.cc:2468] T c403148f1f724c0ca12919d8e85ae572 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 2.
I20260709 13:02:03.810901 11574 leader_election.cc:304] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367; no voters: 
I20260709 13:02:03.811882 11814 raft_consensus.cc:2804] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:03.812340 11814 raft_consensus.cc:697] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 LEADER]: Becoming Leader. State: Replica: 346158a6aa6747c1b8d31b4fb80238d0, State: Running, Role: LEADER
I20260709 13:02:03.811735 10658 catalog_manager.cc:5697] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 2 to 3, leader changed from b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195) to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:03.813282 11814 consensus_queue.cc:237] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:02:03.816835 10980 raft_consensus.cc:2468] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 346158a6aa6747c1b8d31b4fb80238d0 in term 2.
I20260709 13:02:03.829583 10658 catalog_manager.cc:5697] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 reported cstate change: term changed from 1 to 2, leader changed from 5e62c52a41f7476a908dd377c1a8a79f (127.0.107.196) to 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "346158a6aa6747c1b8d31b4fb80238d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:04.206935 10908 raft_consensus.cc:1275] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [term 3 FOLLOWER]: Refusing update from remote peer 346158a6aa6747c1b8d31b4fb80238d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:04.208230 11812 consensus_queue.cc:1048] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b778a184b0ac46f5b86ce4fe363dcbab" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:04.218087 10837 raft_consensus.cc:1275] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367 [term 3 FOLLOWER]: Refusing update from remote peer 346158a6aa6747c1b8d31b4fb80238d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:04.219617 11814 consensus_queue.cc:1048] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:04.247042 10980 raft_consensus.cc:1275] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Refusing update from remote peer 346158a6aa6747c1b8d31b4fb80238d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:04.248600 11814 consensus_queue.cc:1048] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:04.269184 10837 raft_consensus.cc:1275] T c403148f1f724c0ca12919d8e85ae572 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Refusing update from remote peer 346158a6aa6747c1b8d31b4fb80238d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:04.274104 11814 consensus_queue.cc:1048] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:04.590265   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:04.629699   431 tablet_server.cc:179] TabletServer@127.0.107.193:34489 shutting down...
W20260709 13:02:04.633580 10802 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 81 similar messages]
W20260709 13:02:04.637125 10802 consensus_peers.cc:597] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:04.666680   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:04.667768   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.668915   431 raft_consensus.cc:2243] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:02:04.669664 10802 consensus_peers.cc:597] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:04.669852   431 raft_consensus.cc:2272] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.672616   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.673327   431 raft_consensus.cc:2243] T b5a791a0126444ba90c1fb442e1b809b P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:04.673765   431 raft_consensus.cc:2272] T b5a791a0126444ba90c1fb442e1b809b P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.676367   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.677141   431 raft_consensus.cc:2243] T a8b5a22ddad942d7b4db2b897e159337 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:04.677639   431 raft_consensus.cc:2272] T a8b5a22ddad942d7b4db2b897e159337 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.680071   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.680745   431 raft_consensus.cc:2243] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:04.681125   431 raft_consensus.cc:2272] T c6bb330c30de4041b86d22bf1c838e57 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.684552   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.685530   431 raft_consensus.cc:2243] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:04.686026   431 raft_consensus.cc:2272] T 41a51aa36dad4f1a85c485d67d2903e2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:04.692044 10876 consensus_peers.cc:597] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:04.694856 10802 consensus_peers.cc:597] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:04.698109   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.699113   431 raft_consensus.cc:2243] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:04.699676   431 raft_consensus.cc:2272] T dd1014df7b2b4d2d80864646b5e5df5e P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.703789   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.704872   431 raft_consensus.cc:2243] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:04.705433   431 raft_consensus.cc:2272] T a1ce467fbc054ba89724cca56e1ae56e P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.707702   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.708336   431 raft_consensus.cc:2243] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:04.709256   431 raft_consensus.cc:2272] T c1470fc689d7429dada3bf5d45a82374 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.713519   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.714412   431 raft_consensus.cc:2243] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:04.715014   431 raft_consensus.cc:2272] T 9bf0d822416f49caacd1f92cebd84eb8 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:04.716616 10950 consensus_peers.cc:597] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:04.717701   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.718688   431 raft_consensus.cc:2243] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:04.719648   431 raft_consensus.cc:2272] T c403148f1f724c0ca12919d8e85ae572 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.724409   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.725353   431 raft_consensus.cc:2243] T a19edd96c26a4c91a7b2a412d8221e5b P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:04.725843   431 raft_consensus.cc:2272] T a19edd96c26a4c91a7b2a412d8221e5b P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:04.725790 10876 consensus_peers.cc:597] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:04.729421   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:02:04.729523 10876 consensus_peers.cc:597] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:04.730222   431 raft_consensus.cc:2243] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:04.730859   431 raft_consensus.cc:2272] T c6842d144c244233a18d121c7966712a P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:04.732096 10876 consensus_peers.cc:597] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:04.734237   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.735267   431 raft_consensus.cc:2243] T 16fbb9a91d614ce3834f82ce725667fa P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:04.735920   431 raft_consensus.cc:2272] T 16fbb9a91d614ce3834f82ce725667fa P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.739207   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.739998   431 raft_consensus.cc:2243] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:04.740912   431 raft_consensus.cc:2272] T 830984b68ee046d9b9a67009177b55c2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.743420   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.744290   431 raft_consensus.cc:2243] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:04.744884   431 raft_consensus.cc:2272] T 049d8b6c7ecf423e95f1db20ab677254 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:04.744941 10950 consensus_peers.cc:597] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:04.746937 10876 consensus_peers.cc:597] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:04.747886   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.748772   431 raft_consensus.cc:2243] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:04.749715   431 raft_consensus.cc:2272] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.752189   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.752884   431 raft_consensus.cc:2243] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:04.753909   431 raft_consensus.cc:2272] T f547b171c6b9445c95475ce3be870c2e P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:04.754228 10802 consensus_peers.cc:597] T ccad89aaaf3d48008955a353eb0097b9 P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:04.756875   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.757632   431 raft_consensus.cc:2243] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:04.758405   431 raft_consensus.cc:2272] T 211c168fa9614dbda8d8870bf5713616 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:04.759516 10802 consensus_peers.cc:597] T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:04.761155   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.762115   431 raft_consensus.cc:2243] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:04.762655   431 raft_consensus.cc:2272] T ccad89aaaf3d48008955a353eb0097b9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.766139   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.767634   431 raft_consensus.cc:2243] T 96a3b79f0ed34bce9764f4804d72c382 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:04.768550   431 raft_consensus.cc:2272] T 96a3b79f0ed34bce9764f4804d72c382 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.771899   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.772912   431 raft_consensus.cc:2243] T c72b12d4267d44a1a03db0fe148c8d31 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:04.773473   431 raft_consensus.cc:2272] T c72b12d4267d44a1a03db0fe148c8d31 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.777124   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:02:04.777912 10802 consensus_peers.cc:597] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:04.777951   431 raft_consensus.cc:2243] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:04.779138   431 raft_consensus.cc:2272] T e3dd15d873514f74a9bca08bc55e5d36 P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.781960   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.782836   431 raft_consensus.cc:2243] T fa2569632a834231ba0f3bad60cf90ee P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:04.783468   431 raft_consensus.cc:2272] T fa2569632a834231ba0f3bad60cf90ee P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.787662   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.788654   431 raft_consensus.cc:2243] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:04.789776   431 raft_consensus.cc:2272] T 611ca169fbcc420fb11d1502cbe196a9 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.792723   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.793483   431 raft_consensus.cc:2243] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:04.794107   431 raft_consensus.cc:2272] T 141934a83d874ca1bf1d69f49b95f1fc P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.797274   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.798120   431 raft_consensus.cc:2243] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:04.798519 10950 consensus_peers.cc:597] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:04.798693   431 raft_consensus.cc:2272] T 2e976ba764734878bb65c5db5e908f56 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.801970   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.802677   431 raft_consensus.cc:2243] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:04.803462   431 raft_consensus.cc:2272] T 00d1eccb4ed0452ea1afb814db7c7330 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.805718   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.806360   431 raft_consensus.cc:2243] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:04.806823   431 raft_consensus.cc:2272] T 3aa37ce6306b47f0b7ead1fda7590834 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.809217   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.809825   431 raft_consensus.cc:2243] T bec830b175ce40d69b73d9f73ea266a7 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:04.810374   431 raft_consensus.cc:2272] T bec830b175ce40d69b73d9f73ea266a7 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.813056   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.813591   431 raft_consensus.cc:2243] T b74f82b45a3242568f45f6a3fabeda31 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:04.813989   431 raft_consensus.cc:2272] T b74f82b45a3242568f45f6a3fabeda31 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.816850   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.817749   431 raft_consensus.cc:2243] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:04.818567   431 raft_consensus.cc:2272] T 96bfa4098abc4f4ba38783e8b91b8cdb P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.821026   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.821766   431 raft_consensus.cc:2243] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:04.822769   431 raft_consensus.cc:2272] T 64c5fd517a084ef9b707c36ec7c2fe3c P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.825606   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.826416   431 raft_consensus.cc:2243] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:04.826924   431 raft_consensus.cc:2272] T 2ea7c6df9b4340ffaf28c5a78966c74b P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:04.828373 10802 consensus_peers.cc:597] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:04.829708   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.830387   431 raft_consensus.cc:2243] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:04.830813   431 raft_consensus.cc:2272] T bb61bf6eaa1845f8add4d4057e49eb15 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.833284   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.833832   431 raft_consensus.cc:2243] T c3f9e2acc7244a26b1dbae53f8d0040a P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:04.834214   431 raft_consensus.cc:2272] T c3f9e2acc7244a26b1dbae53f8d0040a P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.836886   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.837491   431 raft_consensus.cc:2243] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:04.837950   431 raft_consensus.cc:2272] T 9be3de57a254453d9dc75680e7f27f22 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.840185   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.840807   431 raft_consensus.cc:2243] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:04.841570   431 raft_consensus.cc:2272] T 3ecfbc8cc6e7441fb568b197ffade11e P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.843580   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.844087   431 raft_consensus.cc:2243] T d4b9835406e84c5b88d3c3eed76a3b95 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:04.844446   431 raft_consensus.cc:2272] T d4b9835406e84c5b88d3c3eed76a3b95 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.846365   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.846861   431 raft_consensus.cc:2243] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:04.847617   431 raft_consensus.cc:2272] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P 346158a6aa6747c1b8d31b4fb80238d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.850579   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.851150   431 raft_consensus.cc:2243] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:04.851545   431 raft_consensus.cc:2272] T ffe62eca39f04407943d15c5f7646aee P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.853871   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.854454   431 raft_consensus.cc:2243] T 4a819525c849499885ee37af7d0f42a2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:04.854889   431 raft_consensus.cc:2272] T 4a819525c849499885ee37af7d0f42a2 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.857410   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.858500   431 raft_consensus.cc:2243] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:04.859004   431 raft_consensus.cc:2272] T 26b888af641846d495fe184e39aadc16 P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:04.861171 10802 consensus_peers.cc:597] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:04.861850   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.862504   431 raft_consensus.cc:2243] T 48e63402e1544658a8d6cf5b9220414b P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:04.862910   431 raft_consensus.cc:2272] T 48e63402e1544658a8d6cf5b9220414b P 346158a6aa6747c1b8d31b4fb80238d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.865096   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.865617   431 raft_consensus.cc:2243] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:04.866029   431 raft_consensus.cc:2272] T 14dc277ad7874e419ed2d2bff2165611 P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:04.868177   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:04.868767   431 raft_consensus.cc:2243] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:04.869220   431 raft_consensus.cc:2272] T a3b562356d3b4807a92648800cfe3dac P 346158a6aa6747c1b8d31b4fb80238d0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:04.904656 10950 consensus_peers.cc:597] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:04.911159 10876 consensus_peers.cc:597] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:04.925096 10950 connection.cc:573] client connection to 127.0.107.193:34489 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:02:04.925607 10950 consensus_peers.cc:597] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:04.942353   431 tablet_server.cc:196] TabletServer@127.0.107.193:34489 shutdown complete.
W20260709 13:02:04.942693 10802 consensus_peers.cc:597] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:04.948603 10802 consensus_peers.cc:597] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:04.963971 10950 consensus_peers.cc:597] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:05.014788 10876 consensus_peers.cc:597] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.023636   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:02:05.031894 10802 consensus_peers.cc:597] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:05.065115 10876 consensus_peers.cc:597] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:05.067203 10877 consensus_peers.cc:597] T 03cf7a6241a444369a57fdaf965107b3 P b778a184b0ac46f5b86ce4fe363dcbab -> Peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Couldn't send request to peer dbd1fdffc68440e5b6250f6d95a4a367. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.073094   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:02:05.073689 10802 consensus_peers.cc:597] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.074090   431 tablet_replica.cc:333] T a4eb868d99c9464996fb44dd3acdca7a P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.075675   431 raft_consensus.cc:2243] T a4eb868d99c9464996fb44dd3acdca7a P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.076371   431 raft_consensus.cc:2272] T a4eb868d99c9464996fb44dd3acdca7a P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:05.079551 10876 consensus_peers.cc:597] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.079581   431 tablet_replica.cc:333] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
W20260709 13:02:05.080004 10877 consensus_peers.cc:597] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab -> Peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Couldn't send request to peer dbd1fdffc68440e5b6250f6d95a4a367. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.080842   431 raft_consensus.cc:2243] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.081741   431 raft_consensus.cc:2272] T 2ea7c6df9b4340ffaf28c5a78966c74b P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.084151   431 tablet_replica.cc:333] T 64c5fd517a084ef9b707c36ec7c2fe3c P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.085296   431 raft_consensus.cc:2243] T 64c5fd517a084ef9b707c36ec7c2fe3c P dbd1fdffc68440e5b6250f6d95a4a367 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.085919   431 raft_consensus.cc:2272] T 64c5fd517a084ef9b707c36ec7c2fe3c P dbd1fdffc68440e5b6250f6d95a4a367 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:05.088537 10877 consensus_peers.cc:597] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab -> Peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Couldn't send request to peer dbd1fdffc68440e5b6250f6d95a4a367. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.088701   431 tablet_replica.cc:333] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
W20260709 13:02:05.089380 10950 consensus_peers.cc:597] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.089727   431 raft_consensus.cc:2243] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.090940   431 raft_consensus.cc:2272] T 4a819525c849499885ee37af7d0f42a2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.093788   431 tablet_replica.cc:333] T d2c28919f0174f6d905b1b1a53f64d6d P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.094547   431 raft_consensus.cc:2243] T d2c28919f0174f6d905b1b1a53f64d6d P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.095350   431 raft_consensus.cc:2272] T d2c28919f0174f6d905b1b1a53f64d6d P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.097609   431 tablet_replica.cc:333] T 401ec66526fe4ad0a997979233dd7ef3 P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.098207   431 raft_consensus.cc:2243] T 401ec66526fe4ad0a997979233dd7ef3 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.098664   431 raft_consensus.cc:2272] T 401ec66526fe4ad0a997979233dd7ef3 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.100760   431 tablet_replica.cc:333] T 205f5d9c197b405faa72a70e2a010102 P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.101332   431 raft_consensus.cc:2243] T 205f5d9c197b405faa72a70e2a010102 P dbd1fdffc68440e5b6250f6d95a4a367 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.101781   431 raft_consensus.cc:2272] T 205f5d9c197b405faa72a70e2a010102 P dbd1fdffc68440e5b6250f6d95a4a367 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.103693   431 tablet_replica.cc:333] T c1470fc689d7429dada3bf5d45a82374 P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.104307   431 raft_consensus.cc:2243] T c1470fc689d7429dada3bf5d45a82374 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.104774   431 raft_consensus.cc:2272] T c1470fc689d7429dada3bf5d45a82374 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.106686   431 tablet_replica.cc:333] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.107280   431 raft_consensus.cc:2243] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.108214   431 raft_consensus.cc:2272] T a1ce467fbc054ba89724cca56e1ae56e P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.111073   431 tablet_replica.cc:333] T dd1014df7b2b4d2d80864646b5e5df5e P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.111826   431 raft_consensus.cc:2243] T dd1014df7b2b4d2d80864646b5e5df5e P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.112323   431 raft_consensus.cc:2272] T dd1014df7b2b4d2d80864646b5e5df5e P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.114516   431 tablet_replica.cc:333] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.115064   431 raft_consensus.cc:2243] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.115803   431 raft_consensus.cc:2272] T a8b5a22ddad942d7b4db2b897e159337 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.117738   431 tablet_replica.cc:333] T 611ca169fbcc420fb11d1502cbe196a9 P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.118387   431 raft_consensus.cc:2243] T 611ca169fbcc420fb11d1502cbe196a9 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.118953   431 raft_consensus.cc:2272] T 611ca169fbcc420fb11d1502cbe196a9 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.121482   431 tablet_replica.cc:333] T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.122184   431 raft_consensus.cc:2243] T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:02:05.122692 10951 consensus_peers.cc:597] T 401ec66526fe4ad0a997979233dd7ef3 P 5e62c52a41f7476a908dd377c1a8a79f -> Peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Couldn't send request to peer dbd1fdffc68440e5b6250f6d95a4a367. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.123124   431 raft_consensus.cc:2272] T 141934a83d874ca1bf1d69f49b95f1fc P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.125377   431 tablet_replica.cc:333] T c403148f1f724c0ca12919d8e85ae572 P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.125996   431 raft_consensus.cc:2243] T c403148f1f724c0ca12919d8e85ae572 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.126461   431 raft_consensus.cc:2272] T c403148f1f724c0ca12919d8e85ae572 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.129209   431 tablet_replica.cc:333] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.130064   431 raft_consensus.cc:2243] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.130993   431 raft_consensus.cc:2272] T b74f82b45a3242568f45f6a3fabeda31 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:05.133183 10951 consensus_peers.cc:597] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f -> Peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Couldn't send request to peer dbd1fdffc68440e5b6250f6d95a4a367. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.133587   431 tablet_replica.cc:333] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.134490   431 raft_consensus.cc:2243] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.135589   431 raft_consensus.cc:2272] T 3aa37ce6306b47f0b7ead1fda7590834 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:05.138585 10951 consensus_peers.cc:597] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f -> Peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Couldn't send request to peer dbd1fdffc68440e5b6250f6d95a4a367. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.140609   431 tablet_replica.cc:333] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.141577   431 raft_consensus.cc:2243] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.142226   431 raft_consensus.cc:2272] T 2e976ba764734878bb65c5db5e908f56 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.145386   431 tablet_replica.cc:333] T b5a791a0126444ba90c1fb442e1b809b P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.145998   431 raft_consensus.cc:2243] T b5a791a0126444ba90c1fb442e1b809b P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.146497   431 raft_consensus.cc:2272] T b5a791a0126444ba90c1fb442e1b809b P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.149085   431 tablet_replica.cc:333] T 9fa0ebad5bc4444a8c465b2e412524dd P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.149868   431 raft_consensus.cc:2243] T 9fa0ebad5bc4444a8c465b2e412524dd P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.150453   431 raft_consensus.cc:2272] T 9fa0ebad5bc4444a8c465b2e412524dd P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.153311   431 tablet_replica.cc:333] T 2f47768053ec47e69b367bd5a49662c3 P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.153949   431 raft_consensus.cc:2243] T 2f47768053ec47e69b367bd5a49662c3 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.154398   431 raft_consensus.cc:2272] T 2f47768053ec47e69b367bd5a49662c3 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:05.154611 10876 consensus_peers.cc:597] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.156409   431 tablet_replica.cc:333] T 48e63402e1544658a8d6cf5b9220414b P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.157132   431 raft_consensus.cc:2243] T 48e63402e1544658a8d6cf5b9220414b P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.157579   431 raft_consensus.cc:2272] T 48e63402e1544658a8d6cf5b9220414b P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.160291   431 tablet_replica.cc:333] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.160960   431 raft_consensus.cc:2243] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.161523   431 raft_consensus.cc:2272] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P dbd1fdffc68440e5b6250f6d95a4a367 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.164089   431 tablet_replica.cc:333] T a62d4f04bff940779e241ebbd0aace2b P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.164752   431 raft_consensus.cc:2243] T a62d4f04bff940779e241ebbd0aace2b P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.165191   431 raft_consensus.cc:2272] T a62d4f04bff940779e241ebbd0aace2b P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.167125   431 tablet_replica.cc:333] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.167685   431 raft_consensus.cc:2243] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.168602   431 raft_consensus.cc:2272] T d4b9835406e84c5b88d3c3eed76a3b95 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.170728   431 tablet_replica.cc:333] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.171267   431 raft_consensus.cc:2243] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.171679   431 raft_consensus.cc:2272] T 211c168fa9614dbda8d8870bf5713616 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.173633   431 tablet_replica.cc:333] T ccad89aaaf3d48008955a353eb0097b9 P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.174180   431 raft_consensus.cc:2243] T ccad89aaaf3d48008955a353eb0097b9 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.174968   431 raft_consensus.cc:2272] T ccad89aaaf3d48008955a353eb0097b9 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.177246   431 tablet_replica.cc:333] T 03cf7a6241a444369a57fdaf965107b3 P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.177804   431 raft_consensus.cc:2243] T 03cf7a6241a444369a57fdaf965107b3 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.178333   431 raft_consensus.cc:2272] T 03cf7a6241a444369a57fdaf965107b3 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.180940   431 tablet_replica.cc:333] T e187848edaa746928d647a830da8c970 P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.181528   431 raft_consensus.cc:2243] T e187848edaa746928d647a830da8c970 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.182062   431 raft_consensus.cc:2272] T e187848edaa746928d647a830da8c970 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:05.183171 10951 consensus_peers.cc:597] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f -> Peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Couldn't send request to peer dbd1fdffc68440e5b6250f6d95a4a367. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.184698   431 tablet_replica.cc:333] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.185575   431 raft_consensus.cc:2243] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.186081   431 raft_consensus.cc:2272] T f1c9e47add2e4175b68fde1a27aa92e0 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:05.186584 10951 consensus_peers.cc:597] T f1c9e47add2e4175b68fde1a27aa92e0 P 5e62c52a41f7476a908dd377c1a8a79f -> Peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Couldn't send request to peer dbd1fdffc68440e5b6250f6d95a4a367. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:05.188427 10950 consensus_peers.cc:597] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.188781   431 tablet_replica.cc:333] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.189443   431 raft_consensus.cc:2243] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.190276   431 raft_consensus.cc:2272] T f570072427e34a4e843286441c60a630 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.192217   431 tablet_replica.cc:333] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.192817   431 raft_consensus.cc:2243] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.193586   431 raft_consensus.cc:2272] T c6bb330c30de4041b86d22bf1c838e57 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.195638   431 tablet_replica.cc:333] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.196163   431 raft_consensus.cc:2243] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.197038   431 raft_consensus.cc:2272] T fa2569632a834231ba0f3bad60cf90ee P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.199209   431 tablet_replica.cc:333] T 96a3b79f0ed34bce9764f4804d72c382 P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.199821   431 raft_consensus.cc:2243] T 96a3b79f0ed34bce9764f4804d72c382 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.200254   431 raft_consensus.cc:2272] T 96a3b79f0ed34bce9764f4804d72c382 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.202709   431 tablet_replica.cc:333] T c72b12d4267d44a1a03db0fe148c8d31 P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.203455   431 raft_consensus.cc:2243] T c72b12d4267d44a1a03db0fe148c8d31 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.204010   431 raft_consensus.cc:2272] T c72b12d4267d44a1a03db0fe148c8d31 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.206684   431 tablet_replica.cc:333] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.207316   431 raft_consensus.cc:2243] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.208177   431 raft_consensus.cc:2272] T 16fbb9a91d614ce3834f82ce725667fa P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.210525   431 tablet_replica.cc:333] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.211211   431 raft_consensus.cc:2243] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.211643   431 raft_consensus.cc:2272] T 830984b68ee046d9b9a67009177b55c2 P dbd1fdffc68440e5b6250f6d95a4a367 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.214161   431 tablet_replica.cc:333] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.214944   431 raft_consensus.cc:2243] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.215499   431 raft_consensus.cc:2272] T 14dc277ad7874e419ed2d2bff2165611 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.218510   431 tablet_replica.cc:333] T 1a1b4a3380b746d2bc977cfeff019c26 P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.219244   431 raft_consensus.cc:2243] T 1a1b4a3380b746d2bc977cfeff019c26 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.220283   431 raft_consensus.cc:2272] T 1a1b4a3380b746d2bc977cfeff019c26 P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:05.220868 10876 consensus_peers.cc:597] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab -> Peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Couldn't send request to peer 346158a6aa6747c1b8d31b4fb80238d0. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.222934   431 tablet_replica.cc:333] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.223702   431 raft_consensus.cc:2243] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.224260   431 raft_consensus.cc:2272] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.226657   431 tablet_replica.cc:333] T 9be3de57a254453d9dc75680e7f27f22 P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.227201   431 raft_consensus.cc:2243] T 9be3de57a254453d9dc75680e7f27f22 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.227667   431 raft_consensus.cc:2272] T 9be3de57a254453d9dc75680e7f27f22 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.230005   431 tablet_replica.cc:333] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.230615   431 raft_consensus.cc:2243] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.231163   431 raft_consensus.cc:2272] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.234112   431 tablet_replica.cc:333] T bb61bf6eaa1845f8add4d4057e49eb15 P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.234819   431 raft_consensus.cc:2243] T bb61bf6eaa1845f8add4d4057e49eb15 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.235391   431 raft_consensus.cc:2272] T bb61bf6eaa1845f8add4d4057e49eb15 P dbd1fdffc68440e5b6250f6d95a4a367 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.238287   431 tablet_replica.cc:333] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.238786   431 raft_consensus.cc:2243] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.239306   431 raft_consensus.cc:2272] T 3ecfbc8cc6e7441fb568b197ffade11e P dbd1fdffc68440e5b6250f6d95a4a367 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.241937   431 tablet_replica.cc:333] T 3034b839c8444c8d80acc4fe57bcd00a P dbd1fdffc68440e5b6250f6d95a4a367: stopping tablet replica
I20260709 13:02:05.242576   431 raft_consensus.cc:2243] T 3034b839c8444c8d80acc4fe57bcd00a P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.243100   431 raft_consensus.cc:2272] T 3034b839c8444c8d80acc4fe57bcd00a P dbd1fdffc68440e5b6250f6d95a4a367 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:05.248684 10951 consensus_peers.cc:597] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f -> Peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Couldn't send request to peer dbd1fdffc68440e5b6250f6d95a4a367. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:05.252384 10951 consensus_peers.cc:597] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f -> Peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Couldn't send request to peer dbd1fdffc68440e5b6250f6d95a4a367. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:05.265268 10951 consensus_peers.cc:597] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f -> Peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Couldn't send request to peer dbd1fdffc68440e5b6250f6d95a4a367. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:05.280061 10951 consensus_peers.cc:597] T a4eb868d99c9464996fb44dd3acdca7a P 5e62c52a41f7476a908dd377c1a8a79f -> Peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Couldn't send request to peer dbd1fdffc68440e5b6250f6d95a4a367. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:05.312726 10877 consensus_peers.cc:597] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab -> Peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Couldn't send request to peer dbd1fdffc68440e5b6250f6d95a4a367. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:05.322152 10877 consensus_peers.cc:597] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab -> Peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Couldn't send request to peer dbd1fdffc68440e5b6250f6d95a4a367. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.339458   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:02:05.361254 10877 consensus_peers.cc:597] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab -> Peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Couldn't send request to peer dbd1fdffc68440e5b6250f6d95a4a367. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:05.366650 10877 consensus_peers.cc:597] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab -> Peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Couldn't send request to peer dbd1fdffc68440e5b6250f6d95a4a367. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:05.399221 10951 consensus_peers.cc:597] T e187848edaa746928d647a830da8c970 P 5e62c52a41f7476a908dd377c1a8a79f -> Peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Couldn't send request to peer dbd1fdffc68440e5b6250f6d95a4a367. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:05.403358 10877 consensus_peers.cc:597] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab -> Peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Couldn't send request to peer dbd1fdffc68440e5b6250f6d95a4a367. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.418150   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:02:05.450506   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:05.451318   431 tablet_replica.cc:333] T a4eb868d99c9464996fb44dd3acdca7a P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.452030   431 raft_consensus.cc:2243] T a4eb868d99c9464996fb44dd3acdca7a P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.452602   431 raft_consensus.cc:2272] T a4eb868d99c9464996fb44dd3acdca7a P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.455176   431 tablet_replica.cc:333] T 401ec66526fe4ad0a997979233dd7ef3 P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.455935   431 raft_consensus.cc:2243] T 401ec66526fe4ad0a997979233dd7ef3 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.456516   431 raft_consensus.cc:2272] T 401ec66526fe4ad0a997979233dd7ef3 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.458709   431 tablet_replica.cc:333] T c3f9e2acc7244a26b1dbae53f8d0040a P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.459350   431 raft_consensus.cc:2243] T c3f9e2acc7244a26b1dbae53f8d0040a P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.459750   431 raft_consensus.cc:2272] T c3f9e2acc7244a26b1dbae53f8d0040a P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.461679   431 tablet_replica.cc:333] T 4a819525c849499885ee37af7d0f42a2 P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.462208   431 raft_consensus.cc:2243] T 4a819525c849499885ee37af7d0f42a2 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.462615   431 raft_consensus.cc:2272] T 4a819525c849499885ee37af7d0f42a2 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.464548   431 tablet_replica.cc:333] T d2c28919f0174f6d905b1b1a53f64d6d P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.465054   431 raft_consensus.cc:2243] T d2c28919f0174f6d905b1b1a53f64d6d P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.465413   431 raft_consensus.cc:2272] T d2c28919f0174f6d905b1b1a53f64d6d P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.467227   431 tablet_replica.cc:333] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.467756   431 raft_consensus.cc:2243] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.468511   431 raft_consensus.cc:2272] T 205f5d9c197b405faa72a70e2a010102 P b778a184b0ac46f5b86ce4fe363dcbab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.470468   431 tablet_replica.cc:333] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.470985   431 raft_consensus.cc:2243] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.471684   431 raft_consensus.cc:2272] T 96a3b79f0ed34bce9764f4804d72c382 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.473673   431 tablet_replica.cc:333] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.474203   431 raft_consensus.cc:2243] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.474942   431 raft_consensus.cc:2272] T 41a51aa36dad4f1a85c485d67d2903e2 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.476861   431 tablet_replica.cc:333] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.477376   431 raft_consensus.cc:2243] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.477731   431 raft_consensus.cc:2272] T 96bfa4098abc4f4ba38783e8b91b8cdb P b778a184b0ac46f5b86ce4fe363dcbab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.479784   431 tablet_replica.cc:333] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.480352   431 raft_consensus.cc:2243] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.480795   431 raft_consensus.cc:2272] T a1ce467fbc054ba89724cca56e1ae56e P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.482975   431 tablet_replica.cc:333] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.483556   431 raft_consensus.cc:2243] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.484292   431 raft_consensus.cc:2272] T 26b888af641846d495fe184e39aadc16 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.486274   431 tablet_replica.cc:333] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.486809   431 raft_consensus.cc:2243] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.487581   431 raft_consensus.cc:2272] T 48e63402e1544658a8d6cf5b9220414b P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.489677   431 tablet_replica.cc:333] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.490222   431 raft_consensus.cc:2243] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.490672   431 raft_consensus.cc:2272] T 141934a83d874ca1bf1d69f49b95f1fc P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.493198   431 tablet_replica.cc:333] T f547b171c6b9445c95475ce3be870c2e P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.494027   431 raft_consensus.cc:2243] T f547b171c6b9445c95475ce3be870c2e P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.494514   431 raft_consensus.cc:2272] T f547b171c6b9445c95475ce3be870c2e P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.496536   431 tablet_replica.cc:333] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.497067   431 raft_consensus.cc:2243] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.497781   431 raft_consensus.cc:2272] T 9fa0ebad5bc4444a8c465b2e412524dd P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.499574   431 tablet_replica.cc:333] T e3dd15d873514f74a9bca08bc55e5d36 P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.500097   431 raft_consensus.cc:2243] T e3dd15d873514f74a9bca08bc55e5d36 P b778a184b0ac46f5b86ce4fe363dcbab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.500547   431 raft_consensus.cc:2272] T e3dd15d873514f74a9bca08bc55e5d36 P b778a184b0ac46f5b86ce4fe363dcbab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.502214   431 tablet_replica.cc:333] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.502743   431 raft_consensus.cc:2243] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.503472   431 raft_consensus.cc:2272] T bec830b175ce40d69b73d9f73ea266a7 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.505276   431 tablet_replica.cc:333] T b74f82b45a3242568f45f6a3fabeda31 P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.505877   431 raft_consensus.cc:2243] T b74f82b45a3242568f45f6a3fabeda31 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.506304   431 raft_consensus.cc:2272] T b74f82b45a3242568f45f6a3fabeda31 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.508251   431 tablet_replica.cc:333] T 3aa37ce6306b47f0b7ead1fda7590834 P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.508970   431 raft_consensus.cc:2243] T 3aa37ce6306b47f0b7ead1fda7590834 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.509461   431 raft_consensus.cc:2272] T 3aa37ce6306b47f0b7ead1fda7590834 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.512368   431 tablet_replica.cc:333] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.513273   431 raft_consensus.cc:2243] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.514351   431 raft_consensus.cc:2272] T 9bf0d822416f49caacd1f92cebd84eb8 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.516928   431 tablet_replica.cc:333] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.517546   431 raft_consensus.cc:2243] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.518369   431 raft_consensus.cc:2272] T 14dc277ad7874e419ed2d2bff2165611 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.520794   431 tablet_replica.cc:333] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.521502   431 raft_consensus.cc:2243] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.522468   431 raft_consensus.cc:2272] T a3b562356d3b4807a92648800cfe3dac P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.524991   431 tablet_replica.cc:333] T 1a1b4a3380b746d2bc977cfeff019c26 P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.525521   431 raft_consensus.cc:2243] T 1a1b4a3380b746d2bc977cfeff019c26 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.525893   431 raft_consensus.cc:2272] T 1a1b4a3380b746d2bc977cfeff019c26 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.527787   431 tablet_replica.cc:333] T 049d8b6c7ecf423e95f1db20ab677254 P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.528298   431 raft_consensus.cc:2243] T 049d8b6c7ecf423e95f1db20ab677254 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.528716   431 raft_consensus.cc:2272] T 049d8b6c7ecf423e95f1db20ab677254 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.531143   431 tablet_replica.cc:333] T 16fbb9a91d614ce3834f82ce725667fa P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.531883   431 raft_consensus.cc:2243] T 16fbb9a91d614ce3834f82ce725667fa P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.532414   431 raft_consensus.cc:2272] T 16fbb9a91d614ce3834f82ce725667fa P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.534829   431 tablet_replica.cc:333] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.535717   431 raft_consensus.cc:2243] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.536134   431 raft_consensus.cc:2272] T e187848edaa746928d647a830da8c970 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.538632   431 tablet_replica.cc:333] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.539423   431 raft_consensus.cc:2243] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.540028   431 raft_consensus.cc:2272] T e5382a9b34d84b4fbeccc952bb5f4ef5 P b778a184b0ac46f5b86ce4fe363dcbab [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:05.542598 10951 consensus_peers.cc:597] T 2f47768053ec47e69b367bd5a49662c3 P 5e62c52a41f7476a908dd377c1a8a79f -> Peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Couldn't send request to peer dbd1fdffc68440e5b6250f6d95a4a367. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.542670   431 tablet_replica.cc:333] T f1c9e47add2e4175b68fde1a27aa92e0 P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
W20260709 13:02:05.543162 10952 consensus_peers.cc:597] T a4eb868d99c9464996fb44dd3acdca7a P 5e62c52a41f7476a908dd377c1a8a79f -> Peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Couldn't send request to peer b778a184b0ac46f5b86ce4fe363dcbab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.543910   431 raft_consensus.cc:2243] T f1c9e47add2e4175b68fde1a27aa92e0 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.544569   431 raft_consensus.cc:2272] T f1c9e47add2e4175b68fde1a27aa92e0 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:05.544767 10952 consensus_peers.cc:597] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f -> Peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Couldn't send request to peer b778a184b0ac46f5b86ce4fe363dcbab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.546901   431 tablet_replica.cc:333] T f570072427e34a4e843286441c60a630 P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.547540   431 raft_consensus.cc:2243] T f570072427e34a4e843286441c60a630 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.547952   431 raft_consensus.cc:2272] T f570072427e34a4e843286441c60a630 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.549889   431 tablet_replica.cc:333] T c6bb330c30de4041b86d22bf1c838e57 P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.550523   431 raft_consensus.cc:2243] T c6bb330c30de4041b86d22bf1c838e57 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.550969   431 raft_consensus.cc:2272] T c6bb330c30de4041b86d22bf1c838e57 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.553460   431 tablet_replica.cc:333] T fa2569632a834231ba0f3bad60cf90ee P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.554170   431 raft_consensus.cc:2243] T fa2569632a834231ba0f3bad60cf90ee P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.554684   431 raft_consensus.cc:2272] T fa2569632a834231ba0f3bad60cf90ee P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.556770   431 tablet_replica.cc:333] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.557267   431 raft_consensus.cc:2243] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.557651   431 raft_consensus.cc:2272] T 00d1eccb4ed0452ea1afb814db7c7330 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.559568   431 tablet_replica.cc:333] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.560094   431 raft_consensus.cc:2243] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.560949   431 raft_consensus.cc:2272] T c6842d144c244233a18d121c7966712a P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.563629   431 tablet_replica.cc:333] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.564355   431 raft_consensus.cc:2243] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.565340   431 raft_consensus.cc:2272] T a19edd96c26a4c91a7b2a412d8221e5b P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.567399   431 tablet_replica.cc:333] T ffe62eca39f04407943d15c5f7646aee P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.568038   431 raft_consensus.cc:2243] T ffe62eca39f04407943d15c5f7646aee P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.568583   431 raft_consensus.cc:2272] T ffe62eca39f04407943d15c5f7646aee P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.570858   431 tablet_replica.cc:333] T 03cf7a6241a444369a57fdaf965107b3 P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.571400   431 raft_consensus.cc:2243] T 03cf7a6241a444369a57fdaf965107b3 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.572268   431 raft_consensus.cc:2272] T 03cf7a6241a444369a57fdaf965107b3 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.574766   431 tablet_replica.cc:333] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.575712   431 raft_consensus.cc:2243] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.576678   431 raft_consensus.cc:2272] T 9be3de57a254453d9dc75680e7f27f22 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.579164   431 tablet_replica.cc:333] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.579902   431 raft_consensus.cc:2243] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:02:05.580219 10952 consensus_peers.cc:597] T 401ec66526fe4ad0a997979233dd7ef3 P 5e62c52a41f7476a908dd377c1a8a79f -> Peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Couldn't send request to peer b778a184b0ac46f5b86ce4fe363dcbab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.580956   431 raft_consensus.cc:2272] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.583105   431 tablet_replica.cc:333] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.583681   431 raft_consensus.cc:2243] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.584250   431 raft_consensus.cc:2272] T 3ecfbc8cc6e7441fb568b197ffade11e P b778a184b0ac46f5b86ce4fe363dcbab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.586303   431 tablet_replica.cc:333] T 3034b839c8444c8d80acc4fe57bcd00a P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.586828   431 raft_consensus.cc:2243] T 3034b839c8444c8d80acc4fe57bcd00a P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.587237   431 raft_consensus.cc:2272] T 3034b839c8444c8d80acc4fe57bcd00a P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.589951   431 tablet_replica.cc:333] T a62d4f04bff940779e241ebbd0aace2b P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.590588   431 raft_consensus.cc:2243] T a62d4f04bff940779e241ebbd0aace2b P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.591071   431 raft_consensus.cc:2272] T a62d4f04bff940779e241ebbd0aace2b P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.593591   431 tablet_replica.cc:333] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.594260   431 raft_consensus.cc:2243] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.594775   431 raft_consensus.cc:2272] T 8273bf9f9a174b3ea62b5ab0a0bb5730 P b778a184b0ac46f5b86ce4fe363dcbab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.597579   431 tablet_replica.cc:333] T d4b9835406e84c5b88d3c3eed76a3b95 P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.598299   431 raft_consensus.cc:2243] T d4b9835406e84c5b88d3c3eed76a3b95 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.598875   431 raft_consensus.cc:2272] T d4b9835406e84c5b88d3c3eed76a3b95 P b778a184b0ac46f5b86ce4fe363dcbab [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:05.598919 10951 consensus_peers.cc:597] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f -> Peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Couldn't send request to peer dbd1fdffc68440e5b6250f6d95a4a367. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.601725   431 tablet_replica.cc:333] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab: stopping tablet replica
I20260709 13:02:05.602330   431 raft_consensus.cc:2243] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.602931   431 raft_consensus.cc:2272] T 2f47768053ec47e69b367bd5a49662c3 P b778a184b0ac46f5b86ce4fe363dcbab [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:05.647279 10952 consensus_peers.cc:597] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f -> Peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Couldn't send request to peer b778a184b0ac46f5b86ce4fe363dcbab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.671087   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
W20260709 13:02:05.695210 10952 consensus_peers.cc:597] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f -> Peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Couldn't send request to peer b778a184b0ac46f5b86ce4fe363dcbab. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:36351: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:05.704361 10952 consensus_peers.cc:597] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f -> Peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Couldn't send request to peer b778a184b0ac46f5b86ce4fe363dcbab. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:36351: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:05.719798 10952 consensus_peers.cc:597] T f1c9e47add2e4175b68fde1a27aa92e0 P 5e62c52a41f7476a908dd377c1a8a79f -> Peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Couldn't send request to peer b778a184b0ac46f5b86ce4fe363dcbab. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:36351: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:05.720311 10952 consensus_peers.cc:597] T 2f47768053ec47e69b367bd5a49662c3 P 5e62c52a41f7476a908dd377c1a8a79f -> Peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Couldn't send request to peer b778a184b0ac46f5b86ce4fe363dcbab. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:36351: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:05.728528 10952 consensus_peers.cc:597] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f -> Peer b778a184b0ac46f5b86ce4fe363dcbab (127.0.107.195:36351): Couldn't send request to peer b778a184b0ac46f5b86ce4fe363dcbab. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:36351: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.748662   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
I20260709 13:02:05.771612 11915 raft_consensus.cc:493] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 346158a6aa6747c1b8d31b4fb80238d0)
I20260709 13:02:05.772298 11915 raft_consensus.cc:515] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e62c52a41f7476a908dd377c1a8a79f" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42509 } } peers { permanent_uuid: "346158a6aa6747c1b8d31b4fb80238d0" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34489 } } peers { permanent_uuid: "dbd1fdffc68440e5b6250f6d95a4a367" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35051 } }
I20260709 13:02:05.776418 11915 leader_election.cc:290] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489), dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051)
W20260709 13:02:05.784183 10950 leader_election.cc:336] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 346158a6aa6747c1b8d31b4fb80238d0 (127.0.107.193:34489): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34489: connect: Connection refused (error 111)
W20260709 13:02:05.785298 10951 leader_election.cc:336] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dbd1fdffc68440e5b6250f6d95a4a367 (127.0.107.194:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.194:35051: connect: Connection refused (error 111)
I20260709 13:02:05.785646 10951 leader_election.cc:304] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e62c52a41f7476a908dd377c1a8a79f; no voters: 346158a6aa6747c1b8d31b4fb80238d0, dbd1fdffc68440e5b6250f6d95a4a367
I20260709 13:02:05.786211 11915 raft_consensus.cc:2749] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:05.799435   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:05.800279   431 tablet_replica.cc:333] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.800940   431 raft_consensus.cc:2243] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.801409   431 raft_consensus.cc:2272] T c1470fc689d7429dada3bf5d45a82374 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.803432   431 tablet_replica.cc:333] T a4eb868d99c9464996fb44dd3acdca7a P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.804067   431 raft_consensus.cc:2243] T a4eb868d99c9464996fb44dd3acdca7a P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.804953   431 raft_consensus.cc:2272] T a4eb868d99c9464996fb44dd3acdca7a P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.806869   431 tablet_replica.cc:333] T 401ec66526fe4ad0a997979233dd7ef3 P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.807431   431 raft_consensus.cc:2243] T 401ec66526fe4ad0a997979233dd7ef3 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.808208   431 raft_consensus.cc:2272] T 401ec66526fe4ad0a997979233dd7ef3 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.810238   431 tablet_replica.cc:333] T d2c28919f0174f6d905b1b1a53f64d6d P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.810842   431 raft_consensus.cc:2243] T d2c28919f0174f6d905b1b1a53f64d6d P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.811291   431 raft_consensus.cc:2272] T d2c28919f0174f6d905b1b1a53f64d6d P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.813314   431 tablet_replica.cc:333] T f570072427e34a4e843286441c60a630 P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.813927   431 raft_consensus.cc:2243] T f570072427e34a4e843286441c60a630 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.814332   431 raft_consensus.cc:2272] T f570072427e34a4e843286441c60a630 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.816444   431 tablet_replica.cc:333] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.817075   431 raft_consensus.cc:2243] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.817505   431 raft_consensus.cc:2272] T 611ca169fbcc420fb11d1502cbe196a9 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.819626   431 tablet_replica.cc:333] T bec830b175ce40d69b73d9f73ea266a7 P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.820230   431 raft_consensus.cc:2243] T bec830b175ce40d69b73d9f73ea266a7 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.820698   431 raft_consensus.cc:2272] T bec830b175ce40d69b73d9f73ea266a7 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.823038   431 tablet_replica.cc:333] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.823606   431 raft_consensus.cc:2243] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.823999   431 raft_consensus.cc:2272] T 205f5d9c197b405faa72a70e2a010102 P 5e62c52a41f7476a908dd377c1a8a79f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.826124   431 tablet_replica.cc:333] T 26b888af641846d495fe184e39aadc16 P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.826705   431 raft_consensus.cc:2243] T 26b888af641846d495fe184e39aadc16 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.827143   431 raft_consensus.cc:2272] T 26b888af641846d495fe184e39aadc16 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.829322   431 tablet_replica.cc:333] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.829948   431 raft_consensus.cc:2243] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.830453   431 raft_consensus.cc:2272] T 96bfa4098abc4f4ba38783e8b91b8cdb P 5e62c52a41f7476a908dd377c1a8a79f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.832916   431 tablet_replica.cc:333] T 2ea7c6df9b4340ffaf28c5a78966c74b P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.833707   431 raft_consensus.cc:2243] T 2ea7c6df9b4340ffaf28c5a78966c74b P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.834172   431 raft_consensus.cc:2272] T 2ea7c6df9b4340ffaf28c5a78966c74b P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.836405   431 tablet_replica.cc:333] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.837033   431 raft_consensus.cc:2243] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.837448   431 raft_consensus.cc:2272] T 64c5fd517a084ef9b707c36ec7c2fe3c P 5e62c52a41f7476a908dd377c1a8a79f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.839512   431 tablet_replica.cc:333] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.840088   431 raft_consensus.cc:2243] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.840927   431 raft_consensus.cc:2272] T a62d4f04bff940779e241ebbd0aace2b P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.843211   431 tablet_replica.cc:333] T 41a51aa36dad4f1a85c485d67d2903e2 P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.843815   431 raft_consensus.cc:2243] T 41a51aa36dad4f1a85c485d67d2903e2 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.844354   431 raft_consensus.cc:2272] T 41a51aa36dad4f1a85c485d67d2903e2 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.847043   431 tablet_replica.cc:333] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.847832   431 raft_consensus.cc:2243] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.848912   431 raft_consensus.cc:2272] T dd1014df7b2b4d2d80864646b5e5df5e P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.851455   431 tablet_replica.cc:333] T 9fa0ebad5bc4444a8c465b2e412524dd P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.852139   431 raft_consensus.cc:2243] T 9fa0ebad5bc4444a8c465b2e412524dd P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.852648   431 raft_consensus.cc:2272] T 9fa0ebad5bc4444a8c465b2e412524dd P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.854693   431 tablet_replica.cc:333] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.855235   431 raft_consensus.cc:2243] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.856036   431 raft_consensus.cc:2272] T b5a791a0126444ba90c1fb442e1b809b P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.858254   431 tablet_replica.cc:333] T 9bf0d822416f49caacd1f92cebd84eb8 P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.858841   431 raft_consensus.cc:2243] T 9bf0d822416f49caacd1f92cebd84eb8 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.859306   431 raft_consensus.cc:2272] T 9bf0d822416f49caacd1f92cebd84eb8 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.861528   431 tablet_replica.cc:333] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.862105   431 raft_consensus.cc:2243] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.862511   431 raft_consensus.cc:2272] T c403148f1f724c0ca12919d8e85ae572 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.864641   431 tablet_replica.cc:333] T 211c168fa9614dbda8d8870bf5713616 P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.865219   431 raft_consensus.cc:2243] T 211c168fa9614dbda8d8870bf5713616 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.865635   431 raft_consensus.cc:2272] T 211c168fa9614dbda8d8870bf5713616 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.867640   431 tablet_replica.cc:333] T ccad89aaaf3d48008955a353eb0097b9 P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.868239   431 raft_consensus.cc:2243] T ccad89aaaf3d48008955a353eb0097b9 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.868762   431 raft_consensus.cc:2272] T ccad89aaaf3d48008955a353eb0097b9 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.870798   431 tablet_replica.cc:333] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.871408   431 raft_consensus.cc:2243] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.871814   431 raft_consensus.cc:2272] T f547b171c6b9445c95475ce3be870c2e P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.873790   431 tablet_replica.cc:333] T 00d1eccb4ed0452ea1afb814db7c7330 P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.874377   431 raft_consensus.cc:2243] T 00d1eccb4ed0452ea1afb814db7c7330 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.874804   431 raft_consensus.cc:2272] T 00d1eccb4ed0452ea1afb814db7c7330 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.876816   431 tablet_replica.cc:333] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.877373   431 raft_consensus.cc:2243] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.878145   431 raft_consensus.cc:2272] T 2e976ba764734878bb65c5db5e908f56 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.880005   431 tablet_replica.cc:333] T c6842d144c244233a18d121c7966712a P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.880605   431 raft_consensus.cc:2243] T c6842d144c244233a18d121c7966712a P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.881004   431 raft_consensus.cc:2272] T c6842d144c244233a18d121c7966712a P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.882875   431 tablet_replica.cc:333] T a19edd96c26a4c91a7b2a412d8221e5b P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.883437   431 raft_consensus.cc:2243] T a19edd96c26a4c91a7b2a412d8221e5b P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.883842   431 raft_consensus.cc:2272] T a19edd96c26a4c91a7b2a412d8221e5b P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.885766   431 tablet_replica.cc:333] T 03cf7a6241a444369a57fdaf965107b3 P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.886281   431 raft_consensus.cc:2243] T 03cf7a6241a444369a57fdaf965107b3 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.886708   431 raft_consensus.cc:2272] T 03cf7a6241a444369a57fdaf965107b3 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.888748   431 tablet_replica.cc:333] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.889320   431 raft_consensus.cc:2243] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.890102   431 raft_consensus.cc:2272] T ffe62eca39f04407943d15c5f7646aee P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.892156   431 tablet_replica.cc:333] T 2f47768053ec47e69b367bd5a49662c3 P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.892762   431 raft_consensus.cc:2243] T 2f47768053ec47e69b367bd5a49662c3 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.893500   431 raft_consensus.cc:2272] T 2f47768053ec47e69b367bd5a49662c3 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.895325   431 tablet_replica.cc:333] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.895838   431 raft_consensus.cc:2243] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.896255   431 raft_consensus.cc:2272] T e3dd15d873514f74a9bca08bc55e5d36 P 5e62c52a41f7476a908dd377c1a8a79f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.898149   431 tablet_replica.cc:333] T e187848edaa746928d647a830da8c970 P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.898685   431 raft_consensus.cc:2243] T e187848edaa746928d647a830da8c970 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.899420   431 raft_consensus.cc:2272] T e187848edaa746928d647a830da8c970 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.901400   431 tablet_replica.cc:333] T f1c9e47add2e4175b68fde1a27aa92e0 P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.901907   431 raft_consensus.cc:2243] T f1c9e47add2e4175b68fde1a27aa92e0 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.902634   431 raft_consensus.cc:2272] T f1c9e47add2e4175b68fde1a27aa92e0 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.904595   431 tablet_replica.cc:333] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.905126   431 raft_consensus.cc:2243] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.905551   431 raft_consensus.cc:2272] T e5382a9b34d84b4fbeccc952bb5f4ef5 P 5e62c52a41f7476a908dd377c1a8a79f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.907387   431 tablet_replica.cc:333] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.907912   431 raft_consensus.cc:2243] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.908725   431 raft_consensus.cc:2272] T 3034b839c8444c8d80acc4fe57bcd00a P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.910588   431 tablet_replica.cc:333] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.911158   431 raft_consensus.cc:2243] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.911895   431 raft_consensus.cc:2272] T c3f9e2acc7244a26b1dbae53f8d0040a P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.913883   431 tablet_replica.cc:333] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.914438   431 raft_consensus.cc:2243] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.915243   431 raft_consensus.cc:2272] T bb61bf6eaa1845f8add4d4057e49eb15 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.917194   431 tablet_replica.cc:333] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.917748   431 raft_consensus.cc:2243] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.918174   431 raft_consensus.cc:2272] T 7cc6b6ca3deb4f59aa2803e2ed33c4e8 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.920074   431 tablet_replica.cc:333] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.920639   431 raft_consensus.cc:2243] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.921046   431 raft_consensus.cc:2272] T 830984b68ee046d9b9a67009177b55c2 P 5e62c52a41f7476a908dd377c1a8a79f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.922895   431 tablet_replica.cc:333] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.923427   431 raft_consensus.cc:2243] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.924245   431 raft_consensus.cc:2272] T 049d8b6c7ecf423e95f1db20ab677254 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.926278   431 tablet_replica.cc:333] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.926774   431 raft_consensus.cc:2243] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:05.927536   431 raft_consensus.cc:2272] T c72b12d4267d44a1a03db0fe148c8d31 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.929612   431 tablet_replica.cc:333] T a8b5a22ddad942d7b4db2b897e159337 P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.930132   431 raft_consensus.cc:2243] T a8b5a22ddad942d7b4db2b897e159337 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.930605   431 raft_consensus.cc:2272] T a8b5a22ddad942d7b4db2b897e159337 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.932561   431 tablet_replica.cc:333] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.933061   431 raft_consensus.cc:2243] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.933494   431 raft_consensus.cc:2272] T a3b562356d3b4807a92648800cfe3dac P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.935343   431 tablet_replica.cc:333] T 1a1b4a3380b746d2bc977cfeff019c26 P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.935813   431 raft_consensus.cc:2243] T 1a1b4a3380b746d2bc977cfeff019c26 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.936216   431 raft_consensus.cc:2272] T 1a1b4a3380b746d2bc977cfeff019c26 P 5e62c52a41f7476a908dd377c1a8a79f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:05.938210   431 tablet_replica.cc:333] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 5e62c52a41f7476a908dd377c1a8a79f: stopping tablet replica
I20260709 13:02:05.938694   431 raft_consensus.cc:2243] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:05.939097   431 raft_consensus.cc:2272] T e81009eaf7bf4ee9b7ef6b9a92d61a73 P 5e62c52a41f7476a908dd377c1a8a79f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.015815   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:02:06.075225   431 master.cc:562] Master@127.0.107.254:46133 shutting down...
I20260709 13:02:06.097508   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P caa2c8769dab41e3b2a6fc730aa64dbc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:06.098012   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P caa2c8769dab41e3b2a6fc730aa64dbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:06.098282   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P caa2c8769dab41e3b2a6fc730aa64dbc: stopping tablet replica
I20260709 13:02:06.119248   431 master.cc:584] Master@127.0.107.254:46133 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (31659 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:02:06.201972   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:35617
I20260709 13:02:06.203092   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:06.209132 11919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:06.209209 11921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:06.209285 11918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:06.210426   431 server_base.cc:1061] running on GCE node
I20260709 13:02:06.211501   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:06.211699   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:06.211855   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602126211825 us; error 0 us; skew 500 ppm
I20260709 13:02:06.212350   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:06.214780   431 webserver.cc:533] Webserver started at http://127.0.107.254:35803/ using document root <none> and password file <none>
I20260709 13:02:06.215266   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:06.215478   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:06.215747   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:06.217159   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601786404416-431-0/minicluster-data/master-0-root/instance:
uuid: "37abd221f97f486bbc8848b10e9559a0"
format_stamp: "Formatted at 2026-07-09 13:02:06 on dist-test-slave-6j4g"
I20260709 13:02:06.221429   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:02:06.224802 11926 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:06.225535   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:02:06.225821   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601786404416-431-0/minicluster-data/master-0-root
uuid: "37abd221f97f486bbc8848b10e9559a0"
format_stamp: "Formatted at 2026-07-09 13:02:06 on dist-test-slave-6j4g"
I20260709 13:02:06.226102   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601786404416-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601786404416-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601786404416-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:06.244920   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:06.246143   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:06.284431   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:35617
I20260709 13:02:06.284638 11977 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:35617 every 8 connection(s)
I20260709 13:02:06.288342 11978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.298727 11978 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37abd221f97f486bbc8848b10e9559a0: Bootstrap starting.
I20260709 13:02:06.303455 11978 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 37abd221f97f486bbc8848b10e9559a0: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.307832 11978 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37abd221f97f486bbc8848b10e9559a0: No bootstrap required, opened a new log
I20260709 13:02:06.310109 11978 raft_consensus.cc:359] T 00000000000000000000000000000000 P 37abd221f97f486bbc8848b10e9559a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37abd221f97f486bbc8848b10e9559a0" member_type: VOTER }
I20260709 13:02:06.310528 11978 raft_consensus.cc:385] T 00000000000000000000000000000000 P 37abd221f97f486bbc8848b10e9559a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.310715 11978 raft_consensus.cc:740] T 00000000000000000000000000000000 P 37abd221f97f486bbc8848b10e9559a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37abd221f97f486bbc8848b10e9559a0, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.311230 11978 consensus_queue.cc:260] T 00000000000000000000000000000000 P 37abd221f97f486bbc8848b10e9559a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37abd221f97f486bbc8848b10e9559a0" member_type: VOTER }
I20260709 13:02:06.311676 11978 raft_consensus.cc:399] T 00000000000000000000000000000000 P 37abd221f97f486bbc8848b10e9559a0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:02:06.311877 11978 raft_consensus.cc:493] T 00000000000000000000000000000000 P 37abd221f97f486bbc8848b10e9559a0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:02:06.312099 11978 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 37abd221f97f486bbc8848b10e9559a0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.316916 11978 raft_consensus.cc:515] T 00000000000000000000000000000000 P 37abd221f97f486bbc8848b10e9559a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37abd221f97f486bbc8848b10e9559a0" member_type: VOTER }
I20260709 13:02:06.317617 11978 leader_election.cc:304] T 00000000000000000000000000000000 P 37abd221f97f486bbc8848b10e9559a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 37abd221f97f486bbc8848b10e9559a0; no voters: 
I20260709 13:02:06.318794 11978 leader_election.cc:290] T 00000000000000000000000000000000 P 37abd221f97f486bbc8848b10e9559a0 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:02:06.319095 11981 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 37abd221f97f486bbc8848b10e9559a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:06.320619 11981 raft_consensus.cc:697] T 00000000000000000000000000000000 P 37abd221f97f486bbc8848b10e9559a0 [term 1 LEADER]: Becoming Leader. State: Replica: 37abd221f97f486bbc8848b10e9559a0, State: Running, Role: LEADER
I20260709 13:02:06.321336 11981 consensus_queue.cc:237] T 00000000000000000000000000000000 P 37abd221f97f486bbc8848b10e9559a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37abd221f97f486bbc8848b10e9559a0" member_type: VOTER }
I20260709 13:02:06.321830 11978 sys_catalog.cc:565] T 00000000000000000000000000000000 P 37abd221f97f486bbc8848b10e9559a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:02:06.326319 11982 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37abd221f97f486bbc8848b10e9559a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "37abd221f97f486bbc8848b10e9559a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37abd221f97f486bbc8848b10e9559a0" member_type: VOTER } }
I20260709 13:02:06.326763 11983 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37abd221f97f486bbc8848b10e9559a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37abd221f97f486bbc8848b10e9559a0. Latest consensus state: current_term: 1 leader_uuid: "37abd221f97f486bbc8848b10e9559a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37abd221f97f486bbc8848b10e9559a0" member_type: VOTER } }
I20260709 13:02:06.327287 11982 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37abd221f97f486bbc8848b10e9559a0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:06.327589 11983 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37abd221f97f486bbc8848b10e9559a0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:06.330348 11988 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:02:06.335618 11988 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:02:06.338730   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:02:06.344691 11988 catalog_manager.cc:1383] Generated new cluster ID: 2df410073e9848e996f27383a11bac43
I20260709 13:02:06.344956 11988 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:02:06.368000 11988 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:02:06.369374 11988 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:02:06.383657 11988 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 37abd221f97f486bbc8848b10e9559a0: Generated new TSK 0
I20260709 13:02:06.384274 11988 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:02:06.405841   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:06.411854 11999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:06.412729 12000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:06.413970 12002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:06.414422   431 server_base.cc:1061] running on GCE node
I20260709 13:02:06.415390   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:06.415586   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:06.415772   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602126415745 us; error 0 us; skew 500 ppm
I20260709 13:02:06.416365   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:06.418720   431 webserver.cc:533] Webserver started at http://127.0.107.193:37645/ using document root <none> and password file <none>
I20260709 13:02:06.419167   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:06.419320   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:06.419538   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:06.420606   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601786404416-431-0/minicluster-data/ts-0-root/instance:
uuid: "614235125ef247d9bda52a3accb0cfb7"
format_stamp: "Formatted at 2026-07-09 13:02:06 on dist-test-slave-6j4g"
I20260709 13:02:06.425104   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:02:06.428622 12007 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:06.429347   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:02:06.429664   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601786404416-431-0/minicluster-data/ts-0-root
uuid: "614235125ef247d9bda52a3accb0cfb7"
format_stamp: "Formatted at 2026-07-09 13:02:06 on dist-test-slave-6j4g"
I20260709 13:02:06.429949   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601786404416-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601786404416-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601786404416-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:06.442647   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:06.443838   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:06.445362   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:06.448151   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:06.448382   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:06.448676   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:06.448848   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:06.488354   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:45599
I20260709 13:02:06.488448 12069 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:45599 every 8 connection(s)
I20260709 13:02:06.493409   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:06.501636 12075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:06.502255 12074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:06.505163 12077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:06.505297   431 server_base.cc:1061] running on GCE node
I20260709 13:02:06.506793   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:06.507028   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:06.507205   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602126507184 us; error 0 us; skew 500 ppm
I20260709 13:02:06.507874   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:06.509934 12070 heartbeater.cc:344] Connected to a master server at 127.0.107.254:35617
I20260709 13:02:06.510278 12070 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:06.510838   431 webserver.cc:533] Webserver started at http://127.0.107.194:37441/ using document root <none> and password file <none>
I20260709 13:02:06.510974 12070 heartbeater.cc:507] Master 127.0.107.254:35617 requested a full tablet report, sending...
I20260709 13:02:06.511466   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:06.511689   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:06.511960   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:06.513309 11943 ts_manager.cc:194] Registered new tserver with Master: 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599)
I20260709 13:02:06.513509   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601786404416-431-0/minicluster-data/ts-1-root/instance:
uuid: "11b6e81238e74ac9a19fa102021ec3b3"
format_stamp: "Formatted at 2026-07-09 13:02:06 on dist-test-slave-6j4g"
I20260709 13:02:06.515828 11943 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49140
I20260709 13:02:06.519409   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:02:06.524534 12082 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:06.525357   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:02:06.525663   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601786404416-431-0/minicluster-data/ts-1-root
uuid: "11b6e81238e74ac9a19fa102021ec3b3"
format_stamp: "Formatted at 2026-07-09 13:02:06 on dist-test-slave-6j4g"
I20260709 13:02:06.525944   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601786404416-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601786404416-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601786404416-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:06.545972   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:06.547236   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:06.548840   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:06.551141   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:06.551368   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:06.551595   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:06.551757   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:06.591658   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:42117
I20260709 13:02:06.591758 12144 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:42117 every 8 connection(s)
I20260709 13:02:06.596766   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:06.604288 12148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:06.605291 12149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:06.608306 12151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:06.609431   431 server_base.cc:1061] running on GCE node
I20260709 13:02:06.609771 12145 heartbeater.cc:344] Connected to a master server at 127.0.107.254:35617
I20260709 13:02:06.610262 12145 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:06.610478   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:06.610752   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:06.610906   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602126610892 us; error 0 us; skew 500 ppm
I20260709 13:02:06.611032 12145 heartbeater.cc:507] Master 127.0.107.254:35617 requested a full tablet report, sending...
I20260709 13:02:06.611470   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:06.613335 11943 ts_manager.cc:194] Registered new tserver with Master: 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117)
I20260709 13:02:06.614698 11943 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49142
I20260709 13:02:06.615877   431 webserver.cc:533] Webserver started at http://127.0.107.195:39671/ using document root <none> and password file <none>
I20260709 13:02:06.616528   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:06.616737   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:06.616982   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:06.618144   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601786404416-431-0/minicluster-data/ts-2-root/instance:
uuid: "981b6c7cf04e4f12bd645a47411fc341"
format_stamp: "Formatted at 2026-07-09 13:02:06 on dist-test-slave-6j4g"
I20260709 13:02:06.622869   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:02:06.626637 12156 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:06.627583   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:02:06.627928   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601786404416-431-0/minicluster-data/ts-2-root
uuid: "981b6c7cf04e4f12bd645a47411fc341"
format_stamp: "Formatted at 2026-07-09 13:02:06 on dist-test-slave-6j4g"
I20260709 13:02:06.628276   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601786404416-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601786404416-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601786404416-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:06.653682   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:06.654896   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:06.656347   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:06.659087   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:06.659303   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:06.659541   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:06.659694   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:06.698348   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:40471
I20260709 13:02:06.698446 12218 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:40471 every 8 connection(s)
I20260709 13:02:06.711669 12219 heartbeater.cc:344] Connected to a master server at 127.0.107.254:35617
I20260709 13:02:06.712100 12219 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:06.712884 12219 heartbeater.cc:507] Master 127.0.107.254:35617 requested a full tablet report, sending...
I20260709 13:02:06.714799 11943 ts_manager.cc:194] Registered new tserver with Master: 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195:40471)
I20260709 13:02:06.715178   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013675347s
I20260709 13:02:06.716202 11943 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49150
I20260709 13:02:06.741441 11943 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49166:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:06.744328 11943 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:06.848196 12182 tablet_service.cc:1511] Processing CreateTablet for tablet 1aac29d4192147aea2a627f525d88c7d (DEFAULT_TABLE table=test-workload [id=1b0af2b3d7ce4ff08b57d10651e2ed99]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:02:06.848628 12184 tablet_service.cc:1511] Processing CreateTablet for tablet ce79da57b33749a9be411c92b0178103 (DEFAULT_TABLE table=test-workload [id=1b0af2b3d7ce4ff08b57d10651e2ed99]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:02:06.849763 12182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aac29d4192147aea2a627f525d88c7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.850693 12183 tablet_service.cc:1511] Processing CreateTablet for tablet 8d14cd6559d347979cf41da97a2533b4 (DEFAULT_TABLE table=test-workload [id=1b0af2b3d7ce4ff08b57d10651e2ed99]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:02:06.852102 12181 tablet_service.cc:1511] Processing CreateTablet for tablet 3f30ed75e9c4428fa5fc69291ccef018 (DEFAULT_TABLE table=test-workload [id=1b0af2b3d7ce4ff08b57d10651e2ed99]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:02:06.852142 12183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d14cd6559d347979cf41da97a2533b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.853330 12180 tablet_service.cc:1511] Processing CreateTablet for tablet 4b75f0d8243c43318c29f22313533f08 (DEFAULT_TABLE table=test-workload [id=1b0af2b3d7ce4ff08b57d10651e2ed99]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:02:06.854737 12178 tablet_service.cc:1511] Processing CreateTablet for tablet 472c5d72e71b465abdd55365c4f9bca4 (DEFAULT_TABLE table=test-workload [id=1b0af2b3d7ce4ff08b57d10651e2ed99]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:02:06.854790 12180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b75f0d8243c43318c29f22313533f08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.856840 12178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 472c5d72e71b465abdd55365c4f9bca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.857566 12184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce79da57b33749a9be411c92b0178103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.857225 12177 tablet_service.cc:1511] Processing CreateTablet for tablet 158dbd8d299848848d9d949e89ade205 (DEFAULT_TABLE table=test-workload [id=1b0af2b3d7ce4ff08b57d10651e2ed99]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:02:06.858654 12177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 158dbd8d299848848d9d949e89ade205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.860248 12035 tablet_service.cc:1511] Processing CreateTablet for tablet ce79da57b33749a9be411c92b0178103 (DEFAULT_TABLE table=test-workload [id=1b0af2b3d7ce4ff08b57d10651e2ed99]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:02:06.860702 12029 tablet_service.cc:1511] Processing CreateTablet for tablet 472c5d72e71b465abdd55365c4f9bca4 (DEFAULT_TABLE table=test-workload [id=1b0af2b3d7ce4ff08b57d10651e2ed99]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:02:06.861742 12035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce79da57b33749a9be411c92b0178103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.862351 12029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 472c5d72e71b465abdd55365c4f9bca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.865000 12034 tablet_service.cc:1511] Processing CreateTablet for tablet 8d14cd6559d347979cf41da97a2533b4 (DEFAULT_TABLE table=test-workload [id=1b0af2b3d7ce4ff08b57d10651e2ed99]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:02:06.866504 12034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d14cd6559d347979cf41da97a2533b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.869746 12033 tablet_service.cc:1511] Processing CreateTablet for tablet 1aac29d4192147aea2a627f525d88c7d (DEFAULT_TABLE table=test-workload [id=1b0af2b3d7ce4ff08b57d10651e2ed99]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:02:06.871230 12033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aac29d4192147aea2a627f525d88c7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.872853 12027 tablet_service.cc:1511] Processing CreateTablet for tablet 77ec90b937044a22908ba572a3df7080 (DEFAULT_TABLE table=test-workload [id=1b0af2b3d7ce4ff08b57d10651e2ed99]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:02:06.874320 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77ec90b937044a22908ba572a3df7080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.874734 12031 tablet_service.cc:1511] Processing CreateTablet for tablet 4b75f0d8243c43318c29f22313533f08 (DEFAULT_TABLE table=test-workload [id=1b0af2b3d7ce4ff08b57d10651e2ed99]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:02:06.876210 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b75f0d8243c43318c29f22313533f08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.877719 12030 tablet_service.cc:1511] Processing CreateTablet for tablet 3768bc61992440faa9ef167f5f395162 (DEFAULT_TABLE table=test-workload [id=1b0af2b3d7ce4ff08b57d10651e2ed99]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:02:06.856014 12179 tablet_service.cc:1511] Processing CreateTablet for tablet 3768bc61992440faa9ef167f5f395162 (DEFAULT_TABLE table=test-workload [id=1b0af2b3d7ce4ff08b57d10651e2ed99]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:02:06.882566 12179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3768bc61992440faa9ef167f5f395162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.855980 12176 tablet_service.cc:1511] Processing CreateTablet for tablet 77ec90b937044a22908ba572a3df7080 (DEFAULT_TABLE table=test-workload [id=1b0af2b3d7ce4ff08b57d10651e2ed99]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:02:06.884999 12176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77ec90b937044a22908ba572a3df7080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.871239 12028 tablet_service.cc:1511] Processing CreateTablet for tablet 158dbd8d299848848d9d949e89ade205 (DEFAULT_TABLE table=test-workload [id=1b0af2b3d7ce4ff08b57d10651e2ed99]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:02:06.857242 12175 tablet_service.cc:1511] Processing CreateTablet for tablet e9f2bca87d394ebdae299b722de75c9b (DEFAULT_TABLE table=test-workload [id=1b0af2b3d7ce4ff08b57d10651e2ed99]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:02:06.888669 12175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9f2bca87d394ebdae299b722de75c9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.873101 12032 tablet_service.cc:1511] Processing CreateTablet for tablet 3f30ed75e9c4428fa5fc69291ccef018 (DEFAULT_TABLE table=test-workload [id=1b0af2b3d7ce4ff08b57d10651e2ed99]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:02:06.890594 12181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f30ed75e9c4428fa5fc69291ccef018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.892649 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f30ed75e9c4428fa5fc69291ccef018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.893924 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 158dbd8d299848848d9d949e89ade205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.895061 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3768bc61992440faa9ef167f5f395162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.916435 12026 tablet_service.cc:1511] Processing CreateTablet for tablet e9f2bca87d394ebdae299b722de75c9b (DEFAULT_TABLE table=test-workload [id=1b0af2b3d7ce4ff08b57d10651e2ed99]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:02:06.917964 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9f2bca87d394ebdae299b722de75c9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.917670 12110 tablet_service.cc:1511] Processing CreateTablet for tablet ce79da57b33749a9be411c92b0178103 (DEFAULT_TABLE table=test-workload [id=1b0af2b3d7ce4ff08b57d10651e2ed99]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:02:06.919128 12110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce79da57b33749a9be411c92b0178103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.920017 12106 tablet_service.cc:1511] Processing CreateTablet for tablet 4b75f0d8243c43318c29f22313533f08 (DEFAULT_TABLE table=test-workload [id=1b0af2b3d7ce4ff08b57d10651e2ed99]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:02:06.921411 12106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b75f0d8243c43318c29f22313533f08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.921679 12109 tablet_service.cc:1511] Processing CreateTablet for tablet 8d14cd6559d347979cf41da97a2533b4 (DEFAULT_TABLE table=test-workload [id=1b0af2b3d7ce4ff08b57d10651e2ed99]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:02:06.923065 12109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d14cd6559d347979cf41da97a2533b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.924860 12105 tablet_service.cc:1511] Processing CreateTablet for tablet 3768bc61992440faa9ef167f5f395162 (DEFAULT_TABLE table=test-workload [id=1b0af2b3d7ce4ff08b57d10651e2ed99]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:02:06.925055 12108 tablet_service.cc:1511] Processing CreateTablet for tablet 1aac29d4192147aea2a627f525d88c7d (DEFAULT_TABLE table=test-workload [id=1b0af2b3d7ce4ff08b57d10651e2ed99]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:02:06.926401 12105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3768bc61992440faa9ef167f5f395162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.927646 12107 tablet_service.cc:1511] Processing CreateTablet for tablet 3f30ed75e9c4428fa5fc69291ccef018 (DEFAULT_TABLE table=test-workload [id=1b0af2b3d7ce4ff08b57d10651e2ed99]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:02:06.928606 12104 tablet_service.cc:1511] Processing CreateTablet for tablet 472c5d72e71b465abdd55365c4f9bca4 (DEFAULT_TABLE table=test-workload [id=1b0af2b3d7ce4ff08b57d10651e2ed99]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:02:06.929322 12107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f30ed75e9c4428fa5fc69291ccef018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.930073 12104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 472c5d72e71b465abdd55365c4f9bca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.931762 12108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aac29d4192147aea2a627f525d88c7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.932147 12103 tablet_service.cc:1511] Processing CreateTablet for tablet 158dbd8d299848848d9d949e89ade205 (DEFAULT_TABLE table=test-workload [id=1b0af2b3d7ce4ff08b57d10651e2ed99]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:02:06.933647 12103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 158dbd8d299848848d9d949e89ade205. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.936267 12102 tablet_service.cc:1511] Processing CreateTablet for tablet 77ec90b937044a22908ba572a3df7080 (DEFAULT_TABLE table=test-workload [id=1b0af2b3d7ce4ff08b57d10651e2ed99]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:02:06.937817 12102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77ec90b937044a22908ba572a3df7080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.939801 12101 tablet_service.cc:1511] Processing CreateTablet for tablet e9f2bca87d394ebdae299b722de75c9b (DEFAULT_TABLE table=test-workload [id=1b0af2b3d7ce4ff08b57d10651e2ed99]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:02:06.941293 12101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9f2bca87d394ebdae299b722de75c9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:06.953734 12234 tablet_bootstrap.cc:492] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341: Bootstrap starting.
I20260709 13:02:06.961153 12234 tablet_bootstrap.cc:654] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.972951 12234 tablet_bootstrap.cc:492] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341: No bootstrap required, opened a new log
I20260709 13:02:06.973515 12234 ts_tablet_manager.cc:1403] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:02:06.976640 12234 raft_consensus.cc:359] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:06.977388 12234 raft_consensus.cc:385] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.977700 12234 raft_consensus.cc:740] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 981b6c7cf04e4f12bd645a47411fc341, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.978454 12234 consensus_queue.cc:260] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:06.980862 12219 heartbeater.cc:499] Master 127.0.107.254:35617 was elected leader, sending a full tablet report...
I20260709 13:02:06.981961 12234 ts_tablet_manager.cc:1434] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:06.983106 12234 tablet_bootstrap.cc:492] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341: Bootstrap starting.
I20260709 13:02:06.988893 12236 raft_consensus.cc:493] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.989471 12236 raft_consensus.cc:515] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.006889 12236 leader_election.cc:290] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117)
W20260709 13:02:07.006989 12159 leader_election.cc:343] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Not found: Tablet not found: 4b75f0d8243c43318c29f22313533f08
I20260709 13:02:07.008251 12234 tablet_bootstrap.cc:654] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:07.021566 12160 leader_election.cc:343] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117): Not found: Tablet not found: 4b75f0d8243c43318c29f22313533f08
I20260709 13:02:07.022071 12160 leader_election.cc:304] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 981b6c7cf04e4f12bd645a47411fc341; no voters: 11b6e81238e74ac9a19fa102021ec3b3, 614235125ef247d9bda52a3accb0cfb7
I20260709 13:02:07.022915 12236 raft_consensus.cc:2749] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:07.082221 12234 tablet_bootstrap.cc:492] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341: No bootstrap required, opened a new log
I20260709 13:02:07.082872 12234 ts_tablet_manager.cc:1403] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341: Time spent bootstrapping tablet: real 0.100s	user 0.030s	sys 0.016s
I20260709 13:02:07.104012 12234 raft_consensus.cc:359] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.107992 12239 tablet_bootstrap.cc:492] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap starting.
I20260709 13:02:07.106854 12234 raft_consensus.cc:385] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.118490 12234 raft_consensus.cc:740] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 981b6c7cf04e4f12bd645a47411fc341, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.120965 12238 tablet_bootstrap.cc:492] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3: Bootstrap starting.
I20260709 13:02:07.121594 12234 consensus_queue.cc:260] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.130224 12234 ts_tablet_manager.cc:1434] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341: Time spent starting tablet: real 0.047s	user 0.010s	sys 0.000s
I20260709 13:02:07.131258 12234 tablet_bootstrap.cc:492] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341: Bootstrap starting.
I20260709 13:02:07.133426 12239 tablet_bootstrap.cc:654] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.136335 12238 tablet_bootstrap.cc:654] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.138754 12234 tablet_bootstrap.cc:654] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.144963 12234 tablet_bootstrap.cc:492] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341: No bootstrap required, opened a new log
I20260709 13:02:07.145473 12234 ts_tablet_manager.cc:1403] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341: Time spent bootstrapping tablet: real 0.014s	user 0.001s	sys 0.011s
I20260709 13:02:07.148288 12234 raft_consensus.cc:359] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.149055 12234 raft_consensus.cc:385] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.149363 12234 raft_consensus.cc:740] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 981b6c7cf04e4f12bd645a47411fc341, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.149641 12238 tablet_bootstrap.cc:492] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3: No bootstrap required, opened a new log
I20260709 13:02:07.150170 12238 ts_tablet_manager.cc:1403] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.003s
I20260709 13:02:07.150257 12234 consensus_queue.cc:260] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.151000 12239 tablet_bootstrap.cc:492] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7: No bootstrap required, opened a new log
I20260709 13:02:07.151539 12239 ts_tablet_manager.cc:1403] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.003s
I20260709 13:02:07.152626 12234 ts_tablet_manager.cc:1434] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:02:07.153267 12238 raft_consensus.cc:359] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.154065 12238 raft_consensus.cc:385] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.154378 12238 raft_consensus.cc:740] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11b6e81238e74ac9a19fa102021ec3b3, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.154673 12239 raft_consensus.cc:359] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.155289 12239 raft_consensus.cc:385] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.155756 12239 raft_consensus.cc:740] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 614235125ef247d9bda52a3accb0cfb7, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.155247 12238 consensus_queue.cc:260] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.153785 12234 tablet_bootstrap.cc:492] T ce79da57b33749a9be411c92b0178103 P 981b6c7cf04e4f12bd645a47411fc341: Bootstrap starting.
I20260709 13:02:07.156430 12239 consensus_queue.cc:260] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.163945 12145 heartbeater.cc:499] Master 127.0.107.254:35617 was elected leader, sending a full tablet report...
I20260709 13:02:07.165025 12234 tablet_bootstrap.cc:654] T ce79da57b33749a9be411c92b0178103 P 981b6c7cf04e4f12bd645a47411fc341: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.166857 12239 ts_tablet_manager.cc:1434] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.007s
I20260709 13:02:07.167701 12070 heartbeater.cc:499] Master 127.0.107.254:35617 was elected leader, sending a full tablet report...
I20260709 13:02:07.165055 12238 ts_tablet_manager.cc:1434] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.008s
I20260709 13:02:07.169235 12238 tablet_bootstrap.cc:492] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3: Bootstrap starting.
I20260709 13:02:07.176048 12238 tablet_bootstrap.cc:654] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.177282 12234 tablet_bootstrap.cc:492] T ce79da57b33749a9be411c92b0178103 P 981b6c7cf04e4f12bd645a47411fc341: No bootstrap required, opened a new log
I20260709 13:02:07.177893 12234 ts_tablet_manager.cc:1403] T ce79da57b33749a9be411c92b0178103 P 981b6c7cf04e4f12bd645a47411fc341: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.004s
I20260709 13:02:07.180022 12239 tablet_bootstrap.cc:492] T 8d14cd6559d347979cf41da97a2533b4 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap starting.
I20260709 13:02:07.181092 12234 raft_consensus.cc:359] T ce79da57b33749a9be411c92b0178103 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } }
I20260709 13:02:07.182020 12234 raft_consensus.cc:385] T ce79da57b33749a9be411c92b0178103 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.182338 12234 raft_consensus.cc:740] T ce79da57b33749a9be411c92b0178103 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 981b6c7cf04e4f12bd645a47411fc341, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.183492 12234 consensus_queue.cc:260] T ce79da57b33749a9be411c92b0178103 P 981b6c7cf04e4f12bd645a47411fc341 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } }
I20260709 13:02:07.189158 12239 tablet_bootstrap.cc:654] T 8d14cd6559d347979cf41da97a2533b4 P 614235125ef247d9bda52a3accb0cfb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.192445 12234 ts_tablet_manager.cc:1434] T ce79da57b33749a9be411c92b0178103 P 981b6c7cf04e4f12bd645a47411fc341: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:02:07.193758 12234 tablet_bootstrap.cc:492] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341: Bootstrap starting.
I20260709 13:02:07.195479 12236 raft_consensus.cc:493] T ce79da57b33749a9be411c92b0178103 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.196296 12239 tablet_bootstrap.cc:492] T 8d14cd6559d347979cf41da97a2533b4 P 614235125ef247d9bda52a3accb0cfb7: No bootstrap required, opened a new log
I20260709 13:02:07.196030 12236 raft_consensus.cc:515] T ce79da57b33749a9be411c92b0178103 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } }
I20260709 13:02:07.196875 12239 ts_tablet_manager.cc:1403] T 8d14cd6559d347979cf41da97a2533b4 P 614235125ef247d9bda52a3accb0cfb7: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:02:07.198325 12236 leader_election.cc:290] T ce79da57b33749a9be411c92b0178103 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117), 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599)
I20260709 13:02:07.199975 12239 raft_consensus.cc:359] T 8d14cd6559d347979cf41da97a2533b4 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.200227 12045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce79da57b33749a9be411c92b0178103" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "614235125ef247d9bda52a3accb0cfb7" is_pre_election: true
I20260709 13:02:07.200814 12239 raft_consensus.cc:385] T 8d14cd6559d347979cf41da97a2533b4 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.201166 12239 raft_consensus.cc:740] T 8d14cd6559d347979cf41da97a2533b4 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 614235125ef247d9bda52a3accb0cfb7, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.205276 12238 tablet_bootstrap.cc:492] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3: No bootstrap required, opened a new log
I20260709 13:02:07.202028 12239 consensus_queue.cc:260] T 8d14cd6559d347979cf41da97a2533b4 P 614235125ef247d9bda52a3accb0cfb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.208967 12238 ts_tablet_manager.cc:1403] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.014s
I20260709 13:02:07.210798 12239 ts_tablet_manager.cc:1434] T 8d14cd6559d347979cf41da97a2533b4 P 614235125ef247d9bda52a3accb0cfb7: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:02:07.211815 12239 tablet_bootstrap.cc:492] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7: Bootstrap starting.
W20260709 13:02:07.201943 12159 leader_election.cc:343] T ce79da57b33749a9be411c92b0178103 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.212428 12234 tablet_bootstrap.cc:654] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.212669 12238 raft_consensus.cc:359] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.214012 12238 raft_consensus.cc:385] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.214412 12238 raft_consensus.cc:740] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11b6e81238e74ac9a19fa102021ec3b3, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.203624 12120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce79da57b33749a9be411c92b0178103" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3" is_pre_election: true
W20260709 13:02:07.202421 12220 tablet.cc:2406] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:02:07.215378 12238 consensus_queue.cc:260] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
W20260709 13:02:07.216822 12160 leader_election.cc:343] T ce79da57b33749a9be411c92b0178103 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.217284 12160 leader_election.cc:304] T ce79da57b33749a9be411c92b0178103 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 981b6c7cf04e4f12bd645a47411fc341; no voters: 11b6e81238e74ac9a19fa102021ec3b3, 614235125ef247d9bda52a3accb0cfb7
I20260709 13:02:07.218130 12236 raft_consensus.cc:2749] T ce79da57b33749a9be411c92b0178103 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:07.220842 12239 tablet_bootstrap.cc:654] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.225512 12238 ts_tablet_manager.cc:1434] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 13:02:07.225832 12234 tablet_bootstrap.cc:492] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341: No bootstrap required, opened a new log
I20260709 13:02:07.227173 12234 ts_tablet_manager.cc:1403] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.007s
I20260709 13:02:07.228415 12238 tablet_bootstrap.cc:492] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3: Bootstrap starting.
I20260709 13:02:07.230571 12234 raft_consensus.cc:359] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.231474 12234 raft_consensus.cc:385] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.231932 12234 raft_consensus.cc:740] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 981b6c7cf04e4f12bd645a47411fc341, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.232965 12234 consensus_queue.cc:260] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.235041 12234 ts_tablet_manager.cc:1434] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:07.235932 12238 tablet_bootstrap.cc:654] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.235950 12234 tablet_bootstrap.cc:492] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341: Bootstrap starting.
I20260709 13:02:07.238082 12239 tablet_bootstrap.cc:492] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7: No bootstrap required, opened a new log
I20260709 13:02:07.238668 12239 ts_tablet_manager.cc:1403] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.006s
I20260709 13:02:07.241783 12239 raft_consensus.cc:359] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.242611 12239 raft_consensus.cc:385] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.242971 12239 raft_consensus.cc:740] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 614235125ef247d9bda52a3accb0cfb7, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.243410 12234 tablet_bootstrap.cc:654] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.245177 12239 consensus_queue.cc:260] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.256362 12239 ts_tablet_manager.cc:1434] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7: Time spent starting tablet: real 0.017s	user 0.000s	sys 0.006s
I20260709 13:02:07.257820 12239 tablet_bootstrap.cc:492] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap starting.
I20260709 13:02:07.260023 12234 tablet_bootstrap.cc:492] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341: No bootstrap required, opened a new log
I20260709 13:02:07.260529 12238 tablet_bootstrap.cc:492] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3: No bootstrap required, opened a new log
I20260709 13:02:07.260756 12234 ts_tablet_manager.cc:1403] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.007s
I20260709 13:02:07.261089 12238 ts_tablet_manager.cc:1403] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3: Time spent bootstrapping tablet: real 0.033s	user 0.019s	sys 0.012s
I20260709 13:02:07.264243 12239 tablet_bootstrap.cc:654] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.264039 12234 raft_consensus.cc:359] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.264937 12234 raft_consensus.cc:385] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.264675 12238 raft_consensus.cc:359] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.265254 12234 raft_consensus.cc:740] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 981b6c7cf04e4f12bd645a47411fc341, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.265435 12238 raft_consensus.cc:385] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.265754 12238 raft_consensus.cc:740] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11b6e81238e74ac9a19fa102021ec3b3, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.266084 12234 consensus_queue.cc:260] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.266476 12238 consensus_queue.cc:260] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.268759 12238 ts_tablet_manager.cc:1434] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:07.269577 12234 ts_tablet_manager.cc:1434] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:02:07.270745 12234 tablet_bootstrap.cc:492] T 3f30ed75e9c4428fa5fc69291ccef018 P 981b6c7cf04e4f12bd645a47411fc341: Bootstrap starting.
I20260709 13:02:07.271229 12236 raft_consensus.cc:493] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.271903 12239 tablet_bootstrap.cc:492] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7: No bootstrap required, opened a new log
I20260709 13:02:07.271751 12236 raft_consensus.cc:515] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.272455 12239 ts_tablet_manager.cc:1403] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7: Time spent bootstrapping tablet: real 0.015s	user 0.005s	sys 0.008s
I20260709 13:02:07.274008 12236 leader_election.cc:290] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117)
I20260709 13:02:07.275530 12239 raft_consensus.cc:359] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.276429 12239 raft_consensus.cc:385] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.276816 12239 raft_consensus.cc:740] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 614235125ef247d9bda52a3accb0cfb7, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.277150 12234 tablet_bootstrap.cc:654] T 3f30ed75e9c4428fa5fc69291ccef018 P 981b6c7cf04e4f12bd645a47411fc341: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.277478 12120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f2bca87d394ebdae299b722de75c9b" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3" is_pre_election: true
I20260709 13:02:07.277621 12239 consensus_queue.cc:260] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.278241 12238 tablet_bootstrap.cc:492] T ce79da57b33749a9be411c92b0178103 P 11b6e81238e74ac9a19fa102021ec3b3: Bootstrap starting.
I20260709 13:02:07.280019 12239 ts_tablet_manager.cc:1434] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:02:07.275581 12045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f2bca87d394ebdae299b722de75c9b" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "614235125ef247d9bda52a3accb0cfb7" is_pre_election: true
W20260709 13:02:07.282689 12159 leader_election.cc:343] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:07.285254 12160 leader_election.cc:343] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.285835 12160 leader_election.cc:304] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 981b6c7cf04e4f12bd645a47411fc341; no voters: 11b6e81238e74ac9a19fa102021ec3b3, 614235125ef247d9bda52a3accb0cfb7
I20260709 13:02:07.287117 12236 raft_consensus.cc:2749] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:07.287706 12238 tablet_bootstrap.cc:654] T ce79da57b33749a9be411c92b0178103 P 11b6e81238e74ac9a19fa102021ec3b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.294184 12234 tablet_bootstrap.cc:492] T 3f30ed75e9c4428fa5fc69291ccef018 P 981b6c7cf04e4f12bd645a47411fc341: No bootstrap required, opened a new log
I20260709 13:02:07.294812 12234 ts_tablet_manager.cc:1403] T 3f30ed75e9c4428fa5fc69291ccef018 P 981b6c7cf04e4f12bd645a47411fc341: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.004s
I20260709 13:02:07.295106 12239 tablet_bootstrap.cc:492] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7: Bootstrap starting.
I20260709 13:02:07.298935 12234 raft_consensus.cc:359] T 3f30ed75e9c4428fa5fc69291ccef018 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.299844 12234 raft_consensus.cc:385] T 3f30ed75e9c4428fa5fc69291ccef018 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.300330 12234 raft_consensus.cc:740] T 3f30ed75e9c4428fa5fc69291ccef018 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 981b6c7cf04e4f12bd645a47411fc341, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.301295 12238 tablet_bootstrap.cc:492] T ce79da57b33749a9be411c92b0178103 P 11b6e81238e74ac9a19fa102021ec3b3: No bootstrap required, opened a new log
I20260709 13:02:07.301980 12238 ts_tablet_manager.cc:1403] T ce79da57b33749a9be411c92b0178103 P 11b6e81238e74ac9a19fa102021ec3b3: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.007s
I20260709 13:02:07.301329 12234 consensus_queue.cc:260] T 3f30ed75e9c4428fa5fc69291ccef018 P 981b6c7cf04e4f12bd645a47411fc341 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.303774 12239 tablet_bootstrap.cc:654] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.304766 12234 ts_tablet_manager.cc:1434] T 3f30ed75e9c4428fa5fc69291ccef018 P 981b6c7cf04e4f12bd645a47411fc341: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:02:07.305307 12238 raft_consensus.cc:359] T ce79da57b33749a9be411c92b0178103 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } }
I20260709 13:02:07.305994 12234 tablet_bootstrap.cc:492] T 158dbd8d299848848d9d949e89ade205 P 981b6c7cf04e4f12bd645a47411fc341: Bootstrap starting.
I20260709 13:02:07.306195 12238 raft_consensus.cc:385] T ce79da57b33749a9be411c92b0178103 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.306620 12238 raft_consensus.cc:740] T ce79da57b33749a9be411c92b0178103 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11b6e81238e74ac9a19fa102021ec3b3, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.307575 12238 consensus_queue.cc:260] T ce79da57b33749a9be411c92b0178103 P 11b6e81238e74ac9a19fa102021ec3b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } }
I20260709 13:02:07.312264 12238 ts_tablet_manager.cc:1434] T ce79da57b33749a9be411c92b0178103 P 11b6e81238e74ac9a19fa102021ec3b3: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:02:07.313731 12238 tablet_bootstrap.cc:492] T 77ec90b937044a22908ba572a3df7080 P 11b6e81238e74ac9a19fa102021ec3b3: Bootstrap starting.
I20260709 13:02:07.315711 12239 tablet_bootstrap.cc:492] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7: No bootstrap required, opened a new log
I20260709 13:02:07.316531 12239 ts_tablet_manager.cc:1403] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.000s
I20260709 13:02:07.319692 12239 raft_consensus.cc:359] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.320612 12238 tablet_bootstrap.cc:654] T 77ec90b937044a22908ba572a3df7080 P 11b6e81238e74ac9a19fa102021ec3b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.320694 12239 raft_consensus.cc:385] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.321295 12239 raft_consensus.cc:740] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 614235125ef247d9bda52a3accb0cfb7, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.322146 12234 tablet_bootstrap.cc:654] T 158dbd8d299848848d9d949e89ade205 P 981b6c7cf04e4f12bd645a47411fc341: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.322343 12239 consensus_queue.cc:260] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.326166 12239 ts_tablet_manager.cc:1434] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:02:07.327863 12239 tablet_bootstrap.cc:492] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap starting.
I20260709 13:02:07.333000 12238 tablet_bootstrap.cc:492] T 77ec90b937044a22908ba572a3df7080 P 11b6e81238e74ac9a19fa102021ec3b3: No bootstrap required, opened a new log
I20260709 13:02:07.333775 12238 ts_tablet_manager.cc:1403] T 77ec90b937044a22908ba572a3df7080 P 11b6e81238e74ac9a19fa102021ec3b3: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.009s
W20260709 13:02:07.334249 11991 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:07.336017 12239 tablet_bootstrap.cc:654] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.337076 12238 raft_consensus.cc:359] T 77ec90b937044a22908ba572a3df7080 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.339201 12238 raft_consensus.cc:385] T 77ec90b937044a22908ba572a3df7080 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.339608 12238 raft_consensus.cc:740] T 77ec90b937044a22908ba572a3df7080 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11b6e81238e74ac9a19fa102021ec3b3, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.340831 12234 tablet_bootstrap.cc:492] T 158dbd8d299848848d9d949e89ade205 P 981b6c7cf04e4f12bd645a47411fc341: No bootstrap required, opened a new log
I20260709 13:02:07.340698 12238 consensus_queue.cc:260] T 77ec90b937044a22908ba572a3df7080 P 11b6e81238e74ac9a19fa102021ec3b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.342221 12234 ts_tablet_manager.cc:1403] T 158dbd8d299848848d9d949e89ade205 P 981b6c7cf04e4f12bd645a47411fc341: Time spent bootstrapping tablet: real 0.036s	user 0.022s	sys 0.004s
I20260709 13:02:07.345036 12238 ts_tablet_manager.cc:1434] T 77ec90b937044a22908ba572a3df7080 P 11b6e81238e74ac9a19fa102021ec3b3: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:02:07.346382 12238 tablet_bootstrap.cc:492] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3: Bootstrap starting.
I20260709 13:02:07.345841 12234 raft_consensus.cc:359] T 158dbd8d299848848d9d949e89ade205 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.347972 12243 raft_consensus.cc:493] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.348589 12243 raft_consensus.cc:515] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.347368 12234 raft_consensus.cc:385] T 158dbd8d299848848d9d949e89ade205 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.350791 12234 raft_consensus.cc:740] T 158dbd8d299848848d9d949e89ade205 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 981b6c7cf04e4f12bd645a47411fc341, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.351526 12234 consensus_queue.cc:260] T 158dbd8d299848848d9d949e89ade205 P 981b6c7cf04e4f12bd645a47411fc341 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.353637 12234 ts_tablet_manager.cc:1434] T 158dbd8d299848848d9d949e89ade205 P 981b6c7cf04e4f12bd645a47411fc341: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:02:07.353974 12238 tablet_bootstrap.cc:654] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.354614 12234 tablet_bootstrap.cc:492] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341: Bootstrap starting.
I20260709 13:02:07.356653 12243 leader_election.cc:290] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195:40471)
I20260709 13:02:07.360803 12234 tablet_bootstrap.cc:654] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.365618 12238 tablet_bootstrap.cc:492] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3: No bootstrap required, opened a new log
I20260709 13:02:07.366289 12238 ts_tablet_manager.cc:1403] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 13:02:07.369446 12238 raft_consensus.cc:359] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.370366 12238 raft_consensus.cc:385] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.370741 12238 raft_consensus.cc:740] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11b6e81238e74ac9a19fa102021ec3b3, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.371645 12238 consensus_queue.cc:260] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.374082 12238 ts_tablet_manager.cc:1434] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:07.378664 12238 tablet_bootstrap.cc:492] T 4b75f0d8243c43318c29f22313533f08 P 11b6e81238e74ac9a19fa102021ec3b3: Bootstrap starting.
I20260709 13:02:07.378702 12045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158dbd8d299848848d9d949e89ade205" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "614235125ef247d9bda52a3accb0cfb7" is_pre_election: true
I20260709 13:02:07.379155 12234 tablet_bootstrap.cc:492] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341: No bootstrap required, opened a new log
I20260709 13:02:07.379765 12234 ts_tablet_manager.cc:1403] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.008s
W20260709 13:02:07.380571 12085 leader_election.cc:343] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.383035 12239 tablet_bootstrap.cc:492] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7: No bootstrap required, opened a new log
I20260709 13:02:07.382691 12234 raft_consensus.cc:359] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.383486 12234 raft_consensus.cc:385] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.383622 12239 ts_tablet_manager.cc:1403] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7: Time spent bootstrapping tablet: real 0.056s	user 0.017s	sys 0.004s
I20260709 13:02:07.383773 12234 raft_consensus.cc:740] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 981b6c7cf04e4f12bd645a47411fc341, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.384763 12234 consensus_queue.cc:260] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.385737 12238 tablet_bootstrap.cc:654] T 4b75f0d8243c43318c29f22313533f08 P 11b6e81238e74ac9a19fa102021ec3b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.387238 12239 raft_consensus.cc:359] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.388094 12239 raft_consensus.cc:385] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.388461 12239 raft_consensus.cc:740] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 614235125ef247d9bda52a3accb0cfb7, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.389137 12234 ts_tablet_manager.cc:1434] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:02:07.389415 12239 consensus_queue.cc:260] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.390353 12234 tablet_bootstrap.cc:492] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341: Bootstrap starting.
I20260709 13:02:07.391786 12239 ts_tablet_manager.cc:1434] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:02:07.393028 12239 tablet_bootstrap.cc:492] T 158dbd8d299848848d9d949e89ade205 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap starting.
I20260709 13:02:07.396951 12234 tablet_bootstrap.cc:654] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.408555 12194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158dbd8d299848848d9d949e89ade205" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "981b6c7cf04e4f12bd645a47411fc341" is_pre_election: true
I20260709 13:02:07.409533 12194 raft_consensus.cc:2468] T 158dbd8d299848848d9d949e89ade205 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11b6e81238e74ac9a19fa102021ec3b3 in term 0.
I20260709 13:02:07.408874 12243 raft_consensus.cc:493] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.410571 12239 tablet_bootstrap.cc:654] T 158dbd8d299848848d9d949e89ade205 P 614235125ef247d9bda52a3accb0cfb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.410848 12243 raft_consensus.cc:515] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.413331 12243 leader_election.cc:290] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195:40471)
I20260709 13:02:07.415548 12045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d14cd6559d347979cf41da97a2533b4" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "614235125ef247d9bda52a3accb0cfb7" is_pre_election: true
I20260709 13:02:07.416440 12045 raft_consensus.cc:2468] T 8d14cd6559d347979cf41da97a2533b4 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11b6e81238e74ac9a19fa102021ec3b3 in term 0.
I20260709 13:02:07.418365 12244 raft_consensus.cc:493] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.419014 12244 raft_consensus.cc:515] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.421396 12085 leader_election.cc:304] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3, 981b6c7cf04e4f12bd645a47411fc341; no voters: 614235125ef247d9bda52a3accb0cfb7
I20260709 13:02:07.423041 12085 leader_election.cc:304] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3, 614235125ef247d9bda52a3accb0cfb7; no voters: 
I20260709 13:02:07.424445 12239 tablet_bootstrap.cc:492] T 158dbd8d299848848d9d949e89ade205 P 614235125ef247d9bda52a3accb0cfb7: No bootstrap required, opened a new log
I20260709 13:02:07.425056 12239 ts_tablet_manager.cc:1403] T 158dbd8d299848848d9d949e89ade205 P 614235125ef247d9bda52a3accb0cfb7: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.006s
I20260709 13:02:07.429399 12239 raft_consensus.cc:359] T 158dbd8d299848848d9d949e89ade205 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.430172 12236 raft_consensus.cc:493] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.430804 12236 raft_consensus.cc:515] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.431984 12194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d14cd6559d347979cf41da97a2533b4" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "981b6c7cf04e4f12bd645a47411fc341" is_pre_election: true
I20260709 13:02:07.433364 12236 leader_election.cc:290] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117)
I20260709 13:02:07.435055 12120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d14cd6559d347979cf41da97a2533b4" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3" is_pre_election: true
I20260709 13:02:07.430248 12239 raft_consensus.cc:385] T 158dbd8d299848848d9d949e89ade205 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.435964 12120 raft_consensus.cc:2468] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 981b6c7cf04e4f12bd645a47411fc341 in term 0.
I20260709 13:02:07.436233 12239 raft_consensus.cc:740] T 158dbd8d299848848d9d949e89ade205 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 614235125ef247d9bda52a3accb0cfb7, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.437752 12239 consensus_queue.cc:260] T 158dbd8d299848848d9d949e89ade205 P 614235125ef247d9bda52a3accb0cfb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.438093 12160 leader_election.cc:304] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3, 981b6c7cf04e4f12bd645a47411fc341; no voters: 
I20260709 13:02:07.433313 12268 raft_consensus.cc:2804] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.439199 12268 raft_consensus.cc:493] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.439721 12268 raft_consensus.cc:3060] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.439962 12045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d14cd6559d347979cf41da97a2533b4" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "614235125ef247d9bda52a3accb0cfb7" is_pre_election: true
I20260709 13:02:07.440821 12045 raft_consensus.cc:2468] T 8d14cd6559d347979cf41da97a2533b4 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 981b6c7cf04e4f12bd645a47411fc341 in term 0.
I20260709 13:02:07.443033 12243 raft_consensus.cc:2804] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.443691 12243 raft_consensus.cc:493] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.444018 12238 tablet_bootstrap.cc:492] T 4b75f0d8243c43318c29f22313533f08 P 11b6e81238e74ac9a19fa102021ec3b3: No bootstrap required, opened a new log
I20260709 13:02:07.444628 12194 raft_consensus.cc:2468] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11b6e81238e74ac9a19fa102021ec3b3 in term 0.
I20260709 13:02:07.445391 12236 raft_consensus.cc:2804] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.448035 12236 raft_consensus.cc:493] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.448635 12244 leader_election.cc:290] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117), 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195:40471)
I20260709 13:02:07.450399 12236 raft_consensus.cc:3060] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.453754 12268 raft_consensus.cc:515] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.444173 12243 raft_consensus.cc:3060] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.457628 12045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158dbd8d299848848d9d949e89ade205" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "614235125ef247d9bda52a3accb0cfb7"
I20260709 13:02:07.458629 12045 raft_consensus.cc:3060] T 158dbd8d299848848d9d949e89ade205 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.444833 12238 ts_tablet_manager.cc:1403] T 4b75f0d8243c43318c29f22313533f08 P 11b6e81238e74ac9a19fa102021ec3b3: Time spent bootstrapping tablet: real 0.066s	user 0.028s	sys 0.016s
I20260709 13:02:07.462607 12238 raft_consensus.cc:359] T 4b75f0d8243c43318c29f22313533f08 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.463577 12238 raft_consensus.cc:385] T 4b75f0d8243c43318c29f22313533f08 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.463927 12238 raft_consensus.cc:740] T 4b75f0d8243c43318c29f22313533f08 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11b6e81238e74ac9a19fa102021ec3b3, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.464944 12238 consensus_queue.cc:260] T 4b75f0d8243c43318c29f22313533f08 P 11b6e81238e74ac9a19fa102021ec3b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.465973 12194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158dbd8d299848848d9d949e89ade205" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "981b6c7cf04e4f12bd645a47411fc341"
I20260709 13:02:07.466881 12194 raft_consensus.cc:3060] T 158dbd8d299848848d9d949e89ade205 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.472640 12268 leader_election.cc:290] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 1 election: Requested vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195:40471)
I20260709 13:02:07.458884 12236 raft_consensus.cc:515] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.481992 12044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d14cd6559d347979cf41da97a2533b4" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "614235125ef247d9bda52a3accb0cfb7"
I20260709 13:02:07.482854 12044 raft_consensus.cc:3060] T 8d14cd6559d347979cf41da97a2533b4 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.484251 12045 raft_consensus.cc:2468] T 158dbd8d299848848d9d949e89ade205 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11b6e81238e74ac9a19fa102021ec3b3 in term 1.
I20260709 13:02:07.475097 12234 tablet_bootstrap.cc:492] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341: No bootstrap required, opened a new log
I20260709 13:02:07.485248 12234 ts_tablet_manager.cc:1403] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341: Time spent bootstrapping tablet: real 0.095s	user 0.026s	sys 0.027s
I20260709 13:02:07.484690 12236 leader_election.cc:290] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 1 election: Requested vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117)
I20260709 13:02:07.487226 12236 raft_consensus.cc:493] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.487821 12236 raft_consensus.cc:515] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.490581 12194 raft_consensus.cc:2468] T 158dbd8d299848848d9d949e89ade205 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11b6e81238e74ac9a19fa102021ec3b3 in term 1.
I20260709 13:02:07.494967 12044 raft_consensus.cc:2468] T 8d14cd6559d347979cf41da97a2533b4 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 981b6c7cf04e4f12bd645a47411fc341 in term 1.
I20260709 13:02:07.498001 12159 leader_election.cc:304] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 614235125ef247d9bda52a3accb0cfb7, 981b6c7cf04e4f12bd645a47411fc341; no voters: 
I20260709 13:02:07.491235 12234 raft_consensus.cc:359] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.492676 12244 raft_consensus.cc:493] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.493112 12085 leader_election.cc:304] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3, 614235125ef247d9bda52a3accb0cfb7; no voters: 
I20260709 13:02:07.495262 12120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d14cd6559d347979cf41da97a2533b4" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3"
I20260709 13:02:07.492081 12238 ts_tablet_manager.cc:1434] T 4b75f0d8243c43318c29f22313533f08 P 11b6e81238e74ac9a19fa102021ec3b3: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.005s
I20260709 13:02:07.501097 12244 raft_consensus.cc:515] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.499619 12234 raft_consensus.cc:385] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.502507 12234 raft_consensus.cc:740] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 981b6c7cf04e4f12bd645a47411fc341, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.503463 12045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aac29d4192147aea2a627f525d88c7d" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "614235125ef247d9bda52a3accb0cfb7" is_pre_election: true
I20260709 13:02:07.504539 12045 raft_consensus.cc:2468] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 981b6c7cf04e4f12bd645a47411fc341 in term 0.
I20260709 13:02:07.505259 12238 tablet_bootstrap.cc:492] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3: Bootstrap starting.
I20260709 13:02:07.506372 12159 leader_election.cc:304] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 614235125ef247d9bda52a3accb0cfb7, 981b6c7cf04e4f12bd645a47411fc341; no voters: 
I20260709 13:02:07.503521 12234 consensus_queue.cc:260] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.499151 12272 raft_consensus.cc:2804] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:07.503554 12119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aac29d4192147aea2a627f525d88c7d" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3" is_pre_election: true
I20260709 13:02:07.510677 12119 raft_consensus.cc:2468] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 981b6c7cf04e4f12bd645a47411fc341 in term 0.
I20260709 13:02:07.503669 12236 leader_election.cc:290] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117)
I20260709 13:02:07.513279 12236 raft_consensus.cc:2804] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.515635 12236 raft_consensus.cc:493] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.517551 12244 leader_election.cc:290] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117), 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195:40471)
I20260709 13:02:07.518414 12236 raft_consensus.cc:3060] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.518438 12244 raft_consensus.cc:493] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.519767 12273 raft_consensus.cc:2804] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:07.523532 12118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f30ed75e9c4428fa5fc69291ccef018" candidate_uuid: "614235125ef247d9bda52a3accb0cfb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3" is_pre_election: true
I20260709 13:02:07.524094 12119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "472c5d72e71b465abdd55365c4f9bca4" candidate_uuid: "614235125ef247d9bda52a3accb0cfb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3" is_pre_election: true
I20260709 13:02:07.524888 12118 raft_consensus.cc:2468] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 614235125ef247d9bda52a3accb0cfb7 in term 0.
I20260709 13:02:07.525281 12273 raft_consensus.cc:697] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 LEADER]: Becoming Leader. State: Replica: 11b6e81238e74ac9a19fa102021ec3b3, State: Running, Role: LEADER
I20260709 13:02:07.526741 12273 consensus_queue.cc:237] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.528503 12244 raft_consensus.cc:515] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
W20260709 13:02:07.528869 12011 leader_election.cc:343] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.529134 12193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f30ed75e9c4428fa5fc69291ccef018" candidate_uuid: "614235125ef247d9bda52a3accb0cfb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "981b6c7cf04e4f12bd645a47411fc341" is_pre_election: true
I20260709 13:02:07.530346 12193 raft_consensus.cc:2468] T 3f30ed75e9c4428fa5fc69291ccef018 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 614235125ef247d9bda52a3accb0cfb7 in term 0.
I20260709 13:02:07.530500 12011 leader_election.cc:304] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3, 614235125ef247d9bda52a3accb0cfb7; no voters: 
I20260709 13:02:07.532594 12194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "472c5d72e71b465abdd55365c4f9bca4" candidate_uuid: "614235125ef247d9bda52a3accb0cfb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "981b6c7cf04e4f12bd645a47411fc341" is_pre_election: true
I20260709 13:02:07.533664 12118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b75f0d8243c43318c29f22313533f08" candidate_uuid: "614235125ef247d9bda52a3accb0cfb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3" is_pre_election: true
I20260709 13:02:07.534610 12118 raft_consensus.cc:2468] T 4b75f0d8243c43318c29f22313533f08 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 614235125ef247d9bda52a3accb0cfb7 in term 0.
I20260709 13:02:07.533730 12194 raft_consensus.cc:2468] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 614235125ef247d9bda52a3accb0cfb7 in term 0.
I20260709 13:02:07.523489 12243 raft_consensus.cc:515] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.538317 12011 leader_election.cc:304] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3, 614235125ef247d9bda52a3accb0cfb7; no voters: 
I20260709 13:02:07.539969 12010 leader_election.cc:304] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 614235125ef247d9bda52a3accb0cfb7, 981b6c7cf04e4f12bd645a47411fc341; no voters: 11b6e81238e74ac9a19fa102021ec3b3
I20260709 13:02:07.542899 12120 raft_consensus.cc:2393] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 981b6c7cf04e4f12bd645a47411fc341 in current term 1: Already voted for candidate 11b6e81238e74ac9a19fa102021ec3b3 in this term.
I20260709 13:02:07.543273 12277 raft_consensus.cc:2804] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.543951 12277 raft_consensus.cc:493] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.538837 12244 leader_election.cc:290] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117), 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195:40471)
I20260709 13:02:07.545511 12239 ts_tablet_manager.cc:1434] T 158dbd8d299848848d9d949e89ade205 P 614235125ef247d9bda52a3accb0cfb7: Time spent starting tablet: real 0.119s	user 0.051s	sys 0.050s
I20260709 13:02:07.546016 12244 raft_consensus.cc:2804] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.546545 12244 raft_consensus.cc:493] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.547031 12244 raft_consensus.cc:3060] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.550566 12194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d14cd6559d347979cf41da97a2533b4" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "981b6c7cf04e4f12bd645a47411fc341"
I20260709 13:02:07.552276 12044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d14cd6559d347979cf41da97a2533b4" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "614235125ef247d9bda52a3accb0cfb7"
I20260709 13:02:07.552794 12274 raft_consensus.cc:493] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.554708 12243 leader_election.cc:290] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 1 election: Requested vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195:40471)
I20260709 13:02:07.546439 12234 ts_tablet_manager.cc:1434] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341: Time spent starting tablet: real 0.061s	user 0.010s	sys 0.005s
I20260709 13:02:07.554229 12044 raft_consensus.cc:2393] T 8d14cd6559d347979cf41da97a2533b4 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 11b6e81238e74ac9a19fa102021ec3b3 in current term 1: Already voted for candidate 981b6c7cf04e4f12bd645a47411fc341 in this term.
I20260709 13:02:07.555444 12272 raft_consensus.cc:697] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 LEADER]: Becoming Leader. State: Replica: 981b6c7cf04e4f12bd645a47411fc341, State: Running, Role: LEADER
I20260709 13:02:07.554550 12274 raft_consensus.cc:515] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.556097 12239 tablet_bootstrap.cc:492] T ce79da57b33749a9be411c92b0178103 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap starting.
I20260709 13:02:07.556399 12272 consensus_queue.cc:237] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.545562 12271 raft_consensus.cc:2804] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.559834 12271 raft_consensus.cc:493] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.560165 12271 raft_consensus.cc:3060] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.544404 12277 raft_consensus.cc:3060] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.557734 12238 tablet_bootstrap.cc:654] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.567047 12193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b75f0d8243c43318c29f22313533f08" candidate_uuid: "614235125ef247d9bda52a3accb0cfb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "981b6c7cf04e4f12bd645a47411fc341" is_pre_election: true
I20260709 13:02:07.568008 12193 raft_consensus.cc:2468] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 614235125ef247d9bda52a3accb0cfb7 in term 0.
I20260709 13:02:07.569945 11940 catalog_manager.cc:5697] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "11b6e81238e74ac9a19fa102021ec3b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.573516 12274 leader_election.cc:290] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117)
I20260709 13:02:07.566984 12044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec90b937044a22908ba572a3df7080" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "614235125ef247d9bda52a3accb0cfb7" is_pre_election: true
I20260709 13:02:07.574188 12120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec90b937044a22908ba572a3df7080" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3" is_pre_election: true
I20260709 13:02:07.574915 12120 raft_consensus.cc:2468] T 77ec90b937044a22908ba572a3df7080 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 981b6c7cf04e4f12bd645a47411fc341 in term 0.
W20260709 13:02:07.575568 12159 leader_election.cc:343] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.575839 12239 tablet_bootstrap.cc:654] T ce79da57b33749a9be411c92b0178103 P 614235125ef247d9bda52a3accb0cfb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.576308 12160 leader_election.cc:304] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3, 981b6c7cf04e4f12bd645a47411fc341; no voters: 614235125ef247d9bda52a3accb0cfb7
I20260709 13:02:07.577580 12274 raft_consensus.cc:2804] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.578025 12274 raft_consensus.cc:493] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.573400 12236 raft_consensus.cc:515] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.578428 12274 raft_consensus.cc:3060] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.578080 12244 raft_consensus.cc:515] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.586890 12120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "472c5d72e71b465abdd55365c4f9bca4" candidate_uuid: "614235125ef247d9bda52a3accb0cfb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3"
W20260709 13:02:07.588393 12011 leader_election.cc:343] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.590025 12236 leader_election.cc:290] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 1 election: Requested vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117)
I20260709 13:02:07.590353 12244 leader_election.cc:290] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [CANDIDATE]: Term 1 election: Requested vote from peers 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117), 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195:40471)
I20260709 13:02:07.592768 12274 raft_consensus.cc:515] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.592948 12085 leader_election.cc:304] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3; no voters: 614235125ef247d9bda52a3accb0cfb7, 981b6c7cf04e4f12bd645a47411fc341
I20260709 13:02:07.594587 12120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aac29d4192147aea2a627f525d88c7d" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3"
I20260709 13:02:07.594588 12044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aac29d4192147aea2a627f525d88c7d" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "614235125ef247d9bda52a3accb0cfb7"
I20260709 13:02:07.595436 12044 raft_consensus.cc:3060] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.595863 12194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "472c5d72e71b465abdd55365c4f9bca4" candidate_uuid: "614235125ef247d9bda52a3accb0cfb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "981b6c7cf04e4f12bd645a47411fc341"
I20260709 13:02:07.596448 12194 raft_consensus.cc:3060] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.596561 12274 leader_election.cc:290] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 1 election: Requested vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117)
I20260709 13:02:07.597378 12045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec90b937044a22908ba572a3df7080" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "614235125ef247d9bda52a3accb0cfb7"
W20260709 13:02:07.598640 12159 leader_election.cc:343] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.599152 12118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec90b937044a22908ba572a3df7080" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3"
I20260709 13:02:07.599339 12277 raft_consensus.cc:515] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.599798 12118 raft_consensus.cc:3060] T 77ec90b937044a22908ba572a3df7080 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.602891 12277 leader_election.cc:290] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7 [CANDIDATE]: Term 1 election: Requested vote from peers 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117), 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195:40471)
I20260709 13:02:07.595281 12120 raft_consensus.cc:3060] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.603114 12193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f30ed75e9c4428fa5fc69291ccef018" candidate_uuid: "614235125ef247d9bda52a3accb0cfb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "981b6c7cf04e4f12bd645a47411fc341"
I20260709 13:02:07.603777 12193 raft_consensus.cc:3060] T 3f30ed75e9c4428fa5fc69291ccef018 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.603960 12044 raft_consensus.cc:2468] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 981b6c7cf04e4f12bd645a47411fc341 in term 1.
I20260709 13:02:07.604423 12119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f30ed75e9c4428fa5fc69291ccef018" candidate_uuid: "614235125ef247d9bda52a3accb0cfb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3"
I20260709 13:02:07.605084 12119 raft_consensus.cc:3060] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.605221 12273 raft_consensus.cc:2749] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:07.592079 11941 catalog_manager.cc:5697] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 reported cstate change: term changed from 0 to 1, leader changed from <none> to 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "981b6c7cf04e4f12bd645a47411fc341" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:07.610154 12271 raft_consensus.cc:515] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.613081 12118 raft_consensus.cc:2468] T 77ec90b937044a22908ba572a3df7080 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 981b6c7cf04e4f12bd645a47411fc341 in term 1.
I20260709 13:02:07.615145 12160 leader_election.cc:304] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3, 981b6c7cf04e4f12bd645a47411fc341; no voters: 614235125ef247d9bda52a3accb0cfb7
I20260709 13:02:07.616943 12117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b75f0d8243c43318c29f22313533f08" candidate_uuid: "614235125ef247d9bda52a3accb0cfb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3"
I20260709 13:02:07.616122 12120 raft_consensus.cc:2468] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 981b6c7cf04e4f12bd645a47411fc341 in term 1.
I20260709 13:02:07.618844 12160 leader_election.cc:304] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3, 981b6c7cf04e4f12bd645a47411fc341; no voters: 
I20260709 13:02:07.619809 12274 raft_consensus.cc:2804] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:07.617825 12117 raft_consensus.cc:3060] T 4b75f0d8243c43318c29f22313533f08 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.621270 12239 tablet_bootstrap.cc:492] T ce79da57b33749a9be411c92b0178103 P 614235125ef247d9bda52a3accb0cfb7: No bootstrap required, opened a new log
I20260709 13:02:07.621690 12194 raft_consensus.cc:2468] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 614235125ef247d9bda52a3accb0cfb7 in term 1.
I20260709 13:02:07.622270 12236 raft_consensus.cc:2804] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:07.622975 12010 leader_election.cc:304] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 614235125ef247d9bda52a3accb0cfb7, 981b6c7cf04e4f12bd645a47411fc341; no voters: 11b6e81238e74ac9a19fa102021ec3b3
I20260709 13:02:07.623126 12236 raft_consensus.cc:697] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 LEADER]: Becoming Leader. State: Replica: 981b6c7cf04e4f12bd645a47411fc341, State: Running, Role: LEADER
I20260709 13:02:07.624194 12119 raft_consensus.cc:2468] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 614235125ef247d9bda52a3accb0cfb7 in term 1.
I20260709 13:02:07.624775 12236 consensus_queue.cc:237] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.626330 12193 raft_consensus.cc:2468] T 3f30ed75e9c4428fa5fc69291ccef018 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 614235125ef247d9bda52a3accb0cfb7 in term 1.
I20260709 13:02:07.621852 12239 ts_tablet_manager.cc:1403] T ce79da57b33749a9be411c92b0178103 P 614235125ef247d9bda52a3accb0cfb7: Time spent bootstrapping tablet: real 0.066s	user 0.018s	sys 0.008s
I20260709 13:02:07.628156 12011 leader_election.cc:304] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3, 614235125ef247d9bda52a3accb0cfb7; no voters: 
I20260709 13:02:07.629007 12244 raft_consensus.cc:2804] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:07.629400 12271 leader_election.cc:290] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7 [CANDIDATE]: Term 1 election: Requested vote from peers 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117), 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195:40471)
I20260709 13:02:07.631081 12279 raft_consensus.cc:493] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.631865 12279 raft_consensus.cc:515] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.633122 12239 raft_consensus.cc:359] T ce79da57b33749a9be411c92b0178103 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } }
I20260709 13:02:07.633808 12239 raft_consensus.cc:385] T ce79da57b33749a9be411c92b0178103 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.634019 12239 raft_consensus.cc:740] T ce79da57b33749a9be411c92b0178103 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 614235125ef247d9bda52a3accb0cfb7, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.635883 12277 raft_consensus.cc:2804] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:07.635728 12239 consensus_queue.cc:260] T ce79da57b33749a9be411c92b0178103 P 614235125ef247d9bda52a3accb0cfb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } }
I20260709 13:02:07.636435 12277 raft_consensus.cc:697] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7 [term 1 LEADER]: Becoming Leader. State: Replica: 614235125ef247d9bda52a3accb0cfb7, State: Running, Role: LEADER
I20260709 13:02:07.638615 12193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f2bca87d394ebdae299b722de75c9b" candidate_uuid: "614235125ef247d9bda52a3accb0cfb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "981b6c7cf04e4f12bd645a47411fc341" is_pre_election: true
I20260709 13:02:07.638823 12194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b75f0d8243c43318c29f22313533f08" candidate_uuid: "614235125ef247d9bda52a3accb0cfb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "981b6c7cf04e4f12bd645a47411fc341"
I20260709 13:02:07.638470 12277 consensus_queue.cc:237] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.639127 12119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f2bca87d394ebdae299b722de75c9b" candidate_uuid: "614235125ef247d9bda52a3accb0cfb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3" is_pre_election: true
I20260709 13:02:07.628518 12274 raft_consensus.cc:697] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [term 1 LEADER]: Becoming Leader. State: Replica: 981b6c7cf04e4f12bd645a47411fc341, State: Running, Role: LEADER
I20260709 13:02:07.639359 12193 raft_consensus.cc:2468] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 614235125ef247d9bda52a3accb0cfb7 in term 0.
I20260709 13:02:07.639453 12194 raft_consensus.cc:3060] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.636132 12279 leader_election.cc:290] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117), 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195:40471)
I20260709 13:02:07.640321 12274 consensus_queue.cc:237] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
W20260709 13:02:07.640705 12011 leader_election.cc:343] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.643885 12117 raft_consensus.cc:2468] T 4b75f0d8243c43318c29f22313533f08 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 614235125ef247d9bda52a3accb0cfb7 in term 1.
I20260709 13:02:07.645568 12010 leader_election.cc:304] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 614235125ef247d9bda52a3accb0cfb7, 981b6c7cf04e4f12bd645a47411fc341; no voters: 11b6e81238e74ac9a19fa102021ec3b3
I20260709 13:02:07.646564 12279 raft_consensus.cc:2804] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.646957 12279 raft_consensus.cc:493] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.647293 12279 raft_consensus.cc:3060] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.648227 12194 raft_consensus.cc:2468] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 614235125ef247d9bda52a3accb0cfb7 in term 1.
I20260709 13:02:07.649194 12244 raft_consensus.cc:697] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [term 1 LEADER]: Becoming Leader. State: Replica: 614235125ef247d9bda52a3accb0cfb7, State: Running, Role: LEADER
I20260709 13:02:07.649636 12238 tablet_bootstrap.cc:492] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3: No bootstrap required, opened a new log
I20260709 13:02:07.650318 12238 ts_tablet_manager.cc:1403] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3: Time spent bootstrapping tablet: real 0.145s	user 0.015s	sys 0.021s
I20260709 13:02:07.650202 12244 consensus_queue.cc:237] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.649677 12010 leader_election.cc:304] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 614235125ef247d9bda52a3accb0cfb7, 981b6c7cf04e4f12bd645a47411fc341; no voters: 
I20260709 13:02:07.656751 12279 raft_consensus.cc:515] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.659916 12279 leader_election.cc:290] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [CANDIDATE]: Term 1 election: Requested vote from peers 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117), 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195:40471)
I20260709 13:02:07.660735 12279 raft_consensus.cc:2804] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:07.661327 12279 raft_consensus.cc:697] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7 [term 1 LEADER]: Becoming Leader. State: Replica: 614235125ef247d9bda52a3accb0cfb7, State: Running, Role: LEADER
I20260709 13:02:07.662315 12279 consensus_queue.cc:237] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.662740 12238 raft_consensus.cc:359] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.663596 12238 raft_consensus.cc:385] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.663910 12238 raft_consensus.cc:740] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11b6e81238e74ac9a19fa102021ec3b3, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.664914 12117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f2bca87d394ebdae299b722de75c9b" candidate_uuid: "614235125ef247d9bda52a3accb0cfb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3"
W20260709 13:02:07.666564 12011 leader_election.cc:343] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.667769 12194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f2bca87d394ebdae299b722de75c9b" candidate_uuid: "614235125ef247d9bda52a3accb0cfb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "981b6c7cf04e4f12bd645a47411fc341"
I20260709 13:02:07.668634 12194 raft_consensus.cc:3060] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.672783 12238 consensus_queue.cc:260] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.673977 11942 catalog_manager.cc:5697] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "614235125ef247d9bda52a3accb0cfb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.675190 12238 ts_tablet_manager.cc:1434] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 13:02:07.676359 12238 tablet_bootstrap.cc:492] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3: Bootstrap starting.
I20260709 13:02:07.681478 12194 raft_consensus.cc:2468] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 614235125ef247d9bda52a3accb0cfb7 in term 1.
I20260709 13:02:07.682111 12238 tablet_bootstrap.cc:654] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.682819 12010 leader_election.cc:304] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 614235125ef247d9bda52a3accb0cfb7, 981b6c7cf04e4f12bd645a47411fc341; no voters: 11b6e81238e74ac9a19fa102021ec3b3
I20260709 13:02:07.684247 12244 raft_consensus.cc:2804] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:07.684820 12244 raft_consensus.cc:697] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [term 1 LEADER]: Becoming Leader. State: Replica: 614235125ef247d9bda52a3accb0cfb7, State: Running, Role: LEADER
I20260709 13:02:07.685738 12244 consensus_queue.cc:237] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.693876 12239 ts_tablet_manager.cc:1434] T ce79da57b33749a9be411c92b0178103 P 614235125ef247d9bda52a3accb0cfb7: Time spent starting tablet: real 0.064s	user 0.011s	sys 0.000s
I20260709 13:02:07.695335 12239 tablet_bootstrap.cc:492] T 77ec90b937044a22908ba572a3df7080 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap starting.
I20260709 13:02:07.697827 12238 tablet_bootstrap.cc:492] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3: No bootstrap required, opened a new log
I20260709 13:02:07.698401 12238 ts_tablet_manager.cc:1403] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:02:07.700403 12239 tablet_bootstrap.cc:654] T 77ec90b937044a22908ba572a3df7080 P 614235125ef247d9bda52a3accb0cfb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.701169 12238 raft_consensus.cc:359] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.702162 12238 raft_consensus.cc:385] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.702450 12238 raft_consensus.cc:740] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11b6e81238e74ac9a19fa102021ec3b3, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.703272 12238 consensus_queue.cc:260] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.705722 12238 ts_tablet_manager.cc:1434] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:07.706805 12238 tablet_bootstrap.cc:492] T 3768bc61992440faa9ef167f5f395162 P 11b6e81238e74ac9a19fa102021ec3b3: Bootstrap starting.
I20260709 13:02:07.712921 12238 tablet_bootstrap.cc:654] T 3768bc61992440faa9ef167f5f395162 P 11b6e81238e74ac9a19fa102021ec3b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.719311 12238 tablet_bootstrap.cc:492] T 3768bc61992440faa9ef167f5f395162 P 11b6e81238e74ac9a19fa102021ec3b3: No bootstrap required, opened a new log
I20260709 13:02:07.719825 12238 ts_tablet_manager.cc:1403] T 3768bc61992440faa9ef167f5f395162 P 11b6e81238e74ac9a19fa102021ec3b3: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.003s
I20260709 13:02:07.722000 12238 raft_consensus.cc:359] T 3768bc61992440faa9ef167f5f395162 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.722652 12238 raft_consensus.cc:385] T 3768bc61992440faa9ef167f5f395162 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.722904 12238 raft_consensus.cc:740] T 3768bc61992440faa9ef167f5f395162 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11b6e81238e74ac9a19fa102021ec3b3, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.723662 12238 consensus_queue.cc:260] T 3768bc61992440faa9ef167f5f395162 P 11b6e81238e74ac9a19fa102021ec3b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.725921 12238 ts_tablet_manager.cc:1434] T 3768bc61992440faa9ef167f5f395162 P 11b6e81238e74ac9a19fa102021ec3b3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:02:07.728410 11940 catalog_manager.cc:5697] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341 reported cstate change: term changed from 0 to 1, leader changed from <none> to 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "981b6c7cf04e4f12bd645a47411fc341" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:07.729408 12239 tablet_bootstrap.cc:492] T 77ec90b937044a22908ba572a3df7080 P 614235125ef247d9bda52a3accb0cfb7: No bootstrap required, opened a new log
I20260709 13:02:07.730053 12239 ts_tablet_manager.cc:1403] T 77ec90b937044a22908ba572a3df7080 P 614235125ef247d9bda52a3accb0cfb7: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.005s
I20260709 13:02:07.730422 11940 catalog_manager.cc:5697] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 reported cstate change: term changed from 0 to 1, leader changed from <none> to 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "981b6c7cf04e4f12bd645a47411fc341" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:07.732061 12273 raft_consensus.cc:493] T ce79da57b33749a9be411c92b0178103 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.732652 12273 raft_consensus.cc:515] T ce79da57b33749a9be411c92b0178103 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } }
I20260709 13:02:07.734733 12273 leader_election.cc:290] T ce79da57b33749a9be411c92b0178103 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195:40471), 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599)
I20260709 13:02:07.735790 12044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce79da57b33749a9be411c92b0178103" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "614235125ef247d9bda52a3accb0cfb7" is_pre_election: true
I20260709 13:02:07.735814 12194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce79da57b33749a9be411c92b0178103" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "981b6c7cf04e4f12bd645a47411fc341" is_pre_election: true
I20260709 13:02:07.736714 12194 raft_consensus.cc:2468] T ce79da57b33749a9be411c92b0178103 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11b6e81238e74ac9a19fa102021ec3b3 in term 0.
I20260709 13:02:07.736552 12239 raft_consensus.cc:359] T 77ec90b937044a22908ba572a3df7080 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.737366 12239 raft_consensus.cc:385] T 77ec90b937044a22908ba572a3df7080 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.737682 12239 raft_consensus.cc:740] T 77ec90b937044a22908ba572a3df7080 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 614235125ef247d9bda52a3accb0cfb7, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.738276 12085 leader_election.cc:304] T ce79da57b33749a9be411c92b0178103 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3, 981b6c7cf04e4f12bd645a47411fc341; no voters: 
I20260709 13:02:07.738401 12239 consensus_queue.cc:260] T 77ec90b937044a22908ba572a3df7080 P 614235125ef247d9bda52a3accb0cfb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.739590 12273 raft_consensus.cc:2804] T ce79da57b33749a9be411c92b0178103 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.740067 12273 raft_consensus.cc:493] T ce79da57b33749a9be411c92b0178103 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.740324 12044 raft_consensus.cc:2468] T ce79da57b33749a9be411c92b0178103 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11b6e81238e74ac9a19fa102021ec3b3 in term 0.
I20260709 13:02:07.740530 12239 ts_tablet_manager.cc:1434] T 77ec90b937044a22908ba572a3df7080 P 614235125ef247d9bda52a3accb0cfb7: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:02:07.740485 12273 raft_consensus.cc:3060] T ce79da57b33749a9be411c92b0178103 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.741621 12239 tablet_bootstrap.cc:492] T 3768bc61992440faa9ef167f5f395162 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap starting.
I20260709 13:02:07.742383 11942 catalog_manager.cc:5697] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "614235125ef247d9bda52a3accb0cfb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.744227 11942 catalog_manager.cc:5697] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "614235125ef247d9bda52a3accb0cfb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.747686 12239 tablet_bootstrap.cc:654] T 3768bc61992440faa9ef167f5f395162 P 614235125ef247d9bda52a3accb0cfb7: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.748106 11942 catalog_manager.cc:5697] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "614235125ef247d9bda52a3accb0cfb7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.750043 12273 raft_consensus.cc:515] T ce79da57b33749a9be411c92b0178103 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } }
I20260709 13:02:07.752290 12273 leader_election.cc:290] T ce79da57b33749a9be411c92b0178103 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 1 election: Requested vote from peers 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195:40471), 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599)
I20260709 13:02:07.753441 12194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce79da57b33749a9be411c92b0178103" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "981b6c7cf04e4f12bd645a47411fc341"
I20260709 13:02:07.754130 12194 raft_consensus.cc:3060] T ce79da57b33749a9be411c92b0178103 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.754040 12044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce79da57b33749a9be411c92b0178103" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "614235125ef247d9bda52a3accb0cfb7"
I20260709 13:02:07.754936 12044 raft_consensus.cc:3060] T ce79da57b33749a9be411c92b0178103 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.755640 12239 tablet_bootstrap.cc:492] T 3768bc61992440faa9ef167f5f395162 P 614235125ef247d9bda52a3accb0cfb7: No bootstrap required, opened a new log
I20260709 13:02:07.756211 12239 ts_tablet_manager.cc:1403] T 3768bc61992440faa9ef167f5f395162 P 614235125ef247d9bda52a3accb0cfb7: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:02:07.759052 12239 raft_consensus.cc:359] T 3768bc61992440faa9ef167f5f395162 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.759845 12239 raft_consensus.cc:385] T 3768bc61992440faa9ef167f5f395162 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.760159 12239 raft_consensus.cc:740] T 3768bc61992440faa9ef167f5f395162 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 614235125ef247d9bda52a3accb0cfb7, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.760910 12239 consensus_queue.cc:260] T 3768bc61992440faa9ef167f5f395162 P 614235125ef247d9bda52a3accb0cfb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.762148 12194 raft_consensus.cc:2468] T ce79da57b33749a9be411c92b0178103 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11b6e81238e74ac9a19fa102021ec3b3 in term 1.
I20260709 13:02:07.763396 12239 ts_tablet_manager.cc:1434] T 3768bc61992440faa9ef167f5f395162 P 614235125ef247d9bda52a3accb0cfb7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:07.763536 12085 leader_election.cc:304] T ce79da57b33749a9be411c92b0178103 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3, 981b6c7cf04e4f12bd645a47411fc341; no voters: 
I20260709 13:02:07.764452 12273 raft_consensus.cc:2804] T ce79da57b33749a9be411c92b0178103 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:07.764775 12044 raft_consensus.cc:2468] T ce79da57b33749a9be411c92b0178103 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11b6e81238e74ac9a19fa102021ec3b3 in term 1.
I20260709 13:02:07.764947 12273 raft_consensus.cc:697] T ce79da57b33749a9be411c92b0178103 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 LEADER]: Becoming Leader. State: Replica: 11b6e81238e74ac9a19fa102021ec3b3, State: Running, Role: LEADER
I20260709 13:02:07.765933 12273 consensus_queue.cc:237] T ce79da57b33749a9be411c92b0178103 P 11b6e81238e74ac9a19fa102021ec3b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } }
I20260709 13:02:07.774057 11942 catalog_manager.cc:5697] T ce79da57b33749a9be411c92b0178103 P 11b6e81238e74ac9a19fa102021ec3b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "11b6e81238e74ac9a19fa102021ec3b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.837838 12274 raft_consensus.cc:493] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.838397 12274 raft_consensus.cc:515] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.840269 12274 leader_election.cc:290] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117)
I20260709 13:02:07.841048 12044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3768bc61992440faa9ef167f5f395162" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "614235125ef247d9bda52a3accb0cfb7" is_pre_election: true
I20260709 13:02:07.841269 12117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3768bc61992440faa9ef167f5f395162" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3" is_pre_election: true
I20260709 13:02:07.841646 12044 raft_consensus.cc:2468] T 3768bc61992440faa9ef167f5f395162 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 981b6c7cf04e4f12bd645a47411fc341 in term 0.
I20260709 13:02:07.841881 12117 raft_consensus.cc:2468] T 3768bc61992440faa9ef167f5f395162 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 981b6c7cf04e4f12bd645a47411fc341 in term 0.
I20260709 13:02:07.842650 12159 leader_election.cc:304] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 614235125ef247d9bda52a3accb0cfb7, 981b6c7cf04e4f12bd645a47411fc341; no voters: 
I20260709 13:02:07.843325 12274 raft_consensus.cc:2804] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.843722 12274 raft_consensus.cc:493] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.843958 12274 raft_consensus.cc:3060] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.848940 12274 raft_consensus.cc:515] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.850587 12274 leader_election.cc:290] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 1 election: Requested vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117)
I20260709 13:02:07.851348 12044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3768bc61992440faa9ef167f5f395162" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "614235125ef247d9bda52a3accb0cfb7"
I20260709 13:02:07.851671 12117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3768bc61992440faa9ef167f5f395162" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3"
I20260709 13:02:07.852037 12044 raft_consensus.cc:3060] T 3768bc61992440faa9ef167f5f395162 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.852223 12117 raft_consensus.cc:3060] T 3768bc61992440faa9ef167f5f395162 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.859470 12044 raft_consensus.cc:2468] T 3768bc61992440faa9ef167f5f395162 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 981b6c7cf04e4f12bd645a47411fc341 in term 1.
I20260709 13:02:07.859470 12117 raft_consensus.cc:2468] T 3768bc61992440faa9ef167f5f395162 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 981b6c7cf04e4f12bd645a47411fc341 in term 1.
I20260709 13:02:07.860790 12160 leader_election.cc:304] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3, 981b6c7cf04e4f12bd645a47411fc341; no voters: 
I20260709 13:02:07.861460 12274 raft_consensus.cc:2804] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:07.861905 12274 raft_consensus.cc:697] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 LEADER]: Becoming Leader. State: Replica: 981b6c7cf04e4f12bd645a47411fc341, State: Running, Role: LEADER
I20260709 13:02:07.862643 12274 consensus_queue.cc:237] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:07.869799 11942 catalog_manager.cc:5697] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 reported cstate change: term changed from 0 to 1, leader changed from <none> to 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "981b6c7cf04e4f12bd645a47411fc341" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:07.994719 12273 consensus_queue.cc:1048] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:08.006753 12243 consensus_queue.cc:1048] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:08.023883 12243 raft_consensus.cc:493] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.024401 12243 raft_consensus.cc:515] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:08.026460 12243 leader_election.cc:290] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195:40471)
I20260709 13:02:08.027256 12044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f2bca87d394ebdae299b722de75c9b" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "614235125ef247d9bda52a3accb0cfb7" is_pre_election: true
I20260709 13:02:08.027468 12194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f2bca87d394ebdae299b722de75c9b" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "981b6c7cf04e4f12bd645a47411fc341" is_pre_election: true
I20260709 13:02:08.028285 12194 raft_consensus.cc:2393] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 11b6e81238e74ac9a19fa102021ec3b3 in current term 1: Already voted for candidate 614235125ef247d9bda52a3accb0cfb7 in this term.
I20260709 13:02:08.029114 12085 leader_election.cc:304] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3; no voters: 614235125ef247d9bda52a3accb0cfb7, 981b6c7cf04e4f12bd645a47411fc341
I20260709 13:02:08.029847 12243 raft_consensus.cc:3060] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.035176 12243 raft_consensus.cc:2749] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:08.042533 12244 consensus_queue.cc:1048] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:08.043627 12277 consensus_queue.cc:1048] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:08.046464 12277 raft_consensus.cc:493] T 77ec90b937044a22908ba572a3df7080 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.047114 12277 raft_consensus.cc:515] T 77ec90b937044a22908ba572a3df7080 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:08.048189 12274 consensus_queue.cc:1048] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:08.049480 12277 leader_election.cc:290] T 77ec90b937044a22908ba572a3df7080 P 614235125ef247d9bda52a3accb0cfb7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117), 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195:40471)
I20260709 13:02:08.053835 12119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec90b937044a22908ba572a3df7080" candidate_uuid: "614235125ef247d9bda52a3accb0cfb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3" is_pre_election: true
I20260709 13:02:08.054550 12119 raft_consensus.cc:2393] T 77ec90b937044a22908ba572a3df7080 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 614235125ef247d9bda52a3accb0cfb7 in current term 1: Already voted for candidate 981b6c7cf04e4f12bd645a47411fc341 in this term.
I20260709 13:02:08.057870   431 ts_manager.cc:295] Set tserver state for 614235125ef247d9bda52a3accb0cfb7 to MAINTENANCE_MODE
I20260709 13:02:08.058259 12193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ec90b937044a22908ba572a3df7080" candidate_uuid: "614235125ef247d9bda52a3accb0cfb7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "981b6c7cf04e4f12bd645a47411fc341" is_pre_election: true
I20260709 13:02:08.058779   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:02:08.059762 12010 leader_election.cc:304] T 77ec90b937044a22908ba572a3df7080 P 614235125ef247d9bda52a3accb0cfb7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 614235125ef247d9bda52a3accb0cfb7; no voters: 11b6e81238e74ac9a19fa102021ec3b3, 981b6c7cf04e4f12bd645a47411fc341
I20260709 13:02:08.067181 12243 raft_consensus.cc:493] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.067835 12243 raft_consensus.cc:515] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:08.070398 12277 raft_consensus.cc:3060] T 77ec90b937044a22908ba572a3df7080 P 614235125ef247d9bda52a3accb0cfb7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.077153 12119 raft_consensus.cc:3060] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.077260 12243 leader_election.cc:290] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195:40471)
I20260709 13:02:08.082191 12279 consensus_queue.cc:1048] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:08.091954 12279 consensus_queue.cc:1048] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:08.096813 12244 consensus_queue.cc:1048] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:08.115201 12277 raft_consensus.cc:2749] T 77ec90b937044a22908ba572a3df7080 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:08.122087 12085 leader_election.cc:336] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:02:08.134099 12274 consensus_queue.cc:1048] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:02:08.150447 12159 consensus_peers.cc:597] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:08.125854 12194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "472c5d72e71b465abdd55365c4f9bca4" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "981b6c7cf04e4f12bd645a47411fc341" is_pre_election: true
I20260709 13:02:08.162621 12271 consensus_queue.cc:1048] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:02:08.169445 12159 consensus_peers.cc:597] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:08.174178 12271 consensus_queue.cc:1048] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:02:08.180871 12274 consensus_queue.cc:1048] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:08.181923 12085 leader_election.cc:304] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3; no voters: 614235125ef247d9bda52a3accb0cfb7, 981b6c7cf04e4f12bd645a47411fc341
I20260709 13:02:08.183341 12243 raft_consensus.cc:2749] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:08.187502 12085 consensus_peers.cc:597] T ce79da57b33749a9be411c92b0178103 P 11b6e81238e74ac9a19fa102021ec3b3 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:08.265298 12243 consensus_queue.cc:1048] T ce79da57b33749a9be411c92b0178103 P 11b6e81238e74ac9a19fa102021ec3b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:02:08.287812 12279 consensus_queue.cc:1048] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:02:08.300704 12159 consensus_peers.cc:597] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:08.333045   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:08.333951   431 tablet_replica.cc:333] T 3768bc61992440faa9ef167f5f395162 P 614235125ef247d9bda52a3accb0cfb7: stopping tablet replica
I20260709 13:02:08.335132   431 raft_consensus.cc:2243] T 3768bc61992440faa9ef167f5f395162 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:08.335842 11991 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:02:08.336189   431 raft_consensus.cc:2272] T 3768bc61992440faa9ef167f5f395162 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:08.340312   431 tablet_replica.cc:333] T 158dbd8d299848848d9d949e89ade205 P 614235125ef247d9bda52a3accb0cfb7: stopping tablet replica
I20260709 13:02:08.341286   431 raft_consensus.cc:2243] T 158dbd8d299848848d9d949e89ade205 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:08.341975   431 raft_consensus.cc:2272] T 158dbd8d299848848d9d949e89ade205 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:08.345752   431 tablet_replica.cc:333] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7: stopping tablet replica
I20260709 13:02:08.346458   431 raft_consensus.cc:2243] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:08.347184   431 raft_consensus.cc:2272] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:08.350808   431 tablet_replica.cc:333] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7: stopping tablet replica
I20260709 13:02:08.351295 12315 consensus_queue.cc:1048] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:08.351538   431 raft_consensus.cc:2243] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:08.352901   431 raft_consensus.cc:2272] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:08.357079   431 tablet_replica.cc:333] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7: stopping tablet replica
I20260709 13:02:08.357872   431 raft_consensus.cc:2243] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:08.360255   431 raft_consensus.cc:2272] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:08.366456   431 tablet_replica.cc:333] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7: stopping tablet replica
W20260709 13:02:08.368221 12159 consensus_peers.cc:597] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:08.368451   431 raft_consensus.cc:2243] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:08.370680   431 raft_consensus.cc:2272] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:08.375473   431 tablet_replica.cc:333] T 77ec90b937044a22908ba572a3df7080 P 614235125ef247d9bda52a3accb0cfb7: stopping tablet replica
I20260709 13:02:08.376412   431 raft_consensus.cc:2243] T 77ec90b937044a22908ba572a3df7080 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:08.377130   431 raft_consensus.cc:2272] T 77ec90b937044a22908ba572a3df7080 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:08.379739   431 tablet_replica.cc:333] T ce79da57b33749a9be411c92b0178103 P 614235125ef247d9bda52a3accb0cfb7: stopping tablet replica
I20260709 13:02:08.380410   431 raft_consensus.cc:2243] T ce79da57b33749a9be411c92b0178103 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:08.381035   431 raft_consensus.cc:2272] T ce79da57b33749a9be411c92b0178103 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:08.383250   431 tablet_replica.cc:333] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7: stopping tablet replica
I20260709 13:02:08.383790   431 raft_consensus.cc:2243] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:08.384966   431 raft_consensus.cc:2272] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:08.387902   431 tablet_replica.cc:333] T 8d14cd6559d347979cf41da97a2533b4 P 614235125ef247d9bda52a3accb0cfb7: stopping tablet replica
I20260709 13:02:08.388466   431 raft_consensus.cc:2243] T 8d14cd6559d347979cf41da97a2533b4 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:08.389045   431 raft_consensus.cc:2272] T 8d14cd6559d347979cf41da97a2533b4 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:08.413314   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:02:08.470132 12085 consensus_peers.cc:597] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:09.337108 11991 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:02:09.578164 12322 raft_consensus.cc:493] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 614235125ef247d9bda52a3accb0cfb7)
I20260709 13:02:09.578857 12322 raft_consensus.cc:515] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:09.580917 12322 leader_election.cc:290] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117)
I20260709 13:02:09.582252 12116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "472c5d72e71b465abdd55365c4f9bca4" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3" is_pre_election: true
W20260709 13:02:09.585359 12159 leader_election.cc:336] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111)
I20260709 13:02:09.585778 12159 leader_election.cc:304] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 981b6c7cf04e4f12bd645a47411fc341; no voters: 11b6e81238e74ac9a19fa102021ec3b3, 614235125ef247d9bda52a3accb0cfb7
I20260709 13:02:09.586413 12322 raft_consensus.cc:2749] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:09.631564 12330 raft_consensus.cc:493] T 4b75f0d8243c43318c29f22313533f08 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 614235125ef247d9bda52a3accb0cfb7)
I20260709 13:02:09.632128 12330 raft_consensus.cc:515] T 4b75f0d8243c43318c29f22313533f08 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:09.634039 12330 leader_election.cc:290] T 4b75f0d8243c43318c29f22313533f08 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195:40471)
W20260709 13:02:09.635453 12085 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111) [suppressed 115 similar messages]
I20260709 13:02:09.635682 12194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b75f0d8243c43318c29f22313533f08" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "981b6c7cf04e4f12bd645a47411fc341" is_pre_election: true
W20260709 13:02:09.638247 12085 leader_election.cc:336] T 4b75f0d8243c43318c29f22313533f08 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111)
I20260709 13:02:09.638629 12085 leader_election.cc:304] T 4b75f0d8243c43318c29f22313533f08 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3; no voters: 614235125ef247d9bda52a3accb0cfb7, 981b6c7cf04e4f12bd645a47411fc341
I20260709 13:02:09.639271 12330 raft_consensus.cc:2749] T 4b75f0d8243c43318c29f22313533f08 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:09.641743 12322 raft_consensus.cc:493] T 3f30ed75e9c4428fa5fc69291ccef018 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 614235125ef247d9bda52a3accb0cfb7)
I20260709 13:02:09.642287 12322 raft_consensus.cc:515] T 3f30ed75e9c4428fa5fc69291ccef018 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:09.643950 12322 leader_election.cc:290] T 3f30ed75e9c4428fa5fc69291ccef018 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117)
I20260709 13:02:09.645097 12116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f30ed75e9c4428fa5fc69291ccef018" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3" is_pre_election: true
W20260709 13:02:09.647320 12159 leader_election.cc:336] T 3f30ed75e9c4428fa5fc69291ccef018 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111)
I20260709 13:02:09.647734 12159 leader_election.cc:304] T 3f30ed75e9c4428fa5fc69291ccef018 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 981b6c7cf04e4f12bd645a47411fc341; no voters: 11b6e81238e74ac9a19fa102021ec3b3, 614235125ef247d9bda52a3accb0cfb7
I20260709 13:02:09.648303 12322 raft_consensus.cc:2749] T 3f30ed75e9c4428fa5fc69291ccef018 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:09.650604 12322 raft_consensus.cc:493] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 614235125ef247d9bda52a3accb0cfb7)
I20260709 13:02:09.651037 12322 raft_consensus.cc:515] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:09.652918 12322 leader_election.cc:290] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117)
I20260709 13:02:09.654043 12116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b75f0d8243c43318c29f22313533f08" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3" is_pre_election: true
I20260709 13:02:09.654713 12116 raft_consensus.cc:2468] T 4b75f0d8243c43318c29f22313533f08 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 981b6c7cf04e4f12bd645a47411fc341 in term 1.
I20260709 13:02:09.655773 12160 leader_election.cc:304] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3, 981b6c7cf04e4f12bd645a47411fc341; no voters: 
W20260709 13:02:09.656670 12159 leader_election.cc:336] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111)
I20260709 13:02:09.656759 12322 raft_consensus.cc:2804] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:09.657198 12322 raft_consensus.cc:493] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 614235125ef247d9bda52a3accb0cfb7)
I20260709 13:02:09.657565 12322 raft_consensus.cc:3060] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:09.665581 12322 raft_consensus.cc:515] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:09.667253 12322 leader_election.cc:290] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 2 election: Requested vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117)
I20260709 13:02:09.668532 12116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b75f0d8243c43318c29f22313533f08" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3"
I20260709 13:02:09.669191 12116 raft_consensus.cc:3060] T 4b75f0d8243c43318c29f22313533f08 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:09.670876 12159 leader_election.cc:336] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111)
I20260709 13:02:09.675462 12116 raft_consensus.cc:2468] T 4b75f0d8243c43318c29f22313533f08 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 981b6c7cf04e4f12bd645a47411fc341 in term 2.
I20260709 13:02:09.676560 12160 leader_election.cc:304] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3, 981b6c7cf04e4f12bd645a47411fc341; no voters: 614235125ef247d9bda52a3accb0cfb7
I20260709 13:02:09.677201 12322 raft_consensus.cc:2804] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:09.677603 12322 raft_consensus.cc:697] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [term 2 LEADER]: Becoming Leader. State: Replica: 981b6c7cf04e4f12bd645a47411fc341, State: Running, Role: LEADER
I20260709 13:02:09.678447 12322 consensus_queue.cc:237] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:09.685812 11942 catalog_manager.cc:5697] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 reported cstate change: term changed from 1 to 2, leader changed from 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193) to 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "981b6c7cf04e4f12bd645a47411fc341" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:09.687920 12330 raft_consensus.cc:493] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 614235125ef247d9bda52a3accb0cfb7)
I20260709 13:02:09.688627 12330 raft_consensus.cc:515] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:09.690881 12330 leader_election.cc:290] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195:40471)
I20260709 13:02:09.692799 12194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f30ed75e9c4428fa5fc69291ccef018" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "981b6c7cf04e4f12bd645a47411fc341" is_pre_election: true
I20260709 13:02:09.693543 12194 raft_consensus.cc:2468] T 3f30ed75e9c4428fa5fc69291ccef018 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11b6e81238e74ac9a19fa102021ec3b3 in term 1.
I20260709 13:02:09.695791 12085 leader_election.cc:304] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3, 981b6c7cf04e4f12bd645a47411fc341; no voters: 
I20260709 13:02:09.696698 12330 raft_consensus.cc:2804] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:09.697109 12330 raft_consensus.cc:493] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 614235125ef247d9bda52a3accb0cfb7)
I20260709 13:02:09.697503 12330 raft_consensus.cc:3060] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:09.698997 12085 leader_election.cc:336] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111)
I20260709 13:02:09.705889 12330 raft_consensus.cc:515] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:09.707636 12330 leader_election.cc:290] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 2 election: Requested vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195:40471)
I20260709 13:02:09.709337 12194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f30ed75e9c4428fa5fc69291ccef018" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "981b6c7cf04e4f12bd645a47411fc341"
I20260709 13:02:09.710006 12194 raft_consensus.cc:3060] T 3f30ed75e9c4428fa5fc69291ccef018 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:09.711689 12085 leader_election.cc:336] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111)
I20260709 13:02:09.716349 12194 raft_consensus.cc:2468] T 3f30ed75e9c4428fa5fc69291ccef018 P 981b6c7cf04e4f12bd645a47411fc341 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11b6e81238e74ac9a19fa102021ec3b3 in term 2.
I20260709 13:02:09.717531 12085 leader_election.cc:304] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3, 981b6c7cf04e4f12bd645a47411fc341; no voters: 614235125ef247d9bda52a3accb0cfb7
I20260709 13:02:09.718223 12330 raft_consensus.cc:2804] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:09.718648 12330 raft_consensus.cc:697] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 LEADER]: Becoming Leader. State: Replica: 11b6e81238e74ac9a19fa102021ec3b3, State: Running, Role: LEADER
I20260709 13:02:09.719480 12330 consensus_queue.cc:237] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:09.726956 11942 catalog_manager.cc:5697] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3 reported cstate change: term changed from 1 to 2, leader changed from 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193) to 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "11b6e81238e74ac9a19fa102021ec3b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:09.758884 12330 raft_consensus.cc:493] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 614235125ef247d9bda52a3accb0cfb7)
I20260709 13:02:09.759456 12330 raft_consensus.cc:515] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:09.761225 12330 leader_election.cc:290] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195:40471)
I20260709 13:02:09.762754 12194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "472c5d72e71b465abdd55365c4f9bca4" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "981b6c7cf04e4f12bd645a47411fc341" is_pre_election: true
I20260709 13:02:09.763427 12194 raft_consensus.cc:2468] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11b6e81238e74ac9a19fa102021ec3b3 in term 1.
I20260709 13:02:09.764439 12085 leader_election.cc:304] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3, 981b6c7cf04e4f12bd645a47411fc341; no voters: 
I20260709 13:02:09.765153 12330 raft_consensus.cc:2804] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:02:09.765213 12085 leader_election.cc:336] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111)
I20260709 13:02:09.765601 12330 raft_consensus.cc:493] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 614235125ef247d9bda52a3accb0cfb7)
I20260709 13:02:09.765985 12330 raft_consensus.cc:3060] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:09.771341 12330 raft_consensus.cc:515] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:09.773051 12330 leader_election.cc:290] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 2 election: Requested vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195:40471)
I20260709 13:02:09.774622 12194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "472c5d72e71b465abdd55365c4f9bca4" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "981b6c7cf04e4f12bd645a47411fc341"
I20260709 13:02:09.775223 12194 raft_consensus.cc:3060] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:09.776515 12085 leader_election.cc:336] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111)
I20260709 13:02:09.780838 12194 raft_consensus.cc:2468] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11b6e81238e74ac9a19fa102021ec3b3 in term 2.
I20260709 13:02:09.781927 12085 leader_election.cc:304] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3, 981b6c7cf04e4f12bd645a47411fc341; no voters: 614235125ef247d9bda52a3accb0cfb7
I20260709 13:02:09.782611 12330 raft_consensus.cc:2804] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:09.783072 12330 raft_consensus.cc:697] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 LEADER]: Becoming Leader. State: Replica: 11b6e81238e74ac9a19fa102021ec3b3, State: Running, Role: LEADER
I20260709 13:02:09.783960 12330 consensus_queue.cc:237] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:09.791188 11942 catalog_manager.cc:5697] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 reported cstate change: term changed from 1 to 2, leader changed from 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193) to 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "11b6e81238e74ac9a19fa102021ec3b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:09.797710 12322 raft_consensus.cc:493] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 614235125ef247d9bda52a3accb0cfb7)
I20260709 13:02:09.798373 12322 raft_consensus.cc:515] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:09.800246 12322 leader_election.cc:290] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117)
I20260709 13:02:09.801375 12116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f2bca87d394ebdae299b722de75c9b" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3" is_pre_election: true
I20260709 13:02:09.801963 12116 raft_consensus.cc:2468] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 981b6c7cf04e4f12bd645a47411fc341 in term 1.
I20260709 13:02:09.802933 12160 leader_election.cc:304] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3, 981b6c7cf04e4f12bd645a47411fc341; no voters: 
I20260709 13:02:09.803715 12322 raft_consensus.cc:2804] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:02:09.803756 12159 leader_election.cc:336] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111)
I20260709 13:02:09.804200 12322 raft_consensus.cc:493] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 614235125ef247d9bda52a3accb0cfb7)
I20260709 13:02:09.804593 12322 raft_consensus.cc:3060] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:09.809994 12322 raft_consensus.cc:515] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:09.811771 12322 leader_election.cc:290] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 2 election: Requested vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117)
I20260709 13:02:09.812922 12116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f2bca87d394ebdae299b722de75c9b" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3"
I20260709 13:02:09.813567 12116 raft_consensus.cc:3060] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:09.815188 12159 leader_election.cc:336] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111)
I20260709 13:02:09.818696 12116 raft_consensus.cc:2468] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 981b6c7cf04e4f12bd645a47411fc341 in term 2.
I20260709 13:02:09.819761 12160 leader_election.cc:304] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3, 981b6c7cf04e4f12bd645a47411fc341; no voters: 614235125ef247d9bda52a3accb0cfb7
I20260709 13:02:09.820459 12322 raft_consensus.cc:2804] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:09.820885 12322 raft_consensus.cc:697] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 2 LEADER]: Becoming Leader. State: Replica: 981b6c7cf04e4f12bd645a47411fc341, State: Running, Role: LEADER
I20260709 13:02:09.821762 12322 consensus_queue.cc:237] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:09.828962 11942 catalog_manager.cc:5697] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 reported cstate change: term changed from 1 to 2, leader changed from 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193) to 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "981b6c7cf04e4f12bd645a47411fc341" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:10.069782 12116 raft_consensus.cc:1275] T 4b75f0d8243c43318c29f22313533f08 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 FOLLOWER]: Refusing update from remote peer 981b6c7cf04e4f12bd645a47411fc341: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:10.071058 12322 consensus_queue.cc:1048] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:02:10.085534 12159 consensus_peers.cc:597] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:10.248373 12116 raft_consensus.cc:1275] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 FOLLOWER]: Refusing update from remote peer 981b6c7cf04e4f12bd645a47411fc341: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:10.250756 12322 consensus_queue.cc:1048] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:02:10.255074 12085 consensus_peers.cc:597] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:10.258002 12194 raft_consensus.cc:1275] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [term 2 FOLLOWER]: Refusing update from remote peer 11b6e81238e74ac9a19fa102021ec3b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:10.260165 12330 consensus_queue.cc:1048] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:02:10.267437 12159 consensus_peers.cc:597] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:10.279923 12085 consensus_peers.cc:597] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:10.314203 12194 raft_consensus.cc:1275] T 3f30ed75e9c4428fa5fc69291ccef018 P 981b6c7cf04e4f12bd645a47411fc341 [term 2 FOLLOWER]: Refusing update from remote peer 11b6e81238e74ac9a19fa102021ec3b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:10.315752 12347 consensus_queue.cc:1048] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:02:10.338112 11991 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:02:10.604676 12159 consensus_peers.cc:597] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:10.631328 12159 consensus_peers.cc:597] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:10.632786 12085 consensus_peers.cc:597] T ce79da57b33749a9be411c92b0178103 P 11b6e81238e74ac9a19fa102021ec3b3 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:10.785068 12085 consensus_peers.cc:597] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:11.036434 12159 consensus_peers.cc:597] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:11.079929 12159 consensus_peers.cc:597] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:11.339075 11991 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:02:12.340098 11991 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:02:12.657545 12085 consensus_peers.cc:597] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:12.663447 12159 consensus_peers.cc:597] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:12.669281 12085 consensus_peers.cc:597] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:12.786444 12159 consensus_peers.cc:597] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:12.883876 12159 consensus_peers.cc:597] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:12.915268 12159 consensus_peers.cc:597] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:13.059437 12085 consensus_peers.cc:597] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:13.211608 12085 consensus_peers.cc:597] T ce79da57b33749a9be411c92b0178103 P 11b6e81238e74ac9a19fa102021ec3b3 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:13.341250 11991 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:02:13.394826 12159 consensus_peers.cc:597] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:13.443238   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:13.450456 12351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:13.450543 12352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:13.453241 12354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:13.454136   431 server_base.cc:1061] running on GCE node
I20260709 13:02:13.455258   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:13.455484   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:13.455667   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602133455651 us; error 0 us; skew 500 ppm
I20260709 13:02:13.456223   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:13.458912   431 webserver.cc:533] Webserver started at http://127.0.107.193:37645/ using document root <none> and password file <none>
I20260709 13:02:13.459435   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:13.459616   431 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:02:13.463721   431 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:02:13.468176 12359 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:13.469024   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:02:13.469358   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601786404416-431-0/minicluster-data/ts-0-root
uuid: "614235125ef247d9bda52a3accb0cfb7"
format_stamp: "Formatted at 2026-07-09 13:02:06 on dist-test-slave-6j4g"
I20260709 13:02:13.469720   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601786404416-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601786404416-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601786404416-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:13.485486   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:13.486835   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:13.488354   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:13.492220 12366 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:02:13.547847   431 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:02:13.548166   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.057s	user 0.002s	sys 0.000s
I20260709 13:02:13.548545   431 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:02:13.553947 12366 tablet_bootstrap.cc:492] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap starting.
I20260709 13:02:13.568240 12366 tablet_bootstrap.cc:492] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:13.569151 12366 tablet_bootstrap.cc:492] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap complete.
I20260709 13:02:13.569746 12366 ts_tablet_manager.cc:1403] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.005s
I20260709 13:02:13.572053 12366 raft_consensus.cc:359] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:13.572664 12366 raft_consensus.cc:740] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 614235125ef247d9bda52a3accb0cfb7, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.573283 12366 consensus_queue.cc:260] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:13.575663 12366 ts_tablet_manager.cc:1434] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:02:13.576395 12366 tablet_bootstrap.cc:492] T 158dbd8d299848848d9d949e89ade205 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap starting.
I20260709 13:02:13.590386 12366 tablet_bootstrap.cc:492] T 158dbd8d299848848d9d949e89ade205 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:13.591195 12366 tablet_bootstrap.cc:492] T 158dbd8d299848848d9d949e89ade205 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap complete.
I20260709 13:02:13.591789 12366 ts_tablet_manager.cc:1403] T 158dbd8d299848848d9d949e89ade205 P 614235125ef247d9bda52a3accb0cfb7: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.003s
I20260709 13:02:13.592646   431 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:02:13.592972   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.044s	user 0.041s	sys 0.003s
I20260709 13:02:13.594388 12366 raft_consensus.cc:359] T 158dbd8d299848848d9d949e89ade205 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:13.595124 12366 raft_consensus.cc:740] T 158dbd8d299848848d9d949e89ade205 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 614235125ef247d9bda52a3accb0cfb7, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.595916 12366 consensus_queue.cc:260] T 158dbd8d299848848d9d949e89ade205 P 614235125ef247d9bda52a3accb0cfb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:13.597999 12366 ts_tablet_manager.cc:1434] T 158dbd8d299848848d9d949e89ade205 P 614235125ef247d9bda52a3accb0cfb7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
W20260709 13:02:13.598690 12159 consensus_peers.cc:597] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:13.598860 12366 tablet_bootstrap.cc:492] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7: Bootstrap starting.
I20260709 13:02:13.614631 12366 tablet_bootstrap.cc:492] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:13.615443 12366 tablet_bootstrap.cc:492] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7: Bootstrap complete.
I20260709 13:02:13.615988 12366 ts_tablet_manager.cc:1403] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 13:02:13.618377 12366 raft_consensus.cc:359] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:13.619138 12366 raft_consensus.cc:740] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 614235125ef247d9bda52a3accb0cfb7, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.619807 12366 consensus_queue.cc:260] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:13.621596 12366 ts_tablet_manager.cc:1434] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:02:13.622257 12366 tablet_bootstrap.cc:492] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7: Bootstrap starting.
I20260709 13:02:13.633483 12366 tablet_bootstrap.cc:492] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:13.634349 12366 tablet_bootstrap.cc:492] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7: Bootstrap complete.
I20260709 13:02:13.635165 12366 ts_tablet_manager.cc:1403] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 13:02:13.637967 12366 raft_consensus.cc:359] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:13.638681 12366 raft_consensus.cc:740] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 614235125ef247d9bda52a3accb0cfb7, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.639483 12366 consensus_queue.cc:260] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:13.641510 12366 ts_tablet_manager.cc:1434] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:02:13.642352 12366 tablet_bootstrap.cc:492] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap starting.
I20260709 13:02:13.655906   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:45599
I20260709 13:02:13.656013 12428 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:45599 every 8 connection(s)
I20260709 13:02:13.658273 12366 tablet_bootstrap.cc:492] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:13.659312 12366 tablet_bootstrap.cc:492] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap complete.
I20260709 13:02:13.660037 12366 ts_tablet_manager.cc:1403] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:02:13.663141   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:13.662917 12366 raft_consensus.cc:359] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:13.663837 12366 raft_consensus.cc:740] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 614235125ef247d9bda52a3accb0cfb7, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.664708 12366 consensus_queue.cc:260] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:13.668928 12366 ts_tablet_manager.cc:1434] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.001s
I20260709 13:02:13.670255 12366 tablet_bootstrap.cc:492] T 3768bc61992440faa9ef167f5f395162 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap starting.
I20260709 13:02:13.700724 12366 tablet_bootstrap.cc:492] T 3768bc61992440faa9ef167f5f395162 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:13.701719 12366 tablet_bootstrap.cc:492] T 3768bc61992440faa9ef167f5f395162 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap complete.
I20260709 13:02:13.702512 12366 ts_tablet_manager.cc:1403] T 3768bc61992440faa9ef167f5f395162 P 614235125ef247d9bda52a3accb0cfb7: Time spent bootstrapping tablet: real 0.033s	user 0.023s	sys 0.004s
I20260709 13:02:13.705590 12366 raft_consensus.cc:359] T 3768bc61992440faa9ef167f5f395162 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:13.706374 12366 raft_consensus.cc:740] T 3768bc61992440faa9ef167f5f395162 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 614235125ef247d9bda52a3accb0cfb7, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.707176 12366 consensus_queue.cc:260] T 3768bc61992440faa9ef167f5f395162 P 614235125ef247d9bda52a3accb0cfb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:13.709743 12366 ts_tablet_manager.cc:1434] T 3768bc61992440faa9ef167f5f395162 P 614235125ef247d9bda52a3accb0cfb7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:13.710707 12366 tablet_bootstrap.cc:492] T 77ec90b937044a22908ba572a3df7080 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap starting.
I20260709 13:02:13.711887 12429 heartbeater.cc:344] Connected to a master server at 127.0.107.254:35617
I20260709 13:02:13.712361 12429 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:13.712432 12194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3768bc61992440faa9ef167f5f395162"
dest_uuid: "981b6c7cf04e4f12bd645a47411fc341"
mode: GRACEFUL
new_leader_uuid: "11b6e81238e74ac9a19fa102021ec3b3"
 from {username='slave'} at 127.0.0.1:46704
I20260709 13:02:13.713250 12429 heartbeater.cc:507] Master 127.0.107.254:35617 requested a full tablet report, sending...
I20260709 13:02:13.713250 12194 raft_consensus.cc:606] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 LEADER]: Received request to transfer leadership to TS 11b6e81238e74ac9a19fa102021ec3b3
I20260709 13:02:13.716789 12194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9f2bca87d394ebdae299b722de75c9b"
dest_uuid: "981b6c7cf04e4f12bd645a47411fc341"
mode: GRACEFUL
new_leader_uuid: "11b6e81238e74ac9a19fa102021ec3b3"
 from {username='slave'} at 127.0.0.1:46704
I20260709 13:02:13.717391 12194 raft_consensus.cc:606] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 2 LEADER]: Received request to transfer leadership to TS 11b6e81238e74ac9a19fa102021ec3b3
I20260709 13:02:13.718709   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:13.719384   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:13.719540 11940 ts_manager.cc:194] Re-registered known tserver with Master: 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599)
I20260709 13:02:13.720280   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:13.724431 12366 tablet_bootstrap.cc:492] T 77ec90b937044a22908ba572a3df7080 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:13.725394 12366 tablet_bootstrap.cc:492] T 77ec90b937044a22908ba572a3df7080 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap complete.
I20260709 13:02:13.726058 12366 ts_tablet_manager.cc:1403] T 77ec90b937044a22908ba572a3df7080 P 614235125ef247d9bda52a3accb0cfb7: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:02:13.728965 11940 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57014
I20260709 13:02:13.728724 12366 raft_consensus.cc:359] T 77ec90b937044a22908ba572a3df7080 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:13.729499 12366 raft_consensus.cc:740] T 77ec90b937044a22908ba572a3df7080 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 614235125ef247d9bda52a3accb0cfb7, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.730298 12366 consensus_queue.cc:260] T 77ec90b937044a22908ba572a3df7080 P 614235125ef247d9bda52a3accb0cfb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:13.731856 12366 ts_tablet_manager.cc:1434] T 77ec90b937044a22908ba572a3df7080 P 614235125ef247d9bda52a3accb0cfb7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:13.732419 12429 heartbeater.cc:499] Master 127.0.107.254:35617 was elected leader, sending a full tablet report...
I20260709 13:02:13.732645 12366 tablet_bootstrap.cc:492] T ce79da57b33749a9be411c92b0178103 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap starting.
I20260709 13:02:13.744539 12366 tablet_bootstrap.cc:492] T ce79da57b33749a9be411c92b0178103 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:13.745419 12366 tablet_bootstrap.cc:492] T ce79da57b33749a9be411c92b0178103 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap complete.
I20260709 13:02:13.746119 12366 ts_tablet_manager.cc:1403] T ce79da57b33749a9be411c92b0178103 P 614235125ef247d9bda52a3accb0cfb7: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:02:13.748514 12366 raft_consensus.cc:359] T ce79da57b33749a9be411c92b0178103 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } }
I20260709 13:02:13.749073 12366 raft_consensus.cc:740] T ce79da57b33749a9be411c92b0178103 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 614235125ef247d9bda52a3accb0cfb7, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.749555 12366 consensus_queue.cc:260] T ce79da57b33749a9be411c92b0178103 P 614235125ef247d9bda52a3accb0cfb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } }
I20260709 13:02:13.750988 12366 ts_tablet_manager.cc:1434] T ce79da57b33749a9be411c92b0178103 P 614235125ef247d9bda52a3accb0cfb7: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:13.751782 12366 tablet_bootstrap.cc:492] T 8d14cd6559d347979cf41da97a2533b4 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap starting.
I20260709 13:02:13.763545 12366 tablet_bootstrap.cc:492] T 8d14cd6559d347979cf41da97a2533b4 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:13.764206 12366 tablet_bootstrap.cc:492] T 8d14cd6559d347979cf41da97a2533b4 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap complete.
I20260709 13:02:13.764814 12366 ts_tablet_manager.cc:1403] T 8d14cd6559d347979cf41da97a2533b4 P 614235125ef247d9bda52a3accb0cfb7: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:02:13.766641 12366 raft_consensus.cc:359] T 8d14cd6559d347979cf41da97a2533b4 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:13.767153 12366 raft_consensus.cc:740] T 8d14cd6559d347979cf41da97a2533b4 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 614235125ef247d9bda52a3accb0cfb7, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.767680 12366 consensus_queue.cc:260] T 8d14cd6559d347979cf41da97a2533b4 P 614235125ef247d9bda52a3accb0cfb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:13.769239 12366 ts_tablet_manager.cc:1434] T 8d14cd6559d347979cf41da97a2533b4 P 614235125ef247d9bda52a3accb0cfb7: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:02:13.770000 12366 tablet_bootstrap.cc:492] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap starting.
I20260709 13:02:13.783272 12402 raft_consensus.cc:3060] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:13.786194 12366 tablet_bootstrap.cc:492] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:13.787272 12366 tablet_bootstrap.cc:492] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7: Bootstrap complete.
I20260709 13:02:13.787937 12366 ts_tablet_manager.cc:1403] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:02:13.790593 12366 raft_consensus.cc:359] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:13.791252 12366 raft_consensus.cc:740] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 614235125ef247d9bda52a3accb0cfb7, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.791965 12366 consensus_queue.cc:260] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:13.795188 12366 ts_tablet_manager.cc:1434] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:13.801783 12402 raft_consensus.cc:3060] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:13.813135 12402 raft_consensus.cc:3060] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:13.829125 12446 raft_consensus.cc:993] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341: : Instructing follower 11b6e81238e74ac9a19fa102021ec3b3 to start an election
I20260709 13:02:13.829584 12446 raft_consensus.cc:1081] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 2 LEADER]: Signalling peer 11b6e81238e74ac9a19fa102021ec3b3 to start an election
I20260709 13:02:13.831233 12116 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9f2bca87d394ebdae299b722de75c9b"
dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3"
 from {username='slave'} at 127.0.0.1:39484
I20260709 13:02:13.831739 12116 raft_consensus.cc:493] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:13.832015 12116 raft_consensus.cc:3060] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:13.837828 12116 raft_consensus.cc:515] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:13.839483 12116 leader_election.cc:290] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 3 election: Requested vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195:40471)
I20260709 13:02:13.840211 12402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f2bca87d394ebdae299b722de75c9b" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "614235125ef247d9bda52a3accb0cfb7"
I20260709 13:02:13.840397 12194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f2bca87d394ebdae299b722de75c9b" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "981b6c7cf04e4f12bd645a47411fc341"
I20260709 13:02:13.840874 12402 raft_consensus.cc:3060] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:13.841058 12194 raft_consensus.cc:3055] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:13.841399 12194 raft_consensus.cc:740] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 981b6c7cf04e4f12bd645a47411fc341, State: Running, Role: LEADER
I20260709 13:02:13.842108 12194 consensus_queue.cc:260] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:13.843061 12194 raft_consensus.cc:3060] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:13.846374 12402 raft_consensus.cc:2468] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11b6e81238e74ac9a19fa102021ec3b3 in term 3.
I20260709 13:02:13.847582 12085 leader_election.cc:304] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3, 614235125ef247d9bda52a3accb0cfb7; no voters: 
I20260709 13:02:13.847973 12349 raft_consensus.cc:993] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341: : Instructing follower 11b6e81238e74ac9a19fa102021ec3b3 to start an election
I20260709 13:02:13.848328 12330 raft_consensus.cc:2804] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:13.849747 12447 raft_consensus.cc:1081] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 LEADER]: Signalling peer 11b6e81238e74ac9a19fa102021ec3b3 to start an election
I20260709 13:02:13.849828 12194 raft_consensus.cc:2468] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11b6e81238e74ac9a19fa102021ec3b3 in term 3.
I20260709 13:02:13.851418 12330 raft_consensus.cc:697] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [term 3 LEADER]: Becoming Leader. State: Replica: 11b6e81238e74ac9a19fa102021ec3b3, State: Running, Role: LEADER
I20260709 13:02:13.852488 12330 consensus_queue.cc:237] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:13.854020 12118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3768bc61992440faa9ef167f5f395162"
dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3"
 from {username='slave'} at 127.0.0.1:39484
I20260709 13:02:13.854632 12118 raft_consensus.cc:493] T 3768bc61992440faa9ef167f5f395162 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:13.855026 12118 raft_consensus.cc:3060] T 3768bc61992440faa9ef167f5f395162 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:13.861711 11940 catalog_manager.cc:5697] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 reported cstate change: term changed from 2 to 3, leader changed from 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195) to 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "11b6e81238e74ac9a19fa102021ec3b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:13.862783 12118 raft_consensus.cc:515] T 3768bc61992440faa9ef167f5f395162 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:13.865160 12118 leader_election.cc:290] T 3768bc61992440faa9ef167f5f395162 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 2 election: Requested vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195:40471)
I20260709 13:02:13.865839 12402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3768bc61992440faa9ef167f5f395162" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "614235125ef247d9bda52a3accb0cfb7"
I20260709 13:02:13.866187 12194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3768bc61992440faa9ef167f5f395162" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "981b6c7cf04e4f12bd645a47411fc341"
I20260709 13:02:13.866572 12402 raft_consensus.cc:3060] T 3768bc61992440faa9ef167f5f395162 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:13.866757 12194 raft_consensus.cc:3055] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:13.867138 12194 raft_consensus.cc:740] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 981b6c7cf04e4f12bd645a47411fc341, State: Running, Role: LEADER
I20260709 13:02:13.867893 12194 consensus_queue.cc:260] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:13.868817 12194 raft_consensus.cc:3060] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:13.873689 12402 raft_consensus.cc:2468] T 3768bc61992440faa9ef167f5f395162 P 614235125ef247d9bda52a3accb0cfb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11b6e81238e74ac9a19fa102021ec3b3 in term 2.
I20260709 13:02:13.875108 12085 leader_election.cc:304] T 3768bc61992440faa9ef167f5f395162 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3, 614235125ef247d9bda52a3accb0cfb7; no voters: 
I20260709 13:02:13.875793 12330 raft_consensus.cc:2804] T 3768bc61992440faa9ef167f5f395162 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:13.875814 12194 raft_consensus.cc:2468] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11b6e81238e74ac9a19fa102021ec3b3 in term 2.
I20260709 13:02:13.876277 12330 raft_consensus.cc:697] T 3768bc61992440faa9ef167f5f395162 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 LEADER]: Becoming Leader. State: Replica: 11b6e81238e74ac9a19fa102021ec3b3, State: Running, Role: LEADER
I20260709 13:02:13.877259 12330 consensus_queue.cc:237] T 3768bc61992440faa9ef167f5f395162 P 11b6e81238e74ac9a19fa102021ec3b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:13.884191 11940 catalog_manager.cc:5697] T 3768bc61992440faa9ef167f5f395162 P 11b6e81238e74ac9a19fa102021ec3b3 reported cstate change: term changed from 1 to 2, leader changed from 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195) to 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "11b6e81238e74ac9a19fa102021ec3b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:14.234122 12402 raft_consensus.cc:1275] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [term 3 FOLLOWER]: Refusing update from remote peer 11b6e81238e74ac9a19fa102021ec3b3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:14.235450 12457 consensus_queue.cc:1048] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:14.243643 12401 raft_consensus.cc:3060] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:14.244534 12194 raft_consensus.cc:1275] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 3 FOLLOWER]: Refusing update from remote peer 11b6e81238e74ac9a19fa102021ec3b3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:14.247360 12457 consensus_queue.cc:1048] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:02:14.342334 11991 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:02:14.396799 12401 raft_consensus.cc:1275] T 3768bc61992440faa9ef167f5f395162 P 614235125ef247d9bda52a3accb0cfb7 [term 2 FOLLOWER]: Refusing update from remote peer 11b6e81238e74ac9a19fa102021ec3b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:14.398173 12448 consensus_queue.cc:1048] T 3768bc61992440faa9ef167f5f395162 P 11b6e81238e74ac9a19fa102021ec3b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:14.406628 12194 raft_consensus.cc:1275] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 [term 2 FOLLOWER]: Refusing update from remote peer 11b6e81238e74ac9a19fa102021ec3b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:14.408684 12330 consensus_queue.cc:1048] T 3768bc61992440faa9ef167f5f395162 P 11b6e81238e74ac9a19fa102021ec3b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:14.731070   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:14.748992 12118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "158dbd8d299848848d9d949e89ade205"
dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3"
mode: GRACEFUL
new_leader_uuid: "981b6c7cf04e4f12bd645a47411fc341"
 from {username='slave'} at 127.0.0.1:35480
I20260709 13:02:14.749487 12118 raft_consensus.cc:606] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 LEADER]: Received request to transfer leadership to TS 981b6c7cf04e4f12bd645a47411fc341
I20260709 13:02:14.751950 12118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9f2bca87d394ebdae299b722de75c9b"
dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3"
mode: GRACEFUL
new_leader_uuid: "981b6c7cf04e4f12bd645a47411fc341"
 from {username='slave'} at 127.0.0.1:35480
I20260709 13:02:14.752529 12118 raft_consensus.cc:606] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [term 3 LEADER]: Received request to transfer leadership to TS 981b6c7cf04e4f12bd645a47411fc341
I20260709 13:02:14.753706   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:14.754169   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:14.754715   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:14.855271 12330 raft_consensus.cc:993] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3: : Instructing follower 981b6c7cf04e4f12bd645a47411fc341 to start an election
I20260709 13:02:14.855865 12330 raft_consensus.cc:1081] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [term 3 LEADER]: Signalling peer 981b6c7cf04e4f12bd645a47411fc341 to start an election
I20260709 13:02:14.857523 12194 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9f2bca87d394ebdae299b722de75c9b"
dest_uuid: "981b6c7cf04e4f12bd645a47411fc341"
 from {username='slave'} at 127.0.0.1:46098
I20260709 13:02:14.857970 12194 raft_consensus.cc:493] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:14.858340 12194 raft_consensus.cc:3060] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:14.863144 12194 raft_consensus.cc:515] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:14.864610 12194 leader_election.cc:290] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 4 election: Requested vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117)
I20260709 13:02:14.865540 12401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f2bca87d394ebdae299b722de75c9b" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "614235125ef247d9bda52a3accb0cfb7"
I20260709 13:02:14.865708 12118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f2bca87d394ebdae299b722de75c9b" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3"
I20260709 13:02:14.866159 12401 raft_consensus.cc:3060] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:14.866272 12118 raft_consensus.cc:3055] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:14.866650 12118 raft_consensus.cc:740] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 11b6e81238e74ac9a19fa102021ec3b3, State: Running, Role: LEADER
I20260709 13:02:14.867455 12118 consensus_queue.cc:260] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:14.868530 12118 raft_consensus.cc:3060] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:14.871357 12401 raft_consensus.cc:2468] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 981b6c7cf04e4f12bd645a47411fc341 in term 4.
I20260709 13:02:14.872509 12159 leader_election.cc:304] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 614235125ef247d9bda52a3accb0cfb7, 981b6c7cf04e4f12bd645a47411fc341; no voters: 
I20260709 13:02:14.873157 12447 raft_consensus.cc:2804] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:14.873536 12447 raft_consensus.cc:697] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 4 LEADER]: Becoming Leader. State: Replica: 981b6c7cf04e4f12bd645a47411fc341, State: Running, Role: LEADER
I20260709 13:02:14.873821 12118 raft_consensus.cc:2468] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 981b6c7cf04e4f12bd645a47411fc341 in term 4.
I20260709 13:02:14.874254 12447 consensus_queue.cc:237] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:14.880678 11941 catalog_manager.cc:5697] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 reported cstate change: term changed from 3 to 4, leader changed from 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194) to 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "981b6c7cf04e4f12bd645a47411fc341" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:14.934617 12457 raft_consensus.cc:993] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3: : Instructing follower 981b6c7cf04e4f12bd645a47411fc341 to start an election
I20260709 13:02:14.935120 12330 raft_consensus.cc:1081] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 LEADER]: Signalling peer 981b6c7cf04e4f12bd645a47411fc341 to start an election
I20260709 13:02:14.936635 12194 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "158dbd8d299848848d9d949e89ade205"
dest_uuid: "981b6c7cf04e4f12bd645a47411fc341"
 from {username='slave'} at 127.0.0.1:46098
I20260709 13:02:14.937172 12194 raft_consensus.cc:493] T 158dbd8d299848848d9d949e89ade205 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:14.937438 12194 raft_consensus.cc:3060] T 158dbd8d299848848d9d949e89ade205 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:14.942580 12194 raft_consensus.cc:515] T 158dbd8d299848848d9d949e89ade205 P 981b6c7cf04e4f12bd645a47411fc341 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:14.944058 12194 leader_election.cc:290] T 158dbd8d299848848d9d949e89ade205 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 2 election: Requested vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117)
I20260709 13:02:14.945084 12401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158dbd8d299848848d9d949e89ade205" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "614235125ef247d9bda52a3accb0cfb7"
I20260709 13:02:14.945163 12118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158dbd8d299848848d9d949e89ade205" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3"
I20260709 13:02:14.945775 12401 raft_consensus.cc:3060] T 158dbd8d299848848d9d949e89ade205 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:14.945827 12118 raft_consensus.cc:3055] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:14.946215 12118 raft_consensus.cc:740] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 11b6e81238e74ac9a19fa102021ec3b3, State: Running, Role: LEADER
I20260709 13:02:14.946873 12118 consensus_queue.cc:260] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:14.947860 12118 raft_consensus.cc:3060] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:14.951243 12401 raft_consensus.cc:2468] T 158dbd8d299848848d9d949e89ade205 P 614235125ef247d9bda52a3accb0cfb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 981b6c7cf04e4f12bd645a47411fc341 in term 2.
I20260709 13:02:14.952353 12159 leader_election.cc:304] T 158dbd8d299848848d9d949e89ade205 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 614235125ef247d9bda52a3accb0cfb7, 981b6c7cf04e4f12bd645a47411fc341; no voters: 
I20260709 13:02:14.953102 12447 raft_consensus.cc:2804] T 158dbd8d299848848d9d949e89ade205 P 981b6c7cf04e4f12bd645a47411fc341 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:14.953591 12447 raft_consensus.cc:697] T 158dbd8d299848848d9d949e89ade205 P 981b6c7cf04e4f12bd645a47411fc341 [term 2 LEADER]: Becoming Leader. State: Replica: 981b6c7cf04e4f12bd645a47411fc341, State: Running, Role: LEADER
I20260709 13:02:14.953724 12118 raft_consensus.cc:2468] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 981b6c7cf04e4f12bd645a47411fc341 in term 2.
I20260709 13:02:14.954556 12447 consensus_queue.cc:237] T 158dbd8d299848848d9d949e89ade205 P 981b6c7cf04e4f12bd645a47411fc341 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:14.962818 11941 catalog_manager.cc:5697] T 158dbd8d299848848d9d949e89ade205 P 981b6c7cf04e4f12bd645a47411fc341 reported cstate change: term changed from 1 to 2, leader changed from 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194) to 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "981b6c7cf04e4f12bd645a47411fc341" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:15.326589 12402 raft_consensus.cc:1275] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [term 4 FOLLOWER]: Refusing update from remote peer 981b6c7cf04e4f12bd645a47411fc341: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:15.328783 12447 consensus_queue.cc:1048] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [LEADER]: Connected to new peer: Peer: permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:02:15.346164 11991 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:02:15.347994 12118 raft_consensus.cc:1275] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [term 4 FOLLOWER]: Refusing update from remote peer 981b6c7cf04e4f12bd645a47411fc341: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:15.352145 12476 consensus_queue.cc:1048] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:15.443612 12118 raft_consensus.cc:1275] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 FOLLOWER]: Refusing update from remote peer 981b6c7cf04e4f12bd645a47411fc341: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:15.444896 12476 consensus_queue.cc:1048] T 158dbd8d299848848d9d949e89ade205 P 981b6c7cf04e4f12bd645a47411fc341 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:15.453725 12402 raft_consensus.cc:1275] T 158dbd8d299848848d9d949e89ade205 P 614235125ef247d9bda52a3accb0cfb7 [term 2 FOLLOWER]: Refusing update from remote peer 981b6c7cf04e4f12bd645a47411fc341: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:15.455190 12476 consensus_queue.cc:1048] T 158dbd8d299848848d9d949e89ade205 P 981b6c7cf04e4f12bd645a47411fc341 [LEADER]: Connected to new peer: Peer: permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:15.761214   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:15.769438 12194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1aac29d4192147aea2a627f525d88c7d"
dest_uuid: "981b6c7cf04e4f12bd645a47411fc341"
mode: GRACEFUL
new_leader_uuid: "11b6e81238e74ac9a19fa102021ec3b3"
 from {username='slave'} at 127.0.0.1:46704
I20260709 13:02:15.769927 12194 raft_consensus.cc:606] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [term 1 LEADER]: Received request to transfer leadership to TS 11b6e81238e74ac9a19fa102021ec3b3
I20260709 13:02:15.772413 12194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9f2bca87d394ebdae299b722de75c9b"
dest_uuid: "981b6c7cf04e4f12bd645a47411fc341"
mode: GRACEFUL
new_leader_uuid: "11b6e81238e74ac9a19fa102021ec3b3"
 from {username='slave'} at 127.0.0.1:46704
I20260709 13:02:15.772933 12194 raft_consensus.cc:606] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 4 LEADER]: Received request to transfer leadership to TS 11b6e81238e74ac9a19fa102021ec3b3
I20260709 13:02:15.773883   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:15.774376   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:15.774971   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:15.952132 12476 raft_consensus.cc:993] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341: : Instructing follower 11b6e81238e74ac9a19fa102021ec3b3 to start an election
I20260709 13:02:15.952638 12476 raft_consensus.cc:1081] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 4 LEADER]: Signalling peer 11b6e81238e74ac9a19fa102021ec3b3 to start an election
I20260709 13:02:15.954265 12118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9f2bca87d394ebdae299b722de75c9b"
dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3"
 from {username='slave'} at 127.0.0.1:39484
I20260709 13:02:15.954881 12118 raft_consensus.cc:493] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:15.955231 12118 raft_consensus.cc:3060] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:15.960210 12118 raft_consensus.cc:515] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:15.961838 12118 leader_election.cc:290] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 5 election: Requested vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195:40471)
I20260709 13:02:15.962814 12402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f2bca87d394ebdae299b722de75c9b" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "614235125ef247d9bda52a3accb0cfb7"
I20260709 13:02:15.963176 12194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9f2bca87d394ebdae299b722de75c9b" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "981b6c7cf04e4f12bd645a47411fc341"
I20260709 13:02:15.963443 12402 raft_consensus.cc:3060] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:15.963709 12194 raft_consensus.cc:3055] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:15.963973 12194 raft_consensus.cc:740] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 981b6c7cf04e4f12bd645a47411fc341, State: Running, Role: LEADER
I20260709 13:02:15.964609 12194 consensus_queue.cc:260] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:15.965453 12194 raft_consensus.cc:3060] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:15.970635 12402 raft_consensus.cc:2468] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11b6e81238e74ac9a19fa102021ec3b3 in term 5.
I20260709 13:02:15.971582 12194 raft_consensus.cc:2468] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11b6e81238e74ac9a19fa102021ec3b3 in term 5.
I20260709 13:02:15.972041 12085 leader_election.cc:304] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3, 614235125ef247d9bda52a3accb0cfb7; no voters: 
I20260709 13:02:15.972865 12330 raft_consensus.cc:2804] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:15.973733 12330 raft_consensus.cc:697] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [term 5 LEADER]: Becoming Leader. State: Replica: 11b6e81238e74ac9a19fa102021ec3b3, State: Running, Role: LEADER
I20260709 13:02:15.974395 12330 consensus_queue.cc:237] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:15.980239 11941 catalog_manager.cc:5697] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 reported cstate change: term changed from 4 to 5, leader changed from 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195) to 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194). New cstate: current_term: 5 leader_uuid: "11b6e81238e74ac9a19fa102021ec3b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:16.026934 12446 raft_consensus.cc:993] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341: : Instructing follower 11b6e81238e74ac9a19fa102021ec3b3 to start an election
I20260709 13:02:16.027379 12446 raft_consensus.cc:1081] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [term 1 LEADER]: Signalling peer 11b6e81238e74ac9a19fa102021ec3b3 to start an election
I20260709 13:02:16.028982 12118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1aac29d4192147aea2a627f525d88c7d"
dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3"
 from {username='slave'} at 127.0.0.1:39484
I20260709 13:02:16.029488 12118 raft_consensus.cc:493] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:16.029767 12118 raft_consensus.cc:3060] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:16.035511 12118 raft_consensus.cc:515] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:16.037250 12118 leader_election.cc:290] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 2 election: Requested vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195:40471)
I20260709 13:02:16.037897 12402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aac29d4192147aea2a627f525d88c7d" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "614235125ef247d9bda52a3accb0cfb7"
I20260709 13:02:16.038129 12194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aac29d4192147aea2a627f525d88c7d" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "981b6c7cf04e4f12bd645a47411fc341"
I20260709 13:02:16.038607 12402 raft_consensus.cc:3060] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:16.038637 12194 raft_consensus.cc:3055] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:16.039182 12194 raft_consensus.cc:740] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 981b6c7cf04e4f12bd645a47411fc341, State: Running, Role: LEADER
I20260709 13:02:16.040056 12194 consensus_queue.cc:260] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:16.041333 12194 raft_consensus.cc:3060] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:16.046144 12402 raft_consensus.cc:2468] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11b6e81238e74ac9a19fa102021ec3b3 in term 2.
I20260709 13:02:16.047418 12085 leader_election.cc:304] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3, 614235125ef247d9bda52a3accb0cfb7; no voters: 
I20260709 13:02:16.047811 12194 raft_consensus.cc:2468] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11b6e81238e74ac9a19fa102021ec3b3 in term 2.
I20260709 13:02:16.048214 12481 raft_consensus.cc:2804] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:16.048767 12481 raft_consensus.cc:697] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 LEADER]: Becoming Leader. State: Replica: 11b6e81238e74ac9a19fa102021ec3b3, State: Running, Role: LEADER
I20260709 13:02:16.049767 12481 consensus_queue.cc:237] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:16.057379 11941 catalog_manager.cc:5697] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3 reported cstate change: term changed from 1 to 2, leader changed from 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195) to 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "11b6e81238e74ac9a19fa102021ec3b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:16.347376 11991 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:02:16.468824 12402 raft_consensus.cc:1275] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7 [term 2 FOLLOWER]: Refusing update from remote peer 11b6e81238e74ac9a19fa102021ec3b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:16.470228 12481 consensus_queue.cc:1048] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:16.481691 12194 raft_consensus.cc:1275] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [term 2 FOLLOWER]: Refusing update from remote peer 11b6e81238e74ac9a19fa102021ec3b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:16.486243 12490 consensus_queue.cc:1048] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:16.541455 12402 raft_consensus.cc:1275] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [term 5 FOLLOWER]: Refusing update from remote peer 11b6e81238e74ac9a19fa102021ec3b3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:02:16.542838 12490 consensus_queue.cc:1048] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:16.554769 12194 raft_consensus.cc:1275] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 5 FOLLOWER]: Refusing update from remote peer 11b6e81238e74ac9a19fa102021ec3b3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:02:16.556200 12490 consensus_queue.cc:1048] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:16.781370   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:16.789085 12118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1aac29d4192147aea2a627f525d88c7d"
dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3"
mode: GRACEFUL
new_leader_uuid: "981b6c7cf04e4f12bd645a47411fc341"
 from {username='slave'} at 127.0.0.1:35480
I20260709 13:02:16.789623 12118 raft_consensus.cc:606] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 LEADER]: Received request to transfer leadership to TS 981b6c7cf04e4f12bd645a47411fc341
I20260709 13:02:16.792021 12118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "472c5d72e71b465abdd55365c4f9bca4"
dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3"
mode: GRACEFUL
new_leader_uuid: "981b6c7cf04e4f12bd645a47411fc341"
 from {username='slave'} at 127.0.0.1:35480
I20260709 13:02:16.792531 12118 raft_consensus.cc:606] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 LEADER]: Received request to transfer leadership to TS 981b6c7cf04e4f12bd645a47411fc341
I20260709 13:02:16.793552   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:16.794010   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:16.794550   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:17.076810 12499 raft_consensus.cc:993] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3: : Instructing follower 981b6c7cf04e4f12bd645a47411fc341 to start an election
I20260709 13:02:17.077418 12497 raft_consensus.cc:1081] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 LEADER]: Signalling peer 981b6c7cf04e4f12bd645a47411fc341 to start an election
I20260709 13:02:17.079102 12194 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1aac29d4192147aea2a627f525d88c7d"
dest_uuid: "981b6c7cf04e4f12bd645a47411fc341"
 from {username='slave'} at 127.0.0.1:46098
I20260709 13:02:17.079571 12194 raft_consensus.cc:493] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:17.079838 12194 raft_consensus.cc:3060] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:17.084803 12194 raft_consensus.cc:515] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:17.086369 12194 leader_election.cc:290] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 3 election: Requested vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117)
I20260709 13:02:17.087563 12118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aac29d4192147aea2a627f525d88c7d" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3"
I20260709 13:02:17.087405 12401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aac29d4192147aea2a627f525d88c7d" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "614235125ef247d9bda52a3accb0cfb7"
I20260709 13:02:17.088613 12118 raft_consensus.cc:3055] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:17.088639 12401 raft_consensus.cc:3060] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:17.089084 12118 raft_consensus.cc:740] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 11b6e81238e74ac9a19fa102021ec3b3, State: Running, Role: LEADER
I20260709 13:02:17.089970 12118 consensus_queue.cc:260] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:17.091313 12118 raft_consensus.cc:3060] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:17.096712 12401 raft_consensus.cc:2468] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 981b6c7cf04e4f12bd645a47411fc341 in term 3.
I20260709 13:02:17.098088 12159 leader_election.cc:304] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 614235125ef247d9bda52a3accb0cfb7, 981b6c7cf04e4f12bd645a47411fc341; no voters: 
I20260709 13:02:17.098691 12118 raft_consensus.cc:2468] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 981b6c7cf04e4f12bd645a47411fc341 in term 3.
I20260709 13:02:17.098949 12496 raft_consensus.cc:2804] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:17.099577 12496 raft_consensus.cc:697] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [term 3 LEADER]: Becoming Leader. State: Replica: 981b6c7cf04e4f12bd645a47411fc341, State: Running, Role: LEADER
I20260709 13:02:17.100425 12496 consensus_queue.cc:237] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:17.106630 11941 catalog_manager.cc:5697] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 reported cstate change: term changed from 2 to 3, leader changed from 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194) to 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "981b6c7cf04e4f12bd645a47411fc341" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:17.115466 12499 raft_consensus.cc:993] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3: : Instructing follower 981b6c7cf04e4f12bd645a47411fc341 to start an election
I20260709 13:02:17.116022 12499 raft_consensus.cc:1081] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 LEADER]: Signalling peer 981b6c7cf04e4f12bd645a47411fc341 to start an election
I20260709 13:02:17.117538 12194 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "472c5d72e71b465abdd55365c4f9bca4"
dest_uuid: "981b6c7cf04e4f12bd645a47411fc341"
 from {username='slave'} at 127.0.0.1:46098
I20260709 13:02:17.118002 12194 raft_consensus.cc:493] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:17.118340 12194 raft_consensus.cc:3060] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:17.123710 12194 raft_consensus.cc:515] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:17.126417 12401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "472c5d72e71b465abdd55365c4f9bca4" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "614235125ef247d9bda52a3accb0cfb7"
I20260709 13:02:17.126479 12118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "472c5d72e71b465abdd55365c4f9bca4" candidate_uuid: "981b6c7cf04e4f12bd645a47411fc341" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3"
I20260709 13:02:17.127076 12401 raft_consensus.cc:3060] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:17.127578 12118 raft_consensus.cc:3055] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:17.127974 12118 raft_consensus.cc:740] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 11b6e81238e74ac9a19fa102021ec3b3, State: Running, Role: LEADER
I20260709 13:02:17.128793 12118 consensus_queue.cc:260] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:17.129981 12118 raft_consensus.cc:3060] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:17.126479 12194 leader_election.cc:290] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 3 election: Requested vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117)
I20260709 13:02:17.133343 12401 raft_consensus.cc:2468] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 981b6c7cf04e4f12bd645a47411fc341 in term 3.
I20260709 13:02:17.134593 12159 leader_election.cc:304] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 614235125ef247d9bda52a3accb0cfb7, 981b6c7cf04e4f12bd645a47411fc341; no voters: 
I20260709 13:02:17.135253 12496 raft_consensus.cc:2804] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:17.135651 12496 raft_consensus.cc:697] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [term 3 LEADER]: Becoming Leader. State: Replica: 981b6c7cf04e4f12bd645a47411fc341, State: Running, Role: LEADER
I20260709 13:02:17.136672 12118 raft_consensus.cc:2468] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 981b6c7cf04e4f12bd645a47411fc341 in term 3.
I20260709 13:02:17.136518 12496 consensus_queue.cc:237] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:17.144100 11941 catalog_manager.cc:5697] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 reported cstate change: term changed from 2 to 3, leader changed from 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194) to 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "981b6c7cf04e4f12bd645a47411fc341" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:17.348346 11991 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:02:17.491194 12401 raft_consensus.cc:1275] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7 [term 3 FOLLOWER]: Refusing update from remote peer 981b6c7cf04e4f12bd645a47411fc341: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:17.492465 12496 consensus_queue.cc:1048] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [LEADER]: Connected to new peer: Peer: permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:17.502439 12118 raft_consensus.cc:1275] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3 [term 3 FOLLOWER]: Refusing update from remote peer 981b6c7cf04e4f12bd645a47411fc341: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:17.504207 12496 consensus_queue.cc:1048] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:17.590488 12401 raft_consensus.cc:1275] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [term 3 FOLLOWER]: Refusing update from remote peer 981b6c7cf04e4f12bd645a47411fc341: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:17.591670 12508 consensus_queue.cc:1048] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [LEADER]: Connected to new peer: Peer: permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:17.603034 12118 raft_consensus.cc:1275] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 3 FOLLOWER]: Refusing update from remote peer 981b6c7cf04e4f12bd645a47411fc341: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:17.604718 12446 consensus_queue.cc:1048] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:17.801123   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:17.808766 12194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "472c5d72e71b465abdd55365c4f9bca4"
dest_uuid: "981b6c7cf04e4f12bd645a47411fc341"
mode: GRACEFUL
new_leader_uuid: "11b6e81238e74ac9a19fa102021ec3b3"
 from {username='slave'} at 127.0.0.1:46704
I20260709 13:02:17.809309 12194 raft_consensus.cc:606] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [term 3 LEADER]: Received request to transfer leadership to TS 11b6e81238e74ac9a19fa102021ec3b3
I20260709 13:02:17.811733 12194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d14cd6559d347979cf41da97a2533b4"
dest_uuid: "981b6c7cf04e4f12bd645a47411fc341"
mode: GRACEFUL
new_leader_uuid: "11b6e81238e74ac9a19fa102021ec3b3"
 from {username='slave'} at 127.0.0.1:46704
I20260709 13:02:17.812230 12194 raft_consensus.cc:606] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 LEADER]: Received request to transfer leadership to TS 11b6e81238e74ac9a19fa102021ec3b3
I20260709 13:02:17.813208   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:17.813671   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:17.814196   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:17.999462 12496 raft_consensus.cc:993] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341: : Instructing follower 11b6e81238e74ac9a19fa102021ec3b3 to start an election
I20260709 13:02:17.999914 12446 raft_consensus.cc:1081] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 LEADER]: Signalling peer 11b6e81238e74ac9a19fa102021ec3b3 to start an election
I20260709 13:02:18.001379 12118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d14cd6559d347979cf41da97a2533b4"
dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3"
 from {username='slave'} at 127.0.0.1:39484
I20260709 13:02:18.001889 12118 raft_consensus.cc:493] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:18.002210 12118 raft_consensus.cc:3060] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:18.005045 12496 raft_consensus.cc:993] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341: : Instructing follower 11b6e81238e74ac9a19fa102021ec3b3 to start an election
I20260709 13:02:18.005657 12446 raft_consensus.cc:1081] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [term 3 LEADER]: Signalling peer 11b6e81238e74ac9a19fa102021ec3b3 to start an election
I20260709 13:02:18.007447 12119 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "472c5d72e71b465abdd55365c4f9bca4"
dest_uuid: "11b6e81238e74ac9a19fa102021ec3b3"
 from {username='slave'} at 127.0.0.1:39484
I20260709 13:02:18.008004 12119 raft_consensus.cc:493] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:18.008363 12119 raft_consensus.cc:3060] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:18.008976 12118 raft_consensus.cc:515] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:18.011015 12118 leader_election.cc:290] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 2 election: Requested vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195:40471)
I20260709 13:02:18.012895 12402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d14cd6559d347979cf41da97a2533b4" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "614235125ef247d9bda52a3accb0cfb7"
I20260709 13:02:18.012984 12194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d14cd6559d347979cf41da97a2533b4" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "981b6c7cf04e4f12bd645a47411fc341"
I20260709 13:02:18.013587 12402 raft_consensus.cc:3060] T 8d14cd6559d347979cf41da97a2533b4 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:18.013612 12194 raft_consensus.cc:3055] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:18.014125 12194 raft_consensus.cc:740] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 981b6c7cf04e4f12bd645a47411fc341, State: Running, Role: LEADER
I20260709 13:02:18.014801 12194 consensus_queue.cc:260] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:18.015733 12194 raft_consensus.cc:3060] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:18.015491 12119 raft_consensus.cc:515] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:18.017834 12119 leader_election.cc:290] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 4 election: Requested vote from peers 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599), 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195:40471)
I20260709 13:02:18.019141 12401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "472c5d72e71b465abdd55365c4f9bca4" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "614235125ef247d9bda52a3accb0cfb7"
I20260709 13:02:18.019872 12401 raft_consensus.cc:3060] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:18.021373 12192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "472c5d72e71b465abdd55365c4f9bca4" candidate_uuid: "11b6e81238e74ac9a19fa102021ec3b3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "981b6c7cf04e4f12bd645a47411fc341"
I20260709 13:02:18.022089 12192 raft_consensus.cc:3055] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:18.022032 12402 raft_consensus.cc:2468] T 8d14cd6559d347979cf41da97a2533b4 P 614235125ef247d9bda52a3accb0cfb7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11b6e81238e74ac9a19fa102021ec3b3 in term 2.
I20260709 13:02:18.022583 12192 raft_consensus.cc:740] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 981b6c7cf04e4f12bd645a47411fc341, State: Running, Role: LEADER
I20260709 13:02:18.023479 12194 raft_consensus.cc:2468] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11b6e81238e74ac9a19fa102021ec3b3 in term 2.
I20260709 13:02:18.023895 12085 leader_election.cc:304] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3, 614235125ef247d9bda52a3accb0cfb7; no voters: 
I20260709 13:02:18.023483 12192 consensus_queue.cc:260] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:18.024765 12498 raft_consensus.cc:2804] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:18.025079 12192 raft_consensus.cc:3060] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:18.027282 12498 raft_consensus.cc:697] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 LEADER]: Becoming Leader. State: Replica: 11b6e81238e74ac9a19fa102021ec3b3, State: Running, Role: LEADER
I20260709 13:02:18.028254 12498 consensus_queue.cc:237] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:18.030735 12401 raft_consensus.cc:2468] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11b6e81238e74ac9a19fa102021ec3b3 in term 4.
I20260709 13:02:18.032176 12085 leader_election.cc:304] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11b6e81238e74ac9a19fa102021ec3b3, 614235125ef247d9bda52a3accb0cfb7; no voters: 
I20260709 13:02:18.033232 12514 raft_consensus.cc:2804] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:18.033245 12192 raft_consensus.cc:2468] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11b6e81238e74ac9a19fa102021ec3b3 in term 4.
I20260709 13:02:18.034528 12514 raft_consensus.cc:697] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 4 LEADER]: Becoming Leader. State: Replica: 11b6e81238e74ac9a19fa102021ec3b3, State: Running, Role: LEADER
I20260709 13:02:18.035374 12514 consensus_queue.cc:237] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } }
I20260709 13:02:18.038970 11941 catalog_manager.cc:5697] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 reported cstate change: term changed from 1 to 2, leader changed from 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195) to 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "11b6e81238e74ac9a19fa102021ec3b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:18.052738 11941 catalog_manager.cc:5697] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 reported cstate change: term changed from 3 to 4, leader changed from 981b6c7cf04e4f12bd645a47411fc341 (127.0.107.195) to 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "11b6e81238e74ac9a19fa102021ec3b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11b6e81238e74ac9a19fa102021ec3b3" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:18.349758 11991 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:02:18.431010 12192 raft_consensus.cc:1275] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 [term 2 FOLLOWER]: Refusing update from remote peer 11b6e81238e74ac9a19fa102021ec3b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:18.432461 12514 consensus_queue.cc:1048] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:18.449420 12401 raft_consensus.cc:1275] T 8d14cd6559d347979cf41da97a2533b4 P 614235125ef247d9bda52a3accb0cfb7 [term 2 FOLLOWER]: Refusing update from remote peer 11b6e81238e74ac9a19fa102021ec3b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:18.452124 12498 consensus_queue.cc:1048] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:18.577742 12194 raft_consensus.cc:1275] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [term 4 FOLLOWER]: Refusing update from remote peer 11b6e81238e74ac9a19fa102021ec3b3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:18.578995 12516 consensus_queue.cc:1048] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "981b6c7cf04e4f12bd645a47411fc341" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:18.584758 12402 raft_consensus.cc:1275] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [term 4 FOLLOWER]: Refusing update from remote peer 11b6e81238e74ac9a19fa102021ec3b3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:18.588157 12514 consensus_queue.cc:1048] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "614235125ef247d9bda52a3accb0cfb7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 45599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:18.820645   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:18.854472   431 tablet_server.cc:179] TabletServer@127.0.107.193:45599 shutting down...
W20260709 13:02:18.878602 12159 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 88 similar messages]
I20260709 13:02:18.880376   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:18.881449   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:02:18.882378 12159 consensus_peers.cc:597] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:18.882402   431 raft_consensus.cc:2243] T 3768bc61992440faa9ef167f5f395162 P 614235125ef247d9bda52a3accb0cfb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:18.883347   431 raft_consensus.cc:2272] T 3768bc61992440faa9ef167f5f395162 P 614235125ef247d9bda52a3accb0cfb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:18.886065   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:18.886776   431 raft_consensus.cc:2243] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:18.887413   431 raft_consensus.cc:2272] T e9f2bca87d394ebdae299b722de75c9b P 614235125ef247d9bda52a3accb0cfb7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:18.890014   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:18.890550   431 raft_consensus.cc:2243] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:18.891224   431 raft_consensus.cc:2272] T 1aac29d4192147aea2a627f525d88c7d P 614235125ef247d9bda52a3accb0cfb7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:18.893842   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:18.894372   431 raft_consensus.cc:2243] T 158dbd8d299848848d9d949e89ade205 P 614235125ef247d9bda52a3accb0cfb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:18.894845   431 raft_consensus.cc:2272] T 158dbd8d299848848d9d949e89ade205 P 614235125ef247d9bda52a3accb0cfb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:18.897739   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:18.898571   431 raft_consensus.cc:2243] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:18.899189   431 raft_consensus.cc:2272] T 4b75f0d8243c43318c29f22313533f08 P 614235125ef247d9bda52a3accb0cfb7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:18.900434 12159 consensus_peers.cc:597] T 158dbd8d299848848d9d949e89ade205 P 981b6c7cf04e4f12bd645a47411fc341 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:18.902015   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:18.902709   431 raft_consensus.cc:2243] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:18.903198   431 raft_consensus.cc:2272] T 472c5d72e71b465abdd55365c4f9bca4 P 614235125ef247d9bda52a3accb0cfb7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:18.906225   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:18.906849   431 raft_consensus.cc:2243] T 8d14cd6559d347979cf41da97a2533b4 P 614235125ef247d9bda52a3accb0cfb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:18.907316   431 raft_consensus.cc:2272] T 8d14cd6559d347979cf41da97a2533b4 P 614235125ef247d9bda52a3accb0cfb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:18.910395   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:18.911010   431 raft_consensus.cc:2243] T ce79da57b33749a9be411c92b0178103 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:18.911506   431 raft_consensus.cc:2272] T ce79da57b33749a9be411c92b0178103 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:18.913940   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:18.914462   431 raft_consensus.cc:2243] T 77ec90b937044a22908ba572a3df7080 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:18.915002   431 raft_consensus.cc:2272] T 77ec90b937044a22908ba572a3df7080 P 614235125ef247d9bda52a3accb0cfb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:18.917567   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:18.918078   431 raft_consensus.cc:2243] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:18.918550   431 raft_consensus.cc:2272] T 3f30ed75e9c4428fa5fc69291ccef018 P 614235125ef247d9bda52a3accb0cfb7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:18.954224   431 tablet_server.cc:196] TabletServer@127.0.107.193:45599 shutdown complete.
W20260709 13:02:18.964039 12085 consensus_peers.cc:597] T 3768bc61992440faa9ef167f5f395162 P 11b6e81238e74ac9a19fa102021ec3b3 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:18.974756 12085 consensus_peers.cc:597] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:18.975314 12085 consensus_peers.cc:597] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:18.992941   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:02:19.016271   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:19.017068   431 tablet_replica.cc:333] T 3768bc61992440faa9ef167f5f395162 P 11b6e81238e74ac9a19fa102021ec3b3: stopping tablet replica
I20260709 13:02:19.017930   431 raft_consensus.cc:2243] T 3768bc61992440faa9ef167f5f395162 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:19.018911   431 raft_consensus.cc:2272] T 3768bc61992440faa9ef167f5f395162 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:19.021534   431 tablet_replica.cc:333] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3: stopping tablet replica
I20260709 13:02:19.022214   431 raft_consensus.cc:2243] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:02:19.023142   431 raft_consensus.cc:2272] T 472c5d72e71b465abdd55365c4f9bca4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:19.026201   431 tablet_replica.cc:333] T 4b75f0d8243c43318c29f22313533f08 P 11b6e81238e74ac9a19fa102021ec3b3: stopping tablet replica
I20260709 13:02:19.026774   431 raft_consensus.cc:2243] T 4b75f0d8243c43318c29f22313533f08 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:19.027329   431 raft_consensus.cc:2272] T 4b75f0d8243c43318c29f22313533f08 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:19.029810   431 tablet_replica.cc:333] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3: stopping tablet replica
I20260709 13:02:19.030464   431 raft_consensus.cc:2243] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:19.031306   431 raft_consensus.cc:2272] T 8d14cd6559d347979cf41da97a2533b4 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:19.034056   431 tablet_replica.cc:333] T 77ec90b937044a22908ba572a3df7080 P 11b6e81238e74ac9a19fa102021ec3b3: stopping tablet replica
I20260709 13:02:19.034660   431 raft_consensus.cc:2243] T 77ec90b937044a22908ba572a3df7080 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:19.035161   431 raft_consensus.cc:2272] T 77ec90b937044a22908ba572a3df7080 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:19.037935   431 tablet_replica.cc:333] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3: stopping tablet replica
I20260709 13:02:19.038633   431 raft_consensus.cc:2243] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:19.039528   431 raft_consensus.cc:2272] T 3f30ed75e9c4428fa5fc69291ccef018 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:19.042582   431 tablet_replica.cc:333] T ce79da57b33749a9be411c92b0178103 P 11b6e81238e74ac9a19fa102021ec3b3: stopping tablet replica
I20260709 13:02:19.043282   431 raft_consensus.cc:2243] T ce79da57b33749a9be411c92b0178103 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:19.044373   431 raft_consensus.cc:2272] T ce79da57b33749a9be411c92b0178103 P 11b6e81238e74ac9a19fa102021ec3b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:19.047663   431 tablet_replica.cc:333] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3: stopping tablet replica
I20260709 13:02:19.048357   431 raft_consensus.cc:2243] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:02:19.049587   431 raft_consensus.cc:2272] T e9f2bca87d394ebdae299b722de75c9b P 11b6e81238e74ac9a19fa102021ec3b3 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:19.051956   431 tablet_replica.cc:333] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3: stopping tablet replica
I20260709 13:02:19.052533   431 raft_consensus.cc:2243] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:19.053007   431 raft_consensus.cc:2272] T 1aac29d4192147aea2a627f525d88c7d P 11b6e81238e74ac9a19fa102021ec3b3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:19.055389   431 tablet_replica.cc:333] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3: stopping tablet replica
I20260709 13:02:19.055889   431 raft_consensus.cc:2243] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:19.056370   431 raft_consensus.cc:2272] T 158dbd8d299848848d9d949e89ade205 P 11b6e81238e74ac9a19fa102021ec3b3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:19.077152 12159 consensus_peers.cc:597] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 -> Peer 614235125ef247d9bda52a3accb0cfb7 (127.0.107.193:45599): Couldn't send request to peer 614235125ef247d9bda52a3accb0cfb7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:45599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:19.092644   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:02:19.100844 12160 consensus_peers.cc:597] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 -> Peer 11b6e81238e74ac9a19fa102021ec3b3 (127.0.107.194:42117): Couldn't send request to peer 11b6e81238e74ac9a19fa102021ec3b3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:42117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:19.120976   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:02:19.146325   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:19.147058   431 tablet_replica.cc:333] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341: stopping tablet replica
I20260709 13:02:19.147774   431 raft_consensus.cc:2243] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:19.148305   431 raft_consensus.cc:2272] T 3768bc61992440faa9ef167f5f395162 P 981b6c7cf04e4f12bd645a47411fc341 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:19.150841   431 tablet_replica.cc:333] T 158dbd8d299848848d9d949e89ade205 P 981b6c7cf04e4f12bd645a47411fc341: stopping tablet replica
I20260709 13:02:19.151476   431 raft_consensus.cc:2243] T 158dbd8d299848848d9d949e89ade205 P 981b6c7cf04e4f12bd645a47411fc341 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:19.152369   431 raft_consensus.cc:2272] T 158dbd8d299848848d9d949e89ade205 P 981b6c7cf04e4f12bd645a47411fc341 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:19.154628   431 tablet_replica.cc:333] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341: stopping tablet replica
I20260709 13:02:19.155150   431 raft_consensus.cc:2243] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:19.155982   431 raft_consensus.cc:2272] T 1aac29d4192147aea2a627f525d88c7d P 981b6c7cf04e4f12bd645a47411fc341 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:19.158293   431 tablet_replica.cc:333] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341: stopping tablet replica
I20260709 13:02:19.158865   431 raft_consensus.cc:2243] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:19.159329   431 raft_consensus.cc:2272] T e9f2bca87d394ebdae299b722de75c9b P 981b6c7cf04e4f12bd645a47411fc341 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:19.161641   431 tablet_replica.cc:333] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341: stopping tablet replica
I20260709 13:02:19.162204   431 raft_consensus.cc:2243] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:19.163048   431 raft_consensus.cc:2272] T 4b75f0d8243c43318c29f22313533f08 P 981b6c7cf04e4f12bd645a47411fc341 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:19.165335   431 tablet_replica.cc:333] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341: stopping tablet replica
I20260709 13:02:19.165884   431 raft_consensus.cc:2243] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:19.166302   431 raft_consensus.cc:2272] T 472c5d72e71b465abdd55365c4f9bca4 P 981b6c7cf04e4f12bd645a47411fc341 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:19.168797   431 tablet_replica.cc:333] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341: stopping tablet replica
I20260709 13:02:19.169335   431 raft_consensus.cc:2243] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:19.170269   431 raft_consensus.cc:2272] T 77ec90b937044a22908ba572a3df7080 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:19.172358   431 tablet_replica.cc:333] T 3f30ed75e9c4428fa5fc69291ccef018 P 981b6c7cf04e4f12bd645a47411fc341: stopping tablet replica
I20260709 13:02:19.172889   431 raft_consensus.cc:2243] T 3f30ed75e9c4428fa5fc69291ccef018 P 981b6c7cf04e4f12bd645a47411fc341 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:19.173310   431 raft_consensus.cc:2272] T 3f30ed75e9c4428fa5fc69291ccef018 P 981b6c7cf04e4f12bd645a47411fc341 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:19.175449   431 tablet_replica.cc:333] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341: stopping tablet replica
I20260709 13:02:19.175901   431 raft_consensus.cc:2243] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:19.176277   431 raft_consensus.cc:2272] T 8d14cd6559d347979cf41da97a2533b4 P 981b6c7cf04e4f12bd645a47411fc341 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:19.179085   431 tablet_replica.cc:333] T ce79da57b33749a9be411c92b0178103 P 981b6c7cf04e4f12bd645a47411fc341: stopping tablet replica
I20260709 13:02:19.179581   431 raft_consensus.cc:2243] T ce79da57b33749a9be411c92b0178103 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:19.180033   431 raft_consensus.cc:2272] T ce79da57b33749a9be411c92b0178103 P 981b6c7cf04e4f12bd645a47411fc341 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:19.211907   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:02:19.240124   431 master.cc:562] Master@127.0.107.254:35617 shutting down...
I20260709 13:02:19.262986   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 37abd221f97f486bbc8848b10e9559a0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:19.263599   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 37abd221f97f486bbc8848b10e9559a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:19.263932   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 37abd221f97f486bbc8848b10e9559a0: stopping tablet replica
I20260709 13:02:19.285235   431 master.cc:584] Master@127.0.107.254:35617 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13126 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:02:19.328402   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:39851
I20260709 13:02:19.329646   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:19.335407 12533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:19.335407 12534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:19.337045 12536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:19.338515   431 server_base.cc:1061] running on GCE node
I20260709 13:02:19.339561   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:19.339761   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:19.339872   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602139339859 us; error 0 us; skew 500 ppm
I20260709 13:02:19.340394   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:19.343037   431 webserver.cc:533] Webserver started at http://127.0.107.254:39061/ using document root <none> and password file <none>
I20260709 13:02:19.343501   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:19.343655   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:19.343886   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:19.345052   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601786404416-431-0/minicluster-data/master-0-root/instance:
uuid: "3fb4273d789f4537b81406d0126ab73a"
format_stamp: "Formatted at 2026-07-09 13:02:19 on dist-test-slave-6j4g"
I20260709 13:02:19.349448   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:02:19.352869 12541 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:19.353655   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:02:19.353932   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601786404416-431-0/minicluster-data/master-0-root
uuid: "3fb4273d789f4537b81406d0126ab73a"
format_stamp: "Formatted at 2026-07-09 13:02:19 on dist-test-slave-6j4g"
I20260709 13:02:19.354187   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601786404416-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601786404416-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601786404416-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:19.386688   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:19.387902   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:19.426661   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:39851
I20260709 13:02:19.426767 12592 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:39851 every 8 connection(s)
I20260709 13:02:19.430642 12593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:19.442773 12593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fb4273d789f4537b81406d0126ab73a: Bootstrap starting.
I20260709 13:02:19.447844 12593 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3fb4273d789f4537b81406d0126ab73a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:19.452380 12593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fb4273d789f4537b81406d0126ab73a: No bootstrap required, opened a new log
I20260709 13:02:19.454617 12593 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3fb4273d789f4537b81406d0126ab73a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fb4273d789f4537b81406d0126ab73a" member_type: VOTER }
I20260709 13:02:19.455044 12593 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3fb4273d789f4537b81406d0126ab73a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:19.455289 12593 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3fb4273d789f4537b81406d0126ab73a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fb4273d789f4537b81406d0126ab73a, State: Initialized, Role: FOLLOWER
I20260709 13:02:19.455900 12593 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3fb4273d789f4537b81406d0126ab73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fb4273d789f4537b81406d0126ab73a" member_type: VOTER }
I20260709 13:02:19.456372 12593 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3fb4273d789f4537b81406d0126ab73a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:02:19.456594 12593 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3fb4273d789f4537b81406d0126ab73a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:02:19.456812 12593 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3fb4273d789f4537b81406d0126ab73a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:19.461743 12593 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3fb4273d789f4537b81406d0126ab73a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fb4273d789f4537b81406d0126ab73a" member_type: VOTER }
I20260709 13:02:19.462277 12593 leader_election.cc:304] T 00000000000000000000000000000000 P 3fb4273d789f4537b81406d0126ab73a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3fb4273d789f4537b81406d0126ab73a; no voters: 
I20260709 13:02:19.463390 12593 leader_election.cc:290] T 00000000000000000000000000000000 P 3fb4273d789f4537b81406d0126ab73a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:02:19.463856 12596 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3fb4273d789f4537b81406d0126ab73a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:19.465281 12596 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3fb4273d789f4537b81406d0126ab73a [term 1 LEADER]: Becoming Leader. State: Replica: 3fb4273d789f4537b81406d0126ab73a, State: Running, Role: LEADER
I20260709 13:02:19.466046 12596 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3fb4273d789f4537b81406d0126ab73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fb4273d789f4537b81406d0126ab73a" member_type: VOTER }
I20260709 13:02:19.466240 12593 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3fb4273d789f4537b81406d0126ab73a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:02:19.473286 12597 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fb4273d789f4537b81406d0126ab73a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3fb4273d789f4537b81406d0126ab73a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fb4273d789f4537b81406d0126ab73a" member_type: VOTER } }
I20260709 13:02:19.473408 12598 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fb4273d789f4537b81406d0126ab73a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3fb4273d789f4537b81406d0126ab73a. Latest consensus state: current_term: 1 leader_uuid: "3fb4273d789f4537b81406d0126ab73a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fb4273d789f4537b81406d0126ab73a" member_type: VOTER } }
I20260709 13:02:19.474136 12597 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fb4273d789f4537b81406d0126ab73a [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:19.474217 12598 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fb4273d789f4537b81406d0126ab73a [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:19.481506 12605 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:02:19.486646 12605 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:02:19.487723   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:02:19.496223 12605 catalog_manager.cc:1383] Generated new cluster ID: b4be92043e184edbadbcc0db411e001c
I20260709 13:02:19.496513 12605 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:02:19.517858 12605 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:02:19.519138 12605 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:02:19.536091 12605 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3fb4273d789f4537b81406d0126ab73a: Generated new TSK 0
I20260709 13:02:19.536902 12605 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:02:19.554154   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:19.561194 12614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:19.562862 12615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:19.563355 12617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:19.563691   431 server_base.cc:1061] running on GCE node
I20260709 13:02:19.565173   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:19.565440   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:19.565600   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602139565581 us; error 0 us; skew 500 ppm
I20260709 13:02:19.566146   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:19.568866   431 webserver.cc:533] Webserver started at http://127.0.107.193:43991/ using document root <none> and password file <none>
I20260709 13:02:19.569507   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:19.569679   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:19.569895   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:19.570945   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601786404416-431-0/minicluster-data/ts-0-root/instance:
uuid: "366580e15cb940e1a1ce115887229cf6"
format_stamp: "Formatted at 2026-07-09 13:02:19 on dist-test-slave-6j4g"
I20260709 13:02:19.575431   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 13:02:19.578905 12622 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:19.579632   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:02:19.579953   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601786404416-431-0/minicluster-data/ts-0-root
uuid: "366580e15cb940e1a1ce115887229cf6"
format_stamp: "Formatted at 2026-07-09 13:02:19 on dist-test-slave-6j4g"
I20260709 13:02:19.580219   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601786404416-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601786404416-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601786404416-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:19.596800   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:19.598030   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:19.599466   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:19.601718   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:19.601943   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:19.602171   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:19.602335   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:19.641767   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:44339
I20260709 13:02:19.641848 12684 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:44339 every 8 connection(s)
I20260709 13:02:19.646972   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:19.654580 12689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:19.655864 12690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:19.659227 12692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:19.660220   431 server_base.cc:1061] running on GCE node
I20260709 13:02:19.660593 12685 heartbeater.cc:344] Connected to a master server at 127.0.107.254:39851
I20260709 13:02:19.661023 12685 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:19.661387   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:19.661628   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:19.661762   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602139661750 us; error 0 us; skew 500 ppm
I20260709 13:02:19.661738 12685 heartbeater.cc:507] Master 127.0.107.254:39851 requested a full tablet report, sending...
I20260709 13:02:19.662582   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:19.664296 12558 ts_manager.cc:194] Registered new tserver with Master: 366580e15cb940e1a1ce115887229cf6 (127.0.107.193:44339)
I20260709 13:02:19.665508   431 webserver.cc:533] Webserver started at http://127.0.107.194:40337/ using document root <none> and password file <none>
I20260709 13:02:19.666229   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:19.666474   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:19.666766   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:19.666883 12558 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43024
I20260709 13:02:19.668381   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601786404416-431-0/minicluster-data/ts-1-root/instance:
uuid: "e19d29d496da429b9937e4b720551476"
format_stamp: "Formatted at 2026-07-09 13:02:19 on dist-test-slave-6j4g"
I20260709 13:02:19.673100   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:02:19.676580 12697 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:19.677378   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:02:19.677716   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601786404416-431-0/minicluster-data/ts-1-root
uuid: "e19d29d496da429b9937e4b720551476"
format_stamp: "Formatted at 2026-07-09 13:02:19 on dist-test-slave-6j4g"
I20260709 13:02:19.678009   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601786404416-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601786404416-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601786404416-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:19.692319   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:19.693563   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:19.695189   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:19.697510   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:19.697726   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:19.697947   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:19.698096   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:19.738464   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:45875
I20260709 13:02:19.738583 12759 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:45875 every 8 connection(s)
I20260709 13:02:19.743350   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:19.751425 12763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:19.752527 12764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:19.755501 12760 heartbeater.cc:344] Connected to a master server at 127.0.107.254:39851
I20260709 13:02:19.755975 12760 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:19.756839 12760 heartbeater.cc:507] Master 127.0.107.254:39851 requested a full tablet report, sending...
W20260709 13:02:19.757032 12766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:19.757839   431 server_base.cc:1061] running on GCE node
I20260709 13:02:19.758991   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:02:19.759044 12558 ts_manager.cc:194] Registered new tserver with Master: e19d29d496da429b9937e4b720551476 (127.0.107.194:45875)
W20260709 13:02:19.759328   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:19.759572   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602139759553 us; error 0 us; skew 500 ppm
I20260709 13:02:19.760383   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:19.761005 12558 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43036
I20260709 13:02:19.763336   431 webserver.cc:533] Webserver started at http://127.0.107.195:44343/ using document root <none> and password file <none>
I20260709 13:02:19.763908   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:19.764071   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:19.764288   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:19.765543   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601786404416-431-0/minicluster-data/ts-2-root/instance:
uuid: "1e7d17c1a0e14a32b619b1129f7f3de0"
format_stamp: "Formatted at 2026-07-09 13:02:19 on dist-test-slave-6j4g"
I20260709 13:02:19.770210   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:02:19.773824 12771 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:19.774657   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:02:19.774964   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601786404416-431-0/minicluster-data/ts-2-root
uuid: "1e7d17c1a0e14a32b619b1129f7f3de0"
format_stamp: "Formatted at 2026-07-09 13:02:19 on dist-test-slave-6j4g"
I20260709 13:02:19.775252   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601786404416-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601786404416-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601786404416-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:19.790611   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:19.791831   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:19.793349   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:19.795645   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:19.795838   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:19.796075   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:19.796229   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:19.836956   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:41559
I20260709 13:02:19.837064 12833 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:41559 every 8 connection(s)
I20260709 13:02:19.851258 12834 heartbeater.cc:344] Connected to a master server at 127.0.107.254:39851
I20260709 13:02:19.851711 12834 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:19.852461 12834 heartbeater.cc:507] Master 127.0.107.254:39851 requested a full tablet report, sending...
I20260709 13:02:19.854643 12558 ts_manager.cc:194] Registered new tserver with Master: 1e7d17c1a0e14a32b619b1129f7f3de0 (127.0.107.195:41559)
I20260709 13:02:19.855080   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014828584s
I20260709 13:02:19.856546 12558 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60062
I20260709 13:02:19.881135 12558 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60066:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:19.883394 12558 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:19.933792 12650 tablet_service.cc:1511] Processing CreateTablet for tablet 3dba52a82c5d445a947faee3c5413263 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2899c50c1066419fb75bed1795083513]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:02:19.934412 12649 tablet_service.cc:1511] Processing CreateTablet for tablet 57408ac95c1f401e84f492ffa84dbebc (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2899c50c1066419fb75bed1795083513]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:02:19.935374 12650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dba52a82c5d445a947faee3c5413263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:19.936043 12649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57408ac95c1f401e84f492ffa84dbebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:19.936825 12799 tablet_service.cc:1511] Processing CreateTablet for tablet 3dba52a82c5d445a947faee3c5413263 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2899c50c1066419fb75bed1795083513]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:02:19.938254 12799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dba52a82c5d445a947faee3c5413263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:19.938550 12798 tablet_service.cc:1511] Processing CreateTablet for tablet 57408ac95c1f401e84f492ffa84dbebc (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2899c50c1066419fb75bed1795083513]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:02:19.940042 12798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57408ac95c1f401e84f492ffa84dbebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:19.958890 12725 tablet_service.cc:1511] Processing CreateTablet for tablet 3dba52a82c5d445a947faee3c5413263 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2899c50c1066419fb75bed1795083513]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:02:19.960408 12725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dba52a82c5d445a947faee3c5413263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:19.963402 12724 tablet_service.cc:1511] Processing CreateTablet for tablet 57408ac95c1f401e84f492ffa84dbebc (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2899c50c1066419fb75bed1795083513]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:02:19.964133 12850 tablet_bootstrap.cc:492] T 3dba52a82c5d445a947faee3c5413263 P 1e7d17c1a0e14a32b619b1129f7f3de0: Bootstrap starting.
I20260709 13:02:19.964936 12724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57408ac95c1f401e84f492ffa84dbebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:19.972028 12850 tablet_bootstrap.cc:654] T 3dba52a82c5d445a947faee3c5413263 P 1e7d17c1a0e14a32b619b1129f7f3de0: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:19.979244 12849 tablet_bootstrap.cc:492] T 3dba52a82c5d445a947faee3c5413263 P 366580e15cb940e1a1ce115887229cf6: Bootstrap starting.
I20260709 13:02:19.984334 12852 tablet_bootstrap.cc:492] T 3dba52a82c5d445a947faee3c5413263 P e19d29d496da429b9937e4b720551476: Bootstrap starting.
I20260709 13:02:19.986136 12850 tablet_bootstrap.cc:492] T 3dba52a82c5d445a947faee3c5413263 P 1e7d17c1a0e14a32b619b1129f7f3de0: No bootstrap required, opened a new log
I20260709 13:02:19.986750 12850 ts_tablet_manager.cc:1403] T 3dba52a82c5d445a947faee3c5413263 P 1e7d17c1a0e14a32b619b1129f7f3de0: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.007s
I20260709 13:02:19.989027 12849 tablet_bootstrap.cc:654] T 3dba52a82c5d445a947faee3c5413263 P 366580e15cb940e1a1ce115887229cf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:19.990465 12852 tablet_bootstrap.cc:654] T 3dba52a82c5d445a947faee3c5413263 P e19d29d496da429b9937e4b720551476: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:19.989984 12850 raft_consensus.cc:359] T 3dba52a82c5d445a947faee3c5413263 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } }
I20260709 13:02:19.990895 12850 raft_consensus.cc:385] T 3dba52a82c5d445a947faee3c5413263 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:19.991240 12850 raft_consensus.cc:740] T 3dba52a82c5d445a947faee3c5413263 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e7d17c1a0e14a32b619b1129f7f3de0, State: Initialized, Role: FOLLOWER
I20260709 13:02:19.992084 12850 consensus_queue.cc:260] T 3dba52a82c5d445a947faee3c5413263 P 1e7d17c1a0e14a32b619b1129f7f3de0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } }
I20260709 13:02:19.998188 12834 heartbeater.cc:499] Master 127.0.107.254:39851 was elected leader, sending a full tablet report...
I20260709 13:02:19.998871 12850 ts_tablet_manager.cc:1434] T 3dba52a82c5d445a947faee3c5413263 P 1e7d17c1a0e14a32b619b1129f7f3de0: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.003s
I20260709 13:02:19.999382 12852 tablet_bootstrap.cc:492] T 3dba52a82c5d445a947faee3c5413263 P e19d29d496da429b9937e4b720551476: No bootstrap required, opened a new log
I20260709 13:02:19.999396 12849 tablet_bootstrap.cc:492] T 3dba52a82c5d445a947faee3c5413263 P 366580e15cb940e1a1ce115887229cf6: No bootstrap required, opened a new log
I20260709 13:02:20.000099 12852 ts_tablet_manager.cc:1403] T 3dba52a82c5d445a947faee3c5413263 P e19d29d496da429b9937e4b720551476: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 13:02:20.000414 12850 tablet_bootstrap.cc:492] T 57408ac95c1f401e84f492ffa84dbebc P 1e7d17c1a0e14a32b619b1129f7f3de0: Bootstrap starting.
I20260709 13:02:20.000276 12849 ts_tablet_manager.cc:1403] T 3dba52a82c5d445a947faee3c5413263 P 366580e15cb940e1a1ce115887229cf6: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.010s
I20260709 13:02:20.003382 12852 raft_consensus.cc:359] T 3dba52a82c5d445a947faee3c5413263 P e19d29d496da429b9937e4b720551476 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } }
I20260709 13:02:20.004220 12852 raft_consensus.cc:385] T 3dba52a82c5d445a947faee3c5413263 P e19d29d496da429b9937e4b720551476 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:20.004691 12852 raft_consensus.cc:740] T 3dba52a82c5d445a947faee3c5413263 P e19d29d496da429b9937e4b720551476 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19d29d496da429b9937e4b720551476, State: Initialized, Role: FOLLOWER
I20260709 13:02:20.004262 12849 raft_consensus.cc:359] T 3dba52a82c5d445a947faee3c5413263 P 366580e15cb940e1a1ce115887229cf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } }
I20260709 13:02:20.005328 12849 raft_consensus.cc:385] T 3dba52a82c5d445a947faee3c5413263 P 366580e15cb940e1a1ce115887229cf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:20.005760 12852 consensus_queue.cc:260] T 3dba52a82c5d445a947faee3c5413263 P e19d29d496da429b9937e4b720551476 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } }
I20260709 13:02:20.005677 12849 raft_consensus.cc:740] T 3dba52a82c5d445a947faee3c5413263 P 366580e15cb940e1a1ce115887229cf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 366580e15cb940e1a1ce115887229cf6, State: Initialized, Role: FOLLOWER
I20260709 13:02:20.009581 12849 consensus_queue.cc:260] T 3dba52a82c5d445a947faee3c5413263 P 366580e15cb940e1a1ce115887229cf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } }
I20260709 13:02:20.010097 12850 tablet_bootstrap.cc:654] T 57408ac95c1f401e84f492ffa84dbebc P 1e7d17c1a0e14a32b619b1129f7f3de0: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:20.015169 12685 heartbeater.cc:499] Master 127.0.107.254:39851 was elected leader, sending a full tablet report...
I20260709 13:02:20.015467 12849 ts_tablet_manager.cc:1434] T 3dba52a82c5d445a947faee3c5413263 P 366580e15cb940e1a1ce115887229cf6: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:02:20.016875 12849 tablet_bootstrap.cc:492] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6: Bootstrap starting.
I20260709 13:02:20.018675 12760 heartbeater.cc:499] Master 127.0.107.254:39851 was elected leader, sending a full tablet report...
I20260709 13:02:20.020371 12850 tablet_bootstrap.cc:492] T 57408ac95c1f401e84f492ffa84dbebc P 1e7d17c1a0e14a32b619b1129f7f3de0: No bootstrap required, opened a new log
I20260709 13:02:20.021056 12850 ts_tablet_manager.cc:1403] T 57408ac95c1f401e84f492ffa84dbebc P 1e7d17c1a0e14a32b619b1129f7f3de0: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.008s
I20260709 13:02:20.023712 12849 tablet_bootstrap.cc:654] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:20.024215 12850 raft_consensus.cc:359] T 57408ac95c1f401e84f492ffa84dbebc P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:20.025051 12850 raft_consensus.cc:385] T 57408ac95c1f401e84f492ffa84dbebc P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:20.025326 12850 raft_consensus.cc:740] T 57408ac95c1f401e84f492ffa84dbebc P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e7d17c1a0e14a32b619b1129f7f3de0, State: Initialized, Role: FOLLOWER
I20260709 13:02:20.026227 12850 consensus_queue.cc:260] T 57408ac95c1f401e84f492ffa84dbebc P 1e7d17c1a0e14a32b619b1129f7f3de0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:20.028352 12852 ts_tablet_manager.cc:1434] T 3dba52a82c5d445a947faee3c5413263 P e19d29d496da429b9937e4b720551476: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.008s
I20260709 13:02:20.028846 12850 ts_tablet_manager.cc:1434] T 57408ac95c1f401e84f492ffa84dbebc P 1e7d17c1a0e14a32b619b1129f7f3de0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:02:20.032333 12852 tablet_bootstrap.cc:492] T 57408ac95c1f401e84f492ffa84dbebc P e19d29d496da429b9937e4b720551476: Bootstrap starting.
I20260709 13:02:20.039324 12852 tablet_bootstrap.cc:654] T 57408ac95c1f401e84f492ffa84dbebc P e19d29d496da429b9937e4b720551476: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:20.040764 12849 tablet_bootstrap.cc:492] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6: No bootstrap required, opened a new log
I20260709 13:02:20.041383 12849 ts_tablet_manager.cc:1403] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.008s
I20260709 13:02:20.043987 12852 tablet_bootstrap.cc:492] T 57408ac95c1f401e84f492ffa84dbebc P e19d29d496da429b9937e4b720551476: No bootstrap required, opened a new log
I20260709 13:02:20.043823 12849 raft_consensus.cc:359] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:20.044423 12849 raft_consensus.cc:385] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:20.044564 12852 ts_tablet_manager.cc:1403] T 57408ac95c1f401e84f492ffa84dbebc P e19d29d496da429b9937e4b720551476: Time spent bootstrapping tablet: real 0.012s	user 0.005s	sys 0.007s
I20260709 13:02:20.044763 12849 raft_consensus.cc:740] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 366580e15cb940e1a1ce115887229cf6, State: Initialized, Role: FOLLOWER
I20260709 13:02:20.045593 12849 consensus_queue.cc:260] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:20.047744 12849 ts_tablet_manager.cc:1434] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:02:20.047535 12852 raft_consensus.cc:359] T 57408ac95c1f401e84f492ffa84dbebc P e19d29d496da429b9937e4b720551476 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:20.048333 12852 raft_consensus.cc:385] T 57408ac95c1f401e84f492ffa84dbebc P e19d29d496da429b9937e4b720551476 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:20.048656 12852 raft_consensus.cc:740] T 57408ac95c1f401e84f492ffa84dbebc P e19d29d496da429b9937e4b720551476 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19d29d496da429b9937e4b720551476, State: Initialized, Role: FOLLOWER
I20260709 13:02:20.049425 12852 consensus_queue.cc:260] T 57408ac95c1f401e84f492ffa84dbebc P e19d29d496da429b9937e4b720551476 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:20.051653 12852 ts_tablet_manager.cc:1434] T 57408ac95c1f401e84f492ffa84dbebc P e19d29d496da429b9937e4b720551476: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:02:20.113000 12857 raft_consensus.cc:493] T 3dba52a82c5d445a947faee3c5413263 P 366580e15cb940e1a1ce115887229cf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.113525 12857 raft_consensus.cc:515] T 3dba52a82c5d445a947faee3c5413263 P 366580e15cb940e1a1ce115887229cf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } }
I20260709 13:02:20.115523 12857 leader_election.cc:290] T 3dba52a82c5d445a947faee3c5413263 P 366580e15cb940e1a1ce115887229cf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e7d17c1a0e14a32b619b1129f7f3de0 (127.0.107.195:41559), e19d29d496da429b9937e4b720551476 (127.0.107.194:45875)
I20260709 13:02:20.124876 12809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dba52a82c5d445a947faee3c5413263" candidate_uuid: "366580e15cb940e1a1ce115887229cf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" is_pre_election: true
I20260709 13:02:20.125674 12809 raft_consensus.cc:2468] T 3dba52a82c5d445a947faee3c5413263 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 366580e15cb940e1a1ce115887229cf6 in term 0.
I20260709 13:02:20.126531 12735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dba52a82c5d445a947faee3c5413263" candidate_uuid: "366580e15cb940e1a1ce115887229cf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19d29d496da429b9937e4b720551476" is_pre_election: true
I20260709 13:02:20.126965 12626 leader_election.cc:304] T 3dba52a82c5d445a947faee3c5413263 P 366580e15cb940e1a1ce115887229cf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e7d17c1a0e14a32b619b1129f7f3de0, 366580e15cb940e1a1ce115887229cf6; no voters: 
I20260709 13:02:20.127382 12735 raft_consensus.cc:2468] T 3dba52a82c5d445a947faee3c5413263 P e19d29d496da429b9937e4b720551476 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 366580e15cb940e1a1ce115887229cf6 in term 0.
I20260709 13:02:20.127928 12857 raft_consensus.cc:2804] T 3dba52a82c5d445a947faee3c5413263 P 366580e15cb940e1a1ce115887229cf6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:20.128252 12857 raft_consensus.cc:493] T 3dba52a82c5d445a947faee3c5413263 P 366580e15cb940e1a1ce115887229cf6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.128590 12857 raft_consensus.cc:3060] T 3dba52a82c5d445a947faee3c5413263 P 366580e15cb940e1a1ce115887229cf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:20.134076 12857 raft_consensus.cc:515] T 3dba52a82c5d445a947faee3c5413263 P 366580e15cb940e1a1ce115887229cf6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } }
I20260709 13:02:20.135778 12857 leader_election.cc:290] T 3dba52a82c5d445a947faee3c5413263 P 366580e15cb940e1a1ce115887229cf6 [CANDIDATE]: Term 1 election: Requested vote from peers 1e7d17c1a0e14a32b619b1129f7f3de0 (127.0.107.195:41559), e19d29d496da429b9937e4b720551476 (127.0.107.194:45875)
I20260709 13:02:20.136893 12809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dba52a82c5d445a947faee3c5413263" candidate_uuid: "366580e15cb940e1a1ce115887229cf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0"
I20260709 13:02:20.137131 12735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3dba52a82c5d445a947faee3c5413263" candidate_uuid: "366580e15cb940e1a1ce115887229cf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19d29d496da429b9937e4b720551476"
I20260709 13:02:20.137465 12809 raft_consensus.cc:3060] T 3dba52a82c5d445a947faee3c5413263 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:20.138126 12735 raft_consensus.cc:3060] T 3dba52a82c5d445a947faee3c5413263 P e19d29d496da429b9937e4b720551476 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:20.143740 12809 raft_consensus.cc:2468] T 3dba52a82c5d445a947faee3c5413263 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 366580e15cb940e1a1ce115887229cf6 in term 1.
I20260709 13:02:20.143936 12735 raft_consensus.cc:2468] T 3dba52a82c5d445a947faee3c5413263 P e19d29d496da429b9937e4b720551476 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 366580e15cb940e1a1ce115887229cf6 in term 1.
I20260709 13:02:20.144996 12626 leader_election.cc:304] T 3dba52a82c5d445a947faee3c5413263 P 366580e15cb940e1a1ce115887229cf6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e7d17c1a0e14a32b619b1129f7f3de0, 366580e15cb940e1a1ce115887229cf6; no voters: 
I20260709 13:02:20.145674 12857 raft_consensus.cc:2804] T 3dba52a82c5d445a947faee3c5413263 P 366580e15cb940e1a1ce115887229cf6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:20.146863 12857 raft_consensus.cc:697] T 3dba52a82c5d445a947faee3c5413263 P 366580e15cb940e1a1ce115887229cf6 [term 1 LEADER]: Becoming Leader. State: Replica: 366580e15cb940e1a1ce115887229cf6, State: Running, Role: LEADER
I20260709 13:02:20.147660 12857 consensus_queue.cc:237] T 3dba52a82c5d445a947faee3c5413263 P 366580e15cb940e1a1ce115887229cf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } }
I20260709 13:02:20.157394 12555 catalog_manager.cc:5697] T 3dba52a82c5d445a947faee3c5413263 P 366580e15cb940e1a1ce115887229cf6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 366580e15cb940e1a1ce115887229cf6 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "366580e15cb940e1a1ce115887229cf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:20.171116 12857 raft_consensus.cc:493] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.171653 12857 raft_consensus.cc:515] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:20.173331 12857 leader_election.cc:290] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e19d29d496da429b9937e4b720551476 (127.0.107.194:45875), 1e7d17c1a0e14a32b619b1129f7f3de0 (127.0.107.195:41559)
I20260709 13:02:20.174186 12735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57408ac95c1f401e84f492ffa84dbebc" candidate_uuid: "366580e15cb940e1a1ce115887229cf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19d29d496da429b9937e4b720551476" is_pre_election: true
I20260709 13:02:20.174360 12809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57408ac95c1f401e84f492ffa84dbebc" candidate_uuid: "366580e15cb940e1a1ce115887229cf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" is_pre_election: true
I20260709 13:02:20.174780 12735 raft_consensus.cc:2468] T 57408ac95c1f401e84f492ffa84dbebc P e19d29d496da429b9937e4b720551476 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 366580e15cb940e1a1ce115887229cf6 in term 0.
I20260709 13:02:20.175019 12809 raft_consensus.cc:2468] T 57408ac95c1f401e84f492ffa84dbebc P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 366580e15cb940e1a1ce115887229cf6 in term 0.
I20260709 13:02:20.175853 12626 leader_election.cc:304] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 366580e15cb940e1a1ce115887229cf6, e19d29d496da429b9937e4b720551476; no voters: 
I20260709 13:02:20.176532 12857 raft_consensus.cc:2804] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:20.176879 12857 raft_consensus.cc:493] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.177170 12857 raft_consensus.cc:3060] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:20.182300 12857 raft_consensus.cc:515] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:20.184018 12857 leader_election.cc:290] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6 [CANDIDATE]: Term 1 election: Requested vote from peers e19d29d496da429b9937e4b720551476 (127.0.107.194:45875), 1e7d17c1a0e14a32b619b1129f7f3de0 (127.0.107.195:41559)
I20260709 13:02:20.184870 12735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57408ac95c1f401e84f492ffa84dbebc" candidate_uuid: "366580e15cb940e1a1ce115887229cf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19d29d496da429b9937e4b720551476"
I20260709 13:02:20.185092 12809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57408ac95c1f401e84f492ffa84dbebc" candidate_uuid: "366580e15cb940e1a1ce115887229cf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0"
I20260709 13:02:20.185446 12735 raft_consensus.cc:3060] T 57408ac95c1f401e84f492ffa84dbebc P e19d29d496da429b9937e4b720551476 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:20.185621 12809 raft_consensus.cc:3060] T 57408ac95c1f401e84f492ffa84dbebc P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:20.191056 12735 raft_consensus.cc:2468] T 57408ac95c1f401e84f492ffa84dbebc P e19d29d496da429b9937e4b720551476 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 366580e15cb940e1a1ce115887229cf6 in term 1.
I20260709 13:02:20.191056 12809 raft_consensus.cc:2468] T 57408ac95c1f401e84f492ffa84dbebc P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 366580e15cb940e1a1ce115887229cf6 in term 1.
I20260709 13:02:20.192332 12626 leader_election.cc:304] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e7d17c1a0e14a32b619b1129f7f3de0, 366580e15cb940e1a1ce115887229cf6; no voters: 
I20260709 13:02:20.193084 12857 raft_consensus.cc:2804] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:20.193652 12857 raft_consensus.cc:697] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6 [term 1 LEADER]: Becoming Leader. State: Replica: 366580e15cb940e1a1ce115887229cf6, State: Running, Role: LEADER
I20260709 13:02:20.194828 12857 consensus_queue.cc:237] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:20.201370 12555 catalog_manager.cc:5697] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 366580e15cb940e1a1ce115887229cf6 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "366580e15cb940e1a1ce115887229cf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:20.238585 12555 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60072:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:20.240595 12555 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:20.265321 12650 tablet_service.cc:1511] Processing CreateTablet for tablet 3ea6d2639ac1466aa2752e4ec9cc78d1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d9ea87f2736b4222bb3d9ad7172d6913]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:02:20.266654 12650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ea6d2639ac1466aa2752e4ec9cc78d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:20.266454 12725 tablet_service.cc:1511] Processing CreateTablet for tablet 3ea6d2639ac1466aa2752e4ec9cc78d1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d9ea87f2736b4222bb3d9ad7172d6913]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:02:20.267834 12725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ea6d2639ac1466aa2752e4ec9cc78d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:20.268594 12799 tablet_service.cc:1511] Processing CreateTablet for tablet 3ea6d2639ac1466aa2752e4ec9cc78d1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d9ea87f2736b4222bb3d9ad7172d6913]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:02:20.269958 12799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ea6d2639ac1466aa2752e4ec9cc78d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:20.270730 12649 tablet_service.cc:1511] Processing CreateTablet for tablet 171b942ba6b242fa9264f8ebfe059334 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d9ea87f2736b4222bb3d9ad7172d6913]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:02:20.272078 12649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 171b942ba6b242fa9264f8ebfe059334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:20.283314 12724 tablet_service.cc:1511] Processing CreateTablet for tablet 171b942ba6b242fa9264f8ebfe059334 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d9ea87f2736b4222bb3d9ad7172d6913]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:02:20.284781 12724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 171b942ba6b242fa9264f8ebfe059334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:20.285745 12852 tablet_bootstrap.cc:492] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476: Bootstrap starting.
I20260709 13:02:20.288236 12850 tablet_bootstrap.cc:492] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 1e7d17c1a0e14a32b619b1129f7f3de0: Bootstrap starting.
I20260709 13:02:20.292204 12849 tablet_bootstrap.cc:492] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 366580e15cb940e1a1ce115887229cf6: Bootstrap starting.
I20260709 13:02:20.292423 12852 tablet_bootstrap.cc:654] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:20.300582 12852 tablet_bootstrap.cc:492] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476: No bootstrap required, opened a new log
I20260709 13:02:20.301154 12852 ts_tablet_manager.cc:1403] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.008s
I20260709 13:02:20.303494 12849 tablet_bootstrap.cc:654] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 366580e15cb940e1a1ce115887229cf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:20.304383 12852 raft_consensus.cc:359] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:20.305370 12852 raft_consensus.cc:385] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:20.305689 12852 raft_consensus.cc:740] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19d29d496da429b9937e4b720551476, State: Initialized, Role: FOLLOWER
I20260709 13:02:20.306102 12850 tablet_bootstrap.cc:654] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 1e7d17c1a0e14a32b619b1129f7f3de0: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:20.306567 12852 consensus_queue.cc:260] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:20.307119 12798 tablet_service.cc:1511] Processing CreateTablet for tablet 171b942ba6b242fa9264f8ebfe059334 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d9ea87f2736b4222bb3d9ad7172d6913]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:02:20.308705 12798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 171b942ba6b242fa9264f8ebfe059334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:20.311168 12852 ts_tablet_manager.cc:1434] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 13:02:20.312412 12852 tablet_bootstrap.cc:492] T 171b942ba6b242fa9264f8ebfe059334 P e19d29d496da429b9937e4b720551476: Bootstrap starting.
I20260709 13:02:20.319123 12852 tablet_bootstrap.cc:654] T 171b942ba6b242fa9264f8ebfe059334 P e19d29d496da429b9937e4b720551476: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:20.329170 12850 tablet_bootstrap.cc:492] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 1e7d17c1a0e14a32b619b1129f7f3de0: No bootstrap required, opened a new log
I20260709 13:02:20.329881 12850 ts_tablet_manager.cc:1403] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 1e7d17c1a0e14a32b619b1129f7f3de0: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.007s
I20260709 13:02:20.330816 12856 raft_consensus.cc:493] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.331449 12856 raft_consensus.cc:515] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:20.333485 12850 raft_consensus.cc:359] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:20.334501 12850 raft_consensus.cc:385] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:20.334847 12850 raft_consensus.cc:740] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e7d17c1a0e14a32b619b1129f7f3de0, State: Initialized, Role: FOLLOWER
I20260709 13:02:20.336058 12850 consensus_queue.cc:260] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 1e7d17c1a0e14a32b619b1129f7f3de0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:20.337061 12856 leader_election.cc:290] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 366580e15cb940e1a1ce115887229cf6 (127.0.107.193:44339), 1e7d17c1a0e14a32b619b1129f7f3de0 (127.0.107.195:41559)
I20260709 13:02:20.347106 12850 ts_tablet_manager.cc:1434] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 1e7d17c1a0e14a32b619b1129f7f3de0: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.003s
I20260709 13:02:20.352510 12852 tablet_bootstrap.cc:492] T 171b942ba6b242fa9264f8ebfe059334 P e19d29d496da429b9937e4b720551476: No bootstrap required, opened a new log
I20260709 13:02:20.353181 12852 ts_tablet_manager.cc:1403] T 171b942ba6b242fa9264f8ebfe059334 P e19d29d496da429b9937e4b720551476: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.008s
I20260709 13:02:20.355090 12850 tablet_bootstrap.cc:492] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0: Bootstrap starting.
I20260709 13:02:20.356093 12852 raft_consensus.cc:359] T 171b942ba6b242fa9264f8ebfe059334 P e19d29d496da429b9937e4b720551476 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:20.358999 12852 raft_consensus.cc:385] T 171b942ba6b242fa9264f8ebfe059334 P e19d29d496da429b9937e4b720551476 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:20.359539 12852 raft_consensus.cc:740] T 171b942ba6b242fa9264f8ebfe059334 P e19d29d496da429b9937e4b720551476 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e19d29d496da429b9937e4b720551476, State: Initialized, Role: FOLLOWER
I20260709 13:02:20.360980 12852 consensus_queue.cc:260] T 171b942ba6b242fa9264f8ebfe059334 P e19d29d496da429b9937e4b720551476 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:20.364256 12850 tablet_bootstrap.cc:654] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:20.365762 12852 ts_tablet_manager.cc:1434] T 171b942ba6b242fa9264f8ebfe059334 P e19d29d496da429b9937e4b720551476: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:02:20.364398 12849 tablet_bootstrap.cc:492] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 366580e15cb940e1a1ce115887229cf6: No bootstrap required, opened a new log
I20260709 13:02:20.367429 12849 ts_tablet_manager.cc:1403] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 366580e15cb940e1a1ce115887229cf6: Time spent bootstrapping tablet: real 0.075s	user 0.022s	sys 0.023s
I20260709 13:02:20.374110 12849 raft_consensus.cc:359] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 366580e15cb940e1a1ce115887229cf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:20.375075 12849 raft_consensus.cc:385] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 366580e15cb940e1a1ce115887229cf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:20.375490 12849 raft_consensus.cc:740] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 366580e15cb940e1a1ce115887229cf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 366580e15cb940e1a1ce115887229cf6, State: Initialized, Role: FOLLOWER
I20260709 13:02:20.376513 12849 consensus_queue.cc:260] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 366580e15cb940e1a1ce115887229cf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:20.377637 12660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea6d2639ac1466aa2752e4ec9cc78d1" candidate_uuid: "e19d29d496da429b9937e4b720551476" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "366580e15cb940e1a1ce115887229cf6" is_pre_election: true
I20260709 13:02:20.378455 12660 raft_consensus.cc:2468] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 366580e15cb940e1a1ce115887229cf6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19d29d496da429b9937e4b720551476 in term 0.
I20260709 13:02:20.378968 12850 tablet_bootstrap.cc:492] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0: No bootstrap required, opened a new log
I20260709 13:02:20.379398 12849 ts_tablet_manager.cc:1434] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 366580e15cb940e1a1ce115887229cf6: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:02:20.379757 12850 ts_tablet_manager.cc:1403] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.009s
I20260709 13:02:20.379890 12701 leader_election.cc:304] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 366580e15cb940e1a1ce115887229cf6, e19d29d496da429b9937e4b720551476; no voters: 
I20260709 13:02:20.380751 12849 tablet_bootstrap.cc:492] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6: Bootstrap starting.
I20260709 13:02:20.381016 12856 raft_consensus.cc:2804] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:20.381458 12856 raft_consensus.cc:493] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.381829 12856 raft_consensus.cc:3060] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:20.383198 12850 raft_consensus.cc:359] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:20.384024 12850 raft_consensus.cc:385] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:20.384337 12850 raft_consensus.cc:740] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e7d17c1a0e14a32b619b1129f7f3de0, State: Initialized, Role: FOLLOWER
I20260709 13:02:20.374861 12809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea6d2639ac1466aa2752e4ec9cc78d1" candidate_uuid: "e19d29d496da429b9937e4b720551476" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" is_pre_election: true
I20260709 13:02:20.385459 12850 consensus_queue.cc:260] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:20.386391 12809 raft_consensus.cc:2468] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e19d29d496da429b9937e4b720551476 in term 0.
I20260709 13:02:20.387944 12850 ts_tablet_manager.cc:1434] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:20.388785 12849 tablet_bootstrap.cc:654] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:20.393878 12856 raft_consensus.cc:515] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:20.397271 12660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea6d2639ac1466aa2752e4ec9cc78d1" candidate_uuid: "e19d29d496da429b9937e4b720551476" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "366580e15cb940e1a1ce115887229cf6"
I20260709 13:02:20.397920 12660 raft_consensus.cc:3060] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 366580e15cb940e1a1ce115887229cf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:20.397986 12849 tablet_bootstrap.cc:492] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6: No bootstrap required, opened a new log
I20260709 13:02:20.398684 12849 ts_tablet_manager.cc:1403] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.011s
I20260709 13:02:20.400390 12809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea6d2639ac1466aa2752e4ec9cc78d1" candidate_uuid: "e19d29d496da429b9937e4b720551476" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0"
I20260709 13:02:20.401111 12809 raft_consensus.cc:3060] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:20.402143 12849 raft_consensus.cc:359] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:20.403055 12849 raft_consensus.cc:385] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:20.403276 12856 leader_election.cc:290] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476 [CANDIDATE]: Term 1 election: Requested vote from peers 366580e15cb940e1a1ce115887229cf6 (127.0.107.193:44339), 1e7d17c1a0e14a32b619b1129f7f3de0 (127.0.107.195:41559)
I20260709 13:02:20.403409 12849 raft_consensus.cc:740] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 366580e15cb940e1a1ce115887229cf6, State: Initialized, Role: FOLLOWER
I20260709 13:02:20.404524 12849 consensus_queue.cc:260] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:20.406417 12660 raft_consensus.cc:2468] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 366580e15cb940e1a1ce115887229cf6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19d29d496da429b9937e4b720551476 in term 1.
I20260709 13:02:20.406702 12849 ts_tablet_manager.cc:1434] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 13:02:20.407992 12701 leader_election.cc:304] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 366580e15cb940e1a1ce115887229cf6, e19d29d496da429b9937e4b720551476; no voters: 
I20260709 13:02:20.408049 12809 raft_consensus.cc:2468] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19d29d496da429b9937e4b720551476 in term 1.
I20260709 13:02:20.409096 12856 raft_consensus.cc:2804] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:20.410390 12856 raft_consensus.cc:697] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476 [term 1 LEADER]: Becoming Leader. State: Replica: e19d29d496da429b9937e4b720551476, State: Running, Role: LEADER
I20260709 13:02:20.411278 12856 consensus_queue.cc:237] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:20.419802 12555 catalog_manager.cc:5697] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476 reported cstate change: term changed from 0 to 1, leader changed from <none> to e19d29d496da429b9937e4b720551476 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e19d29d496da429b9937e4b720551476" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:20.478367 12606 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:20.580914 12857 consensus_queue.cc:1048] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:20.595863 12857 consensus_queue.cc:1048] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:20.746829 12857 consensus_queue.cc:1048] T 3dba52a82c5d445a947faee3c5413263 P 366580e15cb940e1a1ce115887229cf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:20.759063 12857 consensus_queue.cc:1048] T 3dba52a82c5d445a947faee3c5413263 P 366580e15cb940e1a1ce115887229cf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:20.773772 12855 raft_consensus.cc:493] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.774461 12855 raft_consensus.cc:515] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:20.777076 12855 leader_election.cc:290] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 366580e15cb940e1a1ce115887229cf6 (127.0.107.193:44339), e19d29d496da429b9937e4b720551476 (127.0.107.194:45875)
I20260709 13:02:20.788156 12660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171b942ba6b242fa9264f8ebfe059334" candidate_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "366580e15cb940e1a1ce115887229cf6" is_pre_election: true
I20260709 13:02:20.788975 12660 raft_consensus.cc:2468] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e7d17c1a0e14a32b619b1129f7f3de0 in term 0.
I20260709 13:02:20.789651 12735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171b942ba6b242fa9264f8ebfe059334" candidate_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19d29d496da429b9937e4b720551476" is_pre_election: true
I20260709 13:02:20.790040 12775 leader_election.cc:304] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e7d17c1a0e14a32b619b1129f7f3de0, 366580e15cb940e1a1ce115887229cf6; no voters: 
I20260709 13:02:20.790252 12735 raft_consensus.cc:2468] T 171b942ba6b242fa9264f8ebfe059334 P e19d29d496da429b9937e4b720551476 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e7d17c1a0e14a32b619b1129f7f3de0 in term 0.
I20260709 13:02:20.790843 12855 raft_consensus.cc:2804] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:20.791215 12855 raft_consensus.cc:493] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.791466 12855 raft_consensus.cc:3060] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:20.797338 12855 raft_consensus.cc:515] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:20.798939 12855 leader_election.cc:290] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [CANDIDATE]: Term 1 election: Requested vote from peers 366580e15cb940e1a1ce115887229cf6 (127.0.107.193:44339), e19d29d496da429b9937e4b720551476 (127.0.107.194:45875)
I20260709 13:02:20.799885 12660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171b942ba6b242fa9264f8ebfe059334" candidate_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "366580e15cb940e1a1ce115887229cf6"
I20260709 13:02:20.800161 12735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171b942ba6b242fa9264f8ebfe059334" candidate_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e19d29d496da429b9937e4b720551476"
I20260709 13:02:20.800634 12660 raft_consensus.cc:3060] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:20.800751 12735 raft_consensus.cc:3060] T 171b942ba6b242fa9264f8ebfe059334 P e19d29d496da429b9937e4b720551476 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:20.808333 12660 raft_consensus.cc:2468] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e7d17c1a0e14a32b619b1129f7f3de0 in term 1.
I20260709 13:02:20.808333 12735 raft_consensus.cc:2468] T 171b942ba6b242fa9264f8ebfe059334 P e19d29d496da429b9937e4b720551476 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e7d17c1a0e14a32b619b1129f7f3de0 in term 1.
I20260709 13:02:20.810066 12775 leader_election.cc:304] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e7d17c1a0e14a32b619b1129f7f3de0, e19d29d496da429b9937e4b720551476; no voters: 
I20260709 13:02:20.810743 12855 raft_consensus.cc:2804] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:20.811625 12855 raft_consensus.cc:697] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 1 LEADER]: Becoming Leader. State: Replica: 1e7d17c1a0e14a32b619b1129f7f3de0, State: Running, Role: LEADER
I20260709 13:02:20.812310 12855 consensus_queue.cc:237] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:20.819309 12557 catalog_manager.cc:5697] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e7d17c1a0e14a32b619b1129f7f3de0 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:20.828753 12856 consensus_queue.cc:1048] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476 [LEADER]: Connected to new peer: Peer: permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:20.840277 12878 consensus_queue.cc:1048] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:20.891240 12660 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57408ac95c1f401e84f492ffa84dbebc"
dest_uuid: "366580e15cb940e1a1ce115887229cf6"
mode: GRACEFUL
new_leader_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0"
 from {username='slave'} at 127.0.0.1:54402
I20260709 13:02:20.891866 12660 raft_consensus.cc:606] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6 [term 1 LEADER]: Received request to transfer leadership to TS 1e7d17c1a0e14a32b619b1129f7f3de0
I20260709 13:02:20.907362 12735 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ea6d2639ac1466aa2752e4ec9cc78d1"
dest_uuid: "e19d29d496da429b9937e4b720551476"
mode: GRACEFUL
new_leader_uuid: "366580e15cb940e1a1ce115887229cf6"
 from {username='slave'} at 127.0.0.1:37728
I20260709 13:02:20.907934 12735 raft_consensus.cc:606] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476 [term 1 LEADER]: Received request to transfer leadership to TS 366580e15cb940e1a1ce115887229cf6
I20260709 13:02:20.923743 12809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "171b942ba6b242fa9264f8ebfe059334"
dest_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0"
mode: GRACEFUL
new_leader_uuid: "366580e15cb940e1a1ce115887229cf6"
 from {username='slave'} at 127.0.0.1:35786
I20260709 13:02:20.924291 12809 raft_consensus.cc:606] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 1 LEADER]: Received request to transfer leadership to TS 366580e15cb940e1a1ce115887229cf6
I20260709 13:02:21.219120 12862 raft_consensus.cc:993] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6: : Instructing follower 1e7d17c1a0e14a32b619b1129f7f3de0 to start an election
I20260709 13:02:21.219657 12857 raft_consensus.cc:1081] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6 [term 1 LEADER]: Signalling peer 1e7d17c1a0e14a32b619b1129f7f3de0 to start an election
I20260709 13:02:21.221304 12809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57408ac95c1f401e84f492ffa84dbebc"
dest_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0"
 from {username='slave'} at 127.0.0.1:35772
I20260709 13:02:21.221851 12809 raft_consensus.cc:493] T 57408ac95c1f401e84f492ffa84dbebc P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:21.222215 12809 raft_consensus.cc:3060] T 57408ac95c1f401e84f492ffa84dbebc P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:21.227671 12809 raft_consensus.cc:515] T 57408ac95c1f401e84f492ffa84dbebc P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:21.229532 12809 leader_election.cc:290] T 57408ac95c1f401e84f492ffa84dbebc P 1e7d17c1a0e14a32b619b1129f7f3de0 [CANDIDATE]: Term 2 election: Requested vote from peers 366580e15cb940e1a1ce115887229cf6 (127.0.107.193:44339), e19d29d496da429b9937e4b720551476 (127.0.107.194:45875)
I20260709 13:02:21.230369 12660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57408ac95c1f401e84f492ffa84dbebc" candidate_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "366580e15cb940e1a1ce115887229cf6"
I20260709 13:02:21.230708 12735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57408ac95c1f401e84f492ffa84dbebc" candidate_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e19d29d496da429b9937e4b720551476"
I20260709 13:02:21.231021 12660 raft_consensus.cc:3055] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:21.231279 12735 raft_consensus.cc:3060] T 57408ac95c1f401e84f492ffa84dbebc P e19d29d496da429b9937e4b720551476 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:21.231351 12660 raft_consensus.cc:740] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 366580e15cb940e1a1ce115887229cf6, State: Running, Role: LEADER
I20260709 13:02:21.232134 12660 consensus_queue.cc:260] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:21.233111 12660 raft_consensus.cc:3060] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:21.236604 12735 raft_consensus.cc:2468] T 57408ac95c1f401e84f492ffa84dbebc P e19d29d496da429b9937e4b720551476 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e7d17c1a0e14a32b619b1129f7f3de0 in term 2.
I20260709 13:02:21.237869 12775 leader_election.cc:304] T 57408ac95c1f401e84f492ffa84dbebc P 1e7d17c1a0e14a32b619b1129f7f3de0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e7d17c1a0e14a32b619b1129f7f3de0, e19d29d496da429b9937e4b720551476; no voters: 
I20260709 13:02:21.238224 12660 raft_consensus.cc:2468] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e7d17c1a0e14a32b619b1129f7f3de0 in term 2.
I20260709 13:02:21.238783 12855 raft_consensus.cc:2804] T 57408ac95c1f401e84f492ffa84dbebc P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:21.239207 12855 raft_consensus.cc:697] T 57408ac95c1f401e84f492ffa84dbebc P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 2 LEADER]: Becoming Leader. State: Replica: 1e7d17c1a0e14a32b619b1129f7f3de0, State: Running, Role: LEADER
I20260709 13:02:21.239940 12855 consensus_queue.cc:237] T 57408ac95c1f401e84f492ffa84dbebc P 1e7d17c1a0e14a32b619b1129f7f3de0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:21.246105 12557 catalog_manager.cc:5697] T 57408ac95c1f401e84f492ffa84dbebc P 1e7d17c1a0e14a32b619b1129f7f3de0 reported cstate change: term changed from 1 to 2, leader changed from 366580e15cb940e1a1ce115887229cf6 (127.0.107.193) to 1e7d17c1a0e14a32b619b1129f7f3de0 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:21.331432 12855 consensus_queue.cc:1048] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:21.338341 12891 raft_consensus.cc:993] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0: : Instructing follower 366580e15cb940e1a1ce115887229cf6 to start an election
I20260709 13:02:21.339557 12891 raft_consensus.cc:1081] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 1 LEADER]: Signalling peer 366580e15cb940e1a1ce115887229cf6 to start an election
I20260709 13:02:21.341660 12659 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "171b942ba6b242fa9264f8ebfe059334"
dest_uuid: "366580e15cb940e1a1ce115887229cf6"
 from {username='slave'} at 127.0.0.1:54396
I20260709 13:02:21.343858 12659 raft_consensus.cc:493] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:21.344339 12659 raft_consensus.cc:3060] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:21.345263 12900 consensus_queue.cc:1048] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:21.352295 12659 raft_consensus.cc:515] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:21.359578 12659 leader_election.cc:290] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6 [CANDIDATE]: Term 2 election: Requested vote from peers e19d29d496da429b9937e4b720551476 (127.0.107.194:45875), 1e7d17c1a0e14a32b619b1129f7f3de0 (127.0.107.195:41559)
I20260709 13:02:21.360337 12735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171b942ba6b242fa9264f8ebfe059334" candidate_uuid: "366580e15cb940e1a1ce115887229cf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e19d29d496da429b9937e4b720551476"
I20260709 13:02:21.360697 12809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171b942ba6b242fa9264f8ebfe059334" candidate_uuid: "366580e15cb940e1a1ce115887229cf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0"
I20260709 13:02:21.361176 12735 raft_consensus.cc:3060] T 171b942ba6b242fa9264f8ebfe059334 P e19d29d496da429b9937e4b720551476 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:21.361404 12809 raft_consensus.cc:3055] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:21.361857 12809 raft_consensus.cc:740] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e7d17c1a0e14a32b619b1129f7f3de0, State: Running, Role: LEADER
I20260709 13:02:21.362699 12809 consensus_queue.cc:260] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:21.364092 12809 raft_consensus.cc:3060] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:21.369665 12735 raft_consensus.cc:2468] T 171b942ba6b242fa9264f8ebfe059334 P e19d29d496da429b9937e4b720551476 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 366580e15cb940e1a1ce115887229cf6 in term 2.
I20260709 13:02:21.371068 12626 leader_election.cc:304] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 366580e15cb940e1a1ce115887229cf6, e19d29d496da429b9937e4b720551476; no voters: 
I20260709 13:02:21.372028 12857 raft_consensus.cc:2804] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:21.372563 12857 raft_consensus.cc:697] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6 [term 2 LEADER]: Becoming Leader. State: Replica: 366580e15cb940e1a1ce115887229cf6, State: Running, Role: LEADER
I20260709 13:02:21.372270 12809 raft_consensus.cc:2468] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 366580e15cb940e1a1ce115887229cf6 in term 2.
I20260709 13:02:21.373509 12857 consensus_queue.cc:237] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:21.382799 12557 catalog_manager.cc:5697] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6 reported cstate change: term changed from 1 to 2, leader changed from 1e7d17c1a0e14a32b619b1129f7f3de0 (127.0.107.195) to 366580e15cb940e1a1ce115887229cf6 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "366580e15cb940e1a1ce115887229cf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:21.404829 12906 raft_consensus.cc:993] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476: : Instructing follower 366580e15cb940e1a1ce115887229cf6 to start an election
I20260709 13:02:21.405267 12906 raft_consensus.cc:1081] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476 [term 1 LEADER]: Signalling peer 366580e15cb940e1a1ce115887229cf6 to start an election
I20260709 13:02:21.406883 12659 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ea6d2639ac1466aa2752e4ec9cc78d1"
dest_uuid: "366580e15cb940e1a1ce115887229cf6"
 from {username='slave'} at 127.0.0.1:54384
I20260709 13:02:21.407534 12659 raft_consensus.cc:493] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 366580e15cb940e1a1ce115887229cf6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:21.407891 12659 raft_consensus.cc:3060] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 366580e15cb940e1a1ce115887229cf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:21.413005 12659 raft_consensus.cc:515] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 366580e15cb940e1a1ce115887229cf6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:21.414597 12659 leader_election.cc:290] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 366580e15cb940e1a1ce115887229cf6 [CANDIDATE]: Term 2 election: Requested vote from peers e19d29d496da429b9937e4b720551476 (127.0.107.194:45875), 1e7d17c1a0e14a32b619b1129f7f3de0 (127.0.107.195:41559)
I20260709 13:02:21.415601 12735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea6d2639ac1466aa2752e4ec9cc78d1" candidate_uuid: "366580e15cb940e1a1ce115887229cf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e19d29d496da429b9937e4b720551476"
I20260709 13:02:21.415882 12809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ea6d2639ac1466aa2752e4ec9cc78d1" candidate_uuid: "366580e15cb940e1a1ce115887229cf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0"
I20260709 13:02:21.416337 12735 raft_consensus.cc:3055] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:21.416430 12809 raft_consensus.cc:3060] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:21.416755 12735 raft_consensus.cc:740] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e19d29d496da429b9937e4b720551476, State: Running, Role: LEADER
I20260709 13:02:21.417654 12735 consensus_queue.cc:260] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:21.418996 12735 raft_consensus.cc:3060] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:21.424816 12809 raft_consensus.cc:2468] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 366580e15cb940e1a1ce115887229cf6 in term 2.
I20260709 13:02:21.426708 12626 leader_election.cc:304] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 366580e15cb940e1a1ce115887229cf6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e7d17c1a0e14a32b619b1129f7f3de0, 366580e15cb940e1a1ce115887229cf6; no voters: 
I20260709 13:02:21.426739 12735 raft_consensus.cc:2468] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 366580e15cb940e1a1ce115887229cf6 in term 2.
I20260709 13:02:21.427572 12857 raft_consensus.cc:2804] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 366580e15cb940e1a1ce115887229cf6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:21.428171 12857 raft_consensus.cc:697] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 366580e15cb940e1a1ce115887229cf6 [term 2 LEADER]: Becoming Leader. State: Replica: 366580e15cb940e1a1ce115887229cf6, State: Running, Role: LEADER
I20260709 13:02:21.429071 12857 consensus_queue.cc:237] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 366580e15cb940e1a1ce115887229cf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:21.435138 12557 catalog_manager.cc:5697] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 366580e15cb940e1a1ce115887229cf6 reported cstate change: term changed from 1 to 2, leader changed from e19d29d496da429b9937e4b720551476 (127.0.107.194) to 366580e15cb940e1a1ce115887229cf6 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "366580e15cb940e1a1ce115887229cf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:21.661185   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:02:21.662788   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:02:21.663192   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:02:21.676800 12659 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "171b942ba6b242fa9264f8ebfe059334"
dest_uuid: "366580e15cb940e1a1ce115887229cf6"
mode: GRACEFUL
new_leader_uuid: "e19d29d496da429b9937e4b720551476"
 from {username='slave'} at 127.0.0.1:54412
I20260709 13:02:21.677384 12659 raft_consensus.cc:606] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6 [term 2 LEADER]: Received request to transfer leadership to TS e19d29d496da429b9937e4b720551476
I20260709 13:02:21.678644   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:02:21.701514 12735 raft_consensus.cc:1275] T 57408ac95c1f401e84f492ffa84dbebc P e19d29d496da429b9937e4b720551476 [term 2 FOLLOWER]: Refusing update from remote peer 1e7d17c1a0e14a32b619b1129f7f3de0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:21.702972 12899 consensus_queue.cc:1048] T 57408ac95c1f401e84f492ffa84dbebc P 1e7d17c1a0e14a32b619b1129f7f3de0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:21.712416 12659 raft_consensus.cc:1275] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6 [term 2 FOLLOWER]: Refusing update from remote peer 1e7d17c1a0e14a32b619b1129f7f3de0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:21.714529 12900 consensus_queue.cc:1048] T 57408ac95c1f401e84f492ffa84dbebc P 1e7d17c1a0e14a32b619b1129f7f3de0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:21.825049 12735 raft_consensus.cc:1275] T 171b942ba6b242fa9264f8ebfe059334 P e19d29d496da429b9937e4b720551476 [term 2 FOLLOWER]: Refusing update from remote peer 366580e15cb940e1a1ce115887229cf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:21.826421 12857 consensus_queue.cc:1048] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:21.831543 12862 raft_consensus.cc:993] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6: : Instructing follower e19d29d496da429b9937e4b720551476 to start an election
I20260709 13:02:21.832365 12857 raft_consensus.cc:1081] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6 [term 2 LEADER]: Signalling peer e19d29d496da429b9937e4b720551476 to start an election
I20260709 13:02:21.834946 12734 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "171b942ba6b242fa9264f8ebfe059334"
dest_uuid: "e19d29d496da429b9937e4b720551476"
 from {username='slave'} at 127.0.0.1:37714
I20260709 13:02:21.835577 12734 raft_consensus.cc:493] T 171b942ba6b242fa9264f8ebfe059334 P e19d29d496da429b9937e4b720551476 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:21.835988 12734 raft_consensus.cc:3060] T 171b942ba6b242fa9264f8ebfe059334 P e19d29d496da429b9937e4b720551476 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:21.837144 12809 raft_consensus.cc:1275] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 2 FOLLOWER]: Refusing update from remote peer 366580e15cb940e1a1ce115887229cf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:21.839459 12911 consensus_queue.cc:1048] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:21.843874 12734 raft_consensus.cc:515] T 171b942ba6b242fa9264f8ebfe059334 P e19d29d496da429b9937e4b720551476 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:21.846073 12734 leader_election.cc:290] T 171b942ba6b242fa9264f8ebfe059334 P e19d29d496da429b9937e4b720551476 [CANDIDATE]: Term 3 election: Requested vote from peers 366580e15cb940e1a1ce115887229cf6 (127.0.107.193:44339), 1e7d17c1a0e14a32b619b1129f7f3de0 (127.0.107.195:41559)
I20260709 13:02:21.847190 12659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171b942ba6b242fa9264f8ebfe059334" candidate_uuid: "e19d29d496da429b9937e4b720551476" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "366580e15cb940e1a1ce115887229cf6"
I20260709 13:02:21.847663 12809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171b942ba6b242fa9264f8ebfe059334" candidate_uuid: "e19d29d496da429b9937e4b720551476" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0"
I20260709 13:02:21.847893 12659 raft_consensus.cc:3055] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:21.848299 12809 raft_consensus.cc:3060] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:21.848320 12659 raft_consensus.cc:740] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 366580e15cb940e1a1ce115887229cf6, State: Running, Role: LEADER
I20260709 13:02:21.849402 12659 consensus_queue.cc:260] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:21.850767 12659 raft_consensus.cc:3060] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:21.856263 12809 raft_consensus.cc:2468] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19d29d496da429b9937e4b720551476 in term 3.
I20260709 13:02:21.857795 12701 leader_election.cc:304] T 171b942ba6b242fa9264f8ebfe059334 P e19d29d496da429b9937e4b720551476 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e7d17c1a0e14a32b619b1129f7f3de0, e19d29d496da429b9937e4b720551476; no voters: 
I20260709 13:02:21.858137 12659 raft_consensus.cc:2468] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e19d29d496da429b9937e4b720551476 in term 3.
I20260709 13:02:21.858865 12906 raft_consensus.cc:2804] T 171b942ba6b242fa9264f8ebfe059334 P e19d29d496da429b9937e4b720551476 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:21.859334 12906 raft_consensus.cc:697] T 171b942ba6b242fa9264f8ebfe059334 P e19d29d496da429b9937e4b720551476 [term 3 LEADER]: Becoming Leader. State: Replica: e19d29d496da429b9937e4b720551476, State: Running, Role: LEADER
I20260709 13:02:21.860148 12906 consensus_queue.cc:237] T 171b942ba6b242fa9264f8ebfe059334 P e19d29d496da429b9937e4b720551476 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } }
I20260709 13:02:21.867267 12557 catalog_manager.cc:5697] T 171b942ba6b242fa9264f8ebfe059334 P e19d29d496da429b9937e4b720551476 reported cstate change: term changed from 2 to 3, leader changed from 366580e15cb940e1a1ce115887229cf6 (127.0.107.193) to e19d29d496da429b9937e4b720551476 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "e19d29d496da429b9937e4b720551476" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "366580e15cb940e1a1ce115887229cf6" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e19d29d496da429b9937e4b720551476" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e7d17c1a0e14a32b619b1129f7f3de0" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:21.899178   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:02:21.919338   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:21.919986   431 tablet_replica.cc:333] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6: stopping tablet replica
I20260709 13:02:21.920567   431 raft_consensus.cc:2243] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:21.921008   431 raft_consensus.cc:2272] T 171b942ba6b242fa9264f8ebfe059334 P 366580e15cb940e1a1ce115887229cf6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:21.923187   431 tablet_replica.cc:333] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 366580e15cb940e1a1ce115887229cf6: stopping tablet replica
I20260709 13:02:21.923739   431 raft_consensus.cc:2243] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 366580e15cb940e1a1ce115887229cf6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:21.924333   431 pending_rounds.cc:70] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 366580e15cb940e1a1ce115887229cf6: Trying to abort 1 pending ops.
I20260709 13:02:21.924536   431 pending_rounds.cc:77] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 366580e15cb940e1a1ce115887229cf6: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305634371300806656 op_type: NO_OP noop_request { }
I20260709 13:02:21.924829   431 raft_consensus.cc:2889] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 366580e15cb940e1a1ce115887229cf6 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:21.925076   431 raft_consensus.cc:2272] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 366580e15cb940e1a1ce115887229cf6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:21.927285   431 tablet_replica.cc:333] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6: stopping tablet replica
I20260709 13:02:21.927803   431 raft_consensus.cc:2243] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:21.928213   431 raft_consensus.cc:2272] T 57408ac95c1f401e84f492ffa84dbebc P 366580e15cb940e1a1ce115887229cf6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:21.930469   431 tablet_replica.cc:333] T 3dba52a82c5d445a947faee3c5413263 P 366580e15cb940e1a1ce115887229cf6: stopping tablet replica
I20260709 13:02:21.930981   431 raft_consensus.cc:2243] T 3dba52a82c5d445a947faee3c5413263 P 366580e15cb940e1a1ce115887229cf6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:21.931721   431 raft_consensus.cc:2272] T 3dba52a82c5d445a947faee3c5413263 P 366580e15cb940e1a1ce115887229cf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:21.945456   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:02:21.958436   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:02:21.977186   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:21.977869   431 tablet_replica.cc:333] T 171b942ba6b242fa9264f8ebfe059334 P e19d29d496da429b9937e4b720551476: stopping tablet replica
I20260709 13:02:21.978477   431 raft_consensus.cc:2243] T 171b942ba6b242fa9264f8ebfe059334 P e19d29d496da429b9937e4b720551476 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:21.979104   431 pending_rounds.cc:70] T 171b942ba6b242fa9264f8ebfe059334 P e19d29d496da429b9937e4b720551476: Trying to abort 1 pending ops.
I20260709 13:02:21.979310   431 pending_rounds.cc:77] T 171b942ba6b242fa9264f8ebfe059334 P e19d29d496da429b9937e4b720551476: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305634373069926400 op_type: NO_OP noop_request { }
I20260709 13:02:21.979583   431 raft_consensus.cc:2889] T 171b942ba6b242fa9264f8ebfe059334 P e19d29d496da429b9937e4b720551476 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:21.979863   431 raft_consensus.cc:2272] T 171b942ba6b242fa9264f8ebfe059334 P e19d29d496da429b9937e4b720551476 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:21.982223   431 tablet_replica.cc:333] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476: stopping tablet replica
I20260709 13:02:21.982786   431 raft_consensus.cc:2243] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:21.983170   431 raft_consensus.cc:2272] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P e19d29d496da429b9937e4b720551476 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:21.985069   431 tablet_replica.cc:333] T 57408ac95c1f401e84f492ffa84dbebc P e19d29d496da429b9937e4b720551476: stopping tablet replica
I20260709 13:02:21.985567   431 raft_consensus.cc:2243] T 57408ac95c1f401e84f492ffa84dbebc P e19d29d496da429b9937e4b720551476 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:21.985986   431 raft_consensus.cc:2272] T 57408ac95c1f401e84f492ffa84dbebc P e19d29d496da429b9937e4b720551476 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:21.988302   431 tablet_replica.cc:333] T 3dba52a82c5d445a947faee3c5413263 P e19d29d496da429b9937e4b720551476: stopping tablet replica
I20260709 13:02:21.988845   431 raft_consensus.cc:2243] T 3dba52a82c5d445a947faee3c5413263 P e19d29d496da429b9937e4b720551476 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:21.989253   431 raft_consensus.cc:2272] T 3dba52a82c5d445a947faee3c5413263 P e19d29d496da429b9937e4b720551476 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.012917   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:02:22.031060   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:02:22.053601   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:22.054361   431 tablet_replica.cc:333] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0: stopping tablet replica
I20260709 13:02:22.054925   431 raft_consensus.cc:2243] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.055393   431 raft_consensus.cc:2272] T 171b942ba6b242fa9264f8ebfe059334 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.057703   431 tablet_replica.cc:333] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 1e7d17c1a0e14a32b619b1129f7f3de0: stopping tablet replica
I20260709 13:02:22.058260   431 raft_consensus.cc:2243] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.058670   431 raft_consensus.cc:2272] T 3ea6d2639ac1466aa2752e4ec9cc78d1 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.060560   431 tablet_replica.cc:333] T 57408ac95c1f401e84f492ffa84dbebc P 1e7d17c1a0e14a32b619b1129f7f3de0: stopping tablet replica
I20260709 13:02:22.061069   431 raft_consensus.cc:2243] T 57408ac95c1f401e84f492ffa84dbebc P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.061872   431 raft_consensus.cc:2272] T 57408ac95c1f401e84f492ffa84dbebc P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.064126   431 tablet_replica.cc:333] T 3dba52a82c5d445a947faee3c5413263 P 1e7d17c1a0e14a32b619b1129f7f3de0: stopping tablet replica
I20260709 13:02:22.064666   431 raft_consensus.cc:2243] T 3dba52a82c5d445a947faee3c5413263 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:22.065076   431 raft_consensus.cc:2272] T 3dba52a82c5d445a947faee3c5413263 P 1e7d17c1a0e14a32b619b1129f7f3de0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.086570   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:02:22.098371   431 master.cc:562] Master@127.0.107.254:39851 shutting down...
I20260709 13:02:22.115114   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3fb4273d789f4537b81406d0126ab73a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:22.115639   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3fb4273d789f4537b81406d0126ab73a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:22.116011   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3fb4273d789f4537b81406d0126ab73a: stopping tablet replica
I20260709 13:02:22.134078   431 master.cc:584] Master@127.0.107.254:39851 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2833 ms)
[----------] 6 tests from LeaderRebalancerTest (355590 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:02:22.162222   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:39611
I20260709 13:02:22.163283   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:22.168401 12912 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:22.168708 12913 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:22.169903 12915 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:22.171113   431 server_base.cc:1061] running on GCE node
I20260709 13:02:22.171973   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:22.172144   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:22.172283   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602142172263 us; error 0 us; skew 500 ppm
I20260709 13:02:22.172932   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:22.175299   431 webserver.cc:533] Webserver started at http://127.0.107.254:42867/ using document root <none> and password file <none>
I20260709 13:02:22.175774   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:22.175931   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:22.176146   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:22.177243   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601786404416-431-0/minicluster-data/master-0-root/instance:
uuid: "f2f50cc530224c83bbc4c38881a2fb0b"
format_stamp: "Formatted at 2026-07-09 13:02:22 on dist-test-slave-6j4g"
I20260709 13:02:22.181859   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:02:22.185217 12920 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:22.186019   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:02:22.186287   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601786404416-431-0/minicluster-data/master-0-root
uuid: "f2f50cc530224c83bbc4c38881a2fb0b"
format_stamp: "Formatted at 2026-07-09 13:02:22 on dist-test-slave-6j4g"
I20260709 13:02:22.186546   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601786404416-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601786404416-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601786404416-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:22.199239   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:22.200233   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:22.234647   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:39611
I20260709 13:02:22.234743 12971 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:39611 every 8 connection(s)
I20260709 13:02:22.238322 12972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.249018 12972 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2f50cc530224c83bbc4c38881a2fb0b: Bootstrap starting.
I20260709 13:02:22.253545 12972 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f2f50cc530224c83bbc4c38881a2fb0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:22.257510 12972 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2f50cc530224c83bbc4c38881a2fb0b: No bootstrap required, opened a new log
I20260709 13:02:22.259594 12972 raft_consensus.cc:359] T 00000000000000000000000000000000 P f2f50cc530224c83bbc4c38881a2fb0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2f50cc530224c83bbc4c38881a2fb0b" member_type: VOTER }
I20260709 13:02:22.259991 12972 raft_consensus.cc:385] T 00000000000000000000000000000000 P f2f50cc530224c83bbc4c38881a2fb0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:22.260202 12972 raft_consensus.cc:740] T 00000000000000000000000000000000 P f2f50cc530224c83bbc4c38881a2fb0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2f50cc530224c83bbc4c38881a2fb0b, State: Initialized, Role: FOLLOWER
I20260709 13:02:22.260754 12972 consensus_queue.cc:260] T 00000000000000000000000000000000 P f2f50cc530224c83bbc4c38881a2fb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2f50cc530224c83bbc4c38881a2fb0b" member_type: VOTER }
I20260709 13:02:22.261193 12972 raft_consensus.cc:399] T 00000000000000000000000000000000 P f2f50cc530224c83bbc4c38881a2fb0b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:02:22.261391 12972 raft_consensus.cc:493] T 00000000000000000000000000000000 P f2f50cc530224c83bbc4c38881a2fb0b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:02:22.261631 12972 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f2f50cc530224c83bbc4c38881a2fb0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:22.266383 12972 raft_consensus.cc:515] T 00000000000000000000000000000000 P f2f50cc530224c83bbc4c38881a2fb0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2f50cc530224c83bbc4c38881a2fb0b" member_type: VOTER }
I20260709 13:02:22.266896 12972 leader_election.cc:304] T 00000000000000000000000000000000 P f2f50cc530224c83bbc4c38881a2fb0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f2f50cc530224c83bbc4c38881a2fb0b; no voters: 
I20260709 13:02:22.267999 12972 leader_election.cc:290] T 00000000000000000000000000000000 P f2f50cc530224c83bbc4c38881a2fb0b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:02:22.268308 12975 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f2f50cc530224c83bbc4c38881a2fb0b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:22.269695 12975 raft_consensus.cc:697] T 00000000000000000000000000000000 P f2f50cc530224c83bbc4c38881a2fb0b [term 1 LEADER]: Becoming Leader. State: Replica: f2f50cc530224c83bbc4c38881a2fb0b, State: Running, Role: LEADER
I20260709 13:02:22.270346 12975 consensus_queue.cc:237] T 00000000000000000000000000000000 P f2f50cc530224c83bbc4c38881a2fb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2f50cc530224c83bbc4c38881a2fb0b" member_type: VOTER }
I20260709 13:02:22.270859 12972 sys_catalog.cc:565] T 00000000000000000000000000000000 P f2f50cc530224c83bbc4c38881a2fb0b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:02:22.273082 12976 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2f50cc530224c83bbc4c38881a2fb0b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f2f50cc530224c83bbc4c38881a2fb0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2f50cc530224c83bbc4c38881a2fb0b" member_type: VOTER } }
I20260709 13:02:22.273089 12977 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2f50cc530224c83bbc4c38881a2fb0b [sys.catalog]: SysCatalogTable state changed. Reason: New leader f2f50cc530224c83bbc4c38881a2fb0b. Latest consensus state: current_term: 1 leader_uuid: "f2f50cc530224c83bbc4c38881a2fb0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2f50cc530224c83bbc4c38881a2fb0b" member_type: VOTER } }
I20260709 13:02:22.273830 12976 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2f50cc530224c83bbc4c38881a2fb0b [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:22.273976 12977 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2f50cc530224c83bbc4c38881a2fb0b [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:22.276851 12980 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:02:22.283936 12980 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:02:22.285099   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:02:22.292881 12980 catalog_manager.cc:1383] Generated new cluster ID: 00983b8cbf9343c58370bbedaef15b69
I20260709 13:02:22.293195 12980 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:02:22.314253 12980 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:02:22.315572 12980 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:02:22.329897 12980 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f2f50cc530224c83bbc4c38881a2fb0b: Generated new TSK 0
I20260709 13:02:22.330539 12980 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:02:22.352090   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:22.358207 12993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:22.359359 12994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:22.361007   431 server_base.cc:1061] running on GCE node
W20260709 13:02:22.361563 12996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:22.362491   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:22.362694   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:22.362869   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602142362839 us; error 0 us; skew 500 ppm
I20260709 13:02:22.363379   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:22.365780   431 webserver.cc:533] Webserver started at http://127.0.107.193:36887/ using document root <none> and password file <none>
I20260709 13:02:22.366298   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:22.366466   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:22.366739   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:22.367837   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601786404416-431-0/minicluster-data/ts-0-root/instance:
uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
format_stamp: "Formatted at 2026-07-09 13:02:22 on dist-test-slave-6j4g"
I20260709 13:02:22.372577   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:02:22.376191 13001 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:22.377032   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:02:22.377336   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601786404416-431-0/minicluster-data/ts-0-root
uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
format_stamp: "Formatted at 2026-07-09 13:02:22 on dist-test-slave-6j4g"
I20260709 13:02:22.377614   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601786404416-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601786404416-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601786404416-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:22.410626   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:22.411770   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:22.413220   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:22.415446   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:22.415638   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:22.415853   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:22.416009   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:22.454241   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:44167
I20260709 13:02:22.454371 13063 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:44167 every 8 connection(s)
I20260709 13:02:22.459290   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:22.465670 13068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:22.467555 13069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:22.469259   431 server_base.cc:1061] running on GCE node
W20260709 13:02:22.469564 13071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:22.471238   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:22.471527   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:22.471598 13064 heartbeater.cc:344] Connected to a master server at 127.0.107.254:39611
I20260709 13:02:22.471689   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602142471673 us; error 0 us; skew 500 ppm
I20260709 13:02:22.472117 13064 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:22.472520   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:22.472944 13064 heartbeater.cc:507] Master 127.0.107.254:39611 requested a full tablet report, sending...
I20260709 13:02:22.475209   431 webserver.cc:533] Webserver started at http://127.0.107.194:38753/ using document root <none> and password file <none>
I20260709 13:02:22.475381 12937 ts_manager.cc:194] Registered new tserver with Master: 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167)
I20260709 13:02:22.475836   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:22.476083   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:22.476337   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:22.477289 12937 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57904
I20260709 13:02:22.477434   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601786404416-431-0/minicluster-data/ts-1-root/instance:
uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
format_stamp: "Formatted at 2026-07-09 13:02:22 on dist-test-slave-6j4g"
I20260709 13:02:22.482203   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:02:22.485457 13076 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:22.486184   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:02:22.486478   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601786404416-431-0/minicluster-data/ts-1-root
uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
format_stamp: "Formatted at 2026-07-09 13:02:22 on dist-test-slave-6j4g"
I20260709 13:02:22.486737   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601786404416-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601786404416-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601786404416-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:22.499945   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:22.501055   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:22.502453   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:22.504833   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:22.505043   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:22.505265   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:22.505426   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:22.542884   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:34599
I20260709 13:02:22.542980 13138 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:34599 every 8 connection(s)
I20260709 13:02:22.547659   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:22.553961 13142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:22.555483 13143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:22.559343 13139 heartbeater.cc:344] Connected to a master server at 127.0.107.254:39611
I20260709 13:02:22.559334   431 server_base.cc:1061] running on GCE node
W20260709 13:02:22.559638 13145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:22.560077 13139 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:22.560897   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:02:22.561103 13139 heartbeater.cc:507] Master 127.0.107.254:39611 requested a full tablet report, sending...
W20260709 13:02:22.561290   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:22.561528   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602142561509 us; error 0 us; skew 500 ppm
I20260709 13:02:22.562290   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:22.563530 12937 ts_manager.cc:194] Registered new tserver with Master: e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599)
I20260709 13:02:22.564801   431 webserver.cc:533] Webserver started at http://127.0.107.195:42163/ using document root <none> and password file <none>
I20260709 13:02:22.565244 12937 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57912
I20260709 13:02:22.565382   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:22.565698   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:22.565973   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:22.567315   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601786404416-431-0/minicluster-data/ts-2-root/instance:
uuid: "907cde6b822944c7a81e18d74131932a"
format_stamp: "Formatted at 2026-07-09 13:02:22 on dist-test-slave-6j4g"
I20260709 13:02:22.571970   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:02:22.575364 13150 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:22.576182   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:02:22.576515   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601786404416-431-0/minicluster-data/ts-2-root
uuid: "907cde6b822944c7a81e18d74131932a"
format_stamp: "Formatted at 2026-07-09 13:02:22 on dist-test-slave-6j4g"
I20260709 13:02:22.576778   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601786404416-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601786404416-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601786404416-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:22.595180   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:22.596238   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:22.597640   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:22.599893   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:22.600092   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:22.600323   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:22.600535   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:02:22.638566   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:38535
I20260709 13:02:22.638666 13212 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:38535 every 8 connection(s)
I20260709 13:02:22.651871 13213 heartbeater.cc:344] Connected to a master server at 127.0.107.254:39611
I20260709 13:02:22.652300 13213 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:22.653038 13213 heartbeater.cc:507] Master 127.0.107.254:39611 requested a full tablet report, sending...
I20260709 13:02:22.655030 12937 ts_manager.cc:194] Registered new tserver with Master: 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:22.655107   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013620055s
I20260709 13:02:22.656464 12937 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57918
I20260709 13:02:22.680713 12937 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57922:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:22.683298 12937 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:22.784636 13178 tablet_service.cc:1511] Processing CreateTablet for tablet 4018c93e45734aac9b61b02e27e0ef16 (DEFAULT_TABLE table=test-workload [id=933f4a92c4bc4ab98e0f1a201e82c4a7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:22.785334 13177 tablet_service.cc:1511] Processing CreateTablet for tablet a3d1a30f18f441fcb2e63ba9dd524989 (DEFAULT_TABLE table=test-workload [id=933f4a92c4bc4ab98e0f1a201e82c4a7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:22.785538 13176 tablet_service.cc:1511] Processing CreateTablet for tablet 16f353bc6d1847a199accd034426ec3f (DEFAULT_TABLE table=test-workload [id=933f4a92c4bc4ab98e0f1a201e82c4a7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:22.786226 13178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4018c93e45734aac9b61b02e27e0ef16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.787526 13029 tablet_service.cc:1511] Processing CreateTablet for tablet 4018c93e45734aac9b61b02e27e0ef16 (DEFAULT_TABLE table=test-workload [id=933f4a92c4bc4ab98e0f1a201e82c4a7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:22.788921 13029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4018c93e45734aac9b61b02e27e0ef16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.789798 13021 tablet_service.cc:1511] Processing CreateTablet for tablet 6d27b2b82449490087a942a8a70295fe (DEFAULT_TABLE table=test-workload [id=933f4a92c4bc4ab98e0f1a201e82c4a7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:22.791153 13021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d27b2b82449490087a942a8a70295fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.793627 13022 tablet_service.cc:1511] Processing CreateTablet for tablet 4a6e18b4b04949d39e83b2d4680ce17a (DEFAULT_TABLE table=test-workload [id=933f4a92c4bc4ab98e0f1a201e82c4a7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:22.795053 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a6e18b4b04949d39e83b2d4680ce17a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.797657 13023 tablet_service.cc:1511] Processing CreateTablet for tablet 8c8e031f412048f09177a12e10d44d21 (DEFAULT_TABLE table=test-workload [id=933f4a92c4bc4ab98e0f1a201e82c4a7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:22.799088 13023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c8e031f412048f09177a12e10d44d21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.800400 13104 tablet_service.cc:1511] Processing CreateTablet for tablet 4018c93e45734aac9b61b02e27e0ef16 (DEFAULT_TABLE table=test-workload [id=933f4a92c4bc4ab98e0f1a201e82c4a7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:22.801955 13104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4018c93e45734aac9b61b02e27e0ef16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.801604 13024 tablet_service.cc:1511] Processing CreateTablet for tablet 1e1e91abc0df42e99e2956ee39413813 (DEFAULT_TABLE table=test-workload [id=933f4a92c4bc4ab98e0f1a201e82c4a7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:22.803030 13024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e1e91abc0df42e99e2956ee39413813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.805855 13028 tablet_service.cc:1511] Processing CreateTablet for tablet a3d1a30f18f441fcb2e63ba9dd524989 (DEFAULT_TABLE table=test-workload [id=933f4a92c4bc4ab98e0f1a201e82c4a7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:22.807339 13028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3d1a30f18f441fcb2e63ba9dd524989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.809806 13027 tablet_service.cc:1511] Processing CreateTablet for tablet 16f353bc6d1847a199accd034426ec3f (DEFAULT_TABLE table=test-workload [id=933f4a92c4bc4ab98e0f1a201e82c4a7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:22.810221 13103 tablet_service.cc:1511] Processing CreateTablet for tablet a3d1a30f18f441fcb2e63ba9dd524989 (DEFAULT_TABLE table=test-workload [id=933f4a92c4bc4ab98e0f1a201e82c4a7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:22.811074 13101 tablet_service.cc:1511] Processing CreateTablet for tablet 44066ba5afb3439496e0ffc8c96b6536 (DEFAULT_TABLE table=test-workload [id=933f4a92c4bc4ab98e0f1a201e82c4a7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:22.811836 13103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3d1a30f18f441fcb2e63ba9dd524989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.812678 13101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44066ba5afb3439496e0ffc8c96b6536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.813032 13026 tablet_service.cc:1511] Processing CreateTablet for tablet 44066ba5afb3439496e0ffc8c96b6536 (DEFAULT_TABLE table=test-workload [id=933f4a92c4bc4ab98e0f1a201e82c4a7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:22.814262 13102 tablet_service.cc:1511] Processing CreateTablet for tablet 16f353bc6d1847a199accd034426ec3f (DEFAULT_TABLE table=test-workload [id=933f4a92c4bc4ab98e0f1a201e82c4a7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:22.815526 13228 tablet_bootstrap.cc:492] T 4018c93e45734aac9b61b02e27e0ef16 P 329c44a887e5438d8d4d7b4b6e2fac58: Bootstrap starting.
I20260709 13:02:22.815797 13102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f353bc6d1847a199accd034426ec3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.817837 13175 tablet_service.cc:1511] Processing CreateTablet for tablet 44066ba5afb3439496e0ffc8c96b6536 (DEFAULT_TABLE table=test-workload [id=933f4a92c4bc4ab98e0f1a201e82c4a7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:22.815376 13025 tablet_service.cc:1511] Processing CreateTablet for tablet fd119138500f4351b2f68bcc272e0780 (DEFAULT_TABLE table=test-workload [id=933f4a92c4bc4ab98e0f1a201e82c4a7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:22.820007 13177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3d1a30f18f441fcb2e63ba9dd524989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.819692 13174 tablet_service.cc:1511] Processing CreateTablet for tablet fd119138500f4351b2f68bcc272e0780 (DEFAULT_TABLE table=test-workload [id=933f4a92c4bc4ab98e0f1a201e82c4a7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:22.821707 13100 tablet_service.cc:1511] Processing CreateTablet for tablet fd119138500f4351b2f68bcc272e0780 (DEFAULT_TABLE table=test-workload [id=933f4a92c4bc4ab98e0f1a201e82c4a7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:22.822908 13172 tablet_service.cc:1511] Processing CreateTablet for tablet 8c8e031f412048f09177a12e10d44d21 (DEFAULT_TABLE table=test-workload [id=933f4a92c4bc4ab98e0f1a201e82c4a7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:22.824993 13171 tablet_service.cc:1511] Processing CreateTablet for tablet 4a6e18b4b04949d39e83b2d4680ce17a (DEFAULT_TABLE table=test-workload [id=933f4a92c4bc4ab98e0f1a201e82c4a7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:22.825519 13099 tablet_service.cc:1511] Processing CreateTablet for tablet 1e1e91abc0df42e99e2956ee39413813 (DEFAULT_TABLE table=test-workload [id=933f4a92c4bc4ab98e0f1a201e82c4a7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:22.811553 13027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f353bc6d1847a199accd034426ec3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.827039 13025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd119138500f4351b2f68bcc272e0780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.821592 13173 tablet_service.cc:1511] Processing CreateTablet for tablet 1e1e91abc0df42e99e2956ee39413813 (DEFAULT_TABLE table=test-workload [id=933f4a92c4bc4ab98e0f1a201e82c4a7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:22.828320 13026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44066ba5afb3439496e0ffc8c96b6536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.828922 13172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c8e031f412048f09177a12e10d44d21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.827147 13170 tablet_service.cc:1511] Processing CreateTablet for tablet 6d27b2b82449490087a942a8a70295fe (DEFAULT_TABLE table=test-workload [id=933f4a92c4bc4ab98e0f1a201e82c4a7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:22.830090 13098 tablet_service.cc:1511] Processing CreateTablet for tablet 8c8e031f412048f09177a12e10d44d21 (DEFAULT_TABLE table=test-workload [id=933f4a92c4bc4ab98e0f1a201e82c4a7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:22.831027 13170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d27b2b82449490087a942a8a70295fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.823328 13100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd119138500f4351b2f68bcc272e0780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.832954 13098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c8e031f412048f09177a12e10d44d21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.835520 13097 tablet_service.cc:1511] Processing CreateTablet for tablet 4a6e18b4b04949d39e83b2d4680ce17a (DEFAULT_TABLE table=test-workload [id=933f4a92c4bc4ab98e0f1a201e82c4a7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:22.836833 13099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e1e91abc0df42e99e2956ee39413813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.844853 13097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a6e18b4b04949d39e83b2d4680ce17a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.865245 13171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a6e18b4b04949d39e83b2d4680ce17a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.870136 13096 tablet_service.cc:1511] Processing CreateTablet for tablet 6d27b2b82449490087a942a8a70295fe (DEFAULT_TABLE table=test-workload [id=933f4a92c4bc4ab98e0f1a201e82c4a7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:22.871552 13096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d27b2b82449490087a942a8a70295fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.876210 13176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f353bc6d1847a199accd034426ec3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.879554 13173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e1e91abc0df42e99e2956ee39413813. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.885288 13174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd119138500f4351b2f68bcc272e0780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.889333 13175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44066ba5afb3439496e0ffc8c96b6536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.913811 13229 tablet_bootstrap.cc:492] T 4018c93e45734aac9b61b02e27e0ef16 P 907cde6b822944c7a81e18d74131932a: Bootstrap starting.
I20260709 13:02:22.921734 13230 tablet_bootstrap.cc:492] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c: Bootstrap starting.
I20260709 13:02:22.938625 13228 tablet_bootstrap.cc:654] T 4018c93e45734aac9b61b02e27e0ef16 P 329c44a887e5438d8d4d7b4b6e2fac58: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:22.955893 13229 tablet_bootstrap.cc:654] T 4018c93e45734aac9b61b02e27e0ef16 P 907cde6b822944c7a81e18d74131932a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:22.963194 13230 tablet_bootstrap.cc:654] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:22.970230 13228 tablet_bootstrap.cc:492] T 4018c93e45734aac9b61b02e27e0ef16 P 329c44a887e5438d8d4d7b4b6e2fac58: No bootstrap required, opened a new log
I20260709 13:02:22.970755 13228 ts_tablet_manager.cc:1403] T 4018c93e45734aac9b61b02e27e0ef16 P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent bootstrapping tablet: real 0.155s	user 0.016s	sys 0.020s
I20260709 13:02:22.971114 13230 tablet_bootstrap.cc:492] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c: No bootstrap required, opened a new log
I20260709 13:02:22.971690 13230 ts_tablet_manager.cc:1403] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c: Time spent bootstrapping tablet: real 0.050s	user 0.000s	sys 0.010s
I20260709 13:02:22.972672 13229 tablet_bootstrap.cc:492] T 4018c93e45734aac9b61b02e27e0ef16 P 907cde6b822944c7a81e18d74131932a: No bootstrap required, opened a new log
I20260709 13:02:22.973230 13229 ts_tablet_manager.cc:1403] T 4018c93e45734aac9b61b02e27e0ef16 P 907cde6b822944c7a81e18d74131932a: Time spent bootstrapping tablet: real 0.081s	user 0.011s	sys 0.011s
I20260709 13:02:22.973196 13228 raft_consensus.cc:359] T 4018c93e45734aac9b61b02e27e0ef16 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } } peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } }
I20260709 13:02:22.973894 13228 raft_consensus.cc:385] T 4018c93e45734aac9b61b02e27e0ef16 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:22.974129 13228 raft_consensus.cc:740] T 4018c93e45734aac9b61b02e27e0ef16 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 329c44a887e5438d8d4d7b4b6e2fac58, State: Initialized, Role: FOLLOWER
I20260709 13:02:22.974557 13230 raft_consensus.cc:359] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:22.974773 13228 consensus_queue.cc:260] T 4018c93e45734aac9b61b02e27e0ef16 P 329c44a887e5438d8d4d7b4b6e2fac58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } } peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } }
I20260709 13:02:22.975430 13230 raft_consensus.cc:385] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:22.975777 13230 raft_consensus.cc:740] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c403ce70cf42d4bf96348aa91ce00c, State: Initialized, Role: FOLLOWER
I20260709 13:02:22.976661 13230 consensus_queue.cc:260] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:22.977252 13064 heartbeater.cc:499] Master 127.0.107.254:39611 was elected leader, sending a full tablet report...
I20260709 13:02:22.976310 13229 raft_consensus.cc:359] T 4018c93e45734aac9b61b02e27e0ef16 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } } peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } }
I20260709 13:02:22.977584 13228 ts_tablet_manager.cc:1434] T 4018c93e45734aac9b61b02e27e0ef16 P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:02:22.977962 13229 raft_consensus.cc:385] T 4018c93e45734aac9b61b02e27e0ef16 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:22.978334 13229 raft_consensus.cc:740] T 4018c93e45734aac9b61b02e27e0ef16 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Initialized, Role: FOLLOWER
I20260709 13:02:22.978915 13228 tablet_bootstrap.cc:492] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58: Bootstrap starting.
I20260709 13:02:22.979506 13229 consensus_queue.cc:260] T 4018c93e45734aac9b61b02e27e0ef16 P 907cde6b822944c7a81e18d74131932a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } } peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } }
I20260709 13:02:22.985832 13228 tablet_bootstrap.cc:654] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:23.014420 13139 heartbeater.cc:499] Master 127.0.107.254:39611 was elected leader, sending a full tablet report...
I20260709 13:02:23.014539 13213 heartbeater.cc:499] Master 127.0.107.254:39611 was elected leader, sending a full tablet report...
I20260709 13:02:23.014930 13230 ts_tablet_manager.cc:1434] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c: Time spent starting tablet: real 0.043s	user 0.022s	sys 0.022s
I20260709 13:02:23.015146 13228 tablet_bootstrap.cc:492] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58: No bootstrap required, opened a new log
I20260709 13:02:23.015820 13228 ts_tablet_manager.cc:1403] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent bootstrapping tablet: real 0.037s	user 0.028s	sys 0.007s
I20260709 13:02:23.016043 13230 tablet_bootstrap.cc:492] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c: Bootstrap starting.
I20260709 13:02:23.014438 13229 ts_tablet_manager.cc:1434] T 4018c93e45734aac9b61b02e27e0ef16 P 907cde6b822944c7a81e18d74131932a: Time spent starting tablet: real 0.041s	user 0.012s	sys 0.027s
I20260709 13:02:23.019544 13229 tablet_bootstrap.cc:492] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a: Bootstrap starting.
I20260709 13:02:23.019090 13228 raft_consensus.cc:359] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.020057 13228 raft_consensus.cc:385] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:23.020426 13228 raft_consensus.cc:740] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 329c44a887e5438d8d4d7b4b6e2fac58, State: Initialized, Role: FOLLOWER
I20260709 13:02:23.021430 13228 consensus_queue.cc:260] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.024101 13228 ts_tablet_manager.cc:1434] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:23.025283 13228 tablet_bootstrap.cc:492] T 1e1e91abc0df42e99e2956ee39413813 P 329c44a887e5438d8d4d7b4b6e2fac58: Bootstrap starting.
I20260709 13:02:23.026373 13229 tablet_bootstrap.cc:654] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:23.031131 13228 tablet_bootstrap.cc:654] T 1e1e91abc0df42e99e2956ee39413813 P 329c44a887e5438d8d4d7b4b6e2fac58: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:23.032385 13230 tablet_bootstrap.cc:654] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:23.038407 13229 tablet_bootstrap.cc:492] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a: No bootstrap required, opened a new log
I20260709 13:02:23.039044 13229 ts_tablet_manager.cc:1403] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.001s
I20260709 13:02:23.042331 13229 raft_consensus.cc:359] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.043195 13229 raft_consensus.cc:385] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:23.043500 13229 raft_consensus.cc:740] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Initialized, Role: FOLLOWER
I20260709 13:02:23.046761 13229 consensus_queue.cc:260] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.049284 13229 ts_tablet_manager.cc:1434] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.004s
I20260709 13:02:23.051410 13228 tablet_bootstrap.cc:492] T 1e1e91abc0df42e99e2956ee39413813 P 329c44a887e5438d8d4d7b4b6e2fac58: No bootstrap required, opened a new log
I20260709 13:02:23.052126 13228 ts_tablet_manager.cc:1403] T 1e1e91abc0df42e99e2956ee39413813 P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.004s
I20260709 13:02:23.052309 13229 tablet_bootstrap.cc:492] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a: Bootstrap starting.
I20260709 13:02:23.055703 13228 raft_consensus.cc:359] T 1e1e91abc0df42e99e2956ee39413813 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.056629 13228 raft_consensus.cc:385] T 1e1e91abc0df42e99e2956ee39413813 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:23.056980 13228 raft_consensus.cc:740] T 1e1e91abc0df42e99e2956ee39413813 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 329c44a887e5438d8d4d7b4b6e2fac58, State: Initialized, Role: FOLLOWER
I20260709 13:02:23.057833 13228 consensus_queue.cc:260] T 1e1e91abc0df42e99e2956ee39413813 P 329c44a887e5438d8d4d7b4b6e2fac58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.058969 13229 tablet_bootstrap.cc:654] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:23.063084 13228 ts_tablet_manager.cc:1434] T 1e1e91abc0df42e99e2956ee39413813 P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:02:23.064384 13228 tablet_bootstrap.cc:492] T 44066ba5afb3439496e0ffc8c96b6536 P 329c44a887e5438d8d4d7b4b6e2fac58: Bootstrap starting.
I20260709 13:02:23.066962 13230 tablet_bootstrap.cc:492] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c: No bootstrap required, opened a new log
I20260709 13:02:23.067059 13229 tablet_bootstrap.cc:492] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a: No bootstrap required, opened a new log
I20260709 13:02:23.067687 13230 ts_tablet_manager.cc:1403] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.012s
I20260709 13:02:23.067786 13229 ts_tablet_manager.cc:1403] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.006s
I20260709 13:02:23.071280 13228 tablet_bootstrap.cc:654] T 44066ba5afb3439496e0ffc8c96b6536 P 329c44a887e5438d8d4d7b4b6e2fac58: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:23.071254 13229 raft_consensus.cc:359] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.072281 13229 raft_consensus.cc:385] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:23.072741 13229 raft_consensus.cc:740] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Initialized, Role: FOLLOWER
I20260709 13:02:23.071005 13230 raft_consensus.cc:359] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.073606 13229 consensus_queue.cc:260] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.074339 13230 raft_consensus.cc:385] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:23.075225 13230 raft_consensus.cc:740] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c403ce70cf42d4bf96348aa91ce00c, State: Initialized, Role: FOLLOWER
I20260709 13:02:23.076130 13230 consensus_queue.cc:260] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.076591 13229 ts_tablet_manager.cc:1434] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:02:23.078461 13230 ts_tablet_manager.cc:1434] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:02:23.079816 13230 tablet_bootstrap.cc:492] T 4018c93e45734aac9b61b02e27e0ef16 P e1c403ce70cf42d4bf96348aa91ce00c: Bootstrap starting.
I20260709 13:02:23.080276 13229 tablet_bootstrap.cc:492] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a: Bootstrap starting.
I20260709 13:02:23.082077 13228 tablet_bootstrap.cc:492] T 44066ba5afb3439496e0ffc8c96b6536 P 329c44a887e5438d8d4d7b4b6e2fac58: No bootstrap required, opened a new log
I20260709 13:02:23.082785 13228 ts_tablet_manager.cc:1403] T 44066ba5afb3439496e0ffc8c96b6536 P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.002s
I20260709 13:02:23.086259 13230 tablet_bootstrap.cc:654] T 4018c93e45734aac9b61b02e27e0ef16 P e1c403ce70cf42d4bf96348aa91ce00c: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:23.085975 13228 raft_consensus.cc:359] T 44066ba5afb3439496e0ffc8c96b6536 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.086922 13228 raft_consensus.cc:385] T 44066ba5afb3439496e0ffc8c96b6536 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:23.087028 13229 tablet_bootstrap.cc:654] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:23.087368 13228 raft_consensus.cc:740] T 44066ba5afb3439496e0ffc8c96b6536 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 329c44a887e5438d8d4d7b4b6e2fac58, State: Initialized, Role: FOLLOWER
I20260709 13:02:23.088359 13228 consensus_queue.cc:260] T 44066ba5afb3439496e0ffc8c96b6536 P 329c44a887e5438d8d4d7b4b6e2fac58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.090802 13228 ts_tablet_manager.cc:1434] T 44066ba5afb3439496e0ffc8c96b6536 P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:23.091966 13228 tablet_bootstrap.cc:492] T 4a6e18b4b04949d39e83b2d4680ce17a P 329c44a887e5438d8d4d7b4b6e2fac58: Bootstrap starting.
I20260709 13:02:23.098204 13228 tablet_bootstrap.cc:654] T 4a6e18b4b04949d39e83b2d4680ce17a P 329c44a887e5438d8d4d7b4b6e2fac58: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:23.106818 13229 tablet_bootstrap.cc:492] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a: No bootstrap required, opened a new log
I20260709 13:02:23.106818 13230 tablet_bootstrap.cc:492] T 4018c93e45734aac9b61b02e27e0ef16 P e1c403ce70cf42d4bf96348aa91ce00c: No bootstrap required, opened a new log
I20260709 13:02:23.107501 13230 ts_tablet_manager.cc:1403] T 4018c93e45734aac9b61b02e27e0ef16 P e1c403ce70cf42d4bf96348aa91ce00c: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.010s
I20260709 13:02:23.107523 13229 ts_tablet_manager.cc:1403] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.006s
I20260709 13:02:23.110754 13230 raft_consensus.cc:359] T 4018c93e45734aac9b61b02e27e0ef16 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } } peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } }
I20260709 13:02:23.111580 13230 raft_consensus.cc:385] T 4018c93e45734aac9b61b02e27e0ef16 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:23.111379 13229 raft_consensus.cc:359] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.111944 13230 raft_consensus.cc:740] T 4018c93e45734aac9b61b02e27e0ef16 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c403ce70cf42d4bf96348aa91ce00c, State: Initialized, Role: FOLLOWER
I20260709 13:02:23.112257 13229 raft_consensus.cc:385] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:23.112640 13229 raft_consensus.cc:740] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Initialized, Role: FOLLOWER
I20260709 13:02:23.112761 13230 consensus_queue.cc:260] T 4018c93e45734aac9b61b02e27e0ef16 P e1c403ce70cf42d4bf96348aa91ce00c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } } peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } }
I20260709 13:02:23.113577 13229 consensus_queue.cc:260] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.115149 13230 ts_tablet_manager.cc:1434] T 4018c93e45734aac9b61b02e27e0ef16 P e1c403ce70cf42d4bf96348aa91ce00c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:23.115705 13228 tablet_bootstrap.cc:492] T 4a6e18b4b04949d39e83b2d4680ce17a P 329c44a887e5438d8d4d7b4b6e2fac58: No bootstrap required, opened a new log
I20260709 13:02:23.116287 13230 tablet_bootstrap.cc:492] T 16f353bc6d1847a199accd034426ec3f P e1c403ce70cf42d4bf96348aa91ce00c: Bootstrap starting.
I20260709 13:02:23.117879 13229 ts_tablet_manager.cc:1434] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:02:23.119182 13229 tablet_bootstrap.cc:492] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a: Bootstrap starting.
I20260709 13:02:23.119427 13228 ts_tablet_manager.cc:1403] T 4a6e18b4b04949d39e83b2d4680ce17a P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.005s
I20260709 13:02:23.123512 13228 raft_consensus.cc:359] T 4a6e18b4b04949d39e83b2d4680ce17a P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.124279 13228 raft_consensus.cc:385] T 4a6e18b4b04949d39e83b2d4680ce17a P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:23.124605 13228 raft_consensus.cc:740] T 4a6e18b4b04949d39e83b2d4680ce17a P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 329c44a887e5438d8d4d7b4b6e2fac58, State: Initialized, Role: FOLLOWER
I20260709 13:02:23.125306 13228 consensus_queue.cc:260] T 4a6e18b4b04949d39e83b2d4680ce17a P 329c44a887e5438d8d4d7b4b6e2fac58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.127571 13228 ts_tablet_manager.cc:1434] T 4a6e18b4b04949d39e83b2d4680ce17a P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:02:23.127664 13229 tablet_bootstrap.cc:654] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:23.128648 13228 tablet_bootstrap.cc:492] T fd119138500f4351b2f68bcc272e0780 P 329c44a887e5438d8d4d7b4b6e2fac58: Bootstrap starting.
I20260709 13:02:23.123528 13230 tablet_bootstrap.cc:654] T 16f353bc6d1847a199accd034426ec3f P e1c403ce70cf42d4bf96348aa91ce00c: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:23.136884 13228 tablet_bootstrap.cc:654] T fd119138500f4351b2f68bcc272e0780 P 329c44a887e5438d8d4d7b4b6e2fac58: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:23.137284 13234 raft_consensus.cc:493] T 4018c93e45734aac9b61b02e27e0ef16 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.137826 13234 raft_consensus.cc:515] T 4018c93e45734aac9b61b02e27e0ef16 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } } peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } }
I20260709 13:02:23.138434 13230 tablet_bootstrap.cc:492] T 16f353bc6d1847a199accd034426ec3f P e1c403ce70cf42d4bf96348aa91ce00c: No bootstrap required, opened a new log
I20260709 13:02:23.139024 13230 ts_tablet_manager.cc:1403] T 16f353bc6d1847a199accd034426ec3f P e1c403ce70cf42d4bf96348aa91ce00c: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.001s
I20260709 13:02:23.141129 13229 tablet_bootstrap.cc:492] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a: No bootstrap required, opened a new log
I20260709 13:02:23.141809 13229 ts_tablet_manager.cc:1403] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.003s
I20260709 13:02:23.142058 13230 raft_consensus.cc:359] T 16f353bc6d1847a199accd034426ec3f P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.142861 13230 raft_consensus.cc:385] T 16f353bc6d1847a199accd034426ec3f P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:23.143154 13230 raft_consensus.cc:740] T 16f353bc6d1847a199accd034426ec3f P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c403ce70cf42d4bf96348aa91ce00c, State: Initialized, Role: FOLLOWER
I20260709 13:02:23.143908 13230 consensus_queue.cc:260] T 16f353bc6d1847a199accd034426ec3f P e1c403ce70cf42d4bf96348aa91ce00c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.145265 13229 raft_consensus.cc:359] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.146210 13229 raft_consensus.cc:385] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:23.146427 13230 ts_tablet_manager.cc:1434] T 16f353bc6d1847a199accd034426ec3f P e1c403ce70cf42d4bf96348aa91ce00c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:23.146536 13229 raft_consensus.cc:740] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Initialized, Role: FOLLOWER
I20260709 13:02:23.147593 13230 tablet_bootstrap.cc:492] T a3d1a30f18f441fcb2e63ba9dd524989 P e1c403ce70cf42d4bf96348aa91ce00c: Bootstrap starting.
I20260709 13:02:23.147733 13229 consensus_queue.cc:260] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.155145 13230 tablet_bootstrap.cc:654] T a3d1a30f18f441fcb2e63ba9dd524989 P e1c403ce70cf42d4bf96348aa91ce00c: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:23.159085 13229 ts_tablet_manager.cc:1434] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:02:23.160434 13234 leader_election.cc:290] T 4018c93e45734aac9b61b02e27e0ef16 P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:23.163676 13229 tablet_bootstrap.cc:492] T 6d27b2b82449490087a942a8a70295fe P 907cde6b822944c7a81e18d74131932a: Bootstrap starting.
I20260709 13:02:23.171967 13229 tablet_bootstrap.cc:654] T 6d27b2b82449490087a942a8a70295fe P 907cde6b822944c7a81e18d74131932a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:23.184510 13229 tablet_bootstrap.cc:492] T 6d27b2b82449490087a942a8a70295fe P 907cde6b822944c7a81e18d74131932a: No bootstrap required, opened a new log
I20260709 13:02:23.185302 13236 raft_consensus.cc:493] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.185986 13236 raft_consensus.cc:515] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.202718 13236 leader_election.cc:290] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599)
I20260709 13:02:23.211259 13114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4018c93e45734aac9b61b02e27e0ef16" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" is_pre_election: true
I20260709 13:02:23.212353 13114 raft_consensus.cc:2468] T 4018c93e45734aac9b61b02e27e0ef16 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 329c44a887e5438d8d4d7b4b6e2fac58 in term 0.
I20260709 13:02:23.215488 13229 ts_tablet_manager.cc:1403] T 6d27b2b82449490087a942a8a70295fe P 907cde6b822944c7a81e18d74131932a: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.011s
I20260709 13:02:23.215405 13005 leader_election.cc:304] T 4018c93e45734aac9b61b02e27e0ef16 P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, e1c403ce70cf42d4bf96348aa91ce00c; no voters: 
I20260709 13:02:23.216646 13234 raft_consensus.cc:2804] T 4018c93e45734aac9b61b02e27e0ef16 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:23.217094 13234 raft_consensus.cc:493] T 4018c93e45734aac9b61b02e27e0ef16 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.217424 13234 raft_consensus.cc:3060] T 4018c93e45734aac9b61b02e27e0ef16 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:23.227221 13234 raft_consensus.cc:515] T 4018c93e45734aac9b61b02e27e0ef16 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } } peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } }
I20260709 13:02:23.234864 13230 tablet_bootstrap.cc:492] T a3d1a30f18f441fcb2e63ba9dd524989 P e1c403ce70cf42d4bf96348aa91ce00c: No bootstrap required, opened a new log
I20260709 13:02:23.235481 13230 ts_tablet_manager.cc:1403] T a3d1a30f18f441fcb2e63ba9dd524989 P e1c403ce70cf42d4bf96348aa91ce00c: Time spent bootstrapping tablet: real 0.088s	user 0.029s	sys 0.044s
I20260709 13:02:23.219527 13229 raft_consensus.cc:359] T 6d27b2b82449490087a942a8a70295fe P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.233235 13188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4018c93e45734aac9b61b02e27e0ef16" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "907cde6b822944c7a81e18d74131932a" is_pre_election: true
I20260709 13:02:23.235718 13234 leader_election.cc:290] T 4018c93e45734aac9b61b02e27e0ef16 P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 1 election: Requested vote from peers e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:23.232023 13228 tablet_bootstrap.cc:492] T fd119138500f4351b2f68bcc272e0780 P 329c44a887e5438d8d4d7b4b6e2fac58: No bootstrap required, opened a new log
I20260709 13:02:23.236402 13114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4018c93e45734aac9b61b02e27e0ef16" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
I20260709 13:02:23.237718 13228 ts_tablet_manager.cc:1403] T fd119138500f4351b2f68bcc272e0780 P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent bootstrapping tablet: real 0.109s	user 0.037s	sys 0.061s
I20260709 13:02:23.237797 13114 raft_consensus.cc:3060] T 4018c93e45734aac9b61b02e27e0ef16 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:23.237030 13187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4018c93e45734aac9b61b02e27e0ef16" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "907cde6b822944c7a81e18d74131932a"
I20260709 13:02:23.239149 13230 raft_consensus.cc:359] T a3d1a30f18f441fcb2e63ba9dd524989 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.237098 13188 raft_consensus.cc:2468] T 4018c93e45734aac9b61b02e27e0ef16 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 329c44a887e5438d8d4d7b4b6e2fac58 in term 0.
I20260709 13:02:23.239988 13230 raft_consensus.cc:385] T a3d1a30f18f441fcb2e63ba9dd524989 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:23.240568 13230 raft_consensus.cc:740] T a3d1a30f18f441fcb2e63ba9dd524989 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c403ce70cf42d4bf96348aa91ce00c, State: Initialized, Role: FOLLOWER
I20260709 13:02:23.241448 13230 consensus_queue.cc:260] T a3d1a30f18f441fcb2e63ba9dd524989 P e1c403ce70cf42d4bf96348aa91ce00c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.241591 13228 raft_consensus.cc:359] T fd119138500f4351b2f68bcc272e0780 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.242767 13228 raft_consensus.cc:385] T fd119138500f4351b2f68bcc272e0780 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:23.243150 13228 raft_consensus.cc:740] T fd119138500f4351b2f68bcc272e0780 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 329c44a887e5438d8d4d7b4b6e2fac58, State: Initialized, Role: FOLLOWER
I20260709 13:02:23.236761 13229 raft_consensus.cc:385] T 6d27b2b82449490087a942a8a70295fe P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:23.244205 13229 raft_consensus.cc:740] T 6d27b2b82449490087a942a8a70295fe P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Initialized, Role: FOLLOWER
I20260709 13:02:23.243984 13228 consensus_queue.cc:260] T fd119138500f4351b2f68bcc272e0780 P 329c44a887e5438d8d4d7b4b6e2fac58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.245110 13229 consensus_queue.cc:260] T 6d27b2b82449490087a942a8a70295fe P 907cde6b822944c7a81e18d74131932a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.246632 13114 raft_consensus.cc:2468] T 4018c93e45734aac9b61b02e27e0ef16 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 329c44a887e5438d8d4d7b4b6e2fac58 in term 1.
I20260709 13:02:23.247941 13005 leader_election.cc:304] T 4018c93e45734aac9b61b02e27e0ef16 P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, e1c403ce70cf42d4bf96348aa91ce00c; no voters: 907cde6b822944c7a81e18d74131932a
I20260709 13:02:23.249107 13228 ts_tablet_manager.cc:1434] T fd119138500f4351b2f68bcc272e0780 P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:02:23.249691 13234 raft_consensus.cc:2804] T 4018c93e45734aac9b61b02e27e0ef16 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:23.250211 13230 ts_tablet_manager.cc:1434] T a3d1a30f18f441fcb2e63ba9dd524989 P e1c403ce70cf42d4bf96348aa91ce00c: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 13:02:23.250331 13228 tablet_bootstrap.cc:492] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58: Bootstrap starting.
I20260709 13:02:23.251387 13230 tablet_bootstrap.cc:492] T 44066ba5afb3439496e0ffc8c96b6536 P e1c403ce70cf42d4bf96348aa91ce00c: Bootstrap starting.
I20260709 13:02:23.254096 13235 raft_consensus.cc:493] T 16f353bc6d1847a199accd034426ec3f P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.254778 13235 raft_consensus.cc:515] T 16f353bc6d1847a199accd034426ec3f P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.260610 13228 tablet_bootstrap.cc:654] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:23.260604 13230 tablet_bootstrap.cc:654] T 44066ba5afb3439496e0ffc8c96b6536 P e1c403ce70cf42d4bf96348aa91ce00c: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:23.257236 13229 ts_tablet_manager.cc:1434] T 6d27b2b82449490087a942a8a70295fe P 907cde6b822944c7a81e18d74131932a: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.000s
I20260709 13:02:23.263237 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd119138500f4351b2f68bcc272e0780" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" is_pre_election: true
I20260709 13:02:23.263931 13229 tablet_bootstrap.cc:492] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a: Bootstrap starting.
I20260709 13:02:23.264057 13039 raft_consensus.cc:2468] T fd119138500f4351b2f68bcc272e0780 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 0.
I20260709 13:02:23.265790 13151 leader_election.cc:304] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, 907cde6b822944c7a81e18d74131932a; no voters: 
I20260709 13:02:23.266804 13236 raft_consensus.cc:2804] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:23.267177 13236 raft_consensus.cc:493] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.267517 13236 raft_consensus.cc:3060] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:23.276353 13236 raft_consensus.cc:515] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
W20260709 13:02:23.281697 12985 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:23.272114 13235 leader_election.cc:290] T 16f353bc6d1847a199accd034426ec3f P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:23.278852 13236 leader_election.cc:290] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 election: Requested vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599)
I20260709 13:02:23.288247 13236 raft_consensus.cc:493] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.288784 13236 raft_consensus.cc:515] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.291646 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd119138500f4351b2f68bcc272e0780" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
I20260709 13:02:23.292373 13039 raft_consensus.cc:3060] T fd119138500f4351b2f68bcc272e0780 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:23.294936 13229 tablet_bootstrap.cc:654] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:23.298877 13235 raft_consensus.cc:493] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.299602 13235 raft_consensus.cc:515] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.308461 13235 leader_election.cc:290] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:23.310539 13039 raft_consensus.cc:2468] T fd119138500f4351b2f68bcc272e0780 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 1.
I20260709 13:02:23.312763 13234 raft_consensus.cc:697] T 4018c93e45734aac9b61b02e27e0ef16 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 LEADER]: Becoming Leader. State: Replica: 329c44a887e5438d8d4d7b4b6e2fac58, State: Running, Role: LEADER
I20260709 13:02:23.314062 13234 consensus_queue.cc:237] T 4018c93e45734aac9b61b02e27e0ef16 P 329c44a887e5438d8d4d7b4b6e2fac58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } } peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } }
I20260709 13:02:23.321730 13114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd119138500f4351b2f68bcc272e0780" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" is_pre_election: true
I20260709 13:02:23.322630 13114 raft_consensus.cc:2468] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 0.
I20260709 13:02:23.323405 13038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6e18b4b04949d39e83b2d4680ce17a" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" is_pre_election: true
I20260709 13:02:23.324152 13038 raft_consensus.cc:2468] T 4a6e18b4b04949d39e83b2d4680ce17a P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 0.
I20260709 13:02:23.325325 13151 leader_election.cc:304] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, 907cde6b822944c7a81e18d74131932a; no voters: 
I20260709 13:02:23.326439 13260 raft_consensus.cc:2804] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:23.326831 13260 raft_consensus.cc:493] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.327153 13260 raft_consensus.cc:3060] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:23.327625 13114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd119138500f4351b2f68bcc272e0780" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
I20260709 13:02:23.328349 13114 raft_consensus.cc:3060] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:23.330771 13151 leader_election.cc:304] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, 907cde6b822944c7a81e18d74131932a; no voters: 
I20260709 13:02:23.338205 13236 leader_election.cc:290] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599)
I20260709 13:02:23.338553 13113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6e18b4b04949d39e83b2d4680ce17a" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" is_pre_election: true
W20260709 13:02:23.340566 13154 leader_election.cc:343] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:23.339562 13236 raft_consensus.cc:2804] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:23.342207 13236 raft_consensus.cc:697] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Becoming Leader. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Running, Role: LEADER
I20260709 13:02:23.351214 13188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f353bc6d1847a199accd034426ec3f" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "907cde6b822944c7a81e18d74131932a" is_pre_election: true
I20260709 13:02:23.350544 12935 catalog_manager.cc:5697] T 4018c93e45734aac9b61b02e27e0ef16 P 329c44a887e5438d8d4d7b4b6e2fac58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:23.351593 13236 consensus_queue.cc:237] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.353180 13188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd119138500f4351b2f68bcc272e0780" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "907cde6b822944c7a81e18d74131932a" is_pre_election: true
I20260709 13:02:23.354250 13229 tablet_bootstrap.cc:492] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a: No bootstrap required, opened a new log
I20260709 13:02:23.354871 13229 ts_tablet_manager.cc:1403] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a: Time spent bootstrapping tablet: real 0.091s	user 0.016s	sys 0.007s
W20260709 13:02:23.355576 13079 leader_election.cc:343] T 16f353bc6d1847a199accd034426ec3f P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:23.358315 13229 raft_consensus.cc:359] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.359457 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f353bc6d1847a199accd034426ec3f" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" is_pre_election: true
I20260709 13:02:23.360852 13038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd119138500f4351b2f68bcc272e0780" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" is_pre_election: true
I20260709 13:02:23.364989 13038 raft_consensus.cc:2393] T fd119138500f4351b2f68bcc272e0780 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1c403ce70cf42d4bf96348aa91ce00c in current term 1: Already voted for candidate 907cde6b822944c7a81e18d74131932a in this term.
I20260709 13:02:23.366355 13228 tablet_bootstrap.cc:492] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58: No bootstrap required, opened a new log
W20260709 13:02:23.366582 13077 leader_election.cc:343] T 16f353bc6d1847a199accd034426ec3f P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:23.367077 13229 raft_consensus.cc:385] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:23.367259 13077 leader_election.cc:304] T 16f353bc6d1847a199accd034426ec3f P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1c403ce70cf42d4bf96348aa91ce00c; no voters: 329c44a887e5438d8d4d7b4b6e2fac58, 907cde6b822944c7a81e18d74131932a
I20260709 13:02:23.367430 13229 raft_consensus.cc:740] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Initialized, Role: FOLLOWER
I20260709 13:02:23.368196 13230 tablet_bootstrap.cc:492] T 44066ba5afb3439496e0ffc8c96b6536 P e1c403ce70cf42d4bf96348aa91ce00c: No bootstrap required, opened a new log
I20260709 13:02:23.368731 13077 leader_election.cc:304] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1c403ce70cf42d4bf96348aa91ce00c; no voters: 329c44a887e5438d8d4d7b4b6e2fac58, 907cde6b822944c7a81e18d74131932a
I20260709 13:02:23.368412 13229 consensus_queue.cc:260] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.368918 13230 ts_tablet_manager.cc:1403] T 44066ba5afb3439496e0ffc8c96b6536 P e1c403ce70cf42d4bf96348aa91ce00c: Time spent bootstrapping tablet: real 0.118s	user 0.026s	sys 0.060s
I20260709 13:02:23.362023 13114 raft_consensus.cc:2468] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 1.
I20260709 13:02:23.370106 13235 raft_consensus.cc:2749] T 16f353bc6d1847a199accd034426ec3f P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:23.370713 13235 raft_consensus.cc:2749] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:23.372059 13229 ts_tablet_manager.cc:1434] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.004s
I20260709 13:02:23.372823 13230 raft_consensus.cc:359] T 44066ba5afb3439496e0ffc8c96b6536 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.374306 13228 ts_tablet_manager.cc:1403] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent bootstrapping tablet: real 0.124s	user 0.024s	sys 0.038s
I20260709 13:02:23.380460 13230 raft_consensus.cc:385] T 44066ba5afb3439496e0ffc8c96b6536 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:23.380890 13230 raft_consensus.cc:740] T 44066ba5afb3439496e0ffc8c96b6536 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c403ce70cf42d4bf96348aa91ce00c, State: Initialized, Role: FOLLOWER
I20260709 13:02:23.381191 13229 tablet_bootstrap.cc:492] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a: Bootstrap starting.
I20260709 13:02:23.381917 13230 consensus_queue.cc:260] T 44066ba5afb3439496e0ffc8c96b6536 P e1c403ce70cf42d4bf96348aa91ce00c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.384024 13228 raft_consensus.cc:359] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.384616 13230 ts_tablet_manager.cc:1434] T 44066ba5afb3439496e0ffc8c96b6536 P e1c403ce70cf42d4bf96348aa91ce00c: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:02:23.387885 13230 tablet_bootstrap.cc:492] T 4a6e18b4b04949d39e83b2d4680ce17a P e1c403ce70cf42d4bf96348aa91ce00c: Bootstrap starting.
I20260709 13:02:23.351256 13260 raft_consensus.cc:515] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.385069 13228 raft_consensus.cc:385] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:23.389297 13228 raft_consensus.cc:740] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 329c44a887e5438d8d4d7b4b6e2fac58, State: Initialized, Role: FOLLOWER
I20260709 13:02:23.390270 13229 tablet_bootstrap.cc:654] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:23.390317 13228 consensus_queue.cc:260] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.393682 13228 ts_tablet_manager.cc:1434] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:02:23.393939 13038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6e18b4b04949d39e83b2d4680ce17a" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
I20260709 13:02:23.394665 13038 raft_consensus.cc:3060] T 4a6e18b4b04949d39e83b2d4680ce17a P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:23.394773 13228 tablet_bootstrap.cc:492] T 8c8e031f412048f09177a12e10d44d21 P 329c44a887e5438d8d4d7b4b6e2fac58: Bootstrap starting.
I20260709 13:02:23.395888 12937 catalog_manager.cc:5697] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a reported cstate change: term changed from 0 to 1, leader changed from <none> to 907cde6b822944c7a81e18d74131932a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "907cde6b822944c7a81e18d74131932a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:23.397089 13230 tablet_bootstrap.cc:654] T 4a6e18b4b04949d39e83b2d4680ce17a P e1c403ce70cf42d4bf96348aa91ce00c: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:23.405005 13228 tablet_bootstrap.cc:654] T 8c8e031f412048f09177a12e10d44d21 P 329c44a887e5438d8d4d7b4b6e2fac58: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:23.411446 13260 leader_election.cc:290] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 election: Requested vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599)
I20260709 13:02:23.411691 13114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6e18b4b04949d39e83b2d4680ce17a" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
W20260709 13:02:23.413324 13154 leader_election.cc:343] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:23.414321 13038 raft_consensus.cc:2468] T 4a6e18b4b04949d39e83b2d4680ce17a P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 1.
I20260709 13:02:23.415393 13234 raft_consensus.cc:493] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.415961 13234 raft_consensus.cc:515] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.416826 13151 leader_election.cc:304] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, 907cde6b822944c7a81e18d74131932a; no voters: e1c403ce70cf42d4bf96348aa91ce00c
I20260709 13:02:23.418139 13229 tablet_bootstrap.cc:492] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a: No bootstrap required, opened a new log
I20260709 13:02:23.418845 13269 raft_consensus.cc:493] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.419566 13234 leader_election.cc:290] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:23.419395 13269 raft_consensus.cc:515] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.419327 13188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d27b2b82449490087a942a8a70295fe" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "907cde6b822944c7a81e18d74131932a" is_pre_election: true
I20260709 13:02:23.420706 13188 raft_consensus.cc:2468] T 6d27b2b82449490087a942a8a70295fe P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 329c44a887e5438d8d4d7b4b6e2fac58 in term 0.
I20260709 13:02:23.422851 13269 leader_election.cc:290] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:23.423209 13236 raft_consensus.cc:2804] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:23.423561 13229 ts_tablet_manager.cc:1403] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.002s
I20260709 13:02:23.423796 13236 raft_consensus.cc:697] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Becoming Leader. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Running, Role: LEADER
I20260709 13:02:23.424751 13236 consensus_queue.cc:237] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.426889 13114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d27b2b82449490087a942a8a70295fe" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" is_pre_election: true
I20260709 13:02:23.426844 13264 raft_consensus.cc:493] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.426689 13229 raft_consensus.cc:359] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.427775 13004 leader_election.cc:304] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, 907cde6b822944c7a81e18d74131932a; no voters: 
I20260709 13:02:23.428187 13229 raft_consensus.cc:385] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:02:23.428586 13005 leader_election.cc:343] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:23.428562 13229 raft_consensus.cc:740] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Initialized, Role: FOLLOWER
I20260709 13:02:23.427886 13264 raft_consensus.cc:515] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.430171 13229 consensus_queue.cc:260] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.431613 13264 leader_election.cc:290] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599)
I20260709 13:02:23.428848 13188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1e91abc0df42e99e2956ee39413813" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "907cde6b822944c7a81e18d74131932a" is_pre_election: true
I20260709 13:02:23.432351 13229 ts_tablet_manager.cc:1434] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:02:23.433166 13038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1e91abc0df42e99e2956ee39413813" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" is_pre_election: true
I20260709 13:02:23.433377 13114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d1a30f18f441fcb2e63ba9dd524989" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" is_pre_election: true
W20260709 13:02:23.433434 13079 leader_election.cc:343] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:23.431891 13234 raft_consensus.cc:2804] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:23.434064 13114 raft_consensus.cc:2468] T a3d1a30f18f441fcb2e63ba9dd524989 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 0.
I20260709 13:02:23.434316 13234 raft_consensus.cc:493] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.434228 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d1a30f18f441fcb2e63ba9dd524989" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" is_pre_election: true
I20260709 13:02:23.434778 13234 raft_consensus.cc:3060] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:23.435302 13229 tablet_bootstrap.cc:492] T 1e1e91abc0df42e99e2956ee39413813 P 907cde6b822944c7a81e18d74131932a: Bootstrap starting.
I20260709 13:02:23.435266 13154 leader_election.cc:304] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 907cde6b822944c7a81e18d74131932a, e1c403ce70cf42d4bf96348aa91ce00c; no voters: 
I20260709 13:02:23.435175 13039 raft_consensus.cc:2468] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 0.
I20260709 13:02:23.437363 13264 raft_consensus.cc:2804] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:23.438948 13264 raft_consensus.cc:493] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.439478 13264 raft_consensus.cc:3060] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:23.433888 13038 raft_consensus.cc:2468] T 1e1e91abc0df42e99e2956ee39413813 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1c403ce70cf42d4bf96348aa91ce00c in term 0.
I20260709 13:02:23.442546 13228 tablet_bootstrap.cc:492] T 8c8e031f412048f09177a12e10d44d21 P 329c44a887e5438d8d4d7b4b6e2fac58: No bootstrap required, opened a new log
I20260709 13:02:23.442569 13077 leader_election.cc:304] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, e1c403ce70cf42d4bf96348aa91ce00c; no voters: 907cde6b822944c7a81e18d74131932a
I20260709 13:02:23.443233 13228 ts_tablet_manager.cc:1403] T 8c8e031f412048f09177a12e10d44d21 P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.009s
I20260709 13:02:23.444002 13269 raft_consensus.cc:2804] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:23.444579 13269 raft_consensus.cc:493] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.444981 13269 raft_consensus.cc:3060] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:23.446237 13228 raft_consensus.cc:359] T 8c8e031f412048f09177a12e10d44d21 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.447016 13228 raft_consensus.cc:385] T 8c8e031f412048f09177a12e10d44d21 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:23.447291 13228 raft_consensus.cc:740] T 8c8e031f412048f09177a12e10d44d21 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 329c44a887e5438d8d4d7b4b6e2fac58, State: Initialized, Role: FOLLOWER
I20260709 13:02:23.448011 13228 consensus_queue.cc:260] T 8c8e031f412048f09177a12e10d44d21 P 329c44a887e5438d8d4d7b4b6e2fac58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.449299 12934 catalog_manager.cc:5697] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a reported cstate change: term changed from 0 to 1, leader changed from <none> to 907cde6b822944c7a81e18d74131932a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "907cde6b822944c7a81e18d74131932a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:23.450650 13264 raft_consensus.cc:515] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.452404 13228 ts_tablet_manager.cc:1434] T 8c8e031f412048f09177a12e10d44d21 P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:02:23.452988 13264 leader_election.cc:290] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 election: Requested vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599)
I20260709 13:02:23.453610 13228 tablet_bootstrap.cc:492] T 16f353bc6d1847a199accd034426ec3f P 329c44a887e5438d8d4d7b4b6e2fac58: Bootstrap starting.
I20260709 13:02:23.454224 13230 tablet_bootstrap.cc:492] T 4a6e18b4b04949d39e83b2d4680ce17a P e1c403ce70cf42d4bf96348aa91ce00c: No bootstrap required, opened a new log
I20260709 13:02:23.454284 13114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d1a30f18f441fcb2e63ba9dd524989" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
I20260709 13:02:23.454974 13230 ts_tablet_manager.cc:1403] T 4a6e18b4b04949d39e83b2d4680ce17a P e1c403ce70cf42d4bf96348aa91ce00c: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.017s
I20260709 13:02:23.455091 13114 raft_consensus.cc:3060] T a3d1a30f18f441fcb2e63ba9dd524989 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:23.455858 13269 raft_consensus.cc:515] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.455319 13229 tablet_bootstrap.cc:654] T 1e1e91abc0df42e99e2956ee39413813 P 907cde6b822944c7a81e18d74131932a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:23.458288 13230 raft_consensus.cc:359] T 4a6e18b4b04949d39e83b2d4680ce17a P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.459620 13230 raft_consensus.cc:385] T 4a6e18b4b04949d39e83b2d4680ce17a P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:23.459993 13230 raft_consensus.cc:740] T 4a6e18b4b04949d39e83b2d4680ce17a P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c403ce70cf42d4bf96348aa91ce00c, State: Initialized, Role: FOLLOWER
I20260709 13:02:23.460158 13228 tablet_bootstrap.cc:654] T 16f353bc6d1847a199accd034426ec3f P 329c44a887e5438d8d4d7b4b6e2fac58: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:23.460924 13230 consensus_queue.cc:260] T 4a6e18b4b04949d39e83b2d4680ce17a P e1c403ce70cf42d4bf96348aa91ce00c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.458405 13269 leader_election.cc:290] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 election: Requested vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:23.461596 13038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1e91abc0df42e99e2956ee39413813" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
I20260709 13:02:23.462656 13038 raft_consensus.cc:3060] T 1e1e91abc0df42e99e2956ee39413813 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:23.467109 13230 ts_tablet_manager.cc:1434] T 4a6e18b4b04949d39e83b2d4680ce17a P e1c403ce70cf42d4bf96348aa91ce00c: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:02:23.470119 13236 raft_consensus.cc:493] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.470744 13236 raft_consensus.cc:515] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.479758 13188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1e91abc0df42e99e2956ee39413813" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "907cde6b822944c7a81e18d74131932a"
I20260709 13:02:23.480262 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d1a30f18f441fcb2e63ba9dd524989" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
I20260709 13:02:23.481025 13039 raft_consensus.cc:3060] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:23.481426 13079 leader_election.cc:343] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:23.485793 13236 leader_election.cc:290] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599)
I20260709 13:02:23.486459 13236 raft_consensus.cc:493] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.486949 13236 raft_consensus.cc:515] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.486971 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f353bc6d1847a199accd034426ec3f" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" is_pre_election: true
I20260709 13:02:23.491307 13236 leader_election.cc:290] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599)
I20260709 13:02:23.492512 13230 tablet_bootstrap.cc:492] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c: Bootstrap starting.
I20260709 13:02:23.494992 13113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f353bc6d1847a199accd034426ec3f" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" is_pre_election: true
I20260709 13:02:23.495775 13113 raft_consensus.cc:2468] T 16f353bc6d1847a199accd034426ec3f P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 0.
I20260709 13:02:23.444103 13234 raft_consensus.cc:515] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.497175 13112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8e031f412048f09177a12e10d44d21" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" is_pre_election: true
I20260709 13:02:23.497675 13154 leader_election.cc:304] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 907cde6b822944c7a81e18d74131932a, e1c403ce70cf42d4bf96348aa91ce00c; no voters: 
W20260709 13:02:23.498955 13151 leader_election.cc:343] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:23.499276 13236 raft_consensus.cc:2804] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:23.499760 13236 raft_consensus.cc:493] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.500097 13236 raft_consensus.cc:3060] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:23.500690 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8e031f412048f09177a12e10d44d21" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" is_pre_election: true
I20260709 13:02:23.501413 13037 raft_consensus.cc:2468] T 8c8e031f412048f09177a12e10d44d21 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 0.
I20260709 13:02:23.502178 13114 raft_consensus.cc:2468] T a3d1a30f18f441fcb2e63ba9dd524989 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 1.
I20260709 13:02:23.502844 13151 leader_election.cc:304] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, 907cde6b822944c7a81e18d74131932a; no voters: 
I20260709 13:02:23.503688 13264 raft_consensus.cc:2804] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:23.504446 13264 raft_consensus.cc:493] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.500721 13038 raft_consensus.cc:2468] T 1e1e91abc0df42e99e2956ee39413813 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1c403ce70cf42d4bf96348aa91ce00c in term 1.
W20260709 13:02:23.505350 13154 leader_election.cc:343] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:23.505911 13077 leader_election.cc:304] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, e1c403ce70cf42d4bf96348aa91ce00c; no voters: 907cde6b822944c7a81e18d74131932a
I20260709 13:02:23.506774 13269 raft_consensus.cc:2804] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:23.506608 13154 leader_election.cc:304] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 907cde6b822944c7a81e18d74131932a, e1c403ce70cf42d4bf96348aa91ce00c; no voters: 
I20260709 13:02:23.507328 13269 raft_consensus.cc:697] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 LEADER]: Becoming Leader. State: Replica: e1c403ce70cf42d4bf96348aa91ce00c, State: Running, Role: LEADER
I20260709 13:02:23.507781 13260 raft_consensus.cc:2804] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:23.508208 13269 consensus_queue.cc:237] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.509234 13264 raft_consensus.cc:3060] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:23.503749 13230 tablet_bootstrap.cc:654] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:23.522570 13236 raft_consensus.cc:515] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.525087 13260 raft_consensus.cc:697] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Becoming Leader. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Running, Role: LEADER
I20260709 13:02:23.527222 13234 leader_election.cc:290] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 1 election: Requested vote from peers e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:23.527364 13114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d27b2b82449490087a942a8a70295fe" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
I20260709 13:02:23.524837 13039 raft_consensus.cc:2468] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 1.
W20260709 13:02:23.528904 13005 leader_election.cc:343] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:23.532107 13188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d27b2b82449490087a942a8a70295fe" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "907cde6b822944c7a81e18d74131932a"
I20260709 13:02:23.532464 13229 tablet_bootstrap.cc:492] T 1e1e91abc0df42e99e2956ee39413813 P 907cde6b822944c7a81e18d74131932a: No bootstrap required, opened a new log
I20260709 13:02:23.532855 13188 raft_consensus.cc:3060] T 6d27b2b82449490087a942a8a70295fe P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:23.533195 13229 ts_tablet_manager.cc:1403] T 1e1e91abc0df42e99e2956ee39413813 P 907cde6b822944c7a81e18d74131932a: Time spent bootstrapping tablet: real 0.099s	user 0.032s	sys 0.019s
I20260709 13:02:23.533670 13264 raft_consensus.cc:515] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.535737 13114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f353bc6d1847a199accd034426ec3f" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
I20260709 13:02:23.535290 12937 catalog_manager.cc:5697] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c reported cstate change: term changed from 0 to 1, leader changed from <none> to e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:23.526914 13260 consensus_queue.cc:237] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.536296 13236 leader_election.cc:290] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 election: Requested vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599)
I20260709 13:02:23.536703 13229 raft_consensus.cc:359] T 1e1e91abc0df42e99e2956ee39413813 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.538002 13229 raft_consensus.cc:385] T 1e1e91abc0df42e99e2956ee39413813 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:23.538338 13229 raft_consensus.cc:740] T 1e1e91abc0df42e99e2956ee39413813 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Initialized, Role: FOLLOWER
I20260709 13:02:23.539100 13229 consensus_queue.cc:260] T 1e1e91abc0df42e99e2956ee39413813 P 907cde6b822944c7a81e18d74131932a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.541234 13229 ts_tablet_manager.cc:1434] T 1e1e91abc0df42e99e2956ee39413813 P 907cde6b822944c7a81e18d74131932a: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:02:23.542111 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f353bc6d1847a199accd034426ec3f" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
I20260709 13:02:23.536372 13114 raft_consensus.cc:3060] T 16f353bc6d1847a199accd034426ec3f P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:23.543553 13151 leader_election.cc:343] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:23.545454 13188 raft_consensus.cc:2468] T 6d27b2b82449490087a942a8a70295fe P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 329c44a887e5438d8d4d7b4b6e2fac58 in term 1.
I20260709 13:02:23.546347 13236 raft_consensus.cc:493] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.546909 13236 raft_consensus.cc:515] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.547266 13004 leader_election.cc:304] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, 907cde6b822944c7a81e18d74131932a; no voters: e1c403ce70cf42d4bf96348aa91ce00c
I20260709 13:02:23.548514 13234 raft_consensus.cc:2804] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:23.548971 13234 raft_consensus.cc:697] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 LEADER]: Becoming Leader. State: Replica: 329c44a887e5438d8d4d7b4b6e2fac58, State: Running, Role: LEADER
I20260709 13:02:23.549790 13234 consensus_queue.cc:237] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.550938 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44066ba5afb3439496e0ffc8c96b6536" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" is_pre_election: true
I20260709 13:02:23.551631 13039 raft_consensus.cc:2468] T 44066ba5afb3439496e0ffc8c96b6536 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 0.
I20260709 13:02:23.552317 13112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44066ba5afb3439496e0ffc8c96b6536" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" is_pre_election: true
I20260709 13:02:23.552979 13151 leader_election.cc:304] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, 907cde6b822944c7a81e18d74131932a; no voters: 
I20260709 13:02:23.553061 13112 raft_consensus.cc:2468] T 44066ba5afb3439496e0ffc8c96b6536 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 0.
I20260709 13:02:23.555631 13276 raft_consensus.cc:2804] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:23.556098 13276 raft_consensus.cc:493] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.556502 13276 raft_consensus.cc:3060] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:23.556950 13114 raft_consensus.cc:2468] T 16f353bc6d1847a199accd034426ec3f P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 1.
I20260709 13:02:23.557415 13228 tablet_bootstrap.cc:492] T 16f353bc6d1847a199accd034426ec3f P 329c44a887e5438d8d4d7b4b6e2fac58: No bootstrap required, opened a new log
I20260709 13:02:23.558436 13154 leader_election.cc:304] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 907cde6b822944c7a81e18d74131932a, e1c403ce70cf42d4bf96348aa91ce00c; no voters: 329c44a887e5438d8d4d7b4b6e2fac58
I20260709 13:02:23.561019 13228 ts_tablet_manager.cc:1403] T 16f353bc6d1847a199accd034426ec3f P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent bootstrapping tablet: real 0.108s	user 0.029s	sys 0.006s
I20260709 13:02:23.562320 13281 raft_consensus.cc:2804] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:23.556099 13236 leader_election.cc:290] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599)
I20260709 13:02:23.564150 13228 raft_consensus.cc:359] T 16f353bc6d1847a199accd034426ec3f P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.565286 13230 tablet_bootstrap.cc:492] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c: No bootstrap required, opened a new log
I20260709 13:02:23.566229 13228 raft_consensus.cc:385] T 16f353bc6d1847a199accd034426ec3f P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:23.566471 13230 ts_tablet_manager.cc:1403] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.005s
I20260709 13:02:23.566568 13228 raft_consensus.cc:740] T 16f353bc6d1847a199accd034426ec3f P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 329c44a887e5438d8d4d7b4b6e2fac58, State: Initialized, Role: FOLLOWER
I20260709 13:02:23.567394 13228 consensus_queue.cc:260] T 16f353bc6d1847a199accd034426ec3f P 329c44a887e5438d8d4d7b4b6e2fac58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.569676 13228 ts_tablet_manager.cc:1434] T 16f353bc6d1847a199accd034426ec3f P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:02:23.570389 13276 raft_consensus.cc:515] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.571336 13264 leader_election.cc:290] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 election: Requested vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599)
I20260709 13:02:23.569901 12937 catalog_manager.cc:5697] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:23.571843 13230 raft_consensus.cc:359] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.572830 13230 raft_consensus.cc:385] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:23.573118 13230 raft_consensus.cc:740] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c403ce70cf42d4bf96348aa91ce00c, State: Initialized, Role: FOLLOWER
I20260709 13:02:23.573835 13230 consensus_queue.cc:260] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.575995 13230 ts_tablet_manager.cc:1434] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:02:23.576511 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8e031f412048f09177a12e10d44d21" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
I20260709 13:02:23.577172 13039 raft_consensus.cc:3060] T 8c8e031f412048f09177a12e10d44d21 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:23.578961 13038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44066ba5afb3439496e0ffc8c96b6536" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
I20260709 13:02:23.579679 13038 raft_consensus.cc:3060] T 44066ba5afb3439496e0ffc8c96b6536 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:23.580411 13276 leader_election.cc:290] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 election: Requested vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599)
I20260709 13:02:23.581303 13230 tablet_bootstrap.cc:492] T 6d27b2b82449490087a942a8a70295fe P e1c403ce70cf42d4bf96348aa91ce00c: Bootstrap starting.
I20260709 13:02:23.580631 13112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44066ba5afb3439496e0ffc8c96b6536" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
I20260709 13:02:23.585999 13112 raft_consensus.cc:3060] T 44066ba5afb3439496e0ffc8c96b6536 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:23.588224 13038 raft_consensus.cc:2468] T 44066ba5afb3439496e0ffc8c96b6536 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 1.
I20260709 13:02:23.589733 13151 leader_election.cc:304] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, 907cde6b822944c7a81e18d74131932a; no voters: 
I20260709 13:02:23.589978 13230 tablet_bootstrap.cc:654] T 6d27b2b82449490087a942a8a70295fe P e1c403ce70cf42d4bf96348aa91ce00c: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:23.590664 13276 raft_consensus.cc:2804] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:23.591228 13276 raft_consensus.cc:697] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Becoming Leader. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Running, Role: LEADER
I20260709 13:02:23.575871 12934 catalog_manager.cc:5697] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a reported cstate change: term changed from 0 to 1, leader changed from <none> to 907cde6b822944c7a81e18d74131932a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "907cde6b822944c7a81e18d74131932a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:23.592163 13276 consensus_queue.cc:237] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.598495 13114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8e031f412048f09177a12e10d44d21" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
I20260709 13:02:23.599241 13114 raft_consensus.cc:3060] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:23.609587 13230 tablet_bootstrap.cc:492] T 6d27b2b82449490087a942a8a70295fe P e1c403ce70cf42d4bf96348aa91ce00c: No bootstrap required, opened a new log
I20260709 13:02:23.609876 13039 raft_consensus.cc:2468] T 8c8e031f412048f09177a12e10d44d21 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 1.
I20260709 13:02:23.611188 13151 leader_election.cc:304] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, 907cde6b822944c7a81e18d74131932a; no voters: 
I20260709 13:02:23.612219 13264 raft_consensus.cc:2804] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:23.613044 13264 raft_consensus.cc:697] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Becoming Leader. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Running, Role: LEADER
I20260709 13:02:23.613997 13264 consensus_queue.cc:237] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.616362 13114 raft_consensus.cc:2468] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 1.
I20260709 13:02:23.617590 13281 raft_consensus.cc:697] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Becoming Leader. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Running, Role: LEADER
I20260709 13:02:23.613917 13112 raft_consensus.cc:2468] T 44066ba5afb3439496e0ffc8c96b6536 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 1.
I20260709 13:02:23.618770 13281 consensus_queue.cc:237] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.610285 13230 ts_tablet_manager.cc:1403] T 6d27b2b82449490087a942a8a70295fe P e1c403ce70cf42d4bf96348aa91ce00c: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.004s
I20260709 13:02:23.630796 13230 raft_consensus.cc:359] T 6d27b2b82449490087a942a8a70295fe P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.631336 13230 raft_consensus.cc:385] T 6d27b2b82449490087a942a8a70295fe P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:23.631608 13230 raft_consensus.cc:740] T 6d27b2b82449490087a942a8a70295fe P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c403ce70cf42d4bf96348aa91ce00c, State: Initialized, Role: FOLLOWER
I20260709 13:02:23.631093 12937 catalog_manager.cc:5697] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a reported cstate change: term changed from 0 to 1, leader changed from <none> to 907cde6b822944c7a81e18d74131932a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "907cde6b822944c7a81e18d74131932a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:23.632259 13230 consensus_queue.cc:260] T 6d27b2b82449490087a942a8a70295fe P e1c403ce70cf42d4bf96348aa91ce00c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.633152 12937 catalog_manager.cc:5697] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a reported cstate change: term changed from 0 to 1, leader changed from <none> to 907cde6b822944c7a81e18d74131932a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "907cde6b822944c7a81e18d74131932a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:23.634202 13230 ts_tablet_manager.cc:1434] T 6d27b2b82449490087a942a8a70295fe P e1c403ce70cf42d4bf96348aa91ce00c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:23.647704 12934 catalog_manager.cc:5697] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a reported cstate change: term changed from 0 to 1, leader changed from <none> to 907cde6b822944c7a81e18d74131932a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "907cde6b822944c7a81e18d74131932a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:23.680320 13188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3d1a30f18f441fcb2e63ba9dd524989"
dest_uuid: "907cde6b822944c7a81e18d74131932a"
mode: GRACEFUL
new_leader_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
 from {username='slave'} at 127.0.0.1:53966
I20260709 13:02:23.680912 13188 raft_consensus.cc:606] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Received request to transfer leadership to TS 329c44a887e5438d8d4d7b4b6e2fac58
I20260709 13:02:23.685995 13188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16f353bc6d1847a199accd034426ec3f"
dest_uuid: "907cde6b822944c7a81e18d74131932a"
mode: GRACEFUL
new_leader_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
 from {username='slave'} at 127.0.0.1:53966
I20260709 13:02:23.686477 13188 raft_consensus.cc:606] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Received request to transfer leadership to TS 329c44a887e5438d8d4d7b4b6e2fac58
I20260709 13:02:23.691627 13188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44066ba5afb3439496e0ffc8c96b6536"
dest_uuid: "907cde6b822944c7a81e18d74131932a"
mode: GRACEFUL
new_leader_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
 from {username='slave'} at 127.0.0.1:53966
I20260709 13:02:23.692157 13188 raft_consensus.cc:606] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Received request to transfer leadership to TS 329c44a887e5438d8d4d7b4b6e2fac58
I20260709 13:02:23.697484 13188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd119138500f4351b2f68bcc272e0780"
dest_uuid: "907cde6b822944c7a81e18d74131932a"
mode: GRACEFUL
new_leader_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
 from {username='slave'} at 127.0.0.1:53966
I20260709 13:02:23.698024 13188 raft_consensus.cc:606] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Received request to transfer leadership to TS e1c403ce70cf42d4bf96348aa91ce00c
I20260709 13:02:23.706218 13188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c8e031f412048f09177a12e10d44d21"
dest_uuid: "907cde6b822944c7a81e18d74131932a"
mode: GRACEFUL
new_leader_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
 from {username='slave'} at 127.0.0.1:53966
I20260709 13:02:23.706748 13188 raft_consensus.cc:606] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Received request to transfer leadership to TS e1c403ce70cf42d4bf96348aa91ce00c
I20260709 13:02:23.711915 13188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a6e18b4b04949d39e83b2d4680ce17a"
dest_uuid: "907cde6b822944c7a81e18d74131932a"
mode: GRACEFUL
new_leader_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
 from {username='slave'} at 127.0.0.1:53966
I20260709 13:02:23.712404 13188 raft_consensus.cc:606] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Received request to transfer leadership to TS e1c403ce70cf42d4bf96348aa91ce00c
I20260709 13:02:23.725023 13039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d27b2b82449490087a942a8a70295fe"
dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
mode: GRACEFUL
new_leader_uuid: "907cde6b822944c7a81e18d74131932a"
 from {username='slave'} at 127.0.0.1:38562
I20260709 13:02:23.725548 13039 raft_consensus.cc:606] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 LEADER]: Received request to transfer leadership to TS 907cde6b822944c7a81e18d74131932a
I20260709 13:02:23.757786 13269 raft_consensus.cc:493] T 4a6e18b4b04949d39e83b2d4680ce17a P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.758440 13269 raft_consensus.cc:515] T 4a6e18b4b04949d39e83b2d4680ce17a P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.760630 13269 leader_election.cc:290] T 4a6e18b4b04949d39e83b2d4680ce17a P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:23.761801 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6e18b4b04949d39e83b2d4680ce17a" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" is_pre_election: true
I20260709 13:02:23.762046 13188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6e18b4b04949d39e83b2d4680ce17a" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "907cde6b822944c7a81e18d74131932a" is_pre_election: true
I20260709 13:02:23.762718 13039 raft_consensus.cc:2393] T 4a6e18b4b04949d39e83b2d4680ce17a P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1c403ce70cf42d4bf96348aa91ce00c in current term 1: Already voted for candidate 907cde6b822944c7a81e18d74131932a in this term.
I20260709 13:02:23.762991 13264 consensus_queue.cc:1048] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:23.763847 13077 leader_election.cc:304] T 4a6e18b4b04949d39e83b2d4680ce17a P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1c403ce70cf42d4bf96348aa91ce00c; no voters: 329c44a887e5438d8d4d7b4b6e2fac58, 907cde6b822944c7a81e18d74131932a
I20260709 13:02:23.763942 13276 consensus_queue.cc:1048] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a [LEADER]: Connected to new peer: Peer: permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:23.764590 13269 raft_consensus.cc:3060] T 4a6e18b4b04949d39e83b2d4680ce17a P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:23.772917 13269 raft_consensus.cc:2749] T 4a6e18b4b04949d39e83b2d4680ce17a P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:23.778888 13276 raft_consensus.cc:993] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a: : Instructing follower e1c403ce70cf42d4bf96348aa91ce00c to start an election
I20260709 13:02:23.779525 13281 raft_consensus.cc:1081] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Signalling peer e1c403ce70cf42d4bf96348aa91ce00c to start an election
I20260709 13:02:23.783004 13114 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd119138500f4351b2f68bcc272e0780"
dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
 from {username='slave'} at 127.0.0.1:54420
I20260709 13:02:23.783614 13114 raft_consensus.cc:493] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:23.784006 13114 raft_consensus.cc:3060] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.794297 13114 raft_consensus.cc:515] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.796509 13114 leader_election.cc:290] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 2 election: Requested vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:23.797740 13188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd119138500f4351b2f68bcc272e0780" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "907cde6b822944c7a81e18d74131932a"
I20260709 13:02:23.798103 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd119138500f4351b2f68bcc272e0780" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
I20260709 13:02:23.798448 13188 raft_consensus.cc:3055] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:23.798710 13039 raft_consensus.cc:3060] T fd119138500f4351b2f68bcc272e0780 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.798842 13188 raft_consensus.cc:740] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Running, Role: LEADER
I20260709 13:02:23.799736 13188 consensus_queue.cc:260] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.801029 13188 raft_consensus.cc:3060] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.806124 13039 raft_consensus.cc:2468] T fd119138500f4351b2f68bcc272e0780 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1c403ce70cf42d4bf96348aa91ce00c in term 2.
I20260709 13:02:23.807448 13077 leader_election.cc:304] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, e1c403ce70cf42d4bf96348aa91ce00c; no voters: 
I20260709 13:02:23.808105 13188 raft_consensus.cc:2468] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1c403ce70cf42d4bf96348aa91ce00c in term 2.
I20260709 13:02:23.808275 13269 raft_consensus.cc:2804] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:23.808892 13269 raft_consensus.cc:697] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 LEADER]: Becoming Leader. State: Replica: e1c403ce70cf42d4bf96348aa91ce00c, State: Running, Role: LEADER
I20260709 13:02:23.809659 13269 consensus_queue.cc:237] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:23.817123 12934 catalog_manager.cc:5697] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c reported cstate change: term changed from 1 to 2, leader changed from 907cde6b822944c7a81e18d74131932a (127.0.107.195) to e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:23.872720 13234 consensus_queue.cc:1048] T 4018c93e45734aac9b61b02e27e0ef16 P 329c44a887e5438d8d4d7b4b6e2fac58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:23.882099 13188 raft_consensus.cc:3060] T 4018c93e45734aac9b61b02e27e0ef16 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:23.891672 13294 consensus_queue.cc:1048] T 4018c93e45734aac9b61b02e27e0ef16 P 329c44a887e5438d8d4d7b4b6e2fac58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:23.980420 13276 consensus_queue.cc:1048] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [LEADER]: Connected to new peer: Peer: permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:23.985208 13276 consensus_queue.cc:1048] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:23.987505 13281 raft_consensus.cc:993] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a: : Instructing follower 329c44a887e5438d8d4d7b4b6e2fac58 to start an election
I20260709 13:02:23.988024 13281 raft_consensus.cc:1081] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Signalling peer 329c44a887e5438d8d4d7b4b6e2fac58 to start an election
I20260709 13:02:23.993501 13039 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3d1a30f18f441fcb2e63ba9dd524989"
dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
 from {username='slave'} at 127.0.0.1:38544
I20260709 13:02:23.994190 13039 raft_consensus.cc:493] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:23.994585 13039 raft_consensus.cc:3060] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.995083 13264 consensus_queue.cc:1048] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:23.996196 13282 raft_consensus.cc:993] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a: : Instructing follower e1c403ce70cf42d4bf96348aa91ce00c to start an election
I20260709 13:02:23.996824 13282 raft_consensus.cc:1081] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Signalling peer e1c403ce70cf42d4bf96348aa91ce00c to start an election
I20260709 13:02:24.000646 13113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a6e18b4b04949d39e83b2d4680ce17a"
dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
 from {username='slave'} at 127.0.0.1:54420
I20260709 13:02:24.001261 13113 raft_consensus.cc:493] T 4a6e18b4b04949d39e83b2d4680ce17a P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:24.001681 13113 raft_consensus.cc:3060] T 4a6e18b4b04949d39e83b2d4680ce17a P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.002351 13039 raft_consensus.cc:515] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:24.002767 13264 consensus_queue.cc:1048] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [LEADER]: Connected to new peer: Peer: permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:24.004882 13111 raft_consensus.cc:3060] T 6d27b2b82449490087a942a8a70295fe P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:24.005956 13039 leader_election.cc:290] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 2 election: Requested vote from peers e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:24.009199 13110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d1a30f18f441fcb2e63ba9dd524989" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
I20260709 13:02:24.009938 13110 raft_consensus.cc:3060] T a3d1a30f18f441fcb2e63ba9dd524989 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.012910 13294 raft_consensus.cc:493] T 16f353bc6d1847a199accd034426ec3f P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.013470 13294 raft_consensus.cc:515] T 16f353bc6d1847a199accd034426ec3f P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:24.014176 13281 raft_consensus.cc:493] T 1e1e91abc0df42e99e2956ee39413813 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.013978 13113 raft_consensus.cc:515] T 4a6e18b4b04949d39e83b2d4680ce17a P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:24.014688 13281 raft_consensus.cc:515] T 1e1e91abc0df42e99e2956ee39413813 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:24.015041 13112 raft_consensus.cc:1240] T 4a6e18b4b04949d39e83b2d4680ce17a P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Rejecting Update request from peer 907cde6b822944c7a81e18d74131932a for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:24.015657 13294 leader_election.cc:290] T 16f353bc6d1847a199accd034426ec3f P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:24.015713 13256 consensus_queue.cc:1048] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:24.017187 13281 leader_election.cc:290] T 1e1e91abc0df42e99e2956ee39413813 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599)
I20260709 13:02:24.018606 13038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6e18b4b04949d39e83b2d4680ce17a" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
I20260709 13:02:24.018837 13109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1e91abc0df42e99e2956ee39413813" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" is_pre_election: true
I20260709 13:02:24.019233 13038 raft_consensus.cc:3060] T 4a6e18b4b04949d39e83b2d4680ce17a P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.021667 13113 leader_election.cc:290] T 4a6e18b4b04949d39e83b2d4680ce17a P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 2 election: Requested vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:24.022387 13188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d1a30f18f441fcb2e63ba9dd524989" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "907cde6b822944c7a81e18d74131932a"
I20260709 13:02:24.023308 13188 raft_consensus.cc:3055] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:24.023670 13188 raft_consensus.cc:740] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Running, Role: LEADER
I20260709 13:02:24.024194 13269 consensus_queue.cc:1048] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c [LEADER]: Connected to new peer: Peer: permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:24.025898 13187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f353bc6d1847a199accd034426ec3f" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "907cde6b822944c7a81e18d74131932a" is_pre_election: true
I20260709 13:02:24.024194 13281 consensus_queue.cc:1059] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:02:24.025194 13186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6e18b4b04949d39e83b2d4680ce17a" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "907cde6b822944c7a81e18d74131932a"
I20260709 13:02:24.028277 13186 raft_consensus.cc:3055] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:24.028712 13186 raft_consensus.cc:740] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Running, Role: LEADER
I20260709 13:02:24.029577 13186 consensus_queue.cc:260] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:24.030758 13186 raft_consensus.cc:3060] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.031298 13036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e1e91abc0df42e99e2956ee39413813" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" is_pre_election: true
I20260709 13:02:24.021382 13110 raft_consensus.cc:2468] T a3d1a30f18f441fcb2e63ba9dd524989 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 329c44a887e5438d8d4d7b4b6e2fac58 in term 2.
I20260709 13:02:24.024669 13188 consensus_queue.cc:260] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:24.035423 13188 raft_consensus.cc:3060] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.025584 13111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f353bc6d1847a199accd034426ec3f" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" is_pre_election: true
I20260709 13:02:24.036594 13005 leader_election.cc:304] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, e1c403ce70cf42d4bf96348aa91ce00c; no voters: 
I20260709 13:02:24.035624 13151 leader_election.cc:304] T 1e1e91abc0df42e99e2956ee39413813 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 907cde6b822944c7a81e18d74131932a; no voters: 329c44a887e5438d8d4d7b4b6e2fac58, e1c403ce70cf42d4bf96348aa91ce00c
I20260709 13:02:24.037513 13256 raft_consensus.cc:2804] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:24.038297 13256 raft_consensus.cc:697] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 LEADER]: Becoming Leader. State: Replica: 329c44a887e5438d8d4d7b4b6e2fac58, State: Running, Role: LEADER
I20260709 13:02:24.039130 13256 consensus_queue.cc:237] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:24.042080 13038 raft_consensus.cc:2468] T 4a6e18b4b04949d39e83b2d4680ce17a P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1c403ce70cf42d4bf96348aa91ce00c in term 2.
I20260709 13:02:24.037580 13281 raft_consensus.cc:2749] T 1e1e91abc0df42e99e2956ee39413813 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:24.043452 13077 leader_election.cc:304] T 4a6e18b4b04949d39e83b2d4680ce17a P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, e1c403ce70cf42d4bf96348aa91ce00c; no voters: 
I20260709 13:02:24.043990 13281 consensus_queue.cc:1048] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a [LEADER]: Connected to new peer: Peer: permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:24.044518 13039 raft_consensus.cc:1240] T 4a6e18b4b04949d39e83b2d4680ce17a P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Rejecting Update request from peer 907cde6b822944c7a81e18d74131932a for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:02:24.044266 13235 raft_consensus.cc:2804] T 4a6e18b4b04949d39e83b2d4680ce17a P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:24.046027 13235 raft_consensus.cc:697] T 4a6e18b4b04949d39e83b2d4680ce17a P e1c403ce70cf42d4bf96348aa91ce00c [term 2 LEADER]: Becoming Leader. State: Replica: e1c403ce70cf42d4bf96348aa91ce00c, State: Running, Role: LEADER
I20260709 13:02:24.046891 13235 consensus_queue.cc:237] T 4a6e18b4b04949d39e83b2d4680ce17a P e1c403ce70cf42d4bf96348aa91ce00c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:24.046782 13037 raft_consensus.cc:3060] T 16f353bc6d1847a199accd034426ec3f P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:24.054368 13186 raft_consensus.cc:2468] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1c403ce70cf42d4bf96348aa91ce00c in term 2.
W20260709 13:02:24.055330 13264 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:02:24.037501 13114 raft_consensus.cc:1240] T a3d1a30f18f441fcb2e63ba9dd524989 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Rejecting Update request from peer 907cde6b822944c7a81e18d74131932a for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:02:24.055349 12934 catalog_manager.cc:5697] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58 reported cstate change: term changed from 1 to 2, leader changed from 907cde6b822944c7a81e18d74131932a (127.0.107.195) to 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:24.061949 13111 raft_consensus.cc:2393] T 16f353bc6d1847a199accd034426ec3f P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 329c44a887e5438d8d4d7b4b6e2fac58 in current term 1: Already voted for candidate 907cde6b822944c7a81e18d74131932a in this term.
I20260709 13:02:24.063645 13264 consensus_queue.cc:1048] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [LEADER]: Connected to new peer: Peer: permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:24.064757 13187 raft_consensus.cc:3060] T 1e1e91abc0df42e99e2956ee39413813 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:24.066416 13301 consensus_queue.cc:1048] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:24.070216 13188 raft_consensus.cc:2468] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 329c44a887e5438d8d4d7b4b6e2fac58 in term 2.
I20260709 13:02:24.073295 12935 catalog_manager.cc:5697] T 4a6e18b4b04949d39e83b2d4680ce17a P e1c403ce70cf42d4bf96348aa91ce00c reported cstate change: term changed from 1 to 2, leader changed from 907cde6b822944c7a81e18d74131932a (127.0.107.195) to e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:24.081561 13005 leader_election.cc:304] T 16f353bc6d1847a199accd034426ec3f P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58; no voters: 907cde6b822944c7a81e18d74131932a, e1c403ce70cf42d4bf96348aa91ce00c
I20260709 13:02:24.083112 13301 raft_consensus.cc:2749] T 16f353bc6d1847a199accd034426ec3f P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:24.084264 13301 raft_consensus.cc:993] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58: : Instructing follower 907cde6b822944c7a81e18d74131932a to start an election
I20260709 13:02:24.084327 13235 consensus_queue.cc:1048] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c [LEADER]: Connected to new peer: Peer: permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:24.084753 13301 raft_consensus.cc:1081] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 LEADER]: Signalling peer 907cde6b822944c7a81e18d74131932a to start an election
I20260709 13:02:24.092234 13187 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d27b2b82449490087a942a8a70295fe"
dest_uuid: "907cde6b822944c7a81e18d74131932a"
 from {username='slave'} at 127.0.0.1:53950
I20260709 13:02:24.092406 13264 raft_consensus.cc:993] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a: : Instructing follower 329c44a887e5438d8d4d7b4b6e2fac58 to start an election
I20260709 13:02:24.092911 13187 raft_consensus.cc:493] T 6d27b2b82449490087a942a8a70295fe P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:24.093036 13264 raft_consensus.cc:1081] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Signalling peer 329c44a887e5438d8d4d7b4b6e2fac58 to start an election
I20260709 13:02:24.093338 13187 raft_consensus.cc:3060] T 6d27b2b82449490087a942a8a70295fe P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.097824 13282 raft_consensus.cc:993] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a: : Instructing follower 329c44a887e5438d8d4d7b4b6e2fac58 to start an election
I20260709 13:02:24.098294 13282 raft_consensus.cc:1081] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Signalling peer 329c44a887e5438d8d4d7b4b6e2fac58 to start an election
I20260709 13:02:24.099402 13260 consensus_queue.cc:1048] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:24.101675 13187 raft_consensus.cc:515] T 6d27b2b82449490087a942a8a70295fe P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:24.103930 13187 leader_election.cc:290] T 6d27b2b82449490087a942a8a70295fe P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 2 election: Requested vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599)
I20260709 13:02:24.106098 13037 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16f353bc6d1847a199accd034426ec3f"
dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
 from {username='slave'} at 127.0.0.1:38544
I20260709 13:02:24.106695 13037 raft_consensus.cc:493] T 16f353bc6d1847a199accd034426ec3f P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:24.106505 13111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d27b2b82449490087a942a8a70295fe" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
I20260709 13:02:24.107154 13037 raft_consensus.cc:3060] T 16f353bc6d1847a199accd034426ec3f P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.107656 13111 raft_consensus.cc:3060] T 6d27b2b82449490087a942a8a70295fe P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.108898 13276 consensus_queue.cc:1048] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:24.110250 13038 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44066ba5afb3439496e0ffc8c96b6536"
dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
 from {username='slave'} at 127.0.0.1:38544
I20260709 13:02:24.111341 13038 raft_consensus.cc:493] T 44066ba5afb3439496e0ffc8c96b6536 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:24.111745 13038 raft_consensus.cc:3060] T 44066ba5afb3439496e0ffc8c96b6536 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.111822 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d27b2b82449490087a942a8a70295fe" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
I20260709 13:02:24.112560 13039 raft_consensus.cc:3055] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:24.112865 13039 raft_consensus.cc:740] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 329c44a887e5438d8d4d7b4b6e2fac58, State: Running, Role: LEADER
I20260709 13:02:24.113548 13039 consensus_queue.cc:260] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:24.114493 13039 raft_consensus.cc:3060] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.119112 13038 raft_consensus.cc:515] T 44066ba5afb3439496e0ffc8c96b6536 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:24.120306 13035 raft_consensus.cc:1240] T 44066ba5afb3439496e0ffc8c96b6536 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Rejecting Update request from peer 907cde6b822944c7a81e18d74131932a for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:24.121189 13276 consensus_queue.cc:1048] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [LEADER]: Connected to new peer: Peer: permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:24.122661 13037 raft_consensus.cc:515] T 16f353bc6d1847a199accd034426ec3f P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:24.122949 13276 consensus_queue.cc:1059] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:24.124909 13264 raft_consensus.cc:3055] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:24.125273 13264 raft_consensus.cc:740] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Running, Role: LEADER
I20260709 13:02:24.127653 13264 consensus_queue.cc:260] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:24.128237 13111 raft_consensus.cc:2468] T 6d27b2b82449490087a942a8a70295fe P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 2.
I20260709 13:02:24.128747 13264 raft_consensus.cc:3060] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.132226 13037 leader_election.cc:290] T 16f353bc6d1847a199accd034426ec3f P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 2 election: Requested vote from peers e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:24.133229 13154 leader_election.cc:304] T 6d27b2b82449490087a942a8a70295fe P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 907cde6b822944c7a81e18d74131932a, e1c403ce70cf42d4bf96348aa91ce00c; no voters: 
I20260709 13:02:24.133828 13187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f353bc6d1847a199accd034426ec3f" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "907cde6b822944c7a81e18d74131932a"
I20260709 13:02:24.134224 13276 raft_consensus.cc:2804] T 6d27b2b82449490087a942a8a70295fe P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:24.134578 13187 raft_consensus.cc:3055] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:24.134807 13276 raft_consensus.cc:697] T 6d27b2b82449490087a942a8a70295fe P 907cde6b822944c7a81e18d74131932a [term 2 LEADER]: Becoming Leader. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Running, Role: LEADER
I20260709 13:02:24.135048 13187 raft_consensus.cc:740] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Running, Role: LEADER
I20260709 13:02:24.137929 13186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44066ba5afb3439496e0ffc8c96b6536" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "907cde6b822944c7a81e18d74131932a"
I20260709 13:02:24.139341 13276 consensus_queue.cc:237] T 6d27b2b82449490087a942a8a70295fe P 907cde6b822944c7a81e18d74131932a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:24.140826 13111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44066ba5afb3439496e0ffc8c96b6536" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
I20260709 13:02:24.141810 13039 raft_consensus.cc:2468] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 2.
I20260709 13:02:24.138185 13038 leader_election.cc:290] T 44066ba5afb3439496e0ffc8c96b6536 P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 2 election: Requested vote from peers e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:24.145372 13111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16f353bc6d1847a199accd034426ec3f" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
I20260709 13:02:24.146385 13187 consensus_queue.cc:260] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:24.147603 13187 raft_consensus.cc:3060] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.147485 13186 raft_consensus.cc:2468] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 329c44a887e5438d8d4d7b4b6e2fac58 in term 2.
I20260709 13:02:24.151940 13276 consensus_queue.cc:1048] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:24.155354 13187 raft_consensus.cc:2468] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 329c44a887e5438d8d4d7b4b6e2fac58 in term 2.
I20260709 13:02:24.155504 13004 leader_election.cc:304] T 44066ba5afb3439496e0ffc8c96b6536 P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, 907cde6b822944c7a81e18d74131932a; no voters: e1c403ce70cf42d4bf96348aa91ce00c
I20260709 13:02:24.156728 13294 raft_consensus.cc:2804] T 44066ba5afb3439496e0ffc8c96b6536 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:24.157191 13294 raft_consensus.cc:697] T 44066ba5afb3439496e0ffc8c96b6536 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 LEADER]: Becoming Leader. State: Replica: 329c44a887e5438d8d4d7b4b6e2fac58, State: Running, Role: LEADER
I20260709 13:02:24.157831 13294 consensus_queue.cc:237] T 44066ba5afb3439496e0ffc8c96b6536 P 329c44a887e5438d8d4d7b4b6e2fac58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:24.161252 13004 leader_election.cc:304] T 16f353bc6d1847a199accd034426ec3f P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, 907cde6b822944c7a81e18d74131932a; no voters: e1c403ce70cf42d4bf96348aa91ce00c
I20260709 13:02:24.162546 13294 raft_consensus.cc:2804] T 16f353bc6d1847a199accd034426ec3f P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:24.163234 13294 raft_consensus.cc:697] T 16f353bc6d1847a199accd034426ec3f P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 LEADER]: Becoming Leader. State: Replica: 329c44a887e5438d8d4d7b4b6e2fac58, State: Running, Role: LEADER
I20260709 13:02:24.164079 13294 consensus_queue.cc:237] T 16f353bc6d1847a199accd034426ec3f P 329c44a887e5438d8d4d7b4b6e2fac58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:24.175287 13281 raft_consensus.cc:993] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a: : Instructing follower e1c403ce70cf42d4bf96348aa91ce00c to start an election
I20260709 13:02:24.175925 13276 raft_consensus.cc:1081] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Signalling peer e1c403ce70cf42d4bf96348aa91ce00c to start an election
I20260709 13:02:24.177316 12937 catalog_manager.cc:5697] T 6d27b2b82449490087a942a8a70295fe P 907cde6b822944c7a81e18d74131932a reported cstate change: term changed from 1 to 2, leader changed from 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193) to 907cde6b822944c7a81e18d74131932a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "907cde6b822944c7a81e18d74131932a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:24.178874 13112 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c8e031f412048f09177a12e10d44d21"
dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
 from {username='slave'} at 127.0.0.1:54420
I20260709 13:02:24.179522 13112 raft_consensus.cc:493] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:24.179997 13112 raft_consensus.cc:3060] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.187352 13112 raft_consensus.cc:515] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:24.187392 12935 catalog_manager.cc:5697] T 16f353bc6d1847a199accd034426ec3f P 329c44a887e5438d8d4d7b4b6e2fac58 reported cstate change: term changed from 1 to 2, leader changed from 907cde6b822944c7a81e18d74131932a (127.0.107.195) to 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:24.189560 13112 leader_election.cc:290] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 2 election: Requested vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:24.189370 12935 catalog_manager.cc:5697] T 44066ba5afb3439496e0ffc8c96b6536 P 329c44a887e5438d8d4d7b4b6e2fac58 reported cstate change: term changed from 1 to 2, leader changed from 907cde6b822944c7a81e18d74131932a (127.0.107.195) to 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:24.190325 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8e031f412048f09177a12e10d44d21" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
I20260709 13:02:24.191197 13035 raft_consensus.cc:3060] T 8c8e031f412048f09177a12e10d44d21 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.193614 13187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8e031f412048f09177a12e10d44d21" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "907cde6b822944c7a81e18d74131932a"
I20260709 13:02:24.194191 13187 raft_consensus.cc:3055] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:24.194464 13187 raft_consensus.cc:740] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Running, Role: LEADER
I20260709 13:02:24.195160 13187 consensus_queue.cc:260] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:24.196339 13187 raft_consensus.cc:3060] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.198226 13035 raft_consensus.cc:2468] T 8c8e031f412048f09177a12e10d44d21 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1c403ce70cf42d4bf96348aa91ce00c in term 2.
I20260709 13:02:24.199535 13077 leader_election.cc:304] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, e1c403ce70cf42d4bf96348aa91ce00c; no voters: 
I20260709 13:02:24.200357 13235 raft_consensus.cc:2804] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:24.200868 13235 raft_consensus.cc:697] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 LEADER]: Becoming Leader. State: Replica: e1c403ce70cf42d4bf96348aa91ce00c, State: Running, Role: LEADER
I20260709 13:02:24.201730 13235 consensus_queue.cc:237] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:24.203529 13187 raft_consensus.cc:2468] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1c403ce70cf42d4bf96348aa91ce00c in term 2.
I20260709 13:02:24.209820 12934 catalog_manager.cc:5697] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c reported cstate change: term changed from 1 to 2, leader changed from 907cde6b822944c7a81e18d74131932a (127.0.107.195) to e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:24.223444 13035 raft_consensus.cc:1275] T fd119138500f4351b2f68bcc272e0780 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Refusing update from remote peer e1c403ce70cf42d4bf96348aa91ce00c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:24.225337 13235 consensus_queue.cc:1048] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c [LEADER]: Connected to new peer: Peer: permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:24.234272 13187 raft_consensus.cc:1275] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Refusing update from remote peer e1c403ce70cf42d4bf96348aa91ce00c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:24.236099 13310 consensus_queue.cc:1048] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c [LEADER]: Connected to new peer: Peer: permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:24.465332 13187 raft_consensus.cc:1275] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Refusing update from remote peer e1c403ce70cf42d4bf96348aa91ce00c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:24.466655 13310 consensus_queue.cc:1048] T 4a6e18b4b04949d39e83b2d4680ce17a P e1c403ce70cf42d4bf96348aa91ce00c [LEADER]: Connected to new peer: Peer: permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:24.476540 13035 raft_consensus.cc:1275] T 4a6e18b4b04949d39e83b2d4680ce17a P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Refusing update from remote peer e1c403ce70cf42d4bf96348aa91ce00c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:24.479624 13310 consensus_queue.cc:1048] T 4a6e18b4b04949d39e83b2d4680ce17a P e1c403ce70cf42d4bf96348aa91ce00c [LEADER]: Connected to new peer: Peer: permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:24.490489 13187 raft_consensus.cc:1275] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Refusing update from remote peer 329c44a887e5438d8d4d7b4b6e2fac58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:24.491698 13294 consensus_queue.cc:1048] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:24.499527 13112 raft_consensus.cc:1275] T a3d1a30f18f441fcb2e63ba9dd524989 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Refusing update from remote peer 329c44a887e5438d8d4d7b4b6e2fac58: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:24.501577 13300 consensus_queue.cc:1048] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:24.553344 13112 raft_consensus.cc:3060] T 16f353bc6d1847a199accd034426ec3f P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.558759 13112 raft_consensus.cc:1275] T 16f353bc6d1847a199accd034426ec3f P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Refusing update from remote peer 329c44a887e5438d8d4d7b4b6e2fac58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:24.559993 13300 consensus_queue.cc:1048] T 16f353bc6d1847a199accd034426ec3f P 329c44a887e5438d8d4d7b4b6e2fac58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:24.567667 13187 raft_consensus.cc:1275] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Refusing update from remote peer 329c44a887e5438d8d4d7b4b6e2fac58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:24.569156 13300 consensus_queue.cc:1048] T 16f353bc6d1847a199accd034426ec3f P 329c44a887e5438d8d4d7b4b6e2fac58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:24.615097 13112 raft_consensus.cc:1275] T 6d27b2b82449490087a942a8a70295fe P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Refusing update from remote peer 907cde6b822944c7a81e18d74131932a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:24.616354 13276 consensus_queue.cc:1048] T 6d27b2b82449490087a942a8a70295fe P 907cde6b822944c7a81e18d74131932a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:24.625402 13035 raft_consensus.cc:1275] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Refusing update from remote peer 907cde6b822944c7a81e18d74131932a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:24.626765 13260 consensus_queue.cc:1048] T 6d27b2b82449490087a942a8a70295fe P 907cde6b822944c7a81e18d74131932a [LEADER]: Connected to new peer: Peer: permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:24.634459 13112 raft_consensus.cc:3060] T 44066ba5afb3439496e0ffc8c96b6536 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.641173 13112 raft_consensus.cc:1275] T 44066ba5afb3439496e0ffc8c96b6536 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Refusing update from remote peer 329c44a887e5438d8d4d7b4b6e2fac58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:24.642493 13300 consensus_queue.cc:1048] T 44066ba5afb3439496e0ffc8c96b6536 P 329c44a887e5438d8d4d7b4b6e2fac58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:24.651075 13187 raft_consensus.cc:1275] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Refusing update from remote peer 329c44a887e5438d8d4d7b4b6e2fac58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:24.652418 13300 consensus_queue.cc:1048] T 44066ba5afb3439496e0ffc8c96b6536 P 329c44a887e5438d8d4d7b4b6e2fac58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:24.737483 13187 raft_consensus.cc:1275] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Refusing update from remote peer e1c403ce70cf42d4bf96348aa91ce00c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:24.738760 13235 consensus_queue.cc:1048] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c [LEADER]: Connected to new peer: Peer: permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:24.746294 13035 raft_consensus.cc:1275] T 8c8e031f412048f09177a12e10d44d21 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Refusing update from remote peer e1c403ce70cf42d4bf96348aa91ce00c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:24.748358 13310 consensus_queue.cc:1048] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c [LEADER]: Connected to new peer: Peer: permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:26.756641 12935 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57936:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:26.758810 12935 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:26.805485 13023 tablet_service.cc:1511] Processing CreateTablet for tablet 4e1ace06c24e420e8597846b56cc0c79 (DEFAULT_TABLE table=soft_deleted_table [id=975c3adad680462c995cefe32ad9a1a9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:26.806844 13023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e1ace06c24e420e8597846b56cc0c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.809995 13173 tablet_service.cc:1511] Processing CreateTablet for tablet 4e1ace06c24e420e8597846b56cc0c79 (DEFAULT_TABLE table=soft_deleted_table [id=975c3adad680462c995cefe32ad9a1a9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:26.810946 13096 tablet_service.cc:1511] Processing CreateTablet for tablet 93c035ed1907476a96662577ef9fae52 (DEFAULT_TABLE table=soft_deleted_table [id=975c3adad680462c995cefe32ad9a1a9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:26.811424 13173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e1ace06c24e420e8597846b56cc0c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.812330 13096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c035ed1907476a96662577ef9fae52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.814445 13024 tablet_service.cc:1511] Processing CreateTablet for tablet 93c035ed1907476a96662577ef9fae52 (DEFAULT_TABLE table=soft_deleted_table [id=975c3adad680462c995cefe32ad9a1a9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:26.815948 13024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c035ed1907476a96662577ef9fae52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.817979 13176 tablet_service.cc:1511] Processing CreateTablet for tablet 93c035ed1907476a96662577ef9fae52 (DEFAULT_TABLE table=soft_deleted_table [id=975c3adad680462c995cefe32ad9a1a9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:26.818349 13172 tablet_service.cc:1511] Processing CreateTablet for tablet 4b5b67cb4af94198b56cdf18c521246a (DEFAULT_TABLE table=soft_deleted_table [id=975c3adad680462c995cefe32ad9a1a9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:26.820322 13027 tablet_service.cc:1511] Processing CreateTablet for tablet 4b5b67cb4af94198b56cdf18c521246a (DEFAULT_TABLE table=soft_deleted_table [id=975c3adad680462c995cefe32ad9a1a9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:26.822052 13097 tablet_service.cc:1511] Processing CreateTablet for tablet 4b5b67cb4af94198b56cdf18c521246a (DEFAULT_TABLE table=soft_deleted_table [id=975c3adad680462c995cefe32ad9a1a9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:26.823418 13097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b5b67cb4af94198b56cdf18c521246a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.823558 13028 tablet_service.cc:1511] Processing CreateTablet for tablet 8c644e2de35045e88e8f1dd90bc75313 (DEFAULT_TABLE table=soft_deleted_table [id=975c3adad680462c995cefe32ad9a1a9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:26.825476 13101 tablet_service.cc:1511] Processing CreateTablet for tablet 8c644e2de35045e88e8f1dd90bc75313 (DEFAULT_TABLE table=soft_deleted_table [id=975c3adad680462c995cefe32ad9a1a9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:26.826411 13025 tablet_service.cc:1511] Processing CreateTablet for tablet d47cdf8b75a649febde90f19de509dbc (DEFAULT_TABLE table=soft_deleted_table [id=975c3adad680462c995cefe32ad9a1a9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:26.826853 13101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c644e2de35045e88e8f1dd90bc75313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.828713 13098 tablet_service.cc:1511] Processing CreateTablet for tablet 4e1ace06c24e420e8597846b56cc0c79 (DEFAULT_TABLE table=soft_deleted_table [id=975c3adad680462c995cefe32ad9a1a9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:26.829327 13022 tablet_service.cc:1511] Processing CreateTablet for tablet 9728ccfd1f9541e5a2850596e2a6d4ca (DEFAULT_TABLE table=soft_deleted_table [id=975c3adad680462c995cefe32ad9a1a9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:26.830096 13098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e1ace06c24e420e8597846b56cc0c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.832001 13026 tablet_service.cc:1511] Processing CreateTablet for tablet 1ccea3721c9444538cd1d7911a5b83a7 (DEFAULT_TABLE table=soft_deleted_table [id=975c3adad680462c995cefe32ad9a1a9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:26.834324 13171 tablet_service.cc:1511] Processing CreateTablet for tablet 8c644e2de35045e88e8f1dd90bc75313 (DEFAULT_TABLE table=soft_deleted_table [id=975c3adad680462c995cefe32ad9a1a9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:26.835803 13177 tablet_service.cc:1511] Processing CreateTablet for tablet 1ccea3721c9444538cd1d7911a5b83a7 (DEFAULT_TABLE table=soft_deleted_table [id=975c3adad680462c995cefe32ad9a1a9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:26.836694 13174 tablet_service.cc:1511] Processing CreateTablet for tablet 9728ccfd1f9541e5a2850596e2a6d4ca (DEFAULT_TABLE table=soft_deleted_table [id=975c3adad680462c995cefe32ad9a1a9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:26.834394 13170 tablet_service.cc:1511] Processing CreateTablet for tablet d47cdf8b75a649febde90f19de509dbc (DEFAULT_TABLE table=soft_deleted_table [id=975c3adad680462c995cefe32ad9a1a9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:26.837908 13104 tablet_service.cc:1511] Processing CreateTablet for tablet 1ccea3721c9444538cd1d7911a5b83a7 (DEFAULT_TABLE table=soft_deleted_table [id=975c3adad680462c995cefe32ad9a1a9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:26.839440 13102 tablet_service.cc:1511] Processing CreateTablet for tablet 9728ccfd1f9541e5a2850596e2a6d4ca (DEFAULT_TABLE table=soft_deleted_table [id=975c3adad680462c995cefe32ad9a1a9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:26.840848 13175 tablet_service.cc:1511] Processing CreateTablet for tablet 377900a1b7524ed298bea187f145147c (DEFAULT_TABLE table=soft_deleted_table [id=975c3adad680462c995cefe32ad9a1a9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:26.841899 13104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ccea3721c9444538cd1d7911a5b83a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.842780 13102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9728ccfd1f9541e5a2850596e2a6d4ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.838402 13103 tablet_service.cc:1511] Processing CreateTablet for tablet d47cdf8b75a649febde90f19de509dbc (DEFAULT_TABLE table=soft_deleted_table [id=975c3adad680462c995cefe32ad9a1a9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:26.845793 13103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d47cdf8b75a649febde90f19de509dbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.846396 13099 tablet_service.cc:1511] Processing CreateTablet for tablet e22c440bef7646da85bb451d84f19072 (DEFAULT_TABLE table=soft_deleted_table [id=975c3adad680462c995cefe32ad9a1a9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:26.847741 13099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e22c440bef7646da85bb451d84f19072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.839218 13100 tablet_service.cc:1511] Processing CreateTablet for tablet 377900a1b7524ed298bea187f145147c (DEFAULT_TABLE table=soft_deleted_table [id=975c3adad680462c995cefe32ad9a1a9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:26.848694 13100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 377900a1b7524ed298bea187f145147c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.849478 13178 tablet_service.cc:1511] Processing CreateTablet for tablet e22c440bef7646da85bb451d84f19072 (DEFAULT_TABLE table=soft_deleted_table [id=975c3adad680462c995cefe32ad9a1a9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:26.857829 13027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b5b67cb4af94198b56cdf18c521246a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.859001 13028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c644e2de35045e88e8f1dd90bc75313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.860780 13025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d47cdf8b75a649febde90f19de509dbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.865581 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9728ccfd1f9541e5a2850596e2a6d4ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.873045 13176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93c035ed1907476a96662577ef9fae52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.874291 13178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e22c440bef7646da85bb451d84f19072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.876811 13177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ccea3721c9444538cd1d7911a5b83a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.878407 13027 tablet_service.cc:1511] Processing CreateTablet for tablet 377900a1b7524ed298bea187f145147c (DEFAULT_TABLE table=soft_deleted_table [id=975c3adad680462c995cefe32ad9a1a9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:26.880113 13027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 377900a1b7524ed298bea187f145147c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.884918 13026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ccea3721c9444538cd1d7911a5b83a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.885317 13021 tablet_service.cc:1511] Processing CreateTablet for tablet e22c440bef7646da85bb451d84f19072 (DEFAULT_TABLE table=soft_deleted_table [id=975c3adad680462c995cefe32ad9a1a9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:26.886665 13021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e22c440bef7646da85bb451d84f19072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.889012 13171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c644e2de35045e88e8f1dd90bc75313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.891831 13172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b5b67cb4af94198b56cdf18c521246a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.898005 13174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9728ccfd1f9541e5a2850596e2a6d4ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.900900 13175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 377900a1b7524ed298bea187f145147c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.903309 13326 tablet_bootstrap.cc:492] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c: Bootstrap starting.
I20260709 13:02:26.904918 13170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d47cdf8b75a649febde90f19de509dbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.907961 13326 tablet_bootstrap.cc:654] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.959214 13326 tablet_bootstrap.cc:492] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c: No bootstrap required, opened a new log
I20260709 13:02:26.959719 13326 ts_tablet_manager.cc:1403] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c: Time spent bootstrapping tablet: real 0.057s	user 0.001s	sys 0.011s
I20260709 13:02:26.970956 13326 raft_consensus.cc:359] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:26.971833 13326 raft_consensus.cc:385] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.972180 13326 raft_consensus.cc:740] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c403ce70cf42d4bf96348aa91ce00c, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.973059 13326 consensus_queue.cc:260] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:26.975114 13325 tablet_bootstrap.cc:492] T 4e1ace06c24e420e8597846b56cc0c79 P 329c44a887e5438d8d4d7b4b6e2fac58: Bootstrap starting.
I20260709 13:02:26.975483 13326 ts_tablet_manager.cc:1434] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:02:26.981403 13329 tablet_bootstrap.cc:492] T 4e1ace06c24e420e8597846b56cc0c79 P 907cde6b822944c7a81e18d74131932a: Bootstrap starting.
I20260709 13:02:26.983783 13325 tablet_bootstrap.cc:654] T 4e1ace06c24e420e8597846b56cc0c79 P 329c44a887e5438d8d4d7b4b6e2fac58: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.986545 13326 tablet_bootstrap.cc:492] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c: Bootstrap starting.
I20260709 13:02:26.996224 13329 tablet_bootstrap.cc:654] T 4e1ace06c24e420e8597846b56cc0c79 P 907cde6b822944c7a81e18d74131932a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.999706 13326 tablet_bootstrap.cc:654] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.003533 13325 tablet_bootstrap.cc:492] T 4e1ace06c24e420e8597846b56cc0c79 P 329c44a887e5438d8d4d7b4b6e2fac58: No bootstrap required, opened a new log
I20260709 13:02:27.004153 13325 ts_tablet_manager.cc:1403] T 4e1ace06c24e420e8597846b56cc0c79 P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.004s
I20260709 13:02:27.007246 13325 raft_consensus.cc:359] T 4e1ace06c24e420e8597846b56cc0c79 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.007987 13325 raft_consensus.cc:385] T 4e1ace06c24e420e8597846b56cc0c79 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:02:27.008639 13004 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38535, user_credentials={real_user=slave}} blocked reactor thread for 92740.6us
I20260709 13:02:27.008266 13325 raft_consensus.cc:740] T 4e1ace06c24e420e8597846b56cc0c79 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 329c44a887e5438d8d4d7b4b6e2fac58, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.011379 13325 consensus_queue.cc:260] T 4e1ace06c24e420e8597846b56cc0c79 P 329c44a887e5438d8d4d7b4b6e2fac58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.027721 13325 ts_tablet_manager.cc:1434] T 4e1ace06c24e420e8597846b56cc0c79 P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:02:27.030522 13326 tablet_bootstrap.cc:492] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c: No bootstrap required, opened a new log
I20260709 13:02:27.031111 13326 ts_tablet_manager.cc:1403] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.014s
I20260709 13:02:27.037118 13326 raft_consensus.cc:359] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.037949 13326 raft_consensus.cc:385] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.038807 13326 raft_consensus.cc:740] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c403ce70cf42d4bf96348aa91ce00c, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.039536 13326 consensus_queue.cc:260] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.041851 13326 ts_tablet_manager.cc:1434] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:02:27.042831 13326 tablet_bootstrap.cc:492] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c: Bootstrap starting.
I20260709 13:02:27.046134 13325 tablet_bootstrap.cc:492] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58: Bootstrap starting.
I20260709 13:02:27.049755 13326 tablet_bootstrap.cc:654] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.052071 13329 tablet_bootstrap.cc:492] T 4e1ace06c24e420e8597846b56cc0c79 P 907cde6b822944c7a81e18d74131932a: No bootstrap required, opened a new log
I20260709 13:02:27.056295 13329 ts_tablet_manager.cc:1403] T 4e1ace06c24e420e8597846b56cc0c79 P 907cde6b822944c7a81e18d74131932a: Time spent bootstrapping tablet: real 0.076s	user 0.019s	sys 0.012s
I20260709 13:02:27.057550 13325 tablet_bootstrap.cc:654] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.058956 13326 tablet_bootstrap.cc:492] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c: No bootstrap required, opened a new log
I20260709 13:02:27.059541 13326 ts_tablet_manager.cc:1403] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.002s
I20260709 13:02:27.059640 13329 raft_consensus.cc:359] T 4e1ace06c24e420e8597846b56cc0c79 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.061077 13329 raft_consensus.cc:385] T 4e1ace06c24e420e8597846b56cc0c79 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.061384 13329 raft_consensus.cc:740] T 4e1ace06c24e420e8597846b56cc0c79 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.062153 13329 consensus_queue.cc:260] T 4e1ace06c24e420e8597846b56cc0c79 P 907cde6b822944c7a81e18d74131932a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.063844 13326 raft_consensus.cc:359] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.064556 13329 ts_tablet_manager.cc:1434] T 4e1ace06c24e420e8597846b56cc0c79 P 907cde6b822944c7a81e18d74131932a: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 13:02:27.064860 13326 raft_consensus.cc:385] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.065199 13326 raft_consensus.cc:740] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c403ce70cf42d4bf96348aa91ce00c, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.066154 13329 tablet_bootstrap.cc:492] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a: Bootstrap starting.
I20260709 13:02:27.065971 13326 consensus_queue.cc:260] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.067603 13325 tablet_bootstrap.cc:492] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58: No bootstrap required, opened a new log
I20260709 13:02:27.068534 13325 ts_tablet_manager.cc:1403] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.010s
I20260709 13:02:27.071687 13325 raft_consensus.cc:359] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.072521 13325 raft_consensus.cc:385] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.072829 13325 raft_consensus.cc:740] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 329c44a887e5438d8d4d7b4b6e2fac58, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.073959 13329 tablet_bootstrap.cc:654] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.073611 13325 consensus_queue.cc:260] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.076649 13325 ts_tablet_manager.cc:1434] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.006s
I20260709 13:02:27.074075 13326 ts_tablet_manager.cc:1434] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 13:02:27.078120 13326 tablet_bootstrap.cc:492] T e22c440bef7646da85bb451d84f19072 P e1c403ce70cf42d4bf96348aa91ce00c: Bootstrap starting.
I20260709 13:02:27.084962 13325 tablet_bootstrap.cc:492] T 377900a1b7524ed298bea187f145147c P 329c44a887e5438d8d4d7b4b6e2fac58: Bootstrap starting.
I20260709 13:02:27.086730 13329 tablet_bootstrap.cc:492] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a: No bootstrap required, opened a new log
I20260709 13:02:27.087358 13329 ts_tablet_manager.cc:1403] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.009s
I20260709 13:02:27.087697 13326 tablet_bootstrap.cc:654] T e22c440bef7646da85bb451d84f19072 P e1c403ce70cf42d4bf96348aa91ce00c: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.090700 13329 raft_consensus.cc:359] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.091554 13329 raft_consensus.cc:385] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.091853 13329 raft_consensus.cc:740] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.092598 13325 tablet_bootstrap.cc:654] T 377900a1b7524ed298bea187f145147c P 329c44a887e5438d8d4d7b4b6e2fac58: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.092686 13329 consensus_queue.cc:260] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.094746 13326 tablet_bootstrap.cc:492] T e22c440bef7646da85bb451d84f19072 P e1c403ce70cf42d4bf96348aa91ce00c: No bootstrap required, opened a new log
I20260709 13:02:27.095350 13326 ts_tablet_manager.cc:1403] T e22c440bef7646da85bb451d84f19072 P e1c403ce70cf42d4bf96348aa91ce00c: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.001s
I20260709 13:02:27.098416 13326 raft_consensus.cc:359] T e22c440bef7646da85bb451d84f19072 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.098989 13329 ts_tablet_manager.cc:1434] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:02:27.099318 13326 raft_consensus.cc:385] T e22c440bef7646da85bb451d84f19072 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.099638 13326 raft_consensus.cc:740] T e22c440bef7646da85bb451d84f19072 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c403ce70cf42d4bf96348aa91ce00c, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.100175 13329 tablet_bootstrap.cc:492] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a: Bootstrap starting.
I20260709 13:02:27.100569 13326 consensus_queue.cc:260] T e22c440bef7646da85bb451d84f19072 P e1c403ce70cf42d4bf96348aa91ce00c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.103442 13326 ts_tablet_manager.cc:1434] T e22c440bef7646da85bb451d84f19072 P e1c403ce70cf42d4bf96348aa91ce00c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:27.104578 13326 tablet_bootstrap.cc:492] T 8c644e2de35045e88e8f1dd90bc75313 P e1c403ce70cf42d4bf96348aa91ce00c: Bootstrap starting.
I20260709 13:02:27.108407 13329 tablet_bootstrap.cc:654] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.117823 13326 tablet_bootstrap.cc:654] T 8c644e2de35045e88e8f1dd90bc75313 P e1c403ce70cf42d4bf96348aa91ce00c: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.121011 13310 raft_consensus.cc:493] T e22c440bef7646da85bb451d84f19072 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.121691 13310 raft_consensus.cc:515] T e22c440bef7646da85bb451d84f19072 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.126297 13187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c440bef7646da85bb451d84f19072" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "907cde6b822944c7a81e18d74131932a" is_pre_election: true
I20260709 13:02:27.128000 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c440bef7646da85bb451d84f19072" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" is_pre_election: true
I20260709 13:02:27.124356 13310 leader_election.cc:290] T e22c440bef7646da85bb451d84f19072 P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
W20260709 13:02:27.130862 13079 leader_election.cc:343] T e22c440bef7646da85bb451d84f19072 P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:27.132722 13077 leader_election.cc:343] T e22c440bef7646da85bb451d84f19072 P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:27.133286 13077 leader_election.cc:304] T e22c440bef7646da85bb451d84f19072 P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1c403ce70cf42d4bf96348aa91ce00c; no voters: 329c44a887e5438d8d4d7b4b6e2fac58, 907cde6b822944c7a81e18d74131932a
I20260709 13:02:27.134310 13310 raft_consensus.cc:2749] T e22c440bef7646da85bb451d84f19072 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:27.136096 13325 tablet_bootstrap.cc:492] T 377900a1b7524ed298bea187f145147c P 329c44a887e5438d8d4d7b4b6e2fac58: No bootstrap required, opened a new log
I20260709 13:02:27.136763 13325 ts_tablet_manager.cc:1403] T 377900a1b7524ed298bea187f145147c P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent bootstrapping tablet: real 0.052s	user 0.020s	sys 0.029s
I20260709 13:02:27.137193 13329 tablet_bootstrap.cc:492] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a: No bootstrap required, opened a new log
I20260709 13:02:27.137791 13329 ts_tablet_manager.cc:1403] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.010s
I20260709 13:02:27.140008 13325 raft_consensus.cc:359] T 377900a1b7524ed298bea187f145147c P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.140828 13325 raft_consensus.cc:385] T 377900a1b7524ed298bea187f145147c P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.141137 13325 raft_consensus.cc:740] T 377900a1b7524ed298bea187f145147c P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 329c44a887e5438d8d4d7b4b6e2fac58, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.141466 13326 tablet_bootstrap.cc:492] T 8c644e2de35045e88e8f1dd90bc75313 P e1c403ce70cf42d4bf96348aa91ce00c: No bootstrap required, opened a new log
I20260709 13:02:27.140973 13329 raft_consensus.cc:359] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.141928 13329 raft_consensus.cc:385] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.142011 13326 ts_tablet_manager.cc:1403] T 8c644e2de35045e88e8f1dd90bc75313 P e1c403ce70cf42d4bf96348aa91ce00c: Time spent bootstrapping tablet: real 0.038s	user 0.023s	sys 0.006s
I20260709 13:02:27.142333 13329 raft_consensus.cc:740] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.142122 13325 consensus_queue.cc:260] T 377900a1b7524ed298bea187f145147c P 329c44a887e5438d8d4d7b4b6e2fac58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.143240 13329 consensus_queue.cc:260] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.144829 13325 ts_tablet_manager.cc:1434] T 377900a1b7524ed298bea187f145147c P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:02:27.145130 13326 raft_consensus.cc:359] T 8c644e2de35045e88e8f1dd90bc75313 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.145521 13329 ts_tablet_manager.cc:1434] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:02:27.145879 13326 raft_consensus.cc:385] T 8c644e2de35045e88e8f1dd90bc75313 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.146225 13326 raft_consensus.cc:740] T 8c644e2de35045e88e8f1dd90bc75313 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c403ce70cf42d4bf96348aa91ce00c, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.146952 13326 consensus_queue.cc:260] T 8c644e2de35045e88e8f1dd90bc75313 P e1c403ce70cf42d4bf96348aa91ce00c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.147552 13329 tablet_bootstrap.cc:492] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a: Bootstrap starting.
I20260709 13:02:27.151005 13326 ts_tablet_manager.cc:1434] T 8c644e2de35045e88e8f1dd90bc75313 P e1c403ce70cf42d4bf96348aa91ce00c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:02:27.147001 13325 tablet_bootstrap.cc:492] T d47cdf8b75a649febde90f19de509dbc P 329c44a887e5438d8d4d7b4b6e2fac58: Bootstrap starting.
I20260709 13:02:27.152109 13326 tablet_bootstrap.cc:492] T 1ccea3721c9444538cd1d7911a5b83a7 P e1c403ce70cf42d4bf96348aa91ce00c: Bootstrap starting.
I20260709 13:02:27.156589 13260 raft_consensus.cc:493] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.157232 13260 raft_consensus.cc:515] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.158666 13325 tablet_bootstrap.cc:654] T d47cdf8b75a649febde90f19de509dbc P 329c44a887e5438d8d4d7b4b6e2fac58: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.159338 13260 leader_election.cc:290] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599)
I20260709 13:02:27.162575 13112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377900a1b7524ed298bea187f145147c" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" is_pre_election: true
I20260709 13:02:27.163309 13326 tablet_bootstrap.cc:654] T 1ccea3721c9444538cd1d7911a5b83a7 P e1c403ce70cf42d4bf96348aa91ce00c: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.156589 13329 tablet_bootstrap.cc:654] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.165691 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377900a1b7524ed298bea187f145147c" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" is_pre_election: true
I20260709 13:02:27.166501 13035 raft_consensus.cc:2468] T 377900a1b7524ed298bea187f145147c P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 0.
W20260709 13:02:27.168954 13154 leader_election.cc:343] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:27.170509 13151 leader_election.cc:304] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, 907cde6b822944c7a81e18d74131932a; no voters: e1c403ce70cf42d4bf96348aa91ce00c
I20260709 13:02:27.171845 13260 raft_consensus.cc:2804] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:27.172268 13260 raft_consensus.cc:493] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.173012 13260 raft_consensus.cc:3060] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.175541 13326 tablet_bootstrap.cc:492] T 1ccea3721c9444538cd1d7911a5b83a7 P e1c403ce70cf42d4bf96348aa91ce00c: No bootstrap required, opened a new log
I20260709 13:02:27.176138 13326 ts_tablet_manager.cc:1403] T 1ccea3721c9444538cd1d7911a5b83a7 P e1c403ce70cf42d4bf96348aa91ce00c: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.004s
I20260709 13:02:27.182163 13326 raft_consensus.cc:359] T 1ccea3721c9444538cd1d7911a5b83a7 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.183048 13326 raft_consensus.cc:385] T 1ccea3721c9444538cd1d7911a5b83a7 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.183368 13326 raft_consensus.cc:740] T 1ccea3721c9444538cd1d7911a5b83a7 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c403ce70cf42d4bf96348aa91ce00c, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.184948 13326 consensus_queue.cc:260] T 1ccea3721c9444538cd1d7911a5b83a7 P e1c403ce70cf42d4bf96348aa91ce00c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.187137 13329 tablet_bootstrap.cc:492] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a: No bootstrap required, opened a new log
I20260709 13:02:27.187305 13326 ts_tablet_manager.cc:1434] T 1ccea3721c9444538cd1d7911a5b83a7 P e1c403ce70cf42d4bf96348aa91ce00c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:02:27.187847 13329 ts_tablet_manager.cc:1403] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.016s
I20260709 13:02:27.188548 13326 tablet_bootstrap.cc:492] T 93c035ed1907476a96662577ef9fae52 P e1c403ce70cf42d4bf96348aa91ce00c: Bootstrap starting.
I20260709 13:02:27.191223 13329 raft_consensus.cc:359] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.191968 13329 raft_consensus.cc:385] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.192252 13329 raft_consensus.cc:740] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.193123 13329 consensus_queue.cc:260] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.195696 13326 tablet_bootstrap.cc:654] T 93c035ed1907476a96662577ef9fae52 P e1c403ce70cf42d4bf96348aa91ce00c: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.202476 13329 ts_tablet_manager.cc:1434] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:02:27.217152 13329 tablet_bootstrap.cc:492] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a: Bootstrap starting.
I20260709 13:02:27.220921 13260 raft_consensus.cc:515] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.225337 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377900a1b7524ed298bea187f145147c" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
I20260709 13:02:27.226241 13035 raft_consensus.cc:3060] T 377900a1b7524ed298bea187f145147c P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.226898 13260 leader_election.cc:290] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 election: Requested vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599)
I20260709 13:02:27.230953 13325 tablet_bootstrap.cc:492] T d47cdf8b75a649febde90f19de509dbc P 329c44a887e5438d8d4d7b4b6e2fac58: No bootstrap required, opened a new log
I20260709 13:02:27.230726 13112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377900a1b7524ed298bea187f145147c" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
I20260709 13:02:27.231565 13325 ts_tablet_manager.cc:1403] T d47cdf8b75a649febde90f19de509dbc P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent bootstrapping tablet: real 0.085s	user 0.032s	sys 0.046s
W20260709 13:02:27.234164 13154 leader_election.cc:343] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:27.234872 13325 raft_consensus.cc:359] T d47cdf8b75a649febde90f19de509dbc P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.235710 13325 raft_consensus.cc:385] T d47cdf8b75a649febde90f19de509dbc P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.236088 13325 raft_consensus.cc:740] T d47cdf8b75a649febde90f19de509dbc P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 329c44a887e5438d8d4d7b4b6e2fac58, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.236914 13325 consensus_queue.cc:260] T d47cdf8b75a649febde90f19de509dbc P 329c44a887e5438d8d4d7b4b6e2fac58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.225230 13345 raft_consensus.cc:493] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.239933 13325 ts_tablet_manager.cc:1434] T d47cdf8b75a649febde90f19de509dbc P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:02:27.240994 13325 tablet_bootstrap.cc:492] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58: Bootstrap starting.
I20260709 13:02:27.241179 13326 tablet_bootstrap.cc:492] T 93c035ed1907476a96662577ef9fae52 P e1c403ce70cf42d4bf96348aa91ce00c: No bootstrap required, opened a new log
I20260709 13:02:27.241827 13326 ts_tablet_manager.cc:1403] T 93c035ed1907476a96662577ef9fae52 P e1c403ce70cf42d4bf96348aa91ce00c: Time spent bootstrapping tablet: real 0.054s	user 0.021s	sys 0.027s
I20260709 13:02:27.239954 13329 tablet_bootstrap.cc:654] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.240108 13345 raft_consensus.cc:515] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.245265 13326 raft_consensus.cc:359] T 93c035ed1907476a96662577ef9fae52 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.246065 13326 raft_consensus.cc:385] T 93c035ed1907476a96662577ef9fae52 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.246421 13326 raft_consensus.cc:740] T 93c035ed1907476a96662577ef9fae52 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c403ce70cf42d4bf96348aa91ce00c, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.247285 13326 consensus_queue.cc:260] T 93c035ed1907476a96662577ef9fae52 P e1c403ce70cf42d4bf96348aa91ce00c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.248383 13325 tablet_bootstrap.cc:654] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.247303 13035 raft_consensus.cc:2468] T 377900a1b7524ed298bea187f145147c P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 1.
I20260709 13:02:27.249936 13326 ts_tablet_manager.cc:1434] T 93c035ed1907476a96662577ef9fae52 P e1c403ce70cf42d4bf96348aa91ce00c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:27.251561 13038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d47cdf8b75a649febde90f19de509dbc" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" is_pre_election: true
I20260709 13:02:27.252290 13038 raft_consensus.cc:2468] T d47cdf8b75a649febde90f19de509dbc P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1c403ce70cf42d4bf96348aa91ce00c in term 0.
I20260709 13:02:27.253479 13326 tablet_bootstrap.cc:492] T 4b5b67cb4af94198b56cdf18c521246a P e1c403ce70cf42d4bf96348aa91ce00c: Bootstrap starting.
I20260709 13:02:27.253744 13077 leader_election.cc:304] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, e1c403ce70cf42d4bf96348aa91ce00c; no voters: 
I20260709 13:02:27.255095 13345 leader_election.cc:290] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:27.256335 13151 leader_election.cc:304] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, 907cde6b822944c7a81e18d74131932a; no voters: e1c403ce70cf42d4bf96348aa91ce00c
I20260709 13:02:27.258106 13260 raft_consensus.cc:2804] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:27.258612 13260 raft_consensus.cc:697] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Becoming Leader. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Running, Role: LEADER
I20260709 13:02:27.259435 13260 consensus_queue.cc:237] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.260737 13326 tablet_bootstrap.cc:654] T 4b5b67cb4af94198b56cdf18c521246a P e1c403ce70cf42d4bf96348aa91ce00c: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.264856 13345 raft_consensus.cc:2804] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:27.266984 13345 raft_consensus.cc:493] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.268456 13345 raft_consensus.cc:3060] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.283674 13310 raft_consensus.cc:493] T 8c644e2de35045e88e8f1dd90bc75313 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.284097 13187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d47cdf8b75a649febde90f19de509dbc" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "907cde6b822944c7a81e18d74131932a" is_pre_election: true
I20260709 13:02:27.284447 13310 raft_consensus.cc:515] T 8c644e2de35045e88e8f1dd90bc75313 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.287066 13310 leader_election.cc:290] T 8c644e2de35045e88e8f1dd90bc75313 P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
W20260709 13:02:27.289215 13079 leader_election.cc:343] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:27.294797 13187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c644e2de35045e88e8f1dd90bc75313" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "907cde6b822944c7a81e18d74131932a" is_pre_election: true
I20260709 13:02:27.297495 12937 catalog_manager.cc:5697] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a reported cstate change: term changed from 0 to 1, leader changed from <none> to 907cde6b822944c7a81e18d74131932a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "907cde6b822944c7a81e18d74131932a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:27.299549 13345 raft_consensus.cc:515] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.300177 13325 tablet_bootstrap.cc:492] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58: No bootstrap required, opened a new log
I20260709 13:02:27.300894 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c644e2de35045e88e8f1dd90bc75313" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" is_pre_election: true
I20260709 13:02:27.301222 13325 ts_tablet_manager.cc:1403] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent bootstrapping tablet: real 0.060s	user 0.024s	sys 0.026s
W20260709 13:02:27.301684 13079 leader_election.cc:343] T 8c644e2de35045e88e8f1dd90bc75313 P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:27.302202 13345 leader_election.cc:290] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 election: Requested vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:27.300447 13326 tablet_bootstrap.cc:492] T 4b5b67cb4af94198b56cdf18c521246a P e1c403ce70cf42d4bf96348aa91ce00c: No bootstrap required, opened a new log
I20260709 13:02:27.303018 13038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d47cdf8b75a649febde90f19de509dbc" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
I20260709 13:02:27.304126 13038 raft_consensus.cc:3060] T d47cdf8b75a649febde90f19de509dbc P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:27.305142 13077 leader_election.cc:343] T 8c644e2de35045e88e8f1dd90bc75313 P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:27.305660 13077 leader_election.cc:304] T 8c644e2de35045e88e8f1dd90bc75313 P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1c403ce70cf42d4bf96348aa91ce00c; no voters: 329c44a887e5438d8d4d7b4b6e2fac58, 907cde6b822944c7a81e18d74131932a
I20260709 13:02:27.305765 13325 raft_consensus.cc:359] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.306388 13325 raft_consensus.cc:385] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.306466 13345 raft_consensus.cc:2749] T 8c644e2de35045e88e8f1dd90bc75313 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:27.306748 13325 raft_consensus.cc:740] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 329c44a887e5438d8d4d7b4b6e2fac58, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.307525 13325 consensus_queue.cc:260] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.309855 13325 ts_tablet_manager.cc:1434] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:27.310878 13325 tablet_bootstrap.cc:492] T 1ccea3721c9444538cd1d7911a5b83a7 P 329c44a887e5438d8d4d7b4b6e2fac58: Bootstrap starting.
I20260709 13:02:27.311596 13187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d47cdf8b75a649febde90f19de509dbc" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "907cde6b822944c7a81e18d74131932a"
W20260709 13:02:27.312829 13079 leader_election.cc:343] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:27.309909 13329 tablet_bootstrap.cc:492] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a: No bootstrap required, opened a new log
I20260709 13:02:27.313702 13329 ts_tablet_manager.cc:1403] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a: Time spent bootstrapping tablet: real 0.110s	user 0.010s	sys 0.008s
I20260709 13:02:27.316329 13038 raft_consensus.cc:2468] T d47cdf8b75a649febde90f19de509dbc P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1c403ce70cf42d4bf96348aa91ce00c in term 1.
I20260709 13:02:27.317452 13325 tablet_bootstrap.cc:654] T 1ccea3721c9444538cd1d7911a5b83a7 P 329c44a887e5438d8d4d7b4b6e2fac58: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.303539 13326 ts_tablet_manager.cc:1403] T 4b5b67cb4af94198b56cdf18c521246a P e1c403ce70cf42d4bf96348aa91ce00c: Time spent bootstrapping tablet: real 0.050s	user 0.017s	sys 0.029s
I20260709 13:02:27.320832 13326 raft_consensus.cc:359] T 4b5b67cb4af94198b56cdf18c521246a P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.321592 13326 raft_consensus.cc:385] T 4b5b67cb4af94198b56cdf18c521246a P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.321857 13326 raft_consensus.cc:740] T 4b5b67cb4af94198b56cdf18c521246a P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c403ce70cf42d4bf96348aa91ce00c, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.322788 13325 tablet_bootstrap.cc:492] T 1ccea3721c9444538cd1d7911a5b83a7 P 329c44a887e5438d8d4d7b4b6e2fac58: No bootstrap required, opened a new log
I20260709 13:02:27.322587 13326 consensus_queue.cc:260] T 4b5b67cb4af94198b56cdf18c521246a P e1c403ce70cf42d4bf96348aa91ce00c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.323309 13325 ts_tablet_manager.cc:1403] T 1ccea3721c9444538cd1d7911a5b83a7 P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:02:27.324999 13326 ts_tablet_manager.cc:1434] T 4b5b67cb4af94198b56cdf18c521246a P e1c403ce70cf42d4bf96348aa91ce00c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:02:27.326859 13326 tablet_bootstrap.cc:492] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c: Bootstrap starting.
I20260709 13:02:27.326480 13325 raft_consensus.cc:359] T 1ccea3721c9444538cd1d7911a5b83a7 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.326979 13077 leader_election.cc:304] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, e1c403ce70cf42d4bf96348aa91ce00c; no voters: 907cde6b822944c7a81e18d74131932a
I20260709 13:02:27.327380 13325 raft_consensus.cc:385] T 1ccea3721c9444538cd1d7911a5b83a7 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.327699 13325 raft_consensus.cc:740] T 1ccea3721c9444538cd1d7911a5b83a7 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 329c44a887e5438d8d4d7b4b6e2fac58, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.328536 13325 consensus_queue.cc:260] T 1ccea3721c9444538cd1d7911a5b83a7 P 329c44a887e5438d8d4d7b4b6e2fac58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
W20260709 13:02:27.326386 12985 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:27.330880 13325 ts_tablet_manager.cc:1434] T 1ccea3721c9444538cd1d7911a5b83a7 P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:27.331416 13345 raft_consensus.cc:493] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.332037 13325 tablet_bootstrap.cc:492] T 93c035ed1907476a96662577ef9fae52 P 329c44a887e5438d8d4d7b4b6e2fac58: Bootstrap starting.
I20260709 13:02:27.331911 13345 raft_consensus.cc:515] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.332443 13329 raft_consensus.cc:359] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.333242 13329 raft_consensus.cc:385] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.333530 13329 raft_consensus.cc:740] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.333621 13326 tablet_bootstrap.cc:654] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.334460 13329 consensus_queue.cc:260] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.337389 13329 ts_tablet_manager.cc:1434] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.002s
I20260709 13:02:27.330753 13310 raft_consensus.cc:2804] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:27.338251 13310 raft_consensus.cc:697] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c [term 1 LEADER]: Becoming Leader. State: Replica: e1c403ce70cf42d4bf96348aa91ce00c, State: Running, Role: LEADER
I20260709 13:02:27.338559 13329 tablet_bootstrap.cc:492] T 93c035ed1907476a96662577ef9fae52 P 907cde6b822944c7a81e18d74131932a: Bootstrap starting.
I20260709 13:02:27.339450 13325 tablet_bootstrap.cc:654] T 93c035ed1907476a96662577ef9fae52 P 329c44a887e5438d8d4d7b4b6e2fac58: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.339147 13310 consensus_queue.cc:237] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.347290 13326 tablet_bootstrap.cc:492] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c: No bootstrap required, opened a new log
I20260709 13:02:27.347565 13329 tablet_bootstrap.cc:654] T 93c035ed1907476a96662577ef9fae52 P 907cde6b822944c7a81e18d74131932a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.347826 13326 ts_tablet_manager.cc:1403] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.004s
I20260709 13:02:27.349484 13345 leader_election.cc:290] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:27.350715 13187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1ace06c24e420e8597846b56cc0c79" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "907cde6b822944c7a81e18d74131932a" is_pre_election: true
I20260709 13:02:27.350785 13326 raft_consensus.cc:359] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.351689 13187 raft_consensus.cc:2468] T 4e1ace06c24e420e8597846b56cc0c79 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1c403ce70cf42d4bf96348aa91ce00c in term 0.
I20260709 13:02:27.351651 13326 raft_consensus.cc:385] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.352363 13326 raft_consensus.cc:740] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c403ce70cf42d4bf96348aa91ce00c, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.351663 13038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1ace06c24e420e8597846b56cc0c79" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" is_pre_election: true
I20260709 13:02:27.353257 13038 raft_consensus.cc:2468] T 4e1ace06c24e420e8597846b56cc0c79 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1c403ce70cf42d4bf96348aa91ce00c in term 0.
I20260709 13:02:27.353083 13326 consensus_queue.cc:260] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.354779 13079 leader_election.cc:304] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 907cde6b822944c7a81e18d74131932a, e1c403ce70cf42d4bf96348aa91ce00c; no voters: 
I20260709 13:02:27.357205 13325 tablet_bootstrap.cc:492] T 93c035ed1907476a96662577ef9fae52 P 329c44a887e5438d8d4d7b4b6e2fac58: No bootstrap required, opened a new log
I20260709 13:02:27.357899 13325 ts_tablet_manager.cc:1403] T 93c035ed1907476a96662577ef9fae52 P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.004s
I20260709 13:02:27.357376 13347 raft_consensus.cc:2804] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:27.358644 13347 raft_consensus.cc:493] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.358994 13347 raft_consensus.cc:3060] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.361792 13260 raft_consensus.cc:493] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.362413 13260 raft_consensus.cc:515] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.365573 13260 leader_election.cc:290] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599)
I20260709 13:02:27.365906 13038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c440bef7646da85bb451d84f19072" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" is_pre_election: true
I20260709 13:02:27.367233 13112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c440bef7646da85bb451d84f19072" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" is_pre_election: true
I20260709 13:02:27.368005 13112 raft_consensus.cc:2468] T e22c440bef7646da85bb451d84f19072 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 0.
W20260709 13:02:27.369131 13151 leader_election.cc:343] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:27.369212 13347 raft_consensus.cc:515] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.374136 13325 raft_consensus.cc:359] T 93c035ed1907476a96662577ef9fae52 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.374962 13325 raft_consensus.cc:385] T 93c035ed1907476a96662577ef9fae52 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.375252 13325 raft_consensus.cc:740] T 93c035ed1907476a96662577ef9fae52 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 329c44a887e5438d8d4d7b4b6e2fac58, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.376035 13038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1ace06c24e420e8597846b56cc0c79" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
I20260709 13:02:27.375953 13325 consensus_queue.cc:260] T 93c035ed1907476a96662577ef9fae52 P 329c44a887e5438d8d4d7b4b6e2fac58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.376807 13038 raft_consensus.cc:3060] T 4e1ace06c24e420e8597846b56cc0c79 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.379081 13154 leader_election.cc:304] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 907cde6b822944c7a81e18d74131932a, e1c403ce70cf42d4bf96348aa91ce00c; no voters: 329c44a887e5438d8d4d7b4b6e2fac58
I20260709 13:02:27.379498 13329 tablet_bootstrap.cc:492] T 93c035ed1907476a96662577ef9fae52 P 907cde6b822944c7a81e18d74131932a: No bootstrap required, opened a new log
I20260709 13:02:27.380193 13329 ts_tablet_manager.cc:1403] T 93c035ed1907476a96662577ef9fae52 P 907cde6b822944c7a81e18d74131932a: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.009s
I20260709 13:02:27.381336 13325 ts_tablet_manager.cc:1434] T 93c035ed1907476a96662577ef9fae52 P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.002s
I20260709 13:02:27.382447 13325 tablet_bootstrap.cc:492] T e22c440bef7646da85bb451d84f19072 P 329c44a887e5438d8d4d7b4b6e2fac58: Bootstrap starting.
I20260709 13:02:27.383487 13329 raft_consensus.cc:359] T 93c035ed1907476a96662577ef9fae52 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.384298 13329 raft_consensus.cc:385] T 93c035ed1907476a96662577ef9fae52 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.384627 13329 raft_consensus.cc:740] T 93c035ed1907476a96662577ef9fae52 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.385408 13038 raft_consensus.cc:2468] T 4e1ace06c24e420e8597846b56cc0c79 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1c403ce70cf42d4bf96348aa91ce00c in term 1.
I20260709 13:02:27.385663 13329 consensus_queue.cc:260] T 93c035ed1907476a96662577ef9fae52 P 907cde6b822944c7a81e18d74131932a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.386785 13077 leader_election.cc:304] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, e1c403ce70cf42d4bf96348aa91ce00c; no voters: 
I20260709 13:02:27.387640 13345 raft_consensus.cc:2804] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:27.389058 13325 tablet_bootstrap.cc:654] T e22c440bef7646da85bb451d84f19072 P 329c44a887e5438d8d4d7b4b6e2fac58: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.389442 13187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1ace06c24e420e8597846b56cc0c79" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "907cde6b822944c7a81e18d74131932a"
I20260709 13:02:27.390014 13326 ts_tablet_manager.cc:1434] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c: Time spent starting tablet: real 0.042s	user 0.004s	sys 0.004s
I20260709 13:02:27.390133 13187 raft_consensus.cc:3060] T 4e1ace06c24e420e8597846b56cc0c79 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.390823 13347 leader_election.cc:290] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 election: Requested vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:27.396690 13260 raft_consensus.cc:2804] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:27.397300 13260 raft_consensus.cc:493] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.397642 13260 raft_consensus.cc:3060] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.398725 13187 raft_consensus.cc:2468] T 4e1ace06c24e420e8597846b56cc0c79 P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1c403ce70cf42d4bf96348aa91ce00c in term 1.
I20260709 13:02:27.397706 13329 ts_tablet_manager.cc:1434] T 93c035ed1907476a96662577ef9fae52 P 907cde6b822944c7a81e18d74131932a: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:02:27.400378 13329 tablet_bootstrap.cc:492] T 8c644e2de35045e88e8f1dd90bc75313 P 907cde6b822944c7a81e18d74131932a: Bootstrap starting.
I20260709 13:02:27.405984 13347 raft_consensus.cc:493] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.406493 13329 tablet_bootstrap.cc:654] T 8c644e2de35045e88e8f1dd90bc75313 P 907cde6b822944c7a81e18d74131932a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.406698 13347 raft_consensus.cc:515] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.410282 13038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377900a1b7524ed298bea187f145147c" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" is_pre_election: true
I20260709 13:02:27.411237 13038 raft_consensus.cc:2393] T 377900a1b7524ed298bea187f145147c P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1c403ce70cf42d4bf96348aa91ce00c in current term 1: Already voted for candidate 907cde6b822944c7a81e18d74131932a in this term.
I20260709 13:02:27.409690 13260 raft_consensus.cc:515] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.419317 13329 tablet_bootstrap.cc:492] T 8c644e2de35045e88e8f1dd90bc75313 P 907cde6b822944c7a81e18d74131932a: No bootstrap required, opened a new log
I20260709 13:02:27.418638 13347 leader_election.cc:290] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:27.421082 13347 raft_consensus.cc:493] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.423830 13112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c440bef7646da85bb451d84f19072" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
I20260709 13:02:27.420228 13038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c440bef7646da85bb451d84f19072" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
I20260709 13:02:27.421232 13187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377900a1b7524ed298bea187f145147c" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "907cde6b822944c7a81e18d74131932a" is_pre_election: true
I20260709 13:02:27.422982 13345 raft_consensus.cc:697] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 LEADER]: Becoming Leader. State: Replica: e1c403ce70cf42d4bf96348aa91ce00c, State: Running, Role: LEADER
I20260709 13:02:27.426486 13325 tablet_bootstrap.cc:492] T e22c440bef7646da85bb451d84f19072 P 329c44a887e5438d8d4d7b4b6e2fac58: No bootstrap required, opened a new log
I20260709 13:02:27.426270 13345 consensus_queue.cc:237] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.427181 13325 ts_tablet_manager.cc:1403] T e22c440bef7646da85bb451d84f19072 P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.028s
I20260709 13:02:27.427495 13260 leader_election.cc:290] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 election: Requested vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599)
I20260709 13:02:27.423821 13347 raft_consensus.cc:515] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.419942 13329 ts_tablet_manager.cc:1403] T 8c644e2de35045e88e8f1dd90bc75313 P 907cde6b822944c7a81e18d74131932a: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:02:27.426465 13079 leader_election.cc:304] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1c403ce70cf42d4bf96348aa91ce00c; no voters: 329c44a887e5438d8d4d7b4b6e2fac58, 907cde6b822944c7a81e18d74131932a
W20260709 13:02:27.430987 13151 leader_election.cc:343] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:27.430732 13325 raft_consensus.cc:359] T e22c440bef7646da85bb451d84f19072 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.431665 13325 raft_consensus.cc:385] T e22c440bef7646da85bb451d84f19072 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.432003 13325 raft_consensus.cc:740] T e22c440bef7646da85bb451d84f19072 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 329c44a887e5438d8d4d7b4b6e2fac58, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.430819 13347 leader_election.cc:290] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:27.433215 13347 raft_consensus.cc:3060] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.433576 13329 raft_consensus.cc:359] T 8c644e2de35045e88e8f1dd90bc75313 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.434135 13038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9728ccfd1f9541e5a2850596e2a6d4ca" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" is_pre_election: true
I20260709 13:02:27.434391 13329 raft_consensus.cc:385] T 8c644e2de35045e88e8f1dd90bc75313 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.434736 13329 raft_consensus.cc:740] T 8c644e2de35045e88e8f1dd90bc75313 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Initialized, Role: FOLLOWER
W20260709 13:02:27.435730 13077 leader_election.cc:343] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:27.435532 13329 consensus_queue.cc:260] T 8c644e2de35045e88e8f1dd90bc75313 P 907cde6b822944c7a81e18d74131932a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.424889 13112 raft_consensus.cc:3060] T e22c440bef7646da85bb451d84f19072 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.438608 13329 ts_tablet_manager.cc:1434] T 8c644e2de35045e88e8f1dd90bc75313 P 907cde6b822944c7a81e18d74131932a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:02:27.440203 13329 tablet_bootstrap.cc:492] T d47cdf8b75a649febde90f19de509dbc P 907cde6b822944c7a81e18d74131932a: Bootstrap starting.
I20260709 13:02:27.427246 12934 catalog_manager.cc:5697] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c reported cstate change: term changed from 0 to 1, leader changed from <none> to e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:27.441184 13187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9728ccfd1f9541e5a2850596e2a6d4ca" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "907cde6b822944c7a81e18d74131932a" is_pre_election: true
I20260709 13:02:27.441797 13260 raft_consensus.cc:493] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.442360 13260 raft_consensus.cc:515] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.443792 13325 consensus_queue.cc:260] T e22c440bef7646da85bb451d84f19072 P 329c44a887e5438d8d4d7b4b6e2fac58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.444175 13187 raft_consensus.cc:2468] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1c403ce70cf42d4bf96348aa91ce00c in term 0.
I20260709 13:02:27.445958 13038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9728ccfd1f9541e5a2850596e2a6d4ca" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" is_pre_election: true
I20260709 13:02:27.446416 13325 ts_tablet_manager.cc:1434] T e22c440bef7646da85bb451d84f19072 P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
W20260709 13:02:27.447645 13151 leader_election.cc:343] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:27.449084 13347 raft_consensus.cc:2749] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:27.450644 13325 tablet_bootstrap.cc:492] T 9728ccfd1f9541e5a2850596e2a6d4ca P 329c44a887e5438d8d4d7b4b6e2fac58: Bootstrap starting.
I20260709 13:02:27.452986 13114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9728ccfd1f9541e5a2850596e2a6d4ca" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" is_pre_election: true
I20260709 13:02:27.453727 13114 raft_consensus.cc:2468] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 0.
I20260709 13:02:27.456151 13154 leader_election.cc:304] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 907cde6b822944c7a81e18d74131932a, e1c403ce70cf42d4bf96348aa91ce00c; no voters: 329c44a887e5438d8d4d7b4b6e2fac58
I20260709 13:02:27.457155 13343 raft_consensus.cc:2804] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:27.457258 13325 tablet_bootstrap.cc:654] T 9728ccfd1f9541e5a2850596e2a6d4ca P 329c44a887e5438d8d4d7b4b6e2fac58: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.457597 13343 raft_consensus.cc:493] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.457964 13343 raft_consensus.cc:3060] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.458401 13329 tablet_bootstrap.cc:654] T d47cdf8b75a649febde90f19de509dbc P 907cde6b822944c7a81e18d74131932a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.459007 13079 leader_election.cc:304] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 907cde6b822944c7a81e18d74131932a, e1c403ce70cf42d4bf96348aa91ce00c; no voters: 329c44a887e5438d8d4d7b4b6e2fac58
I20260709 13:02:27.459918 13347 raft_consensus.cc:2804] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:27.460297 13347 raft_consensus.cc:493] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.460642 13347 raft_consensus.cc:3060] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.462836 13327 raft_consensus.cc:493] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.463378 13327 raft_consensus.cc:515] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.464601 13260 leader_election.cc:290] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599)
I20260709 13:02:27.466205 13327 leader_election.cc:290] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:27.468575 13347 raft_consensus.cc:515] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.469000 13114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5b67cb4af94198b56cdf18c521246a" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" is_pre_election: true
I20260709 13:02:27.469763 13114 raft_consensus.cc:2468] T 4b5b67cb4af94198b56cdf18c521246a P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 329c44a887e5438d8d4d7b4b6e2fac58 in term 0.
I20260709 13:02:27.470852 13347 leader_election.cc:290] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 election: Requested vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:27.472204 13186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9728ccfd1f9541e5a2850596e2a6d4ca" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "907cde6b822944c7a81e18d74131932a"
I20260709 13:02:27.473515 13005 leader_election.cc:304] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, e1c403ce70cf42d4bf96348aa91ce00c; no voters: 
I20260709 13:02:27.474799 13038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9728ccfd1f9541e5a2850596e2a6d4ca" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
I20260709 13:02:27.475835 13325 tablet_bootstrap.cc:492] T 9728ccfd1f9541e5a2850596e2a6d4ca P 329c44a887e5438d8d4d7b4b6e2fac58: No bootstrap required, opened a new log
I20260709 13:02:27.475709 13343 raft_consensus.cc:515] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.476370 13325 ts_tablet_manager.cc:1403] T 9728ccfd1f9541e5a2850596e2a6d4ca P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.003s
W20260709 13:02:27.476442 13077 leader_election.cc:343] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:27.477720 13327 raft_consensus.cc:2804] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:27.478134 13327 raft_consensus.cc:493] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.478446 13327 raft_consensus.cc:3060] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.479206 13329 tablet_bootstrap.cc:492] T d47cdf8b75a649febde90f19de509dbc P 907cde6b822944c7a81e18d74131932a: No bootstrap required, opened a new log
I20260709 13:02:27.479779 13329 ts_tablet_manager.cc:1403] T d47cdf8b75a649febde90f19de509dbc P 907cde6b822944c7a81e18d74131932a: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.005s
I20260709 13:02:27.479436 13325 raft_consensus.cc:359] T 9728ccfd1f9541e5a2850596e2a6d4ca P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.480245 13325 raft_consensus.cc:385] T 9728ccfd1f9541e5a2850596e2a6d4ca P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.481931 13186 raft_consensus.cc:2393] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e1c403ce70cf42d4bf96348aa91ce00c in current term 1: Already voted for candidate 907cde6b822944c7a81e18d74131932a in this term.
I20260709 13:02:27.483598 13325 raft_consensus.cc:740] T 9728ccfd1f9541e5a2850596e2a6d4ca P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 329c44a887e5438d8d4d7b4b6e2fac58, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.484378 13325 consensus_queue.cc:260] T 9728ccfd1f9541e5a2850596e2a6d4ca P 329c44a887e5438d8d4d7b4b6e2fac58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.485189 13343 leader_election.cc:290] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 election: Requested vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599)
I20260709 13:02:27.485544 13079 leader_election.cc:304] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1c403ce70cf42d4bf96348aa91ce00c; no voters: 329c44a887e5438d8d4d7b4b6e2fac58, 907cde6b822944c7a81e18d74131932a
I20260709 13:02:27.486212 13114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9728ccfd1f9541e5a2850596e2a6d4ca" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
I20260709 13:02:27.482609 13329 raft_consensus.cc:359] T d47cdf8b75a649febde90f19de509dbc P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.486825 13329 raft_consensus.cc:385] T d47cdf8b75a649febde90f19de509dbc P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.487100 13329 raft_consensus.cc:740] T d47cdf8b75a649febde90f19de509dbc P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.487516 13325 ts_tablet_manager.cc:1434] T 9728ccfd1f9541e5a2850596e2a6d4ca P 329c44a887e5438d8d4d7b4b6e2fac58: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:02:27.484241 13038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9728ccfd1f9541e5a2850596e2a6d4ca" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
I20260709 13:02:27.488059 13329 consensus_queue.cc:260] T d47cdf8b75a649febde90f19de509dbc P 907cde6b822944c7a81e18d74131932a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.488674 13038 raft_consensus.cc:3060] T 9728ccfd1f9541e5a2850596e2a6d4ca P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.490549 13329 ts_tablet_manager.cc:1434] T d47cdf8b75a649febde90f19de509dbc P 907cde6b822944c7a81e18d74131932a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:02:27.487063 13114 raft_consensus.cc:2393] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 907cde6b822944c7a81e18d74131932a in current term 1: Already voted for candidate e1c403ce70cf42d4bf96348aa91ce00c in this term.
I20260709 13:02:27.491271 13347 raft_consensus.cc:2749] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:27.491623 13329 tablet_bootstrap.cc:492] T 4b5b67cb4af94198b56cdf18c521246a P 907cde6b822944c7a81e18d74131932a: Bootstrap starting.
I20260709 13:02:27.496879 13187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5b67cb4af94198b56cdf18c521246a" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "907cde6b822944c7a81e18d74131932a" is_pre_election: true
I20260709 13:02:27.498127 13329 tablet_bootstrap.cc:654] T 4b5b67cb4af94198b56cdf18c521246a P 907cde6b822944c7a81e18d74131932a: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:27.498492 13004 leader_election.cc:343] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:27.496397 12935 catalog_manager.cc:5697] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c reported cstate change: term changed from 0 to 1, leader changed from <none> to e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:27.505286 13038 raft_consensus.cc:2468] T 9728ccfd1f9541e5a2850596e2a6d4ca P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 1.
I20260709 13:02:27.506842 13151 leader_election.cc:304] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, 907cde6b822944c7a81e18d74131932a; no voters: e1c403ce70cf42d4bf96348aa91ce00c
I20260709 13:02:27.507726 13343 raft_consensus.cc:2804] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:27.508248 13343 raft_consensus.cc:697] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Becoming Leader. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Running, Role: LEADER
I20260709 13:02:27.509203 13343 consensus_queue.cc:237] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.511395 13329 tablet_bootstrap.cc:492] T 4b5b67cb4af94198b56cdf18c521246a P 907cde6b822944c7a81e18d74131932a: No bootstrap required, opened a new log
I20260709 13:02:27.511386 13327 raft_consensus.cc:515] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.512073 13329 ts_tablet_manager.cc:1403] T 4b5b67cb4af94198b56cdf18c521246a P 907cde6b822944c7a81e18d74131932a: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.000s
I20260709 13:02:27.512648 13112 raft_consensus.cc:2468] T e22c440bef7646da85bb451d84f19072 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 1.
I20260709 13:02:27.514086 13154 leader_election.cc:304] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 907cde6b822944c7a81e18d74131932a, e1c403ce70cf42d4bf96348aa91ce00c; no voters: 329c44a887e5438d8d4d7b4b6e2fac58
I20260709 13:02:27.514948 13260 raft_consensus.cc:2804] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:27.514842 13114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5b67cb4af94198b56cdf18c521246a" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
I20260709 13:02:27.516075 13114 raft_consensus.cc:3060] T 4b5b67cb4af94198b56cdf18c521246a P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.522349 13187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5b67cb4af94198b56cdf18c521246a" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "907cde6b822944c7a81e18d74131932a"
W20260709 13:02:27.524050 13004 leader_election.cc:343] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:27.524899 13327 leader_election.cc:290] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 1 election: Requested vote from peers e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:27.525832 13329 raft_consensus.cc:359] T 4b5b67cb4af94198b56cdf18c521246a P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.528324 13329 raft_consensus.cc:385] T 4b5b67cb4af94198b56cdf18c521246a P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.527458 13114 raft_consensus.cc:2468] T 4b5b67cb4af94198b56cdf18c521246a P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 329c44a887e5438d8d4d7b4b6e2fac58 in term 1.
I20260709 13:02:27.530990 13005 leader_election.cc:304] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, e1c403ce70cf42d4bf96348aa91ce00c; no voters: 907cde6b822944c7a81e18d74131932a
I20260709 13:02:27.532011 13327 raft_consensus.cc:2804] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:27.532744 13327 raft_consensus.cc:697] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 LEADER]: Becoming Leader. State: Replica: 329c44a887e5438d8d4d7b4b6e2fac58, State: Running, Role: LEADER
I20260709 13:02:27.533727 13327 consensus_queue.cc:237] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.535023 13260 raft_consensus.cc:697] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Becoming Leader. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Running, Role: LEADER
I20260709 13:02:27.528805 13329 raft_consensus.cc:740] T 4b5b67cb4af94198b56cdf18c521246a P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.536513 13260 consensus_queue.cc:237] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.536635 13329 consensus_queue.cc:260] T 4b5b67cb4af94198b56cdf18c521246a P 907cde6b822944c7a81e18d74131932a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.538877 13329 ts_tablet_manager.cc:1434] T 4b5b67cb4af94198b56cdf18c521246a P 907cde6b822944c7a81e18d74131932a: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:02:27.539202 12935 catalog_manager.cc:5697] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a reported cstate change: term changed from 0 to 1, leader changed from <none> to 907cde6b822944c7a81e18d74131932a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "907cde6b822944c7a81e18d74131932a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:27.546784 13327 raft_consensus.cc:493] T 93c035ed1907476a96662577ef9fae52 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.547362 13327 raft_consensus.cc:515] T 93c035ed1907476a96662577ef9fae52 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.549640 12934 catalog_manager.cc:5697] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:27.550316 13114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c035ed1907476a96662577ef9fae52" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" is_pre_election: true
I20260709 13:02:27.551024 13114 raft_consensus.cc:2468] T 93c035ed1907476a96662577ef9fae52 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 329c44a887e5438d8d4d7b4b6e2fac58 in term 0.
I20260709 13:02:27.551275 13187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c035ed1907476a96662577ef9fae52" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "907cde6b822944c7a81e18d74131932a" is_pre_election: true
I20260709 13:02:27.551952 13187 raft_consensus.cc:2468] T 93c035ed1907476a96662577ef9fae52 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 329c44a887e5438d8d4d7b4b6e2fac58 in term 0.
I20260709 13:02:27.549575 13327 leader_election.cc:290] T 93c035ed1907476a96662577ef9fae52 P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:27.553207 13004 leader_election.cc:304] T 93c035ed1907476a96662577ef9fae52 P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, 907cde6b822944c7a81e18d74131932a; no voters: 
I20260709 13:02:27.554000 13327 raft_consensus.cc:2804] T 93c035ed1907476a96662577ef9fae52 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:27.554402 13327 raft_consensus.cc:493] T 93c035ed1907476a96662577ef9fae52 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.556051 13327 raft_consensus.cc:3060] T 93c035ed1907476a96662577ef9fae52 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.559444 12935 catalog_manager.cc:5697] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a reported cstate change: term changed from 0 to 1, leader changed from <none> to 907cde6b822944c7a81e18d74131932a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "907cde6b822944c7a81e18d74131932a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:27.561794 13327 raft_consensus.cc:515] T 93c035ed1907476a96662577ef9fae52 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.563604 13327 leader_election.cc:290] T 93c035ed1907476a96662577ef9fae52 P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 1 election: Requested vote from peers e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:27.564343 13114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c035ed1907476a96662577ef9fae52" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
I20260709 13:02:27.564714 13260 raft_consensus.cc:493] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.565055 13114 raft_consensus.cc:3060] T 93c035ed1907476a96662577ef9fae52 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.564900 13187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93c035ed1907476a96662577ef9fae52" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "907cde6b822944c7a81e18d74131932a"
I20260709 13:02:27.566206 13187 raft_consensus.cc:3060] T 93c035ed1907476a96662577ef9fae52 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.565515 13260 raft_consensus.cc:515] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.569684 13038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ccea3721c9444538cd1d7911a5b83a7" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" is_pre_election: true
I20260709 13:02:27.570415 13038 raft_consensus.cc:2468] T 1ccea3721c9444538cd1d7911a5b83a7 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 0.
I20260709 13:02:27.572008 13151 leader_election.cc:304] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, 907cde6b822944c7a81e18d74131932a; no voters: 
I20260709 13:02:27.572827 13343 raft_consensus.cc:2804] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:27.573215 13343 raft_consensus.cc:493] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.573516 13260 leader_election.cc:290] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599)
I20260709 13:02:27.573575 13343 raft_consensus.cc:3060] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.574117 13112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ccea3721c9444538cd1d7911a5b83a7" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" is_pre_election: true
I20260709 13:02:27.574869 13112 raft_consensus.cc:2468] T 1ccea3721c9444538cd1d7911a5b83a7 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 0.
I20260709 13:02:27.576452 13187 raft_consensus.cc:2468] T 93c035ed1907476a96662577ef9fae52 P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 329c44a887e5438d8d4d7b4b6e2fac58 in term 1.
I20260709 13:02:27.577524 13114 raft_consensus.cc:2468] T 93c035ed1907476a96662577ef9fae52 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 329c44a887e5438d8d4d7b4b6e2fac58 in term 1.
I20260709 13:02:27.577903 13004 leader_election.cc:304] T 93c035ed1907476a96662577ef9fae52 P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, 907cde6b822944c7a81e18d74131932a; no voters: 
I20260709 13:02:27.578857 13327 raft_consensus.cc:2804] T 93c035ed1907476a96662577ef9fae52 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:27.579516 13327 raft_consensus.cc:697] T 93c035ed1907476a96662577ef9fae52 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 LEADER]: Becoming Leader. State: Replica: 329c44a887e5438d8d4d7b4b6e2fac58, State: Running, Role: LEADER
I20260709 13:02:27.579918 13343 raft_consensus.cc:515] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.580247 13327 consensus_queue.cc:237] T 93c035ed1907476a96662577ef9fae52 P 329c44a887e5438d8d4d7b4b6e2fac58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.581809 13343 leader_election.cc:290] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 election: Requested vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599)
I20260709 13:02:27.582731 13038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ccea3721c9444538cd1d7911a5b83a7" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
I20260709 13:02:27.582938 13114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ccea3721c9444538cd1d7911a5b83a7" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
I20260709 13:02:27.583328 13038 raft_consensus.cc:3060] T 1ccea3721c9444538cd1d7911a5b83a7 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.583685 13114 raft_consensus.cc:3060] T 1ccea3721c9444538cd1d7911a5b83a7 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.590035 13038 raft_consensus.cc:2468] T 1ccea3721c9444538cd1d7911a5b83a7 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 1.
I20260709 13:02:27.590669 13114 raft_consensus.cc:2468] T 1ccea3721c9444538cd1d7911a5b83a7 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 1.
I20260709 13:02:27.590446 12935 catalog_manager.cc:5697] T 93c035ed1907476a96662577ef9fae52 P 329c44a887e5438d8d4d7b4b6e2fac58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:27.591578 13151 leader_election.cc:304] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, 907cde6b822944c7a81e18d74131932a; no voters: 
I20260709 13:02:27.592299 13343 raft_consensus.cc:2804] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:27.592788 13343 raft_consensus.cc:697] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Becoming Leader. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Running, Role: LEADER
I20260709 13:02:27.593621 13343 consensus_queue.cc:237] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.601444 12935 catalog_manager.cc:5697] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a reported cstate change: term changed from 0 to 1, leader changed from <none> to 907cde6b822944c7a81e18d74131932a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "907cde6b822944c7a81e18d74131932a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:27.610107 13327 raft_consensus.cc:493] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.610631 13327 raft_consensus.cc:515] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.612529 13327 leader_election.cc:290] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:27.613333 13114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c644e2de35045e88e8f1dd90bc75313" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" is_pre_election: true
I20260709 13:02:27.613726 13187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c644e2de35045e88e8f1dd90bc75313" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "907cde6b822944c7a81e18d74131932a" is_pre_election: true
I20260709 13:02:27.614092 13114 raft_consensus.cc:2468] T 8c644e2de35045e88e8f1dd90bc75313 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 329c44a887e5438d8d4d7b4b6e2fac58 in term 0.
I20260709 13:02:27.614385 13187 raft_consensus.cc:2468] T 8c644e2de35045e88e8f1dd90bc75313 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 329c44a887e5438d8d4d7b4b6e2fac58 in term 0.
I20260709 13:02:27.615247 13005 leader_election.cc:304] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, e1c403ce70cf42d4bf96348aa91ce00c; no voters: 
I20260709 13:02:27.615936 13327 raft_consensus.cc:2804] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:27.616250 13327 raft_consensus.cc:493] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.616529 13327 raft_consensus.cc:3060] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.621485 13327 raft_consensus.cc:515] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.623122 13327 leader_election.cc:290] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 1 election: Requested vote from peers e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:27.624083 13114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c644e2de35045e88e8f1dd90bc75313" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
I20260709 13:02:27.624230 13187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c644e2de35045e88e8f1dd90bc75313" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "907cde6b822944c7a81e18d74131932a"
I20260709 13:02:27.624739 13114 raft_consensus.cc:3060] T 8c644e2de35045e88e8f1dd90bc75313 P e1c403ce70cf42d4bf96348aa91ce00c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.624938 13187 raft_consensus.cc:3060] T 8c644e2de35045e88e8f1dd90bc75313 P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.631448 13114 raft_consensus.cc:2468] T 8c644e2de35045e88e8f1dd90bc75313 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 329c44a887e5438d8d4d7b4b6e2fac58 in term 1.
I20260709 13:02:27.633530 13005 leader_election.cc:304] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, e1c403ce70cf42d4bf96348aa91ce00c; no voters: 
I20260709 13:02:27.633777 13187 raft_consensus.cc:2468] T 8c644e2de35045e88e8f1dd90bc75313 P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 329c44a887e5438d8d4d7b4b6e2fac58 in term 1.
I20260709 13:02:27.634435 13327 raft_consensus.cc:2804] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:27.634991 13327 raft_consensus.cc:697] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 LEADER]: Becoming Leader. State: Replica: 329c44a887e5438d8d4d7b4b6e2fac58, State: Running, Role: LEADER
I20260709 13:02:27.635774 13327 consensus_queue.cc:237] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.637302 13343 raft_consensus.cc:493] T 4b5b67cb4af94198b56cdf18c521246a P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.637853 13343 raft_consensus.cc:515] T 4b5b67cb4af94198b56cdf18c521246a P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.641036 13038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5b67cb4af94198b56cdf18c521246a" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" is_pre_election: true
I20260709 13:02:27.641314 13343 leader_election.cc:290] T 4b5b67cb4af94198b56cdf18c521246a P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599)
I20260709 13:02:27.641036 13114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5b67cb4af94198b56cdf18c521246a" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" is_pre_election: true
I20260709 13:02:27.642248 13114 raft_consensus.cc:2393] T 4b5b67cb4af94198b56cdf18c521246a P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 907cde6b822944c7a81e18d74131932a in current term 1: Already voted for candidate 329c44a887e5438d8d4d7b4b6e2fac58 in this term.
I20260709 13:02:27.643234 13154 leader_election.cc:304] T 4b5b67cb4af94198b56cdf18c521246a P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 907cde6b822944c7a81e18d74131932a; no voters: 329c44a887e5438d8d4d7b4b6e2fac58, e1c403ce70cf42d4bf96348aa91ce00c
I20260709 13:02:27.643909 13343 raft_consensus.cc:3060] T 4b5b67cb4af94198b56cdf18c521246a P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.644586 12935 catalog_manager.cc:5697] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:27.650094 13343 raft_consensus.cc:2749] T 4b5b67cb4af94198b56cdf18c521246a P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:27.743873 13114 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e1ace06c24e420e8597846b56cc0c79"
dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
mode: GRACEFUL
new_leader_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
 from {username='slave'} at 127.0.0.1:54434
I20260709 13:02:27.744379 13114 raft_consensus.cc:606] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 LEADER]: Received request to transfer leadership to TS 329c44a887e5438d8d4d7b4b6e2fac58
I20260709 13:02:27.760156 13187 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9728ccfd1f9541e5a2850596e2a6d4ca"
dest_uuid: "907cde6b822944c7a81e18d74131932a"
mode: GRACEFUL
new_leader_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
 from {username='slave'} at 127.0.0.1:53966
I20260709 13:02:27.760680 13187 raft_consensus.cc:606] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Received request to transfer leadership to TS e1c403ce70cf42d4bf96348aa91ce00c
I20260709 13:02:27.765820 13187 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ccea3721c9444538cd1d7911a5b83a7"
dest_uuid: "907cde6b822944c7a81e18d74131932a"
mode: GRACEFUL
new_leader_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
 from {username='slave'} at 127.0.0.1:53966
I20260709 13:02:27.766331 13187 raft_consensus.cc:606] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Received request to transfer leadership to TS e1c403ce70cf42d4bf96348aa91ce00c
I20260709 13:02:27.771950 13187 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "377900a1b7524ed298bea187f145147c"
dest_uuid: "907cde6b822944c7a81e18d74131932a"
mode: GRACEFUL
new_leader_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
 from {username='slave'} at 127.0.0.1:53966
I20260709 13:02:27.772497 13187 raft_consensus.cc:606] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Received request to transfer leadership to TS e1c403ce70cf42d4bf96348aa91ce00c
I20260709 13:02:27.803911 13345 consensus_queue.cc:1048] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c [LEADER]: Connected to new peer: Peer: permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:27.811915 13187 raft_consensus.cc:3060] T d47cdf8b75a649febde90f19de509dbc P 907cde6b822944c7a81e18d74131932a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.823050 13347 consensus_queue.cc:1048] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c [LEADER]: Connected to new peer: Peer: permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:27.865587 13343 consensus_queue.cc:1048] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:27.872522 13260 raft_consensus.cc:993] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a: : Instructing follower e1c403ce70cf42d4bf96348aa91ce00c to start an election
I20260709 13:02:27.873008 13260 raft_consensus.cc:1081] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Signalling peer e1c403ce70cf42d4bf96348aa91ce00c to start an election
I20260709 13:02:27.879030 13343 consensus_queue.cc:1048] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [LEADER]: Connected to new peer: Peer: permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:27.881143 13114 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "377900a1b7524ed298bea187f145147c"
dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
 from {username='slave'} at 127.0.0.1:54420
I20260709 13:02:27.881839 13114 raft_consensus.cc:493] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:27.882310 13114 raft_consensus.cc:3060] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.892498 13114 raft_consensus.cc:515] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.895078 13114 leader_election.cc:290] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 2 election: Requested vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:27.895685 13186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377900a1b7524ed298bea187f145147c" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "907cde6b822944c7a81e18d74131932a"
I20260709 13:02:27.895298 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377900a1b7524ed298bea187f145147c" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
I20260709 13:02:27.896523 13186 raft_consensus.cc:3055] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:27.896651 13035 raft_consensus.cc:3060] T 377900a1b7524ed298bea187f145147c P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.896943 13186 raft_consensus.cc:740] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Running, Role: LEADER
I20260709 13:02:27.898030 13186 consensus_queue.cc:260] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.899531 13186 raft_consensus.cc:3060] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.904908 13035 raft_consensus.cc:2468] T 377900a1b7524ed298bea187f145147c P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1c403ce70cf42d4bf96348aa91ce00c in term 2.
I20260709 13:02:27.906348 13077 leader_election.cc:304] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, e1c403ce70cf42d4bf96348aa91ce00c; no voters: 
I20260709 13:02:27.907223 13347 raft_consensus.cc:2804] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:27.907310 13186 raft_consensus.cc:2468] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1c403ce70cf42d4bf96348aa91ce00c in term 2.
I20260709 13:02:27.907876 13347 raft_consensus.cc:697] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c [term 2 LEADER]: Becoming Leader. State: Replica: e1c403ce70cf42d4bf96348aa91ce00c, State: Running, Role: LEADER
I20260709 13:02:27.908449 13345 consensus_queue.cc:1048] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c [LEADER]: Connected to new peer: Peer: permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:27.908865 13347 consensus_queue.cc:237] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.914965 13343 consensus_queue.cc:1048] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:27.918721 12935 catalog_manager.cc:5697] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c reported cstate change: term changed from 1 to 2, leader changed from 907cde6b822944c7a81e18d74131932a (127.0.107.195) to e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:27.926890 13345 consensus_queue.cc:1048] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c [LEADER]: Connected to new peer: Peer: permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:27.928799 13234 raft_consensus.cc:493] T e22c440bef7646da85bb451d84f19072 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.929440 13234 raft_consensus.cc:515] T e22c440bef7646da85bb451d84f19072 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.931681 13234 leader_election.cc:290] T e22c440bef7646da85bb451d84f19072 P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:27.933518 13187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c440bef7646da85bb451d84f19072" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "907cde6b822944c7a81e18d74131932a" is_pre_election: true
I20260709 13:02:27.936753 13343 raft_consensus.cc:993] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a: : Instructing follower e1c403ce70cf42d4bf96348aa91ce00c to start an election
I20260709 13:02:27.938093 13114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22c440bef7646da85bb451d84f19072" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" is_pre_election: true
I20260709 13:02:27.939092 13367 raft_consensus.cc:1081] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Signalling peer e1c403ce70cf42d4bf96348aa91ce00c to start an election
I20260709 13:02:27.939584 13114 raft_consensus.cc:2393] T e22c440bef7646da85bb451d84f19072 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 329c44a887e5438d8d4d7b4b6e2fac58 in current term 1: Already voted for candidate 907cde6b822944c7a81e18d74131932a in this term.
I20260709 13:02:27.943609 13005 leader_election.cc:304] T e22c440bef7646da85bb451d84f19072 P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58; no voters: 907cde6b822944c7a81e18d74131932a, e1c403ce70cf42d4bf96348aa91ce00c
I20260709 13:02:27.945545 13234 raft_consensus.cc:3060] T e22c440bef7646da85bb451d84f19072 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.948282 13114 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9728ccfd1f9541e5a2850596e2a6d4ca"
dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
 from {username='slave'} at 127.0.0.1:54420
I20260709 13:02:27.950515 13114 raft_consensus.cc:493] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:27.950991 13114 raft_consensus.cc:3060] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.953361 13234 raft_consensus.cc:2749] T e22c440bef7646da85bb451d84f19072 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:27.951081 13260 consensus_queue.cc:1048] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [LEADER]: Connected to new peer: Peer: permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:02:27.955032 13345 raft_consensus.cc:993] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c: : Instructing follower 329c44a887e5438d8d4d7b4b6e2fac58 to start an election
I20260709 13:02:27.955547 13345 raft_consensus.cc:1081] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 LEADER]: Signalling peer 329c44a887e5438d8d4d7b4b6e2fac58 to start an election
I20260709 13:02:27.957350 13038 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e1ace06c24e420e8597846b56cc0c79"
dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
 from {username='slave'} at 127.0.0.1:38552
I20260709 13:02:27.957938 13038 raft_consensus.cc:493] T 4e1ace06c24e420e8597846b56cc0c79 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:27.958374 13038 raft_consensus.cc:3060] T 4e1ace06c24e420e8597846b56cc0c79 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.961213 13114 raft_consensus.cc:515] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.964087 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9728ccfd1f9541e5a2850596e2a6d4ca" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
I20260709 13:02:27.964268 13186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9728ccfd1f9541e5a2850596e2a6d4ca" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "907cde6b822944c7a81e18d74131932a"
I20260709 13:02:27.964815 13039 raft_consensus.cc:3060] T 9728ccfd1f9541e5a2850596e2a6d4ca P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.964928 13186 raft_consensus.cc:3055] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:27.965410 13186 raft_consensus.cc:740] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Running, Role: LEADER
I20260709 13:02:27.964069 13114 leader_election.cc:290] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 2 election: Requested vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:27.966316 13186 consensus_queue.cc:260] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.967965 13186 raft_consensus.cc:3060] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.970301 13038 raft_consensus.cc:515] T 4e1ace06c24e420e8597846b56cc0c79 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.974443 13187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1ace06c24e420e8597846b56cc0c79" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "907cde6b822944c7a81e18d74131932a"
I20260709 13:02:27.975016 13187 raft_consensus.cc:3060] T 4e1ace06c24e420e8597846b56cc0c79 P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.975248 13114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1ace06c24e420e8597846b56cc0c79" candidate_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
I20260709 13:02:27.975864 13114 raft_consensus.cc:3055] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:27.976143 13114 raft_consensus.cc:740] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e1c403ce70cf42d4bf96348aa91ce00c, State: Running, Role: LEADER
I20260709 13:02:27.976884 13114 consensus_queue.cc:260] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.977896 13114 raft_consensus.cc:3060] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.978973 13038 leader_election.cc:290] T 4e1ace06c24e420e8597846b56cc0c79 P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 2 election: Requested vote from peers e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:27.981837 13187 raft_consensus.cc:2468] T 4e1ace06c24e420e8597846b56cc0c79 P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 329c44a887e5438d8d4d7b4b6e2fac58 in term 2.
I20260709 13:02:27.982295 13039 raft_consensus.cc:2468] T 9728ccfd1f9541e5a2850596e2a6d4ca P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1c403ce70cf42d4bf96348aa91ce00c in term 2.
I20260709 13:02:27.974989 13186 raft_consensus.cc:2468] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1c403ce70cf42d4bf96348aa91ce00c in term 2.
I20260709 13:02:27.982915 13004 leader_election.cc:304] T 4e1ace06c24e420e8597846b56cc0c79 P 329c44a887e5438d8d4d7b4b6e2fac58 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, 907cde6b822944c7a81e18d74131932a; no voters: 
I20260709 13:02:27.984180 13234 raft_consensus.cc:2804] T 4e1ace06c24e420e8597846b56cc0c79 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:27.984277 13079 leader_election.cc:304] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 907cde6b822944c7a81e18d74131932a, e1c403ce70cf42d4bf96348aa91ce00c; no voters: 
I20260709 13:02:27.984655 13114 raft_consensus.cc:2468] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 329c44a887e5438d8d4d7b4b6e2fac58 in term 2.
I20260709 13:02:27.985621 13359 raft_consensus.cc:2804] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:27.984722 13234 raft_consensus.cc:697] T 4e1ace06c24e420e8597846b56cc0c79 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 LEADER]: Becoming Leader. State: Replica: 329c44a887e5438d8d4d7b4b6e2fac58, State: Running, Role: LEADER
I20260709 13:02:27.986079 13359 raft_consensus.cc:697] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [term 2 LEADER]: Becoming Leader. State: Replica: e1c403ce70cf42d4bf96348aa91ce00c, State: Running, Role: LEADER
I20260709 13:02:27.986816 13234 consensus_queue.cc:237] T 4e1ace06c24e420e8597846b56cc0c79 P 329c44a887e5438d8d4d7b4b6e2fac58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.987552 13359 consensus_queue.cc:237] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:27.996716 12934 catalog_manager.cc:5697] T 4e1ace06c24e420e8597846b56cc0c79 P 329c44a887e5438d8d4d7b4b6e2fac58 reported cstate change: term changed from 1 to 2, leader changed from e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194) to 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:27.997299 12935 catalog_manager.cc:5697] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c reported cstate change: term changed from 1 to 2, leader changed from 907cde6b822944c7a81e18d74131932a (127.0.107.195) to e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:27.998044 13367 consensus_queue.cc:1048] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a [LEADER]: Connected to new peer: Peer: permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:28.000914 13234 consensus_queue.cc:1048] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:28.014953 13343 consensus_queue.cc:1048] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:28.037987 13390 consensus_queue.cc:1048] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:28.052904 13234 consensus_queue.cc:1048] T 93c035ed1907476a96662577ef9fae52 P 329c44a887e5438d8d4d7b4b6e2fac58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:28.069288 13392 consensus_queue.cc:1048] T 93c035ed1907476a96662577ef9fae52 P 329c44a887e5438d8d4d7b4b6e2fac58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:28.072795 13260 consensus_queue.cc:1048] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:28.084623 13343 raft_consensus.cc:993] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a: : Instructing follower e1c403ce70cf42d4bf96348aa91ce00c to start an election
I20260709 13:02:28.085105 13343 raft_consensus.cc:1081] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Signalling peer e1c403ce70cf42d4bf96348aa91ce00c to start an election
I20260709 13:02:28.086625 13114 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ccea3721c9444538cd1d7911a5b83a7"
dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
 from {username='slave'} at 127.0.0.1:54420
I20260709 13:02:28.087119 13114 raft_consensus.cc:493] T 1ccea3721c9444538cd1d7911a5b83a7 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:28.087495 13114 raft_consensus.cc:3060] T 1ccea3721c9444538cd1d7911a5b83a7 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:28.092197 13390 consensus_queue.cc:1048] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:28.092677 13260 consensus_queue.cc:1048] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a [LEADER]: Connected to new peer: Peer: permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:28.095373 13114 raft_consensus.cc:515] T 1ccea3721c9444538cd1d7911a5b83a7 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:28.096823 13112 raft_consensus.cc:1240] T 1ccea3721c9444538cd1d7911a5b83a7 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Rejecting Update request from peer 907cde6b822944c7a81e18d74131932a for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:28.097803 13114 leader_election.cc:290] T 1ccea3721c9444538cd1d7911a5b83a7 P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 2 election: Requested vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), 907cde6b822944c7a81e18d74131932a (127.0.107.195:38535)
I20260709 13:02:28.098217 13038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ccea3721c9444538cd1d7911a5b83a7" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
I20260709 13:02:28.101339 13186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ccea3721c9444538cd1d7911a5b83a7" candidate_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "907cde6b822944c7a81e18d74131932a"
I20260709 13:02:28.101863 13260 consensus_queue.cc:1059] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:28.102653 13186 raft_consensus.cc:3055] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:28.103024 13186 raft_consensus.cc:740] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Running, Role: LEADER
I20260709 13:02:28.103971 13186 consensus_queue.cc:260] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:28.105443 13186 raft_consensus.cc:3060] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:28.113904 13186 raft_consensus.cc:2468] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1c403ce70cf42d4bf96348aa91ce00c in term 2.
W20260709 13:02:28.114434 13367 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:02:28.116204 13079 leader_election.cc:304] T 1ccea3721c9444538cd1d7911a5b83a7 P e1c403ce70cf42d4bf96348aa91ce00c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 907cde6b822944c7a81e18d74131932a, e1c403ce70cf42d4bf96348aa91ce00c; no voters: 329c44a887e5438d8d4d7b4b6e2fac58
I20260709 13:02:28.117180 13327 consensus_queue.cc:1048] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:28.117641 13359 raft_consensus.cc:2804] T 1ccea3721c9444538cd1d7911a5b83a7 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:28.118209 13359 raft_consensus.cc:697] T 1ccea3721c9444538cd1d7911a5b83a7 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 LEADER]: Becoming Leader. State: Replica: e1c403ce70cf42d4bf96348aa91ce00c, State: Running, Role: LEADER
I20260709 13:02:28.119071 13359 consensus_queue.cc:237] T 1ccea3721c9444538cd1d7911a5b83a7 P e1c403ce70cf42d4bf96348aa91ce00c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:28.131875 12937 catalog_manager.cc:5697] T 1ccea3721c9444538cd1d7911a5b83a7 P e1c403ce70cf42d4bf96348aa91ce00c reported cstate change: term changed from 1 to 2, leader changed from 907cde6b822944c7a81e18d74131932a (127.0.107.195) to e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194). New cstate: current_term: 2 leader_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:28.369030 13187 raft_consensus.cc:1275] T 4e1ace06c24e420e8597846b56cc0c79 P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Refusing update from remote peer 329c44a887e5438d8d4d7b4b6e2fac58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:28.370836 13111 raft_consensus.cc:1275] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Refusing update from remote peer 329c44a887e5438d8d4d7b4b6e2fac58: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:28.373029 13327 consensus_queue.cc:1048] T 4e1ace06c24e420e8597846b56cc0c79 P 329c44a887e5438d8d4d7b4b6e2fac58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:02:28.375880 13234 consensus_queue.cc:1048] T 4e1ace06c24e420e8597846b56cc0c79 P 329c44a887e5438d8d4d7b4b6e2fac58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:28.377852 13039 raft_consensus.cc:1275] T 9728ccfd1f9541e5a2850596e2a6d4ca P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Refusing update from remote peer e1c403ce70cf42d4bf96348aa91ce00c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:28.380338 13347 consensus_queue.cc:1048] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [LEADER]: Connected to new peer: Peer: permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:28.404767 13186 raft_consensus.cc:1275] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Refusing update from remote peer e1c403ce70cf42d4bf96348aa91ce00c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:28.412016 13345 consensus_queue.cc:1048] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [LEADER]: Connected to new peer: Peer: permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:28.455088 13186 raft_consensus.cc:1275] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Refusing update from remote peer e1c403ce70cf42d4bf96348aa91ce00c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:28.456344 13347 consensus_queue.cc:1048] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c [LEADER]: Connected to new peer: Peer: permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:28.467816 13039 raft_consensus.cc:1275] T 377900a1b7524ed298bea187f145147c P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Refusing update from remote peer e1c403ce70cf42d4bf96348aa91ce00c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:28.470317 13347 consensus_queue.cc:1048] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c [LEADER]: Connected to new peer: Peer: permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:28.543984 13186 raft_consensus.cc:1275] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Refusing update from remote peer e1c403ce70cf42d4bf96348aa91ce00c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:28.545482 13347 consensus_queue.cc:1048] T 1ccea3721c9444538cd1d7911a5b83a7 P e1c403ce70cf42d4bf96348aa91ce00c [LEADER]: Connected to new peer: Peer: permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:28.557957 13039 raft_consensus.cc:3060] T 1ccea3721c9444538cd1d7911a5b83a7 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:28.568219 13039 raft_consensus.cc:1275] T 1ccea3721c9444538cd1d7911a5b83a7 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Refusing update from remote peer e1c403ce70cf42d4bf96348aa91ce00c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:28.569793 13402 consensus_queue.cc:1048] T 1ccea3721c9444538cd1d7911a5b83a7 P e1c403ce70cf42d4bf96348aa91ce00c [LEADER]: Connected to new peer: Peer: permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:30.779006 12934 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57936:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:02:30.803638 12934 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57936:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:02:30.881721 13428 tablet.cc:1724] T 93c035ed1907476a96662577ef9fae52 P e1c403ce70cf42d4bf96348aa91ce00c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:30.895638   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:02:31.002170 13005 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:34599, user_credentials={real_user=slave}} blocked reactor thread for 97722us
I20260709 13:02:31.077858 13444 tablet.cc:1724] T 4e1ace06c24e420e8597846b56cc0c79 P 907cde6b822944c7a81e18d74131932a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:31.057344 13442 tablet.cc:1724] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:02:31.114116 13005 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:34599, user_credentials={real_user=slave}} blocked reactor thread for 66168.2us
I20260709 13:02:31.054277 13433 tablet.cc:1724] T 4e1ace06c24e420e8597846b56cc0c79 P 329c44a887e5438d8d4d7b4b6e2fac58: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:31.157138 13443 tablet.cc:1724] T 93c035ed1907476a96662577ef9fae52 P 329c44a887e5438d8d4d7b4b6e2fac58: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:31.177886 13460 tablet.cc:1724] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:31.175232 13463 tablet.cc:1724] T 8c644e2de35045e88e8f1dd90bc75313 P 907cde6b822944c7a81e18d74131932a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:31.222611 13466 tablet.cc:1724] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:31.230427 13456 tablet.cc:1724] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:31.217064 13462 tablet.cc:1724] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:31.255765 13428 tablet.cc:1724] T 8c644e2de35045e88e8f1dd90bc75313 P e1c403ce70cf42d4bf96348aa91ce00c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:31.300716 13444 tablet.cc:1724] T 4b5b67cb4af94198b56cdf18c521246a P 907cde6b822944c7a81e18d74131932a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:31.300716 13428 tablet.cc:1724] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:31.343745 13443 tablet.cc:1724] T d47cdf8b75a649febde90f19de509dbc P 329c44a887e5438d8d4d7b4b6e2fac58: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:31.337095 13473 tablet.cc:1724] T 1ccea3721c9444538cd1d7911a5b83a7 P e1c403ce70cf42d4bf96348aa91ce00c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:02:31.369468 13468 log.cc:927] Time spent T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:02:31.375998 13466 tablet.cc:1724] T 9728ccfd1f9541e5a2850596e2a6d4ca P 329c44a887e5438d8d4d7b4b6e2fac58: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:31.377671 13037 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c644e2de35045e88e8f1dd90bc75313"
dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
mode: GRACEFUL
new_leader_uuid: "907cde6b822944c7a81e18d74131932a"
 from {username='slave'} at 127.0.0.1:34850
I20260709 13:02:31.378545 13037 raft_consensus.cc:606] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 LEADER]: Received request to transfer leadership to TS 907cde6b822944c7a81e18d74131932a
I20260709 13:02:31.386258 13442 tablet.cc:1724] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:31.381029 13433 tablet.cc:1724] T 1ccea3721c9444538cd1d7911a5b83a7 P 329c44a887e5438d8d4d7b4b6e2fac58: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:31.388388 13443 tablet.cc:1724] T 377900a1b7524ed298bea187f145147c P 329c44a887e5438d8d4d7b4b6e2fac58: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:31.406322 13462 tablet.cc:1724] T d47cdf8b75a649febde90f19de509dbc P 907cde6b822944c7a81e18d74131932a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:31.407485 13473 tablet.cc:1724] T e22c440bef7646da85bb451d84f19072 P e1c403ce70cf42d4bf96348aa91ce00c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:31.338611 13474 tablet.cc:1724] T 93c035ed1907476a96662577ef9fae52 P 907cde6b822944c7a81e18d74131932a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:31.424968 13463 tablet.cc:1724] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:31.427920 13444 tablet.cc:1724] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:31.427997 13473 tablet.cc:1724] T 4b5b67cb4af94198b56cdf18c521246a P e1c403ce70cf42d4bf96348aa91ce00c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:31.416189 13466 tablet.cc:1724] T e22c440bef7646da85bb451d84f19072 P 329c44a887e5438d8d4d7b4b6e2fac58: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:31.446655 13444 tablet.cc:1724] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:31.478451 13111 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9728ccfd1f9541e5a2850596e2a6d4ca"
dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
mode: GRACEFUL
new_leader_uuid: "907cde6b822944c7a81e18d74131932a"
 from {username='slave'} at 127.0.0.1:34004
I20260709 13:02:31.479173 13111 raft_consensus.cc:606] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [term 2 LEADER]: Received request to transfer leadership to TS 907cde6b822944c7a81e18d74131932a
I20260709 13:02:31.481242   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:02:31.481923   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:31.489372 12937 catalog_manager.cc:6242] T 00000000000000000000000000000000 P f2f50cc530224c83bbc4c38881a2fb0b: soft_deleted_table [id=975c3adad680462c995cefe32ad9a1a9] alter complete (version 1)
I20260709 13:02:31.496513 13111 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c8e031f412048f09177a12e10d44d21"
dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
mode: GRACEFUL
new_leader_uuid: "907cde6b822944c7a81e18d74131932a"
 from {username='slave'} at 127.0.0.1:34004
I20260709 13:02:31.497200 13111 raft_consensus.cc:606] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 LEADER]: Received request to transfer leadership to TS 907cde6b822944c7a81e18d74131932a
I20260709 13:02:31.500846 13035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3d1a30f18f441fcb2e63ba9dd524989"
dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
mode: GRACEFUL
new_leader_uuid: "907cde6b822944c7a81e18d74131932a"
 from {username='slave'} at 127.0.0.1:34850
I20260709 13:02:31.501443 13035 raft_consensus.cc:606] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 LEADER]: Received request to transfer leadership to TS 907cde6b822944c7a81e18d74131932a
I20260709 13:02:31.502688   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:31.503149   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:31.618168 13452 raft_consensus.cc:993] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58: : Instructing follower 907cde6b822944c7a81e18d74131932a to start an election
I20260709 13:02:31.618824 13430 raft_consensus.cc:1081] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 LEADER]: Signalling peer 907cde6b822944c7a81e18d74131932a to start an election
I20260709 13:02:31.620787 13183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3d1a30f18f441fcb2e63ba9dd524989"
dest_uuid: "907cde6b822944c7a81e18d74131932a"
 from {username='slave'} at 127.0.0.1:53950
I20260709 13:02:31.621457 13183 raft_consensus.cc:493] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:31.621817 13183 raft_consensus.cc:3060] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:31.627542 13183 raft_consensus.cc:515] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:31.629238 13183 leader_election.cc:290] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 3 election: Requested vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599)
I20260709 13:02:31.630234 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d1a30f18f441fcb2e63ba9dd524989" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
I20260709 13:02:31.630515 13112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3d1a30f18f441fcb2e63ba9dd524989" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
I20260709 13:02:31.630893 13035 raft_consensus.cc:3055] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:31.631075 13112 raft_consensus.cc:3060] T a3d1a30f18f441fcb2e63ba9dd524989 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:31.631203 13035 raft_consensus.cc:740] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 329c44a887e5438d8d4d7b4b6e2fac58, State: Running, Role: LEADER
I20260709 13:02:31.632109 13035 consensus_queue.cc:260] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:31.633226 13035 raft_consensus.cc:3060] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:31.637220 13112 raft_consensus.cc:2468] T a3d1a30f18f441fcb2e63ba9dd524989 P e1c403ce70cf42d4bf96348aa91ce00c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 3.
I20260709 13:02:31.639017 13154 leader_election.cc:304] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 907cde6b822944c7a81e18d74131932a, e1c403ce70cf42d4bf96348aa91ce00c; no voters: 
I20260709 13:02:31.640031 13464 raft_consensus.cc:2804] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:31.640620 13464 raft_consensus.cc:697] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [term 3 LEADER]: Becoming Leader. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Running, Role: LEADER
I20260709 13:02:31.641477 13447 raft_consensus.cc:993] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c: : Instructing follower 907cde6b822944c7a81e18d74131932a to start an election
I20260709 13:02:31.641742 13035 raft_consensus.cc:2468] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 3.
I20260709 13:02:31.641625 13464 consensus_queue.cc:237] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:31.642246 13446 raft_consensus.cc:1081] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [term 2 LEADER]: Signalling peer 907cde6b822944c7a81e18d74131932a to start an election
I20260709 13:02:31.644430 13183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9728ccfd1f9541e5a2850596e2a6d4ca"
dest_uuid: "907cde6b822944c7a81e18d74131932a"
 from {username='slave'} at 127.0.0.1:53962
I20260709 13:02:31.645078 13183 raft_consensus.cc:493] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:31.645488 13183 raft_consensus.cc:3060] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:31.651389 12934 catalog_manager.cc:5697] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a reported cstate change: term changed from 2 to 3, leader changed from 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193) to 907cde6b822944c7a81e18d74131932a (127.0.107.195). New cstate: current_term: 3 leader_uuid: "907cde6b822944c7a81e18d74131932a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:31.652287 13183 raft_consensus.cc:515] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:31.654161 13183 leader_election.cc:290] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 3 election: Requested vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599)
I20260709 13:02:31.654796 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9728ccfd1f9541e5a2850596e2a6d4ca" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
I20260709 13:02:31.655331 13112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9728ccfd1f9541e5a2850596e2a6d4ca" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
I20260709 13:02:31.655428 13035 raft_consensus.cc:3060] T 9728ccfd1f9541e5a2850596e2a6d4ca P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:31.655977 13112 raft_consensus.cc:3055] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:31.656314 13112 raft_consensus.cc:740] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e1c403ce70cf42d4bf96348aa91ce00c, State: Running, Role: LEADER
I20260709 13:02:31.657250 13112 consensus_queue.cc:260] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:31.658550 13112 raft_consensus.cc:3060] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:31.664611 13035 raft_consensus.cc:2468] T 9728ccfd1f9541e5a2850596e2a6d4ca P 329c44a887e5438d8d4d7b4b6e2fac58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 3.
I20260709 13:02:31.665572 13112 raft_consensus.cc:2468] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 3.
I20260709 13:02:31.665969 13151 leader_election.cc:304] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, 907cde6b822944c7a81e18d74131932a; no voters: 
I20260709 13:02:31.666867 13464 raft_consensus.cc:2804] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:31.667258 13464 raft_consensus.cc:697] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [term 3 LEADER]: Becoming Leader. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Running, Role: LEADER
I20260709 13:02:31.668021 13464 consensus_queue.cc:237] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:31.675274 12934 catalog_manager.cc:5697] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a reported cstate change: term changed from 2 to 3, leader changed from e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194) to 907cde6b822944c7a81e18d74131932a (127.0.107.195). New cstate: current_term: 3 leader_uuid: "907cde6b822944c7a81e18d74131932a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:31.712714 13452 raft_consensus.cc:993] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58: : Instructing follower 907cde6b822944c7a81e18d74131932a to start an election
I20260709 13:02:31.713162 13430 raft_consensus.cc:1081] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 LEADER]: Signalling peer 907cde6b822944c7a81e18d74131932a to start an election
I20260709 13:02:31.714526 13183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c644e2de35045e88e8f1dd90bc75313"
dest_uuid: "907cde6b822944c7a81e18d74131932a"
 from {username='slave'} at 127.0.0.1:53950
I20260709 13:02:31.715045 13183 raft_consensus.cc:493] T 8c644e2de35045e88e8f1dd90bc75313 P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:31.715340 13183 raft_consensus.cc:3060] T 8c644e2de35045e88e8f1dd90bc75313 P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:31.720520 13183 raft_consensus.cc:515] T 8c644e2de35045e88e8f1dd90bc75313 P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:31.722227 13183 leader_election.cc:290] T 8c644e2de35045e88e8f1dd90bc75313 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 2 election: Requested vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599)
I20260709 13:02:31.722971 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c644e2de35045e88e8f1dd90bc75313" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
I20260709 13:02:31.723429 13112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c644e2de35045e88e8f1dd90bc75313" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
I20260709 13:02:31.723664 13035 raft_consensus.cc:3055] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:31.723939 13112 raft_consensus.cc:3060] T 8c644e2de35045e88e8f1dd90bc75313 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:31.724045 13035 raft_consensus.cc:740] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 329c44a887e5438d8d4d7b4b6e2fac58, State: Running, Role: LEADER
I20260709 13:02:31.724972 13035 consensus_queue.cc:260] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:31.725968 13035 raft_consensus.cc:3060] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:31.729018 13112 raft_consensus.cc:2468] T 8c644e2de35045e88e8f1dd90bc75313 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 2.
I20260709 13:02:31.730326 13154 leader_election.cc:304] T 8c644e2de35045e88e8f1dd90bc75313 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 907cde6b822944c7a81e18d74131932a, e1c403ce70cf42d4bf96348aa91ce00c; no voters: 
I20260709 13:02:31.731048 13464 raft_consensus.cc:2804] T 8c644e2de35045e88e8f1dd90bc75313 P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:31.731424 13464 raft_consensus.cc:697] T 8c644e2de35045e88e8f1dd90bc75313 P 907cde6b822944c7a81e18d74131932a [term 2 LEADER]: Becoming Leader. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Running, Role: LEADER
I20260709 13:02:31.731619 13035 raft_consensus.cc:2468] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 2.
I20260709 13:02:31.732216 13464 consensus_queue.cc:237] T 8c644e2de35045e88e8f1dd90bc75313 P 907cde6b822944c7a81e18d74131932a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:31.738767 12934 catalog_manager.cc:5697] T 8c644e2de35045e88e8f1dd90bc75313 P 907cde6b822944c7a81e18d74131932a reported cstate change: term changed from 1 to 2, leader changed from 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193) to 907cde6b822944c7a81e18d74131932a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "907cde6b822944c7a81e18d74131932a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:31.837658 13447 raft_consensus.cc:993] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c: : Instructing follower 907cde6b822944c7a81e18d74131932a to start an election
I20260709 13:02:31.838112 13446 raft_consensus.cc:1081] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 LEADER]: Signalling peer 907cde6b822944c7a81e18d74131932a to start an election
I20260709 13:02:31.839599 13183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c8e031f412048f09177a12e10d44d21"
dest_uuid: "907cde6b822944c7a81e18d74131932a"
 from {username='slave'} at 127.0.0.1:53962
I20260709 13:02:31.840096 13183 raft_consensus.cc:493] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:31.840386 13183 raft_consensus.cc:3060] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:31.845839 13183 raft_consensus.cc:515] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:31.847640 13183 leader_election.cc:290] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 3 election: Requested vote from peers 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167), e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599)
I20260709 13:02:31.848676 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8e031f412048f09177a12e10d44d21" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "329c44a887e5438d8d4d7b4b6e2fac58"
I20260709 13:02:31.848727 13112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c8e031f412048f09177a12e10d44d21" candidate_uuid: "907cde6b822944c7a81e18d74131932a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e1c403ce70cf42d4bf96348aa91ce00c"
I20260709 13:02:31.849344 13035 raft_consensus.cc:3060] T 8c8e031f412048f09177a12e10d44d21 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:31.849383 13112 raft_consensus.cc:3055] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:31.849789 13112 raft_consensus.cc:740] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e1c403ce70cf42d4bf96348aa91ce00c, State: Running, Role: LEADER
I20260709 13:02:31.850492 13112 consensus_queue.cc:260] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:31.851651 13112 raft_consensus.cc:3060] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:31.855261 13035 raft_consensus.cc:2468] T 8c8e031f412048f09177a12e10d44d21 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 3.
I20260709 13:02:31.856284 13112 raft_consensus.cc:2468] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 907cde6b822944c7a81e18d74131932a in term 3.
I20260709 13:02:31.856426 13151 leader_election.cc:304] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 329c44a887e5438d8d4d7b4b6e2fac58, 907cde6b822944c7a81e18d74131932a; no voters: 
I20260709 13:02:31.857282 13464 raft_consensus.cc:2804] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:31.857757 13464 raft_consensus.cc:697] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [term 3 LEADER]: Becoming Leader. State: Replica: 907cde6b822944c7a81e18d74131932a, State: Running, Role: LEADER
I20260709 13:02:31.858558 13464 consensus_queue.cc:237] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } }
I20260709 13:02:31.865610 12934 catalog_manager.cc:5697] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a reported cstate change: term changed from 2 to 3, leader changed from e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194) to 907cde6b822944c7a81e18d74131932a (127.0.107.195). New cstate: current_term: 3 leader_uuid: "907cde6b822944c7a81e18d74131932a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "907cde6b822944c7a81e18d74131932a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38535 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:32.041283 13112 raft_consensus.cc:1275] T a3d1a30f18f441fcb2e63ba9dd524989 P e1c403ce70cf42d4bf96348aa91ce00c [term 3 FOLLOWER]: Refusing update from remote peer 907cde6b822944c7a81e18d74131932a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:32.042496 13464 consensus_queue.cc:1048] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:32.053284 13035 raft_consensus.cc:1275] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 3 FOLLOWER]: Refusing update from remote peer 907cde6b822944c7a81e18d74131932a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:32.054791 13464 consensus_queue.cc:1048] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [LEADER]: Connected to new peer: Peer: permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:32.079908 13112 raft_consensus.cc:1275] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [term 3 FOLLOWER]: Refusing update from remote peer 907cde6b822944c7a81e18d74131932a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:02:32.081089 13367 consensus_queue.cc:1048] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:32.090435 13035 raft_consensus.cc:1275] T 9728ccfd1f9541e5a2850596e2a6d4ca P 329c44a887e5438d8d4d7b4b6e2fac58 [term 3 FOLLOWER]: Refusing update from remote peer 907cde6b822944c7a81e18d74131932a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:02:32.092123 13464 consensus_queue.cc:1048] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [LEADER]: Connected to new peer: Peer: permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:32.267998 13035 raft_consensus.cc:1275] T 8c8e031f412048f09177a12e10d44d21 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 3 FOLLOWER]: Refusing update from remote peer 907cde6b822944c7a81e18d74131932a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:32.269218 13464 consensus_queue.cc:1048] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [LEADER]: Connected to new peer: Peer: permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:32.272606 13112 raft_consensus.cc:1275] T 8c644e2de35045e88e8f1dd90bc75313 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Refusing update from remote peer 907cde6b822944c7a81e18d74131932a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:02:32.273950 13464 consensus_queue.cc:1048] T 8c644e2de35045e88e8f1dd90bc75313 P 907cde6b822944c7a81e18d74131932a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:32.280786 13112 raft_consensus.cc:1275] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c [term 3 FOLLOWER]: Refusing update from remote peer 907cde6b822944c7a81e18d74131932a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:32.286003 13483 consensus_queue.cc:1048] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1c403ce70cf42d4bf96348aa91ce00c" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:32.286607 13035 raft_consensus.cc:1275] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Refusing update from remote peer 907cde6b822944c7a81e18d74131932a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:02:32.288358 13367 consensus_queue.cc:1048] T 8c644e2de35045e88e8f1dd90bc75313 P 907cde6b822944c7a81e18d74131932a [LEADER]: Connected to new peer: Peer: permanent_uuid: "329c44a887e5438d8d4d7b4b6e2fac58" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:32.561391   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:02:32.567252   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:02:32.567759   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:32.572813   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:02:32.573191   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:33.603984   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:02:33.606096 13151 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
W20260709 13:02:33.613911 13151 consensus_peers.cc:597] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a -> Peer 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167): Couldn't send request to peer 329c44a887e5438d8d4d7b4b6e2fac58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:33.619513 13151 consensus_peers.cc:597] T 6d27b2b82449490087a942a8a70295fe P 907cde6b822944c7a81e18d74131932a -> Peer 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167): Couldn't send request to peer 329c44a887e5438d8d4d7b4b6e2fac58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:33.634800   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:33.635735   431 tablet_replica.cc:333] T e22c440bef7646da85bb451d84f19072 P 329c44a887e5438d8d4d7b4b6e2fac58: stopping tablet replica
I20260709 13:02:33.636714   431 raft_consensus.cc:2243] T e22c440bef7646da85bb451d84f19072 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:33.637360   431 raft_consensus.cc:2272] T e22c440bef7646da85bb451d84f19072 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.639814   431 tablet_replica.cc:333] T 93c035ed1907476a96662577ef9fae52 P 329c44a887e5438d8d4d7b4b6e2fac58: stopping tablet replica
I20260709 13:02:33.640654   431 raft_consensus.cc:2243] T 93c035ed1907476a96662577ef9fae52 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:33.641638   431 raft_consensus.cc:2272] T 93c035ed1907476a96662577ef9fae52 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.643908   431 tablet_replica.cc:333] T 9728ccfd1f9541e5a2850596e2a6d4ca P 329c44a887e5438d8d4d7b4b6e2fac58: stopping tablet replica
I20260709 13:02:33.644742   431 raft_consensus.cc:2243] T 9728ccfd1f9541e5a2850596e2a6d4ca P 329c44a887e5438d8d4d7b4b6e2fac58 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:33.645202   431 raft_consensus.cc:2272] T 9728ccfd1f9541e5a2850596e2a6d4ca P 329c44a887e5438d8d4d7b4b6e2fac58 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.647553   431 tablet_replica.cc:333] T d47cdf8b75a649febde90f19de509dbc P 329c44a887e5438d8d4d7b4b6e2fac58: stopping tablet replica
I20260709 13:02:33.648177   431 raft_consensus.cc:2243] T d47cdf8b75a649febde90f19de509dbc P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:33.648705   431 raft_consensus.cc:2272] T d47cdf8b75a649febde90f19de509dbc P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.651082   431 tablet_replica.cc:333] T 377900a1b7524ed298bea187f145147c P 329c44a887e5438d8d4d7b4b6e2fac58: stopping tablet replica
I20260709 13:02:33.651793   431 raft_consensus.cc:2243] T 377900a1b7524ed298bea187f145147c P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:33.652310   431 raft_consensus.cc:2272] T 377900a1b7524ed298bea187f145147c P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.655002   431 tablet_replica.cc:333] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58: stopping tablet replica
I20260709 13:02:33.655898   431 raft_consensus.cc:2243] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:33.657035   431 raft_consensus.cc:2272] T 4b5b67cb4af94198b56cdf18c521246a P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.659819   431 tablet_replica.cc:333] T 16f353bc6d1847a199accd034426ec3f P 329c44a887e5438d8d4d7b4b6e2fac58: stopping tablet replica
I20260709 13:02:33.660789   431 raft_consensus.cc:2243] T 16f353bc6d1847a199accd034426ec3f P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:33.662117   431 raft_consensus.cc:2272] T 16f353bc6d1847a199accd034426ec3f P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.665515   431 tablet_replica.cc:333] T 1e1e91abc0df42e99e2956ee39413813 P 329c44a887e5438d8d4d7b4b6e2fac58: stopping tablet replica
I20260709 13:02:33.666326   431 raft_consensus.cc:2243] T 1e1e91abc0df42e99e2956ee39413813 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:33.666941   431 raft_consensus.cc:2272] T 1e1e91abc0df42e99e2956ee39413813 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.670086   431 tablet_replica.cc:333] T 44066ba5afb3439496e0ffc8c96b6536 P 329c44a887e5438d8d4d7b4b6e2fac58: stopping tablet replica
I20260709 13:02:33.670867   431 raft_consensus.cc:2243] T 44066ba5afb3439496e0ffc8c96b6536 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:33.672029   431 raft_consensus.cc:2272] T 44066ba5afb3439496e0ffc8c96b6536 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.674991   431 tablet_replica.cc:333] T 4e1ace06c24e420e8597846b56cc0c79 P 329c44a887e5438d8d4d7b4b6e2fac58: stopping tablet replica
I20260709 13:02:33.675696   431 raft_consensus.cc:2243] T 4e1ace06c24e420e8597846b56cc0c79 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:33.676765   431 raft_consensus.cc:2272] T 4e1ace06c24e420e8597846b56cc0c79 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.680416   431 tablet_replica.cc:333] T 4018c93e45734aac9b61b02e27e0ef16 P 329c44a887e5438d8d4d7b4b6e2fac58: stopping tablet replica
I20260709 13:02:33.681298   431 raft_consensus.cc:2243] T 4018c93e45734aac9b61b02e27e0ef16 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:33.682492   431 raft_consensus.cc:2272] T 4018c93e45734aac9b61b02e27e0ef16 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.685665   431 tablet_replica.cc:333] T fd119138500f4351b2f68bcc272e0780 P 329c44a887e5438d8d4d7b4b6e2fac58: stopping tablet replica
I20260709 13:02:33.686517   431 raft_consensus.cc:2243] T fd119138500f4351b2f68bcc272e0780 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:33.687675   431 raft_consensus.cc:2272] T fd119138500f4351b2f68bcc272e0780 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:33.690542 13077 consensus_peers.cc:597] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c -> Peer 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167): Couldn't send request to peer 329c44a887e5438d8d4d7b4b6e2fac58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:33.691004   431 tablet_replica.cc:333] T 8c8e031f412048f09177a12e10d44d21 P 329c44a887e5438d8d4d7b4b6e2fac58: stopping tablet replica
I20260709 13:02:33.691797   431 raft_consensus.cc:2243] T 8c8e031f412048f09177a12e10d44d21 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:33.692271   431 raft_consensus.cc:2272] T 8c8e031f412048f09177a12e10d44d21 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.694541   431 tablet_replica.cc:333] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58: stopping tablet replica
I20260709 13:02:33.695116   431 raft_consensus.cc:2243] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:33.695510   431 raft_consensus.cc:2272] T 8c644e2de35045e88e8f1dd90bc75313 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.697485   431 tablet_replica.cc:333] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58: stopping tablet replica
I20260709 13:02:33.697966   431 raft_consensus.cc:2243] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:33.698350   431 raft_consensus.cc:2272] T a3d1a30f18f441fcb2e63ba9dd524989 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.700524   431 tablet_replica.cc:333] T 1ccea3721c9444538cd1d7911a5b83a7 P 329c44a887e5438d8d4d7b4b6e2fac58: stopping tablet replica
I20260709 13:02:33.701021   431 raft_consensus.cc:2243] T 1ccea3721c9444538cd1d7911a5b83a7 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:33.701464   431 raft_consensus.cc:2272] T 1ccea3721c9444538cd1d7911a5b83a7 P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.703639   431 tablet_replica.cc:333] T 4a6e18b4b04949d39e83b2d4680ce17a P 329c44a887e5438d8d4d7b4b6e2fac58: stopping tablet replica
I20260709 13:02:33.704118   431 raft_consensus.cc:2243] T 4a6e18b4b04949d39e83b2d4680ce17a P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:33.704598   431 raft_consensus.cc:2272] T 4a6e18b4b04949d39e83b2d4680ce17a P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.706673   431 tablet_replica.cc:333] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58: stopping tablet replica
I20260709 13:02:33.707156   431 raft_consensus.cc:2243] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:33.707623   431 raft_consensus.cc:2272] T 6d27b2b82449490087a942a8a70295fe P 329c44a887e5438d8d4d7b4b6e2fac58 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:33.717592 13151 consensus_peers.cc:597] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a -> Peer 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167): Couldn't send request to peer 329c44a887e5438d8d4d7b4b6e2fac58. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:33.734663 13077 connection.cc:573] client connection to 127.0.107.193:44167 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:02:33.742151 13077 consensus_peers.cc:597] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c -> Peer 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167): Couldn't send request to peer 329c44a887e5438d8d4d7b4b6e2fac58. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:33.746901 13077 consensus_peers.cc:597] T 1ccea3721c9444538cd1d7911a5b83a7 P e1c403ce70cf42d4bf96348aa91ce00c -> Peer 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167): Couldn't send request to peer 329c44a887e5438d8d4d7b4b6e2fac58. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:33.749752   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:02:33.765441 13151 consensus_peers.cc:597] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a -> Peer 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167): Couldn't send request to peer 329c44a887e5438d8d4d7b4b6e2fac58. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:33.785918   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:02:33.811048   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:33.811714   431 tablet_replica.cc:333] T 4b5b67cb4af94198b56cdf18c521246a P e1c403ce70cf42d4bf96348aa91ce00c: stopping tablet replica
I20260709 13:02:33.812655   431 raft_consensus.cc:2243] T 4b5b67cb4af94198b56cdf18c521246a P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:33.813228   431 raft_consensus.cc:2272] T 4b5b67cb4af94198b56cdf18c521246a P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.815878   431 tablet_replica.cc:333] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c: stopping tablet replica
I20260709 13:02:33.816617   431 raft_consensus.cc:2243] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:33.817641   431 raft_consensus.cc:2272] T 377900a1b7524ed298bea187f145147c P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.819994   431 tablet_replica.cc:333] T 93c035ed1907476a96662577ef9fae52 P e1c403ce70cf42d4bf96348aa91ce00c: stopping tablet replica
I20260709 13:02:33.820676   431 raft_consensus.cc:2243] T 93c035ed1907476a96662577ef9fae52 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:33.821137   431 raft_consensus.cc:2272] T 93c035ed1907476a96662577ef9fae52 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.823065   431 tablet_replica.cc:333] T e22c440bef7646da85bb451d84f19072 P e1c403ce70cf42d4bf96348aa91ce00c: stopping tablet replica
I20260709 13:02:33.823666   431 raft_consensus.cc:2243] T e22c440bef7646da85bb451d84f19072 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:33.824080   431 raft_consensus.cc:2272] T e22c440bef7646da85bb451d84f19072 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.826243   431 tablet_replica.cc:333] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c: stopping tablet replica
I20260709 13:02:33.826980   431 raft_consensus.cc:2243] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:33.827710   431 raft_consensus.cc:2272] T d47cdf8b75a649febde90f19de509dbc P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.829699   431 tablet_replica.cc:333] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c: stopping tablet replica
I20260709 13:02:33.830222   431 raft_consensus.cc:2243] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:33.830598   431 raft_consensus.cc:2272] T 9728ccfd1f9541e5a2850596e2a6d4ca P e1c403ce70cf42d4bf96348aa91ce00c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.832594   431 tablet_replica.cc:333] T 4018c93e45734aac9b61b02e27e0ef16 P e1c403ce70cf42d4bf96348aa91ce00c: stopping tablet replica
I20260709 13:02:33.833096   431 raft_consensus.cc:2243] T 4018c93e45734aac9b61b02e27e0ef16 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:33.833695   431 raft_consensus.cc:2272] T 4018c93e45734aac9b61b02e27e0ef16 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.835741   431 tablet_replica.cc:333] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c: stopping tablet replica
I20260709 13:02:33.836246   431 raft_consensus.cc:2243] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:33.837059   431 raft_consensus.cc:2272] T fd119138500f4351b2f68bcc272e0780 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.839622   431 tablet_replica.cc:333] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c: stopping tablet replica
I20260709 13:02:33.840375   431 raft_consensus.cc:2243] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:33.840863   431 raft_consensus.cc:2272] T 8c8e031f412048f09177a12e10d44d21 P e1c403ce70cf42d4bf96348aa91ce00c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.842767   431 tablet_replica.cc:333] T 1ccea3721c9444538cd1d7911a5b83a7 P e1c403ce70cf42d4bf96348aa91ce00c: stopping tablet replica
I20260709 13:02:33.843317   431 raft_consensus.cc:2243] T 1ccea3721c9444538cd1d7911a5b83a7 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:33.844316   431 raft_consensus.cc:2272] T 1ccea3721c9444538cd1d7911a5b83a7 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.846522   431 tablet_replica.cc:333] T 4a6e18b4b04949d39e83b2d4680ce17a P e1c403ce70cf42d4bf96348aa91ce00c: stopping tablet replica
I20260709 13:02:33.847083   431 raft_consensus.cc:2243] T 4a6e18b4b04949d39e83b2d4680ce17a P e1c403ce70cf42d4bf96348aa91ce00c [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:02:33.847766 13077 consensus_peers.cc:597] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c -> Peer 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167): Couldn't send request to peer 329c44a887e5438d8d4d7b4b6e2fac58. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:33.848212   431 raft_consensus.cc:2272] T 4a6e18b4b04949d39e83b2d4680ce17a P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.850780   431 tablet_replica.cc:333] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c: stopping tablet replica
I20260709 13:02:33.851369   431 raft_consensus.cc:2243] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:33.851884   431 raft_consensus.cc:2272] T 4e1ace06c24e420e8597846b56cc0c79 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.854312   431 tablet_replica.cc:333] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c: stopping tablet replica
I20260709 13:02:33.854992   431 raft_consensus.cc:2243] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:33.855962   431 raft_consensus.cc:2272] T 1e1e91abc0df42e99e2956ee39413813 P e1c403ce70cf42d4bf96348aa91ce00c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:33.857708 13151 consensus_peers.cc:597] T 8c644e2de35045e88e8f1dd90bc75313 P 907cde6b822944c7a81e18d74131932a -> Peer 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167): Couldn't send request to peer 329c44a887e5438d8d4d7b4b6e2fac58. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:33.858263 13151 consensus_peers.cc:597] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a -> Peer 329c44a887e5438d8d4d7b4b6e2fac58 (127.0.107.193:44167): Couldn't send request to peer 329c44a887e5438d8d4d7b4b6e2fac58. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:33.858990   431 tablet_replica.cc:333] T 16f353bc6d1847a199accd034426ec3f P e1c403ce70cf42d4bf96348aa91ce00c: stopping tablet replica
I20260709 13:02:33.859570   431 raft_consensus.cc:2243] T 16f353bc6d1847a199accd034426ec3f P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:33.859995   431 raft_consensus.cc:2272] T 16f353bc6d1847a199accd034426ec3f P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.862193   431 tablet_replica.cc:333] T 44066ba5afb3439496e0ffc8c96b6536 P e1c403ce70cf42d4bf96348aa91ce00c: stopping tablet replica
I20260709 13:02:33.862756   431 raft_consensus.cc:2243] T 44066ba5afb3439496e0ffc8c96b6536 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:33.863197   431 raft_consensus.cc:2272] T 44066ba5afb3439496e0ffc8c96b6536 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:33.865873 13154 consensus_peers.cc:597] T 6d27b2b82449490087a942a8a70295fe P 907cde6b822944c7a81e18d74131932a -> Peer e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599): Couldn't send request to peer e1c403ce70cf42d4bf96348aa91ce00c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:33.865902   431 tablet_replica.cc:333] T 8c644e2de35045e88e8f1dd90bc75313 P e1c403ce70cf42d4bf96348aa91ce00c: stopping tablet replica
I20260709 13:02:33.866816   431 raft_consensus.cc:2243] T 8c644e2de35045e88e8f1dd90bc75313 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:33.867267   431 raft_consensus.cc:2272] T 8c644e2de35045e88e8f1dd90bc75313 P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.869300   431 tablet_replica.cc:333] T a3d1a30f18f441fcb2e63ba9dd524989 P e1c403ce70cf42d4bf96348aa91ce00c: stopping tablet replica
I20260709 13:02:33.869836   431 raft_consensus.cc:2243] T a3d1a30f18f441fcb2e63ba9dd524989 P e1c403ce70cf42d4bf96348aa91ce00c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:33.870306   431 raft_consensus.cc:2272] T a3d1a30f18f441fcb2e63ba9dd524989 P e1c403ce70cf42d4bf96348aa91ce00c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.872460   431 tablet_replica.cc:333] T 6d27b2b82449490087a942a8a70295fe P e1c403ce70cf42d4bf96348aa91ce00c: stopping tablet replica
I20260709 13:02:33.872956   431 raft_consensus.cc:2243] T 6d27b2b82449490087a942a8a70295fe P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:33.873399   431 raft_consensus.cc:2272] T 6d27b2b82449490087a942a8a70295fe P e1c403ce70cf42d4bf96348aa91ce00c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.913199   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:02:33.946722 13154 consensus_peers.cc:597] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a -> Peer e1c403ce70cf42d4bf96348aa91ce00c (127.0.107.194:34599): Couldn't send request to peer e1c403ce70cf42d4bf96348aa91ce00c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:34599: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:33.950150   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:02:33.979939   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:33.980690   431 tablet_replica.cc:333] T 4b5b67cb4af94198b56cdf18c521246a P 907cde6b822944c7a81e18d74131932a: stopping tablet replica
I20260709 13:02:33.981547   431 raft_consensus.cc:2243] T 4b5b67cb4af94198b56cdf18c521246a P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:33.982152   431 raft_consensus.cc:2272] T 4b5b67cb4af94198b56cdf18c521246a P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.984124   431 tablet_replica.cc:333] T 93c035ed1907476a96662577ef9fae52 P 907cde6b822944c7a81e18d74131932a: stopping tablet replica
I20260709 13:02:33.984711   431 raft_consensus.cc:2243] T 93c035ed1907476a96662577ef9fae52 P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:33.985092   431 raft_consensus.cc:2272] T 93c035ed1907476a96662577ef9fae52 P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.986897   431 tablet_replica.cc:333] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a: stopping tablet replica
I20260709 13:02:33.987666   431 raft_consensus.cc:2243] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:33.988826   431 raft_consensus.cc:2272] T e22c440bef7646da85bb451d84f19072 P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.991228   431 tablet_replica.cc:333] T d47cdf8b75a649febde90f19de509dbc P 907cde6b822944c7a81e18d74131932a: stopping tablet replica
I20260709 13:02:33.991813   431 raft_consensus.cc:2243] T d47cdf8b75a649febde90f19de509dbc P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:33.992295   431 raft_consensus.cc:2272] T d47cdf8b75a649febde90f19de509dbc P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.994261   431 tablet_replica.cc:333] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a: stopping tablet replica
I20260709 13:02:33.994803   431 raft_consensus.cc:2243] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:33.995543   431 raft_consensus.cc:2272] T 9728ccfd1f9541e5a2850596e2a6d4ca P 907cde6b822944c7a81e18d74131932a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:33.997491   431 tablet_replica.cc:333] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a: stopping tablet replica
I20260709 13:02:33.998034   431 raft_consensus.cc:2243] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:33.998482   431 raft_consensus.cc:2272] T 377900a1b7524ed298bea187f145147c P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:34.000284   431 tablet_replica.cc:333] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a: stopping tablet replica
I20260709 13:02:34.000835   431 raft_consensus.cc:2243] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:34.001288   431 raft_consensus.cc:2272] T 4a6e18b4b04949d39e83b2d4680ce17a P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:34.003275   431 tablet_replica.cc:333] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a: stopping tablet replica
I20260709 13:02:34.003943   431 raft_consensus.cc:2243] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:34.004377   431 raft_consensus.cc:2272] T 1ccea3721c9444538cd1d7911a5b83a7 P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:34.006274   431 tablet_replica.cc:333] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a: stopping tablet replica
I20260709 13:02:34.006785   431 raft_consensus.cc:2243] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:34.007194   431 raft_consensus.cc:2272] T 44066ba5afb3439496e0ffc8c96b6536 P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:34.009142   431 tablet_replica.cc:333] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a: stopping tablet replica
I20260709 13:02:34.009672   431 raft_consensus.cc:2243] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:34.010155   431 raft_consensus.cc:2272] T 16f353bc6d1847a199accd034426ec3f P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:34.012064   431 tablet_replica.cc:333] T 4e1ace06c24e420e8597846b56cc0c79 P 907cde6b822944c7a81e18d74131932a: stopping tablet replica
I20260709 13:02:34.012619   431 raft_consensus.cc:2243] T 4e1ace06c24e420e8597846b56cc0c79 P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:34.013041   431 raft_consensus.cc:2272] T 4e1ace06c24e420e8597846b56cc0c79 P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:34.015044   431 tablet_replica.cc:333] T 1e1e91abc0df42e99e2956ee39413813 P 907cde6b822944c7a81e18d74131932a: stopping tablet replica
I20260709 13:02:34.015527   431 raft_consensus.cc:2243] T 1e1e91abc0df42e99e2956ee39413813 P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:34.015916   431 raft_consensus.cc:2272] T 1e1e91abc0df42e99e2956ee39413813 P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:34.017874   431 tablet_replica.cc:333] T 4018c93e45734aac9b61b02e27e0ef16 P 907cde6b822944c7a81e18d74131932a: stopping tablet replica
I20260709 13:02:34.018361   431 raft_consensus.cc:2243] T 4018c93e45734aac9b61b02e27e0ef16 P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:34.018764   431 raft_consensus.cc:2272] T 4018c93e45734aac9b61b02e27e0ef16 P 907cde6b822944c7a81e18d74131932a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:34.020725   431 tablet_replica.cc:333] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a: stopping tablet replica
I20260709 13:02:34.021198   431 raft_consensus.cc:2243] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:34.021623   431 raft_consensus.cc:2272] T fd119138500f4351b2f68bcc272e0780 P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:34.023471   431 tablet_replica.cc:333] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a: stopping tablet replica
I20260709 13:02:34.023933   431 raft_consensus.cc:2243] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:34.024649   431 raft_consensus.cc:2272] T 8c8e031f412048f09177a12e10d44d21 P 907cde6b822944c7a81e18d74131932a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:34.026428   431 tablet_replica.cc:333] T 6d27b2b82449490087a942a8a70295fe P 907cde6b822944c7a81e18d74131932a: stopping tablet replica
I20260709 13:02:34.027038   431 raft_consensus.cc:2243] T 6d27b2b82449490087a942a8a70295fe P 907cde6b822944c7a81e18d74131932a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:34.027956   431 raft_consensus.cc:2272] T 6d27b2b82449490087a942a8a70295fe P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:34.030146   431 tablet_replica.cc:333] T 8c644e2de35045e88e8f1dd90bc75313 P 907cde6b822944c7a81e18d74131932a: stopping tablet replica
I20260709 13:02:34.030650   431 raft_consensus.cc:2243] T 8c644e2de35045e88e8f1dd90bc75313 P 907cde6b822944c7a81e18d74131932a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:34.031350   431 raft_consensus.cc:2272] T 8c644e2de35045e88e8f1dd90bc75313 P 907cde6b822944c7a81e18d74131932a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:34.033216   431 tablet_replica.cc:333] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a: stopping tablet replica
I20260709 13:02:34.033661   431 raft_consensus.cc:2243] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:34.034379   431 raft_consensus.cc:2272] T a3d1a30f18f441fcb2e63ba9dd524989 P 907cde6b822944c7a81e18d74131932a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:34.076938   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:02:34.109825   431 master.cc:562] Master@127.0.107.254:39611 shutting down...
I20260709 13:02:34.133726   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f2f50cc530224c83bbc4c38881a2fb0b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:34.134251   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f2f50cc530224c83bbc4c38881a2fb0b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:34.134558   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P f2f50cc530224c83bbc4c38881a2fb0b: stopping tablet replica
I20260709 13:02:34.154776   431 master.cc:584] Master@127.0.107.254:39611 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12043 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:02:34.206049   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:37559
I20260709 13:02:34.207183   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:34.213279 13501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:34.213297 13500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:34.214278 13503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:34.214677   431 server_base.cc:1061] running on GCE node
I20260709 13:02:34.215556   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:34.215758   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:34.215894   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602154215878 us; error 0 us; skew 500 ppm
I20260709 13:02:34.216382   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:34.219054   431 webserver.cc:533] Webserver started at http://127.0.107.254:43987/ using document root <none> and password file <none>
I20260709 13:02:34.219556   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:34.219736   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:34.219993   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:34.221155   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601786404416-431-0/minicluster-data/master-0-root/instance:
uuid: "94f6ec2862e4400a8203b964a86f9869"
format_stamp: "Formatted at 2026-07-09 13:02:34 on dist-test-slave-6j4g"
I20260709 13:02:34.225593   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:02:34.229117 13508 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:34.229900   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:02:34.230178   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601786404416-431-0/minicluster-data/master-0-root
uuid: "94f6ec2862e4400a8203b964a86f9869"
format_stamp: "Formatted at 2026-07-09 13:02:34 on dist-test-slave-6j4g"
I20260709 13:02:34.230423   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601786404416-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601786404416-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601786404416-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:34.258625   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:34.259807   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:34.297279   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:37559
I20260709 13:02:34.297380 13559 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:37559 every 8 connection(s)
I20260709 13:02:34.301164 13560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.312515 13560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94f6ec2862e4400a8203b964a86f9869: Bootstrap starting.
I20260709 13:02:34.317458 13560 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 94f6ec2862e4400a8203b964a86f9869: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:34.322000 13560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94f6ec2862e4400a8203b964a86f9869: No bootstrap required, opened a new log
I20260709 13:02:34.324368 13560 raft_consensus.cc:359] T 00000000000000000000000000000000 P 94f6ec2862e4400a8203b964a86f9869 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94f6ec2862e4400a8203b964a86f9869" member_type: VOTER }
I20260709 13:02:34.324815 13560 raft_consensus.cc:385] T 00000000000000000000000000000000 P 94f6ec2862e4400a8203b964a86f9869 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:34.325037 13560 raft_consensus.cc:740] T 00000000000000000000000000000000 P 94f6ec2862e4400a8203b964a86f9869 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94f6ec2862e4400a8203b964a86f9869, State: Initialized, Role: FOLLOWER
I20260709 13:02:34.325592 13560 consensus_queue.cc:260] T 00000000000000000000000000000000 P 94f6ec2862e4400a8203b964a86f9869 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94f6ec2862e4400a8203b964a86f9869" member_type: VOTER }
I20260709 13:02:34.326035 13560 raft_consensus.cc:399] T 00000000000000000000000000000000 P 94f6ec2862e4400a8203b964a86f9869 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:02:34.326244 13560 raft_consensus.cc:493] T 00000000000000000000000000000000 P 94f6ec2862e4400a8203b964a86f9869 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:02:34.326507 13560 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 94f6ec2862e4400a8203b964a86f9869 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:34.331487 13560 raft_consensus.cc:515] T 00000000000000000000000000000000 P 94f6ec2862e4400a8203b964a86f9869 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94f6ec2862e4400a8203b964a86f9869" member_type: VOTER }
I20260709 13:02:34.332046 13560 leader_election.cc:304] T 00000000000000000000000000000000 P 94f6ec2862e4400a8203b964a86f9869 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 94f6ec2862e4400a8203b964a86f9869; no voters: 
I20260709 13:02:34.333303 13560 leader_election.cc:290] T 00000000000000000000000000000000 P 94f6ec2862e4400a8203b964a86f9869 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:02:34.333650 13563 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 94f6ec2862e4400a8203b964a86f9869 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:34.335062 13563 raft_consensus.cc:697] T 00000000000000000000000000000000 P 94f6ec2862e4400a8203b964a86f9869 [term 1 LEADER]: Becoming Leader. State: Replica: 94f6ec2862e4400a8203b964a86f9869, State: Running, Role: LEADER
I20260709 13:02:34.335714 13563 consensus_queue.cc:237] T 00000000000000000000000000000000 P 94f6ec2862e4400a8203b964a86f9869 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94f6ec2862e4400a8203b964a86f9869" member_type: VOTER }
I20260709 13:02:34.336412 13560 sys_catalog.cc:565] T 00000000000000000000000000000000 P 94f6ec2862e4400a8203b964a86f9869 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:02:34.340173 13564 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94f6ec2862e4400a8203b964a86f9869 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "94f6ec2862e4400a8203b964a86f9869" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94f6ec2862e4400a8203b964a86f9869" member_type: VOTER } }
I20260709 13:02:34.340087 13565 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94f6ec2862e4400a8203b964a86f9869 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 94f6ec2862e4400a8203b964a86f9869. Latest consensus state: current_term: 1 leader_uuid: "94f6ec2862e4400a8203b964a86f9869" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94f6ec2862e4400a8203b964a86f9869" member_type: VOTER } }
I20260709 13:02:34.341015 13564 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94f6ec2862e4400a8203b964a86f9869 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:34.341061 13565 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94f6ec2862e4400a8203b964a86f9869 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:34.347810 13568 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:02:34.355465 13568 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:02:34.356894   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:02:34.364877 13568 catalog_manager.cc:1383] Generated new cluster ID: ecfe46f283b24984a2694ada54cd057c
I20260709 13:02:34.365213 13568 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:02:34.382189 13568 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:02:34.383498 13568 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:02:34.396306 13568 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 94f6ec2862e4400a8203b964a86f9869: Generated new TSK 0
I20260709 13:02:34.396966 13568 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:02:34.423998   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:34.430712 13581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:34.431514 13582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:34.433873   431 server_base.cc:1061] running on GCE node
W20260709 13:02:34.433907 13584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:34.435307   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:34.435541   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:34.435667   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602154435655 us; error 0 us; skew 500 ppm
I20260709 13:02:34.436129   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:34.438529   431 webserver.cc:533] Webserver started at http://127.0.107.193:45093/ using document root <none> and password file <none>
I20260709 13:02:34.438962   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:34.439116   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:34.439314   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:34.440336   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601786404416-431-0/minicluster-data/ts-0-root/instance:
uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
format_stamp: "Formatted at 2026-07-09 13:02:34 on dist-test-slave-6j4g"
I20260709 13:02:34.444868   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:02:34.448257 13589 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:34.449131   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:02:34.449425   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601786404416-431-0/minicluster-data/ts-0-root
uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
format_stamp: "Formatted at 2026-07-09 13:02:34 on dist-test-slave-6j4g"
I20260709 13:02:34.449720   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601786404416-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601786404416-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601786404416-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:34.461305   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:34.462517   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:34.463949   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:34.466274   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:34.466495   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:34.466728   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:34.466892   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:34.506385   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:41087
I20260709 13:02:34.506479 13651 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:41087 every 8 connection(s)
I20260709 13:02:34.511340   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:34.518576 13656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:34.520123 13657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:34.521389   431 server_base.cc:1061] running on GCE node
W20260709 13:02:34.521970 13659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:34.523093   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:34.523303   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:34.523465   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602154523448 us; error 0 us; skew 500 ppm
I20260709 13:02:34.524003   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:34.525993 13652 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37559
I20260709 13:02:34.526355 13652 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:34.526679   431 webserver.cc:533] Webserver started at http://127.0.107.194:43711/ using document root <none> and password file <none>
I20260709 13:02:34.527099 13652 heartbeater.cc:507] Master 127.0.107.254:37559 requested a full tablet report, sending...
I20260709 13:02:34.527215   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:34.527493   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:34.527750   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:34.529045   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601786404416-431-0/minicluster-data/ts-1-root/instance:
uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
format_stamp: "Formatted at 2026-07-09 13:02:34 on dist-test-slave-6j4g"
I20260709 13:02:34.529309 13525 ts_manager.cc:194] Registered new tserver with Master: 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087)
I20260709 13:02:34.531100 13525 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42824
I20260709 13:02:34.533885   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:02:34.537395 13664 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:34.538157   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:02:34.538457   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601786404416-431-0/minicluster-data/ts-1-root
uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
format_stamp: "Formatted at 2026-07-09 13:02:34 on dist-test-slave-6j4g"
I20260709 13:02:34.538753   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601786404416-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601786404416-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601786404416-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:34.554342   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:34.555487   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:34.556901   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:34.559139   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:34.559329   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:34.559583   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:34.559729   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:34.599630   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:36901
I20260709 13:02:34.599725 13726 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:36901 every 8 connection(s)
I20260709 13:02:34.604223   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:34.610755 13730 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:34.612203 13731 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:34.615303 13733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:34.615371   431 server_base.cc:1061] running on GCE node
I20260709 13:02:34.616405 13727 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37559
I20260709 13:02:34.616930 13727 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:34.617061   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:34.617377   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:34.617581   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602154617559 us; error 0 us; skew 500 ppm
I20260709 13:02:34.617859 13727 heartbeater.cc:507] Master 127.0.107.254:37559 requested a full tablet report, sending...
I20260709 13:02:34.618407   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:34.620358 13525 ts_manager.cc:194] Registered new tserver with Master: 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901)
I20260709 13:02:34.621220   431 webserver.cc:533] Webserver started at http://127.0.107.195:33599/ using document root <none> and password file <none>
I20260709 13:02:34.621768   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:34.621917 13525 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42826
I20260709 13:02:34.621945   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:34.622519   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:34.623812   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601786404416-431-0/minicluster-data/ts-2-root/instance:
uuid: "79660023c1124b7e8da27181f34a5c92"
format_stamp: "Formatted at 2026-07-09 13:02:34 on dist-test-slave-6j4g"
I20260709 13:02:34.628295   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:02:34.631642 13738 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:34.632429   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:02:34.632769   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601786404416-431-0/minicluster-data/ts-2-root
uuid: "79660023c1124b7e8da27181f34a5c92"
format_stamp: "Formatted at 2026-07-09 13:02:34 on dist-test-slave-6j4g"
I20260709 13:02:34.633037   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601786404416-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601786404416-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskDWfrq5/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601786404416-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:34.649344   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:34.650624   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:34.652279   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:34.654593   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:34.654815   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:34.655048   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:34.655215   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:34.694586   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:43687
I20260709 13:02:34.694679 13800 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:43687 every 8 connection(s)
I20260709 13:02:34.708074 13801 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37559
I20260709 13:02:34.708559 13801 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:34.709239 13801 heartbeater.cc:507] Master 127.0.107.254:37559 requested a full tablet report, sending...
I20260709 13:02:34.711241 13525 ts_manager.cc:194] Registered new tserver with Master: 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:34.711489   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013643218s
I20260709 13:02:34.712705 13525 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42842
I20260709 13:02:34.737035 13525 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42850:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:34.739835 13525 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:34.813863 13766 tablet_service.cc:1511] Processing CreateTablet for tablet 0ba8cd98760e4f269f64ee27c6a368e6 (DEFAULT_TABLE table=test-workload [id=d15ec675c7d44250905bbff7f2a5c226]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:34.815100 13617 tablet_service.cc:1511] Processing CreateTablet for tablet 0ba8cd98760e4f269f64ee27c6a368e6 (DEFAULT_TABLE table=test-workload [id=d15ec675c7d44250905bbff7f2a5c226]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:34.815596 13766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ba8cd98760e4f269f64ee27c6a368e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.816272 13615 tablet_service.cc:1511] Processing CreateTablet for tablet 4a63f82eddf641898443ae8c2a8b9b1c (DEFAULT_TABLE table=test-workload [id=d15ec675c7d44250905bbff7f2a5c226]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:34.817098 13616 tablet_service.cc:1511] Processing CreateTablet for tablet 42a59bf8b7ad4c42931ad97808e91469 (DEFAULT_TABLE table=test-workload [id=d15ec675c7d44250905bbff7f2a5c226]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:34.817224 13764 tablet_service.cc:1511] Processing CreateTablet for tablet 4a63f82eddf641898443ae8c2a8b9b1c (DEFAULT_TABLE table=test-workload [id=d15ec675c7d44250905bbff7f2a5c226]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:34.817852 13615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a63f82eddf641898443ae8c2a8b9b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.818722 13764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a63f82eddf641898443ae8c2a8b9b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.819010 13617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ba8cd98760e4f269f64ee27c6a368e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.820374 13765 tablet_service.cc:1511] Processing CreateTablet for tablet 42a59bf8b7ad4c42931ad97808e91469 (DEFAULT_TABLE table=test-workload [id=d15ec675c7d44250905bbff7f2a5c226]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:34.822908 13616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42a59bf8b7ad4c42931ad97808e91469. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.823415 13763 tablet_service.cc:1511] Processing CreateTablet for tablet 973db6db1a614f46a8c51c49bbe2afcd (DEFAULT_TABLE table=test-workload [id=d15ec675c7d44250905bbff7f2a5c226]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:34.824915 13763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 973db6db1a614f46a8c51c49bbe2afcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.829564 13614 tablet_service.cc:1511] Processing CreateTablet for tablet 973db6db1a614f46a8c51c49bbe2afcd (DEFAULT_TABLE table=test-workload [id=d15ec675c7d44250905bbff7f2a5c226]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:34.831207 13614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 973db6db1a614f46a8c51c49bbe2afcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.832300 13765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42a59bf8b7ad4c42931ad97808e91469. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.843076 13613 tablet_service.cc:1511] Processing CreateTablet for tablet 93b5051b31254e9189de01203c87bc4e (DEFAULT_TABLE table=test-workload [id=d15ec675c7d44250905bbff7f2a5c226]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:34.844683 13613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93b5051b31254e9189de01203c87bc4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.850368 13762 tablet_service.cc:1511] Processing CreateTablet for tablet 93b5051b31254e9189de01203c87bc4e (DEFAULT_TABLE table=test-workload [id=d15ec675c7d44250905bbff7f2a5c226]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:34.852012 13762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93b5051b31254e9189de01203c87bc4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.865792 13761 tablet_service.cc:1511] Processing CreateTablet for tablet 854f9710b117408cb32500bffcc2f500 (DEFAULT_TABLE table=test-workload [id=d15ec675c7d44250905bbff7f2a5c226]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:34.866818 13612 tablet_service.cc:1511] Processing CreateTablet for tablet 854f9710b117408cb32500bffcc2f500 (DEFAULT_TABLE table=test-workload [id=d15ec675c7d44250905bbff7f2a5c226]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:34.867586 13761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 854f9710b117408cb32500bffcc2f500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.868247 13612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 854f9710b117408cb32500bffcc2f500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.874603 13611 tablet_service.cc:1511] Processing CreateTablet for tablet 93f0a9b2a4014d229a766e13ae96be58 (DEFAULT_TABLE table=test-workload [id=d15ec675c7d44250905bbff7f2a5c226]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:34.876187 13611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93f0a9b2a4014d229a766e13ae96be58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.898451 13817 tablet_bootstrap.cc:492] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92: Bootstrap starting.
I20260709 13:02:34.906203 13817 tablet_bootstrap.cc:654] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:34.913841 13692 tablet_service.cc:1511] Processing CreateTablet for tablet 0ba8cd98760e4f269f64ee27c6a368e6 (DEFAULT_TABLE table=test-workload [id=d15ec675c7d44250905bbff7f2a5c226]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:34.917827 13689 tablet_service.cc:1511] Processing CreateTablet for tablet 973db6db1a614f46a8c51c49bbe2afcd (DEFAULT_TABLE table=test-workload [id=d15ec675c7d44250905bbff7f2a5c226]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:34.918236 13691 tablet_service.cc:1511] Processing CreateTablet for tablet 42a59bf8b7ad4c42931ad97808e91469 (DEFAULT_TABLE table=test-workload [id=d15ec675c7d44250905bbff7f2a5c226]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:34.918938 13686 tablet_service.cc:1511] Processing CreateTablet for tablet 93f0a9b2a4014d229a766e13ae96be58 (DEFAULT_TABLE table=test-workload [id=d15ec675c7d44250905bbff7f2a5c226]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:34.921382 13688 tablet_service.cc:1511] Processing CreateTablet for tablet 93b5051b31254e9189de01203c87bc4e (DEFAULT_TABLE table=test-workload [id=d15ec675c7d44250905bbff7f2a5c226]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:34.923074 13687 tablet_service.cc:1511] Processing CreateTablet for tablet 854f9710b117408cb32500bffcc2f500 (DEFAULT_TABLE table=test-workload [id=d15ec675c7d44250905bbff7f2a5c226]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:34.924217 13690 tablet_service.cc:1511] Processing CreateTablet for tablet 4a63f82eddf641898443ae8c2a8b9b1c (DEFAULT_TABLE table=test-workload [id=d15ec675c7d44250905bbff7f2a5c226]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:34.919463 13689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 973db6db1a614f46a8c51c49bbe2afcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.931438 13816 tablet_bootstrap.cc:492] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7: Bootstrap starting.
I20260709 13:02:34.931442 13692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ba8cd98760e4f269f64ee27c6a368e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.938297 13688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93b5051b31254e9189de01203c87bc4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.942677 13615 tablet_service.cc:1511] Processing CreateTablet for tablet 2177fcc303304952a036acbb82983fda (DEFAULT_TABLE table=test-workload [id=d15ec675c7d44250905bbff7f2a5c226]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:34.944303 13615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2177fcc303304952a036acbb82983fda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.945623 13764 tablet_service.cc:1511] Processing CreateTablet for tablet 2177fcc303304952a036acbb82983fda (DEFAULT_TABLE table=test-workload [id=d15ec675c7d44250905bbff7f2a5c226]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:34.947088 13764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2177fcc303304952a036acbb82983fda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.949277 13686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93f0a9b2a4014d229a766e13ae96be58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.950162 13690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a63f82eddf641898443ae8c2a8b9b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.950932 13691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42a59bf8b7ad4c42931ad97808e91469. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.951666 13685 tablet_service.cc:1511] Processing CreateTablet for tablet 2177fcc303304952a036acbb82983fda (DEFAULT_TABLE table=test-workload [id=d15ec675c7d44250905bbff7f2a5c226]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:34.953241 13685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2177fcc303304952a036acbb82983fda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.955670 13687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 854f9710b117408cb32500bffcc2f500. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.973767 13816 tablet_bootstrap.cc:654] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:34.979126 13684 tablet_service.cc:1511] Processing CreateTablet for tablet eb56f1ea81c24546bb53bb5763ccddc4 (DEFAULT_TABLE table=test-workload [id=d15ec675c7d44250905bbff7f2a5c226]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:34.973377 13766 tablet_service.cc:1511] Processing CreateTablet for tablet 93f0a9b2a4014d229a766e13ae96be58 (DEFAULT_TABLE table=test-workload [id=d15ec675c7d44250905bbff7f2a5c226]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:34.980701 13684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb56f1ea81c24546bb53bb5763ccddc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.981400 13766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93f0a9b2a4014d229a766e13ae96be58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.980310 13761 tablet_service.cc:1511] Processing CreateTablet for tablet eb56f1ea81c24546bb53bb5763ccddc4 (DEFAULT_TABLE table=test-workload [id=d15ec675c7d44250905bbff7f2a5c226]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:34.985275 13761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb56f1ea81c24546bb53bb5763ccddc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:34.988869 13613 tablet_service.cc:1511] Processing CreateTablet for tablet eb56f1ea81c24546bb53bb5763ccddc4 (DEFAULT_TABLE table=test-workload [id=d15ec675c7d44250905bbff7f2a5c226]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:34.990372 13613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb56f1ea81c24546bb53bb5763ccddc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:35.012079 13817 tablet_bootstrap.cc:492] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92: No bootstrap required, opened a new log
I20260709 13:02:35.012933 13817 ts_tablet_manager.cc:1403] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92: Time spent bootstrapping tablet: real 0.115s	user 0.028s	sys 0.023s
I20260709 13:02:35.017628 13817 raft_consensus.cc:359] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.018778 13817 raft_consensus.cc:385] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.025928 13817 raft_consensus.cc:740] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.029063 13817 consensus_queue.cc:260] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.041599 13817 ts_tablet_manager.cc:1434] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.002s
I20260709 13:02:35.042444 13801 heartbeater.cc:499] Master 127.0.107.254:37559 was elected leader, sending a full tablet report...
I20260709 13:02:35.094755 13816 tablet_bootstrap.cc:492] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7: No bootstrap required, opened a new log
I20260709 13:02:35.096333 13816 ts_tablet_manager.cc:1403] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent bootstrapping tablet: real 0.165s	user 0.033s	sys 0.052s
I20260709 13:02:35.097605 13821 tablet_bootstrap.cc:492] T 973db6db1a614f46a8c51c49bbe2afcd P 3c82125d03ae4947ac9a79aebe4d8cf0: Bootstrap starting.
I20260709 13:02:35.099975 13816 raft_consensus.cc:359] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.100883 13816 raft_consensus.cc:385] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.101249 13816 raft_consensus.cc:740] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.102046 13816 consensus_queue.cc:260] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.104964 13817 tablet_bootstrap.cc:492] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92: Bootstrap starting.
I20260709 13:02:35.110075 13821 tablet_bootstrap.cc:654] T 973db6db1a614f46a8c51c49bbe2afcd P 3c82125d03ae4947ac9a79aebe4d8cf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.134944 13817 tablet_bootstrap.cc:654] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.137532 13652 heartbeater.cc:499] Master 127.0.107.254:37559 was elected leader, sending a full tablet report...
I20260709 13:02:35.139569 13821 tablet_bootstrap.cc:492] T 973db6db1a614f46a8c51c49bbe2afcd P 3c82125d03ae4947ac9a79aebe4d8cf0: No bootstrap required, opened a new log
I20260709 13:02:35.140669 13821 ts_tablet_manager.cc:1403] T 973db6db1a614f46a8c51c49bbe2afcd P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent bootstrapping tablet: real 0.043s	user 0.025s	sys 0.008s
I20260709 13:02:35.143873 13821 raft_consensus.cc:359] T 973db6db1a614f46a8c51c49bbe2afcd P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.144809 13821 raft_consensus.cc:385] T 973db6db1a614f46a8c51c49bbe2afcd P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.144938 13816 ts_tablet_manager.cc:1434] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent starting tablet: real 0.048s	user 0.023s	sys 0.016s
I20260709 13:02:35.145153 13821 raft_consensus.cc:740] T 973db6db1a614f46a8c51c49bbe2afcd P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.146797 13816 tablet_bootstrap.cc:492] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7: Bootstrap starting.
I20260709 13:02:35.146479 13821 consensus_queue.cc:260] T 973db6db1a614f46a8c51c49bbe2afcd P 3c82125d03ae4947ac9a79aebe4d8cf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.155839 13816 tablet_bootstrap.cc:654] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.156189 13821 ts_tablet_manager.cc:1434] T 973db6db1a614f46a8c51c49bbe2afcd P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:02:35.156903 13727 heartbeater.cc:499] Master 127.0.107.254:37559 was elected leader, sending a full tablet report...
I20260709 13:02:35.159008 13817 tablet_bootstrap.cc:492] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92: No bootstrap required, opened a new log
I20260709 13:02:35.159621 13817 ts_tablet_manager.cc:1403] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92: Time spent bootstrapping tablet: real 0.055s	user 0.017s	sys 0.013s
I20260709 13:02:35.161494 13821 tablet_bootstrap.cc:492] T 93f0a9b2a4014d229a766e13ae96be58 P 3c82125d03ae4947ac9a79aebe4d8cf0: Bootstrap starting.
I20260709 13:02:35.162953 13817 raft_consensus.cc:359] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.163875 13817 raft_consensus.cc:385] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.164196 13817 raft_consensus.cc:740] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.165088 13817 consensus_queue.cc:260] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.167739 13817 ts_tablet_manager.cc:1434] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:02:35.168886 13817 tablet_bootstrap.cc:492] T 0ba8cd98760e4f269f64ee27c6a368e6 P 79660023c1124b7e8da27181f34a5c92: Bootstrap starting.
I20260709 13:02:35.172137 13821 tablet_bootstrap.cc:654] T 93f0a9b2a4014d229a766e13ae96be58 P 3c82125d03ae4947ac9a79aebe4d8cf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.175621 13817 tablet_bootstrap.cc:654] T 0ba8cd98760e4f269f64ee27c6a368e6 P 79660023c1124b7e8da27181f34a5c92: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.183087 13817 tablet_bootstrap.cc:492] T 0ba8cd98760e4f269f64ee27c6a368e6 P 79660023c1124b7e8da27181f34a5c92: No bootstrap required, opened a new log
I20260709 13:02:35.183799 13817 ts_tablet_manager.cc:1403] T 0ba8cd98760e4f269f64ee27c6a368e6 P 79660023c1124b7e8da27181f34a5c92: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.001s
I20260709 13:02:35.186029 13821 tablet_bootstrap.cc:492] T 93f0a9b2a4014d229a766e13ae96be58 P 3c82125d03ae4947ac9a79aebe4d8cf0: No bootstrap required, opened a new log
I20260709 13:02:35.186647 13821 ts_tablet_manager.cc:1403] T 93f0a9b2a4014d229a766e13ae96be58 P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.004s
I20260709 13:02:35.186899 13817 raft_consensus.cc:359] T 0ba8cd98760e4f269f64ee27c6a368e6 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } } peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } }
I20260709 13:02:35.187723 13817 raft_consensus.cc:385] T 0ba8cd98760e4f269f64ee27c6a368e6 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.188026 13817 raft_consensus.cc:740] T 0ba8cd98760e4f269f64ee27c6a368e6 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.189323 13816 tablet_bootstrap.cc:492] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7: No bootstrap required, opened a new log
I20260709 13:02:35.188988 13817 consensus_queue.cc:260] T 0ba8cd98760e4f269f64ee27c6a368e6 P 79660023c1124b7e8da27181f34a5c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } } peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } }
I20260709 13:02:35.189843 13816 ts_tablet_manager.cc:1403] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.005s
I20260709 13:02:35.189824 13821 raft_consensus.cc:359] T 93f0a9b2a4014d229a766e13ae96be58 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.190722 13821 raft_consensus.cc:385] T 93f0a9b2a4014d229a766e13ae96be58 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.191020 13821 raft_consensus.cc:740] T 93f0a9b2a4014d229a766e13ae96be58 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.191926 13817 ts_tablet_manager.cc:1434] T 0ba8cd98760e4f269f64ee27c6a368e6 P 79660023c1124b7e8da27181f34a5c92: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:35.191910 13821 consensus_queue.cc:260] T 93f0a9b2a4014d229a766e13ae96be58 P 3c82125d03ae4947ac9a79aebe4d8cf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.193190 13817 tablet_bootstrap.cc:492] T 973db6db1a614f46a8c51c49bbe2afcd P 79660023c1124b7e8da27181f34a5c92: Bootstrap starting.
I20260709 13:02:35.193409 13816 raft_consensus.cc:359] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.194221 13816 raft_consensus.cc:385] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.194520 13816 raft_consensus.cc:740] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.194614 13821 ts_tablet_manager.cc:1434] T 93f0a9b2a4014d229a766e13ae96be58 P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:02:35.195773 13821 tablet_bootstrap.cc:492] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0: Bootstrap starting.
I20260709 13:02:35.195504 13816 consensus_queue.cc:260] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.200736 13817 tablet_bootstrap.cc:654] T 973db6db1a614f46a8c51c49bbe2afcd P 79660023c1124b7e8da27181f34a5c92: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.203241 13821 tablet_bootstrap.cc:654] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.205754 13822 raft_consensus.cc:493] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.206365 13822 raft_consensus.cc:515] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.214737 13821 tablet_bootstrap.cc:492] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0: No bootstrap required, opened a new log
I20260709 13:02:35.214745 13817 tablet_bootstrap.cc:492] T 973db6db1a614f46a8c51c49bbe2afcd P 79660023c1124b7e8da27181f34a5c92: No bootstrap required, opened a new log
I20260709 13:02:35.215500 13817 ts_tablet_manager.cc:1403] T 973db6db1a614f46a8c51c49bbe2afcd P 79660023c1124b7e8da27181f34a5c92: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.012s
I20260709 13:02:35.215500 13821 ts_tablet_manager.cc:1403] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 13:02:35.217072 13822 leader_election.cc:290] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:35.218928 13821 raft_consensus.cc:359] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.218806 13817 raft_consensus.cc:359] T 973db6db1a614f46a8c51c49bbe2afcd P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.219841 13821 raft_consensus.cc:385] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.219903 13817 raft_consensus.cc:385] T 973db6db1a614f46a8c51c49bbe2afcd P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.220228 13821 raft_consensus.cc:740] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.220353 13817 raft_consensus.cc:740] T 973db6db1a614f46a8c51c49bbe2afcd P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.221292 13817 consensus_queue.cc:260] T 973db6db1a614f46a8c51c49bbe2afcd P 79660023c1124b7e8da27181f34a5c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.221318 13821 consensus_queue.cc:260] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.224023 13821 ts_tablet_manager.cc:1434] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:02:35.224030 13817 ts_tablet_manager.cc:1434] T 973db6db1a614f46a8c51c49bbe2afcd P 79660023c1124b7e8da27181f34a5c92: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:35.225255 13821 tablet_bootstrap.cc:492] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0: Bootstrap starting.
I20260709 13:02:35.225255 13817 tablet_bootstrap.cc:492] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92: Bootstrap starting.
I20260709 13:02:35.231410 13816 ts_tablet_manager.cc:1434] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:02:35.235677 13816 tablet_bootstrap.cc:492] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7: Bootstrap starting.
I20260709 13:02:35.240494 13821 tablet_bootstrap.cc:654] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.242861 13817 tablet_bootstrap.cc:654] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.246977 13816 tablet_bootstrap.cc:654] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.253562 13821 tablet_bootstrap.cc:492] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0: No bootstrap required, opened a new log
I20260709 13:02:35.254184 13821 ts_tablet_manager.cc:1403] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.008s
I20260709 13:02:35.257315 13821 raft_consensus.cc:359] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.257750 13816 tablet_bootstrap.cc:492] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7: No bootstrap required, opened a new log
I20260709 13:02:35.258142 13821 raft_consensus.cc:385] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.257767 13776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "973db6db1a614f46a8c51c49bbe2afcd" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79660023c1124b7e8da27181f34a5c92" is_pre_election: true
I20260709 13:02:35.258498 13816 ts_tablet_manager.cc:1403] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.006s
I20260709 13:02:35.258701 13821 raft_consensus.cc:740] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.257316 13702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "973db6db1a614f46a8c51c49bbe2afcd" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" is_pre_election: true
I20260709 13:02:35.259683 13702 raft_consensus.cc:2468] T 973db6db1a614f46a8c51c49bbe2afcd P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d1f3335b323406f8f1ad7a1e277cdc7 in term 0.
I20260709 13:02:35.259678 13821 consensus_queue.cc:260] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.258975 13776 raft_consensus.cc:2468] T 973db6db1a614f46a8c51c49bbe2afcd P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d1f3335b323406f8f1ad7a1e277cdc7 in term 0.
I20260709 13:02:35.261219 13592 leader_election.cc:304] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 3d1f3335b323406f8f1ad7a1e277cdc7; no voters: 
I20260709 13:02:35.262936 13817 tablet_bootstrap.cc:492] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92: No bootstrap required, opened a new log
I20260709 13:02:35.263682 13817 ts_tablet_manager.cc:1403] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.004s
I20260709 13:02:35.263872 13822 raft_consensus.cc:2804] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:35.264308 13822 raft_consensus.cc:493] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.264729 13822 raft_consensus.cc:3060] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.261938 13816 raft_consensus.cc:359] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } } peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } }
I20260709 13:02:35.265111 13816 raft_consensus.cc:385] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.265398 13816 raft_consensus.cc:740] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.266300 13816 consensus_queue.cc:260] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } } peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } }
I20260709 13:02:35.266923 13817 raft_consensus.cc:359] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.267841 13817 raft_consensus.cc:385] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.268105 13817 raft_consensus.cc:740] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.268857 13817 consensus_queue.cc:260] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.271112 13817 ts_tablet_manager.cc:1434] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:35.272209 13817 tablet_bootstrap.cc:492] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92: Bootstrap starting.
I20260709 13:02:35.274312 13816 ts_tablet_manager.cc:1434] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.003s
I20260709 13:02:35.275472 13816 tablet_bootstrap.cc:492] T 4a63f82eddf641898443ae8c2a8b9b1c P 3d1f3335b323406f8f1ad7a1e277cdc7: Bootstrap starting.
I20260709 13:02:35.263682 13821 ts_tablet_manager.cc:1434] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.006s
I20260709 13:02:35.278851 13817 tablet_bootstrap.cc:654] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.279248 13821 tablet_bootstrap.cc:492] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0: Bootstrap starting.
I20260709 13:02:35.282477 13816 tablet_bootstrap.cc:654] T 4a63f82eddf641898443ae8c2a8b9b1c P 3d1f3335b323406f8f1ad7a1e277cdc7: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.286687 13821 tablet_bootstrap.cc:654] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.291522 13817 tablet_bootstrap.cc:492] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92: No bootstrap required, opened a new log
I20260709 13:02:35.291126 13822 raft_consensus.cc:515] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.292187 13817 ts_tablet_manager.cc:1403] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92: Time spent bootstrapping tablet: real 0.020s	user 0.004s	sys 0.012s
I20260709 13:02:35.294430 13702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "973db6db1a614f46a8c51c49bbe2afcd" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
I20260709 13:02:35.294729 13816 tablet_bootstrap.cc:492] T 4a63f82eddf641898443ae8c2a8b9b1c P 3d1f3335b323406f8f1ad7a1e277cdc7: No bootstrap required, opened a new log
I20260709 13:02:35.295141 13702 raft_consensus.cc:3060] T 973db6db1a614f46a8c51c49bbe2afcd P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.295389 13816 ts_tablet_manager.cc:1403] T 4a63f82eddf641898443ae8c2a8b9b1c P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 13:02:35.295699 13817 raft_consensus.cc:359] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.296816 13817 raft_consensus.cc:385] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.297139 13817 raft_consensus.cc:740] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.298166 13817 consensus_queue.cc:260] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.298674 13816 raft_consensus.cc:359] T 4a63f82eddf641898443ae8c2a8b9b1c P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.299479 13816 raft_consensus.cc:385] T 4a63f82eddf641898443ae8c2a8b9b1c P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.299782 13816 raft_consensus.cc:740] T 4a63f82eddf641898443ae8c2a8b9b1c P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.300801 13817 ts_tablet_manager.cc:1434] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:35.300765 13816 consensus_queue.cc:260] T 4a63f82eddf641898443ae8c2a8b9b1c P 3d1f3335b323406f8f1ad7a1e277cdc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.302055 13817 tablet_bootstrap.cc:492] T 2177fcc303304952a036acbb82983fda P 79660023c1124b7e8da27181f34a5c92: Bootstrap starting.
I20260709 13:02:35.303994 13702 raft_consensus.cc:2468] T 973db6db1a614f46a8c51c49bbe2afcd P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1f3335b323406f8f1ad7a1e277cdc7 in term 1.
I20260709 13:02:35.306000 13592 leader_election.cc:304] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 3d1f3335b323406f8f1ad7a1e277cdc7; no voters: 
I20260709 13:02:35.307046 13836 raft_consensus.cc:2804] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:35.307518 13822 leader_election.cc:290] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 election: Requested vote from peers 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:35.307571 13836 raft_consensus.cc:697] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 LEADER]: Becoming Leader. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Running, Role: LEADER
I20260709 13:02:35.309186 13776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "973db6db1a614f46a8c51c49bbe2afcd" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79660023c1124b7e8da27181f34a5c92"
I20260709 13:02:35.310810 13776 raft_consensus.cc:3060] T 973db6db1a614f46a8c51c49bbe2afcd P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.315780 13816 ts_tablet_manager.cc:1434] T 4a63f82eddf641898443ae8c2a8b9b1c P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.015s
I20260709 13:02:35.317333 13816 tablet_bootstrap.cc:492] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7: Bootstrap starting.
I20260709 13:02:35.319537 13817 tablet_bootstrap.cc:654] T 2177fcc303304952a036acbb82983fda P 79660023c1124b7e8da27181f34a5c92: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.309566 13836 consensus_queue.cc:237] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.325299 13816 tablet_bootstrap.cc:654] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.336737 13776 raft_consensus.cc:2468] T 973db6db1a614f46a8c51c49bbe2afcd P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1f3335b323406f8f1ad7a1e277cdc7 in term 1.
I20260709 13:02:35.339421 13817 tablet_bootstrap.cc:492] T 2177fcc303304952a036acbb82983fda P 79660023c1124b7e8da27181f34a5c92: No bootstrap required, opened a new log
I20260709 13:02:35.339788 13816 tablet_bootstrap.cc:492] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7: No bootstrap required, opened a new log
I20260709 13:02:35.340150 13817 ts_tablet_manager.cc:1403] T 2177fcc303304952a036acbb82983fda P 79660023c1124b7e8da27181f34a5c92: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.004s
I20260709 13:02:35.340452 13816 ts_tablet_manager.cc:1403] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.004s
I20260709 13:02:35.342682 13817 raft_consensus.cc:359] T 2177fcc303304952a036acbb82983fda P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.343331 13817 raft_consensus.cc:385] T 2177fcc303304952a036acbb82983fda P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.343636 13817 raft_consensus.cc:740] T 2177fcc303304952a036acbb82983fda P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.344463 13817 consensus_queue.cc:260] T 2177fcc303304952a036acbb82983fda P 79660023c1124b7e8da27181f34a5c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.343969 13816 raft_consensus.cc:359] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.345669 13821 tablet_bootstrap.cc:492] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0: No bootstrap required, opened a new log
I20260709 13:02:35.345923 13816 raft_consensus.cc:385] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.346232 13821 ts_tablet_manager.cc:1403] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent bootstrapping tablet: real 0.067s	user 0.019s	sys 0.012s
I20260709 13:02:35.346997 13817 ts_tablet_manager.cc:1434] T 2177fcc303304952a036acbb82983fda P 79660023c1124b7e8da27181f34a5c92: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:35.348104 13817 tablet_bootstrap.cc:492] T eb56f1ea81c24546bb53bb5763ccddc4 P 79660023c1124b7e8da27181f34a5c92: Bootstrap starting.
I20260709 13:02:35.346238 13816 raft_consensus.cc:740] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Initialized, Role: FOLLOWER
W20260709 13:02:35.351823 13573 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:35.350332 13816 consensus_queue.cc:260] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.357577 13816 ts_tablet_manager.cc:1434] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.004s
I20260709 13:02:35.358453 13817 tablet_bootstrap.cc:654] T eb56f1ea81c24546bb53bb5763ccddc4 P 79660023c1124b7e8da27181f34a5c92: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.359196 13816 tablet_bootstrap.cc:492] T 93f0a9b2a4014d229a766e13ae96be58 P 3d1f3335b323406f8f1ad7a1e277cdc7: Bootstrap starting.
I20260709 13:02:35.359421 13524 catalog_manager.cc:5697] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:35.354739 13821 raft_consensus.cc:359] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.364019 13821 raft_consensus.cc:385] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.364509 13821 raft_consensus.cc:740] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.365694 13821 consensus_queue.cc:260] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.367456 13816 tablet_bootstrap.cc:654] T 93f0a9b2a4014d229a766e13ae96be58 P 3d1f3335b323406f8f1ad7a1e277cdc7: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.370882 13825 raft_consensus.cc:493] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.371546 13825 raft_consensus.cc:515] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.373845 13820 raft_consensus.cc:493] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.374451 13820 raft_consensus.cc:515] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.377224 13820 leader_election.cc:290] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901)
I20260709 13:02:35.377785 13820 raft_consensus.cc:493] T 2177fcc303304952a036acbb82983fda P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.378237 13820 raft_consensus.cc:515] T 2177fcc303304952a036acbb82983fda P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.380337 13820 leader_election.cc:290] T 2177fcc303304952a036acbb82983fda P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901)
I20260709 13:02:35.385430 13825 leader_election.cc:290] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:35.398527 13836 raft_consensus.cc:493] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.399163 13836 raft_consensus.cc:515] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.400045 13821 ts_tablet_manager.cc:1434] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.001s
I20260709 13:02:35.403364 13776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854f9710b117408cb32500bffcc2f500" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79660023c1124b7e8da27181f34a5c92" is_pre_election: true
I20260709 13:02:35.404167 13776 raft_consensus.cc:2468] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d1f3335b323406f8f1ad7a1e277cdc7 in term 0.
I20260709 13:02:35.401125 13817 tablet_bootstrap.cc:492] T eb56f1ea81c24546bb53bb5763ccddc4 P 79660023c1124b7e8da27181f34a5c92: No bootstrap required, opened a new log
I20260709 13:02:35.408082 13590 leader_election.cc:304] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1f3335b323406f8f1ad7a1e277cdc7, 79660023c1124b7e8da27181f34a5c92; no voters: 
I20260709 13:02:35.405933 13821 tablet_bootstrap.cc:492] T 4a63f82eddf641898443ae8c2a8b9b1c P 3c82125d03ae4947ac9a79aebe4d8cf0: Bootstrap starting.
I20260709 13:02:35.405990 13702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854f9710b117408cb32500bffcc2f500" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" is_pre_election: true
I20260709 13:02:35.409061 13839 raft_consensus.cc:2804] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:35.409458 13839 raft_consensus.cc:493] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.409790 13839 raft_consensus.cc:3060] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:35.410166 13592 leader_election.cc:343] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.401371 13836 leader_election.cc:290] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:35.412772 13627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2177fcc303304952a036acbb82983fda" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" is_pre_election: true
W20260709 13:02:35.414659 13667 leader_election.cc:343] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.415366 13825 raft_consensus.cc:493] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.415885 13825 raft_consensus.cc:515] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.418125 13825 leader_election.cc:290] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:35.418933 13627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb56f1ea81c24546bb53bb5763ccddc4" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" is_pre_election: true
W20260709 13:02:35.420945 13667 leader_election.cc:343] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.421650 13839 raft_consensus.cc:515] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.408107 13817 ts_tablet_manager.cc:1403] T eb56f1ea81c24546bb53bb5763ccddc4 P 79660023c1124b7e8da27181f34a5c92: Time spent bootstrapping tablet: real 0.060s	user 0.024s	sys 0.006s
I20260709 13:02:35.427829 13776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854f9710b117408cb32500bffcc2f500" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79660023c1124b7e8da27181f34a5c92"
I20260709 13:02:35.428503 13776 raft_consensus.cc:3060] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.428836 13817 raft_consensus.cc:359] T eb56f1ea81c24546bb53bb5763ccddc4 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.429683 13817 raft_consensus.cc:385] T eb56f1ea81c24546bb53bb5763ccddc4 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.430156 13817 raft_consensus.cc:740] T eb56f1ea81c24546bb53bb5763ccddc4 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.430933 13817 consensus_queue.cc:260] T eb56f1ea81c24546bb53bb5763ccddc4 P 79660023c1124b7e8da27181f34a5c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.429461 13702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854f9710b117408cb32500bffcc2f500" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
I20260709 13:02:35.437398 13776 raft_consensus.cc:2468] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1f3335b323406f8f1ad7a1e277cdc7 in term 1.
I20260709 13:02:35.439349 13590 leader_election.cc:304] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1f3335b323406f8f1ad7a1e277cdc7, 79660023c1124b7e8da27181f34a5c92; no voters: 
W20260709 13:02:35.439950 13592 leader_election.cc:343] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.440253 13836 raft_consensus.cc:2804] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:35.440873 13836 raft_consensus.cc:697] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 LEADER]: Becoming Leader. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Running, Role: LEADER
I20260709 13:02:35.441721 13836 consensus_queue.cc:237] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.442909 13817 ts_tablet_manager.cc:1434] T eb56f1ea81c24546bb53bb5763ccddc4 P 79660023c1124b7e8da27181f34a5c92: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 13:02:35.446931 13816 tablet_bootstrap.cc:492] T 93f0a9b2a4014d229a766e13ae96be58 P 3d1f3335b323406f8f1ad7a1e277cdc7: No bootstrap required, opened a new log
I20260709 13:02:35.447576 13816 ts_tablet_manager.cc:1403] T 93f0a9b2a4014d229a766e13ae96be58 P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent bootstrapping tablet: real 0.089s	user 0.024s	sys 0.007s
I20260709 13:02:35.451756 13817 tablet_bootstrap.cc:492] T 93f0a9b2a4014d229a766e13ae96be58 P 79660023c1124b7e8da27181f34a5c92: Bootstrap starting.
I20260709 13:02:35.450677 13816 raft_consensus.cc:359] T 93f0a9b2a4014d229a766e13ae96be58 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.455027 13816 raft_consensus.cc:385] T 93f0a9b2a4014d229a766e13ae96be58 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.455374 13816 raft_consensus.cc:740] T 93f0a9b2a4014d229a766e13ae96be58 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.456101 13821 tablet_bootstrap.cc:654] T 4a63f82eddf641898443ae8c2a8b9b1c P 3c82125d03ae4947ac9a79aebe4d8cf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.457718 13816 consensus_queue.cc:260] T 93f0a9b2a4014d229a766e13ae96be58 P 3d1f3335b323406f8f1ad7a1e277cdc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.459296 13817 tablet_bootstrap.cc:654] T 93f0a9b2a4014d229a766e13ae96be58 P 79660023c1124b7e8da27181f34a5c92: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.437983 13839 leader_election.cc:290] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 election: Requested vote from peers 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:35.462829 13775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb56f1ea81c24546bb53bb5763ccddc4" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79660023c1124b7e8da27181f34a5c92" is_pre_election: true
I20260709 13:02:35.463764 13775 raft_consensus.cc:2468] T eb56f1ea81c24546bb53bb5763ccddc4 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in term 0.
I20260709 13:02:35.465323 13665 leader_election.cc:304] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 79660023c1124b7e8da27181f34a5c92; no voters: 3d1f3335b323406f8f1ad7a1e277cdc7
I20260709 13:02:35.466771 13825 raft_consensus.cc:2804] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:35.467202 13825 raft_consensus.cc:493] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.467559 13825 raft_consensus.cc:3060] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.472976 13776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2177fcc303304952a036acbb82983fda" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79660023c1124b7e8da27181f34a5c92" is_pre_election: true
I20260709 13:02:35.473562 13850 raft_consensus.cc:493] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.473894 13776 raft_consensus.cc:2468] T 2177fcc303304952a036acbb82983fda P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in term 0.
I20260709 13:02:35.474139 13850 raft_consensus.cc:515] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.475333 13665 leader_election.cc:304] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 79660023c1124b7e8da27181f34a5c92; no voters: 3d1f3335b323406f8f1ad7a1e277cdc7
I20260709 13:02:35.476642 13850 leader_election.cc:290] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901)
I20260709 13:02:35.479310 13627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a63f82eddf641898443ae8c2a8b9b1c" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" is_pre_election: true
I20260709 13:02:35.480094 13627 raft_consensus.cc:2468] T 4a63f82eddf641898443ae8c2a8b9b1c P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79660023c1124b7e8da27181f34a5c92 in term 0.
I20260709 13:02:35.482232 13627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2177fcc303304952a036acbb82983fda" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" is_pre_election: true
I20260709 13:02:35.483916 13821 tablet_bootstrap.cc:492] T 4a63f82eddf641898443ae8c2a8b9b1c P 3c82125d03ae4947ac9a79aebe4d8cf0: No bootstrap required, opened a new log
I20260709 13:02:35.484299 13627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a59bf8b7ad4c42931ad97808e91469" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" is_pre_election: true
I20260709 13:02:35.485073 13627 raft_consensus.cc:2468] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79660023c1124b7e8da27181f34a5c92 in term 0.
I20260709 13:02:35.484598 13821 ts_tablet_manager.cc:1403] T 4a63f82eddf641898443ae8c2a8b9b1c P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent bootstrapping tablet: real 0.079s	user 0.018s	sys 0.002s
I20260709 13:02:35.487321 13825 raft_consensus.cc:515] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.487949 13821 raft_consensus.cc:359] T 4a63f82eddf641898443ae8c2a8b9b1c P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.488665 13821 raft_consensus.cc:385] T 4a63f82eddf641898443ae8c2a8b9b1c P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.488881 13821 raft_consensus.cc:740] T 4a63f82eddf641898443ae8c2a8b9b1c P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.489530 13821 consensus_queue.cc:260] T 4a63f82eddf641898443ae8c2a8b9b1c P 3c82125d03ae4947ac9a79aebe4d8cf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.491097 13741 leader_election.cc:304] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1f3335b323406f8f1ad7a1e277cdc7, 79660023c1124b7e8da27181f34a5c92; no voters: 
I20260709 13:02:35.492063 13850 raft_consensus.cc:2804] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:35.492425 13850 raft_consensus.cc:493] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.492794 13850 raft_consensus.cc:3060] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.494293 13816 ts_tablet_manager.cc:1434] T 93f0a9b2a4014d229a766e13ae96be58 P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.002s
I20260709 13:02:35.495639 13816 tablet_bootstrap.cc:492] T 93b5051b31254e9189de01203c87bc4e P 3d1f3335b323406f8f1ad7a1e277cdc7: Bootstrap starting.
I20260709 13:02:35.496693 13839 raft_consensus.cc:493] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.497251 13839 raft_consensus.cc:515] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.497459 13523 catalog_manager.cc:5697] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:35.499511 13839 leader_election.cc:290] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
W20260709 13:02:35.500829 13741 leader_election.cc:343] T 2177fcc303304952a036acbb82983fda P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.501729 13741 leader_election.cc:304] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1f3335b323406f8f1ad7a1e277cdc7, 79660023c1124b7e8da27181f34a5c92; no voters: 
I20260709 13:02:35.502272 13702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a59bf8b7ad4c42931ad97808e91469" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" is_pre_election: true
I20260709 13:02:35.503589 13627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb56f1ea81c24546bb53bb5763ccddc4" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
I20260709 13:02:35.504189 13820 raft_consensus.cc:2804] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:35.504616 13820 raft_consensus.cc:493] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.504976 13820 raft_consensus.cc:3060] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:35.505221 13667 leader_election.cc:343] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.505823 13850 raft_consensus.cc:515] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.507690 13775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb56f1ea81c24546bb53bb5763ccddc4" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79660023c1124b7e8da27181f34a5c92"
W20260709 13:02:35.505302 13592 leader_election.cc:343] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.508978 13825 leader_election.cc:290] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 election: Requested vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:35.508387 13775 raft_consensus.cc:3060] T eb56f1ea81c24546bb53bb5763ccddc4 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.509881 13627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a63f82eddf641898443ae8c2a8b9b1c" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
I20260709 13:02:35.510375 13821 ts_tablet_manager.cc:1434] T 4a63f82eddf641898443ae8c2a8b9b1c P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent starting tablet: real 0.025s	user 0.001s	sys 0.004s
I20260709 13:02:35.510548 13627 raft_consensus.cc:3060] T 4a63f82eddf641898443ae8c2a8b9b1c P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.515425 13776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a59bf8b7ad4c42931ad97808e91469" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79660023c1124b7e8da27181f34a5c92" is_pre_election: true
I20260709 13:02:35.518757 13821 tablet_bootstrap.cc:492] T 42a59bf8b7ad4c42931ad97808e91469 P 3c82125d03ae4947ac9a79aebe4d8cf0: Bootstrap starting.
I20260709 13:02:35.519969 13820 raft_consensus.cc:515] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.521926 13776 raft_consensus.cc:2393] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3d1f3335b323406f8f1ad7a1e277cdc7 in current term 1: Already voted for candidate 79660023c1124b7e8da27181f34a5c92 in this term.
I20260709 13:02:35.524048 13626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a59bf8b7ad4c42931ad97808e91469" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
I20260709 13:02:35.524804 13626 raft_consensus.cc:3060] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.525899 13775 raft_consensus.cc:2468] T eb56f1ea81c24546bb53bb5763ccddc4 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in term 1.
I20260709 13:02:35.527629 13590 leader_election.cc:304] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d1f3335b323406f8f1ad7a1e277cdc7; no voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 79660023c1124b7e8da27181f34a5c92
I20260709 13:02:35.529632 13825 raft_consensus.cc:493] T 93f0a9b2a4014d229a766e13ae96be58 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.529888 13836 raft_consensus.cc:493] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.530385 13825 raft_consensus.cc:515] T 93f0a9b2a4014d229a766e13ae96be58 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.530768 13836 raft_consensus.cc:515] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } } peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } }
I20260709 13:02:35.533242 13626 raft_consensus.cc:2468] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79660023c1124b7e8da27181f34a5c92 in term 1.
I20260709 13:02:35.533872 13839 raft_consensus.cc:2749] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:35.534540 13817 tablet_bootstrap.cc:492] T 93f0a9b2a4014d229a766e13ae96be58 P 79660023c1124b7e8da27181f34a5c92: No bootstrap required, opened a new log
I20260709 13:02:35.535681 13702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba8cd98760e4f269f64ee27c6a368e6" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" is_pre_election: true
I20260709 13:02:35.541885 13699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a59bf8b7ad4c42931ad97808e91469" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" is_pre_election: true
I20260709 13:02:35.491513 13859 raft_consensus.cc:2804] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:35.542619 13859 raft_consensus.cc:493] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.537467 13625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f0a9b2a4014d229a766e13ae96be58" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" is_pre_election: true
I20260709 13:02:35.543308 13625 raft_consensus.cc:2468] T 93f0a9b2a4014d229a766e13ae96be58 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in term 0.
W20260709 13:02:35.543452 13592 leader_election.cc:343] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.536266 13836 leader_election.cc:290] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687), 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901)
I20260709 13:02:35.538108 13701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a63f82eddf641898443ae8c2a8b9b1c" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" is_pre_election: true
I20260709 13:02:35.538489 13825 leader_election.cc:290] T 93f0a9b2a4014d229a766e13ae96be58 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:35.538115 13665 leader_election.cc:304] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 79660023c1124b7e8da27181f34a5c92; no voters: 3d1f3335b323406f8f1ad7a1e277cdc7
W20260709 13:02:35.545047 13741 leader_election.cc:343] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.545526 13859 raft_consensus.cc:3060] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.547000 13858 raft_consensus.cc:2804] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:35.547447 13775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f0a9b2a4014d229a766e13ae96be58" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79660023c1124b7e8da27181f34a5c92" is_pre_election: true
I20260709 13:02:35.539675 13700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2177fcc303304952a036acbb82983fda" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" is_pre_election: true
I20260709 13:02:35.548439 13858 raft_consensus.cc:697] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 LEADER]: Becoming Leader. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Running, Role: LEADER
I20260709 13:02:35.549379 13858 consensus_queue.cc:237] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.550556 13860 raft_consensus.cc:493] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.551107 13860 raft_consensus.cc:515] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.535552 13627 raft_consensus.cc:2468] T 4a63f82eddf641898443ae8c2a8b9b1c P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79660023c1124b7e8da27181f34a5c92 in term 1.
I20260709 13:02:35.540879 13816 tablet_bootstrap.cc:654] T 93b5051b31254e9189de01203c87bc4e P 3d1f3335b323406f8f1ad7a1e277cdc7: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.540923 13698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a63f82eddf641898443ae8c2a8b9b1c" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
I20260709 13:02:35.541361 13697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a59bf8b7ad4c42931ad97808e91469" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
I20260709 13:02:35.542198 13817 ts_tablet_manager.cc:1403] T 93f0a9b2a4014d229a766e13ae96be58 P 79660023c1124b7e8da27181f34a5c92: Time spent bootstrapping tablet: real 0.091s	user 0.032s	sys 0.022s
I20260709 13:02:35.556255 13817 raft_consensus.cc:359] T 93f0a9b2a4014d229a766e13ae96be58 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.557024 13817 raft_consensus.cc:385] T 93f0a9b2a4014d229a766e13ae96be58 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.557293 13817 raft_consensus.cc:740] T 93f0a9b2a4014d229a766e13ae96be58 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.508108 13850 leader_election.cc:290] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 election: Requested vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901)
I20260709 13:02:35.522233 13820 leader_election.cc:290] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 election: Requested vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901)
I20260709 13:02:35.544790 13667 leader_election.cc:304] T 93f0a9b2a4014d229a766e13ae96be58 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 3d1f3335b323406f8f1ad7a1e277cdc7; no voters: 
I20260709 13:02:35.558236 13817 consensus_queue.cc:260] T 93f0a9b2a4014d229a766e13ae96be58 P 79660023c1124b7e8da27181f34a5c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
W20260709 13:02:35.559443 13665 leader_election.cc:343] T 93f0a9b2a4014d229a766e13ae96be58 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.561283 13626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b5051b31254e9189de01203c87bc4e" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" is_pre_election: true
I20260709 13:02:35.545049 13701 raft_consensus.cc:2468] T 4a63f82eddf641898443ae8c2a8b9b1c P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79660023c1124b7e8da27181f34a5c92 in term 0.
I20260709 13:02:35.561440 13697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b5051b31254e9189de01203c87bc4e" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" is_pre_election: true
I20260709 13:02:35.536947 13776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba8cd98760e4f269f64ee27c6a368e6" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79660023c1124b7e8da27181f34a5c92" is_pre_election: true
W20260709 13:02:35.562685 13741 leader_election.cc:343] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.562652 13697 raft_consensus.cc:2468] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79660023c1124b7e8da27181f34a5c92 in term 0.
I20260709 13:02:35.563597 13741 leader_election.cc:304] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d1f3335b323406f8f1ad7a1e277cdc7, 79660023c1124b7e8da27181f34a5c92; no voters: 3c82125d03ae4947ac9a79aebe4d8cf0
I20260709 13:02:35.564603 13741 leader_election.cc:304] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d1f3335b323406f8f1ad7a1e277cdc7, 79660023c1124b7e8da27181f34a5c92; no voters: 3c82125d03ae4947ac9a79aebe4d8cf0
I20260709 13:02:35.565901 13862 raft_consensus.cc:493] T 0ba8cd98760e4f269f64ee27c6a368e6 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.566584 13862 raft_consensus.cc:515] T 0ba8cd98760e4f269f64ee27c6a368e6 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } } peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } }
I20260709 13:02:35.567723 13776 raft_consensus.cc:2468] T 0ba8cd98760e4f269f64ee27c6a368e6 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d1f3335b323406f8f1ad7a1e277cdc7 in term 0.
I20260709 13:02:35.558164 13859 raft_consensus.cc:515] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.568859 13820 raft_consensus.cc:2804] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:35.569303 13700 raft_consensus.cc:2393] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79660023c1124b7e8da27181f34a5c92 in current term 1: Already voted for candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in this term.
I20260709 13:02:35.569427 13820 raft_consensus.cc:697] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92 [term 1 LEADER]: Becoming Leader. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Running, Role: LEADER
I20260709 13:02:35.570394 13820 consensus_queue.cc:237] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.571578 13858 raft_consensus.cc:493] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.572127 13858 raft_consensus.cc:515] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.571487 13590 leader_election.cc:304] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d1f3335b323406f8f1ad7a1e277cdc7, 79660023c1124b7e8da27181f34a5c92; no voters: 3c82125d03ae4947ac9a79aebe4d8cf0
I20260709 13:02:35.576263 13836 raft_consensus.cc:2804] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:35.576763 13836 raft_consensus.cc:493] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.577111 13836 raft_consensus.cc:3060] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.577250 13859 leader_election.cc:290] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 election: Requested vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:35.576124 13626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2177fcc303304952a036acbb82983fda" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
I20260709 13:02:35.576785 13627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b5051b31254e9189de01203c87bc4e" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" is_pre_election: true
I20260709 13:02:35.562954 13861 raft_consensus.cc:2804] T 93f0a9b2a4014d229a766e13ae96be58 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:35.579061 13850 raft_consensus.cc:2804] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:35.573930 13860 leader_election.cc:290] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901)
W20260709 13:02:35.580862 13667 leader_election.cc:343] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.582505 13817 ts_tablet_manager.cc:1434] T 93f0a9b2a4014d229a766e13ae96be58 P 79660023c1124b7e8da27181f34a5c92: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.006s
W20260709 13:02:35.582827 13667 leader_election.cc:343] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.579221 13524 catalog_manager.cc:5697] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:35.580039 13861 raft_consensus.cc:493] T 93f0a9b2a4014d229a766e13ae96be58 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.584327 13741 leader_election.cc:304] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 79660023c1124b7e8da27181f34a5c92; no voters: 
W20260709 13:02:35.587885 13741 leader_election.cc:343] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.587883 13776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2177fcc303304952a036acbb82983fda" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79660023c1124b7e8da27181f34a5c92"
I20260709 13:02:35.588754 13776 raft_consensus.cc:3060] T 2177fcc303304952a036acbb82983fda P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.589093 13860 raft_consensus.cc:2804] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:35.589514 13860 raft_consensus.cc:493] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.589855 13860 raft_consensus.cc:3060] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.592609 13821 tablet_bootstrap.cc:654] T 42a59bf8b7ad4c42931ad97808e91469 P 3c82125d03ae4947ac9a79aebe4d8cf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.595816 13858 leader_election.cc:290] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:35.585860 13850 raft_consensus.cc:697] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [term 1 LEADER]: Becoming Leader. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Running, Role: LEADER
I20260709 13:02:35.586450 13861 raft_consensus.cc:3060] T 93f0a9b2a4014d229a766e13ae96be58 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.597348 13741 leader_election.cc:304] T 2177fcc303304952a036acbb82983fda P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79660023c1124b7e8da27181f34a5c92; no voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 3d1f3335b323406f8f1ad7a1e277cdc7
I20260709 13:02:35.597963 13775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b5051b31254e9189de01203c87bc4e" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79660023c1124b7e8da27181f34a5c92" is_pre_election: true
I20260709 13:02:35.596385 13776 raft_consensus.cc:2468] T 2177fcc303304952a036acbb82983fda P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in term 1.
I20260709 13:02:35.599336 13866 raft_consensus.cc:2749] T 2177fcc303304952a036acbb82983fda P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:35.599783 13665 leader_election.cc:304] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 79660023c1124b7e8da27181f34a5c92; no voters: 3d1f3335b323406f8f1ad7a1e277cdc7
I20260709 13:02:35.600596 13850 consensus_queue.cc:237] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.601178 13858 raft_consensus.cc:2804] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:35.601912 13858 raft_consensus.cc:697] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 LEADER]: Becoming Leader. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Running, Role: LEADER
I20260709 13:02:35.602744 13858 consensus_queue.cc:237] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.603080 13836 raft_consensus.cc:515] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } } peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } }
I20260709 13:02:35.607043 13816 tablet_bootstrap.cc:492] T 93b5051b31254e9189de01203c87bc4e P 3d1f3335b323406f8f1ad7a1e277cdc7: No bootstrap required, opened a new log
I20260709 13:02:35.607693 13816 ts_tablet_manager.cc:1403] T 93b5051b31254e9189de01203c87bc4e P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent bootstrapping tablet: real 0.112s	user 0.011s	sys 0.008s
I20260709 13:02:35.607908 13776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba8cd98760e4f269f64ee27c6a368e6" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79660023c1124b7e8da27181f34a5c92"
I20260709 13:02:35.608608 13776 raft_consensus.cc:3060] T 0ba8cd98760e4f269f64ee27c6a368e6 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.609149 13821 tablet_bootstrap.cc:492] T 42a59bf8b7ad4c42931ad97808e91469 P 3c82125d03ae4947ac9a79aebe4d8cf0: No bootstrap required, opened a new log
I20260709 13:02:35.609870 13821 ts_tablet_manager.cc:1403] T 42a59bf8b7ad4c42931ad97808e91469 P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent bootstrapping tablet: real 0.091s	user 0.010s	sys 0.002s
I20260709 13:02:35.610693 13816 raft_consensus.cc:359] T 93b5051b31254e9189de01203c87bc4e P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.611481 13816 raft_consensus.cc:385] T 93b5051b31254e9189de01203c87bc4e P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.611778 13816 raft_consensus.cc:740] T 93b5051b31254e9189de01203c87bc4e P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.613197 13862 leader_election.cc:290] T 0ba8cd98760e4f269f64ee27c6a368e6 P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901)
I20260709 13:02:35.613539 13860 raft_consensus.cc:515] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.614811 13775 raft_consensus.cc:2393] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in current term 1: Already voted for candidate 79660023c1124b7e8da27181f34a5c92 in this term.
I20260709 13:02:35.615447 13700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba8cd98760e4f269f64ee27c6a368e6" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" is_pre_election: true
I20260709 13:02:35.616691 13627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba8cd98760e4f269f64ee27c6a368e6" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" is_pre_election: true
I20260709 13:02:35.616940 13776 raft_consensus.cc:2468] T 0ba8cd98760e4f269f64ee27c6a368e6 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1f3335b323406f8f1ad7a1e277cdc7 in term 1.
W20260709 13:02:35.617553 13741 leader_election.cc:343] T 0ba8cd98760e4f269f64ee27c6a368e6 P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.618618 13665 leader_election.cc:304] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0; no voters: 3d1f3335b323406f8f1ad7a1e277cdc7, 79660023c1124b7e8da27181f34a5c92
I20260709 13:02:35.619931 13859 raft_consensus.cc:3060] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.617568 13627 raft_consensus.cc:2393] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79660023c1124b7e8da27181f34a5c92 in current term 1: Already voted for candidate 3d1f3335b323406f8f1ad7a1e277cdc7 in this term.
I20260709 13:02:35.622200 13590 leader_election.cc:304] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1f3335b323406f8f1ad7a1e277cdc7, 79660023c1124b7e8da27181f34a5c92; no voters: 
I20260709 13:02:35.623332 13741 leader_election.cc:304] T 0ba8cd98760e4f269f64ee27c6a368e6 P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79660023c1124b7e8da27181f34a5c92; no voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 3d1f3335b323406f8f1ad7a1e277cdc7
I20260709 13:02:35.625108 13700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ba8cd98760e4f269f64ee27c6a368e6" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
I20260709 13:02:35.624929 13861 raft_consensus.cc:515] T 93f0a9b2a4014d229a766e13ae96be58 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.626807 13862 raft_consensus.cc:2749] T 0ba8cd98760e4f269f64ee27c6a368e6 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:35.623279 13839 raft_consensus.cc:2804] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:35.628580 13839 raft_consensus.cc:697] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 LEADER]: Becoming Leader. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Running, Role: LEADER
I20260709 13:02:35.629570 13839 consensus_queue.cc:237] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } } peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } }
I20260709 13:02:35.634193 13700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b5051b31254e9189de01203c87bc4e" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
I20260709 13:02:35.620453 13836 leader_election.cc:290] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 election: Requested vote from peers 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687), 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901)
I20260709 13:02:35.636125 13627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f0a9b2a4014d229a766e13ae96be58" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
I20260709 13:02:35.627899 13860 leader_election.cc:290] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 election: Requested vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901)
I20260709 13:02:35.636487 13821 raft_consensus.cc:359] T 42a59bf8b7ad4c42931ad97808e91469 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.637326 13821 raft_consensus.cc:385] T 42a59bf8b7ad4c42931ad97808e91469 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.637637 13821 raft_consensus.cc:740] T 42a59bf8b7ad4c42931ad97808e91469 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.641089 13627 raft_consensus.cc:3060] T 93f0a9b2a4014d229a766e13ae96be58 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.641644 13821 consensus_queue.cc:260] T 42a59bf8b7ad4c42931ad97808e91469 P 3c82125d03ae4947ac9a79aebe4d8cf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
W20260709 13:02:35.627954 13592 leader_election.cc:343] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:35.646684 13776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93f0a9b2a4014d229a766e13ae96be58" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79660023c1124b7e8da27181f34a5c92"
I20260709 13:02:35.647369 13776 raft_consensus.cc:3060] T 93f0a9b2a4014d229a766e13ae96be58 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.648429 13626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b5051b31254e9189de01203c87bc4e" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
I20260709 13:02:35.648456 13821 ts_tablet_manager.cc:1434] T 42a59bf8b7ad4c42931ad97808e91469 P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.002s
I20260709 13:02:35.646112 13861 leader_election.cc:290] T 93f0a9b2a4014d229a766e13ae96be58 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 election: Requested vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:35.650892 13821 tablet_bootstrap.cc:492] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3c82125d03ae4947ac9a79aebe4d8cf0: Bootstrap starting.
I20260709 13:02:35.653450 13861 raft_consensus.cc:493] T 42a59bf8b7ad4c42931ad97808e91469 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.654429 13861 raft_consensus.cc:515] T 42a59bf8b7ad4c42931ad97808e91469 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.653703 13859 raft_consensus.cc:2749] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:35.655843 13776 raft_consensus.cc:2468] T 93f0a9b2a4014d229a766e13ae96be58 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in term 1.
I20260709 13:02:35.653049 13816 consensus_queue.cc:260] T 93b5051b31254e9189de01203c87bc4e P 3d1f3335b323406f8f1ad7a1e277cdc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.657274 13665 leader_election.cc:304] T 93f0a9b2a4014d229a766e13ae96be58 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 79660023c1124b7e8da27181f34a5c92; no voters: 
I20260709 13:02:35.657419 13626 raft_consensus.cc:3060] T 93b5051b31254e9189de01203c87bc4e P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.657971 13625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a59bf8b7ad4c42931ad97808e91469" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" is_pre_election: true
I20260709 13:02:35.663069 13825 raft_consensus.cc:2804] T 93f0a9b2a4014d229a766e13ae96be58 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:35.688782 13625 raft_consensus.cc:2393] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in current term 1: Already voted for candidate 79660023c1124b7e8da27181f34a5c92 in this term.
I20260709 13:02:35.693976 13776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a59bf8b7ad4c42931ad97808e91469" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79660023c1124b7e8da27181f34a5c92" is_pre_election: true
I20260709 13:02:35.696215 13523 catalog_manager.cc:5697] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:35.697692 13700 raft_consensus.cc:2468] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79660023c1124b7e8da27181f34a5c92 in term 1.
I20260709 13:02:35.698189 13627 raft_consensus.cc:2468] T 93f0a9b2a4014d229a766e13ae96be58 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in term 1.
I20260709 13:02:35.700258 13741 leader_election.cc:304] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 79660023c1124b7e8da27181f34a5c92; no voters: 
I20260709 13:02:35.701444 13820 raft_consensus.cc:2804] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:35.701967 13820 raft_consensus.cc:697] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [term 1 LEADER]: Becoming Leader. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Running, Role: LEADER
I20260709 13:02:35.702881 13820 consensus_queue.cc:237] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.704546 13825 raft_consensus.cc:697] T 93f0a9b2a4014d229a766e13ae96be58 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 LEADER]: Becoming Leader. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Running, Role: LEADER
I20260709 13:02:35.705494 13825 consensus_queue.cc:237] T 93f0a9b2a4014d229a766e13ae96be58 P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.703853 13524 catalog_manager.cc:5697] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79660023c1124b7e8da27181f34a5c92 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "79660023c1124b7e8da27181f34a5c92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.686228 13861 leader_election.cc:290] T 42a59bf8b7ad4c42931ad97808e91469 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:35.707959 13524 catalog_manager.cc:5697] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79660023c1124b7e8da27181f34a5c92 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "79660023c1124b7e8da27181f34a5c92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.713780 13665 leader_election.cc:304] T 42a59bf8b7ad4c42931ad97808e91469 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0; no voters: 3d1f3335b323406f8f1ad7a1e277cdc7, 79660023c1124b7e8da27181f34a5c92
I20260709 13:02:35.715129 13861 raft_consensus.cc:3060] T 42a59bf8b7ad4c42931ad97808e91469 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.716715 13821 tablet_bootstrap.cc:654] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3c82125d03ae4947ac9a79aebe4d8cf0: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:35.722898 13868 log.cc:927] Time spent T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92: Append to log took a long time: real 0.055s	user 0.000s	sys 0.009s
I20260709 13:02:35.728150 13523 catalog_manager.cc:5697] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:35.734185 13626 raft_consensus.cc:2468] T 93b5051b31254e9189de01203c87bc4e P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79660023c1124b7e8da27181f34a5c92 in term 1.
I20260709 13:02:35.740772 13861 raft_consensus.cc:2749] T 42a59bf8b7ad4c42931ad97808e91469 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:35.744239 13816 ts_tablet_manager.cc:1434] T 93b5051b31254e9189de01203c87bc4e P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent starting tablet: real 0.136s	user 0.010s	sys 0.008s
I20260709 13:02:35.748266 13816 tablet_bootstrap.cc:492] T 2177fcc303304952a036acbb82983fda P 3d1f3335b323406f8f1ad7a1e277cdc7: Bootstrap starting.
I20260709 13:02:35.746661 13836 consensus_queue.cc:1048] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:35.769052 13816 tablet_bootstrap.cc:654] T 2177fcc303304952a036acbb82983fda P 3d1f3335b323406f8f1ad7a1e277cdc7: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.785203 13816 tablet_bootstrap.cc:492] T 2177fcc303304952a036acbb82983fda P 3d1f3335b323406f8f1ad7a1e277cdc7: No bootstrap required, opened a new log
I20260709 13:02:35.785878 13816 ts_tablet_manager.cc:1403] T 2177fcc303304952a036acbb82983fda P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.000s
I20260709 13:02:35.787238 13524 catalog_manager.cc:5697] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79660023c1124b7e8da27181f34a5c92 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "79660023c1124b7e8da27181f34a5c92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:35.789413 13816 raft_consensus.cc:359] T 2177fcc303304952a036acbb82983fda P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.790378 13816 raft_consensus.cc:385] T 2177fcc303304952a036acbb82983fda P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.790705 13816 raft_consensus.cc:740] T 2177fcc303304952a036acbb82983fda P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.791798 13821 tablet_bootstrap.cc:492] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3c82125d03ae4947ac9a79aebe4d8cf0: No bootstrap required, opened a new log
I20260709 13:02:35.791589 13816 consensus_queue.cc:260] T 2177fcc303304952a036acbb82983fda P 3d1f3335b323406f8f1ad7a1e277cdc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.792568 13821 ts_tablet_manager.cc:1403] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent bootstrapping tablet: real 0.142s	user 0.021s	sys 0.003s
I20260709 13:02:35.793991 13816 ts_tablet_manager.cc:1434] T 2177fcc303304952a036acbb82983fda P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:02:35.795513 13816 tablet_bootstrap.cc:492] T eb56f1ea81c24546bb53bb5763ccddc4 P 3d1f3335b323406f8f1ad7a1e277cdc7: Bootstrap starting.
I20260709 13:02:35.796092 13821 raft_consensus.cc:359] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } } peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } }
I20260709 13:02:35.797345 13821 raft_consensus.cc:385] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.797669 13821 raft_consensus.cc:740] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.798570 13821 consensus_queue.cc:260] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } } peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } }
I20260709 13:02:35.800729 13821 ts_tablet_manager.cc:1434] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:02:35.801779 13821 tablet_bootstrap.cc:492] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0: Bootstrap starting.
I20260709 13:02:35.802569 13816 tablet_bootstrap.cc:654] T eb56f1ea81c24546bb53bb5763ccddc4 P 3d1f3335b323406f8f1ad7a1e277cdc7: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.804185 13523 catalog_manager.cc:5697] T 93f0a9b2a4014d229a766e13ae96be58 P 3c82125d03ae4947ac9a79aebe4d8cf0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:35.808983 13821 tablet_bootstrap.cc:654] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.821166 13821 tablet_bootstrap.cc:492] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0: No bootstrap required, opened a new log
I20260709 13:02:35.821729 13821 ts_tablet_manager.cc:1403] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:02:35.824625 13821 raft_consensus.cc:359] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.825433 13821 raft_consensus.cc:385] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.825733 13821 raft_consensus.cc:740] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.826771 13821 consensus_queue.cc:260] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.829016 13821 ts_tablet_manager.cc:1434] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:02:35.832993 13816 tablet_bootstrap.cc:492] T eb56f1ea81c24546bb53bb5763ccddc4 P 3d1f3335b323406f8f1ad7a1e277cdc7: No bootstrap required, opened a new log
I20260709 13:02:35.833549 13816 ts_tablet_manager.cc:1403] T eb56f1ea81c24546bb53bb5763ccddc4 P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent bootstrapping tablet: real 0.038s	user 0.030s	sys 0.006s
I20260709 13:02:35.836014 13836 consensus_queue.cc:1048] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:35.836130 13816 raft_consensus.cc:359] T eb56f1ea81c24546bb53bb5763ccddc4 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.836923 13816 raft_consensus.cc:385] T eb56f1ea81c24546bb53bb5763ccddc4 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.837214 13816 raft_consensus.cc:740] T eb56f1ea81c24546bb53bb5763ccddc4 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.837950 13816 consensus_queue.cc:260] T eb56f1ea81c24546bb53bb5763ccddc4 P 3d1f3335b323406f8f1ad7a1e277cdc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.840204 13816 ts_tablet_manager.cc:1434] T eb56f1ea81c24546bb53bb5763ccddc4 P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 13:02:35.904098 13825 raft_consensus.cc:493] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.904758 13825 raft_consensus.cc:515] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:35.906401 13825 leader_election.cc:290] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:35.907377 13626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854f9710b117408cb32500bffcc2f500" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" is_pre_election: true
I20260709 13:02:35.907518 13776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854f9710b117408cb32500bffcc2f500" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79660023c1124b7e8da27181f34a5c92" is_pre_election: true
I20260709 13:02:35.908245 13776 raft_consensus.cc:2393] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in current term 1: Already voted for candidate 3d1f3335b323406f8f1ad7a1e277cdc7 in this term.
I20260709 13:02:35.909276 13665 leader_election.cc:304] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0; no voters: 3d1f3335b323406f8f1ad7a1e277cdc7, 79660023c1124b7e8da27181f34a5c92
I20260709 13:02:35.909947 13825 raft_consensus.cc:3060] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.915337 13825 raft_consensus.cc:2749] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:35.990593 13836 consensus_queue.cc:1048] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:36.001390 13822 consensus_queue.cc:1048] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:36.020697 13820 consensus_queue.cc:1048] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:36.023512 13776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42a59bf8b7ad4c42931ad97808e91469"
dest_uuid: "79660023c1124b7e8da27181f34a5c92"
mode: GRACEFUL
new_leader_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
 from {username='slave'} at 127.0.0.1:53282
I20260709 13:02:36.024222 13776 raft_consensus.cc:606] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [term 1 LEADER]: Received request to transfer leadership to TS 3d1f3335b323406f8f1ad7a1e277cdc7
I20260709 13:02:36.027340 13822 consensus_queue.cc:1048] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:36.034276 13700 raft_consensus.cc:3060] T 4a63f82eddf641898443ae8c2a8b9b1c P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:36.037000 13776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a63f82eddf641898443ae8c2a8b9b1c"
dest_uuid: "79660023c1124b7e8da27181f34a5c92"
mode: GRACEFUL
new_leader_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
 from {username='slave'} at 127.0.0.1:53282
I20260709 13:02:36.037744 13776 raft_consensus.cc:606] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92 [term 1 LEADER]: Received request to transfer leadership to TS 3d1f3335b323406f8f1ad7a1e277cdc7
I20260709 13:02:36.042641 13860 consensus_queue.cc:1048] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:36.045686 13697 raft_consensus.cc:3060] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:36.050782 13776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93b5051b31254e9189de01203c87bc4e"
dest_uuid: "79660023c1124b7e8da27181f34a5c92"
mode: GRACEFUL
new_leader_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
 from {username='slave'} at 127.0.0.1:53282
I20260709 13:02:36.051762 13776 raft_consensus.cc:606] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [term 1 LEADER]: Received request to transfer leadership to TS 3c82125d03ae4947ac9a79aebe4d8cf0
I20260709 13:02:36.057406 13822 consensus_queue.cc:1048] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:36.064401 13626 raft_consensus.cc:3060] T eb56f1ea81c24546bb53bb5763ccddc4 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:36.069619 13625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "854f9710b117408cb32500bffcc2f500"
dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
mode: GRACEFUL
new_leader_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
 from {username='slave'} at 127.0.0.1:52116
I20260709 13:02:36.070351 13625 raft_consensus.cc:606] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 LEADER]: Received request to transfer leadership to TS 3c82125d03ae4947ac9a79aebe4d8cf0
I20260709 13:02:36.070261 13860 consensus_queue.cc:1048] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:36.078660 13825 consensus_queue.cc:1048] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:36.094511 13861 consensus_queue.cc:1048] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:36.097409 13862 raft_consensus.cc:993] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92: : Instructing follower 3d1f3335b323406f8f1ad7a1e277cdc7 to start an election
I20260709 13:02:36.097977 13862 raft_consensus.cc:1081] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [term 1 LEADER]: Signalling peer 3d1f3335b323406f8f1ad7a1e277cdc7 to start an election
I20260709 13:02:36.097939 13825 consensus_queue.cc:1048] T 93f0a9b2a4014d229a766e13ae96be58 P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:36.108559 13860 consensus_queue.cc:1048] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:36.118834 13701 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb56f1ea81c24546bb53bb5763ccddc4"
dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
mode: GRACEFUL
new_leader_uuid: "79660023c1124b7e8da27181f34a5c92"
 from {username='slave'} at 127.0.0.1:45142
I20260709 13:02:36.119544 13701 raft_consensus.cc:606] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 LEADER]: Received request to transfer leadership to TS 79660023c1124b7e8da27181f34a5c92
I20260709 13:02:36.120123 13627 raft_consensus.cc:3060] T 2177fcc303304952a036acbb82983fda P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:36.121737 13861 consensus_queue.cc:1048] T 93f0a9b2a4014d229a766e13ae96be58 P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:36.134153 13626 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42a59bf8b7ad4c42931ad97808e91469"
dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
 from {username='slave'} at 127.0.0.1:52110
I20260709 13:02:36.135061 13626 raft_consensus.cc:493] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:36.136114 13626 raft_consensus.cc:3060] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:36.141201 13861 consensus_queue.cc:1048] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:36.152536 13861 raft_consensus.cc:993] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0: : Instructing follower 79660023c1124b7e8da27181f34a5c92 to start an election
I20260709 13:02:36.153335 13861 raft_consensus.cc:1081] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 LEADER]: Signalling peer 79660023c1124b7e8da27181f34a5c92 to start an election
I20260709 13:02:36.152509 13626 raft_consensus.cc:515] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:36.158063 13776 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb56f1ea81c24546bb53bb5763ccddc4"
dest_uuid: "79660023c1124b7e8da27181f34a5c92"
 from {username='slave'} at 127.0.0.1:53268
I20260709 13:02:36.158798 13776 raft_consensus.cc:493] T eb56f1ea81c24546bb53bb5763ccddc4 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:36.159186 13776 raft_consensus.cc:3060] T eb56f1ea81c24546bb53bb5763ccddc4 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:36.161427 13700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a59bf8b7ad4c42931ad97808e91469" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
I20260709 13:02:36.162241 13700 raft_consensus.cc:3060] T 42a59bf8b7ad4c42931ad97808e91469 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:36.158008 13774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42a59bf8b7ad4c42931ad97808e91469" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79660023c1124b7e8da27181f34a5c92"
I20260709 13:02:36.163259 13774 raft_consensus.cc:3055] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:36.163632 13774 raft_consensus.cc:740] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Running, Role: LEADER
I20260709 13:02:36.164804 13774 consensus_queue.cc:260] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:36.172979 13861 consensus_queue.cc:1048] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:36.173908 13776 raft_consensus.cc:515] T eb56f1ea81c24546bb53bb5763ccddc4 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:36.175323 13774 raft_consensus.cc:3060] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:36.180126 13776 leader_election.cc:290] T eb56f1ea81c24546bb53bb5763ccddc4 P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 2 election: Requested vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901)
I20260709 13:02:36.181247 13625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb56f1ea81c24546bb53bb5763ccddc4" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
I20260709 13:02:36.181622 13701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb56f1ea81c24546bb53bb5763ccddc4" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
I20260709 13:02:36.182031 13625 raft_consensus.cc:3060] T eb56f1ea81c24546bb53bb5763ccddc4 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:36.175339 13700 raft_consensus.cc:2468] T 42a59bf8b7ad4c42931ad97808e91469 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1f3335b323406f8f1ad7a1e277cdc7 in term 2.
I20260709 13:02:36.182423 13701 raft_consensus.cc:3055] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:36.182957 13701 raft_consensus.cc:740] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Running, Role: LEADER
I20260709 13:02:36.185541 13592 leader_election.cc:304] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 3d1f3335b323406f8f1ad7a1e277cdc7; no voters: 
I20260709 13:02:36.186820 13822 raft_consensus.cc:2804] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:36.187381 13822 raft_consensus.cc:697] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 LEADER]: Becoming Leader. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Running, Role: LEADER
I20260709 13:02:36.182221 13626 leader_election.cc:290] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 2 election: Requested vote from peers 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:36.188328 13822 consensus_queue.cc:237] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:36.190524 13774 raft_consensus.cc:2468] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1f3335b323406f8f1ad7a1e277cdc7 in term 2.
I20260709 13:02:36.183995 13701 consensus_queue.cc:260] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:36.195250 13701 raft_consensus.cc:3060] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:36.198210 13625 raft_consensus.cc:2468] T eb56f1ea81c24546bb53bb5763ccddc4 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79660023c1124b7e8da27181f34a5c92 in term 2.
I20260709 13:02:36.200553 13741 leader_election.cc:304] T eb56f1ea81c24546bb53bb5763ccddc4 P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1f3335b323406f8f1ad7a1e277cdc7, 79660023c1124b7e8da27181f34a5c92; no voters: 
I20260709 13:02:36.201598 13860 raft_consensus.cc:2804] T eb56f1ea81c24546bb53bb5763ccddc4 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:36.202153 13860 raft_consensus.cc:697] T eb56f1ea81c24546bb53bb5763ccddc4 P 79660023c1124b7e8da27181f34a5c92 [term 2 LEADER]: Becoming Leader. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Running, Role: LEADER
I20260709 13:02:36.202430 13523 catalog_manager.cc:5697] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7 reported cstate change: term changed from 1 to 2, leader changed from 79660023c1124b7e8da27181f34a5c92 (127.0.107.195) to 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:36.202992 13860 consensus_queue.cc:237] T eb56f1ea81c24546bb53bb5763ccddc4 P 79660023c1124b7e8da27181f34a5c92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:36.205448 13701 raft_consensus.cc:2468] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79660023c1124b7e8da27181f34a5c92 in term 2.
I20260709 13:02:36.211680 13525 catalog_manager.cc:5697] T eb56f1ea81c24546bb53bb5763ccddc4 P 79660023c1124b7e8da27181f34a5c92 reported cstate change: term changed from 1 to 2, leader changed from 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194) to 79660023c1124b7e8da27181f34a5c92 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "79660023c1124b7e8da27181f34a5c92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:36.292550 13860 consensus_queue.cc:1048] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:36.299289 13850 raft_consensus.cc:993] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92: : Instructing follower 3c82125d03ae4947ac9a79aebe4d8cf0 to start an election
I20260709 13:02:36.299793 13820 raft_consensus.cc:1081] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [term 1 LEADER]: Signalling peer 3c82125d03ae4947ac9a79aebe4d8cf0 to start an election
I20260709 13:02:36.302397 13700 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93b5051b31254e9189de01203c87bc4e"
dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
 from {username='slave'} at 127.0.0.1:45138
I20260709 13:02:36.303013 13700 raft_consensus.cc:493] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:36.303444 13700 raft_consensus.cc:3060] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:36.305868 13860 consensus_queue.cc:1048] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:36.311084 13700 raft_consensus.cc:515] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:36.314232 13625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b5051b31254e9189de01203c87bc4e" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
I20260709 13:02:36.314469 13700 leader_election.cc:290] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 2 election: Requested vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:36.314985 13625 raft_consensus.cc:3060] T 93b5051b31254e9189de01203c87bc4e P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:36.316028 13775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93b5051b31254e9189de01203c87bc4e" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79660023c1124b7e8da27181f34a5c92"
I20260709 13:02:36.316599 13775 raft_consensus.cc:3055] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:36.316859 13775 raft_consensus.cc:740] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Running, Role: LEADER
I20260709 13:02:36.317566 13775 consensus_queue.cc:260] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:36.318595 13775 raft_consensus.cc:3060] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:36.322230 13625 raft_consensus.cc:2468] T 93b5051b31254e9189de01203c87bc4e P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in term 2.
I20260709 13:02:36.323669 13667 leader_election.cc:304] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 3d1f3335b323406f8f1ad7a1e277cdc7; no voters: 
I20260709 13:02:36.324566 13861 raft_consensus.cc:2804] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:36.325068 13861 raft_consensus.cc:697] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 LEADER]: Becoming Leader. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Running, Role: LEADER
I20260709 13:02:36.325855 13861 consensus_queue.cc:237] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:36.327708 13775 raft_consensus.cc:2468] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in term 2.
I20260709 13:02:36.334278 13525 catalog_manager.cc:5697] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0 reported cstate change: term changed from 1 to 2, leader changed from 79660023c1124b7e8da27181f34a5c92 (127.0.107.195) to 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:36.409619 13820 raft_consensus.cc:993] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92: : Instructing follower 3d1f3335b323406f8f1ad7a1e277cdc7 to start an election
I20260709 13:02:36.410087 13860 raft_consensus.cc:1081] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92 [term 1 LEADER]: Signalling peer 3d1f3335b323406f8f1ad7a1e277cdc7 to start an election
I20260709 13:02:36.411669 13625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a63f82eddf641898443ae8c2a8b9b1c"
dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
 from {username='slave'} at 127.0.0.1:52110
I20260709 13:02:36.412185 13625 raft_consensus.cc:493] T 4a63f82eddf641898443ae8c2a8b9b1c P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:36.412495 13625 raft_consensus.cc:3060] T 4a63f82eddf641898443ae8c2a8b9b1c P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:36.417825 13625 raft_consensus.cc:515] T 4a63f82eddf641898443ae8c2a8b9b1c P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:36.419710 13625 leader_election.cc:290] T 4a63f82eddf641898443ae8c2a8b9b1c P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 2 election: Requested vote from peers 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:36.420725 13700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a63f82eddf641898443ae8c2a8b9b1c" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
I20260709 13:02:36.420827 13775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a63f82eddf641898443ae8c2a8b9b1c" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79660023c1124b7e8da27181f34a5c92"
I20260709 13:02:36.421383 13700 raft_consensus.cc:3060] T 4a63f82eddf641898443ae8c2a8b9b1c P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:36.421445 13775 raft_consensus.cc:3055] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:36.421867 13775 raft_consensus.cc:740] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Running, Role: LEADER
I20260709 13:02:36.422513 13775 consensus_queue.cc:260] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:36.423501 13775 raft_consensus.cc:3060] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:36.426940 13700 raft_consensus.cc:2468] T 4a63f82eddf641898443ae8c2a8b9b1c P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1f3335b323406f8f1ad7a1e277cdc7 in term 2.
I20260709 13:02:36.428349 13592 leader_election.cc:304] T 4a63f82eddf641898443ae8c2a8b9b1c P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 3d1f3335b323406f8f1ad7a1e277cdc7; no voters: 
I20260709 13:02:36.429178 13775 raft_consensus.cc:2468] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1f3335b323406f8f1ad7a1e277cdc7 in term 2.
I20260709 13:02:36.429220 13822 raft_consensus.cc:2804] T 4a63f82eddf641898443ae8c2a8b9b1c P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:36.429860 13822 raft_consensus.cc:697] T 4a63f82eddf641898443ae8c2a8b9b1c P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 LEADER]: Becoming Leader. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Running, Role: LEADER
I20260709 13:02:36.430667 13822 consensus_queue.cc:237] T 4a63f82eddf641898443ae8c2a8b9b1c P 3d1f3335b323406f8f1ad7a1e277cdc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:36.437258 13525 catalog_manager.cc:5697] T 4a63f82eddf641898443ae8c2a8b9b1c P 3d1f3335b323406f8f1ad7a1e277cdc7 reported cstate change: term changed from 1 to 2, leader changed from 79660023c1124b7e8da27181f34a5c92 (127.0.107.195) to 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:36.615262 13839 raft_consensus.cc:993] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7: : Instructing follower 3c82125d03ae4947ac9a79aebe4d8cf0 to start an election
I20260709 13:02:36.615757 13822 raft_consensus.cc:1081] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 LEADER]: Signalling peer 3c82125d03ae4947ac9a79aebe4d8cf0 to start an election
I20260709 13:02:36.617209 13700 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "854f9710b117408cb32500bffcc2f500"
dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
 from {username='slave'} at 127.0.0.1:45122
I20260709 13:02:36.617724 13700 raft_consensus.cc:493] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:36.618028 13700 raft_consensus.cc:3060] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:36.623210 13700 raft_consensus.cc:515] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:36.624977 13700 leader_election.cc:290] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 2 election: Requested vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:36.625824 13625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854f9710b117408cb32500bffcc2f500" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
I20260709 13:02:36.626056 13775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854f9710b117408cb32500bffcc2f500" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79660023c1124b7e8da27181f34a5c92"
I20260709 13:02:36.626456 13625 raft_consensus.cc:3055] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:36.626627 13775 raft_consensus.cc:3060] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:36.626782 13625 raft_consensus.cc:740] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Running, Role: LEADER
I20260709 13:02:36.627595 13625 consensus_queue.cc:260] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:36.628608 13625 raft_consensus.cc:3060] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:36.632134 13775 raft_consensus.cc:2468] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in term 2.
I20260709 13:02:36.633315 13665 leader_election.cc:304] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 79660023c1124b7e8da27181f34a5c92; no voters: 
I20260709 13:02:36.633895 13625 raft_consensus.cc:2468] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in term 2.
I20260709 13:02:36.634037 13861 raft_consensus.cc:2804] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:36.634548 13861 raft_consensus.cc:697] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 LEADER]: Becoming Leader. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Running, Role: LEADER
I20260709 13:02:36.635311 13861 consensus_queue.cc:237] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:36.641745 13525 catalog_manager.cc:5697] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 reported cstate change: term changed from 1 to 2, leader changed from 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193) to 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:36.678247 13700 raft_consensus.cc:1275] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Refusing update from remote peer 79660023c1124b7e8da27181f34a5c92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:36.679436 13860 consensus_queue.cc:1048] T eb56f1ea81c24546bb53bb5763ccddc4 P 79660023c1124b7e8da27181f34a5c92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:36.687592 13625 raft_consensus.cc:1275] T eb56f1ea81c24546bb53bb5763ccddc4 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Refusing update from remote peer 79660023c1124b7e8da27181f34a5c92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:36.689116 13820 consensus_queue.cc:1048] T eb56f1ea81c24546bb53bb5763ccddc4 P 79660023c1124b7e8da27181f34a5c92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:36.751979 13700 raft_consensus.cc:1275] T 42a59bf8b7ad4c42931ad97808e91469 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Refusing update from remote peer 3d1f3335b323406f8f1ad7a1e277cdc7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:36.753280 13822 consensus_queue.cc:1048] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:36.760849 13775 raft_consensus.cc:1275] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Refusing update from remote peer 3d1f3335b323406f8f1ad7a1e277cdc7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:36.762868 13836 consensus_queue.cc:1048] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:36.833493 13625 raft_consensus.cc:1275] T 93b5051b31254e9189de01203c87bc4e P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Refusing update from remote peer 3c82125d03ae4947ac9a79aebe4d8cf0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:36.834957 13825 consensus_queue.cc:1048] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:36.843827 13775 raft_consensus.cc:1275] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Refusing update from remote peer 3c82125d03ae4947ac9a79aebe4d8cf0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:36.845630 13825 consensus_queue.cc:1048] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:36.868880 13775 raft_consensus.cc:1275] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Refusing update from remote peer 3d1f3335b323406f8f1ad7a1e277cdc7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:36.870107 13836 consensus_queue.cc:1048] T 4a63f82eddf641898443ae8c2a8b9b1c P 3d1f3335b323406f8f1ad7a1e277cdc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:36.877929 13700 raft_consensus.cc:1275] T 4a63f82eddf641898443ae8c2a8b9b1c P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Refusing update from remote peer 3d1f3335b323406f8f1ad7a1e277cdc7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:36.879619 13839 consensus_queue.cc:1048] T 4a63f82eddf641898443ae8c2a8b9b1c P 3d1f3335b323406f8f1ad7a1e277cdc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:37.166181 13775 raft_consensus.cc:1275] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Refusing update from remote peer 3c82125d03ae4947ac9a79aebe4d8cf0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:37.167384 13825 consensus_queue.cc:1048] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:37.170475 13625 raft_consensus.cc:1275] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Refusing update from remote peer 3c82125d03ae4947ac9a79aebe4d8cf0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:37.171872 13825 consensus_queue.cc:1048] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:39.151319 13523 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42866:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:39.154206 13523 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:39.214144 13613 tablet_service.cc:1511] Processing CreateTablet for tablet 45bd91d3220e4f1e972885415f1ce1ae (DEFAULT_TABLE table=soft_deleted_table [id=d356804d01994cdfb721eb22b8c66fd9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:39.215121 13687 tablet_service.cc:1511] Processing CreateTablet for tablet 45bd91d3220e4f1e972885415f1ce1ae (DEFAULT_TABLE table=soft_deleted_table [id=d356804d01994cdfb721eb22b8c66fd9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:39.216250 13613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45bd91d3220e4f1e972885415f1ce1ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.217038 13687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45bd91d3220e4f1e972885415f1ce1ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.217278 13766 tablet_service.cc:1511] Processing CreateTablet for tablet 45bd91d3220e4f1e972885415f1ce1ae (DEFAULT_TABLE table=soft_deleted_table [id=d356804d01994cdfb721eb22b8c66fd9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:39.218962 13766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45bd91d3220e4f1e972885415f1ce1ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.221549 13761 tablet_service.cc:1511] Processing CreateTablet for tablet 9536c08be4d6442abdf27526c01de2e9 (DEFAULT_TABLE table=soft_deleted_table [id=d356804d01994cdfb721eb22b8c66fd9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:39.222582 13615 tablet_service.cc:1511] Processing CreateTablet for tablet 9536c08be4d6442abdf27526c01de2e9 (DEFAULT_TABLE table=soft_deleted_table [id=d356804d01994cdfb721eb22b8c66fd9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:39.223368 13761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9536c08be4d6442abdf27526c01de2e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.224282 13615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9536c08be4d6442abdf27526c01de2e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.228412 13684 tablet_service.cc:1511] Processing CreateTablet for tablet 9536c08be4d6442abdf27526c01de2e9 (DEFAULT_TABLE table=soft_deleted_table [id=d356804d01994cdfb721eb22b8c66fd9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:39.230249 13684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9536c08be4d6442abdf27526c01de2e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.238994 13764 tablet_service.cc:1511] Processing CreateTablet for tablet da7b8e9e2cd2438385b3cd4db2887674 (DEFAULT_TABLE table=soft_deleted_table [id=d356804d01994cdfb721eb22b8c66fd9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:39.239782 13612 tablet_service.cc:1511] Processing CreateTablet for tablet da7b8e9e2cd2438385b3cd4db2887674 (DEFAULT_TABLE table=soft_deleted_table [id=d356804d01994cdfb721eb22b8c66fd9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:39.240684 13764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da7b8e9e2cd2438385b3cd4db2887674. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.241333 13612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da7b8e9e2cd2438385b3cd4db2887674. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.248378 13692 tablet_service.cc:1511] Processing CreateTablet for tablet da7b8e9e2cd2438385b3cd4db2887674 (DEFAULT_TABLE table=soft_deleted_table [id=d356804d01994cdfb721eb22b8c66fd9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:39.250069 13692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da7b8e9e2cd2438385b3cd4db2887674. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.251597 13763 tablet_service.cc:1511] Processing CreateTablet for tablet b7206076e6c7492fb38ceed548977cd6 (DEFAULT_TABLE table=soft_deleted_table [id=d356804d01994cdfb721eb22b8c66fd9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:39.253154 13763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7206076e6c7492fb38ceed548977cd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.264411 13765 tablet_service.cc:1511] Processing CreateTablet for tablet 51f837ca6c9244cd9add3d210c307cb5 (DEFAULT_TABLE table=soft_deleted_table [id=d356804d01994cdfb721eb22b8c66fd9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:39.266196 13765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51f837ca6c9244cd9add3d210c307cb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.266605 13919 tablet_bootstrap.cc:492] T 45bd91d3220e4f1e972885415f1ce1ae P 79660023c1124b7e8da27181f34a5c92: Bootstrap starting.
I20260709 13:02:39.271183 13611 tablet_service.cc:1511] Processing CreateTablet for tablet b7206076e6c7492fb38ceed548977cd6 (DEFAULT_TABLE table=soft_deleted_table [id=d356804d01994cdfb721eb22b8c66fd9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:39.272806 13611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7206076e6c7492fb38ceed548977cd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.274384 13919 tablet_bootstrap.cc:654] T 45bd91d3220e4f1e972885415f1ce1ae P 79660023c1124b7e8da27181f34a5c92: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.287209 13919 tablet_bootstrap.cc:492] T 45bd91d3220e4f1e972885415f1ce1ae P 79660023c1124b7e8da27181f34a5c92: No bootstrap required, opened a new log
I20260709 13:02:39.287847 13919 ts_tablet_manager.cc:1403] T 45bd91d3220e4f1e972885415f1ce1ae P 79660023c1124b7e8da27181f34a5c92: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 13:02:39.290906 13761 tablet_service.cc:1511] Processing CreateTablet for tablet 3ff553d020244a79a9313c1b5bfec8f3 (DEFAULT_TABLE table=soft_deleted_table [id=d356804d01994cdfb721eb22b8c66fd9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:39.291402 13919 raft_consensus.cc:359] T 45bd91d3220e4f1e972885415f1ce1ae P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.292732 13761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ff553d020244a79a9313c1b5bfec8f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.292783 13919 raft_consensus.cc:385] T 45bd91d3220e4f1e972885415f1ce1ae P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.293465 13919 raft_consensus.cc:740] T 45bd91d3220e4f1e972885415f1ce1ae P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.293215 13616 tablet_service.cc:1511] Processing CreateTablet for tablet 51f837ca6c9244cd9add3d210c307cb5 (DEFAULT_TABLE table=soft_deleted_table [id=d356804d01994cdfb721eb22b8c66fd9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:39.294716 13616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51f837ca6c9244cd9add3d210c307cb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.290966 13691 tablet_service.cc:1511] Processing CreateTablet for tablet b7206076e6c7492fb38ceed548977cd6 (DEFAULT_TABLE table=soft_deleted_table [id=d356804d01994cdfb721eb22b8c66fd9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:39.294580 13919 consensus_queue.cc:260] T 45bd91d3220e4f1e972885415f1ce1ae P 79660023c1124b7e8da27181f34a5c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.295858 13691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7206076e6c7492fb38ceed548977cd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.300665 13919 ts_tablet_manager.cc:1434] T 45bd91d3220e4f1e972885415f1ce1ae P 79660023c1124b7e8da27181f34a5c92: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.004s
I20260709 13:02:39.302496 13766 tablet_service.cc:1511] Processing CreateTablet for tablet 8e0d0d36fd19492ca51a47c34fdb2b64 (DEFAULT_TABLE table=soft_deleted_table [id=d356804d01994cdfb721eb22b8c66fd9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:39.303925 13766 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e0d0d36fd19492ca51a47c34fdb2b64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.311935 13690 tablet_service.cc:1511] Processing CreateTablet for tablet 51f837ca6c9244cd9add3d210c307cb5 (DEFAULT_TABLE table=soft_deleted_table [id=d356804d01994cdfb721eb22b8c66fd9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:39.313560 13690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51f837ca6c9244cd9add3d210c307cb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.314805 13685 tablet_service.cc:1511] Processing CreateTablet for tablet 3ff553d020244a79a9313c1b5bfec8f3 (DEFAULT_TABLE table=soft_deleted_table [id=d356804d01994cdfb721eb22b8c66fd9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:39.315618 13617 tablet_service.cc:1511] Processing CreateTablet for tablet 3ff553d020244a79a9313c1b5bfec8f3 (DEFAULT_TABLE table=soft_deleted_table [id=d356804d01994cdfb721eb22b8c66fd9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:39.316386 13685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ff553d020244a79a9313c1b5bfec8f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.317153 13617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ff553d020244a79a9313c1b5bfec8f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.326277 13919 tablet_bootstrap.cc:492] T 9536c08be4d6442abdf27526c01de2e9 P 79660023c1124b7e8da27181f34a5c92: Bootstrap starting.
I20260709 13:02:39.328831 13614 tablet_service.cc:1511] Processing CreateTablet for tablet 8e0d0d36fd19492ca51a47c34fdb2b64 (DEFAULT_TABLE table=soft_deleted_table [id=d356804d01994cdfb721eb22b8c66fd9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:39.330498 13614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e0d0d36fd19492ca51a47c34fdb2b64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.338469 13765 tablet_service.cc:1511] Processing CreateTablet for tablet 94c5ee32461343ea8ed9720c6ae81482 (DEFAULT_TABLE table=soft_deleted_table [id=d356804d01994cdfb721eb22b8c66fd9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:39.340046 13765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94c5ee32461343ea8ed9720c6ae81482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.346432 13688 tablet_service.cc:1511] Processing CreateTablet for tablet 8e0d0d36fd19492ca51a47c34fdb2b64 (DEFAULT_TABLE table=soft_deleted_table [id=d356804d01994cdfb721eb22b8c66fd9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:39.348106 13688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e0d0d36fd19492ca51a47c34fdb2b64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.352754 13613 tablet_service.cc:1511] Processing CreateTablet for tablet 94c5ee32461343ea8ed9720c6ae81482 (DEFAULT_TABLE table=soft_deleted_table [id=d356804d01994cdfb721eb22b8c66fd9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:39.354424 13613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94c5ee32461343ea8ed9720c6ae81482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.348102 13919 tablet_bootstrap.cc:654] T 9536c08be4d6442abdf27526c01de2e9 P 79660023c1124b7e8da27181f34a5c92: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.358775 13764 tablet_service.cc:1511] Processing CreateTablet for tablet 10a905a175a44997948637602e0b015e (DEFAULT_TABLE table=soft_deleted_table [id=d356804d01994cdfb721eb22b8c66fd9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:39.360339 13764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10a905a175a44997948637602e0b015e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.346364 13920 tablet_bootstrap.cc:492] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7: Bootstrap starting.
I20260709 13:02:39.378304 13686 tablet_service.cc:1511] Processing CreateTablet for tablet 94c5ee32461343ea8ed9720c6ae81482 (DEFAULT_TABLE table=soft_deleted_table [id=d356804d01994cdfb721eb22b8c66fd9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:39.378502 13611 tablet_service.cc:1511] Processing CreateTablet for tablet 10a905a175a44997948637602e0b015e (DEFAULT_TABLE table=soft_deleted_table [id=d356804d01994cdfb721eb22b8c66fd9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:39.379959 13611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10a905a175a44997948637602e0b015e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.380366 13686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94c5ee32461343ea8ed9720c6ae81482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.385838 13689 tablet_service.cc:1511] Processing CreateTablet for tablet 10a905a175a44997948637602e0b015e (DEFAULT_TABLE table=soft_deleted_table [id=d356804d01994cdfb721eb22b8c66fd9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:39.387298 13689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10a905a175a44997948637602e0b015e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:39.400353 13920 tablet_bootstrap.cc:654] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.423738 13918 raft_consensus.cc:493] T 45bd91d3220e4f1e972885415f1ce1ae P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.424350 13918 raft_consensus.cc:515] T 45bd91d3220e4f1e972885415f1ce1ae P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.426716 13918 leader_election.cc:290] T 45bd91d3220e4f1e972885415f1ce1ae P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901)
I20260709 13:02:39.428711 13625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45bd91d3220e4f1e972885415f1ce1ae" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" is_pre_election: true
W20260709 13:02:39.429916 13741 leader_election.cc:343] T 45bd91d3220e4f1e972885415f1ce1ae P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901): Not found: Tablet not found: 45bd91d3220e4f1e972885415f1ce1ae
I20260709 13:02:39.430406 13919 tablet_bootstrap.cc:492] T 9536c08be4d6442abdf27526c01de2e9 P 79660023c1124b7e8da27181f34a5c92: No bootstrap required, opened a new log
W20260709 13:02:39.430734 13741 leader_election.cc:343] T 45bd91d3220e4f1e972885415f1ce1ae P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.430959 13919 ts_tablet_manager.cc:1403] T 9536c08be4d6442abdf27526c01de2e9 P 79660023c1124b7e8da27181f34a5c92: Time spent bootstrapping tablet: real 0.111s	user 0.013s	sys 0.008s
I20260709 13:02:39.431247 13741 leader_election.cc:304] T 45bd91d3220e4f1e972885415f1ce1ae P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79660023c1124b7e8da27181f34a5c92; no voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 3d1f3335b323406f8f1ad7a1e277cdc7
I20260709 13:02:39.432390 13918 raft_consensus.cc:2749] T 45bd91d3220e4f1e972885415f1ce1ae P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:39.441860 13573 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:39.450179 13920 tablet_bootstrap.cc:492] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7: No bootstrap required, opened a new log
I20260709 13:02:39.450721 13920 ts_tablet_manager.cc:1403] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent bootstrapping tablet: real 0.105s	user 0.012s	sys 0.004s
I20260709 13:02:39.453591 13920 raft_consensus.cc:359] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.454345 13920 raft_consensus.cc:385] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.454635 13920 raft_consensus.cc:740] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.455755 13920 consensus_queue.cc:260] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.459090 13920 ts_tablet_manager.cc:1434] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:02:39.460067 13920 tablet_bootstrap.cc:492] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7: Bootstrap starting.
I20260709 13:02:39.465139 13920 tablet_bootstrap.cc:654] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.469487 13923 tablet_bootstrap.cc:492] T 3ff553d020244a79a9313c1b5bfec8f3 P 3c82125d03ae4947ac9a79aebe4d8cf0: Bootstrap starting.
I20260709 13:02:39.470468 13919 raft_consensus.cc:359] T 9536c08be4d6442abdf27526c01de2e9 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.471371 13919 raft_consensus.cc:385] T 9536c08be4d6442abdf27526c01de2e9 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.471688 13919 raft_consensus.cc:740] T 9536c08be4d6442abdf27526c01de2e9 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.473830 13919 consensus_queue.cc:260] T 9536c08be4d6442abdf27526c01de2e9 P 79660023c1124b7e8da27181f34a5c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.484290 13919 ts_tablet_manager.cc:1434] T 9536c08be4d6442abdf27526c01de2e9 P 79660023c1124b7e8da27181f34a5c92: Time spent starting tablet: real 0.053s	user 0.002s	sys 0.005s
I20260709 13:02:39.485181 13923 tablet_bootstrap.cc:654] T 3ff553d020244a79a9313c1b5bfec8f3 P 3c82125d03ae4947ac9a79aebe4d8cf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.485720 13919 tablet_bootstrap.cc:492] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92: Bootstrap starting.
I20260709 13:02:39.494187 13919 tablet_bootstrap.cc:654] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:39.503789 13802 tablet.cc:2406] T 45bd91d3220e4f1e972885415f1ce1ae P 79660023c1124b7e8da27181f34a5c92: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:02:39.503826 13919 tablet_bootstrap.cc:492] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92: No bootstrap required, opened a new log
I20260709 13:02:39.504701 13919 ts_tablet_manager.cc:1403] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:02:39.510485 13919 raft_consensus.cc:359] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.510985 13923 tablet_bootstrap.cc:492] T 3ff553d020244a79a9313c1b5bfec8f3 P 3c82125d03ae4947ac9a79aebe4d8cf0: No bootstrap required, opened a new log
I20260709 13:02:39.511555 13923 ts_tablet_manager.cc:1403] T 3ff553d020244a79a9313c1b5bfec8f3 P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.000s
I20260709 13:02:39.512619 13919 raft_consensus.cc:385] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.513132 13919 raft_consensus.cc:740] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.514389 13920 tablet_bootstrap.cc:492] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7: No bootstrap required, opened a new log
I20260709 13:02:39.514328 13919 consensus_queue.cc:260] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.514483 13923 raft_consensus.cc:359] T 3ff553d020244a79a9313c1b5bfec8f3 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.515278 13920 ts_tablet_manager.cc:1403] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.037s
I20260709 13:02:39.515465 13923 raft_consensus.cc:385] T 3ff553d020244a79a9313c1b5bfec8f3 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.516266 13923 raft_consensus.cc:740] T 3ff553d020244a79a9313c1b5bfec8f3 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.517086 13923 consensus_queue.cc:260] T 3ff553d020244a79a9313c1b5bfec8f3 P 3c82125d03ae4947ac9a79aebe4d8cf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.517519 13919 ts_tablet_manager.cc:1434] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:02:39.518785 13920 raft_consensus.cc:359] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.519645 13920 raft_consensus.cc:385] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.519877 13923 ts_tablet_manager.cc:1434] T 3ff553d020244a79a9313c1b5bfec8f3 P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:39.519984 13920 raft_consensus.cc:740] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.521138 13923 tablet_bootstrap.cc:492] T da7b8e9e2cd2438385b3cd4db2887674 P 3c82125d03ae4947ac9a79aebe4d8cf0: Bootstrap starting.
I20260709 13:02:39.521102 13920 consensus_queue.cc:260] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.524158 13920 ts_tablet_manager.cc:1434] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:39.525279 13920 tablet_bootstrap.cc:492] T 51f837ca6c9244cd9add3d210c307cb5 P 3d1f3335b323406f8f1ad7a1e277cdc7: Bootstrap starting.
I20260709 13:02:39.533546 13920 tablet_bootstrap.cc:654] T 51f837ca6c9244cd9add3d210c307cb5 P 3d1f3335b323406f8f1ad7a1e277cdc7: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.534657 13923 tablet_bootstrap.cc:654] T da7b8e9e2cd2438385b3cd4db2887674 P 3c82125d03ae4947ac9a79aebe4d8cf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.537993 13919 tablet_bootstrap.cc:492] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92: Bootstrap starting.
I20260709 13:02:39.546682 13920 tablet_bootstrap.cc:492] T 51f837ca6c9244cd9add3d210c307cb5 P 3d1f3335b323406f8f1ad7a1e277cdc7: No bootstrap required, opened a new log
I20260709 13:02:39.546957 13919 tablet_bootstrap.cc:654] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.547294 13920 ts_tablet_manager.cc:1403] T 51f837ca6c9244cd9add3d210c307cb5 P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.009s
I20260709 13:02:39.547724 13923 tablet_bootstrap.cc:492] T da7b8e9e2cd2438385b3cd4db2887674 P 3c82125d03ae4947ac9a79aebe4d8cf0: No bootstrap required, opened a new log
I20260709 13:02:39.548257 13923 ts_tablet_manager.cc:1403] T da7b8e9e2cd2438385b3cd4db2887674 P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent bootstrapping tablet: real 0.027s	user 0.001s	sys 0.018s
I20260709 13:02:39.550705 13920 raft_consensus.cc:359] T 51f837ca6c9244cd9add3d210c307cb5 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.551625 13920 raft_consensus.cc:385] T 51f837ca6c9244cd9add3d210c307cb5 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.551452 13923 raft_consensus.cc:359] T da7b8e9e2cd2438385b3cd4db2887674 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.551966 13920 raft_consensus.cc:740] T 51f837ca6c9244cd9add3d210c307cb5 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.552273 13923 raft_consensus.cc:385] T da7b8e9e2cd2438385b3cd4db2887674 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.552616 13923 raft_consensus.cc:740] T da7b8e9e2cd2438385b3cd4db2887674 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.552918 13920 consensus_queue.cc:260] T 51f837ca6c9244cd9add3d210c307cb5 P 3d1f3335b323406f8f1ad7a1e277cdc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.555361 13920 ts_tablet_manager.cc:1434] T 51f837ca6c9244cd9add3d210c307cb5 P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:39.556634 13920 tablet_bootstrap.cc:492] T 3ff553d020244a79a9313c1b5bfec8f3 P 3d1f3335b323406f8f1ad7a1e277cdc7: Bootstrap starting.
I20260709 13:02:39.557051 13919 tablet_bootstrap.cc:492] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92: No bootstrap required, opened a new log
I20260709 13:02:39.556541 13923 consensus_queue.cc:260] T da7b8e9e2cd2438385b3cd4db2887674 P 3c82125d03ae4947ac9a79aebe4d8cf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.557593 13919 ts_tablet_manager.cc:1403] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.000s
I20260709 13:02:39.560189 13919 raft_consensus.cc:359] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.560792 13919 raft_consensus.cc:385] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.561075 13919 raft_consensus.cc:740] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.561842 13919 consensus_queue.cc:260] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.564282 13920 tablet_bootstrap.cc:654] T 3ff553d020244a79a9313c1b5bfec8f3 P 3d1f3335b323406f8f1ad7a1e277cdc7: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.564381 13919 ts_tablet_manager.cc:1434] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:02:39.565917 13919 tablet_bootstrap.cc:492] T 3ff553d020244a79a9313c1b5bfec8f3 P 79660023c1124b7e8da27181f34a5c92: Bootstrap starting.
I20260709 13:02:39.577668 13923 ts_tablet_manager.cc:1434] T da7b8e9e2cd2438385b3cd4db2887674 P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:02:39.584028 13923 tablet_bootstrap.cc:492] T 51f837ca6c9244cd9add3d210c307cb5 P 3c82125d03ae4947ac9a79aebe4d8cf0: Bootstrap starting.
I20260709 13:02:39.590080 13919 tablet_bootstrap.cc:654] T 3ff553d020244a79a9313c1b5bfec8f3 P 79660023c1124b7e8da27181f34a5c92: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.591810 13923 tablet_bootstrap.cc:654] T 51f837ca6c9244cd9add3d210c307cb5 P 3c82125d03ae4947ac9a79aebe4d8cf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.593398 13920 tablet_bootstrap.cc:492] T 3ff553d020244a79a9313c1b5bfec8f3 P 3d1f3335b323406f8f1ad7a1e277cdc7: No bootstrap required, opened a new log
I20260709 13:02:39.594003 13920 ts_tablet_manager.cc:1403] T 3ff553d020244a79a9313c1b5bfec8f3 P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent bootstrapping tablet: real 0.038s	user 0.026s	sys 0.011s
I20260709 13:02:39.597080 13920 raft_consensus.cc:359] T 3ff553d020244a79a9313c1b5bfec8f3 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.597815 13920 raft_consensus.cc:385] T 3ff553d020244a79a9313c1b5bfec8f3 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.598102 13920 raft_consensus.cc:740] T 3ff553d020244a79a9313c1b5bfec8f3 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.598991 13920 consensus_queue.cc:260] T 3ff553d020244a79a9313c1b5bfec8f3 P 3d1f3335b323406f8f1ad7a1e277cdc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.602115 13919 tablet_bootstrap.cc:492] T 3ff553d020244a79a9313c1b5bfec8f3 P 79660023c1124b7e8da27181f34a5c92: No bootstrap required, opened a new log
I20260709 13:02:39.602814 13919 ts_tablet_manager.cc:1403] T 3ff553d020244a79a9313c1b5bfec8f3 P 79660023c1124b7e8da27181f34a5c92: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.004s
I20260709 13:02:39.603012 13920 ts_tablet_manager.cc:1434] T 3ff553d020244a79a9313c1b5bfec8f3 P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:02:39.604161 13920 tablet_bootstrap.cc:492] T 9536c08be4d6442abdf27526c01de2e9 P 3d1f3335b323406f8f1ad7a1e277cdc7: Bootstrap starting.
I20260709 13:02:39.606171 13919 raft_consensus.cc:359] T 3ff553d020244a79a9313c1b5bfec8f3 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.606954 13919 raft_consensus.cc:385] T 3ff553d020244a79a9313c1b5bfec8f3 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.607239 13919 raft_consensus.cc:740] T 3ff553d020244a79a9313c1b5bfec8f3 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.607968 13919 consensus_queue.cc:260] T 3ff553d020244a79a9313c1b5bfec8f3 P 79660023c1124b7e8da27181f34a5c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.610688 13919 ts_tablet_manager.cc:1434] T 3ff553d020244a79a9313c1b5bfec8f3 P 79660023c1124b7e8da27181f34a5c92: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:02:39.611721 13919 tablet_bootstrap.cc:492] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 79660023c1124b7e8da27181f34a5c92: Bootstrap starting.
I20260709 13:02:39.612493 13920 tablet_bootstrap.cc:654] T 9536c08be4d6442abdf27526c01de2e9 P 3d1f3335b323406f8f1ad7a1e277cdc7: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.613691 13923 tablet_bootstrap.cc:492] T 51f837ca6c9244cd9add3d210c307cb5 P 3c82125d03ae4947ac9a79aebe4d8cf0: No bootstrap required, opened a new log
I20260709 13:02:39.614343 13923 ts_tablet_manager.cc:1403] T 51f837ca6c9244cd9add3d210c307cb5 P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.006s
I20260709 13:02:39.617735 13923 raft_consensus.cc:359] T 51f837ca6c9244cd9add3d210c307cb5 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.618975 13923 raft_consensus.cc:385] T 51f837ca6c9244cd9add3d210c307cb5 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.619576 13923 raft_consensus.cc:740] T 51f837ca6c9244cd9add3d210c307cb5 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.618472 13926 raft_consensus.cc:493] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.620582 13923 consensus_queue.cc:260] T 51f837ca6c9244cd9add3d210c307cb5 P 3c82125d03ae4947ac9a79aebe4d8cf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.620967 13926 raft_consensus.cc:515] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.623224 13923 ts_tablet_manager.cc:1434] T 51f837ca6c9244cd9add3d210c307cb5 P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:02:39.624547 13923 tablet_bootstrap.cc:492] T 9536c08be4d6442abdf27526c01de2e9 P 3c82125d03ae4947ac9a79aebe4d8cf0: Bootstrap starting.
I20260709 13:02:39.624773 13920 tablet_bootstrap.cc:492] T 9536c08be4d6442abdf27526c01de2e9 P 3d1f3335b323406f8f1ad7a1e277cdc7: No bootstrap required, opened a new log
I20260709 13:02:39.625481 13920 ts_tablet_manager.cc:1403] T 9536c08be4d6442abdf27526c01de2e9 P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.012s
I20260709 13:02:39.625808 13700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45bd91d3220e4f1e972885415f1ce1ae" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" is_pre_election: true
I20260709 13:02:39.626291 13775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45bd91d3220e4f1e972885415f1ce1ae" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79660023c1124b7e8da27181f34a5c92" is_pre_election: true
I20260709 13:02:39.626986 13775 raft_consensus.cc:2468] T 45bd91d3220e4f1e972885415f1ce1ae P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d1f3335b323406f8f1ad7a1e277cdc7 in term 0.
W20260709 13:02:39.629221 13592 leader_election.cc:343] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.628861 13920 raft_consensus.cc:359] T 9536c08be4d6442abdf27526c01de2e9 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.629869 13920 raft_consensus.cc:385] T 9536c08be4d6442abdf27526c01de2e9 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.630179 13920 raft_consensus.cc:740] T 9536c08be4d6442abdf27526c01de2e9 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.630239 13590 leader_election.cc:304] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d1f3335b323406f8f1ad7a1e277cdc7, 79660023c1124b7e8da27181f34a5c92; no voters: 3c82125d03ae4947ac9a79aebe4d8cf0
I20260709 13:02:39.631565 13839 raft_consensus.cc:2804] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.631160 13920 consensus_queue.cc:260] T 9536c08be4d6442abdf27526c01de2e9 P 3d1f3335b323406f8f1ad7a1e277cdc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.631984 13839 raft_consensus.cc:493] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.632161 13923 tablet_bootstrap.cc:654] T 9536c08be4d6442abdf27526c01de2e9 P 3c82125d03ae4947ac9a79aebe4d8cf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.632360 13839 raft_consensus.cc:3060] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.623268 13926 leader_election.cc:290] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:39.644460 13920 ts_tablet_manager.cc:1434] T 9536c08be4d6442abdf27526c01de2e9 P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent starting tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 13:02:39.644924 13919 tablet_bootstrap.cc:654] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 79660023c1124b7e8da27181f34a5c92: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.646122 13920 tablet_bootstrap.cc:492] T 94c5ee32461343ea8ed9720c6ae81482 P 3d1f3335b323406f8f1ad7a1e277cdc7: Bootstrap starting.
I20260709 13:02:39.646785 13839 raft_consensus.cc:515] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.653151 13839 leader_election.cc:290] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 election: Requested vote from peers 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:39.654023 13700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45bd91d3220e4f1e972885415f1ce1ae" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
W20260709 13:02:39.655869 13592 leader_election.cc:343] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.659722 13923 tablet_bootstrap.cc:492] T 9536c08be4d6442abdf27526c01de2e9 P 3c82125d03ae4947ac9a79aebe4d8cf0: No bootstrap required, opened a new log
I20260709 13:02:39.659722 13919 tablet_bootstrap.cc:492] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 79660023c1124b7e8da27181f34a5c92: No bootstrap required, opened a new log
I20260709 13:02:39.660660 13923 ts_tablet_manager.cc:1403] T 9536c08be4d6442abdf27526c01de2e9 P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.004s
I20260709 13:02:39.660660 13919 ts_tablet_manager.cc:1403] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 79660023c1124b7e8da27181f34a5c92: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.004s
I20260709 13:02:39.661175 13920 tablet_bootstrap.cc:654] T 94c5ee32461343ea8ed9720c6ae81482 P 3d1f3335b323406f8f1ad7a1e277cdc7: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.663565 13775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45bd91d3220e4f1e972885415f1ce1ae" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79660023c1124b7e8da27181f34a5c92"
I20260709 13:02:39.664146 13919 raft_consensus.cc:359] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.664460 13923 raft_consensus.cc:359] T 9536c08be4d6442abdf27526c01de2e9 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.665014 13919 raft_consensus.cc:385] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.665403 13919 raft_consensus.cc:740] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.665417 13923 raft_consensus.cc:385] T 9536c08be4d6442abdf27526c01de2e9 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.665953 13923 raft_consensus.cc:740] T 9536c08be4d6442abdf27526c01de2e9 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.666364 13919 consensus_queue.cc:260] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 79660023c1124b7e8da27181f34a5c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.668849 13919 ts_tablet_manager.cc:1434] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 79660023c1124b7e8da27181f34a5c92: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:39.669839 13919 tablet_bootstrap.cc:492] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92: Bootstrap starting.
I20260709 13:02:39.673837 13839 raft_consensus.cc:493] T 9536c08be4d6442abdf27526c01de2e9 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.673664 13923 consensus_queue.cc:260] T 9536c08be4d6442abdf27526c01de2e9 P 3c82125d03ae4947ac9a79aebe4d8cf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.674399 13839 raft_consensus.cc:515] T 9536c08be4d6442abdf27526c01de2e9 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.664294 13775 raft_consensus.cc:3060] T 45bd91d3220e4f1e972885415f1ce1ae P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.676664 13839 leader_election.cc:290] T 9536c08be4d6442abdf27526c01de2e9 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:39.676713 13923 ts_tablet_manager.cc:1434] T 9536c08be4d6442abdf27526c01de2e9 P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:02:39.679157 13700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9536c08be4d6442abdf27526c01de2e9" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" is_pre_election: true
I20260709 13:02:39.679828 13700 raft_consensus.cc:2468] T 9536c08be4d6442abdf27526c01de2e9 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d1f3335b323406f8f1ad7a1e277cdc7 in term 0.
I20260709 13:02:39.681140 13592 leader_election.cc:304] T 9536c08be4d6442abdf27526c01de2e9 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 3d1f3335b323406f8f1ad7a1e277cdc7; no voters: 
I20260709 13:02:39.681398 13923 tablet_bootstrap.cc:492] T 45bd91d3220e4f1e972885415f1ce1ae P 3c82125d03ae4947ac9a79aebe4d8cf0: Bootstrap starting.
I20260709 13:02:39.682608 13839 raft_consensus.cc:493] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.683209 13839 raft_consensus.cc:515] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.683468 13774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9536c08be4d6442abdf27526c01de2e9" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79660023c1124b7e8da27181f34a5c92" is_pre_election: true
I20260709 13:02:39.684338 13774 raft_consensus.cc:2468] T 9536c08be4d6442abdf27526c01de2e9 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d1f3335b323406f8f1ad7a1e277cdc7 in term 0.
I20260709 13:02:39.685549 13839 leader_election.cc:290] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:39.687369 13774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7206076e6c7492fb38ceed548977cd6" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79660023c1124b7e8da27181f34a5c92" is_pre_election: true
W20260709 13:02:39.689500 13590 leader_election.cc:343] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.691677 13923 tablet_bootstrap.cc:654] T 45bd91d3220e4f1e972885415f1ce1ae P 3c82125d03ae4947ac9a79aebe4d8cf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.692452 13700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7206076e6c7492fb38ceed548977cd6" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" is_pre_election: true
W20260709 13:02:39.694082 13592 leader_election.cc:343] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.694522 13592 leader_election.cc:304] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d1f3335b323406f8f1ad7a1e277cdc7; no voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 79660023c1124b7e8da27181f34a5c92
I20260709 13:02:39.695521 13936 raft_consensus.cc:2804] T 9536c08be4d6442abdf27526c01de2e9 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.695930 13936 raft_consensus.cc:493] T 9536c08be4d6442abdf27526c01de2e9 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.696245 13936 raft_consensus.cc:3060] T 9536c08be4d6442abdf27526c01de2e9 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.699903 13839 raft_consensus.cc:2749] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:39.704319 13919 tablet_bootstrap.cc:654] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.704799 13936 raft_consensus.cc:515] T 9536c08be4d6442abdf27526c01de2e9 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.708731 13700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9536c08be4d6442abdf27526c01de2e9" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
I20260709 13:02:39.709419 13700 raft_consensus.cc:3060] T 9536c08be4d6442abdf27526c01de2e9 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.718878 13920 tablet_bootstrap.cc:492] T 94c5ee32461343ea8ed9720c6ae81482 P 3d1f3335b323406f8f1ad7a1e277cdc7: No bootstrap required, opened a new log
I20260709 13:02:39.719750 13920 ts_tablet_manager.cc:1403] T 94c5ee32461343ea8ed9720c6ae81482 P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent bootstrapping tablet: real 0.074s	user 0.014s	sys 0.029s
I20260709 13:02:39.723546 13920 raft_consensus.cc:359] T 94c5ee32461343ea8ed9720c6ae81482 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.724447 13920 raft_consensus.cc:385] T 94c5ee32461343ea8ed9720c6ae81482 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.724819 13920 raft_consensus.cc:740] T 94c5ee32461343ea8ed9720c6ae81482 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.724982 13936 leader_election.cc:290] T 9536c08be4d6442abdf27526c01de2e9 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 election: Requested vote from peers 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:39.725893 13920 consensus_queue.cc:260] T 94c5ee32461343ea8ed9720c6ae81482 P 3d1f3335b323406f8f1ad7a1e277cdc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.726452 13774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9536c08be4d6442abdf27526c01de2e9" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79660023c1124b7e8da27181f34a5c92"
I20260709 13:02:39.728735 13700 raft_consensus.cc:2468] T 9536c08be4d6442abdf27526c01de2e9 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1f3335b323406f8f1ad7a1e277cdc7 in term 1.
I20260709 13:02:39.730304 13592 leader_election.cc:304] T 9536c08be4d6442abdf27526c01de2e9 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 3d1f3335b323406f8f1ad7a1e277cdc7; no voters: 
I20260709 13:02:39.727164 13774 raft_consensus.cc:3060] T 9536c08be4d6442abdf27526c01de2e9 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.732072 13936 raft_consensus.cc:2804] T 9536c08be4d6442abdf27526c01de2e9 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:39.734861 13936 raft_consensus.cc:697] T 9536c08be4d6442abdf27526c01de2e9 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 LEADER]: Becoming Leader. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Running, Role: LEADER
I20260709 13:02:39.735939 13936 consensus_queue.cc:237] T 9536c08be4d6442abdf27526c01de2e9 P 3d1f3335b323406f8f1ad7a1e277cdc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.743898 13923 tablet_bootstrap.cc:492] T 45bd91d3220e4f1e972885415f1ce1ae P 3c82125d03ae4947ac9a79aebe4d8cf0: No bootstrap required, opened a new log
I20260709 13:02:39.745067 13923 ts_tablet_manager.cc:1403] T 45bd91d3220e4f1e972885415f1ce1ae P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent bootstrapping tablet: real 0.067s	user 0.015s	sys 0.028s
I20260709 13:02:39.744374 13919 tablet_bootstrap.cc:492] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92: No bootstrap required, opened a new log
I20260709 13:02:39.746572 13919 ts_tablet_manager.cc:1403] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92: Time spent bootstrapping tablet: real 0.077s	user 0.014s	sys 0.019s
I20260709 13:02:39.728796 13920 ts_tablet_manager.cc:1434] T 94c5ee32461343ea8ed9720c6ae81482 P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260709 13:02:39.748705 13923 raft_consensus.cc:359] T 45bd91d3220e4f1e972885415f1ce1ae P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.749742 13923 raft_consensus.cc:385] T 45bd91d3220e4f1e972885415f1ce1ae P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.750128 13923 raft_consensus.cc:740] T 45bd91d3220e4f1e972885415f1ce1ae P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.750173 13920 tablet_bootstrap.cc:492] T da7b8e9e2cd2438385b3cd4db2887674 P 3d1f3335b323406f8f1ad7a1e277cdc7: Bootstrap starting.
I20260709 13:02:39.751351 13919 raft_consensus.cc:359] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.752197 13919 raft_consensus.cc:385] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.752501 13919 raft_consensus.cc:740] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.754048 13907 raft_consensus.cc:493] T 3ff553d020244a79a9313c1b5bfec8f3 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.751082 13923 consensus_queue.cc:260] T 45bd91d3220e4f1e972885415f1ce1ae P 3c82125d03ae4947ac9a79aebe4d8cf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.754580 13907 raft_consensus.cc:515] T 3ff553d020244a79a9313c1b5bfec8f3 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.757282 13923 ts_tablet_manager.cc:1434] T 45bd91d3220e4f1e972885415f1ce1ae P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:02:39.758351 13920 tablet_bootstrap.cc:654] T da7b8e9e2cd2438385b3cd4db2887674 P 3d1f3335b323406f8f1ad7a1e277cdc7: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.758517 13923 tablet_bootstrap.cc:492] T 94c5ee32461343ea8ed9720c6ae81482 P 3c82125d03ae4947ac9a79aebe4d8cf0: Bootstrap starting.
I20260709 13:02:39.759337 13907 leader_election.cc:290] T 3ff553d020244a79a9313c1b5bfec8f3 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:39.758641 13625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff553d020244a79a9313c1b5bfec8f3" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" is_pre_election: true
I20260709 13:02:39.760428 13625 raft_consensus.cc:2468] T 3ff553d020244a79a9313c1b5bfec8f3 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in term 0.
I20260709 13:02:39.761053 13918 raft_consensus.cc:493] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.761605 13918 raft_consensus.cc:515] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.762038 13667 leader_election.cc:304] T 3ff553d020244a79a9313c1b5bfec8f3 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 3d1f3335b323406f8f1ad7a1e277cdc7; no voters: 
I20260709 13:02:39.763633 13907 raft_consensus.cc:2804] T 3ff553d020244a79a9313c1b5bfec8f3 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.763798 13918 leader_election.cc:290] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901)
I20260709 13:02:39.764045 13907 raft_consensus.cc:493] T 3ff553d020244a79a9313c1b5bfec8f3 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.764496 13907 raft_consensus.cc:3060] T 3ff553d020244a79a9313c1b5bfec8f3 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.765334 13700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0d0d36fd19492ca51a47c34fdb2b64" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" is_pre_election: true
I20260709 13:02:39.766743 13625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0d0d36fd19492ca51a47c34fdb2b64" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" is_pre_election: true
W20260709 13:02:39.768453 13741 leader_election.cc:343] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:39.769688 13741 leader_election.cc:343] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.770128 13741 leader_election.cc:304] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79660023c1124b7e8da27181f34a5c92; no voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 3d1f3335b323406f8f1ad7a1e277cdc7
I20260709 13:02:39.746572 13775 raft_consensus.cc:2468] T 45bd91d3220e4f1e972885415f1ce1ae P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1f3335b323406f8f1ad7a1e277cdc7 in term 1.
I20260709 13:02:39.782855 13907 raft_consensus.cc:515] T 3ff553d020244a79a9313c1b5bfec8f3 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.753357 13919 consensus_queue.cc:260] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.788667 13943 raft_consensus.cc:2749] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:39.785066 13918 raft_consensus.cc:493] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.794049 13776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff553d020244a79a9313c1b5bfec8f3" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79660023c1124b7e8da27181f34a5c92" is_pre_election: true
I20260709 13:02:39.794874 13776 raft_consensus.cc:2468] T 3ff553d020244a79a9313c1b5bfec8f3 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in term 0.
I20260709 13:02:39.794008 13918 raft_consensus.cc:515] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.797190 13625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff553d020244a79a9313c1b5bfec8f3" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
I20260709 13:02:39.797014 13907 leader_election.cc:290] T 3ff553d020244a79a9313c1b5bfec8f3 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 election: Requested vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:39.797930 13625 raft_consensus.cc:3060] T 3ff553d020244a79a9313c1b5bfec8f3 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.798126 13774 raft_consensus.cc:2468] T 9536c08be4d6442abdf27526c01de2e9 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1f3335b323406f8f1ad7a1e277cdc7 in term 1.
I20260709 13:02:39.799522 13918 leader_election.cc:290] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901)
I20260709 13:02:39.792416 13590 leader_election.cc:304] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d1f3335b323406f8f1ad7a1e277cdc7, 79660023c1124b7e8da27181f34a5c92; no voters: 3c82125d03ae4947ac9a79aebe4d8cf0
I20260709 13:02:39.801275 13926 raft_consensus.cc:2804] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:39.801563 13626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a905a175a44997948637602e0b015e" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" is_pre_election: true
I20260709 13:02:39.801795 13926 raft_consensus.cc:697] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 LEADER]: Becoming Leader. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Running, Role: LEADER
I20260709 13:02:39.802660 13926 consensus_queue.cc:237] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.803301 13700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a905a175a44997948637602e0b015e" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" is_pre_election: true
I20260709 13:02:39.803093 13522 catalog_manager.cc:5697] T 9536c08be4d6442abdf27526c01de2e9 P 3d1f3335b323406f8f1ad7a1e277cdc7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:39.805979 13741 leader_election.cc:343] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:39.807093 13741 leader_election.cc:343] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.807577 13741 leader_election.cc:304] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79660023c1124b7e8da27181f34a5c92; no voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 3d1f3335b323406f8f1ad7a1e277cdc7
I20260709 13:02:39.823609 13918 raft_consensus.cc:2749] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:39.825320 13625 raft_consensus.cc:2468] T 3ff553d020244a79a9313c1b5bfec8f3 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in term 1.
I20260709 13:02:39.827102 13667 leader_election.cc:304] T 3ff553d020244a79a9313c1b5bfec8f3 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 3d1f3335b323406f8f1ad7a1e277cdc7; no voters: 
I20260709 13:02:39.828142 13907 raft_consensus.cc:2804] T 3ff553d020244a79a9313c1b5bfec8f3 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:39.828685 13907 raft_consensus.cc:697] T 3ff553d020244a79a9313c1b5bfec8f3 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 LEADER]: Becoming Leader. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Running, Role: LEADER
I20260709 13:02:39.829519 13907 consensus_queue.cc:237] T 3ff553d020244a79a9313c1b5bfec8f3 P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.832566 13923 tablet_bootstrap.cc:654] T 94c5ee32461343ea8ed9720c6ae81482 P 3c82125d03ae4947ac9a79aebe4d8cf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.838861 13919 ts_tablet_manager.cc:1434] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92: Time spent starting tablet: real 0.092s	user 0.007s	sys 0.021s
I20260709 13:02:39.840135 13919 tablet_bootstrap.cc:492] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92: Bootstrap starting.
I20260709 13:02:39.840899 13776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff553d020244a79a9313c1b5bfec8f3" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79660023c1124b7e8da27181f34a5c92"
I20260709 13:02:39.841539 13776 raft_consensus.cc:3060] T 3ff553d020244a79a9313c1b5bfec8f3 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.847991 13919 tablet_bootstrap.cc:654] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.852495 13923 tablet_bootstrap.cc:492] T 94c5ee32461343ea8ed9720c6ae81482 P 3c82125d03ae4947ac9a79aebe4d8cf0: No bootstrap required, opened a new log
I20260709 13:02:39.852977 13920 tablet_bootstrap.cc:492] T da7b8e9e2cd2438385b3cd4db2887674 P 3d1f3335b323406f8f1ad7a1e277cdc7: No bootstrap required, opened a new log
I20260709 13:02:39.853107 13923 ts_tablet_manager.cc:1403] T 94c5ee32461343ea8ed9720c6ae81482 P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent bootstrapping tablet: real 0.095s	user 0.013s	sys 0.001s
I20260709 13:02:39.853629 13920 ts_tablet_manager.cc:1403] T da7b8e9e2cd2438385b3cd4db2887674 P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent bootstrapping tablet: real 0.104s	user 0.010s	sys 0.006s
I20260709 13:02:39.856395 13923 raft_consensus.cc:359] T 94c5ee32461343ea8ed9720c6ae81482 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.857375 13923 raft_consensus.cc:385] T 94c5ee32461343ea8ed9720c6ae81482 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.857719 13923 raft_consensus.cc:740] T 94c5ee32461343ea8ed9720c6ae81482 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.856309 13776 raft_consensus.cc:2468] T 3ff553d020244a79a9313c1b5bfec8f3 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in term 1.
I20260709 13:02:39.858747 13923 consensus_queue.cc:260] T 94c5ee32461343ea8ed9720c6ae81482 P 3c82125d03ae4947ac9a79aebe4d8cf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.856755 13920 raft_consensus.cc:359] T da7b8e9e2cd2438385b3cd4db2887674 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.860162 13920 raft_consensus.cc:385] T da7b8e9e2cd2438385b3cd4db2887674 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.860532 13920 raft_consensus.cc:740] T da7b8e9e2cd2438385b3cd4db2887674 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.861033 13923 ts_tablet_manager.cc:1434] T 94c5ee32461343ea8ed9720c6ae81482 P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:02:39.862161 13923 tablet_bootstrap.cc:492] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0: Bootstrap starting.
I20260709 13:02:39.861646 13522 catalog_manager.cc:5697] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:39.864883 13920 consensus_queue.cc:260] T da7b8e9e2cd2438385b3cd4db2887674 P 3d1f3335b323406f8f1ad7a1e277cdc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.867790 13920 ts_tablet_manager.cc:1434] T da7b8e9e2cd2438385b3cd4db2887674 P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:02:39.868916 13920 tablet_bootstrap.cc:492] T 10a905a175a44997948637602e0b015e P 3d1f3335b323406f8f1ad7a1e277cdc7: Bootstrap starting.
I20260709 13:02:39.871161 13923 tablet_bootstrap.cc:654] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.873883 13525 catalog_manager.cc:5697] T 3ff553d020244a79a9313c1b5bfec8f3 P 3c82125d03ae4947ac9a79aebe4d8cf0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:39.875324 13920 tablet_bootstrap.cc:654] T 10a905a175a44997948637602e0b015e P 3d1f3335b323406f8f1ad7a1e277cdc7: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.885537 13944 raft_consensus.cc:493] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.886648 13944 raft_consensus.cc:515] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.888638 13923 tablet_bootstrap.cc:492] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0: No bootstrap required, opened a new log
I20260709 13:02:39.896970 13923 ts_tablet_manager.cc:1403] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.014s
I20260709 13:02:39.889973 13700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f837ca6c9244cd9add3d210c307cb5" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" is_pre_election: true
I20260709 13:02:39.897969 13700 raft_consensus.cc:2468] T 51f837ca6c9244cd9add3d210c307cb5 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79660023c1124b7e8da27181f34a5c92 in term 0.
I20260709 13:02:39.890013 13625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f837ca6c9244cd9add3d210c307cb5" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" is_pre_election: true
I20260709 13:02:39.899431 13625 raft_consensus.cc:2468] T 51f837ca6c9244cd9add3d210c307cb5 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79660023c1124b7e8da27181f34a5c92 in term 0.
I20260709 13:02:39.895043 13918 raft_consensus.cc:493] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.900385 13923 raft_consensus.cc:359] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.900705 13741 leader_election.cc:304] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1f3335b323406f8f1ad7a1e277cdc7, 79660023c1124b7e8da27181f34a5c92; no voters: 
I20260709 13:02:39.901695 13943 raft_consensus.cc:2804] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.902021 13923 raft_consensus.cc:385] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.902096 13943 raft_consensus.cc:493] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.902452 13923 raft_consensus.cc:740] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.902657 13943 raft_consensus.cc:3060] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.888949 13944 leader_election.cc:290] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901)
I20260709 13:02:39.903369 13923 consensus_queue.cc:260] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.903972 13918 raft_consensus.cc:515] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.906014 13923 ts_tablet_manager.cc:1434] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:02:39.906327 13918 leader_election.cc:290] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901)
I20260709 13:02:39.907214 13923 tablet_bootstrap.cc:492] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0: Bootstrap starting.
I20260709 13:02:39.909513 13625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7b8e9e2cd2438385b3cd4db2887674" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" is_pre_election: true
I20260709 13:02:39.910267 13625 raft_consensus.cc:2468] T da7b8e9e2cd2438385b3cd4db2887674 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79660023c1124b7e8da27181f34a5c92 in term 0.
I20260709 13:02:39.911288 13943 raft_consensus.cc:515] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.911754 13741 leader_election.cc:304] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1f3335b323406f8f1ad7a1e277cdc7, 79660023c1124b7e8da27181f34a5c92; no voters: 
I20260709 13:02:39.912957 13700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7b8e9e2cd2438385b3cd4db2887674" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" is_pre_election: true
I20260709 13:02:39.913661 13700 raft_consensus.cc:2468] T da7b8e9e2cd2438385b3cd4db2887674 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79660023c1124b7e8da27181f34a5c92 in term 0.
I20260709 13:02:39.914624 13625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f837ca6c9244cd9add3d210c307cb5" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
I20260709 13:02:39.915087 13923 tablet_bootstrap.cc:654] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.915302 13625 raft_consensus.cc:3060] T 51f837ca6c9244cd9add3d210c307cb5 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.923264 13625 raft_consensus.cc:2468] T 51f837ca6c9244cd9add3d210c307cb5 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79660023c1124b7e8da27181f34a5c92 in term 1.
I20260709 13:02:39.915438 13918 raft_consensus.cc:2804] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.925405 13918 raft_consensus.cc:493] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.925751 13918 raft_consensus.cc:3060] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.929023 13700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f837ca6c9244cd9add3d210c307cb5" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
I20260709 13:02:39.929698 13700 raft_consensus.cc:3060] T 51f837ca6c9244cd9add3d210c307cb5 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.932235 13918 raft_consensus.cc:515] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.933131 13741 leader_election.cc:304] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1f3335b323406f8f1ad7a1e277cdc7, 79660023c1124b7e8da27181f34a5c92; no voters: 
I20260709 13:02:39.933948 13944 raft_consensus.cc:2804] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:39.924443 13943 leader_election.cc:290] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 election: Requested vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901)
I20260709 13:02:39.940413 13700 raft_consensus.cc:2468] T 51f837ca6c9244cd9add3d210c307cb5 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79660023c1124b7e8da27181f34a5c92 in term 1.
I20260709 13:02:39.943259 13919 tablet_bootstrap.cc:492] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92: No bootstrap required, opened a new log
I20260709 13:02:39.943933 13919 ts_tablet_manager.cc:1403] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92: Time spent bootstrapping tablet: real 0.104s	user 0.017s	sys 0.017s
I20260709 13:02:39.944456 13625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7b8e9e2cd2438385b3cd4db2887674" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
I20260709 13:02:39.946271 13923 tablet_bootstrap.cc:492] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0: No bootstrap required, opened a new log
I20260709 13:02:39.945305 13918 leader_election.cc:290] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 election: Requested vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901)
I20260709 13:02:39.946437 13920 tablet_bootstrap.cc:492] T 10a905a175a44997948637602e0b015e P 3d1f3335b323406f8f1ad7a1e277cdc7: No bootstrap required, opened a new log
I20260709 13:02:39.943476 13700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7b8e9e2cd2438385b3cd4db2887674" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
I20260709 13:02:39.946985 13920 ts_tablet_manager.cc:1403] T 10a905a175a44997948637602e0b015e P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent bootstrapping tablet: real 0.078s	user 0.015s	sys 0.019s
I20260709 13:02:39.946796 13919 raft_consensus.cc:359] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.947599 13700 raft_consensus.cc:3060] T da7b8e9e2cd2438385b3cd4db2887674 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.947089 13625 raft_consensus.cc:3060] T da7b8e9e2cd2438385b3cd4db2887674 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.946800 13923 ts_tablet_manager.cc:1403] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.018s
I20260709 13:02:39.947896 13919 raft_consensus.cc:385] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.951160 13919 raft_consensus.cc:740] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.952119 13919 consensus_queue.cc:260] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.954078 13944 raft_consensus.cc:697] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92 [term 1 LEADER]: Becoming Leader. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Running, Role: LEADER
I20260709 13:02:39.955148 13944 consensus_queue.cc:237] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.955298 13923 raft_consensus.cc:359] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.956168 13923 raft_consensus.cc:385] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.956466 13923 raft_consensus.cc:740] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.956566 13700 raft_consensus.cc:2468] T da7b8e9e2cd2438385b3cd4db2887674 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79660023c1124b7e8da27181f34a5c92 in term 1.
I20260709 13:02:39.957255 13923 consensus_queue.cc:260] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.957764 13741 leader_election.cc:304] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 79660023c1124b7e8da27181f34a5c92; no voters: 
I20260709 13:02:39.954411 13919 ts_tablet_manager.cc:1434] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:02:39.958715 13918 raft_consensus.cc:2804] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:39.959141 13923 ts_tablet_manager.cc:1434] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:02:39.959206 13918 raft_consensus.cc:697] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92 [term 1 LEADER]: Becoming Leader. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Running, Role: LEADER
I20260709 13:02:39.960414 13918 consensus_queue.cc:237] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.960959 13923 tablet_bootstrap.cc:492] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3c82125d03ae4947ac9a79aebe4d8cf0: Bootstrap starting.
I20260709 13:02:39.962227 13919 tablet_bootstrap.cc:492] T b7206076e6c7492fb38ceed548977cd6 P 79660023c1124b7e8da27181f34a5c92: Bootstrap starting.
I20260709 13:02:39.968406 13923 tablet_bootstrap.cc:654] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3c82125d03ae4947ac9a79aebe4d8cf0: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.969159 13907 raft_consensus.cc:493] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.969851 13907 raft_consensus.cc:515] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.971643 13920 raft_consensus.cc:359] T 10a905a175a44997948637602e0b015e P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.972566 13920 raft_consensus.cc:385] T 10a905a175a44997948637602e0b015e P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.972877 13920 raft_consensus.cc:740] T 10a905a175a44997948637602e0b015e P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.973670 13920 consensus_queue.cc:260] T 10a905a175a44997948637602e0b015e P 3d1f3335b323406f8f1ad7a1e277cdc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.974004 13776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a905a175a44997948637602e0b015e" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79660023c1124b7e8da27181f34a5c92" is_pre_election: true
I20260709 13:02:39.974802 13776 raft_consensus.cc:2468] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in term 0.
I20260709 13:02:39.975919 13626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a905a175a44997948637602e0b015e" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" is_pre_election: true
I20260709 13:02:39.976786 13626 raft_consensus.cc:2468] T 10a905a175a44997948637602e0b015e P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in term 0.
I20260709 13:02:39.977046 13919 tablet_bootstrap.cc:654] T b7206076e6c7492fb38ceed548977cd6 P 79660023c1124b7e8da27181f34a5c92: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.976186 13920 ts_tablet_manager.cc:1434] T 10a905a175a44997948637602e0b015e P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent starting tablet: real 0.029s	user 0.002s	sys 0.002s
I20260709 13:02:39.980854 13923 tablet_bootstrap.cc:492] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3c82125d03ae4947ac9a79aebe4d8cf0: No bootstrap required, opened a new log
I20260709 13:02:39.981062 13920 tablet_bootstrap.cc:492] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7: Bootstrap starting.
I20260709 13:02:39.981351 13923 ts_tablet_manager.cc:1403] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.003s
I20260709 13:02:39.972270 13907 leader_election.cc:290] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:39.984331 13923 raft_consensus.cc:359] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.985110 13923 raft_consensus.cc:385] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.985383 13923 raft_consensus.cc:740] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.985596 13665 leader_election.cc:304] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 79660023c1124b7e8da27181f34a5c92; no voters: 
I20260709 13:02:39.986047 13923 consensus_queue.cc:260] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3c82125d03ae4947ac9a79aebe4d8cf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.987702 13903 raft_consensus.cc:2804] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.988091 13903 raft_consensus.cc:493] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.988445 13903 raft_consensus.cc:3060] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.987787 13920 tablet_bootstrap.cc:654] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.988238 13923 ts_tablet_manager.cc:1434] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3c82125d03ae4947ac9a79aebe4d8cf0: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:02:39.990813 13919 tablet_bootstrap.cc:492] T b7206076e6c7492fb38ceed548977cd6 P 79660023c1124b7e8da27181f34a5c92: No bootstrap required, opened a new log
I20260709 13:02:39.991219 13919 ts_tablet_manager.cc:1403] T b7206076e6c7492fb38ceed548977cd6 P 79660023c1124b7e8da27181f34a5c92: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.004s
I20260709 13:02:39.993553 13919 raft_consensus.cc:359] T b7206076e6c7492fb38ceed548977cd6 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.994195 13919 raft_consensus.cc:385] T b7206076e6c7492fb38ceed548977cd6 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.994450 13919 raft_consensus.cc:740] T b7206076e6c7492fb38ceed548977cd6 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.995282 13919 consensus_queue.cc:260] T b7206076e6c7492fb38ceed548977cd6 P 79660023c1124b7e8da27181f34a5c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:39.997990 13919 ts_tablet_manager.cc:1434] T b7206076e6c7492fb38ceed548977cd6 P 79660023c1124b7e8da27181f34a5c92: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:02:40.010957 13625 raft_consensus.cc:2468] T da7b8e9e2cd2438385b3cd4db2887674 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79660023c1124b7e8da27181f34a5c92 in term 1.
I20260709 13:02:40.014642 13903 raft_consensus.cc:515] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:40.019217 13903 leader_election.cc:290] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 election: Requested vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:40.018640 13920 tablet_bootstrap.cc:492] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7: No bootstrap required, opened a new log
I20260709 13:02:40.019850 13625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a905a175a44997948637602e0b015e" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
I20260709 13:02:40.020291 13776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a905a175a44997948637602e0b015e" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79660023c1124b7e8da27181f34a5c92"
I20260709 13:02:40.020665 13920 ts_tablet_manager.cc:1403] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.018s
I20260709 13:02:40.020696 13625 raft_consensus.cc:3060] T 10a905a175a44997948637602e0b015e P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.020994 13776 raft_consensus.cc:3060] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.023692 13920 raft_consensus.cc:359] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:40.024539 13920 raft_consensus.cc:385] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.024829 13920 raft_consensus.cc:740] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.025655 13920 consensus_queue.cc:260] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:40.027781 13920 ts_tablet_manager.cc:1434] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:40.028745 13776 raft_consensus.cc:2468] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in term 1.
I20260709 13:02:40.030015 13665 leader_election.cc:304] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 79660023c1124b7e8da27181f34a5c92; no voters: 
I20260709 13:02:40.030556 13625 raft_consensus.cc:2468] T 10a905a175a44997948637602e0b015e P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in term 1.
I20260709 13:02:40.030965 13903 raft_consensus.cc:2804] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.031718 13903 raft_consensus.cc:697] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 LEADER]: Becoming Leader. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Running, Role: LEADER
I20260709 13:02:40.031029 13522 catalog_manager.cc:5697] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79660023c1124b7e8da27181f34a5c92 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "79660023c1124b7e8da27181f34a5c92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:40.032603 13903 consensus_queue.cc:237] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:40.048034 13522 catalog_manager.cc:5697] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:40.052935 13525 catalog_manager.cc:5697] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79660023c1124b7e8da27181f34a5c92 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "79660023c1124b7e8da27181f34a5c92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:40.064198 13918 raft_consensus.cc:493] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.064985 13918 raft_consensus.cc:515] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:40.067317 13918 leader_election.cc:290] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901)
I20260709 13:02:40.068008 13625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c5ee32461343ea8ed9720c6ae81482" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" is_pre_election: true
I20260709 13:02:40.068768 13625 raft_consensus.cc:2468] T 94c5ee32461343ea8ed9720c6ae81482 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79660023c1124b7e8da27181f34a5c92 in term 0.
I20260709 13:02:40.069952 13741 leader_election.cc:304] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1f3335b323406f8f1ad7a1e277cdc7, 79660023c1124b7e8da27181f34a5c92; no voters: 
I20260709 13:02:40.070463 13700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c5ee32461343ea8ed9720c6ae81482" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" is_pre_election: true
I20260709 13:02:40.070688 13918 raft_consensus.cc:2804] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:40.070726 13903 raft_consensus.cc:493] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.071290 13918 raft_consensus.cc:493] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.071509 13700 raft_consensus.cc:2468] T 94c5ee32461343ea8ed9720c6ae81482 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79660023c1124b7e8da27181f34a5c92 in term 0.
I20260709 13:02:40.071444 13903 raft_consensus.cc:515] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:40.072054 13918 raft_consensus.cc:3060] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.073930 13903 leader_election.cc:290] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:40.075117 13776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7206076e6c7492fb38ceed548977cd6" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79660023c1124b7e8da27181f34a5c92" is_pre_election: true
I20260709 13:02:40.075117 13625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7206076e6c7492fb38ceed548977cd6" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" is_pre_election: true
I20260709 13:02:40.076103 13776 raft_consensus.cc:2468] T b7206076e6c7492fb38ceed548977cd6 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in term 0.
I20260709 13:02:40.076103 13625 raft_consensus.cc:2468] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in term 0.
I20260709 13:02:40.077534 13665 leader_election.cc:304] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 79660023c1124b7e8da27181f34a5c92; no voters: 
I20260709 13:02:40.078502 13903 raft_consensus.cc:2804] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:40.078812 13903 raft_consensus.cc:493] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.079257 13903 raft_consensus.cc:3060] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.078862 13918 raft_consensus.cc:515] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:40.080789 13918 leader_election.cc:290] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 election: Requested vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901)
I20260709 13:02:40.081595 13625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c5ee32461343ea8ed9720c6ae81482" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
I20260709 13:02:40.082088 13700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c5ee32461343ea8ed9720c6ae81482" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
I20260709 13:02:40.082226 13625 raft_consensus.cc:3060] T 94c5ee32461343ea8ed9720c6ae81482 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.082731 13700 raft_consensus.cc:3060] T 94c5ee32461343ea8ed9720c6ae81482 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.085263 13903 raft_consensus.cc:515] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:40.087598 13903 leader_election.cc:290] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 election: Requested vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:40.088055 13626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7206076e6c7492fb38ceed548977cd6" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
I20260709 13:02:40.088655 13626 raft_consensus.cc:3060] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.089480 13700 raft_consensus.cc:2468] T 94c5ee32461343ea8ed9720c6ae81482 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79660023c1124b7e8da27181f34a5c92 in term 1.
I20260709 13:02:40.089480 13625 raft_consensus.cc:2468] T 94c5ee32461343ea8ed9720c6ae81482 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79660023c1124b7e8da27181f34a5c92 in term 1.
I20260709 13:02:40.090737 13741 leader_election.cc:304] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1f3335b323406f8f1ad7a1e277cdc7, 79660023c1124b7e8da27181f34a5c92; no voters: 
I20260709 13:02:40.091393 13918 raft_consensus.cc:2804] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.092659 13918 raft_consensus.cc:697] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92 [term 1 LEADER]: Becoming Leader. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Running, Role: LEADER
I20260709 13:02:40.093484 13918 consensus_queue.cc:237] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:40.095495 13626 raft_consensus.cc:2468] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in term 1.
I20260709 13:02:40.096637 13667 leader_election.cc:304] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 3d1f3335b323406f8f1ad7a1e277cdc7; no voters: 
I20260709 13:02:40.097143 13776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7206076e6c7492fb38ceed548977cd6" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79660023c1124b7e8da27181f34a5c92"
I20260709 13:02:40.097743 13776 raft_consensus.cc:3060] T b7206076e6c7492fb38ceed548977cd6 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.099268 13903 raft_consensus.cc:2804] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.100109 13903 raft_consensus.cc:697] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 LEADER]: Becoming Leader. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Running, Role: LEADER
I20260709 13:02:40.101029 13903 consensus_queue.cc:237] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:40.104395 13776 raft_consensus.cc:2468] T b7206076e6c7492fb38ceed548977cd6 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in term 1.
I20260709 13:02:40.107440 13525 catalog_manager.cc:5697] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79660023c1124b7e8da27181f34a5c92 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "79660023c1124b7e8da27181f34a5c92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:40.110054 13522 catalog_manager.cc:5697] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:40.128801 13839 consensus_queue.cc:1048] T 9536c08be4d6442abdf27526c01de2e9 P 3d1f3335b323406f8f1ad7a1e277cdc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.140508 13839 consensus_queue.cc:1048] T 9536c08be4d6442abdf27526c01de2e9 P 3d1f3335b323406f8f1ad7a1e277cdc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.185016 13839 consensus_queue.cc:1048] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.193732 13700 raft_consensus.cc:3060] T 45bd91d3220e4f1e972885415f1ce1ae P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.201594 13936 consensus_queue.cc:1048] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.240688 13903 consensus_queue.cc:1048] T 3ff553d020244a79a9313c1b5bfec8f3 P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.252147 13907 consensus_queue.cc:1048] T 3ff553d020244a79a9313c1b5bfec8f3 P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.422329 13936 raft_consensus.cc:493] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.422848 13936 raft_consensus.cc:515] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:40.424665 13936 leader_election.cc:290] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:40.425273 13700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0d0d36fd19492ca51a47c34fdb2b64" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" is_pre_election: true
I20260709 13:02:40.425557 13776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0d0d36fd19492ca51a47c34fdb2b64" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79660023c1124b7e8da27181f34a5c92" is_pre_election: true
I20260709 13:02:40.425945 13700 raft_consensus.cc:2468] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d1f3335b323406f8f1ad7a1e277cdc7 in term 0.
I20260709 13:02:40.426267 13776 raft_consensus.cc:2468] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d1f3335b323406f8f1ad7a1e277cdc7 in term 0.
I20260709 13:02:40.426990 13592 leader_election.cc:304] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 3d1f3335b323406f8f1ad7a1e277cdc7; no voters: 
I20260709 13:02:40.427778 13936 raft_consensus.cc:2804] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:40.428162 13936 raft_consensus.cc:493] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.428422 13936 raft_consensus.cc:3060] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.433785 13936 raft_consensus.cc:515] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:40.435662 13936 leader_election.cc:290] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 election: Requested vote from peers 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:40.436419 13700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0d0d36fd19492ca51a47c34fdb2b64" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
I20260709 13:02:40.436635 13776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0d0d36fd19492ca51a47c34fdb2b64" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79660023c1124b7e8da27181f34a5c92"
I20260709 13:02:40.436986 13700 raft_consensus.cc:3060] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.437228 13776 raft_consensus.cc:3060] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 79660023c1124b7e8da27181f34a5c92 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.442071 13700 raft_consensus.cc:2468] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1f3335b323406f8f1ad7a1e277cdc7 in term 1.
I20260709 13:02:40.443012 13776 raft_consensus.cc:2468] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1f3335b323406f8f1ad7a1e277cdc7 in term 1.
I20260709 13:02:40.443351 13592 leader_election.cc:304] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 3d1f3335b323406f8f1ad7a1e277cdc7; no voters: 
I20260709 13:02:40.444211 13936 raft_consensus.cc:2804] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.444624 13936 raft_consensus.cc:697] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 LEADER]: Becoming Leader. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Running, Role: LEADER
I20260709 13:02:40.445489 13936 consensus_queue.cc:237] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
W20260709 13:02:40.448899 13573 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:40.453310 13522 catalog_manager.cc:5697] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:40.484400 13918 consensus_queue.cc:1048] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.486979 13918 consensus_queue.cc:1048] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.502199 13944 consensus_queue.cc:1048] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.509672 13961 consensus_queue.cc:1048] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.526708 13956 consensus_queue.cc:1048] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:40.526724 13961 consensus_queue.cc:1048] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:40.527361 13943 consensus_queue.cc:1048] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.555884 13943 consensus_queue.cc:1048] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.584467 13961 consensus_queue.cc:1048] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.595188 13903 consensus_queue.cc:1048] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.648624 13776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da7b8e9e2cd2438385b3cd4db2887674"
dest_uuid: "79660023c1124b7e8da27181f34a5c92"
mode: GRACEFUL
new_leader_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
 from {username='slave'} at 127.0.0.1:53282
I20260709 13:02:40.649159 13776 raft_consensus.cc:606] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92 [term 1 LEADER]: Received request to transfer leadership to TS 3d1f3335b323406f8f1ad7a1e277cdc7
I20260709 13:02:40.654120 13700 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7206076e6c7492fb38ceed548977cd6"
dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
mode: GRACEFUL
new_leader_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
 from {username='slave'} at 127.0.0.1:45142
I20260709 13:02:40.654619 13700 raft_consensus.cc:606] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 LEADER]: Received request to transfer leadership to TS 3d1f3335b323406f8f1ad7a1e277cdc7
I20260709 13:02:40.659299 13776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51f837ca6c9244cd9add3d210c307cb5"
dest_uuid: "79660023c1124b7e8da27181f34a5c92"
mode: GRACEFUL
new_leader_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
 from {username='slave'} at 127.0.0.1:53282
I20260709 13:02:40.659786 13776 raft_consensus.cc:606] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92 [term 1 LEADER]: Received request to transfer leadership to TS 3c82125d03ae4947ac9a79aebe4d8cf0
I20260709 13:02:40.667078 13626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e0d0d36fd19492ca51a47c34fdb2b64"
dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
mode: GRACEFUL
new_leader_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
 from {username='slave'} at 127.0.0.1:52116
I20260709 13:02:40.667735 13626 raft_consensus.cc:606] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 LEADER]: Received request to transfer leadership to TS 3c82125d03ae4947ac9a79aebe4d8cf0
I20260709 13:02:40.672554 13776 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94c5ee32461343ea8ed9720c6ae81482"
dest_uuid: "79660023c1124b7e8da27181f34a5c92"
mode: GRACEFUL
new_leader_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
 from {username='slave'} at 127.0.0.1:53282
I20260709 13:02:40.673013 13776 raft_consensus.cc:606] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92 [term 1 LEADER]: Received request to transfer leadership to TS 3c82125d03ae4947ac9a79aebe4d8cf0
I20260709 13:02:40.678094 13700 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10a905a175a44997948637602e0b015e"
dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
mode: GRACEFUL
new_leader_uuid: "79660023c1124b7e8da27181f34a5c92"
 from {username='slave'} at 127.0.0.1:45142
I20260709 13:02:40.678629 13700 raft_consensus.cc:606] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 LEADER]: Received request to transfer leadership to TS 79660023c1124b7e8da27181f34a5c92
I20260709 13:02:40.829473 13936 consensus_queue.cc:1048] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.840981 13936 consensus_queue.cc:1048] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.850095 13936 raft_consensus.cc:993] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7: : Instructing follower 3c82125d03ae4947ac9a79aebe4d8cf0 to start an election
I20260709 13:02:40.850579 13839 raft_consensus.cc:1081] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 LEADER]: Signalling peer 3c82125d03ae4947ac9a79aebe4d8cf0 to start an election
I20260709 13:02:40.852521 13700 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e0d0d36fd19492ca51a47c34fdb2b64"
dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
 from {username='slave'} at 127.0.0.1:45122
I20260709 13:02:40.853031 13700 raft_consensus.cc:493] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:40.853300 13700 raft_consensus.cc:3060] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:40.858302 13700 raft_consensus.cc:515] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:40.860607 13700 leader_election.cc:290] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 2 election: Requested vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:40.860966 13776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0d0d36fd19492ca51a47c34fdb2b64" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79660023c1124b7e8da27181f34a5c92"
I20260709 13:02:40.860941 13626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e0d0d36fd19492ca51a47c34fdb2b64" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
I20260709 13:02:40.861812 13626 raft_consensus.cc:3055] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:40.862217 13626 raft_consensus.cc:740] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Running, Role: LEADER
I20260709 13:02:40.861781 13776 raft_consensus.cc:3060] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:40.863059 13626 consensus_queue.cc:260] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:40.864450 13626 raft_consensus.cc:3060] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:40.868193 13776 raft_consensus.cc:2468] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in term 2.
I20260709 13:02:40.869468 13665 leader_election.cc:304] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 79660023c1124b7e8da27181f34a5c92; no voters: 
I20260709 13:02:40.870182 13903 raft_consensus.cc:2804] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:40.871042 13626 raft_consensus.cc:2468] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in term 2.
I20260709 13:02:40.870679 13903 raft_consensus.cc:697] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 LEADER]: Becoming Leader. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Running, Role: LEADER
I20260709 13:02:40.873076 13903 consensus_queue.cc:237] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:40.883072 13522 catalog_manager.cc:5697] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3c82125d03ae4947ac9a79aebe4d8cf0 reported cstate change: term changed from 1 to 2, leader changed from 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193) to 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:40.916177 13918 raft_consensus.cc:993] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92: : Instructing follower 3c82125d03ae4947ac9a79aebe4d8cf0 to start an election
I20260709 13:02:40.916860 13918 raft_consensus.cc:1081] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92 [term 1 LEADER]: Signalling peer 3c82125d03ae4947ac9a79aebe4d8cf0 to start an election
I20260709 13:02:40.917662 13956 raft_consensus.cc:993] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92: : Instructing follower 3d1f3335b323406f8f1ad7a1e277cdc7 to start an election
I20260709 13:02:40.918371 13956 raft_consensus.cc:1081] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92 [term 1 LEADER]: Signalling peer 3d1f3335b323406f8f1ad7a1e277cdc7 to start an election
I20260709 13:02:40.919484 13700 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94c5ee32461343ea8ed9720c6ae81482"
dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
 from {username='slave'} at 127.0.0.1:45138
I20260709 13:02:40.920352 13700 raft_consensus.cc:493] T 94c5ee32461343ea8ed9720c6ae81482 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:40.920827 13700 raft_consensus.cc:3060] T 94c5ee32461343ea8ed9720c6ae81482 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:40.920778 13626 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da7b8e9e2cd2438385b3cd4db2887674"
dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
 from {username='slave'} at 127.0.0.1:52110
I20260709 13:02:40.921913 13626 raft_consensus.cc:493] T da7b8e9e2cd2438385b3cd4db2887674 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:40.922389 13626 raft_consensus.cc:3060] T da7b8e9e2cd2438385b3cd4db2887674 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:40.928395 13700 raft_consensus.cc:515] T 94c5ee32461343ea8ed9720c6ae81482 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:40.929114 13626 raft_consensus.cc:515] T da7b8e9e2cd2438385b3cd4db2887674 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:40.931416 13700 leader_election.cc:290] T 94c5ee32461343ea8ed9720c6ae81482 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 2 election: Requested vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:40.931864 13626 leader_election.cc:290] T da7b8e9e2cd2438385b3cd4db2887674 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 2 election: Requested vote from peers 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:40.938297 13775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7b8e9e2cd2438385b3cd4db2887674" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79660023c1124b7e8da27181f34a5c92"
I20260709 13:02:40.933516 13701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7b8e9e2cd2438385b3cd4db2887674" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
I20260709 13:02:40.931304 13776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c5ee32461343ea8ed9720c6ae81482" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79660023c1124b7e8da27181f34a5c92"
I20260709 13:02:40.931334 13627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94c5ee32461343ea8ed9720c6ae81482" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
I20260709 13:02:40.943099 13775 raft_consensus.cc:3055] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:40.943148 13627 raft_consensus.cc:3060] T 94c5ee32461343ea8ed9720c6ae81482 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:40.942788 13701 raft_consensus.cc:3060] T da7b8e9e2cd2438385b3cd4db2887674 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:40.943514 13775 raft_consensus.cc:740] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Running, Role: LEADER
I20260709 13:02:40.944561 13775 consensus_queue.cc:260] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:40.945981 13775 raft_consensus.cc:3060] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:40.948753 13776 raft_consensus.cc:3055] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:40.949189 13776 raft_consensus.cc:740] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Running, Role: LEADER
I20260709 13:02:40.950088 13701 raft_consensus.cc:2468] T da7b8e9e2cd2438385b3cd4db2887674 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1f3335b323406f8f1ad7a1e277cdc7 in term 2.
I20260709 13:02:40.950002 13776 consensus_queue.cc:260] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:40.951550 13776 raft_consensus.cc:3060] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:40.951792 13592 leader_election.cc:304] T da7b8e9e2cd2438385b3cd4db2887674 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 3d1f3335b323406f8f1ad7a1e277cdc7; no voters: 
I20260709 13:02:40.952104 13627 raft_consensus.cc:2468] T 94c5ee32461343ea8ed9720c6ae81482 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in term 2.
I20260709 13:02:40.952780 13839 raft_consensus.cc:2804] T da7b8e9e2cd2438385b3cd4db2887674 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:40.953279 13839 raft_consensus.cc:697] T da7b8e9e2cd2438385b3cd4db2887674 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 LEADER]: Becoming Leader. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Running, Role: LEADER
I20260709 13:02:40.953838 13775 raft_consensus.cc:2468] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1f3335b323406f8f1ad7a1e277cdc7 in term 2.
I20260709 13:02:40.954106 13839 consensus_queue.cc:237] T da7b8e9e2cd2438385b3cd4db2887674 P 3d1f3335b323406f8f1ad7a1e277cdc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:40.955621 13667 leader_election.cc:304] T 94c5ee32461343ea8ed9720c6ae81482 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 3d1f3335b323406f8f1ad7a1e277cdc7; no voters: 
I20260709 13:02:40.956429 13903 raft_consensus.cc:2804] T 94c5ee32461343ea8ed9720c6ae81482 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:40.956911 13903 raft_consensus.cc:697] T 94c5ee32461343ea8ed9720c6ae81482 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 LEADER]: Becoming Leader. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Running, Role: LEADER
I20260709 13:02:40.957677 13903 consensus_queue.cc:237] T 94c5ee32461343ea8ed9720c6ae81482 P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:40.961853 13776 raft_consensus.cc:2468] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in term 2.
I20260709 13:02:40.963284 13522 catalog_manager.cc:5697] T da7b8e9e2cd2438385b3cd4db2887674 P 3d1f3335b323406f8f1ad7a1e277cdc7 reported cstate change: term changed from 1 to 2, leader changed from 79660023c1124b7e8da27181f34a5c92 (127.0.107.195) to 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:40.965353 13524 catalog_manager.cc:5697] T 94c5ee32461343ea8ed9720c6ae81482 P 3c82125d03ae4947ac9a79aebe4d8cf0 reported cstate change: term changed from 1 to 2, leader changed from 79660023c1124b7e8da27181f34a5c92 (127.0.107.195) to 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:41.086107 13990 raft_consensus.cc:993] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0: : Instructing follower 3d1f3335b323406f8f1ad7a1e277cdc7 to start an election
I20260709 13:02:41.086740 13990 raft_consensus.cc:1081] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 LEADER]: Signalling peer 3d1f3335b323406f8f1ad7a1e277cdc7 to start an election
I20260709 13:02:41.088392 13627 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7206076e6c7492fb38ceed548977cd6"
dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
 from {username='slave'} at 127.0.0.1:52098
I20260709 13:02:41.089061 13627 raft_consensus.cc:493] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:41.089473 13627 raft_consensus.cc:3060] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:41.089972 13956 raft_consensus.cc:993] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92: : Instructing follower 3c82125d03ae4947ac9a79aebe4d8cf0 to start an election
I20260709 13:02:41.090520 13943 raft_consensus.cc:1081] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92 [term 1 LEADER]: Signalling peer 3c82125d03ae4947ac9a79aebe4d8cf0 to start an election
I20260709 13:02:41.092015 13701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51f837ca6c9244cd9add3d210c307cb5"
dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
 from {username='slave'} at 127.0.0.1:45138
I20260709 13:02:41.092517 13701 raft_consensus.cc:493] T 51f837ca6c9244cd9add3d210c307cb5 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:41.092809 13701 raft_consensus.cc:3060] T 51f837ca6c9244cd9add3d210c307cb5 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:41.096616 13627 raft_consensus.cc:515] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:41.098798 13627 leader_election.cc:290] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 2 election: Requested vote from peers 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:41.099100 13701 raft_consensus.cc:515] T 51f837ca6c9244cd9add3d210c307cb5 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:41.100644 13775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7206076e6c7492fb38ceed548977cd6" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79660023c1124b7e8da27181f34a5c92"
I20260709 13:02:41.101212 13775 raft_consensus.cc:3060] T b7206076e6c7492fb38ceed548977cd6 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:41.101905 13701 leader_election.cc:290] T 51f837ca6c9244cd9add3d210c307cb5 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 2 election: Requested vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 79660023c1124b7e8da27181f34a5c92 (127.0.107.195:43687)
I20260709 13:02:41.102075 13627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f837ca6c9244cd9add3d210c307cb5" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
I20260709 13:02:41.102650 13627 raft_consensus.cc:3060] T 51f837ca6c9244cd9add3d210c307cb5 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:41.102742 13776 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51f837ca6c9244cd9add3d210c307cb5" candidate_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79660023c1124b7e8da27181f34a5c92"
I20260709 13:02:41.103416 13776 raft_consensus.cc:3055] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:41.100096 13700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7206076e6c7492fb38ceed548977cd6" candidate_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
I20260709 13:02:41.103732 13776 raft_consensus.cc:740] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Running, Role: LEADER
I20260709 13:02:41.103971 13700 raft_consensus.cc:3055] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:41.104439 13700 raft_consensus.cc:740] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Running, Role: LEADER
I20260709 13:02:41.104611 13776 consensus_queue.cc:260] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:41.105397 13700 consensus_queue.cc:260] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:41.106098 13776 raft_consensus.cc:3060] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:41.106863 13700 raft_consensus.cc:3060] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:41.109476 13775 raft_consensus.cc:2468] T b7206076e6c7492fb38ceed548977cd6 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1f3335b323406f8f1ad7a1e277cdc7 in term 2.
I20260709 13:02:41.110951 13590 leader_election.cc:304] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1f3335b323406f8f1ad7a1e277cdc7, 79660023c1124b7e8da27181f34a5c92; no voters: 
I20260709 13:02:41.111017 13627 raft_consensus.cc:2468] T 51f837ca6c9244cd9add3d210c307cb5 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in term 2.
I20260709 13:02:41.111901 13936 raft_consensus.cc:2804] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:41.112243 13667 leader_election.cc:304] T 51f837ca6c9244cd9add3d210c307cb5 P 3c82125d03ae4947ac9a79aebe4d8cf0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 3d1f3335b323406f8f1ad7a1e277cdc7; no voters: 
I20260709 13:02:41.112375 13936 raft_consensus.cc:697] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 LEADER]: Becoming Leader. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Running, Role: LEADER
I20260709 13:02:41.113106 13907 raft_consensus.cc:2804] T 51f837ca6c9244cd9add3d210c307cb5 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:41.113631 13907 raft_consensus.cc:697] T 51f837ca6c9244cd9add3d210c307cb5 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 LEADER]: Becoming Leader. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Running, Role: LEADER
I20260709 13:02:41.113889 13936 consensus_queue.cc:237] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:41.114427 13907 consensus_queue.cc:237] T 51f837ca6c9244cd9add3d210c307cb5 P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:41.114849 13776 raft_consensus.cc:2468] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c82125d03ae4947ac9a79aebe4d8cf0 in term 2.
I20260709 13:02:41.116123 13700 raft_consensus.cc:2468] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d1f3335b323406f8f1ad7a1e277cdc7 in term 2.
I20260709 13:02:41.122185 13524 catalog_manager.cc:5697] T 51f837ca6c9244cd9add3d210c307cb5 P 3c82125d03ae4947ac9a79aebe4d8cf0 reported cstate change: term changed from 1 to 2, leader changed from 79660023c1124b7e8da27181f34a5c92 (127.0.107.195) to 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:41.122351 13522 catalog_manager.cc:5697] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7 reported cstate change: term changed from 1 to 2, leader changed from 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194) to 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:41.199442 13961 raft_consensus.cc:993] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0: : Instructing follower 79660023c1124b7e8da27181f34a5c92 to start an election
I20260709 13:02:41.199882 13907 raft_consensus.cc:1081] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 LEADER]: Signalling peer 79660023c1124b7e8da27181f34a5c92 to start an election
I20260709 13:02:41.201390 13776 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10a905a175a44997948637602e0b015e"
dest_uuid: "79660023c1124b7e8da27181f34a5c92"
 from {username='slave'} at 127.0.0.1:53268
I20260709 13:02:41.201881 13776 raft_consensus.cc:493] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:41.202137 13776 raft_consensus.cc:3060] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:41.207347 13776 raft_consensus.cc:515] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:41.209108 13776 leader_election.cc:290] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 2 election: Requested vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901)
I20260709 13:02:41.209849 13627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a905a175a44997948637602e0b015e" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
I20260709 13:02:41.210183 13700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10a905a175a44997948637602e0b015e" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
I20260709 13:02:41.210467 13627 raft_consensus.cc:3060] T 10a905a175a44997948637602e0b015e P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:41.210736 13700 raft_consensus.cc:3055] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:41.210985 13700 raft_consensus.cc:740] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Running, Role: LEADER
I20260709 13:02:41.211531 13700 consensus_queue.cc:260] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:41.212440 13700 raft_consensus.cc:3060] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:41.215905 13627 raft_consensus.cc:2468] T 10a905a175a44997948637602e0b015e P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79660023c1124b7e8da27181f34a5c92 in term 2.
I20260709 13:02:41.217043 13700 raft_consensus.cc:2468] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79660023c1124b7e8da27181f34a5c92 in term 2.
I20260709 13:02:41.217284 13741 leader_election.cc:304] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1f3335b323406f8f1ad7a1e277cdc7, 79660023c1124b7e8da27181f34a5c92; no voters: 
I20260709 13:02:41.218102 13943 raft_consensus.cc:2804] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:41.218612 13943 raft_consensus.cc:697] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92 [term 2 LEADER]: Becoming Leader. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Running, Role: LEADER
I20260709 13:02:41.219218 13943 consensus_queue.cc:237] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:41.225631 13522 catalog_manager.cc:5697] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92 reported cstate change: term changed from 1 to 2, leader changed from 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194) to 79660023c1124b7e8da27181f34a5c92 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "79660023c1124b7e8da27181f34a5c92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:41.318209 13776 raft_consensus.cc:1275] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Refusing update from remote peer 3c82125d03ae4947ac9a79aebe4d8cf0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:41.319339 13907 consensus_queue.cc:1048] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:41.326524 13627 raft_consensus.cc:1275] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Refusing update from remote peer 3c82125d03ae4947ac9a79aebe4d8cf0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:41.328032 13907 consensus_queue.cc:1048] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:41.352421 13776 raft_consensus.cc:1275] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Refusing update from remote peer 3c82125d03ae4947ac9a79aebe4d8cf0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:41.353528 13907 consensus_queue.cc:1048] T 94c5ee32461343ea8ed9720c6ae81482 P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:41.363878 13627 raft_consensus.cc:1275] T 94c5ee32461343ea8ed9720c6ae81482 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Refusing update from remote peer 3c82125d03ae4947ac9a79aebe4d8cf0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:41.365340 13903 consensus_queue.cc:1048] T 94c5ee32461343ea8ed9720c6ae81482 P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:41.389881 13776 raft_consensus.cc:1275] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Refusing update from remote peer 3d1f3335b323406f8f1ad7a1e277cdc7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:41.391027 13936 consensus_queue.cc:1048] T da7b8e9e2cd2438385b3cd4db2887674 P 3d1f3335b323406f8f1ad7a1e277cdc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:41.399072 13700 raft_consensus.cc:1275] T da7b8e9e2cd2438385b3cd4db2887674 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Refusing update from remote peer 3d1f3335b323406f8f1ad7a1e277cdc7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:41.400363 13991 consensus_queue.cc:1048] T da7b8e9e2cd2438385b3cd4db2887674 P 3d1f3335b323406f8f1ad7a1e277cdc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:41.552170 13776 raft_consensus.cc:1275] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Refusing update from remote peer 3c82125d03ae4947ac9a79aebe4d8cf0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:41.553450 13903 consensus_queue.cc:1048] T 51f837ca6c9244cd9add3d210c307cb5 P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:41.562882 13627 raft_consensus.cc:1275] T 51f837ca6c9244cd9add3d210c307cb5 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Refusing update from remote peer 3c82125d03ae4947ac9a79aebe4d8cf0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:41.564555 13990 consensus_queue.cc:1048] T 51f837ca6c9244cd9add3d210c307cb5 P 3c82125d03ae4947ac9a79aebe4d8cf0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:41.631327 13700 raft_consensus.cc:1275] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Refusing update from remote peer 79660023c1124b7e8da27181f34a5c92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:41.632467 13943 consensus_queue.cc:1048] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:41.641603 13627 raft_consensus.cc:1275] T 10a905a175a44997948637602e0b015e P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Refusing update from remote peer 79660023c1124b7e8da27181f34a5c92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:41.643268 13956 consensus_queue.cc:1048] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:41.693903 13700 raft_consensus.cc:1275] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Refusing update from remote peer 3d1f3335b323406f8f1ad7a1e277cdc7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:41.695204 13991 consensus_queue.cc:1048] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:41.707367 13776 raft_consensus.cc:1275] T b7206076e6c7492fb38ceed548977cd6 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Refusing update from remote peer 3d1f3335b323406f8f1ad7a1e277cdc7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:41.710040 13936 consensus_queue.cc:1048] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:43.681464 13522 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:02:43.701573 13522 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42866:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:02:43.742134   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:43.797897 13592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36901, user_credentials={real_user=slave}} blocked reactor thread for 48535.9us
W20260709 13:02:43.815250 14014 log.cc:927] Time spent T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 13:02:43.953434 14023 log.cc:927] Time spent T 45bd91d3220e4f1e972885415f1ce1ae P 79660023c1124b7e8da27181f34a5c92: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 13:02:43.955132 14031 log.cc:927] Time spent T da7b8e9e2cd2438385b3cd4db2887674 P 3d1f3335b323406f8f1ad7a1e277cdc7: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:02:44.066205 14058 tablet.cc:1724] T 45bd91d3220e4f1e972885415f1ce1ae P 79660023c1124b7e8da27181f34a5c92: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:44.066205 14056 tablet.cc:1724] T 9536c08be4d6442abdf27526c01de2e9 P 3c82125d03ae4947ac9a79aebe4d8cf0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:44.105538 14055 tablet.cc:1724] T 9536c08be4d6442abdf27526c01de2e9 P 3d1f3335b323406f8f1ad7a1e277cdc7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:44.105593 14059 tablet.cc:1724] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:44.101500 14054 tablet.cc:1724] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:02:44.137096 13590 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43687, user_credentials={real_user=slave}} blocked reactor thread for 52909.5us
W20260709 13:02:44.140256 13592 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:36901, user_credentials={real_user=slave}} blocked reactor thread for 57844.1us
W20260709 13:02:44.145493 14048 log.cc:927] Time spent T 51f837ca6c9244cd9add3d210c307cb5 P 3d1f3335b323406f8f1ad7a1e277cdc7: Append to log took a long time: real 0.139s	user 0.003s	sys 0.000s
W20260709 13:02:44.153262 14047 log.cc:927] Time spent T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92: Append to log took a long time: real 0.114s	user 0.002s	sys 0.000s
I20260709 13:02:44.067782 14053 tablet.cc:1724] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3c82125d03ae4947ac9a79aebe4d8cf0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:44.184903 14068 tablet.cc:1724] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:44.192668 14065 tablet.cc:1724] T 3ff553d020244a79a9313c1b5bfec8f3 P 3c82125d03ae4947ac9a79aebe4d8cf0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:44.206357 14056 tablet.cc:1724] T 45bd91d3220e4f1e972885415f1ce1ae P 3c82125d03ae4947ac9a79aebe4d8cf0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:44.217844 14058 tablet.cc:1724] T b7206076e6c7492fb38ceed548977cd6 P 79660023c1124b7e8da27181f34a5c92: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:44.224509 14070 tablet.cc:1724] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:44.233531 13700 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "854f9710b117408cb32500bffcc2f500"
dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
mode: GRACEFUL
new_leader_uuid: "79660023c1124b7e8da27181f34a5c92"
 from {username='slave'} at 127.0.0.1:52938
I20260709 13:02:44.234342 13700 raft_consensus.cc:606] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 LEADER]: Received request to transfer leadership to TS 79660023c1124b7e8da27181f34a5c92
I20260709 13:02:44.238334 14054 tablet.cc:1724] T 10a905a175a44997948637602e0b015e P 3d1f3335b323406f8f1ad7a1e277cdc7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:44.254050 14033 raft_consensus.cc:993] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0: : Instructing follower 79660023c1124b7e8da27181f34a5c92 to start an election
I20260709 13:02:44.254632 14033 raft_consensus.cc:1081] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 LEADER]: Signalling peer 79660023c1124b7e8da27181f34a5c92 to start an election
I20260709 13:02:44.258900 13771 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "854f9710b117408cb32500bffcc2f500"
dest_uuid: "79660023c1124b7e8da27181f34a5c92"
 from {username='slave'} at 127.0.0.1:53268
I20260709 13:02:44.259634 13771 raft_consensus.cc:493] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:44.260109 13771 raft_consensus.cc:3060] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:44.263252 14055 tablet.cc:1724] T da7b8e9e2cd2438385b3cd4db2887674 P 3d1f3335b323406f8f1ad7a1e277cdc7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:44.247442 14062 tablet.cc:1724] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:44.267956 14059 tablet.cc:1724] T 94c5ee32461343ea8ed9720c6ae81482 P 3d1f3335b323406f8f1ad7a1e277cdc7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:44.278898 14053 tablet.cc:1724] T 94c5ee32461343ea8ed9720c6ae81482 P 3c82125d03ae4947ac9a79aebe4d8cf0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:44.283386 14065 tablet.cc:1724] T 51f837ca6c9244cd9add3d210c307cb5 P 3c82125d03ae4947ac9a79aebe4d8cf0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:44.289702 13771 raft_consensus.cc:515] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:44.292238 13771 leader_election.cc:290] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 3 election: Requested vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901)
I20260709 13:02:44.293536 13697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854f9710b117408cb32500bffcc2f500" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
I20260709 13:02:44.293557 13623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "854f9710b117408cb32500bffcc2f500" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
I20260709 13:02:44.305574 13623 raft_consensus.cc:3060] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:44.305442 13697 raft_consensus.cc:3055] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:44.315474 13697 raft_consensus.cc:740] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3c82125d03ae4947ac9a79aebe4d8cf0, State: Running, Role: LEADER
I20260709 13:02:44.316434 13697 consensus_queue.cc:260] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:44.317642 13697 raft_consensus.cc:3060] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:44.323256 14068 tablet.cc:1724] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:44.324636 14072 tablet.cc:1724] T 3ff553d020244a79a9313c1b5bfec8f3 P 79660023c1124b7e8da27181f34a5c92: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:44.317456 14070 tablet.cc:1724] T 51f837ca6c9244cd9add3d210c307cb5 P 3d1f3335b323406f8f1ad7a1e277cdc7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:44.328302 14056 tablet.cc:1724] T da7b8e9e2cd2438385b3cd4db2887674 P 3c82125d03ae4947ac9a79aebe4d8cf0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:44.313144 14062 tablet.cc:1724] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:44.299767 14058 tablet.cc:1724] T 9536c08be4d6442abdf27526c01de2e9 P 79660023c1124b7e8da27181f34a5c92: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:44.336748 14054 tablet.cc:1724] T 3ff553d020244a79a9313c1b5bfec8f3 P 3d1f3335b323406f8f1ad7a1e277cdc7: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:44.333590 14071 tablet.cc:1724] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 79660023c1124b7e8da27181f34a5c92: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:44.347748 13623 raft_consensus.cc:2468] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79660023c1124b7e8da27181f34a5c92 in term 3.
I20260709 13:02:44.369519 13741 leader_election.cc:304] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d1f3335b323406f8f1ad7a1e277cdc7, 79660023c1124b7e8da27181f34a5c92; no voters: 
I20260709 13:02:44.370659 14027 raft_consensus.cc:2804] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:44.371155 14027 raft_consensus.cc:697] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92 [term 3 LEADER]: Becoming Leader. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Running, Role: LEADER
I20260709 13:02:44.371985 14027 consensus_queue.cc:237] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:44.376366 14062 tablet.cc:1724] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:44.384317 13623 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "973db6db1a614f46a8c51c49bbe2afcd"
dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
mode: GRACEFUL
new_leader_uuid: "79660023c1124b7e8da27181f34a5c92"
 from {username='slave'} at 127.0.0.1:52198
I20260709 13:02:44.384999 13697 raft_consensus.cc:2468] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79660023c1124b7e8da27181f34a5c92 in term 3.
I20260709 13:02:44.386072 14071 tablet.cc:1724] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:44.385190 13623 raft_consensus.cc:606] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 LEADER]: Received request to transfer leadership to TS 79660023c1124b7e8da27181f34a5c92
I20260709 13:02:44.395879   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:44.396554   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:44.407503 13525 catalog_manager.cc:5697] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92 reported cstate change: term changed from 2 to 3, leader changed from 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194) to 79660023c1124b7e8da27181f34a5c92 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "79660023c1124b7e8da27181f34a5c92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.416112 13522 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 94f6ec2862e4400a8203b964a86f9869: soft_deleted_table [id=d356804d01994cdfb721eb22b8c66fd9] alter complete (version 1)
I20260709 13:02:44.803900 13991 raft_consensus.cc:993] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7: : Instructing follower 79660023c1124b7e8da27181f34a5c92 to start an election
I20260709 13:02:44.804320 13991 raft_consensus.cc:1081] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 LEADER]: Signalling peer 79660023c1124b7e8da27181f34a5c92 to start an election
I20260709 13:02:44.805684 13771 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "973db6db1a614f46a8c51c49bbe2afcd"
dest_uuid: "79660023c1124b7e8da27181f34a5c92"
 from {username='slave'} at 127.0.0.1:53256
I20260709 13:02:44.806133 13771 raft_consensus.cc:493] T 973db6db1a614f46a8c51c49bbe2afcd P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:44.806393 13771 raft_consensus.cc:3060] T 973db6db1a614f46a8c51c49bbe2afcd P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:44.811543 13771 raft_consensus.cc:515] T 973db6db1a614f46a8c51c49bbe2afcd P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:44.813256 13771 leader_election.cc:290] T 973db6db1a614f46a8c51c49bbe2afcd P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 2 election: Requested vote from peers 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087), 3c82125d03ae4947ac9a79aebe4d8cf0 (127.0.107.194:36901)
I20260709 13:02:44.814071 13623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "973db6db1a614f46a8c51c49bbe2afcd" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7"
I20260709 13:02:44.814378 13697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "973db6db1a614f46a8c51c49bbe2afcd" candidate_uuid: "79660023c1124b7e8da27181f34a5c92" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0"
I20260709 13:02:44.814745 13623 raft_consensus.cc:3055] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:44.814951 13697 raft_consensus.cc:3060] T 973db6db1a614f46a8c51c49bbe2afcd P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:44.815110 13623 raft_consensus.cc:740] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d1f3335b323406f8f1ad7a1e277cdc7, State: Running, Role: LEADER
I20260709 13:02:44.815898 13623 consensus_queue.cc:260] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:44.816941 13623 raft_consensus.cc:3060] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:44.820339 13697 raft_consensus.cc:2468] T 973db6db1a614f46a8c51c49bbe2afcd P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79660023c1124b7e8da27181f34a5c92 in term 2.
I20260709 13:02:44.821771 13741 leader_election.cc:304] T 973db6db1a614f46a8c51c49bbe2afcd P 79660023c1124b7e8da27181f34a5c92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c82125d03ae4947ac9a79aebe4d8cf0, 79660023c1124b7e8da27181f34a5c92; no voters: 
I20260709 13:02:44.822221 13623 raft_consensus.cc:2468] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79660023c1124b7e8da27181f34a5c92 in term 2.
I20260709 13:02:44.822562 14027 raft_consensus.cc:2804] T 973db6db1a614f46a8c51c49bbe2afcd P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:44.823083 14027 raft_consensus.cc:697] T 973db6db1a614f46a8c51c49bbe2afcd P 79660023c1124b7e8da27181f34a5c92 [term 2 LEADER]: Becoming Leader. State: Replica: 79660023c1124b7e8da27181f34a5c92, State: Running, Role: LEADER
I20260709 13:02:44.823958 14027 consensus_queue.cc:237] T 973db6db1a614f46a8c51c49bbe2afcd P 79660023c1124b7e8da27181f34a5c92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } }
I20260709 13:02:44.833420 13522 catalog_manager.cc:5697] T 973db6db1a614f46a8c51c49bbe2afcd P 79660023c1124b7e8da27181f34a5c92 reported cstate change: term changed from 1 to 2, leader changed from 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193) to 79660023c1124b7e8da27181f34a5c92 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "79660023c1124b7e8da27181f34a5c92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79660023c1124b7e8da27181f34a5c92" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43687 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.860908 13623 raft_consensus.cc:1275] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 3 FOLLOWER]: Refusing update from remote peer 79660023c1124b7e8da27181f34a5c92: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:44.862147 14027 consensus_queue.cc:1048] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:44.874642 13697 raft_consensus.cc:1275] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 3 FOLLOWER]: Refusing update from remote peer 79660023c1124b7e8da27181f34a5c92: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:44.876991 14027 consensus_queue.cc:1048] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:45.277117 13697 raft_consensus.cc:1275] T 973db6db1a614f46a8c51c49bbe2afcd P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Refusing update from remote peer 79660023c1124b7e8da27181f34a5c92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:45.278373 14000 consensus_queue.cc:1048] T 973db6db1a614f46a8c51c49bbe2afcd P 79660023c1124b7e8da27181f34a5c92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c82125d03ae4947ac9a79aebe4d8cf0" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 36901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:45.289574 13624 raft_consensus.cc:1275] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Refusing update from remote peer 79660023c1124b7e8da27181f34a5c92: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:45.291105 14083 consensus_queue.cc:1048] T 973db6db1a614f46a8c51c49bbe2afcd P 79660023c1124b7e8da27181f34a5c92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d1f3335b323406f8f1ad7a1e277cdc7" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 41087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:45.457731   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:02:45.481086   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:45.481791   431 tablet_replica.cc:333] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7: stopping tablet replica
I20260709 13:02:45.482443   431 raft_consensus.cc:2243] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.482960   431 raft_consensus.cc:2272] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.484961   431 tablet_replica.cc:333] T 10a905a175a44997948637602e0b015e P 3d1f3335b323406f8f1ad7a1e277cdc7: stopping tablet replica
I20260709 13:02:45.485555   431 raft_consensus.cc:2243] T 10a905a175a44997948637602e0b015e P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.485994   431 raft_consensus.cc:2272] T 10a905a175a44997948637602e0b015e P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.488034   431 tablet_replica.cc:333] T da7b8e9e2cd2438385b3cd4db2887674 P 3d1f3335b323406f8f1ad7a1e277cdc7: stopping tablet replica
I20260709 13:02:45.488632   431 raft_consensus.cc:2243] T da7b8e9e2cd2438385b3cd4db2887674 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.489399   431 raft_consensus.cc:2272] T da7b8e9e2cd2438385b3cd4db2887674 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.491257   431 tablet_replica.cc:333] T 94c5ee32461343ea8ed9720c6ae81482 P 3d1f3335b323406f8f1ad7a1e277cdc7: stopping tablet replica
I20260709 13:02:45.491809   431 raft_consensus.cc:2243] T 94c5ee32461343ea8ed9720c6ae81482 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.492223   431 raft_consensus.cc:2272] T 94c5ee32461343ea8ed9720c6ae81482 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.494029   431 tablet_replica.cc:333] T 9536c08be4d6442abdf27526c01de2e9 P 3d1f3335b323406f8f1ad7a1e277cdc7: stopping tablet replica
I20260709 13:02:45.494545   431 raft_consensus.cc:2243] T 9536c08be4d6442abdf27526c01de2e9 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.495262   431 raft_consensus.cc:2272] T 9536c08be4d6442abdf27526c01de2e9 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.497069   431 tablet_replica.cc:333] T 3ff553d020244a79a9313c1b5bfec8f3 P 3d1f3335b323406f8f1ad7a1e277cdc7: stopping tablet replica
I20260709 13:02:45.497574   431 raft_consensus.cc:2243] T 3ff553d020244a79a9313c1b5bfec8f3 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.497985   431 raft_consensus.cc:2272] T 3ff553d020244a79a9313c1b5bfec8f3 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.500161   431 tablet_replica.cc:333] T eb56f1ea81c24546bb53bb5763ccddc4 P 3d1f3335b323406f8f1ad7a1e277cdc7: stopping tablet replica
I20260709 13:02:45.500994   431 raft_consensus.cc:2243] T eb56f1ea81c24546bb53bb5763ccddc4 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.501610   431 raft_consensus.cc:2272] T eb56f1ea81c24546bb53bb5763ccddc4 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.504492   431 tablet_replica.cc:333] T 51f837ca6c9244cd9add3d210c307cb5 P 3d1f3335b323406f8f1ad7a1e277cdc7: stopping tablet replica
I20260709 13:02:45.505242   431 raft_consensus.cc:2243] T 51f837ca6c9244cd9add3d210c307cb5 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.505913   431 raft_consensus.cc:2272] T 51f837ca6c9244cd9add3d210c307cb5 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.507833   431 tablet_replica.cc:333] T 93f0a9b2a4014d229a766e13ae96be58 P 3d1f3335b323406f8f1ad7a1e277cdc7: stopping tablet replica
I20260709 13:02:45.508376   431 raft_consensus.cc:2243] T 93f0a9b2a4014d229a766e13ae96be58 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.508824   431 raft_consensus.cc:2272] T 93f0a9b2a4014d229a766e13ae96be58 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.510821   431 tablet_replica.cc:333] T 2177fcc303304952a036acbb82983fda P 3d1f3335b323406f8f1ad7a1e277cdc7: stopping tablet replica
I20260709 13:02:45.511304   431 raft_consensus.cc:2243] T 2177fcc303304952a036acbb82983fda P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.511662   431 raft_consensus.cc:2272] T 2177fcc303304952a036acbb82983fda P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.513659   431 tablet_replica.cc:333] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7: stopping tablet replica
I20260709 13:02:45.514168   431 raft_consensus.cc:2243] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.514873   431 raft_consensus.cc:2272] T b7206076e6c7492fb38ceed548977cd6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.516670   431 tablet_replica.cc:333] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7: stopping tablet replica
I20260709 13:02:45.517222   431 raft_consensus.cc:2243] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.518119   431 raft_consensus.cc:2272] T 45bd91d3220e4f1e972885415f1ce1ae P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.520618   431 tablet_replica.cc:333] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7: stopping tablet replica
I20260709 13:02:45.521390   431 raft_consensus.cc:2243] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.522464   431 raft_consensus.cc:2272] T 42a59bf8b7ad4c42931ad97808e91469 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.525326   431 tablet_replica.cc:333] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7: stopping tablet replica
I20260709 13:02:45.526160   431 raft_consensus.cc:2243] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.526714   431 raft_consensus.cc:2272] T 854f9710b117408cb32500bffcc2f500 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.529950   431 tablet_replica.cc:333] T 93b5051b31254e9189de01203c87bc4e P 3d1f3335b323406f8f1ad7a1e277cdc7: stopping tablet replica
I20260709 13:02:45.530761   431 raft_consensus.cc:2243] T 93b5051b31254e9189de01203c87bc4e P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.531338   431 raft_consensus.cc:2272] T 93b5051b31254e9189de01203c87bc4e P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.534299   431 tablet_replica.cc:333] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7: stopping tablet replica
I20260709 13:02:45.535157   431 raft_consensus.cc:2243] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.535810   431 raft_consensus.cc:2272] T 973db6db1a614f46a8c51c49bbe2afcd P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:45.536274 13667 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 13 similar messages]
I20260709 13:02:45.539589   431 tablet_replica.cc:333] T 4a63f82eddf641898443ae8c2a8b9b1c P 3d1f3335b323406f8f1ad7a1e277cdc7: stopping tablet replica
I20260709 13:02:45.540510   431 raft_consensus.cc:2243] T 4a63f82eddf641898443ae8c2a8b9b1c P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:02:45.541239 13667 consensus_peers.cc:597] T 51f837ca6c9244cd9add3d210c307cb5 P 3c82125d03ae4947ac9a79aebe4d8cf0 -> Peer 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087): Couldn't send request to peer 3d1f3335b323406f8f1ad7a1e277cdc7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:45.541826   431 raft_consensus.cc:2272] T 4a63f82eddf641898443ae8c2a8b9b1c P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.544960   431 tablet_replica.cc:333] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7: stopping tablet replica
I20260709 13:02:45.545614   431 raft_consensus.cc:2243] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.546660   431 raft_consensus.cc:2272] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3d1f3335b323406f8f1ad7a1e277cdc7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:45.564369 13667 consensus_peers.cc:597] T 94c5ee32461343ea8ed9720c6ae81482 P 3c82125d03ae4947ac9a79aebe4d8cf0 -> Peer 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087): Couldn't send request to peer 3d1f3335b323406f8f1ad7a1e277cdc7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:45.593361 13667 consensus_peers.cc:597] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0 -> Peer 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087): Couldn't send request to peer 3d1f3335b323406f8f1ad7a1e277cdc7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41087: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:45.594769   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:02:45.605341 13667 consensus_peers.cc:597] T 93f0a9b2a4014d229a766e13ae96be58 P 3c82125d03ae4947ac9a79aebe4d8cf0 -> Peer 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087): Couldn't send request to peer 3d1f3335b323406f8f1ad7a1e277cdc7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41087: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:45.627663   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:02:45.653446   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:45.654170   431 tablet_replica.cc:333] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3c82125d03ae4947ac9a79aebe4d8cf0: stopping tablet replica
I20260709 13:02:45.654951   431 raft_consensus.cc:2243] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.655931   431 raft_consensus.cc:2272] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.657804   431 tablet_replica.cc:333] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0: stopping tablet replica
I20260709 13:02:45.658352   431 raft_consensus.cc:2243] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.658818   431 raft_consensus.cc:2272] T 10a905a175a44997948637602e0b015e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.660619   431 tablet_replica.cc:333] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0: stopping tablet replica
I20260709 13:02:45.661119   431 raft_consensus.cc:2243] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.661499   431 raft_consensus.cc:2272] T b7206076e6c7492fb38ceed548977cd6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.663256   431 tablet_replica.cc:333] T 45bd91d3220e4f1e972885415f1ce1ae P 3c82125d03ae4947ac9a79aebe4d8cf0: stopping tablet replica
I20260709 13:02:45.663936   431 raft_consensus.cc:2243] T 45bd91d3220e4f1e972885415f1ce1ae P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.664433   431 raft_consensus.cc:2272] T 45bd91d3220e4f1e972885415f1ce1ae P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.666445   431 tablet_replica.cc:333] T 9536c08be4d6442abdf27526c01de2e9 P 3c82125d03ae4947ac9a79aebe4d8cf0: stopping tablet replica
I20260709 13:02:45.667016   431 raft_consensus.cc:2243] T 9536c08be4d6442abdf27526c01de2e9 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.667454   431 raft_consensus.cc:2272] T 9536c08be4d6442abdf27526c01de2e9 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.669338   431 tablet_replica.cc:333] T 94c5ee32461343ea8ed9720c6ae81482 P 3c82125d03ae4947ac9a79aebe4d8cf0: stopping tablet replica
I20260709 13:02:45.669865   431 raft_consensus.cc:2243] T 94c5ee32461343ea8ed9720c6ae81482 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.670593   431 raft_consensus.cc:2272] T 94c5ee32461343ea8ed9720c6ae81482 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.672299   431 tablet_replica.cc:333] T da7b8e9e2cd2438385b3cd4db2887674 P 3c82125d03ae4947ac9a79aebe4d8cf0: stopping tablet replica
I20260709 13:02:45.672848   431 raft_consensus.cc:2243] T da7b8e9e2cd2438385b3cd4db2887674 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.673247   431 raft_consensus.cc:2272] T da7b8e9e2cd2438385b3cd4db2887674 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.674962   431 tablet_replica.cc:333] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3c82125d03ae4947ac9a79aebe4d8cf0: stopping tablet replica
I20260709 13:02:45.675473   431 raft_consensus.cc:2243] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.675938   431 raft_consensus.cc:2272] T 0ba8cd98760e4f269f64ee27c6a368e6 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.677911   431 tablet_replica.cc:333] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0: stopping tablet replica
I20260709 13:02:45.678460   431 raft_consensus.cc:2243] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.678862   431 raft_consensus.cc:2272] T 854f9710b117408cb32500bffcc2f500 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.681314   431 tablet_replica.cc:333] T 42a59bf8b7ad4c42931ad97808e91469 P 3c82125d03ae4947ac9a79aebe4d8cf0: stopping tablet replica
I20260709 13:02:45.681912   431 raft_consensus.cc:2243] T 42a59bf8b7ad4c42931ad97808e91469 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.682355   431 raft_consensus.cc:2272] T 42a59bf8b7ad4c42931ad97808e91469 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.684298   431 tablet_replica.cc:333] T 51f837ca6c9244cd9add3d210c307cb5 P 3c82125d03ae4947ac9a79aebe4d8cf0: stopping tablet replica
I20260709 13:02:45.684836   431 raft_consensus.cc:2243] T 51f837ca6c9244cd9add3d210c307cb5 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.685596   431 raft_consensus.cc:2272] T 51f837ca6c9244cd9add3d210c307cb5 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.687466   431 tablet_replica.cc:333] T 93f0a9b2a4014d229a766e13ae96be58 P 3c82125d03ae4947ac9a79aebe4d8cf0: stopping tablet replica
I20260709 13:02:45.688006   431 raft_consensus.cc:2243] T 93f0a9b2a4014d229a766e13ae96be58 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.688750   431 raft_consensus.cc:2272] T 93f0a9b2a4014d229a766e13ae96be58 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.691006   431 tablet_replica.cc:333] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0: stopping tablet replica
I20260709 13:02:45.691800   431 raft_consensus.cc:2243] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.692718   431 raft_consensus.cc:2272] T 2177fcc303304952a036acbb82983fda P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.695233   431 tablet_replica.cc:333] T 4a63f82eddf641898443ae8c2a8b9b1c P 3c82125d03ae4947ac9a79aebe4d8cf0: stopping tablet replica
W20260709 13:02:45.695497 13741 consensus_peers.cc:597] T eb56f1ea81c24546bb53bb5763ccddc4 P 79660023c1124b7e8da27181f34a5c92 -> Peer 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087): Couldn't send request to peer 3d1f3335b323406f8f1ad7a1e277cdc7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41087: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:45.695940   431 raft_consensus.cc:2243] T 4a63f82eddf641898443ae8c2a8b9b1c P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.696460   431 raft_consensus.cc:2272] T 4a63f82eddf641898443ae8c2a8b9b1c P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.698438   431 tablet_replica.cc:333] T 973db6db1a614f46a8c51c49bbe2afcd P 3c82125d03ae4947ac9a79aebe4d8cf0: stopping tablet replica
I20260709 13:02:45.698959   431 raft_consensus.cc:2243] T 973db6db1a614f46a8c51c49bbe2afcd P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.699335   431 raft_consensus.cc:2272] T 973db6db1a614f46a8c51c49bbe2afcd P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.701859   431 tablet_replica.cc:333] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0: stopping tablet replica
I20260709 13:02:45.702368   431 raft_consensus.cc:2243] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.703203   431 raft_consensus.cc:2272] T 93b5051b31254e9189de01203c87bc4e P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.705929   431 tablet_replica.cc:333] T 3ff553d020244a79a9313c1b5bfec8f3 P 3c82125d03ae4947ac9a79aebe4d8cf0: stopping tablet replica
I20260709 13:02:45.706888   431 raft_consensus.cc:2243] T 3ff553d020244a79a9313c1b5bfec8f3 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.707825   431 raft_consensus.cc:2272] T 3ff553d020244a79a9313c1b5bfec8f3 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:45.709086 13741 consensus_peers.cc:597] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92 -> Peer 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087): Couldn't send request to peer 3d1f3335b323406f8f1ad7a1e277cdc7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41087: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:45.710058   431 tablet_replica.cc:333] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0: stopping tablet replica
I20260709 13:02:45.710646   431 raft_consensus.cc:2243] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.711134   431 raft_consensus.cc:2272] T eb56f1ea81c24546bb53bb5763ccddc4 P 3c82125d03ae4947ac9a79aebe4d8cf0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.749184   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:02:45.780865   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:02:45.804944   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:45.805650   431 tablet_replica.cc:333] T b7206076e6c7492fb38ceed548977cd6 P 79660023c1124b7e8da27181f34a5c92: stopping tablet replica
I20260709 13:02:45.806236   431 raft_consensus.cc:2243] T b7206076e6c7492fb38ceed548977cd6 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.806737   431 raft_consensus.cc:2272] T b7206076e6c7492fb38ceed548977cd6 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.808714   431 tablet_replica.cc:333] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92: stopping tablet replica
I20260709 13:02:45.809293   431 raft_consensus.cc:2243] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.810063   431 raft_consensus.cc:2272] T 10a905a175a44997948637602e0b015e P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.811885   431 tablet_replica.cc:333] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 79660023c1124b7e8da27181f34a5c92: stopping tablet replica
I20260709 13:02:45.812392   431 raft_consensus.cc:2243] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.812868   431 raft_consensus.cc:2272] T 8e0d0d36fd19492ca51a47c34fdb2b64 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.814580   431 tablet_replica.cc:333] T 3ff553d020244a79a9313c1b5bfec8f3 P 79660023c1124b7e8da27181f34a5c92: stopping tablet replica
I20260709 13:02:45.815090   431 raft_consensus.cc:2243] T 3ff553d020244a79a9313c1b5bfec8f3 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.815495   431 raft_consensus.cc:2272] T 3ff553d020244a79a9313c1b5bfec8f3 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.817308   431 tablet_replica.cc:333] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92: stopping tablet replica
I20260709 13:02:45.817878   431 raft_consensus.cc:2243] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.818295   431 raft_consensus.cc:2272] T 94c5ee32461343ea8ed9720c6ae81482 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.820013   431 tablet_replica.cc:333] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92: stopping tablet replica
I20260709 13:02:45.820540   431 raft_consensus.cc:2243] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.820955   431 raft_consensus.cc:2272] T da7b8e9e2cd2438385b3cd4db2887674 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.822642   431 tablet_replica.cc:333] T 9536c08be4d6442abdf27526c01de2e9 P 79660023c1124b7e8da27181f34a5c92: stopping tablet replica
I20260709 13:02:45.823215   431 raft_consensus.cc:2243] T 9536c08be4d6442abdf27526c01de2e9 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.823629   431 raft_consensus.cc:2272] T 9536c08be4d6442abdf27526c01de2e9 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.825500   431 tablet_replica.cc:333] T 45bd91d3220e4f1e972885415f1ce1ae P 79660023c1124b7e8da27181f34a5c92: stopping tablet replica
I20260709 13:02:45.826087   431 raft_consensus.cc:2243] T 45bd91d3220e4f1e972885415f1ce1ae P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.826485   431 raft_consensus.cc:2272] T 45bd91d3220e4f1e972885415f1ce1ae P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.828258   431 tablet_replica.cc:333] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92: stopping tablet replica
I20260709 13:02:45.828796   431 raft_consensus.cc:2243] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.829188   431 raft_consensus.cc:2272] T 51f837ca6c9244cd9add3d210c307cb5 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.830912   431 tablet_replica.cc:333] T 2177fcc303304952a036acbb82983fda P 79660023c1124b7e8da27181f34a5c92: stopping tablet replica
I20260709 13:02:45.831423   431 raft_consensus.cc:2243] T 2177fcc303304952a036acbb82983fda P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.831845   431 raft_consensus.cc:2272] T 2177fcc303304952a036acbb82983fda P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.833822   431 tablet_replica.cc:333] T 93f0a9b2a4014d229a766e13ae96be58 P 79660023c1124b7e8da27181f34a5c92: stopping tablet replica
I20260709 13:02:45.834374   431 raft_consensus.cc:2243] T 93f0a9b2a4014d229a766e13ae96be58 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.834821   431 raft_consensus.cc:2272] T 93f0a9b2a4014d229a766e13ae96be58 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.837051   431 tablet_replica.cc:333] T eb56f1ea81c24546bb53bb5763ccddc4 P 79660023c1124b7e8da27181f34a5c92: stopping tablet replica
I20260709 13:02:45.837615   431 raft_consensus.cc:2243] T eb56f1ea81c24546bb53bb5763ccddc4 P 79660023c1124b7e8da27181f34a5c92 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.838454   431 raft_consensus.cc:2272] T eb56f1ea81c24546bb53bb5763ccddc4 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:45.839414 13741 consensus_peers.cc:597] T 973db6db1a614f46a8c51c49bbe2afcd P 79660023c1124b7e8da27181f34a5c92 -> Peer 3d1f3335b323406f8f1ad7a1e277cdc7 (127.0.107.193:41087): Couldn't send request to peer 3d1f3335b323406f8f1ad7a1e277cdc7. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:41087: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:45.840560   431 tablet_replica.cc:333] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92: stopping tablet replica
I20260709 13:02:45.841245   431 raft_consensus.cc:2243] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.841729   431 raft_consensus.cc:2272] T 4a63f82eddf641898443ae8c2a8b9b1c P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.844012   431 tablet_replica.cc:333] T 973db6db1a614f46a8c51c49bbe2afcd P 79660023c1124b7e8da27181f34a5c92: stopping tablet replica
I20260709 13:02:45.844645   431 raft_consensus.cc:2243] T 973db6db1a614f46a8c51c49bbe2afcd P 79660023c1124b7e8da27181f34a5c92 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.845448   431 raft_consensus.cc:2272] T 973db6db1a614f46a8c51c49bbe2afcd P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.847797   431 tablet_replica.cc:333] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92: stopping tablet replica
I20260709 13:02:45.848317   431 raft_consensus.cc:2243] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.848819   431 raft_consensus.cc:2272] T 93b5051b31254e9189de01203c87bc4e P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.850914   431 tablet_replica.cc:333] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92: stopping tablet replica
I20260709 13:02:45.851387   431 raft_consensus.cc:2243] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.852142   431 raft_consensus.cc:2272] T 854f9710b117408cb32500bffcc2f500 P 79660023c1124b7e8da27181f34a5c92 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.854413   431 tablet_replica.cc:333] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92: stopping tablet replica
I20260709 13:02:45.854954   431 raft_consensus.cc:2243] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.855387   431 raft_consensus.cc:2272] T 42a59bf8b7ad4c42931ad97808e91469 P 79660023c1124b7e8da27181f34a5c92 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.857342   431 tablet_replica.cc:333] T 0ba8cd98760e4f269f64ee27c6a368e6 P 79660023c1124b7e8da27181f34a5c92: stopping tablet replica
I20260709 13:02:45.857790   431 raft_consensus.cc:2243] T 0ba8cd98760e4f269f64ee27c6a368e6 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.858184   431 raft_consensus.cc:2272] T 0ba8cd98760e4f269f64ee27c6a368e6 P 79660023c1124b7e8da27181f34a5c92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.895907   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:02:45.924594   431 master.cc:562] Master@127.0.107.254:37559 shutting down...
I20260709 13:02:45.943185   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 94f6ec2862e4400a8203b964a86f9869 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.943722   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 94f6ec2862e4400a8203b964a86f9869 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.944031   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 94f6ec2862e4400a8203b964a86f9869: stopping tablet replica
I20260709 13:02:45.963982   431 master.cc:584] Master@127.0.107.254:37559 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11805 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (23849 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (379441 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:02:46.015280   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 423 messages since previous log ~567 seconds ago
I20260709 13:02:46.015516   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 423 messages since previous log ~567 seconds ago
I20260709 13:02:46.015692   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 417 messages since previous log ~567 seconds ago
I20260709 13:02:46.015861   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~32 seconds ago
I20260709 13:02:46.016135   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~32 seconds ago
I20260709 13:02:46.016422   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 6 messages since previous log ~150 seconds ago
I20260709 13:02:46.016750   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 6 messages since previous log ~0 seconds ago
I20260709 13:02:46.016938   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~6 seconds ago
